2024-09-19T09:00:49.888 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:00:49.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:00:50.020 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911895' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGsHKqAlpxQXCyWKth+ZSVtYMt8HkqFhlzBR9iZAQhwbeiy+Jxv0wbiEfZFQcWDbMvME9HVT3Qpmmwkv/+obC/A= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS1Zh6IVsORSwuhsgLCQHnVbUfVE9/5CLBE0HTApJ8tqgJgBZlr4NOAD698578r2gK6jeAIy1y10tEacS6b0zw= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvNdx8tQFVlXo3CoR484bdg8Yf32ObzA8nWzt1hoEus05VJyJpI3F/SCFU7xVR/+vOteMHnWqQCfI0IvJ5qmQA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:00:50.021 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:00:50.021 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:00:50.022 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:00:50.023 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:00:50.048 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:00:50.048 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:00:50.049 INFO:teuthology.packaging:ref: None 2024-09-19T09:00:50.049 INFO:teuthology.packaging:tag: None 2024-09-19T09:00:50.049 INFO:teuthology.packaging:branch: squid 2024-09-19T09:00:50.049 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:00:50.049 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:00:50.263 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:00:50.264 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:00:50.270 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:00:50.270 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:00:50.320 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:00:50.342 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:00:50.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:00:50.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:55:45.649655', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGsHKqAlpxQXCyWKth+ZSVtYMt8HkqFhlzBR9iZAQhwbeiy+Jxv0wbiEfZFQcWDbMvME9HVT3Qpmmwkv/+obC/A='} 2024-09-19T09:00:50.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:55:45.651228', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIS1Zh6IVsORSwuhsgLCQHnVbUfVE9/5CLBE0HTApJ8tqgJgBZlr4NOAD698578r2gK6jeAIy1y10tEacS6b0zw='} 2024-09-19T09:00:50.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:55:45.652611', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDvNdx8tQFVlXo3CoR484bdg8Yf32ObzA8nWzt1hoEus05VJyJpI3F/SCFU7xVR/+vOteMHnWqQCfI0IvJ5qmQA='} 2024-09-19T09:00:50.432 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:00:50.438 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T09:00:50.438 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T09:00:50.438 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T09:00:50.438 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:00:50.537 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f479e343490>, signals=[15]) 2024-09-19T09:00:50.538 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:00:50.543 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:00:50.544 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:00:50.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:00:50.624 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T09:00:50.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:00:50.705 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T09:00:50.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:00:50.779 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:00:50.785 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-19T09:00:50.803 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-19T09:00:50.804 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-19T09:00:50.861 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:00:50.862 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:00:50.863 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:00:50.863 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:00:50.863 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-19T09:00:50.886 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-19T09:00:50.904 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-19T09:00:50.904 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-09-19T09:00:50.962 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:00:50.963 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:00:50.963 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-19T09:00:50.986 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-09-19T09:00:51.004 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-09-19T09:00:51.005 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-09-19T09:00:51.065 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-09-19T09:00:51.065 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-09-19T09:00:51.065 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:00:51.066 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:00:51.067 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-09-19T09:00:51.086 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:00:51.096 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:00:51.121 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:00:51.121 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:00:51.123 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:00:51.126 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:00:51.143 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:00:51.150 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:00:51.150 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:00:51.181 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:00:51.183 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:00:51.300 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:00:51.376 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:00:51.391 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:00:51.391 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T09:00:51.392 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:00:51.392 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:00:51.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:00:51.409 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-19T09:00:51.467 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:00:51.467 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-503.el9.x86_64 2024-09-19T09:00:51.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-09-19T09:00:55.742 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.3 MB 00:02 2024-09-19T09:00:57.535 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T09:01:01.945 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T09:01:03.471 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-19T09:01:04.591 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T09:01:10.297 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T09:01:12.362 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:01:12.362 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:01:12.465 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:01:12.484 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:01:12.485 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-19T09:01:12.485 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-19T09:01:12.485 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2024-09-19T09:01:12.485 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:01:12.485 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 79 M 2024-09-19T09:01:12.486 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 126 M 2024-09-19T09:01:12.486 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-19T09:01:12.740 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 285 kB/s | 36 kB 00:00 2024-09-19T09:01:17.298 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-19T09:01:25.898 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-19T09:01:28.490 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:15 2024-09-19T09:01:28.490 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:01:28.490 INFO:teuthology.orchestra.run.smithi052.stdout:Total 4.9 MB/s | 79 MB 00:16 2024-09-19T09:01:29.195 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-19T09:01:29.570 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-19T09:01:29.570 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-19T09:01:30.527 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-19T09:01:30.528 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-19T09:01:33.083 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-19T09:01:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:01:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:01:36.582 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:01:36.711 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:01:41.839 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:01:41.878 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:01:47.020 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:02:25.692 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:02:25.735 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:02:26.045 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:02:26.937 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:02:26.937 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:02:26.937 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-19T09:02:26.937 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:02:26.938 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:02:26.938 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:02:26.938 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:02:26.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:02:26.938 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-19T09:02:27.309 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:02:27.384 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:02:27.384 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:02:27.385 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:02:27.385 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:02:27.385 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:02:27.385 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:02:27.385 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:02:27.385 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:02:27.444 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:02:27.445 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:02:27.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo rpm -qi grub2-tools 2024-09-19T09:02:27.487 INFO:teuthology.orchestra.run.smithi052.stdout:Name : grub2-tools 2024-09-19T09:02:27.488 INFO:teuthology.orchestra.run.smithi052.stdout:Epoch : 1 2024-09-19T09:02:27.488 INFO:teuthology.orchestra.run.smithi052.stdout:Version : 2.06 2024-09-19T09:02:27.488 INFO:teuthology.orchestra.run.smithi052.stdout:Release : 82.el9 2024-09-19T09:02:27.488 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: x86_64 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Group : Unspecified 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Size : 8274670 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:License : GPLv3+ 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:02:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:Packager : builder@centos.org 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:Vendor : CentOS 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:Summary : Support tools for GRUB. 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:Description : 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:02:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:02:27.491 INFO:teuthology.orchestra.run.smithi052.stdout:hardware devices. 2024-09-19T09:02:27.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:02:27.491 INFO:teuthology.orchestra.run.smithi052.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:02:27.494 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:02:27.494 INFO:teuthology.task.kernel:Updating grub on smithi052 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:02:27.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:02:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-19T09:02:29.370 INFO:teuthology.orchestra.run.smithi052.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:02:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-19T09:02:29.398 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-19T09:02:29.442 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.RaHKqLNP0B 2024-09-19T09:02:29.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RaHKqLNP0B 2024-09-19T09:02:29.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.RaHKqLNP0B 2024-09-19T09:02:29.612 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.RaHKqLNP0B is 6KB 2024-09-19T09:02:29.661 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.RaHKqLNP0B 2024-09-19T09:02:29.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:02:29.738 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:02:29.738 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:02:29.738 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:02:29.738 INFO:teuthology.orchestra.run.smithi052.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:02:29.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:02:30.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-19T09:03:00.017 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:03:00.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:03:00.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:03:18.589 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-09-19T09:03:27.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:03:27.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:04:27.594 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T09:04:39.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:04:39.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:04:39.947 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-19T09:04:40.315 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:04:40.316 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:04:40.316 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-19T09:04:40.333 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:04:40.334 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:04:40.334 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:04:40.334 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:04:41.335 DEBUG:teuthology.parallel:result is None 2024-09-19T09:04:41.335 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:04:41.342 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:04:41.343 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:04:41.345 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:04:41.348 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:04:41.367 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:04:41.373 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:04:41.407 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:04:41.407 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:04:41.410 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:04:41.412 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:04:41.487 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:04:41.493 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:04:41.493 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:04:41.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:41.511 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:04:41.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:41.529 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:04:41.532 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:04:41.554 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:04:41.621 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.625 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.635 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.636 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.642 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.652 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:04:41.654 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:04:41.661 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:04:41.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:04:41.664 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:04:41.666 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:04:41.694 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:04:41.726 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:04:41.726 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:04:41.734 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:04:41.736 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:04:41.753 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:41.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:41.885 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:41.968 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:42.011 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:04:42.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:04:42.079 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:42.124 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:42.187 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:42.231 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:42.276 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:04:42.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:04:42.345 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:42.391 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:04:42.453 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:42.496 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:04:42.541 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:04:42.541 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:04:42.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-19T09:04:42.610 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-19T09:04:42.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-09-19T09:04:42.650 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:04:42.658 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:04:42.681 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:04:43.048 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:04:43.057 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:04:43.057 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:04:43.111 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:04:43.143 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:04:43.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-19T09:04:43.211 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-19T09:04:43.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-09-19T09:04:43.278 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-09-19T09:04:43.280 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-09-19T09:04:43.329 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-09-19T09:04:43.331 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:04:43.331 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-19T09:04:43.361 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-19T09:04:43.361 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-09-19T09:04:43.399 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-09-19T09:04:43.399 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-09-19T09:04:43.421 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-09-19T09:04:43.421 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:04:43.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:04:43.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:43.453 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:04:43.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:43.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:04:43.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:43.511 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:04:43.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:04:43.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:04:43.594 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:04:43.635 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:04:43.644 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T09:04:43.647 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T09:04:43.758 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:04:43.770 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:04:43.771 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi086.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:08:46.841 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-09-19T09:08:46.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:08:46.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:08:46.925 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-19T09:08:47.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-19T09:08:47.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T09:08:47.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:08:47.092 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-19T09:08:47.176 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-19T09:08:47.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T09:08:47.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:08:47.250 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-09-19T09:08:47.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-09-19T09:08:47.330 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:08:47.340 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:08:47.340 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:08:47.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:08:47.343 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:08:47.343 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:08:47.345 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:08:47.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:08:47.373 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:08:47.374 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:08:47.387 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:08:47.392 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:08:47.401 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:08:47.413 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-09-19T09:08:47.416 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:08:47.417 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-19T09:08:47.425 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-09-19T09:08:47.429 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-19T09:08:47.440 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:08:47.441 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-09-19T09:08:47.444 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:08:47.453 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-09-19T09:08:47.454 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:08:47.460 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:08:47.467 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:08:47.481 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:08:47.516 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:08:47.517 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:08:47.519 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:08:47.520 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-19T09:08:47.520 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.520 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.520 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.520 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.522 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.533 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.537 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:08:47.538 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:08:47.546 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:08:47.546 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:08:47.546 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:08:47.546 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:08:47.552 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:08:47.552 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:08:47.553 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:08:47.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:47.556 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:08:47.556 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:47.557 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:08:47.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:47.695 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:08:47.695 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:08:47.707 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:08:47.707 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:08:47.710 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:08:47.710 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:08:47.805 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:08:47.805 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:08:47.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:08:47.815 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:08:47.816 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:08:47.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:08:47.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:08:47.825 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:08:47.825 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:08:47.832 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:08:47.832 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:08:47.842 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:08:47.843 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:08:47.851 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:08:47.851 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:08:47.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:08:47.909 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:08:47.917 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:08:47.976 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:08:47.985 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:08:47.992 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:08:48.041 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-19T09:08:48.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-19T09:08:48.049 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-09-19T09:08:48.051 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-09-19T09:08:48.056 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-09-19T09:08:48.058 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-09-19T09:08:48.278 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-09-19T09:08:48.282 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-09-19T09:08:48.299 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-19T09:08:48.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:08:48.308 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:08:48.326 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:08:48.855 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-19T09:08:48.856 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-19T09:08:48.892 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T09:08:49.138 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:08:49.175 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:08:49.382 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-19T09:08:49.424 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-19T09:08:49.443 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T09:08:49.889 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-19T09:08:50.741 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.3 MB 00:01 2024-09-19T09:08:51.992 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-19T09:08:53.718 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-19T09:08:55.359 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-19T09:08:55.682 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-19T09:08:58.111 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T09:08:59.628 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-19T09:08:59.974 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T09:09:00.482 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T09:09:00.984 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-19T09:09:01.450 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-19T09:09:02.354 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T09:09:02.468 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-19T09:09:03.398 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T09:09:05.980 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T09:09:07.727 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-19T09:09:08.249 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:08.250 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:08.262 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:09:08.262 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:09:08.263 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:09:08.264 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:09:08.266 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:09:08.268 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:09:08.269 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:09:08.335 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-19T09:09:08.351 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-19T09:09:08.351 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-19T09:09:08.351 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:09:08.352 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:09:08.353 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:09:08.354 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-19T09:09:08.355 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:09:08.356 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:09:08.357 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:09:08.358 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:09:08.359 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:09:08.360 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:09:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:09:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:09:08.363 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:09:08.364 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout:Install 148 Packages 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 8 Packages 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 226 M 2024-09-19T09:09:08.365 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-19T09:09:08.820 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-19T09:09:09.098 INFO:teuthology.orchestra.run.smithi052.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T09:09:09.332 INFO:teuthology.orchestra.run.smithi052.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-19T09:09:09.457 INFO:teuthology.orchestra.run.smithi052.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T09:09:09.482 INFO:teuthology.orchestra.run.smithi052.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 967 kB/s | 145 kB 00:00 2024-09-19T09:09:09.574 INFO:teuthology.orchestra.run.smithi052.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-19T09:09:09.641 INFO:teuthology.orchestra.run.smithi052.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 9.6 MB/s | 1.5 MB 00:00 2024-09-19T09:09:09.853 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:09.854 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:09.865 INFO:teuthology.orchestra.run.smithi086.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:09:09.866 INFO:teuthology.orchestra.run.smithi086.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:09:09.866 INFO:teuthology.orchestra.run.smithi086.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:09:09.867 INFO:teuthology.orchestra.run.smithi086.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:09:09.869 INFO:teuthology.orchestra.run.smithi086.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:09:09.871 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:09:09.872 INFO:teuthology.orchestra.run.smithi086.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:09:09.934 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-19T09:09:09.941 INFO:teuthology.orchestra.run.smithi052.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-19T09:09:09.953 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T09:09:09.956 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-19T09:09:09.957 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T09:09:09.957 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-19T09:09:09.957 INFO:teuthology.orchestra.run.smithi086.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:09:09.957 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:09:09.957 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:09:09.958 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:09:09.959 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:09:09.960 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:09:09.961 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:09:09.962 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:09:09.963 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:09:09.964 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:09:09.965 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:09:09.966 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:09:09.967 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:09:09.968 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:09:09.969 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout:Install 148 Packages 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 8 Packages 2024-09-19T09:09:09.970 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:09.971 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 226 M 2024-09-19T09:09:09.971 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-19T09:09:10.208 INFO:teuthology.orchestra.run.smithi052.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T09:09:10.258 INFO:teuthology.orchestra.run.smithi052.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 505 kB/s | 25 kB 00:00 2024-09-19T09:09:10.628 INFO:teuthology.orchestra.run.smithi086.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 33 kB/s | 6.6 kB 00:00 2024-09-19T09:09:10.675 INFO:teuthology.orchestra.run.smithi052.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 14 MB/s | 11 MB 00:00 2024-09-19T09:09:10.867 INFO:teuthology.orchestra.run.smithi052.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T09:09:10.892 INFO:teuthology.orchestra.run.smithi052.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.0 MB/s | 228 kB 00:00 2024-09-19T09:09:10.911 INFO:teuthology.orchestra.run.smithi086.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.1 MB/s | 896 kB 00:00 2024-09-19T09:09:10.942 INFO:teuthology.orchestra.run.smithi052.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 362 kB/s | 27 kB 00:00 2024-09-19T09:09:10.968 INFO:teuthology.orchestra.run.smithi052.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 422 kB/s | 32 kB 00:00 2024-09-19T09:09:10.973 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:10.974 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:09:10.985 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:09:10.986 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:09:10.986 INFO:teuthology.orchestra.run.smithi086.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.7 MB/s | 5.4 MB 00:00 2024-09-19T09:09:10.987 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:09:10.988 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:09:10.990 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:09:10.993 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:09:10.993 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:09:11.012 INFO:teuthology.orchestra.run.smithi086.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T09:09:11.043 INFO:teuthology.orchestra.run.smithi052.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T09:09:11.057 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-09-19T09:09:11.068 INFO:teuthology.orchestra.run.smithi052.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:09:11.078 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:09:11.079 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:09:11.080 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:09:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:09:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:09:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:09:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:09:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:09:11.085 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:09:11.086 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:09:11.087 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:09:11.088 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:09:11.089 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:09:11.090 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:09:11.091 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:09:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:09:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:09:11.092 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-09-19T09:09:11.093 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout:====================================================================================== 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout:Install 148 Packages 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 8 Packages 2024-09-19T09:09:11.094 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:09:11.095 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 226 M 2024-09-19T09:09:11.095 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-09-19T09:09:11.152 INFO:teuthology.orchestra.run.smithi052.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.1 MB/s | 127 kB 00:00 2024-09-19T09:09:11.177 INFO:teuthology.orchestra.run.smithi052.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.6 MB/s | 506 kB 00:00 2024-09-19T09:09:11.286 INFO:teuthology.orchestra.run.smithi052.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 417 kB/s | 45 kB 00:00 2024-09-19T09:09:11.371 INFO:teuthology.orchestra.run.smithi086.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.2 MB/s | 1.5 MB 00:00 2024-09-19T09:09:11.386 INFO:teuthology.orchestra.run.smithi052.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T09:09:11.469 INFO:teuthology.orchestra.run.smithi052.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T09:09:11.545 INFO:teuthology.orchestra.run.smithi052.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T09:09:11.570 INFO:teuthology.orchestra.run.smithi052.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T09:09:11.571 INFO:teuthology.orchestra.run.smithi086.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 2.4 MB 00:00 2024-09-19T09:09:11.603 INFO:teuthology.orchestra.run.smithi052.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T09:09:11.637 INFO:teuthology.orchestra.run.smithi052.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 99 kB 00:00 2024-09-19T09:09:11.704 INFO:teuthology.orchestra.run.smithi052.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 848 kB/s | 85 kB 00:00 2024-09-19T09:09:11.771 INFO:teuthology.orchestra.run.smithi052.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T09:09:11.822 INFO:teuthology.orchestra.run.smithi169.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 22 kB/s | 6.6 kB 00:00 2024-09-19T09:09:11.846 INFO:teuthology.orchestra.run.smithi086.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 15 MB/s | 21 MB 00:01 2024-09-19T09:09:11.872 INFO:teuthology.orchestra.run.smithi052.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-19T09:09:11.897 INFO:teuthology.orchestra.run.smithi052.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 254 kB/s | 32 kB 00:00 2024-09-19T09:09:11.930 INFO:teuthology.orchestra.run.smithi086.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 8.4 MB/s | 4.7 MB 00:00 2024-09-19T09:09:11.955 INFO:teuthology.orchestra.run.smithi052.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T09:09:12.038 INFO:teuthology.orchestra.run.smithi086.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 233 kB/s | 25 kB 00:00 2024-09-19T09:09:12.256 INFO:teuthology.orchestra.run.smithi052.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.9 MB/s | 3.6 MB 00:00 2024-09-19T09:09:12.356 INFO:teuthology.orchestra.run.smithi052.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T09:09:12.473 INFO:teuthology.orchestra.run.smithi052.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 423 kB/s | 49 kB 00:00 2024-09-19T09:09:12.573 INFO:teuthology.orchestra.run.smithi052.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 165 kB/s | 16 kB 00:00 2024-09-19T09:09:12.630 INFO:teuthology.orchestra.run.smithi086.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 14 MB/s | 11 MB 00:00 2024-09-19T09:09:12.673 INFO:teuthology.orchestra.run.smithi052.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.8 MB/s | 285 kB 00:00 2024-09-19T09:09:12.940 INFO:teuthology.orchestra.run.smithi052.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 7.5 MB/s | 7.4 MB 00:00 2024-09-19T09:09:12.999 INFO:teuthology.orchestra.run.smithi052.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 315 kB/s | 18 kB 00:00 2024-09-19T09:09:13.022 INFO:teuthology.orchestra.run.smithi086.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T09:09:13.072 INFO:teuthology.orchestra.run.smithi086.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 544 kB/s | 27 kB 00:00 2024-09-19T09:09:13.097 INFO:teuthology.orchestra.run.smithi086.stdout:(13/156): cephfs-mirror-19.1.1-361.g2f599a46.el 488 kB/s | 228 kB 00:00 2024-09-19T09:09:13.123 INFO:teuthology.orchestra.run.smithi086.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 631 kB/s | 32 kB 00:00 2024-09-19T09:09:13.149 INFO:teuthology.orchestra.run.smithi052.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.6 MB/s | 765 kB 00:00 2024-09-19T09:09:13.171 INFO:teuthology.orchestra.run.smithi169.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 664 kB/s | 896 kB 00:01 2024-09-19T09:09:13.181 INFO:teuthology.orchestra.run.smithi086.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T09:09:13.206 INFO:teuthology.orchestra.run.smithi086.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T09:09:13.232 INFO:teuthology.orchestra.run.smithi086.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:09:13.274 INFO:teuthology.orchestra.run.smithi086.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T09:09:13.297 INFO:teuthology.orchestra.run.smithi169.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T09:09:13.332 INFO:teuthology.orchestra.run.smithi086.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 775 kB/s | 45 kB 00:00 2024-09-19T09:09:13.391 INFO:teuthology.orchestra.run.smithi086.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T09:09:13.449 INFO:teuthology.orchestra.run.smithi086.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T09:09:13.533 INFO:teuthology.orchestra.run.smithi086.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.7 MB/s | 320 kB 00:00 2024-09-19T09:09:13.600 INFO:teuthology.orchestra.run.smithi086.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T09:09:13.625 INFO:teuthology.orchestra.run.smithi086.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.2 MB/s | 300 kB 00:00 2024-09-19T09:09:13.650 INFO:teuthology.orchestra.run.smithi052.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-19T09:09:13.651 INFO:teuthology.orchestra.run.smithi086.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:09:13.676 INFO:teuthology.orchestra.run.smithi086.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:09:13.735 INFO:teuthology.orchestra.run.smithi086.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T09:09:13.793 INFO:teuthology.orchestra.run.smithi086.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 545 kB/s | 32 kB 00:00 2024-09-19T09:09:13.877 INFO:teuthology.orchestra.run.smithi086.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T09:09:13.902 INFO:teuthology.orchestra.run.smithi086.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.3 MB/s | 146 kB 00:00 2024-09-19T09:09:14.033 INFO:teuthology.orchestra.run.smithi052.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 907 kB/s | 801 kB 00:00 2024-09-19T09:09:14.136 INFO:teuthology.orchestra.run.smithi086.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T09:09:14.194 INFO:teuthology.orchestra.run.smithi086.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T09:09:14.253 INFO:teuthology.orchestra.run.smithi086.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 848 kB/s | 49 kB 00:00 2024-09-19T09:09:14.272 INFO:teuthology.orchestra.run.smithi169.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.0 MB/s | 5.4 MB 00:02 2024-09-19T09:09:14.312 INFO:teuthology.orchestra.run.smithi086.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 282 kB/s | 16 kB 00:00 2024-09-19T09:09:14.412 INFO:teuthology.orchestra.run.smithi086.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-19T09:09:14.437 INFO:teuthology.orchestra.run.smithi086.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 285 kB 00:00 2024-09-19T09:09:14.456 INFO:teuthology.orchestra.run.smithi169.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.1 MB/s | 2.4 MB 00:01 2024-09-19T09:09:14.487 INFO:teuthology.orchestra.run.smithi086.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 366 kB/s | 18 kB 00:00 2024-09-19T09:09:14.513 INFO:teuthology.orchestra.run.smithi086.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-19T09:09:14.534 INFO:teuthology.orchestra.run.smithi052.stdout:(41/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T09:09:14.596 INFO:teuthology.orchestra.run.smithi086.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-19T09:09:14.655 INFO:teuthology.orchestra.run.smithi086.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T09:09:14.656 INFO:teuthology.orchestra.run.smithi169.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-19T09:09:14.680 INFO:teuthology.orchestra.run.smithi086.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-19T09:09:14.706 INFO:teuthology.orchestra.run.smithi086.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-19T09:09:14.747 INFO:teuthology.orchestra.run.smithi086.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-19T09:09:14.772 INFO:teuthology.orchestra.run.smithi086.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T09:09:14.789 INFO:teuthology.orchestra.run.smithi086.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T09:09:14.814 INFO:teuthology.orchestra.run.smithi086.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T09:09:14.839 INFO:teuthology.orchestra.run.smithi086.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-09-19T09:09:14.842 INFO:teuthology.orchestra.run.smithi052.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 160 kB/s | 191 kB 00:01 2024-09-19T09:09:15.105 INFO:teuthology.orchestra.run.smithi086.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-19T09:09:15.159 INFO:teuthology.orchestra.run.smithi052.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 225 kB/s | 253 kB 00:01 2024-09-19T09:09:15.172 INFO:teuthology.orchestra.run.smithi086.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-19T09:09:15.197 INFO:teuthology.orchestra.run.smithi086.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-19T09:09:15.231 INFO:teuthology.orchestra.run.smithi086.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-19T09:09:15.290 INFO:teuthology.orchestra.run.smithi086.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T09:09:15.315 INFO:teuthology.orchestra.run.smithi086.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-19T09:09:15.407 INFO:teuthology.orchestra.run.smithi086.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-19T09:09:15.457 INFO:teuthology.orchestra.run.smithi086.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-19T09:09:15.482 INFO:teuthology.orchestra.run.smithi086.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-19T09:09:15.484 INFO:teuthology.orchestra.run.smithi052.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-19T09:09:15.541 INFO:teuthology.orchestra.run.smithi086.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T09:09:15.575 INFO:teuthology.orchestra.run.smithi086.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-19T09:09:15.584 INFO:teuthology.orchestra.run.smithi052.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 144 kB/s | 106 kB 00:00 2024-09-19T09:09:15.617 INFO:teuthology.orchestra.run.smithi086.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-19T09:09:15.659 INFO:teuthology.orchestra.run.smithi086.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-19T09:09:15.689 INFO:teuthology.orchestra.run.smithi169.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 3.8 MB/s | 4.7 MB 00:01 2024-09-19T09:09:15.692 INFO:teuthology.orchestra.run.smithi086.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T09:09:15.734 INFO:teuthology.orchestra.run.smithi086.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-19T09:09:15.776 INFO:teuthology.orchestra.run.smithi086.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T09:09:15.802 INFO:teuthology.orchestra.run.smithi086.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-19T09:09:15.885 INFO:teuthology.orchestra.run.smithi086.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-19T09:09:15.951 INFO:teuthology.orchestra.run.smithi052.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 171 kB/s | 135 kB 00:00 2024-09-19T09:09:16.011 INFO:teuthology.orchestra.run.smithi086.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T09:09:16.086 INFO:teuthology.orchestra.run.smithi086.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-19T09:09:16.145 INFO:teuthology.orchestra.run.smithi086.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T09:09:16.193 INFO:teuthology.orchestra.run.smithi052.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 176 kB/s | 125 kB 00:00 2024-09-19T09:09:16.211 INFO:teuthology.orchestra.run.smithi086.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-19T09:09:16.236 INFO:teuthology.orchestra.run.smithi086.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T09:09:16.260 INFO:teuthology.orchestra.run.smithi052.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-19T09:09:16.319 INFO:teuthology.orchestra.run.smithi052.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T09:09:16.343 INFO:teuthology.orchestra.run.smithi052.stdout:(50/156): python3-urllib3-1.26.5-6.el9.noarch.r 283 kB/s | 215 kB 00:00 2024-09-19T09:09:16.369 INFO:teuthology.orchestra.run.smithi052.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-19T09:09:16.427 INFO:teuthology.orchestra.run.smithi052.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-09-19T09:09:16.503 INFO:teuthology.orchestra.run.smithi052.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-19T09:09:16.545 INFO:teuthology.orchestra.run.smithi052.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-19T09:09:16.578 INFO:teuthology.orchestra.run.smithi052.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-09-19T09:09:16.595 INFO:teuthology.orchestra.run.smithi052.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-19T09:09:16.646 INFO:teuthology.orchestra.run.smithi052.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T09:09:16.671 INFO:teuthology.orchestra.run.smithi052.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-19T09:09:16.704 INFO:teuthology.orchestra.run.smithi052.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T09:09:16.745 INFO:teuthology.orchestra.run.smithi086.stdout:(71/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 10 MB/s | 49 MB 00:04 2024-09-19T09:09:16.754 INFO:teuthology.orchestra.run.smithi052.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-19T09:09:16.787 INFO:teuthology.orchestra.run.smithi086.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-09-19T09:09:16.788 INFO:teuthology.orchestra.run.smithi052.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-19T09:09:16.813 INFO:teuthology.orchestra.run.smithi052.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-19T09:09:16.847 INFO:teuthology.orchestra.run.smithi052.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T09:09:16.896 INFO:teuthology.orchestra.run.smithi086.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 8.4 MB/s | 5.8 MB 00:00 2024-09-19T09:09:16.897 INFO:teuthology.orchestra.run.smithi052.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2024-09-19T09:09:16.906 INFO:teuthology.orchestra.run.smithi169.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.9 MB/s | 21 MB 00:05 2024-09-19T09:09:16.923 INFO:teuthology.orchestra.run.smithi052.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T09:09:16.956 INFO:teuthology.orchestra.run.smithi169.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 507 kB/s | 25 kB 00:00 2024-09-19T09:09:16.971 INFO:teuthology.orchestra.run.smithi086.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 821 kB/s | 61 kB 00:00 2024-09-19T09:09:17.046 INFO:teuthology.orchestra.run.smithi086.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2024-09-19T09:09:17.071 INFO:teuthology.orchestra.run.smithi086.stdout:(76/156): python3-attrs-20.3.0-7.el9.noarch.rpm 268 kB/s | 87 kB 00:00 2024-09-19T09:09:17.105 INFO:teuthology.orchestra.run.smithi086.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-19T09:09:17.163 INFO:teuthology.orchestra.run.smithi086.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-19T09:09:17.189 INFO:teuthology.orchestra.run.smithi086.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T09:09:17.256 INFO:teuthology.orchestra.run.smithi086.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 19 kB 00:00 2024-09-19T09:09:17.281 INFO:teuthology.orchestra.run.smithi086.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 378 kB/s | 35 kB 00:00 2024-09-19T09:09:17.434 INFO:teuthology.orchestra.run.smithi052.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.7 MB/s | 4.9 MB 00:00 2024-09-19T09:09:17.434 INFO:teuthology.orchestra.run.smithi169.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 6.2 MB/s | 17 MB 00:02 2024-09-19T09:09:17.435 INFO:teuthology.orchestra.run.smithi169.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.4 MB/s | 228 kB 00:00 2024-09-19T09:09:17.435 INFO:teuthology.orchestra.run.smithi086.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-19T09:09:17.435 INFO:teuthology.orchestra.run.smithi086.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-19T09:09:17.449 INFO:teuthology.orchestra.run.smithi086.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-09-19T09:09:17.474 INFO:teuthology.orchestra.run.smithi086.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-09-19T09:09:17.475 INFO:teuthology.orchestra.run.smithi169.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 540 kB/s | 27 kB 00:00 2024-09-19T09:09:17.499 INFO:teuthology.orchestra.run.smithi086.stdout:(86/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-09-19T09:09:17.524 INFO:teuthology.orchestra.run.smithi169.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 637 kB/s | 32 kB 00:00 2024-09-19T09:09:17.549 INFO:teuthology.orchestra.run.smithi086.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-19T09:09:17.573 INFO:teuthology.orchestra.run.smithi052.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-09-19T09:09:17.574 INFO:teuthology.orchestra.run.smithi086.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-19T09:09:17.608 INFO:teuthology.orchestra.run.smithi086.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T09:09:17.633 INFO:teuthology.orchestra.run.smithi086.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T09:09:17.641 INFO:teuthology.orchestra.run.smithi169.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-19T09:09:17.659 INFO:teuthology.orchestra.run.smithi086.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-19T09:09:17.690 INFO:teuthology.orchestra.run.smithi052.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-19T09:09:17.692 INFO:teuthology.orchestra.run.smithi086.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-09-19T09:09:17.734 INFO:teuthology.orchestra.run.smithi086.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-19T09:09:17.740 INFO:teuthology.orchestra.run.smithi052.stdout:(69/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-09-19T09:09:17.750 INFO:teuthology.orchestra.run.smithi169.stdout:(15/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 5.1 MB/s | 11 MB 00:02 2024-09-19T09:09:17.775 INFO:teuthology.orchestra.run.smithi169.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.2 MB/s | 163 kB 00:00 2024-09-19T09:09:17.784 INFO:teuthology.orchestra.run.smithi086.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 479 kB/s | 44 kB 00:00 2024-09-19T09:09:17.799 INFO:teuthology.orchestra.run.smithi052.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T09:09:17.800 INFO:teuthology.orchestra.run.smithi169.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:09:17.810 INFO:teuthology.orchestra.run.smithi086.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-19T09:09:17.852 INFO:teuthology.orchestra.run.smithi086.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-19T09:09:17.876 INFO:teuthology.orchestra.run.smithi169.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T09:09:17.877 INFO:teuthology.orchestra.run.smithi086.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-19T09:09:17.917 INFO:teuthology.orchestra.run.smithi169.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 1.1 MB/s | 45 kB 00:00 2024-09-19T09:09:17.968 INFO:teuthology.orchestra.run.smithi169.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:09:18.010 INFO:teuthology.orchestra.run.smithi169.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.8 MB/s | 161 kB 00:00 2024-09-19T09:09:18.077 INFO:teuthology.orchestra.run.smithi169.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T09:09:18.077 INFO:teuthology.orchestra.run.smithi086.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-19T09:09:18.144 INFO:teuthology.orchestra.run.smithi169.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T09:09:18.194 INFO:teuthology.orchestra.run.smithi169.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:09:18.209 INFO:teuthology.orchestra.run.smithi086.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 174 kB/s | 58 kB 00:00 2024-09-19T09:09:18.244 INFO:teuthology.orchestra.run.smithi169.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:09:18.294 INFO:teuthology.orchestra.run.smithi086.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 443 kB/s | 96 kB 00:00 2024-09-19T09:09:18.320 INFO:teuthology.orchestra.run.smithi086.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 576 kB/s | 64 kB 00:00 2024-09-19T09:09:18.345 INFO:teuthology.orchestra.run.smithi086.stdout:(102/156): socat-1.7.4.1-6.el9.x86_64.rpm 617 kB/s | 304 kB 00:00 2024-09-19T09:09:18.349 INFO:teuthology.orchestra.run.smithi052.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 9.5 MB/s | 5.8 MB 00:00 2024-09-19T09:09:18.370 INFO:teuthology.orchestra.run.smithi086.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 593 kB/s | 45 kB 00:00 2024-09-19T09:09:18.383 INFO:teuthology.orchestra.run.smithi052.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-09-19T09:09:18.408 INFO:teuthology.orchestra.run.smithi052.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T09:09:18.420 INFO:teuthology.orchestra.run.smithi086.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:09:18.454 INFO:teuthology.orchestra.run.smithi086.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T09:09:18.458 INFO:teuthology.orchestra.run.smithi052.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T09:09:18.479 INFO:teuthology.orchestra.run.smithi086.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-19T09:09:18.505 INFO:teuthology.orchestra.run.smithi086.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 121 kB/s | 22 kB 00:00 2024-09-19T09:09:18.517 INFO:teuthology.orchestra.run.smithi052.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T09:09:18.555 INFO:teuthology.orchestra.run.smithi086.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-19T09:09:18.575 INFO:teuthology.orchestra.run.smithi052.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T09:09:18.580 INFO:teuthology.orchestra.run.smithi086.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:09:18.594 INFO:teuthology.orchestra.run.smithi169.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 6.7 MB/s | 5.3 MB 00:00 2024-09-19T09:09:18.626 INFO:teuthology.orchestra.run.smithi052.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-19T09:09:18.630 INFO:teuthology.orchestra.run.smithi086.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T09:09:18.644 INFO:teuthology.orchestra.run.smithi169.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-19T09:09:18.664 INFO:teuthology.orchestra.run.smithi086.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-19T09:09:18.684 INFO:teuthology.orchestra.run.smithi052.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-09-19T09:09:18.695 INFO:teuthology.orchestra.run.smithi169.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 6.9 MB/s | 3.1 MB 00:00 2024-09-19T09:09:18.706 INFO:teuthology.orchestra.run.smithi086.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-19T09:09:18.744 INFO:teuthology.orchestra.run.smithi052.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T09:09:18.773 INFO:teuthology.orchestra.run.smithi086.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T09:09:18.798 INFO:teuthology.orchestra.run.smithi086.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:09:18.801 INFO:teuthology.orchestra.run.smithi052.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-09-19T09:09:18.814 INFO:teuthology.orchestra.run.smithi169.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 188 kB/s | 32 kB 00:00 2024-09-19T09:09:18.823 INFO:teuthology.orchestra.run.smithi086.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:09:18.837 INFO:teuthology.orchestra.run.smithi169.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.0 MB/s | 146 kB 00:00 2024-09-19T09:09:18.849 INFO:teuthology.orchestra.run.smithi086.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-19T09:09:18.874 INFO:teuthology.orchestra.run.smithi086.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-19T09:09:18.899 INFO:teuthology.orchestra.run.smithi086.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:09:18.924 INFO:teuthology.orchestra.run.smithi086.stdout:(119/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 839 kB 00:00 2024-09-19T09:09:18.958 INFO:teuthology.orchestra.run.smithi086.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T09:09:18.983 INFO:teuthology.orchestra.run.smithi086.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-19T09:09:19.008 INFO:teuthology.orchestra.run.smithi086.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T09:09:19.033 INFO:teuthology.orchestra.run.smithi086.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-19T09:09:19.059 INFO:teuthology.orchestra.run.smithi086.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T09:09:19.084 INFO:teuthology.orchestra.run.smithi086.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T09:09:19.109 INFO:teuthology.orchestra.run.smithi086.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T09:09:19.135 INFO:teuthology.orchestra.run.smithi086.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 385 kB/s | 19 kB 00:00 2024-09-19T09:09:19.160 INFO:teuthology.orchestra.run.smithi086.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-19T09:09:19.186 INFO:teuthology.orchestra.run.smithi086.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:09:19.219 INFO:teuthology.orchestra.run.smithi086.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T09:09:19.244 INFO:teuthology.orchestra.run.smithi086.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:09:19.271 INFO:teuthology.orchestra.run.smithi169.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.8 MB/s | 3.6 MB 00:00 2024-09-19T09:09:19.278 INFO:teuthology.orchestra.run.smithi086.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T09:09:19.285 INFO:teuthology.orchestra.run.smithi052.stdout:(81/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.9 MB/s | 4.4 MB 00:02 2024-09-19T09:09:19.303 INFO:teuthology.orchestra.run.smithi086.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-19T09:09:19.328 INFO:teuthology.orchestra.run.smithi086.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T09:09:19.338 INFO:teuthology.orchestra.run.smithi169.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T09:09:19.354 INFO:teuthology.orchestra.run.smithi086.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-19T09:09:19.379 INFO:teuthology.orchestra.run.smithi086.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T09:09:19.382 INFO:teuthology.orchestra.run.smithi052.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.8 MB/s | 5.1 MB 00:00 2024-09-19T09:09:19.388 INFO:teuthology.orchestra.run.smithi169.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 989 kB/s | 49 kB 00:00 2024-09-19T09:09:19.404 INFO:teuthology.orchestra.run.smithi086.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T09:09:19.430 INFO:teuthology.orchestra.run.smithi086.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:09:19.438 INFO:teuthology.orchestra.run.smithi169.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 330 kB/s | 16 kB 00:00 2024-09-19T09:09:19.444 INFO:teuthology.orchestra.run.smithi052.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 222 kB 00:00 2024-09-19T09:09:19.455 INFO:teuthology.orchestra.run.smithi086.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T09:09:19.480 INFO:teuthology.orchestra.run.smithi086.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T09:09:19.502 INFO:teuthology.orchestra.run.smithi052.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-09-19T09:09:19.505 INFO:teuthology.orchestra.run.smithi169.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T09:09:19.505 INFO:teuthology.orchestra.run.smithi086.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:09:19.519 INFO:teuthology.orchestra.run.smithi052.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-19T09:09:19.553 INFO:teuthology.orchestra.run.smithi052.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-19T09:09:19.555 INFO:teuthology.orchestra.run.smithi086.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T09:09:19.578 INFO:teuthology.orchestra.run.smithi052.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T09:09:19.581 INFO:teuthology.orchestra.run.smithi086.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-19T09:09:19.606 INFO:teuthology.orchestra.run.smithi086.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T09:09:19.622 INFO:teuthology.orchestra.run.smithi169.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-19T09:09:19.631 INFO:teuthology.orchestra.run.smithi086.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T09:09:19.645 INFO:teuthology.orchestra.run.smithi052.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-09-19T09:09:19.657 INFO:teuthology.orchestra.run.smithi086.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:09:19.682 INFO:teuthology.orchestra.run.smithi086.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T09:09:19.696 INFO:teuthology.orchestra.run.smithi052.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-19T09:09:19.721 INFO:teuthology.orchestra.run.smithi052.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 679 kB/s | 51 kB 00:00 2024-09-19T09:09:19.732 INFO:teuthology.orchestra.run.smithi086.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:09:19.739 INFO:teuthology.orchestra.run.smithi169.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 8.2 MB/s | 7.4 MB 00:00 2024-09-19T09:09:19.754 INFO:teuthology.orchestra.run.smithi052.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 918 kB/s | 54 kB 00:00 2024-09-19T09:09:19.764 INFO:teuthology.orchestra.run.smithi169.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 129 kB/s | 18 kB 00:00 2024-09-19T09:09:19.796 INFO:teuthology.orchestra.run.smithi052.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-09-19T09:09:19.847 INFO:teuthology.orchestra.run.smithi052.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-19T09:09:19.881 INFO:teuthology.orchestra.run.smithi169.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 685 kB/s | 80 kB 00:00 2024-09-19T09:09:19.916 INFO:teuthology.orchestra.run.smithi086.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-19T09:09:19.957 INFO:teuthology.orchestra.run.smithi169.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-19T09:09:19.974 INFO:teuthology.orchestra.run.smithi169.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T09:09:19.991 INFO:teuthology.orchestra.run.smithi086.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T09:09:20.013 INFO:teuthology.orchestra.run.smithi052.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-19T09:09:20.049 INFO:teuthology.orchestra.run.smithi086.stdout:(151/156): librados2-19.1.1-361.g2f599a46.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-19T09:09:20.064 INFO:teuthology.orchestra.run.smithi052.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-19T09:09:20.065 INFO:teuthology.orchestra.run.smithi169.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T09:09:20.066 INFO:teuthology.orchestra.run.smithi086.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-19T09:09:20.108 INFO:teuthology.orchestra.run.smithi086.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 9.4 MB/s | 1.8 MB 00:00 2024-09-19T09:09:20.114 INFO:teuthology.orchestra.run.smithi052.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-19T09:09:20.124 INFO:teuthology.orchestra.run.smithi169.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T09:09:20.192 INFO:teuthology.orchestra.run.smithi086.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-19T09:09:20.199 INFO:teuthology.orchestra.run.smithi169.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-19T09:09:20.225 INFO:teuthology.orchestra.run.smithi169.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-19T09:09:20.242 INFO:teuthology.orchestra.run.smithi086.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-19T09:09:20.250 INFO:teuthology.orchestra.run.smithi169.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T09:09:20.267 INFO:teuthology.orchestra.run.smithi086.stdout:(156/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.1 MB/s | 249 kB 00:00 2024-09-19T09:09:20.273 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:09:20.273 INFO:teuthology.orchestra.run.smithi086.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-19T09:09:20.306 INFO:teuthology.orchestra.run.smithi052.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-19T09:09:20.318 INFO:teuthology.orchestra.run.smithi169.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T09:09:20.365 INFO:teuthology.orchestra.run.smithi052.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 991 kB/s | 58 kB 00:00 2024-09-19T09:09:20.426 INFO:teuthology.orchestra.run.smithi169.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-19T09:09:20.457 INFO:teuthology.orchestra.run.smithi052.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-09-19T09:09:20.477 INFO:teuthology.orchestra.run.smithi169.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.0 MB/s | 107 kB 00:00 2024-09-19T09:09:20.511 INFO:teuthology.orchestra.run.smithi169.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-19T09:09:20.528 INFO:teuthology.orchestra.run.smithi169.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-19T09:09:20.540 INFO:teuthology.orchestra.run.smithi052.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2024-09-19T09:09:20.553 INFO:teuthology.orchestra.run.smithi169.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-09-19T09:09:20.570 INFO:teuthology.orchestra.run.smithi169.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 782 kB/s | 33 kB 00:00 2024-09-19T09:09:20.599 INFO:teuthology.orchestra.run.smithi052.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-09-19T09:09:20.612 INFO:teuthology.orchestra.run.smithi169.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-19T09:09:20.645 INFO:teuthology.orchestra.run.smithi169.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 337 kB/s | 11 kB 00:00 2024-09-19T09:09:20.696 INFO:teuthology.orchestra.run.smithi169.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-19T09:09:20.721 INFO:teuthology.orchestra.run.smithi169.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T09:09:20.746 INFO:teuthology.orchestra.run.smithi169.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-19T09:09:20.797 INFO:teuthology.orchestra.run.smithi169.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-19T09:09:20.830 INFO:teuthology.orchestra.run.smithi169.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-19T09:09:20.856 INFO:teuthology.orchestra.run.smithi169.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T09:09:20.881 INFO:teuthology.orchestra.run.smithi169.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-19T09:09:20.906 INFO:teuthology.orchestra.run.smithi169.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T09:09:20.932 INFO:teuthology.orchestra.run.smithi169.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T09:09:20.957 INFO:teuthology.orchestra.run.smithi169.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-19T09:09:21.132 INFO:teuthology.orchestra.run.smithi169.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-19T09:09:21.133 INFO:teuthology.orchestra.run.smithi052.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-19T09:09:21.199 INFO:teuthology.orchestra.run.smithi169.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T09:09:21.241 INFO:teuthology.orchestra.run.smithi169.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:09:21.274 INFO:teuthology.orchestra.run.smithi169.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-19T09:09:21.308 INFO:teuthology.orchestra.run.smithi169.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T09:09:21.358 INFO:teuthology.orchestra.run.smithi052.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.9 MB/s | 16 MB 00:01 2024-09-19T09:09:21.367 INFO:teuthology.orchestra.run.smithi169.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T09:09:21.409 INFO:teuthology.orchestra.run.smithi169.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-09-19T09:09:21.441 INFO:teuthology.orchestra.run.smithi052.stdout:(104/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.9 MB/s | 6.0 MB 00:03 2024-09-19T09:09:21.500 INFO:teuthology.orchestra.run.smithi052.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-09-19T09:09:21.501 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-19T09:09:21.501 INFO:teuthology.orchestra.run.smithi169.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-19T09:09:21.525 INFO:teuthology.orchestra.run.smithi052.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-19T09:09:21.543 INFO:teuthology.orchestra.run.smithi169.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:09:21.567 INFO:teuthology.orchestra.run.smithi052.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.4 MB/s | 308 kB 00:00 2024-09-19T09:09:21.585 INFO:teuthology.orchestra.run.smithi169.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-19T09:09:21.592 INFO:teuthology.orchestra.run.smithi052.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:09:21.617 INFO:teuthology.orchestra.run.smithi052.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:09:21.651 INFO:teuthology.orchestra.run.smithi052.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T09:09:21.653 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-19T09:09:21.653 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-19T09:09:21.660 INFO:teuthology.orchestra.run.smithi169.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2024-09-19T09:09:21.684 INFO:teuthology.orchestra.run.smithi052.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T09:09:21.685 INFO:teuthology.orchestra.run.smithi169.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-19T09:09:21.702 INFO:teuthology.orchestra.run.smithi169.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-19T09:09:21.719 INFO:teuthology.orchestra.run.smithi169.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 573 kB/s | 19 kB 00:00 2024-09-19T09:09:21.745 INFO:teuthology.orchestra.run.smithi169.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-19T09:09:21.760 INFO:teuthology.orchestra.run.smithi052.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-19T09:09:21.761 INFO:teuthology.orchestra.run.smithi169.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-19T09:09:21.794 INFO:teuthology.orchestra.run.smithi052.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-19T09:09:21.803 INFO:teuthology.orchestra.run.smithi169.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-19T09:09:21.820 INFO:teuthology.orchestra.run.smithi052.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-19T09:09:21.844 INFO:teuthology.orchestra.run.smithi052.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-09-19T09:09:21.854 INFO:teuthology.orchestra.run.smithi169.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-19T09:09:21.869 INFO:teuthology.orchestra.run.smithi052.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-19T09:09:21.895 INFO:teuthology.orchestra.run.smithi052.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T09:09:21.920 INFO:teuthology.orchestra.run.smithi052.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:09:21.929 INFO:teuthology.orchestra.run.smithi169.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-19T09:09:21.945 INFO:teuthology.orchestra.run.smithi052.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T09:09:21.954 INFO:teuthology.orchestra.run.smithi169.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 770 kB/s | 77 kB 00:00 2024-09-19T09:09:21.970 INFO:teuthology.orchestra.run.smithi052.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T09:09:21.979 INFO:teuthology.orchestra.run.smithi169.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-19T09:09:21.996 INFO:teuthology.orchestra.run.smithi052.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:09:22.005 INFO:teuthology.orchestra.run.smithi169.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T09:09:22.030 INFO:teuthology.orchestra.run.smithi052.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T09:09:22.030 INFO:teuthology.orchestra.run.smithi169.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:09:22.055 INFO:teuthology.orchestra.run.smithi169.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T09:09:22.063 INFO:teuthology.orchestra.run.smithi052.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 323 kB/s | 11 kB 00:00 2024-09-19T09:09:22.081 INFO:teuthology.orchestra.run.smithi169.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T09:09:22.088 INFO:teuthology.orchestra.run.smithi052.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T09:09:22.106 INFO:teuthology.orchestra.run.smithi169.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:09:22.113 INFO:teuthology.orchestra.run.smithi052.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-19T09:09:22.139 INFO:teuthology.orchestra.run.smithi052.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-19T09:09:22.148 INFO:teuthology.orchestra.run.smithi169.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T09:09:22.164 INFO:teuthology.orchestra.run.smithi052.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-19T09:09:22.190 INFO:teuthology.orchestra.run.smithi169.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T09:09:22.214 INFO:teuthology.orchestra.run.smithi052.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-19T09:09:22.240 INFO:teuthology.orchestra.run.smithi169.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:09:22.249 INFO:teuthology.orchestra.run.smithi052.stdout:(129/156): protobuf-compiler-3.14.0-13.el9.x86_ 774 kB/s | 863 kB 00:01 2024-09-19T09:09:22.273 INFO:teuthology.orchestra.run.smithi052.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 790 kB/s | 46 kB 00:00 2024-09-19T09:09:22.282 INFO:teuthology.orchestra.run.smithi169.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 866 kB/s | 36 kB 00:00 2024-09-19T09:09:22.307 INFO:teuthology.orchestra.run.smithi052.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:09:22.324 INFO:teuthology.orchestra.run.smithi169.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T09:09:22.340 INFO:teuthology.orchestra.run.smithi052.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.5 MB/s | 272 kB 00:00 2024-09-19T09:09:22.366 INFO:teuthology.orchestra.run.smithi052.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-09-19T09:09:22.374 INFO:teuthology.orchestra.run.smithi169.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-19T09:09:22.391 INFO:teuthology.orchestra.run.smithi052.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-19T09:09:22.425 INFO:teuthology.orchestra.run.smithi052.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-19T09:09:22.450 INFO:teuthology.orchestra.run.smithi052.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-19T09:09:22.475 INFO:teuthology.orchestra.run.smithi052.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 826 kB/s | 90 kB 00:00 2024-09-19T09:09:22.492 INFO:teuthology.orchestra.run.smithi052.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-09-19T09:09:22.517 INFO:teuthology.orchestra.run.smithi052.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:09:22.533 INFO:teuthology.orchestra.run.smithi169.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-19T09:09:22.542 INFO:teuthology.orchestra.run.smithi052.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T09:09:22.567 INFO:teuthology.orchestra.run.smithi169.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-09-19T09:09:22.567 INFO:teuthology.orchestra.run.smithi052.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-19T09:09:22.592 INFO:teuthology.orchestra.run.smithi169.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T09:09:22.593 INFO:teuthology.orchestra.run.smithi052.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-19T09:09:22.617 INFO:teuthology.orchestra.run.smithi169.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:09:22.618 INFO:teuthology.orchestra.run.smithi052.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T09:09:22.643 INFO:teuthology.orchestra.run.smithi169.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T09:09:22.643 INFO:teuthology.orchestra.run.smithi052.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T09:09:22.660 INFO:teuthology.orchestra.run.smithi052.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-19T09:09:22.685 INFO:teuthology.orchestra.run.smithi052.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T09:09:22.711 INFO:teuthology.orchestra.run.smithi052.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-19T09:09:22.761 INFO:teuthology.orchestra.run.smithi052.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:09:22.995 INFO:teuthology.orchestra.run.smithi052.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T09:09:23.053 INFO:teuthology.orchestra.run.smithi052.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-19T09:09:23.076 INFO:teuthology.orchestra.run.smithi169.stdout:(103/156): ceph-test-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 49 MB 00:06 2024-09-19T09:09:23.126 INFO:teuthology.orchestra.run.smithi169.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:09:23.160 INFO:teuthology.orchestra.run.smithi169.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:09:23.185 INFO:teuthology.orchestra.run.smithi169.stdout:(106/156): lua-devel-5.4.4-4.el9.x86_64.rpm 39 kB/s | 22 kB 00:00 2024-09-19T09:09:23.210 INFO:teuthology.orchestra.run.smithi169.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-19T09:09:23.244 INFO:teuthology.orchestra.run.smithi169.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 994 kB/s | 26 kB 00:00 2024-09-19T09:09:23.269 INFO:teuthology.orchestra.run.smithi169.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T09:09:23.286 INFO:teuthology.orchestra.run.smithi169.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-19T09:09:23.312 INFO:teuthology.orchestra.run.smithi169.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T09:09:23.370 INFO:teuthology.orchestra.run.smithi169.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T09:09:23.404 INFO:teuthology.orchestra.run.smithi169.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-19T09:09:23.446 INFO:teuthology.orchestra.run.smithi169.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-19T09:09:23.471 INFO:teuthology.orchestra.run.smithi169.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-19T09:09:23.477 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-19T09:09:23.481 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-19T09:09:23.488 INFO:teuthology.orchestra.run.smithi169.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 518 kB/s | 43 kB 00:00 2024-09-19T09:09:23.505 INFO:teuthology.orchestra.run.smithi169.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-19T09:09:23.539 INFO:teuthology.orchestra.run.smithi169.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:09:23.564 INFO:teuthology.orchestra.run.smithi169.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:09:23.597 INFO:teuthology.orchestra.run.smithi169.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:09:23.623 INFO:teuthology.orchestra.run.smithi169.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T09:09:23.636 INFO:teuthology.orchestra.run.smithi052.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 70 kB/s | 41 kB 00:00 2024-09-19T09:09:23.648 INFO:teuthology.orchestra.run.smithi169.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T09:09:23.673 INFO:teuthology.orchestra.run.smithi169.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-19T09:09:23.698 INFO:teuthology.orchestra.run.smithi169.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-19T09:09:23.724 INFO:teuthology.orchestra.run.smithi169.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-19T09:09:23.749 INFO:teuthology.orchestra.run.smithi169.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-19T09:09:23.774 INFO:teuthology.orchestra.run.smithi169.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-09-19T09:09:23.795 INFO:teuthology.orchestra.run.smithi052.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-19T09:09:23.958 INFO:teuthology.orchestra.run.smithi169.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-09-19T09:09:23.984 INFO:teuthology.orchestra.run.smithi169.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:09:23.995 INFO:teuthology.orchestra.run.smithi052.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-09-19T09:09:24.009 INFO:teuthology.orchestra.run.smithi169.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:09:24.034 INFO:teuthology.orchestra.run.smithi169.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:09:24.076 INFO:teuthology.orchestra.run.smithi169.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-09-19T09:09:24.101 INFO:teuthology.orchestra.run.smithi169.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T09:09:24.143 INFO:teuthology.orchestra.run.smithi169.stdout:(134/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-19T09:09:24.169 INFO:teuthology.orchestra.run.smithi169.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:09:24.194 INFO:teuthology.orchestra.run.smithi169.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 977 kB/s | 90 kB 00:00 2024-09-19T09:09:24.219 INFO:teuthology.orchestra.run.smithi169.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T09:09:24.245 INFO:teuthology.orchestra.run.smithi169.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-19T09:09:24.270 INFO:teuthology.orchestra.run.smithi169.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T09:09:24.295 INFO:teuthology.orchestra.run.smithi169.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T09:09:24.320 INFO:teuthology.orchestra.run.smithi169.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T09:09:24.345 INFO:teuthology.orchestra.run.smithi169.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T09:09:24.362 INFO:teuthology.orchestra.run.smithi169.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-19T09:09:24.388 INFO:teuthology.orchestra.run.smithi169.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-19T09:09:24.413 INFO:teuthology.orchestra.run.smithi052.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 321 kB/s | 249 kB 00:00 2024-09-19T09:09:24.413 INFO:teuthology.orchestra.run.smithi169.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T09:09:24.438 INFO:teuthology.orchestra.run.smithi169.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:09:24.472 INFO:teuthology.orchestra.run.smithi169.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T09:09:24.522 INFO:teuthology.orchestra.run.smithi169.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:09:24.746 INFO:teuthology.orchestra.run.smithi052.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-19T09:09:24.897 INFO:teuthology.orchestra.run.smithi169.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-19T09:09:24.989 INFO:teuthology.orchestra.run.smithi169.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 6.2 MB/s | 3.4 MB 00:00 2024-09-19T09:09:25.030 INFO:teuthology.orchestra.run.smithi052.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-19T09:09:25.037 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:09:25.037 INFO:teuthology.orchestra.run.smithi052.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-19T09:09:25.073 INFO:teuthology.orchestra.run.smithi169.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 493 kB/s | 41 kB 00:00 2024-09-19T09:09:25.156 INFO:teuthology.orchestra.run.smithi169.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.7 MB/s | 2.3 MB 00:00 2024-09-19T09:09:25.198 INFO:teuthology.orchestra.run.smithi169.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T09:09:25.324 INFO:teuthology.orchestra.run.smithi169.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.2 MB/s | 1.8 MB 00:00 2024-09-19T09:09:25.582 INFO:teuthology.orchestra.run.smithi169.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-19T09:09:25.749 INFO:teuthology.orchestra.run.smithi169.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-09-19T09:09:25.756 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:09:25.756 INFO:teuthology.orchestra.run.smithi169.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-19T09:09:26.264 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-19T09:09:26.435 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-19T09:09:26.435 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-19T09:09:27.003 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-09-19T09:09:27.158 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-09-19T09:09:27.159 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-09-19T09:09:28.958 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-19T09:09:28.959 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-19T09:09:28.989 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-09-19T09:09:29.035 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-09-19T09:09:29.792 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-19T09:09:29.913 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:09:29.951 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:09:30.004 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:09:30.038 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:09:30.164 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:09:30.291 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:09:30.620 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:09:30.731 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:30.853 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:30.882 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:30.972 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:31.003 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:09:31.154 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:09:31.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:09:31.228 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:31.332 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:31.362 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:31.425 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:31.446 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:31.469 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:31.656 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:31.799 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:31.958 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:09:32.062 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:32.129 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:32.358 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:32.476 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:09:32.571 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:09:32.609 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:09:32.644 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:09:32.708 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:09:32.753 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:09:32.785 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:09:32.828 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:09:32.861 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:09:32.889 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:09:32.956 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:09:33.013 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:09:33.044 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:09:33.080 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:09:33.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:09:33.190 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:09:33.225 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:09:33.263 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:09:33.332 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:09:33.377 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:09:33.450 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:09:33.584 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:09:33.638 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:09:34.169 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:09:34.324 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:09:34.354 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:09:34.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:09:34.434 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:09:34.476 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:09:34.648 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:09:34.721 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:09:34.775 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:09:34.839 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:09:34.872 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:09:34.907 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:09:34.954 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:09:34.990 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:09:35.032 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:09:35.074 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:09:35.209 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:09:35.259 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:09:35.300 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:09:35.403 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:09:35.407 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-09-19T09:09:35.433 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:09:35.473 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:09:35.503 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:09:35.520 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-19T09:09:35.566 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:09:35.604 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:09:35.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:09:35.642 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:09:35.695 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:09:35.706 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:09:35.729 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:09:35.754 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:09:35.784 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:09:35.805 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:09:35.832 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:09:35.864 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:09:35.892 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:09:35.926 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:09:35.952 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:09:35.965 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:09:35.992 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:09:35.996 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:09:36.017 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:09:36.026 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:09:36.061 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:09:36.077 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:09:36.094 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:09:36.135 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:09:36.136 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:09:36.170 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:09:36.230 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:36.256 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:09:36.309 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:09:36.340 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:09:36.351 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:36.381 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:36.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:09:36.443 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:09:36.471 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:36.502 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:09:36.507 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:09:36.534 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:36.651 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:09:36.658 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:09:36.685 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:36.707 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:09:36.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:36.777 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:09:36.814 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:09:36.822 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:36.844 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:36.907 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:36.929 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:36.952 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:36.999 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:09:37.060 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:09:37.089 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:37.097 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:37.180 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:09:37.207 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:37.217 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:09:37.244 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:37.262 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:09:37.269 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:09:37.291 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:37.296 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:09:37.317 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:09:37.394 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:09:37.395 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:09:37.451 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:09:37.495 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:09:37.499 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:37.520 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:37.570 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:37.581 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:09:37.615 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:09:37.689 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:09:37.798 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:37.800 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:09:37.805 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:09:37.838 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:09:37.905 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:09:37.915 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:09:37.920 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:37.982 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:37.998 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:09:38.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:09:38.069 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:09:38.142 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:09:38.203 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:09:38.206 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:09:38.243 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:09:38.287 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:09:38.315 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:09:38.319 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:09:38.347 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:09:38.417 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:09:38.420 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:09:38.464 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:09:38.473 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:09:38.504 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:09:38.505 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:09:38.547 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:09:38.548 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:09:38.573 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:09:38.623 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:09:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:09:38.658 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:09:38.659 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:09:38.663 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:09:38.701 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:09:38.707 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:09:38.730 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:09:38.739 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:09:38.767 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:09:38.799 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:09:38.837 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:09:38.844 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:09:38.898 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:09:38.919 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:09:38.928 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:09:38.967 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:09:39.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:09:39.054 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:09:39.074 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:09:39.106 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:09:39.120 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:09:39.145 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:09:39.218 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:09:39.269 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:09:39.346 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:09:39.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:09:39.556 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:09:39.638 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:09:39.718 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:09:39.746 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:09:39.790 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:09:39.827 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:09:39.866 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:09:39.868 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:09:39.949 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:09:39.976 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:09:40.001 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:09:40.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:09:40.080 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:09:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:09:40.135 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:09:40.203 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:09:40.208 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:09:40.237 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:09:40.239 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:09:40.281 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:09:40.284 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:09:40.303 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:09:40.318 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:09:40.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:09:40.339 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:40.367 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:09:40.375 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:09:40.420 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:09:40.429 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:40.460 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:09:40.462 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:09:40.497 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:09:40.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:09:40.599 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:09:40.604 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:09:40.647 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:09:40.661 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:09:40.687 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:09:40.735 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:09:40.772 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:09:40.792 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:09:40.808 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:09:40.856 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:09:40.890 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:09:40.942 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:09:40.955 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:09:40.979 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:09:40.984 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:09:40.995 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:09:41.017 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:41.029 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:09:41.054 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:09:41.088 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:41.118 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:09:41.128 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:09:41.131 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:09:41.169 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:09:41.244 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:09:41.257 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:09:41.294 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:09:41.322 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:09:41.356 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:09:41.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:09:41.426 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:09:41.459 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:09:41.492 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:09:41.493 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:09:41.527 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:09:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:09:41.602 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:09:41.691 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:09:41.700 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:09:41.740 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:09:41.741 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:09:41.772 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:09:41.775 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:09:41.800 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:09:41.884 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:09:41.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:09:41.940 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:09:42.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:09:42.082 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:09:42.119 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:09:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:09:42.203 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:09:42.243 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:09:42.273 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:09:42.307 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:09:42.340 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:09:42.383 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:09:42.416 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:09:42.506 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:09:42.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:09:42.595 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:09:42.672 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:09:42.702 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:09:42.720 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:09:42.754 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:09:42.774 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:09:42.854 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:09:42.918 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:09:42.962 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:09:43.050 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:09:43.090 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:09:43.278 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:09:43.304 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:09:43.381 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:09:43.404 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:43.442 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:43.535 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:09:43.601 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:09:43.634 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:09:43.737 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:09:43.790 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:09:43.835 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:09:43.924 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:09:43.970 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:09:43.987 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:44.028 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:44.029 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:09:44.120 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:09:44.120 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:09:44.121 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:44.146 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:09:44.154 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:09:44.160 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:09:44.192 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:09:44.273 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:09:44.956 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:09:45.075 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:09:45.376 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:09:45.450 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:09:45.477 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:09:45.511 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:09:45.820 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:09:45.865 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:45.956 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:45.986 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:09:46.023 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:09:46.386 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:09:46.477 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:09:46.506 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:09:46.508 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:09:46.534 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:46.538 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:09:46.598 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:46.628 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:09:46.864 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:09:46.901 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:46.992 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:09:47.050 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:09:47.093 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:09:47.600 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:09:47.628 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:47.700 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:09:47.730 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:09:48.900 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:48.933 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:49.478 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:49.536 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:49.636 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:49.636 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:09:49.636 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:09:49.636 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:09:49.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:09:50.121 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:50.151 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:50.731 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:09:50.763 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:50.856 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:09:50.856 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:09:50.857 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:09:50.857 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:09:50.889 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-09-19T09:09:55.902 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-09-19T09:09:55.903 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:56.072 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:09:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:09:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:09:56.089 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:09:56.089 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:57.575 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:09:57.602 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:57.825 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:09:57.849 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:58.284 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:09:58.308 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:09:58.406 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:09:58.471 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:09:58.526 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:09:58.709 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:09:58.760 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:09:58.837 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:09:58.925 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:09:59.071 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:09:59.118 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:09:59.149 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:09:59.177 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:09:59.548 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:09:59.576 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:09:59.607 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:09:59.668 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:09:59.698 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:00.740 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:00.775 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-09-19T09:10:01.583 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-09-19T09:10:01.584 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:01.747 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:01.766 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:10:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:10:01.785 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:01.785 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:10:01.785 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:01.785 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:01.885 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:02.047 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:10:02.069 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:02.094 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:02.145 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:02.157 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:02.254 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:10:02.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-19T09:10:03.186 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-19T09:10:03.187 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-19T09:10:03.187 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-19T09:10:03.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:03.222 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:10:03.256 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:03.279 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:03.280 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.280 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:10:03.280 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:03.280 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:03.280 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:03.286 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:10:03.314 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:03.323 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:03.346 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:03.346 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.346 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:10:03.347 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:03.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:10:03.390 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:03.400 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:10:03.400 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.400 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:10:03.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:03.414 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:03.536 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:10:03.559 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:10:03.559 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.560 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:10:03.560 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:10:03.560 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:10:03.560 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:03.716 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:03.740 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:03.995 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:10:04.019 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:04.142 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:10:04.199 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:10:04.255 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:10:04.440 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:10:04.496 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:10:04.574 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:10:04.662 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:10:04.803 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:10:04.846 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:10:04.878 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:10:04.905 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:10:04.929 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:10:04.957 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:05.196 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:10:05.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:05.310 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:10:05.337 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:10:05.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:10:05.431 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:10:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:05.671 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:10:05.696 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:05.810 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:10:05.869 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:10:05.932 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:10:06.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:10:06.181 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:10:06.262 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:10:06.352 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:10:06.493 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:10:06.514 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:06.554 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:06.557 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:10:06.587 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:10:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:10:07.087 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:10:07.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:10:07.145 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:10:07.210 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:10:07.236 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:07.520 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:07.554 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:07.656 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:07.826 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:10:07.856 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:07.879 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:07.880 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:07.880 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:10:07.880 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:07.880 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:07.880 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:07.924 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:07.935 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:08.033 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:10:08.080 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:10:08.253 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:10:08.302 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:10:08.343 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:10:08.343 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:10:08.375 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:10:08.379 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:08.402 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:10:08.583 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:10:08.632 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:10:08.662 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:10:08.692 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:10:08.730 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:10:09.012 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:10:09.043 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:09.067 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:09.110 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:10:09.134 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:09.187 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:09.209 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:09.210 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:09.210 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:10:09.210 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:09.210 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:09.210 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:09.352 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:09.391 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:10:09.393 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:09.414 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:09.421 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:09.520 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:09.532 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:10:09.543 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:09.544 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:09.544 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:10:09.544 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:09.544 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:09.544 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:09.708 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:10:09.740 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:09.765 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:10:09.765 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:09.765 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:10:09.765 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:09.765 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:10:09.766 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:09.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:09.827 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:10:09.929 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:10:09.986 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:10:10.229 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:10:10.323 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:10:10.363 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:10:10.445 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:10:10.476 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:10:10.501 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:10:10.527 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:10:10.527 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:10.619 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:10.619 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:10.703 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:10.728 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:10:10.734 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:10.734 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:10.913 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:10.913 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:10.957 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:10:10.993 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:10.997 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:10:11.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:11.060 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:11.069 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:11.084 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:10:11.084 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:11.085 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:10:11.085 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:11.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:11.160 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:10:11.160 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:11.160 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:10:11.161 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:11.161 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:10:11.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:11.478 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:10:11.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:14.132 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:10:14.173 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:10:14.214 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:10:14.246 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:10:14.274 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:10:14.457 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:10:14.503 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:10:14.525 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:10:14.555 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:10:14.593 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:10:15.202 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:15.241 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:15.261 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:16.112 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:10:16.195 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:10:16.237 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:10:16.319 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:10:16.324 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:10:16.357 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:10:16.366 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:10:16.382 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:10:16.407 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:10:16.408 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:10:16.408 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:16.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:10:16.465 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:10:16.484 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:16.484 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:16.551 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:16.576 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:10:16.582 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:16.582 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:16.674 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:10:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:16.700 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:10:16.701 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:10:16.702 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:10:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:10:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:10:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:10:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:10:16.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:10:16.725 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:10:16.726 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:10:16.727 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:10:16.728 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:10:16.758 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:10:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:16.761 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:16.798 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:10:16.842 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:10:16.854 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:16.918 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:17.491 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:17.531 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:17.552 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:10:18.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:10:18.569 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:10:18.612 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:10:18.706 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:10:18.738 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:10:18.764 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:10:18.800 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:10:18.801 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:18.874 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:10:18.874 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:18.949 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:10:18.974 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:10:18.979 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:18.979 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:19.131 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-19T09:10:19.132 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.133 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.134 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:10:19.135 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:10:19.136 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:10:19.137 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:10:19.138 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:10:19.139 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:10:19.140 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:10:19.141 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:10:19.142 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:10:19.143 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:10:19.144 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:10:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:10:19.145 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:10:19.145 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-19T09:10:19.167 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:10:19.168 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:19.252 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:10:19.321 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:19.557 DEBUG:teuthology.parallel:result is None 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:10:22.493 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:10:22.494 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:10:22.495 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:10:22.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:10:22.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:10:22.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:10:22.509 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:10:22.510 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:10:22.511 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:10:22.512 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:10:22.513 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:10:22.514 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:10:22.515 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:10:22.516 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:10:22.517 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:10:22.518 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:10:22.519 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:10:22.520 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:10:24.816 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:10:24.817 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:10:24.818 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:10:24.819 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:10:24.819 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:10:24.819 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:10:24.833 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:10:24.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:10:24.835 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:10:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:10:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:10:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:10:24.839 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:10:24.840 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:10:24.841 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:10:24.842 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:10:24.843 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:10:25.214 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:25.214 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:25.214 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-09-19T09:10:25.215 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:25.215 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:25.215 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:25.215 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:25.215 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:10:25.216 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:10:25.217 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:10:25.217 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:10:25.217 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.217 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.217 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.218 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.219 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.219 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.219 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.219 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.219 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.220 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.220 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.220 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.220 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.220 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:25.221 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:10:25.222 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:10:25.223 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.224 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:10:25.225 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:10:25.226 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.227 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:10:25.228 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:10:25.229 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:10:25.230 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:10:25.231 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:25.232 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:10:25.233 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-09-19T09:10:25.690 DEBUG:teuthology.parallel:result is None 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.751 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.752 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.753 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:10:27.754 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:10:27.755 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:10:27.756 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:10:27.757 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:10:27.758 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:10:27.759 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:10:27.760 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:10:27.761 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:10:27.762 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:10:27.763 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:10:27.764 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-19T09:10:28.180 DEBUG:teuthology.parallel:result is None 2024-09-19T09:10:28.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:28.325 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:10:28.348 INFO:teuthology.orchestra.run.smithi052.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.348 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.349 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:10:28.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:28.502 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:10:28.528 INFO:teuthology.orchestra.run.smithi086.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.529 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.529 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:10:28.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:28.668 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:10:28.694 INFO:teuthology.orchestra.run.smithi169.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.694 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:10:28.694 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:10:28.697 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:10:28.697 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:10:28.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:10:28.727 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:10:28.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:10:28.759 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:10:28.759 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:10:28.791 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:10:28.791 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:10:28.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:10:28.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:10:28.887 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:10:28.887 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:10:28.918 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:10:28.987 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:10:28.987 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:10:29.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:10:29.089 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:10:29.089 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:10:29.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:10:29.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:10:29.185 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:10:29.185 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:10:29.215 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:10:29.284 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:10:29.284 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:10:29.315 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:10:29.384 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:10:29.384 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:10:29.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:10:29.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:10:29.479 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:10:29.480 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:10:29.510 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:10:29.578 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:10:29.578 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:10:29.608 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:10:29.678 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:10:29.777 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T09:10:29.778 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:29.778 INFO:tasks.cephadm:Cluster fsid is 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:10:29.778 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:10:29.778 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.52', 'mon.b': '172.21.15.86', 'mon.c': '172.21.15.169'} 2024-09-19T09:10:29.778 INFO:tasks.cephadm:First mon is mon.a on smithi052 2024-09-19T09:10:29.779 INFO:tasks.cephadm:First mgr is x 2024-09-19T09:10:29.779 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:10:29.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2024-09-19T09:10:29.808 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-09-19T09:10:29.838 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname $(hostname -s) 2024-09-19T09:10:29.869 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T09:10:29.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:30.010 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T09:10:30.150 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:10:30.152 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:10:30.152 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:10:30.152 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:30.538 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:10 /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:30.539 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:30.926 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:10 /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:30.926 DEBUG:teuthology.orchestra.run.smithi169:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:31.309 INFO:teuthology.orchestra.run.smithi169.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:10 /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:31.309 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:31.330 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:31.349 DEBUG:teuthology.orchestra.run.smithi169:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:10:31.384 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T09:10:31.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:10:31.387 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:10:31.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:10:32.866 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:10:33.041 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:10:33.152 INFO:teuthology.orchestra.run.smithi169.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:11:08.222 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T09:11:08.222 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:11:08.222 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:11:08.223 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-09-19T09:11:08.223 INFO:teuthology.orchestra.run.smithi086.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:11:08.223 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-09-19T09:11:08.223 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T09:11:26.321 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:11:26.322 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout: "repo_digests": [ 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout: ] 2024-09-19T09:11:28.342 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T09:11:28.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2024-09-19T09:11:28.404 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-09-19T09:11:28.436 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph 2024-09-19T09:11:28.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2024-09-19T09:11:28.495 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-09-19T09:11:28.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /etc/ceph 2024-09-19T09:11:28.547 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:11:28.549 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:11:28.550 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T09:11:28.551 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:11:28.552 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T09:11:28.553 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T09:11:28.554 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:11:28.554 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:11:28.572 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 044f38fa-7667-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:11:28.573 DEBUG:teuthology.orchestra.run.smithi052:mon.a> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T09:11:28.616 DEBUG:teuthology.orchestra.run.smithi052:mgr.x> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T09:11:28.659 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:11:28.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.52 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:11:28.873 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:11:28.873 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '044f38fa-7667-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.52', '--skip-admin-label'] 2024-09-19T09:11:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:11:28.874 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying podman|docker is present... 2024-09-19T09:11:28.898 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:11:28.899 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying lvm2 is present... 2024-09-19T09:11:28.899 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying time synchronization is in place... 2024-09-19T09:11:28.906 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:11:28.907 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:11:28.913 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:11:28.913 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:11:28.920 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout enabled 2024-09-19T09:11:28.926 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout active 2024-09-19T09:11:28.927 INFO:teuthology.orchestra.run.smithi052.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:11:28.927 INFO:teuthology.orchestra.run.smithi052.stdout:Repeating the final host check... 2024-09-19T09:11:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:11:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:11:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl is present 2024-09-19T09:11:28.950 INFO:teuthology.orchestra.run.smithi052.stdout:lvcreate is present 2024-09-19T09:11:28.957 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:11:28.957 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:11:28.963 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:11:28.963 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:11:28.970 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout enabled 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout active 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:Host looks OK 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:Cluster fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:Acquiring lock 140386449970176 on /run/cephadm/044f38fa-7667-11ef-bceb-c7b262605968.lock 2024-09-19T09:11:28.977 INFO:teuthology.orchestra.run.smithi052.stdout:Lock 140386449970176 acquired on /run/cephadm/044f38fa-7667-11ef-bceb-c7b262605968.lock 2024-09-19T09:11:28.978 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying IP 172.21.15.52 port 3300 ... 2024-09-19T09:11:28.978 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying IP 172.21.15.52 port 6789 ... 2024-09-19T09:11:28.978 INFO:teuthology.orchestra.run.smithi052.stdout:Base mon IP(s) is [172.21.15.52:3300, 172.21.15.52:6789], mon addrv is [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-19T09:11:28.981 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.52 metric 100 2024-09-19T09:11:28.981 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.52 metric 100 2024-09-19T09:11:28.984 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:11:28.984 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T09:11:28.984 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2024-09-19T09:11:28.986 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:Mon IP `172.21.15.52` is in CIDR network `172.21.0.0/20` 2024-09-19T09:11:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:Mon IP `172.21.15.52` is in CIDR network `172.21.0.0/20` 2024-09-19T09:11:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:11:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:11:28.989 INFO:teuthology.orchestra.run.smithi052.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:11:29.465 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:11:30.386 INFO:teuthology.orchestra.run.smithi052.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:11:30.426 INFO:teuthology.orchestra.run.smithi052.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:11:30.426 INFO:teuthology.orchestra.run.smithi052.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:11:31.284 INFO:teuthology.orchestra.run.smithi052.stdout:stat: stdout 167 167 2024-09-19T09:11:31.285 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial keys... 2024-09-19T09:11:32.274 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQDD6utm3ZJzKxAAdXlRstKffMBHZyQXg+3wHQ== 2024-09-19T09:11:33.196 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQDE6utmAiy8IxAA9+NK1saDfDy6a53ID70kGg== 2024-09-19T09:11:34.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQDF6utm9gGfGxAAC8R2jFxKOpA6B44QFDFltw== 2024-09-19T09:11:34.096 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial monmap... 2024-09-19T09:11:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:11:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T09:11:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:11:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool for a [v2:172.21.15.52:3300,v1:172.21.15.52:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: set fsid to 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:11:35.019 INFO:teuthology.orchestra.run.smithi052.stdout:Creating mon... 2024-09-19T09:11:35.933 INFO:teuthology.orchestra.run.smithi052.stdout:create mon.a on 2024-09-19T09:11:36.152 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:11:36.294 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:11:36.556 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target. 2024-09-19T09:11:36.556 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target. 2024-09-19T09:11:36.793 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:11:36.794 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T09:11:36.966 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target.wants/ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968@.service. 2024-09-19T09:11:37.476 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:37 smithi052 ceph-mon[30576]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:11:37.476 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:37 smithi052 bash[30557]: 24ce34b9b5adce4d7084b28d3fe81fc3023c82749c8ed0969b24d00ee203a5e4 2024-09-19T09:11:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:11:37.491 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-19T09:11:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:11:37.498 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:11:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-19T09:11:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:11:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mon to start... 2024-09-19T09:11:37.499 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mon... 2024-09-19T09:11:37.752 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:37 smithi052 systemd[1]: Started Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: monmap epoch 1 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: last_changed 2024-09-19T09:11:34.459294+0000 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: min_mon_release 19 (squid) 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: election_strategy: 1 2024-09-19T09:11:38.533 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:11:38.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: fsmap 2024-09-19T09:11:38.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:11:38.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: mgrmap e1: no daemons active 2024-09-19T09:11:38.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:38 smithi052 ceph-mon[30576]: from='client.? 172.21.15.52:0/1032763242' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout id: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.566556s) 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:11:38.541 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2c2414640 1 Processor -- start 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2c2414640 1 -- start start 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2c2414640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2c2414640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1080a0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43222/0 (socket says 172.21.15.52:43222) 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.927+0000 7fd2bbfff640 1 -- 172.21.15.52:0/3013217238 learned_addr learned my addr 172.21.15.52:0/3013217238 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.928+0000 7fd2bbfff640 1 -- 172.21.15.52:0/3013217238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc1088d0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.542 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.930+0000 7fd2bbfff640 1 --2- 172.21.15.52:0/3013217238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009820 tx=0x7fd2ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de8b4023961b08e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.930+0000 7fd2bb7fe640 1 -- 172.21.15.52:0/3013217238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac037070 con 0x7fd2bc1076d0 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.930+0000 7fd2bb7fe640 1 -- 172.21.15.52:0/3013217238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac032440 con 0x7fd2bc1076d0 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.930+0000 7fd2bb7fe640 1 -- 172.21.15.52:0/3013217238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac032740 con 0x7fd2bc1076d0 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 -- 172.21.15.52:0/3013217238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 msgr2=0x7fd2bc107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 --2- 172.21.15.52:0/3013217238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009820 tx=0x7fd2ac02a270 comp rx=0 tx=0).stop 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 -- 172.21.15.52:0/3013217238 shutdown_connections 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 --2- 172.21.15.52:0/3013217238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc107ad0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 -- 172.21.15.52:0/3013217238 >> 172.21.15.52:0/3013217238 conn(0x7fd2bc102e80 msgr2=0x7fd2bc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 -- 172.21.15.52:0/3013217238 shutdown_connections 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 -- 172.21.15.52:0/3013217238 wait complete. 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.931+0000 7fd2c2414640 1 Processor -- start 2024-09-19T09:11:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2c2414640 1 -- start start 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2c2414640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2c2414640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc108e00 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43230/0 (socket says 172.21.15.52:43230) 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2bbfff640 1 -- 172.21.15.52:0/1032763242 learned_addr learned my addr 172.21.15.52:0/1032763242 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2bbfff640 1 -- 172.21.15.52:0/1032763242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc19b360 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2bbfff640 1 --2- 172.21.15.52:0/1032763242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0090b0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac041070 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac03c7a0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.932+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc19b5f0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.933+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2ac037040 con 0x7fd2bc1076d0 2024-09-19T09:11:38.544 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.933+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc19e2e0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.933+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2ac044070 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.933+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2ac03d3f0 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.934+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc109450 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.936+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd2ac046450 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.998+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd2bc19e830 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.999+0000 7fd2b9ffb640 1 -- 172.21.15.52:0/1032763242 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fd2ac046630 con 0x7fd2bc1076d0 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.999+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 msgr2=0x7fd2bc19ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:37.999+0000 7fd2c2414640 1 --2- 172.21.15.52:0/1032763242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac0090b0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.000+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 shutdown_connections 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.000+0000 7fd2c2414640 1 --2- 172.21.15.52:0/1032763242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2bc1076d0 0x7fd2bc19ae20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.000+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 >> 172.21.15.52:0/1032763242 conn(0x7fd2bc102e80 msgr2=0x7fd2bc18f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:38.545 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.000+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 shutdown_connections 2024-09-19T09:11:38.546 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.000+0000 7fd2c2414640 1 -- 172.21.15.52:0/1032763242 wait complete. 2024-09-19T09:11:38.546 INFO:teuthology.orchestra.run.smithi052.stdout:mon is available 2024-09-19T09:11:38.546 INFO:teuthology.orchestra.run.smithi052.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:11:39.614 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:39 smithi052 ceph-mon[30576]: from='client.? 172.21.15.52:0/2610604896' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:11:39.614 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:39 smithi052 ceph-mon[30576]: from='client.? 172.21.15.52:0/2610604896' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:11:39.617 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout fsid = 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:11:39.624 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf0dd11640 1 Processor -- start 2024-09-19T09:11:39.625 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf0dd11640 1 -- start start 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf0dd11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf0dd11640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf08108080 con 0x7faf081076b0 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44486/0 (socket says 172.21.15.52:44486) 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.948+0000 7faf077fe640 1 -- 172.21.15.52:0/1095540101 learned_addr learned my addr 172.21.15.52:0/1095540101 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.949+0000 7faf077fe640 1 -- 172.21.15.52:0/1095540101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf081088b0 con 0x7faf081076b0 2024-09-19T09:11:39.626 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.949+0000 7faf077fe640 1 --2- 172.21.15.52:0/1095540101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faef8009820 tx=0x7faef802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100dea0a42c958a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.949+0000 7faf067fc640 1 -- 172.21.15.52:0/1095540101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef8037070 con 0x7faf081076b0 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf067fc640 1 -- 172.21.15.52:0/1095540101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef8032440 con 0x7faf081076b0 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf067fc640 1 -- 172.21.15.52:0/1095540101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef8032740 con 0x7faf081076b0 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 -- 172.21.15.52:0/1095540101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 msgr2=0x7faf08107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 --2- 172.21.15.52:0/1095540101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7faef8009820 tx=0x7faef802a270 comp rx=0 tx=0).stop 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 -- 172.21.15.52:0/1095540101 shutdown_connections 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 --2- 172.21.15.52:0/1095540101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf08107ab0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 -- 172.21.15.52:0/1095540101 >> 172.21.15.52:0/1095540101 conn(0x7faf08102e80 msgr2=0x7faf081052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 -- 172.21.15.52:0/1095540101 shutdown_connections 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.950+0000 7faf0dd11640 1 -- 172.21.15.52:0/1095540101 wait complete. 2024-09-19T09:11:39.627 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf0dd11640 1 Processor -- start 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf0dd11640 1 -- start start 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf0dd11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf0dd11640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf08108de0 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44496/0 (socket says 172.21.15.52:44496) 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf077fe640 1 -- 172.21.15.52:0/2610604896 learned_addr learned my addr 172.21.15.52:0/2610604896 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.951+0000 7faf077fe640 1 -- 172.21.15.52:0/2610604896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0819b380 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf077fe640 1 --2- 172.21.15.52:0/2610604896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faef80090b0 tx=0x7faef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef8041070 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef803c7a0 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0819b610 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef8037040 con 0x7faf081076b0 2024-09-19T09:11:39.628 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0819e300 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faef8044070 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.952+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faef803d730 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.953+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf08109430 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:38.955+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faef803cbe0 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.016+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7faf0819f9e0 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.019+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7faef803cdc0 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 msgr2=0x7faf0819ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 --2- 172.21.15.52:0/2610604896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7faef80090b0 tx=0x7faef80046c0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf04ff9640 1 -- 172.21.15.52:0/2610604896 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faef8032440 con 0x7faf081076b0 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 shutdown_connections 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 --2- 172.21.15.52:0/2610604896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf081076b0 0x7faf0819ae40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.629 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 >> 172.21.15.52:0/2610604896 conn(0x7faf08102e80 msgr2=0x7faf0818f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:39.630 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 shutdown_connections 2024-09-19T09:11:39.630 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:39.020+0000 7faf0dd11640 1 -- 172.21.15.52:0/2610604896 wait complete. 2024-09-19T09:11:39.630 INFO:teuthology.orchestra.run.smithi052.stdout:Generating new minimal ceph.conf... 2024-09-19T09:11:40.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:40 smithi052 ceph-mon[30576]: from='client.? 172.21.15.52:0/1214482287' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:40.694 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.046+0000 7f320cb43640 1 Processor -- start 2024-09-19T09:11:40.694 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.046+0000 7f320cb43640 1 -- start start 2024-09-19T09:11:40.694 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.046+0000 7f320cb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.694 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.046+0000 7f320cb43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3208108080 con 0x7f32081076b0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.046+0000 7f320659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.047+0000 7f320659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44508/0 (socket says 172.21.15.52:44508) 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.047+0000 7f320659c640 1 -- 172.21.15.52:0/4207547494 learned_addr learned my addr 172.21.15.52:0/4207547494 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.047+0000 7f320659c640 1 -- 172.21.15.52:0/4207547494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32081088b0 con 0x7f32081076b0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.047+0000 7f320659c640 1 --2- 172.21.15.52:0/4207547494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009820 tx=0x7f31f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a59daf499060d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320559a640 1 -- 172.21.15.52:0/4207547494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f8037070 con 0x7f32081076b0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320559a640 1 -- 172.21.15.52:0/4207547494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31f8032900 con 0x7f32081076b0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320559a640 1 -- 172.21.15.52:0/4207547494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f8030850 con 0x7f32081076b0 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 -- 172.21.15.52:0/4207547494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 msgr2=0x7f3208107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 --2- 172.21.15.52:0/4207547494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009820 tx=0x7f31f802a270 comp rx=0 tx=0).stop 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 -- 172.21.15.52:0/4207547494 shutdown_connections 2024-09-19T09:11:40.695 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 --2- 172.21.15.52:0/4207547494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f3208107ab0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 -- 172.21.15.52:0/4207547494 >> 172.21.15.52:0/4207547494 conn(0x7f3208102e80 msgr2=0x7f32081052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 -- 172.21.15.52:0/4207547494 shutdown_connections 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.048+0000 7f320cb43640 1 -- 172.21.15.52:0/4207547494 wait complete. 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320cb43640 1 Processor -- start 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320cb43640 1 -- start start 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320cb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320cb43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f320810bc60 con 0x7f32081076b0 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44520/0 (socket says 172.21.15.52:44520) 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.049+0000 7f320659c640 1 -- 172.21.15.52:0/1214482287 learned_addr learned my addr 172.21.15.52:0/1214482287 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f320659c640 1 -- 172.21.15.52:0/1214482287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320819bba0 con 0x7f32081076b0 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f320659c640 1 --2- 172.21.15.52:0/1214482287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009940 tx=0x7f31f8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:40.696 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f8042070 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31f80308c0 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320819be30 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f8037040 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320819eb20 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f31f8045070 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.050+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f31f8047bc0 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.051+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3208107b30 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.053+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f31f80327b0 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.113+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f320819f0a0 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.114+0000 7f31f77fe640 1 -- 172.21.15.52:0/1214482287 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f31f803c800 con 0x7f32081076b0 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.114+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 msgr2=0x7f320819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:40.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.114+0000 7f320cb43640 1 --2- 172.21.15.52:0/1214482287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009940 tx=0x7f31f8032ce0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.115+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 shutdown_connections 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.115+0000 7f320cb43640 1 --2- 172.21.15.52:0/1214482287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32081076b0 0x7f320819b660 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.115+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 >> 172.21.15.52:0/1214482287 conn(0x7f3208102e80 msgr2=0x7f32081039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.115+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 shutdown_connections 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:40.115+0000 7f320cb43640 1 -- 172.21.15.52:0/1214482287 wait complete. 2024-09-19T09:11:40.698 INFO:teuthology.orchestra.run.smithi052.stdout:Restarting the monitor... 2024-09-19T09:11:40.991 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:40 smithi052 systemd[1]: Stopping Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:11:41.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:40 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a[30571]: 2024-09-19T09:11:40.990+0000 7fd87e13d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:11:41.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:40 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a[30571]: 2024-09-19T09:11:40.990+0000 7fd87e13d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:11:41.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 podman[30829]: 2024-09-19 09:11:41.216144537 +0000 UTC m=+0.331071478 container died 24ce34b9b5adce4d7084b28d3fe81fc3023c82749c8ed0969b24d00ee203a5e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:11:41.749 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 podman[30829]: 2024-09-19 09:11:41.548941587 +0000 UTC m=+0.663868528 container cleanup 24ce34b9b5adce4d7084b28d3fe81fc3023c82749c8ed0969b24d00ee203a5e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:11:41.750 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 bash[30829]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:11:42.099 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 podman[30842]: 2024-09-19 09:11:41.750179439 +0000 UTC m=+0.535783627 container remove 24ce34b9b5adce4d7084b28d3fe81fc3023c82749c8ed0969b24d00ee203a5e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:11:42.099 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T09:11:42.099 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 systemd[1]: Stopped Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:11:42.099 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:41 smithi052 systemd[1]: Starting Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:11:42.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 podman[30929]: 2024-09-19 09:11:42.002411155 +0000 UTC m=+0.015998603 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:11:42.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 podman[30929]: 2024-09-19 09:11:42.100863127 +0000 UTC m=+0.114450565 container create 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:11:42.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 podman[30929]: 2024-09-19 09:11:42.305111454 +0000 UTC m=+0.318698895 container init 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:11:42.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 podman[30929]: 2024-09-19 09:11:42.308328508 +0000 UTC m=+0.321915947 container start 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: pidfile_write: ignore empty --pid-file 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: load: jerasure load: lrc 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Git sha 0 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: DB SUMMARY 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: DB Session ID: 707QUDD9GID8E2ROL981 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:11:42.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105630 ; 2024-09-19T09:11:42.389 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:11:42.390 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.env: 0x55efee231940 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.info_log: 0x55efef2416e0 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.statistics: (nil) 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.use_fsync: 0 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:11:42.391 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.db_log_dir: 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.wal_dir: 2024-09-19T09:11:42.392 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.write_buffer_manager: 0x55efef250dc0 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:11:42.393 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.unordered_write: 0 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.row_cache: None 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.wal_filter: None 2024-09-19T09:11:42.394 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.wal_compression: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:11:42.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:11:42.396 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_open_files: -1 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Compression algorithms supported: 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kZSTD supported: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:11:42.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.merge_operator: 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_filter: None 2024-09-19T09:11:42.398 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55efef241320) 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: index_type: 0 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: data_block_index_type: 0 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: index_shortening: 1 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:11:42.399 INFO:journalctl@ceph.mon.a.smithi052.stdout: checksum: 4 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: no_block_cache: 0 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_cache: 0x55efef2351f0 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_cache_options: 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: capacity : 536870912 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: num_shard_bits : 4 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: strict_capacity_limit : 0 2024-09-19T09:11:42.400 INFO:journalctl@ceph.mon.a.smithi052.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_cache_compressed: (nil) 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: persistent_cache: (nil) 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_size: 4096 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_size_deviation: 10 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_restart_interval: 16 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: index_block_restart_interval: 1 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: metadata_block_size: 4096 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: partition_filters: 0 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: use_delta_encoding: 1 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: filter_policy: bloomfilter 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: whole_key_filtering: 1 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: verify_compression: 0 2024-09-19T09:11:42.401 INFO:journalctl@ceph.mon.a.smithi052.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: format_version: 5 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: enable_index_compression: 1 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: block_align: 0 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: max_auto_readahead_size: 262144 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: prepopulate_block_cache: 0 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:11:42.402 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression: NoCompression 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.num_levels: 7 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:11:42.403 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:11:42.404 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:11:42.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:11:42.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:11:42.407 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:11:42.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.ttl: 2592000 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:11:42.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3a210169-7f1b-4914-9911-231f0a8fdc9c 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737102335262, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737102336465, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100618, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98512, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14397, "raw_average_key_size": 49, "raw_value_size": 90758, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726737102, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3a210169-7f1b-4914-9911-231f0a8fdc9c", "db_session_id": "707QUDD9GID8E2ROL981", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726737102336565, "job": 1, "event": "recovery_finished"} 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T09:11:42.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55efef262e00 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: DB pointer 0x55efef35e000 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout: ** DB Stats ** 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:11:42.411 INFO:journalctl@ceph.mon.a.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: L0 2/0 100.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Sum 2/0 100.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-19T09:11:42.412 INFO:journalctl@ceph.mon.a.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Cumulative compaction: 0.00 GB write, 28.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Interval compaction: 0.00 GB write, 28.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:11:42.413 INFO:journalctl@ceph.mon.a.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: Block cache BinnedLRUCache@0x55efef2351f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: starting mon.a rank 0 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???) e1 preinit fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).mds e1 new map 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).mds e1 print_map 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: e1 2024-09-19T09:11:42.414 INFO:journalctl@ceph.mon.a.smithi052.stdout: btime 2024-09-19T09:11:37:433536+0000 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout: legacy client fscid: -1 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout: 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout: No filesystems configured 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 bash[30929]: 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 2024-09-19T09:11:42.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 systemd[1]: Started Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:11:42.416 INFO:teuthology.orchestra.run.smithi052.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:11:42.660 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:11:42.660 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: monmap epoch 1 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: last_changed 2024-09-19T09:11:34.459294+0000 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: election_strategy: 1 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: fsmap 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:11:42.661 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:42 smithi052 ceph-mon[30947]: mgrmap e1: no daemons active 2024-09-19T09:11:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:43 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2572521967' entity='client.admin' 2024-09-19T09:11:47.435 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.842+0000 7f2bfbad7640 1 Processor -- start 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.842+0000 7f2bfbad7640 1 -- start start 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.842+0000 7f2bfbad7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.842+0000 7f2bfbad7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4108080 con 0x7f2bf41076b0 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.843+0000 7f2bf9873640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.843+0000 7f2bf9873640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44530/0 (socket says 172.21.15.52:44530) 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.843+0000 7f2bf9873640 1 -- 172.21.15.52:0/98198723 learned_addr learned my addr 172.21.15.52:0/98198723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.843+0000 7f2bf9873640 1 -- 172.21.15.52:0/98198723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41088b0 con 0x7f2bf41076b0 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.845+0000 7f2bf9873640 1 --2- 172.21.15.52:0/98198723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009820 tx=0x7f2bf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f673ade7ef71cbff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:47.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.845+0000 7f2bf8871640 1 -- 172.21.15.52:0/98198723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0037070 con 0x7f2bf41076b0 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.845+0000 7f2bf8871640 1 -- 172.21.15.52:0/98198723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bf0032900 con 0x7f2bf41076b0 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.845+0000 7f2bf8871640 1 -- 172.21.15.52:0/98198723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0030850 con 0x7f2bf41076b0 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- 172.21.15.52:0/98198723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 msgr2=0x7f2bf4107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 --2- 172.21.15.52:0/98198723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009820 tx=0x7f2bf002a270 comp rx=0 tx=0).stop 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- 172.21.15.52:0/98198723 shutdown_connections 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 --2- 172.21.15.52:0/98198723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf4107ab0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- 172.21.15.52:0/98198723 >> 172.21.15.52:0/98198723 conn(0x7f2bf4102e80 msgr2=0x7f2bf41052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- 172.21.15.52:0/98198723 shutdown_connections 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- 172.21.15.52:0/98198723 wait complete. 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 Processor -- start 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- start start 2024-09-19T09:11:47.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.846+0000 7f2bfbad7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410bc60 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bf9873640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bf9873640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44544/0 (socket says 172.21.15.52:44544) 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bf9873640 1 -- 172.21.15.52:0/2572521967 learned_addr learned my addr 172.21.15.52:0/2572521967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bf9873640 1 -- 172.21.15.52:0/2572521967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf419bba0 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bf9873640 1 --2- 172.21.15.52:0/2572521967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009940 tx=0x7f2bf0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0042070 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2bf00308c0 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf0037040 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf419be30 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.847+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf419eb20 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.848+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2bf0045070 con 0x7f2bf41076b0 2024-09-19T09:11:47.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.848+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2bf00463b0 con 0x7f2bf41076b0 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.848+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf4107b30 con 0x7f2bf41076b0 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.851+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2bf00327b0 con 0x7f2bf41076b0 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.910+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f2bf419f100 con 0x7f2bf41076b0 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.912+0000 7f2beaffd640 1 -- 172.21.15.52:0/2572521967 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f2bf0047440 con 0x7f2bf41076b0 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 msgr2=0x7f2bf419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 --2- 172.21.15.52:0/2572521967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009940 tx=0x7f2bf0032ce0 comp rx=0 tx=0).stop 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 shutdown_connections 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 --2- 172.21.15.52:0/2572521967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bf41076b0 0x7f2bf419b660 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 >> 172.21.15.52:0/2572521967 conn(0x7f2bf4102e80 msgr2=0x7f2bf41039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 shutdown_connections 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:42.913+0000 7f2bfbad7640 1 -- 172.21.15.52:0/2572521967 wait complete. 2024-09-19T09:11:47.443 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:11:47.637 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:11:47.637 INFO:teuthology.orchestra.run.smithi052.stdout:Creating mgr... 2024-09-19T09:11:47.638 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:11:47.638 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:11:48.802 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:11:48.802 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T09:11:49.149 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968.target.wants/ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-044f38fa-7667-11ef-bceb-c7b262605968@.service. 2024-09-19T09:11:49.429 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:49 smithi052 podman[31158]: 2024-09-19 09:11:49.286610656 +0000 UTC m=+0.016575726 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:11:50.002 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:49 smithi052 podman[31158]: 2024-09-19 09:11:49.700760899 +0000 UTC m=+0.430725984 container create 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:11:50.002 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:49 smithi052 podman[31158]: 2024-09-19 09:11:49.919698128 +0000 UTC m=+0.649663187 container init 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:11:50.002 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:49 smithi052 podman[31158]: 2024-09-19 09:11:49.922378604 +0000 UTC m=+0.652343644 container start 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T09:11:50.019 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:11:50.019 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-19T09:11:50.028 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:11:50.029 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:11:50.029 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-19T09:11:50.029 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:11:50.039 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:11:50.040 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-19T09:11:50.047 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:11:50.048 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:11:50.048 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-19T09:11:50.048 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T09:11:50.048 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr to start... 2024-09-19T09:11:50.048 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr... 2024-09-19T09:11:50.273 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 bash[31158]: 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 2024-09-19T09:11:50.273 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 systemd[1]: Started Ceph mgr.x for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:11:50.273 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.055+0000 7f27de82d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:11:50.274 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.118+0000 7f27de82d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:11:50.541 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.279+0000 7f27de82d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:11:50.541 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.348+0000 7f27de82d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:11:50.541 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.508+0000 7f27de82d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:11:50.900 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/14555893' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:11:50.900 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.660+0000 7f27de82d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:11:51.179 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:50.996+0000 7f27de82d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:11:51.179 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:51.060+0000 7f27de82d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:11:51.214 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:11:51.215 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:11:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:11:51.225 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:11:37:433536+0000", 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:11:51.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:11:37.434170+0000", 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.468+0000 7fa084806640 1 Processor -- start 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.468+0000 7fa084806640 1 -- start start 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa084806640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa084806640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa08007bed0 con 0x7fa080108130 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58890/0 (socket says 172.21.15.52:58890) 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa07e59c640 1 -- 172.21.15.52:0/1037259469 learned_addr learned my addr 172.21.15.52:0/1037259469 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:51.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.469+0000 7fa07e59c640 1 -- 172.21.15.52:0/1037259469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08010aa60 con 0x7fa080108130 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.470+0000 7fa07e59c640 1 --2- 172.21.15.52:0/1037259469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa070009e80 tx=0x7fa07002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1936a3cc3fdb691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.470+0000 7fa07d59a640 1 -- 172.21.15.52:0/1037259469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070036070 con 0x7fa080108130 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.470+0000 7fa07d59a640 1 -- 172.21.15.52:0/1037259469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0700318c0 con 0x7fa080108130 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.470+0000 7fa07d59a640 1 -- 172.21.15.52:0/1037259469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070007ab0 con 0x7fa080108130 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.471+0000 7fa084806640 1 -- 172.21.15.52:0/1037259469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 msgr2=0x7fa08010a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.471+0000 7fa084806640 1 --2- 172.21.15.52:0/1037259469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa070009e80 tx=0x7fa07002a7a0 comp rx=0 tx=0).stop 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.471+0000 7fa084806640 1 -- 172.21.15.52:0/1037259469 shutdown_connections 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.471+0000 7fa084806640 1 --2- 172.21.15.52:0/1037259469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa08010a520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.471+0000 7fa084806640 1 -- 172.21.15.52:0/1037259469 >> 172.21.15.52:0/1037259469 conn(0x7fa080101d70 msgr2=0x7fa080104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.472+0000 7fa084806640 1 -- 172.21.15.52:0/1037259469 shutdown_connections 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.472+0000 7fa084806640 1 -- 172.21.15.52:0/1037259469 wait complete. 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.472+0000 7fa084806640 1 Processor -- start 2024-09-19T09:11:51.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.472+0000 7fa084806640 1 -- start start 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa084806640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa084806640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa08010ba90 con 0x7fa080108130 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa07e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58900/0 (socket says 172.21.15.52:58900) 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa07e59c640 1 -- 172.21.15.52:0/14555893 learned_addr learned my addr 172.21.15.52:0/14555893 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa07e59c640 1 -- 172.21.15.52:0/14555893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa080107ef0 con 0x7fa080108130 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa07e59c640 1 --2- 172.21.15.52:0/14555893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa070031ca0 tx=0x7fa070031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:51.233 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070036050 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa070042070 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07003d820 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.473+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0801060e0 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.474+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa080106620 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.474+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa07003dad0 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.474+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa070007e00 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.475+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa080108590 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.477+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa0700072f0 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.539+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa080106960 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.540+0000 7fa06f7fe640 1 -- 172.21.15.52:0/14555893 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa070047460 con 0x7fa080108130 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 msgr2=0x7fa0801079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 --2- 172.21.15.52:0/14555893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa070031ca0 tx=0x7fa070031cd0 comp rx=0 tx=0).stop 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 shutdown_connections 2024-09-19T09:11:51.234 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 --2- 172.21.15.52:0/14555893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa080108130 0x7fa0801079b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:51.235 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 >> 172.21.15.52:0/14555893 conn(0x7fa080101d70 msgr2=0x7fa080102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:51.235 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 shutdown_connections 2024-09-19T09:11:51.235 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:50.541+0000 7fa084806640 1 -- 172.21.15.52:0/14555893 wait complete. 2024-09-19T09:11:51.235 INFO:teuthology.orchestra.run.smithi052.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:11:51.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:51.257+0000 7f27de82d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:11:52.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:52.189+0000 7f27de82d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:11:52.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:52.260+0000 7f27de82d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:11:53.297 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.022+0000 7f27de82d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:11:53.297 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.143+0000 7f27de82d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:11:53.571 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.296+0000 7f27de82d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:11:53.571 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.360+0000 7f27de82d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:11:53.571 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.520+0000 7f27de82d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:11:53.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2165897241' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:11:53.831 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.593+0000 7f27de82d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:11:53.831 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.659+0000 7f27de82d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:11:53.831 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.829+0000 7f27de82d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:11:54.091 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.902+0000 7f27de82d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:11:54.091 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:53.972+0000 7f27de82d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:11:54.091 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:54.060+0000 7f27de82d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:11:54.409 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:54.123+0000 7f27de82d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:11:54.409 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:54.185+0000 7f27de82d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:11:54.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:11:54.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:11:54.416 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:11:54.417 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:11:54.426 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:11:37:433536+0000", 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:11:54.427 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:11:54.428 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:11:37.434170+0000", 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.649+0000 7fd328d12640 1 Processor -- start 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.649+0000 7fd328d12640 1 -- start start 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd328d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd328d12640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd32407bed0 con 0x7fd324108130 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd32259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd32259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58906/0 (socket says 172.21.15.52:58906) 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd32259c640 1 -- 172.21.15.52:0/42286421 learned_addr learned my addr 172.21.15.52:0/42286421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.650+0000 7fd32259c640 1 -- 172.21.15.52:0/42286421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32410aa60 con 0x7fd324108130 2024-09-19T09:11:54.429 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.651+0000 7fd32259c640 1 --2- 172.21.15.52:0/42286421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd314009820 tx=0x7fd31402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a8ccbb8db26a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.651+0000 7fd32159a640 1 -- 172.21.15.52:0/42286421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314037070 con 0x7fd324108130 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.651+0000 7fd32159a640 1 -- 172.21.15.52:0/42286421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd314032900 con 0x7fd324108130 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.651+0000 7fd32159a640 1 -- 172.21.15.52:0/42286421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314030850 con 0x7fd324108130 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 -- 172.21.15.52:0/42286421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 msgr2=0x7fd32410a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 --2- 172.21.15.52:0/42286421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd314009820 tx=0x7fd31402a270 comp rx=0 tx=0).stop 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 -- 172.21.15.52:0/42286421 shutdown_connections 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 --2- 172.21.15.52:0/42286421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd32410a520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.430 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 -- 172.21.15.52:0/42286421 >> 172.21.15.52:0/42286421 conn(0x7fd324101d70 msgr2=0x7fd324104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 -- 172.21.15.52:0/42286421 shutdown_connections 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 -- 172.21.15.52:0/42286421 wait complete. 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.652+0000 7fd328d12640 1 Processor -- start 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd328d12640 1 -- start start 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd328d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd328d12640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd32410ba90 con 0x7fd324108130 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd32259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd32259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58916/0 (socket says 172.21.15.52:58916) 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd32259c640 1 -- 172.21.15.52:0/2165897241 learned_addr learned my addr 172.21.15.52:0/2165897241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd32259c640 1 -- 172.21.15.52:0/2165897241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd324107ef0 con 0x7fd324108130 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd32259c640 1 --2- 172.21.15.52:0/2165897241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd314032ce0 tx=0x7fd314032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314042070 con 0x7fd324108130 2024-09-19T09:11:54.431 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.653+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3140308c0 con 0x7fd324108130 2024-09-19T09:11:54.432 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.654+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3241060e0 con 0x7fd324108130 2024-09-19T09:11:54.432 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.654+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314037040 con 0x7fd324108130 2024-09-19T09:11:54.432 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.654+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd324106620 con 0x7fd324108130 2024-09-19T09:11:54.432 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.654+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd314045070 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.654+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd314047b80 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.655+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd324108590 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.657+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd314047e20 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.719+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd324106b50 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.720+0000 7fd3137fe640 1 -- 172.21.15.52:0/2165897241 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7fd31403c740 con 0x7fd324108130 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 msgr2=0x7fd3241079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 --2- 172.21.15.52:0/2165897241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd314032ce0 tx=0x7fd314032d10 comp rx=0 tx=0).stop 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 shutdown_connections 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 --2- 172.21.15.52:0/2165897241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd324108130 0x7fd3241079b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:54.433 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 >> 172.21.15.52:0/2165897241 conn(0x7fd324101d70 msgr2=0x7fd324102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:54.434 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 shutdown_connections 2024-09-19T09:11:54.434 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:53.721+0000 7fd328d12640 1 -- 172.21.15.52:0/2165897241 wait complete. 2024-09-19T09:11:54.434 INFO:teuthology.orchestra.run.smithi052.stdout:mgr not available, waiting (2/15)... 2024-09-19T09:11:55.429 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:11:55.022+0000 7f27de82d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:11:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: Activating manager daemon x 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: mgrmap e2: x(active, starting, since 0.00325018s) 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: Manager daemon x is now available 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:11:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' 2024-09-19T09:11:55.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' 2024-09-19T09:11:55.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:55 smithi052 ceph-mon[30947]: from='mgr.14100 172.21.15.52:0/2462402473' entity='mgr.x' 2024-09-19T09:11:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:57 smithi052 ceph-mon[30947]: mgrmap e3: x(active, since 1.00699s) 2024-09-19T09:11:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:58 smithi052 ceph-mon[30947]: mgrmap e4: x(active, since 2s) 2024-09-19T09:12:00.126 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:11:59 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1952282663' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:12:00.396 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:12:00.398 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:12:00.398 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:12:00.399 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:12:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:12:00.408 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:12:00.408 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:12:00.408 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:12:00.409 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:11:37:433536+0000", 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:12:00.410 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:11:37.434170+0000", 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.554+0000 7ff9ffa8e640 1 Processor -- start 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.554+0000 7ff9ffa8e640 1 -- start start 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.554+0000 7ff9ffa8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.554+0000 7ff9ffa8e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f8108080 con 0x7ff9f81076b0 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.555+0000 7ff9fd82a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.555+0000 7ff9fd82a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60804/0 (socket says 172.21.15.52:60804) 2024-09-19T09:12:00.411 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.555+0000 7ff9fd82a640 1 -- 172.21.15.52:0/361147294 learned_addr learned my addr 172.21.15.52:0/361147294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.555+0000 7ff9fd82a640 1 -- 172.21.15.52:0/361147294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f81088b0 con 0x7ff9f81076b0 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.556+0000 7ff9fd82a640 1 --2- 172.21.15.52:0/361147294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009820 tx=0x7ff9f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1379ce6ff5d95201 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.556+0000 7ff9fc828640 1 -- 172.21.15.52:0/361147294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4037070 con 0x7ff9f81076b0 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.556+0000 7ff9fc828640 1 -- 172.21.15.52:0/361147294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9f4032900 con 0x7ff9f81076b0 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.556+0000 7ff9fc828640 1 -- 172.21.15.52:0/361147294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4030850 con 0x7ff9f81076b0 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/361147294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 msgr2=0x7ff9f8107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/361147294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4009820 tx=0x7ff9f402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/361147294 shutdown_connections 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/361147294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f8107ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/361147294 >> 172.21.15.52:0/361147294 conn(0x7ff9f8102e80 msgr2=0x7ff9f81052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/361147294 shutdown_connections 2024-09-19T09:12:00.412 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.557+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/361147294 wait complete. 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9ffa8e640 1 Processor -- start 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9ffa8e640 1 -- start start 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9ffa8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9ffa8e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f810bc60 con 0x7ff9f81076b0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9fd82a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9fd82a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60818/0 (socket says 172.21.15.52:60818) 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9fd82a640 1 -- 172.21.15.52:0/1952282663 learned_addr learned my addr 172.21.15.52:0/1952282663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9fd82a640 1 -- 172.21.15.52:0/1952282663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f807e0d0 con 0x7ff9f81076b0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.558+0000 7ff9fd82a640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097f0 tx=0x7ff9f4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.559+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4037040 con 0x7ff9f81076b0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.559+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9f4040070 con 0x7ff9f81076b0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.559+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f403a390 con 0x7ff9f81076b0 2024-09-19T09:12:00.413 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.559+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f807c2c0 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.559+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f807c7a0 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.560+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ff9f403a5e0 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.560+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f8107b30 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.560+0000 7ff9eeffd640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 0x7ff9e403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.560+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff9f406c4c0 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.560+0000 7ff9fd029640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 0x7ff9e403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.561+0000 7ff9fd029640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 0x7ff9e403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80098c0 tx=0x7ff9e8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.565+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9f403a980 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.806+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff9f807cfe0 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.806+0000 7ff9eeffd640 1 -- 172.21.15.52:0/1952282663 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff9f406c220 con 0x7ff9f81076b0 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.808+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 msgr2=0x7ff9e403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.808+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 0x7ff9e403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80098c0 tx=0x7ff9e8006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.808+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 msgr2=0x7ff9f807db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:00.414 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.808+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40097f0 tx=0x7ff9f4030d80 comp rx=0 tx=0).stop 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 shutdown_connections 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7ff9e40391b0 0x7ff9e403b670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 --2- 172.21.15.52:0/1952282663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9f81076b0 0x7ff9f807db90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 >> 172.21.15.52:0/1952282663 conn(0x7ff9f8102e80 msgr2=0x7ff9f81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 shutdown_connections 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:11:59.809+0000 7ff9ffa8e640 1 -- 172.21.15.52:0/1952282663 wait complete. 2024-09-19T09:12:00.415 INFO:teuthology.orchestra.run.smithi052.stdout:mgr is available 2024-09-19T09:12:01.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3517862390' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:12:02.118 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:12:02.118 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout fsid = 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:12:02.119 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.373+0000 7f199cddd640 1 Processor -- start 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.373+0000 7f199cddd640 1 -- start start 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199cddd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199cddd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f199807be50 con 0x7f19981081b0 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60822/0 (socket says 172.21.15.52:60822) 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199659c640 1 -- 172.21.15.52:0/3123924781 learned_addr learned my addr 172.21.15.52:0/3123924781 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.374+0000 7f199659c640 1 -- 172.21.15.52:0/3123924781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199810aae0 con 0x7f19981081b0 2024-09-19T09:12:02.120 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199659c640 1 --2- 172.21.15.52:0/3123924781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1988009e80 tx=0x7f198802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4049c8c3d7115b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199559a640 1 -- 172.21.15.52:0/3123924781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1988036070 con 0x7f19981081b0 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199559a640 1 -- 172.21.15.52:0/3123924781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19880318c0 con 0x7f19981081b0 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199559a640 1 -- 172.21.15.52:0/3123924781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1988007ab0 con 0x7f19981081b0 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199cddd640 1 -- 172.21.15.52:0/3123924781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 msgr2=0x7f199810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.375+0000 7f199cddd640 1 --2- 172.21.15.52:0/3123924781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1988009e80 tx=0x7f198802a7a0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 -- 172.21.15.52:0/3123924781 shutdown_connections 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 --2- 172.21.15.52:0/3123924781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199810a5a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 -- 172.21.15.52:0/3123924781 >> 172.21.15.52:0/3123924781 conn(0x7f1998101d70 msgr2=0x7f1998104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 -- 172.21.15.52:0/3123924781 shutdown_connections 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 -- 172.21.15.52:0/3123924781 wait complete. 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.376+0000 7f199cddd640 1 Processor -- start 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199cddd640 1 -- start start 2024-09-19T09:12:02.121 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199cddd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199cddd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f199810ba50 con 0x7f19981081b0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60828/0 (socket says 172.21.15.52:60828) 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199659c640 1 -- 172.21.15.52:0/3517862390 learned_addr learned my addr 172.21.15.52:0/3517862390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199659c640 1 -- 172.21.15.52:0/3517862390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199819bb90 con 0x7f19981081b0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f199659c640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f198802acc0 tx=0x7f1988031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.377+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1988036050 con 0x7f19981081b0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.378+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1988037040 con 0x7f19981081b0 2024-09-19T09:12:02.122 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.378+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f198803d850 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.378+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199819be20 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.378+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199819eb10 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.378+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f1988044020 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.379+0000 7f19877fe640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 0x7f198003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.379+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1998108610 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.379+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1988042020 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.379+0000 7f1995d9b640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 0x7f198003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.379+0000 7f1995d9b640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 0x7f198003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098c0 tx=0x7f198c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.384+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f198804b020 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.562+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f19981a02e0 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.563+0000 7f19877fe640 1 -- 172.21.15.52:0/3517862390 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f198806c7e0 con 0x7f19981081b0 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 msgr2=0x7f198003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:02.123 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 0x7f198003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f198c0098c0 tx=0x7f198c006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 msgr2=0x7f199819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f198802acc0 tx=0x7f1988031ca0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 shutdown_connections 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f19800391b0 0x7f198003b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 --2- 172.21.15.52:0/3517862390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19981081b0 0x7f199819b650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.565+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 >> 172.21.15.52:0/3517862390 conn(0x7f1998101d70 msgr2=0x7f1998102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.566+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 shutdown_connections 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:01.566+0000 7f199cddd640 1 -- 172.21.15.52:0/3517862390 wait complete. 2024-09-19T09:12:02.124 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling cephadm module... 2024-09-19T09:12:03.023 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:02 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4023405755' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:12:03.023 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ignoring --setuser ceph since I am not root 2024-09-19T09:12:03.024 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ignoring --setgroup ceph since I am not root 2024-09-19T09:12:03.024 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:02.962+0000 7f4f85623040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:12:03.024 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.022+0000 7f4f85623040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:12:03.358 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.176+0000 7f4f85623040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:12:03.358 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.245+0000 7f4f85623040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd487eef640 1 Processor -- start 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd487eef640 1 -- start start 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd487eef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd487eef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd480108080 con 0x7fd4801076b0 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd485c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd485c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60842/0 (socket says 172.21.15.52:60842) 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd485c8b640 1 -- 172.21.15.52:0/1467449037 learned_addr learned my addr 172.21.15.52:0/1467449037 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:03.365 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.529+0000 7fd485c8b640 1 -- 172.21.15.52:0/1467449037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4801088b0 con 0x7fd4801076b0 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.530+0000 7fd485c8b640 1 --2- 172.21.15.52:0/1467449037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009820 tx=0x7fd47c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7137537689b58021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.530+0000 7fd484c89640 1 -- 172.21.15.52:0/1467449037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd47c037070 con 0x7fd4801076b0 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.530+0000 7fd484c89640 1 -- 172.21.15.52:0/1467449037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd47c032900 con 0x7fd4801076b0 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.530+0000 7fd484c89640 1 -- 172.21.15.52:0/1467449037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd47c030850 con 0x7fd4801076b0 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 -- 172.21.15.52:0/1467449037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 msgr2=0x7fd480107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 --2- 172.21.15.52:0/1467449037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009820 tx=0x7fd47c02a270 comp rx=0 tx=0).stop 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 -- 172.21.15.52:0/1467449037 shutdown_connections 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 --2- 172.21.15.52:0/1467449037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd480107ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 -- 172.21.15.52:0/1467449037 >> 172.21.15.52:0/1467449037 conn(0x7fd480102e80 msgr2=0x7fd4801052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 -- 172.21.15.52:0/1467449037 shutdown_connections 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.531+0000 7fd487eef640 1 -- 172.21.15.52:0/1467449037 wait complete. 2024-09-19T09:12:03.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd487eef640 1 Processor -- start 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd487eef640 1 -- start start 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd487eef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd487eef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd48010bc60 con 0x7fd4801076b0 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd485c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd485c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60854/0 (socket says 172.21.15.52:60854) 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd485c8b640 1 -- 172.21.15.52:0/4023405755 learned_addr learned my addr 172.21.15.52:0/4023405755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd485c8b640 1 -- 172.21.15.52:0/4023405755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48019bba0 con 0x7fd4801076b0 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.532+0000 7fd485c8b640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097f0 tx=0x7fd47c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.533+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd47c037040 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.533+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd47c040070 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.533+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48019be30 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.533+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd47c03a390 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.533+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48019eb20 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd47c03a5e0 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd476ffd640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 0x7fd46c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd47c06c3a0 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd480107b30 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd48548a640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 0x7fd46c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.534+0000 7fd48548a640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 0x7fd46c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4700098c0 tx=0x7fd470006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.539+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd47c06c100 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.766+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd48019f070 con 0x7fd4801076b0 2024-09-19T09:12:03.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.817+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd47c03a8d0 con 0x7fd4801076b0 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.819+0000 7fd476ffd640 1 -- 172.21.15.52:0/4023405755 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd47c02fd60 con 0x7fd4801076b0 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 msgr2=0x7fd46c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 0x7fd46c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd4700098c0 tx=0x7fd470006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 msgr2=0x7fd48019b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0097f0 tx=0x7fd47c030d80 comp rx=0 tx=0).stop 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 shutdown_connections 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7fd46c0391b0 0x7fd46c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 --2- 172.21.15.52:0/4023405755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4801076b0 0x7fd48019b660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.820+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 >> 172.21.15.52:0/4023405755 conn(0x7fd480102e80 msgr2=0x7fd480103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.821+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 shutdown_connections 2024-09-19T09:12:03.369 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:02.821+0000 7fd487eef640 1 -- 172.21.15.52:0/4023405755 wait complete. 2024-09-19T09:12:03.609 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.409+0000 7f4f85623040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:12:03.609 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.557+0000 7f4f85623040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:12:03.896 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4023405755' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:12:03.897 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-mon[30947]: mgrmap e5: x(active, since 7s) 2024-09-19T09:12:04.164 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.895+0000 7f4f85623040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:12:04.164 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:03.960+0000 7f4f85623040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:12:04.164 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:04.163+0000 7f4f85623040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:12:04.581 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.772+0000 7f7d7f848640 1 Processor -- start 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.772+0000 7f7d7f848640 1 -- start start 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7f848640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.582 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7f848640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d781080e0 con 0x7f7d78107710 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7d5e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7d5e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60884/0 (socket says 172.21.15.52:60884) 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7d5e4640 1 -- 172.21.15.52:0/2517063368 learned_addr learned my addr 172.21.15.52:0/2517063368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.773+0000 7f7d7d5e4640 1 -- 172.21.15.52:0/2517063368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78108910 con 0x7f7d78107710 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.774+0000 7f7d7d5e4640 1 --2- 172.21.15.52:0/2517063368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009820 tx=0x7f7d7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8a71900e2243ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.774+0000 7f7d6ffff640 1 -- 172.21.15.52:0/2517063368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d74037070 con 0x7f7d78107710 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.774+0000 7f7d6ffff640 1 -- 172.21.15.52:0/2517063368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d74032900 con 0x7f7d78107710 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.774+0000 7f7d6ffff640 1 -- 172.21.15.52:0/2517063368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d74030850 con 0x7f7d78107710 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 -- 172.21.15.52:0/2517063368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 msgr2=0x7f7d78107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.583 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 --2- 172.21.15.52:0/2517063368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009820 tx=0x7f7d7402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 -- 172.21.15.52:0/2517063368 shutdown_connections 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 --2- 172.21.15.52:0/2517063368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d78107b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 -- 172.21.15.52:0/2517063368 >> 172.21.15.52:0/2517063368 conn(0x7f7d78102ec0 msgr2=0x7f7d781052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 -- 172.21.15.52:0/2517063368 shutdown_connections 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.775+0000 7f7d7f848640 1 -- 172.21.15.52:0/2517063368 wait complete. 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7f848640 1 Processor -- start 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7f848640 1 -- start start 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7f848640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7f848640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7810bcc0 con 0x7f7d78107710 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7d5e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7d5e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60888/0 (socket says 172.21.15.52:60888) 2024-09-19T09:12:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7d5e4640 1 -- 172.21.15.52:0/1255163342 learned_addr learned my addr 172.21.15.52:0/1255163342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.776+0000 7f7d7d5e4640 1 -- 172.21.15.52:0/1255163342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7807e0d0 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d7d5e4640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009940 tx=0x7f7d74032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d74042070 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7807c2c0 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d740308c0 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d74037040 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.777+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7807c800 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f7d74045070 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d78107b90 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d6e7fc640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 0x7f7d6403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d7406c280 con 0x7f7d78107710 2024-09-19T09:12:04.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d7cde3640 1 -- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 msgr2=0x7f7d6403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.778+0000 7f7d7cde3640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 0x7f7d6403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.783+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d7404b170 con 0x7f7d78107710 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.979+0000 7f7d7cde3640 1 -- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 msgr2=0x7f7d6403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:03.979+0000 7f7d7cde3640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 0x7f7d6403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.007+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7d7807d040 con 0x7f7d78107710 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.007+0000 7f7d6e7fc640 1 -- 172.21.15.52:0/1255163342 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f7d7403cd90 con 0x7f7d78107710 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 msgr2=0x7f7d6403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 0x7f7d6403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 msgr2=0x7f7d7807db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009940 tx=0x7f7d74032ce0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 shutdown_connections 2024-09-19T09:12:04.586 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f7d640391b0 0x7f7d6403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 --2- 172.21.15.52:0/1255163342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d78107710 0x7f7d7807db90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 >> 172.21.15.52:0/1255163342 conn(0x7f7d78102ec0 msgr2=0x7f7d781039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 shutdown_connections 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.011+0000 7f7d7f848640 1 -- 172.21.15.52:0/1255163342 wait complete. 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for the mgr to restart... 2024-09-19T09:12:04.587 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr epoch 5... 2024-09-19T09:12:04.876 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1255163342' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:12:05.163 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:05.102+0000 7f4f85623040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:12:05.429 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:05.173+0000 7f4f85623040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:12:06.179 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:05.917+0000 7f4f85623040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:12:06.179 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.038+0000 7f4f85623040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:12:06.497 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.193+0000 7f4f85623040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:12:06.497 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.268+0000 7f4f85623040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:12:06.497 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.424+0000 7f4f85623040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:12:06.497 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.495+0000 7f4f85623040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:12:06.795 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.557+0000 7f4f85623040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:12:06.795 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.723+0000 7f4f85623040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:12:06.795 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.794+0000 7f4f85623040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:12:07.074 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.864+0000 7f4f85623040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:12:07.074 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:06.950+0000 7f4f85623040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:12:07.074 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:07.011+0000 7f4f85623040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:12:07.075 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:07.073+0000 7f4f85623040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:07.897+0000 7f4f85623040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: Active manager daemon x restarted 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: Activating manager daemon x 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: mgrmap e6: x(active, starting, since 0.00347459s) 2024-09-19T09:12:08.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: Manager daemon x is now available 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:12:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:07 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:12:09.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:08 smithi052 ceph-mon[30947]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:12:09.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:08 smithi052 ceph-mon[30947]: mgrmap e7: x(active, since 1.00554s) 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.955+0000 7f0a4fd03640 1 Processor -- start 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4fd03640 1 -- start start 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4fd03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4fd03640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4807bdf0 con 0x7f0a48108240 2024-09-19T09:12:09.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4da9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4da9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60902/0 (socket says 172.21.15.52:60902) 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4da9f640 1 -- 172.21.15.52:0/958051043 learned_addr learned my addr 172.21.15.52:0/958051043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.956+0000 7f0a4da9f640 1 -- 172.21.15.52:0/958051043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4810ab70 con 0x7f0a48108240 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.957+0000 7f0a4da9f640 1 --2- 172.21.15.52:0/958051043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009820 tx=0x7f0a4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe3c22784336996 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.957+0000 7f0a4ca9d640 1 -- 172.21.15.52:0/958051043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a44037070 con 0x7f0a48108240 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.957+0000 7f0a4ca9d640 1 -- 172.21.15.52:0/958051043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a44032900 con 0x7f0a48108240 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.957+0000 7f0a4ca9d640 1 -- 172.21.15.52:0/958051043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a44030850 con 0x7f0a48108240 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 -- 172.21.15.52:0/958051043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 msgr2=0x7f0a4810a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/958051043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009820 tx=0x7f0a4402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 -- 172.21.15.52:0/958051043 shutdown_connections 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/958051043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4810a630 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 -- 172.21.15.52:0/958051043 >> 172.21.15.52:0/958051043 conn(0x7f0a48101dc0 msgr2=0x7f0a481041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 -- 172.21.15.52:0/958051043 shutdown_connections 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.958+0000 7f0a4fd03640 1 -- 172.21.15.52:0/958051043 wait complete. 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4fd03640 1 Processor -- start 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4fd03640 1 -- start start 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4fd03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4fd03640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4810ba80 con 0x7f0a48108240 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4da9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4da9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60914/0 (socket says 172.21.15.52:60914) 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4da9f640 1 -- 172.21.15.52:0/1328256722 learned_addr learned my addr 172.21.15.52:0/1328256722 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4da9f640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4819bc10 con 0x7f0a48108240 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.959+0000 7f0a4da9f640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a44031000 tx=0x7f0a440326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.960+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a44042070 con 0x7f0a48108240 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.960+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4819bea0 con 0x7f0a48108240 2024-09-19T09:12:09.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.960+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a44032be0 con 0x7f0a48108240 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.960+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a44037040 con 0x7f0a48108240 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.960+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4819eb90 con 0x7f0a48108240 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f0a44045070 con 0x7f0a48108240 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a3affd640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0a3403bd80 con 0x7f0a340391b0 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a4d29e640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 msgr2=0x7f0a3403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0a4406c1d0 con 0x7f0a48108240 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:04.961+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:05.162+0000 7f0a4d29e640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 msgr2=0x7f0a3403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:05.162+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:05.563+0000 7f0a4d29e640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 msgr2=0x7f0a3403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:09.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:05.563+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:06.364+0000 7f0a4d29e640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 msgr2=0x7f0a3403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/3194006990 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:06.364+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:07.900+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f0a44039d80 con 0x7f0a48108240 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:07.901+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 msgr2=0x7f0a3403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:07.901+0000 7f0a3affd640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.902+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f0a4403d430 con 0x7f0a48108240 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.902+0000 7f0a3affd640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 0x7f0a3403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.902+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0a3403bd80 con 0x7f0a3403cae0 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.902+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 0x7f0a3403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.903+0000 7f0a4d29e640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 0x7f0a3403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c003980 tx=0x7f0a3c006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.904+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0a3403bd80 con 0x7f0a3403cae0 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.916+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0a481086a0 con 0x7f0a3403cae0 2024-09-19T09:12:09.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.916+0000 7f0a3affd640 1 -- 172.21.15.52:0/1328256722 <== mgr.14118 v2:172.21.15.52:6800/561717915 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0a481086a0 con 0x7f0a3403cae0 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 msgr2=0x7f0a3403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 0x7f0a3403eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c003980 tx=0x7f0a3c006e10 comp rx=0 tx=0).stop 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 msgr2=0x7f0a4819b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0a44031000 tx=0x7f0a440326e0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 shutdown_connections 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f0a3403cae0 0x7f0a3403eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:6800/3194006990,v1:172.21.15.52:6801/3194006990] conn(0x7f0a340391b0 0x7f0a3403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 --2- 172.21.15.52:0/1328256722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a48108240 0x7f0a4819b6d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 >> 172.21.15.52:0/1328256722 conn(0x7f0a48101dc0 msgr2=0x7f0a48102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 shutdown_connections 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:08.917+0000 7f0a4fd03640 1 -- 172.21.15.52:0/1328256722 wait complete. 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:mgr epoch 5 is available 2024-09-19T09:12:09.446 INFO:teuthology.orchestra.run.smithi052.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:12:10.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:09 smithi052 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:12:10.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:09 smithi052 ceph-mon[30947]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:12:10.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:09 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:10.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:09 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:10.409+0000 7f4eec93d640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:12:10] ENGINE Error in HTTPServer.serve 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: Traceback (most recent call last): 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._connections.run(self.expiration_interval) 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:12:10.680 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._run(expiration_interval) 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: s = self.context.wrap_socket( 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: return self.sslsocket_class._create( 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self.do_handshake() 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:12:10.681 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._sslobj.do_handshake() 2024-09-19T09:12:10.682 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:12:10.682 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:10.812 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1ed7c640 1 Processor -- start 2024-09-19T09:12:10.812 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1ed7c640 1 -- start start 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1ed7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1ed7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1807bed0 con 0x7f4f18108130 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1cb18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1cb18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43640/0 (socket says 172.21.15.52:43640) 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1cb18640 1 -- 172.21.15.52:0/4256412715 learned_addr learned my addr 172.21.15.52:0/4256412715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.828+0000 7f4f1cb18640 1 -- 172.21.15.52:0/4256412715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1810aa60 con 0x7f4f18108130 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.829+0000 7f4f1cb18640 1 --2- 172.21.15.52:0/4256412715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a2f4d37266c89b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:10.813 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f177fe640 1 -- 172.21.15.52:0/4256412715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c037070 con 0x7f4f18108130 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f177fe640 1 -- 172.21.15.52:0/4256412715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f0c032900 con 0x7f4f18108130 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f177fe640 1 -- 172.21.15.52:0/4256412715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c030850 con 0x7f4f18108130 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/4256412715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 msgr2=0x7f4f1810a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/4256412715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c02a270 comp rx=0 tx=0).stop 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/4256412715 shutdown_connections 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/4256412715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1810a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/4256412715 >> 172.21.15.52:0/4256412715 conn(0x7f4f18101d70 msgr2=0x7f4f18104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/4256412715 shutdown_connections 2024-09-19T09:12:10.814 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.830+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/4256412715 wait complete. 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1ed7c640 1 Processor -- start 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1ed7c640 1 -- start start 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1ed7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1ed7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1810ba90 con 0x7f4f18108130 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1cb18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1cb18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43646/0 (socket says 172.21.15.52:43646) 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.831+0000 7f4f1cb18640 1 -- 172.21.15.52:0/3486168873 learned_addr learned my addr 172.21.15.52:0/3486168873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f1cb18640 1 -- 172.21.15.52:0/3486168873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1819bb80 con 0x7f4f18108130 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f1cb18640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c037040 con 0x7f4f18108130 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f0c040070 con 0x7f4f18108130 2024-09-19T09:12:10.815 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1819be10 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f0c03a390 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.832+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1819eb00 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.833+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f4f0c03a5e0 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.833+0000 7f4f15ffb640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 0x7f4f0803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.833+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4f0c06c5b0 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.834+0000 7f4f17fff640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 0x7f4f0803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.834+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f18108590 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.834+0000 7f4f17fff640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 0x7f4f0803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f040098c0 tx=0x7f4f04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.839+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f0c03a920 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:09.974+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4f0c02fd60 con 0x7f4f18108130 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.045+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f4f18102ff0 con 0x7f4f080390f0 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.050+0000 7f4f15ffb640 1 -- 172.21.15.52:0/3486168873 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4f18102ff0 con 0x7f4f080390f0 2024-09-19T09:12:10.816 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 msgr2=0x7f4f0803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 0x7f4f0803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f040098c0 tx=0x7f4f04006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 msgr2=0x7f4f1819b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0097f0 tx=0x7f4f0c030d80 comp rx=0 tx=0).stop 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 shutdown_connections 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f4f080390f0 0x7f4f0803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 --2- 172.21.15.52:0/3486168873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f18108130 0x7f4f1819b640 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 >> 172.21.15.52:0/3486168873 conn(0x7f4f18101d70 msgr2=0x7f4f181028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 shutdown_connections 2024-09-19T09:12:10.817 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:10.053+0000 7f4f1ed7c640 1 -- 172.21.15.52:0/3486168873 wait complete. 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: mgrmap e8: x(active, since 2s) 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:10] ENGINE Bus STARTING 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:10] ENGINE Serving on http://172.21.15.52:8765 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:10] ENGINE Serving on https://172.21.15.52:7150 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:10] ENGINE Bus STARTED 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:11.123 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:10 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:10] ENGINE Error in HTTPServer.serve 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: Traceback (most recent call last): 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._run(expiration_interval) 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:12:11.124 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: s = self.context.wrap_socket( 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: return self.sslsocket_class._create( 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:12:11.125 INFO:journalctl@ceph.mon.a.smithi052.stdout: self.do_handshake() 2024-09-19T09:12:11.126 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:12:11.126 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._sslobj.do_handshake() 2024-09-19T09:12:11.126 INFO:journalctl@ceph.mon.a.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.210+0000 7f582a9eb640 1 Processor -- start 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.210+0000 7f582a9eb640 1 -- start start 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f582a9eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f582a9eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f582407be50 con 0x7f58241081e0 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f5823fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f5823fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43658/0 (socket says 172.21.15.52:43658) 2024-09-19T09:12:11.909 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f5823fff640 1 -- 172.21.15.52:0/4141246779 learned_addr learned my addr 172.21.15.52:0/4141246779 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.211+0000 7f5823fff640 1 -- 172.21.15.52:0/4141246779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582410ab10 con 0x7f58241081e0 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.212+0000 7f5823fff640 1 --2- 172.21.15.52:0/4141246779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5814009820 tx=0x7f581402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bf28d28927d3f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.212+0000 7f5822ffd640 1 -- 172.21.15.52:0/4141246779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5814037070 con 0x7f58241081e0 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.212+0000 7f5822ffd640 1 -- 172.21.15.52:0/4141246779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5814032900 con 0x7f58241081e0 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.212+0000 7f5822ffd640 1 -- 172.21.15.52:0/4141246779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5814030850 con 0x7f58241081e0 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- 172.21.15.52:0/4141246779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 msgr2=0x7f582410a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 --2- 172.21.15.52:0/4141246779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5814009820 tx=0x7f581402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- 172.21.15.52:0/4141246779 shutdown_connections 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 --2- 172.21.15.52:0/4141246779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f582410a5d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- 172.21.15.52:0/4141246779 >> 172.21.15.52:0/4141246779 conn(0x7f5824101dc0 msgr2=0x7f58241041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- 172.21.15.52:0/4141246779 shutdown_connections 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- 172.21.15.52:0/4141246779 wait complete. 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 Processor -- start 2024-09-19T09:12:11.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.213+0000 7f582a9eb640 1 -- start start 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f582a9eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f582a9eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f582410ba80 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f5823fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f5823fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43664/0 (socket says 172.21.15.52:43664) 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f5823fff640 1 -- 172.21.15.52:0/626146894 learned_addr learned my addr 172.21.15.52:0/626146894 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f5823fff640 1 -- 172.21.15.52:0/626146894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5824107fa0 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.214+0000 7f5823fff640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5814031000 tx=0x7f58140326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.215+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5814042070 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.215+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5814032be0 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.215+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5824106190 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.215+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5814037040 con 0x7f58241081e0 2024-09-19T09:12:11.911 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.215+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241066d0 con 0x7f58241081e0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.216+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5814045070 con 0x7f58241081e0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.216+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5824108640 con 0x7f58241081e0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.216+0000 7f58217fa640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 0x7f580c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.216+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f581406c250 con 0x7f58241081e0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.216+0000 7f58237fe640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 0x7f580c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.217+0000 7f58237fe640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 0x7f580c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58180098c0 tx=0x7f5818006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.221+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f581402f2a0 con 0x7f58241081e0 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.399+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5824106f20 con 0x7f580c039200 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.400+0000 7f58217fa640 1 -- 172.21.15.52:0/626146894 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5824106f20 con 0x7f580c039200 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.402+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 msgr2=0x7f580c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.402+0000 7f582a9eb640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 0x7f580c03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58180098c0 tx=0x7f5818006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:11.912 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.402+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 msgr2=0x7f5824107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.402+0000 7f582a9eb640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5814031000 tx=0x7f58140326e0 comp rx=0 tx=0).stop 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 shutdown_connections 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f580c039200 0x7f580c03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 --2- 172.21.15.52:0/626146894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58241081e0 0x7f5824107a60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 >> 172.21.15.52:0/626146894 conn(0x7f5824101dc0 msgr2=0x7f5824102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 shutdown_connections 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:11.403+0000 7f582a9eb640 1 -- 172.21.15.52:0/626146894 wait complete. 2024-09-19T09:12:11.913 INFO:teuthology.orchestra.run.smithi052.stdout:Generating ssh key... 2024-09-19T09:12:12.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:11 smithi052 ceph-mon[30947]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: Generating public/private rsa key pair. 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: Your identification has been saved in /tmp/tmpct2wt5kr/key 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: Your public key has been saved in /tmp/tmpct2wt5kr/key.pub 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: The key fingerprint is: 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: SHA256:oK4Ia7NxoxD8NRXSwtPd3xPSAi4wbnWdSMV+ssSMT5Q ceph-044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: The key's randomart image is: 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: +---[RSA 3072]----+ 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: | ..o+..o+*.+ | 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: | +oo=.oo E o | 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: | ++ . .B + .| 2024-09-19T09:12:12.930 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: |. .o. .. O + | 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: |.. .o S + + .| 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: | .... . o | 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: |o. +. | 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: |o=+.. | 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: |+o+ | 2024-09-19T09:12:12.931 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: +----[SHA256]-----+ 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f5a9d4640 1 Processor -- start 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f5a9d4640 1 -- start start 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f5a9d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f5a9d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54106f90 con 0x7f7f541065c0 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43678/0 (socket says 172.21.15.52:43678) 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.341+0000 7f7f53fff640 1 -- 172.21.15.52:0/3832591767 learned_addr learned my addr 172.21.15.52:0/3832591767 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:13.226 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.342+0000 7f7f53fff640 1 -- 172.21.15.52:0/3832591767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f541077c0 con 0x7f7f541065c0 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.342+0000 7f7f53fff640 1 --2- 172.21.15.52:0/3832591767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009820 tx=0x7f7f4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9576a5d6eb2e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f537fe640 1 -- 172.21.15.52:0/3832591767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f44037070 con 0x7f7f541065c0 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f537fe640 1 -- 172.21.15.52:0/3832591767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f44032900 con 0x7f7f541065c0 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f537fe640 1 -- 172.21.15.52:0/3832591767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f44030850 con 0x7f7f541065c0 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/3832591767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 msgr2=0x7f7f541069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/3832591767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009820 tx=0x7f7f4402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/3832591767 shutdown_connections 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/3832591767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f541069c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.343+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/3832591767 >> 172.21.15.52:0/3832591767 conn(0x7f7f54101d70 msgr2=0x7f7f54104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:13.227 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/3832591767 shutdown_connections 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/3832591767 wait complete. 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 Processor -- start 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 -- start start 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.344+0000 7f7f5a9d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5410ab70 con 0x7f7f541065c0 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43686/0 (socket says 172.21.15.52:43686) 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f53fff640 1 -- 172.21.15.52:0/1887214760 learned_addr learned my addr 172.21.15.52:0/1887214760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f53fff640 1 -- 172.21.15.52:0/1887214760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5419c170 con 0x7f7f541065c0 2024-09-19T09:12:13.228 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f53fff640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009940 tx=0x7f7f44032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f44042070 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f440308c0 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f541a0780 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f44037040 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.345+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f541a0ba0 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.346+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7f44045070 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.347+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f54106a40 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.347+0000 7f7f51ffb640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 0x7f7f4003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.347+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7f4406c330 con 0x7f7f541065c0 2024-09-19T09:12:13.229 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.347+0000 7f7f4bfff640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 0x7f7f4003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.347+0000 7f7f4bfff640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 0x7f7f4003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098c0 tx=0x7f7f3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.352+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f4402fd90 con 0x7f7f541065c0 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.528+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7f54102fb0 con 0x7f7f400391b0 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.653+0000 7f7f51ffb640 1 -- 172.21.15.52:0/1887214760 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7f54102fb0 con 0x7f7f400391b0 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.655+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 msgr2=0x7f7f4003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.655+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 0x7f7f4003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c0098c0 tx=0x7f7f3c006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 msgr2=0x7f7f5407bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009940 tx=0x7f7f44032ce0 comp rx=0 tx=0).stop 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 shutdown_connections 2024-09-19T09:12:13.230 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7f400391b0 0x7f7f4003b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:13.231 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 --2- 172.21.15.52:0/1887214760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f541065c0 0x7f7f5407bab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:13.231 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 >> 172.21.15.52:0/1887214760 conn(0x7f7f54101d70 msgr2=0x7f7f541028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:13.231 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 shutdown_connections 2024-09-19T09:12:13.231 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:12.656+0000 7f7f5a9d4640 1 -- 172.21.15.52:0/1887214760 wait complete. 2024-09-19T09:12:13.758 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:13 smithi052 ceph-mon[30947]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:13.758 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:13 smithi052 ceph-mon[30947]: Generating ssh key... 2024-09-19T09:12:13.758 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:13 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:13.758 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:13 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:14.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:14.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75e6743640 1 Processor -- start 2024-09-19T09:12:14.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75e6743640 1 -- start start 2024-09-19T09:12:14.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75e6743640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:14.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75e6743640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75e0106350 con 0x7f75e0105980 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75dffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75dffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43688/0 (socket says 172.21.15.52:43688) 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75dffff640 1 -- 172.21.15.52:0/2907712501 learned_addr learned my addr 172.21.15.52:0/2907712501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.570+0000 7f75dffff640 1 -- 172.21.15.52:0/2907712501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e0108960 con 0x7f75e0105980 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.571+0000 7f75dffff640 1 --2- 172.21.15.52:0/2907712501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009820 tx=0x7f75d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ded713fa798ea0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.571+0000 7f75deffd640 1 -- 172.21.15.52:0/2907712501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0037070 con 0x7f75e0105980 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.571+0000 7f75deffd640 1 -- 172.21.15.52:0/2907712501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75d0032900 con 0x7f75e0105980 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.571+0000 7f75deffd640 1 -- 172.21.15.52:0/2907712501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0030850 con 0x7f75e0105980 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 -- 172.21.15.52:0/2907712501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 msgr2=0x7f75e0105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 --2- 172.21.15.52:0/2907712501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009820 tx=0x7f75d002a270 comp rx=0 tx=0).stop 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 -- 172.21.15.52:0/2907712501 shutdown_connections 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 --2- 172.21.15.52:0/2907712501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e0105d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:14.374 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 -- 172.21.15.52:0/2907712501 >> 172.21.15.52:0/2907712501 conn(0x7f75e0101510 msgr2=0x7f75e0103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 -- 172.21.15.52:0/2907712501 shutdown_connections 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.572+0000 7f75e6743640 1 -- 172.21.15.52:0/2907712501 wait complete. 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75e6743640 1 Processor -- start 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75e6743640 1 -- start start 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75e6743640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75e6743640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f75e010bb90 con 0x7f75e0105980 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75dffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75dffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43692/0 (socket says 172.21.15.52:43692) 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.573+0000 7f75dffff640 1 -- 172.21.15.52:0/1792184729 learned_addr learned my addr 172.21.15.52:0/1792184729 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75dffff640 1 -- 172.21.15.52:0/1792184729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e0108720 con 0x7f75e0105980 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75dffff640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009940 tx=0x7f75d0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0042070 con 0x7f75e0105980 2024-09-19T09:12:14.375 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75d00308c0 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e0106910 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0037040 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.574+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e0106e50 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.575+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f75d0045070 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.575+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e0105e00 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.575+0000 7f75dd7fa640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 0x7f75c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.575+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f75d006c5d0 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.575+0000 7f75df7fe640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 0x7f75c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.576+0000 7f75df7fe640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 0x7f75c803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098c0 tx=0x7f75d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.580+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75d003cd90 con 0x7f75e0105980 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.757+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f75e01077a0 con 0x7f75c80391b0 2024-09-19T09:12:14.376 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.758+0000 7f75dd7fa640 1 -- 172.21.15.52:0/1792184729 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f75e01077a0 con 0x7f75c80391b0 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 msgr2=0x7f75c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 0x7f75c803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098c0 tx=0x7f75d4006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 msgr2=0x7f75e01081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009940 tx=0x7f75d0032ce0 comp rx=0 tx=0).stop 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 shutdown_connections 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f75c80391b0 0x7f75c803b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 --2- 172.21.15.52:0/1792184729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75e0105980 0x7f75e01081e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 >> 172.21.15.52:0/1792184729 conn(0x7f75e0101510 msgr2=0x7f75e0102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 shutdown_connections 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:13.760+0000 7f75e6743640 1 -- 172.21.15.52:0/1792184729 wait complete. 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:12:14.377 INFO:teuthology.orchestra.run.smithi052.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:12:14.381 INFO:teuthology.orchestra.run.smithi052.stdout:Adding host smithi052... 2024-09-19T09:12:14.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:14 smithi052 ceph-mon[30947]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:15.997 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:15 smithi052 ceph-mon[30947]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "addr": "172.21.15.52", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:17.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:16 smithi052 ceph-mon[30947]: Deploying cephadm binary to smithi052 2024-09-19T09:12:19.439 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Added host 'smithi052' with addr '172.21.15.52' 2024-09-19T09:12:19.439 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.758+0000 7f8ef8499640 1 Processor -- start 2024-09-19T09:12:19.439 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.758+0000 7f8ef8499640 1 -- start start 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef8499640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef8499640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0108080 con 0x7f8ef01076b0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef6235640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef6235640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43696/0 (socket says 172.21.15.52:43696) 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef6235640 1 -- 172.21.15.52:0/3375982316 learned_addr learned my addr 172.21.15.52:0/3375982316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.759+0000 7f8ef6235640 1 -- 172.21.15.52:0/3375982316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef01088b0 con 0x7f8ef01076b0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.760+0000 7f8ef6235640 1 --2- 172.21.15.52:0/3375982316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009820 tx=0x7f8eec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00b0e9babaf20ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.760+0000 7f8ef5233640 1 -- 172.21.15.52:0/3375982316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec037070 con 0x7f8ef01076b0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.760+0000 7f8ef5233640 1 -- 172.21.15.52:0/3375982316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8eec032900 con 0x7f8ef01076b0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.760+0000 7f8ef5233640 1 -- 172.21.15.52:0/3375982316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec030850 con 0x7f8ef01076b0 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 -- 172.21.15.52:0/3375982316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 msgr2=0x7f8ef0107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.440 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3375982316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009820 tx=0x7f8eec02a270 comp rx=0 tx=0).stop 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 -- 172.21.15.52:0/3375982316 shutdown_connections 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3375982316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef0107ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 -- 172.21.15.52:0/3375982316 >> 172.21.15.52:0/3375982316 conn(0x7f8ef0102e80 msgr2=0x7f8ef01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 -- 172.21.15.52:0/3375982316 shutdown_connections 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.761+0000 7f8ef8499640 1 -- 172.21.15.52:0/3375982316 wait complete. 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef8499640 1 Processor -- start 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef8499640 1 -- start start 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef8499640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef8499640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef010bc60 con 0x7f8ef01076b0 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef6235640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef6235640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43702/0 (socket says 172.21.15.52:43702) 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef6235640 1 -- 172.21.15.52:0/3256077687 learned_addr learned my addr 172.21.15.52:0/3256077687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:19.441 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.762+0000 7f8ef6235640 1 -- 172.21.15.52:0/3256077687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef007e0d0 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ef6235640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097f0 tx=0x7f8eec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec037040 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8eec040070 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef007c2c0 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eec03a390 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.763+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef007c7a0 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.764+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8eec03a5e0 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.764+0000 7f8ee77fe640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 0x7f8edc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.764+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8eec06c740 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.764+0000 7f8ef5a34640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 0x7f8edc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.764+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ef0107b30 con 0x7f8ef01076b0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.765+0000 7f8ef5a34640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 0x7f8edc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00098c0 tx=0x7f8ee0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:19.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.769+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8eec03b550 con 0x7f8ef01076b0 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:14.951+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi052", "addr": "172.21.15.52", "target": ["mon-mgr", ""]}) -- 0x7f8ef007d0d0 con 0x7f8edc039200 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.860+0000 7f8ee77fe640 1 -- 172.21.15.52:0/3256077687 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8ef007d0d0 con 0x7f8edc039200 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 msgr2=0x7f8edc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 0x7f8edc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00098c0 tx=0x7f8ee0006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 msgr2=0x7f8ef007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097f0 tx=0x7f8eec030d80 comp rx=0 tx=0).stop 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 shutdown_connections 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8edc039200 0x7f8edc03b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 --2- 172.21.15.52:0/3256077687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ef01076b0 0x7f8ef007db90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:19.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.862+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 >> 172.21.15.52:0/3256077687 conn(0x7f8ef0102e80 msgr2=0x7f8ef01039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:19.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.863+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 shutdown_connections 2024-09-19T09:12:19.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:18.863+0000 7f8ef8499640 1 -- 172.21.15.52:0/3256077687 wait complete. 2024-09-19T09:12:19.444 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying unmanaged mon service... 2024-09-19T09:12:20.082 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:19 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:20.082 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:19 smithi052 ceph-mon[30947]: Added host smithi052 2024-09-19T09:12:20.083 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:19 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:20.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:12:20.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.863+0000 7f8dca7f1640 1 Processor -- start 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.863+0000 7f8dca7f1640 1 -- start start 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.863+0000 7f8dca7f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.863+0000 7f8dca7f1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc407be50 con 0x7f8dc41081b0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.864+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.864+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42164/0 (socket says 172.21.15.52:42164) 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.864+0000 7f8dc3fff640 1 -- 172.21.15.52:0/1156901615 learned_addr learned my addr 172.21.15.52:0/1156901615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.864+0000 7f8dc3fff640 1 -- 172.21.15.52:0/1156901615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc410aae0 con 0x7f8dc41081b0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dc3fff640 1 --2- 172.21.15.52:0/1156901615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009820 tx=0x7f8db402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc49bcb02914b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dc37fe640 1 -- 172.21.15.52:0/1156901615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4037070 con 0x7f8dc41081b0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dc37fe640 1 -- 172.21.15.52:0/1156901615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8db4032900 con 0x7f8dc41081b0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dc37fe640 1 -- 172.21.15.52:0/1156901615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4030850 con 0x7f8dc41081b0 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dca7f1640 1 -- 172.21.15.52:0/1156901615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 msgr2=0x7f8dc410a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:20.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.865+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/1156901615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009820 tx=0x7f8db402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:20.852 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- 172.21.15.52:0/1156901615 shutdown_connections 2024-09-19T09:12:20.852 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/1156901615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc410a5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:20.852 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- 172.21.15.52:0/1156901615 >> 172.21.15.52:0/1156901615 conn(0x7f8dc4101d70 msgr2=0x7f8dc4104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:20.853 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- 172.21.15.52:0/1156901615 shutdown_connections 2024-09-19T09:12:20.853 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- 172.21.15.52:0/1156901615 wait complete. 2024-09-19T09:12:20.853 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 Processor -- start 2024-09-19T09:12:20.853 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- start start 2024-09-19T09:12:20.853 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.866+0000 7f8dca7f1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc410ba50 con 0x7f8dc41081b0 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42172/0 (socket says 172.21.15.52:42172) 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc3fff640 1 -- 172.21.15.52:0/2086398005 learned_addr learned my addr 172.21.15.52:0/2086398005 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc3fff640 1 -- 172.21.15.52:0/2086398005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc419bb90 con 0x7f8dc41081b0 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc3fff640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097f0 tx=0x7f8db4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:20.854 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db4037040 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8db4040070 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc419be20 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db403a390 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.867+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc419eb10 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.868+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8db403a5e0 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.868+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4108610 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.869+0000 7f8dc1ffb640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 0x7f8db003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.869+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8db406c8b0 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.869+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 0x7f8db003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.869+0000 7f8dbbfff640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 0x7f8db003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098c0 tx=0x7f8dac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:19.874+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8db403a9d0 con 0x7f8dc41081b0 2024-09-19T09:12:20.855 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.082+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8dc4102ff0 con 0x7f8db0039200 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.087+0000 7f8dc1ffb640 1 -- 172.21.15.52:0/2086398005 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8dc4102ff0 con 0x7f8db0039200 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.089+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 msgr2=0x7f8db003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.089+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 0x7f8db003b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098c0 tx=0x7f8dac006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.089+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 msgr2=0x7f8dc419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.089+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097f0 tx=0x7f8db4030d80 comp rx=0 tx=0).stop 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 shutdown_connections 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8db0039200 0x7f8db003b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 --2- 172.21.15.52:0/2086398005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8dc41081b0 0x7f8dc419b650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 >> 172.21.15.52:0/2086398005 conn(0x7f8dc4101d70 msgr2=0x7f8dc41028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 shutdown_connections 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:20.090+0000 7f8dca7f1640 1 -- 172.21.15.52:0/2086398005 wait complete. 2024-09-19T09:12:20.856 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying unmanaged mgr service... 2024-09-19T09:12:21.178 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:21 smithi052 ceph-mon[30947]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:21.178 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:21 smithi052 ceph-mon[30947]: Saving service mon spec with placement count:5 2024-09-19T09:12:21.178 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:21 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:22.067 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.294+0000 7f8735d13640 1 Processor -- start 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.294+0000 7f8735d13640 1 -- start start 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.294+0000 7f8735d13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.294+0000 7f8735d13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f873007be50 con 0x7f87301081b0 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.295+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.295+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42184/0 (socket says 172.21.15.52:42184) 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.295+0000 7f872f7fe640 1 -- 172.21.15.52:0/3371115629 learned_addr learned my addr 172.21.15.52:0/3371115629 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:22.068 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.295+0000 7f872f7fe640 1 -- 172.21.15.52:0/3371115629 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873010aae0 con 0x7f87301081b0 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f872f7fe640 1 --2- 172.21.15.52:0/3371115629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8720009e80 tx=0x7f872002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52db99a9531d8316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f872e7fc640 1 -- 172.21.15.52:0/3371115629 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8720036070 con 0x7f87301081b0 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f872e7fc640 1 -- 172.21.15.52:0/3371115629 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87200318c0 con 0x7f87301081b0 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f872e7fc640 1 -- 172.21.15.52:0/3371115629 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8720007ab0 con 0x7f87301081b0 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f8735d13640 1 -- 172.21.15.52:0/3371115629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 msgr2=0x7f873010a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.296+0000 7f8735d13640 1 --2- 172.21.15.52:0/3371115629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8720009e80 tx=0x7f872002a7a0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 -- 172.21.15.52:0/3371115629 shutdown_connections 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 --2- 172.21.15.52:0/3371115629 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f873010a5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 -- 172.21.15.52:0/3371115629 >> 172.21.15.52:0/3371115629 conn(0x7f8730101d70 msgr2=0x7f8730104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 -- 172.21.15.52:0/3371115629 shutdown_connections 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 -- 172.21.15.52:0/3371115629 wait complete. 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 Processor -- start 2024-09-19T09:12:22.069 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.297+0000 7f8735d13640 1 -- start start 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f8735d13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f8735d13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f873010ba50 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42200/0 (socket says 172.21.15.52:42200) 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872f7fe640 1 -- 172.21.15.52:0/968952947 learned_addr learned my addr 172.21.15.52:0/968952947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872f7fe640 1 -- 172.21.15.52:0/968952947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8730107f70 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872f7fe640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8720031ca0 tx=0x7f8720031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8720036050 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8720042070 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8730106160 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f872003d820 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.298+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87301066a0 con 0x7f87301081b0 2024-09-19T09:12:22.070 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f872003dad0 con 0x7f87301081b0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8730108610 con 0x7f87301081b0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f872cff9640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 0x7f871803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8720007e00 con 0x7f87301081b0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f872effd640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 0x7f871803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.300+0000 7f872effd640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 0x7f871803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f8724006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.304+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8720007310 con 0x7f87301081b0 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.496+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8730106f50 con 0x7f8718039200 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.500+0000 7f872cff9640 1 -- 172.21.15.52:0/968952947 <== mgr.14118 v2:172.21.15.52:6800/561717915 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8730106f50 con 0x7f8718039200 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 msgr2=0x7f871803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 0x7f871803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f87240098c0 tx=0x7f8724006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 msgr2=0x7f8730107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:22.071 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8720031ca0 tx=0x7f8720031cd0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 shutdown_connections 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f8718039200 0x7f871803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 --2- 172.21.15.52:0/968952947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87301081b0 0x7f8730107a30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.502+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 >> 172.21.15.52:0/968952947 conn(0x7f8730101d70 msgr2=0x7f87301028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.503+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 shutdown_connections 2024-09-19T09:12:22.072 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:21.503+0000 7f8735d13640 1 -- 172.21.15.52:0/968952947 wait complete. 2024-09-19T09:12:22.653 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:22 smithi052 ceph-mon[30947]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:22.653 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:22 smithi052 ceph-mon[30947]: Saving service mgr spec with placement count:2 2024-09-19T09:12:22.653 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:22 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.468+0000 7fd173e32640 1 Processor -- start 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd173e32640 1 -- start start 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd173e32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd173e32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c07bdf0 con 0x7fd16c108210 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd171bce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd171bce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42202/0 (socket says 172.21.15.52:42202) 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd171bce640 1 -- 172.21.15.52:0/3602909227 learned_addr learned my addr 172.21.15.52:0/3602909227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:23.442 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.469+0000 7fd171bce640 1 -- 172.21.15.52:0/3602909227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c10ab40 con 0x7fd16c108210 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.470+0000 7fd171bce640 1 --2- 172.21.15.52:0/3602909227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd168009e80 tx=0x7fd16802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707475b799e8a923 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.470+0000 7fd170bcc640 1 -- 172.21.15.52:0/3602909227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168036070 con 0x7fd16c108210 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.470+0000 7fd170bcc640 1 -- 172.21.15.52:0/3602909227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1680318c0 con 0x7fd16c108210 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.470+0000 7fd170bcc640 1 -- 172.21.15.52:0/3602909227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168007ab0 con 0x7fd16c108210 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 -- 172.21.15.52:0/3602909227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 msgr2=0x7fd16c10a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 --2- 172.21.15.52:0/3602909227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd168009e80 tx=0x7fd16802a7a0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 -- 172.21.15.52:0/3602909227 shutdown_connections 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 --2- 172.21.15.52:0/3602909227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c10a600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 -- 172.21.15.52:0/3602909227 >> 172.21.15.52:0/3602909227 conn(0x7fd16c101d70 msgr2=0x7fd16c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 -- 172.21.15.52:0/3602909227 shutdown_connections 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.471+0000 7fd173e32640 1 -- 172.21.15.52:0/3602909227 wait complete. 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd173e32640 1 Processor -- start 2024-09-19T09:12:23.443 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd173e32640 1 -- start start 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd173e32640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd173e32640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c10ba50 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd171bce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd171bce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42218/0 (socket says 172.21.15.52:42218) 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd171bce640 1 -- 172.21.15.52:0/2710018138 learned_addr learned my addr 172.21.15.52:0/2710018138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.472+0000 7fd171bce640 1 -- 172.21.15.52:0/2710018138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c19bb90 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd171bce640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd16802acc0 tx=0x7fd168031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168036050 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd168037040 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c19be20 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd16803d850 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.473+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c19eb10 con 0x7fd16c108210 2024-09-19T09:12:23.444 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd168044020 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 0x7fd15803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c108670 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd168042020 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd1713cd640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 0x7fd15803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.474+0000 7fd1713cd640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 0x7fd15803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0098c0 tx=0x7fd15c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.479+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd16804b020 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.653+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fd16c19f160 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.656+0000 7fd162ffd640 1 -- 172.21.15.52:0/2710018138 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fd168039300 con 0x7fd16c108210 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 msgr2=0x7fd15803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 0x7fd15803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0098c0 tx=0x7fd15c006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 msgr2=0x7fd16c19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd16802acc0 tx=0x7fd168031ca0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 shutdown_connections 2024-09-19T09:12:23.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fd1580391b0 0x7fd15803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 --2- 172.21.15.52:0/2710018138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd16c108210 0x7fd16c19b650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:23.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.658+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 >> 172.21.15.52:0/2710018138 conn(0x7fd16c101d70 msgr2=0x7fd16c102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:23.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.659+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 shutdown_connections 2024-09-19T09:12:23.446 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:22.659+0000 7fd173e32640 1 -- 172.21.15.52:0/2710018138 wait complete. 2024-09-19T09:12:23.816 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:23 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2710018138' entity='client.admin' 2024-09-19T09:12:24.935 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.905+0000 7f776ebee640 1 Processor -- start 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.905+0000 7f776ebee640 1 -- start start 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776ebee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776ebee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f776807be50 con 0x7f77681081b0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776c98a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776c98a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42224/0 (socket says 172.21.15.52:42224) 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776c98a640 1 -- 172.21.15.52:0/2290393185 learned_addr learned my addr 172.21.15.52:0/2290393185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.906+0000 7f776c98a640 1 -- 172.21.15.52:0/2290393185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776810aae0 con 0x7f77681081b0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.907+0000 7f776c98a640 1 --2- 172.21.15.52:0/2290393185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7758009820 tx=0x7f775802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df624c7ddf920c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.907+0000 7f77677fe640 1 -- 172.21.15.52:0/2290393185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7758037070 con 0x7f77681081b0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.907+0000 7f77677fe640 1 -- 172.21.15.52:0/2290393185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7758032900 con 0x7f77681081b0 2024-09-19T09:12:24.936 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.907+0000 7f77677fe640 1 -- 172.21.15.52:0/2290393185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7758030850 con 0x7f77681081b0 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 -- 172.21.15.52:0/2290393185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 msgr2=0x7f776810a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 --2- 172.21.15.52:0/2290393185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7758009820 tx=0x7f775802a270 comp rx=0 tx=0).stop 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 -- 172.21.15.52:0/2290393185 shutdown_connections 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 --2- 172.21.15.52:0/2290393185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776810a5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 -- 172.21.15.52:0/2290393185 >> 172.21.15.52:0/2290393185 conn(0x7f7768101d70 msgr2=0x7f7768104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 -- 172.21.15.52:0/2290393185 shutdown_connections 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 -- 172.21.15.52:0/2290393185 wait complete. 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.908+0000 7f776ebee640 1 Processor -- start 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776ebee640 1 -- start start 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776ebee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776ebee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f776810ba50 con 0x7f77681081b0 2024-09-19T09:12:24.937 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776c98a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776c98a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42240/0 (socket says 172.21.15.52:42240) 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776c98a640 1 -- 172.21.15.52:0/367549377 learned_addr learned my addr 172.21.15.52:0/367549377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776c98a640 1 -- 172.21.15.52:0/367549377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776819bba0 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776c98a640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7758032ce0 tx=0x7f7758032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7758042070 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77580308c0 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776819be30 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.909+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7758037040 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.910+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776819eb20 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7758045070 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768108610 con 0x7f77681081b0 2024-09-19T09:12:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f7765ffb640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 0x7f775403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f775806c2c0 con 0x7f77681081b0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f7767fff640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 0x7f775403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.911+0000 7f7767fff640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 0x7f775403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77500098c0 tx=0x7f7750006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:23.916+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f775804b170 con 0x7f77681081b0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.093+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f776819f280 con 0x7f77681081b0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.095+0000 7f7765ffb640 1 -- 172.21.15.52:0/367549377 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v7)=0 v7) ==== 130+0+0 (secure 0 0 0) 0x7f775803c780 con 0x7f77681081b0 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 msgr2=0x7f775403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 0x7f775403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f77500098c0 tx=0x7f7750006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 msgr2=0x7f776819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7758032ce0 tx=0x7f7758032d10 comp rx=0 tx=0).stop 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 shutdown_connections 2024-09-19T09:12:24.939 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f7754039200 0x7f775403b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:24.940 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 --2- 172.21.15.52:0/367549377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77681081b0 0x7f776819b660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:24.940 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.097+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 >> 172.21.15.52:0/367549377 conn(0x7f7768101d70 msgr2=0x7f7768102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:24.940 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.098+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 shutdown_connections 2024-09-19T09:12:24.940 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:24.098+0000 7f776ebee640 1 -- 172.21.15.52:0/367549377 wait complete. 2024-09-19T09:12:24.940 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling the dashboard module... 2024-09-19T09:12:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:25 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/367549377' entity='client.admin' 2024-09-19T09:12:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:25 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:25 smithi052 ceph-mon[30947]: from='mgr.14118 172.21.15.52:0/4147810855' entity='mgr.x' 2024-09-19T09:12:26.142 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/989810225' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:12:26.414 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ignoring --setuser ceph since I am not root 2024-09-19T09:12:26.414 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ignoring --setgroup ceph since I am not root 2024-09-19T09:12:26.415 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.262+0000 7faccc97f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:12:26.415 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.327+0000 7faccc97f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:12:26.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.486+0000 7faccc97f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:12:26.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.557+0000 7faccc97f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:12:26.841 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.353+0000 7fa804278640 1 Processor -- start 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.353+0000 7fa804278640 1 -- start start 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa804278640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa804278640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc108080 con 0x7fa7fc1076b0 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa802014640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa802014640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42254/0 (socket says 172.21.15.52:42254) 2024-09-19T09:12:26.847 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa802014640 1 -- 172.21.15.52:0/2589422160 learned_addr learned my addr 172.21.15.52:0/2589422160 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.354+0000 7fa802014640 1 -- 172.21.15.52:0/2589422160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc1088b0 con 0x7fa7fc1076b0 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.355+0000 7fa802014640 1 --2- 172.21.15.52:0/2589422160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009820 tx=0x7fa7f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531a9bb7a3614562 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.355+0000 7fa801012640 1 -- 172.21.15.52:0/2589422160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8037070 con 0x7fa7fc1076b0 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.355+0000 7fa801012640 1 -- 172.21.15.52:0/2589422160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f8032920 con 0x7fa7fc1076b0 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.355+0000 7fa801012640 1 -- 172.21.15.52:0/2589422160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8030810 con 0x7fa7fc1076b0 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 -- 172.21.15.52:0/2589422160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 msgr2=0x7fa7fc107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 --2- 172.21.15.52:0/2589422160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009820 tx=0x7fa7f802a270 comp rx=0 tx=0).stop 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 -- 172.21.15.52:0/2589422160 shutdown_connections 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 --2- 172.21.15.52:0/2589422160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc107ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 -- 172.21.15.52:0/2589422160 >> 172.21.15.52:0/2589422160 conn(0x7fa7fc102e80 msgr2=0x7fa7fc1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 -- 172.21.15.52:0/2589422160 shutdown_connections 2024-09-19T09:12:26.848 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.356+0000 7fa804278640 1 -- 172.21.15.52:0/2589422160 wait complete. 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa804278640 1 Processor -- start 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa804278640 1 -- start start 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa804278640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa804278640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7fc10bc60 con 0x7fa7fc1076b0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa802014640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa802014640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42258/0 (socket says 172.21.15.52:42258) 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa802014640 1 -- 172.21.15.52:0/989810225 learned_addr learned my addr 172.21.15.52:0/989810225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.357+0000 7fa802014640 1 -- 172.21.15.52:0/989810225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7fc19bc20 con 0x7fa7fc1076b0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa802014640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8030560 tx=0x7fa7f8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f8037040 con 0x7fa7fc1076b0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f8040070 con 0x7fa7fc1076b0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7fc19beb0 con 0x7fa7fc1076b0 2024-09-19T09:12:26.849 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7f803a740 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.358+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7fc19eba0 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.359+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa7f803a8e0 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.359+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7fc107b30 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.359+0000 7fa7f37fe640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 0x7fa7e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.359+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7f806c940 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.359+0000 7fa801813640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 0x7fa7e803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.360+0000 7fa801813640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 0x7fa7e803b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0098c0 tx=0x7fa7ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.364+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7f803acd0 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:25.599+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa7fc19ed70 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.097+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fa7f8045980 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.099+0000 7fa7f37fe640 1 -- 172.21.15.52:0/989810225 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fa7f8045460 con 0x7fa7fc1076b0 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 msgr2=0x7fa7e803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 0x7fa7e803b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0098c0 tx=0x7fa7ec006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:26.850 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 msgr2=0x7fa7fc19b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8030560 tx=0x7fa7f8032670 comp rx=0 tx=0).stop 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 shutdown_connections 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7fa7e8039200 0x7fa7e803b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 --2- 172.21.15.52:0/989810225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7fc1076b0 0x7fa7fc19b6e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.100+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 >> 172.21.15.52:0/989810225 conn(0x7fa7fc102e80 msgr2=0x7fa7fc103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.101+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 shutdown_connections 2024-09-19T09:12:26.851 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:26.101+0000 7fa804278640 1 -- 172.21.15.52:0/989810225 wait complete. 2024-09-19T09:12:26.968 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.716+0000 7faccc97f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:12:26.968 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:26.869+0000 7faccc97f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:12:27.278 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/989810225' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:12:27.279 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:27 smithi052 ceph-mon[30947]: mgrmap e9: x(active, since 18s) 2024-09-19T09:12:27.279 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:27.213+0000 7faccc97f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:12:27.279 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:27.278+0000 7faccc97f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:12:27.532 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:27.478+0000 7faccc97f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:12:28.112 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:12:28.112 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:12:28.112 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.283+0000 7f668685c640 1 Processor -- start 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.283+0000 7f668685c640 1 -- start start 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f668685c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f668685c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6680108080 con 0x7f66801076b0 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f667ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f667ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42290/0 (socket says 172.21.15.52:42290) 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f667ffff640 1 -- 172.21.15.52:0/3612010410 learned_addr learned my addr 172.21.15.52:0/3612010410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:28.113 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.284+0000 7f667ffff640 1 -- 172.21.15.52:0/3612010410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66801088b0 con 0x7f66801076b0 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.285+0000 7f667ffff640 1 --2- 172.21.15.52:0/3612010410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f667000f960 tx=0x7f667002e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992b26e25b618da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.285+0000 7f667effd640 1 -- 172.21.15.52:0/3612010410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f667003a070 con 0x7f66801076b0 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.285+0000 7f667effd640 1 -- 172.21.15.52:0/3612010410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6670033b20 con 0x7f66801076b0 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.285+0000 7f667effd640 1 -- 172.21.15.52:0/3612010410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6670035cb0 con 0x7f66801076b0 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 -- 172.21.15.52:0/3612010410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 msgr2=0x7f6680107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 --2- 172.21.15.52:0/3612010410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f667000f960 tx=0x7f667002e550 comp rx=0 tx=0).stop 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 -- 172.21.15.52:0/3612010410 shutdown_connections 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 --2- 172.21.15.52:0/3612010410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680107ab0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 -- 172.21.15.52:0/3612010410 >> 172.21.15.52:0/3612010410 conn(0x7f6680102e40 msgr2=0x7f6680105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 -- 172.21.15.52:0/3612010410 shutdown_connections 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.286+0000 7f668685c640 1 -- 172.21.15.52:0/3612010410 wait complete. 2024-09-19T09:12:28.114 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.287+0000 7f668685c640 1 Processor -- start 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.287+0000 7f668685c640 1 -- start start 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f668685c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f668685c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f668007c100 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42296/0 (socket says 172.21.15.52:42296) 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667ffff640 1 -- 172.21.15.52:0/2236378681 learned_addr learned my addr 172.21.15.52:0/2236378681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667ffff640 1 -- 172.21.15.52:0/2236378681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66801999c0 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667ffff640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f667000fa80 tx=0x7f6670033740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6670044020 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.288+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6680199c50 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.289+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6670040900 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.289+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f667003a040 con 0x7f66801076b0 2024-09-19T09:12:28.115 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.289+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668019c940 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f6670047020 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6680107b30 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f667d7fa640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 0x7f666803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6670071220 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f667f7fe640 1 -- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 msgr2=0x7f666803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.290+0000 7f667f7fe640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 0x7f666803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.295+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f667004e020 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.491+0000 7f667f7fe640 1 -- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 msgr2=0x7f666803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.491+0000 7f667f7fe640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 0x7f666803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.520+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f668002d9b0 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.520+0000 7f667d7fa640 1 -- 172.21.15.52:0/2236378681 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f667003b250 con 0x7f66801076b0 2024-09-19T09:12:28.116 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 msgr2=0x7f666803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 0x7f666803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 msgr2=0x7f6680199480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f667000fa80 tx=0x7f6670033740 comp rx=0 tx=0).stop 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 shutdown_connections 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f6668039200 0x7f666803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 --2- 172.21.15.52:0/2236378681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f66801076b0 0x7f6680199480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 >> 172.21.15.52:0/2236378681 conn(0x7f6680102e40 msgr2=0x7f6680104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:28.117 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 shutdown_connections 2024-09-19T09:12:28.118 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:27.522+0000 7f668685c640 1 -- 172.21.15.52:0/2236378681 wait complete. 2024-09-19T09:12:28.118 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for the mgr to restart... 2024-09-19T09:12:28.118 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr epoch 9... 2024-09-19T09:12:28.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:28 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2236378681' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:12:28.494 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:28.420+0000 7faccc97f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:12:28.929 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:28.493+0000 7faccc97f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:12:29.358 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.237+0000 7faccc97f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:12:29.358 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.358+0000 7faccc97f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:12:29.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.506+0000 7faccc97f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:12:29.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.570+0000 7faccc97f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:12:30.025 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.725+0000 7faccc97f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:12:30.025 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.796+0000 7faccc97f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:12:30.025 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:29.858+0000 7faccc97f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:12:30.025 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.023+0000 7faccc97f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:12:30.309 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.091+0000 7faccc97f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:12:30.309 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.161+0000 7faccc97f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:12:30.309 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.247+0000 7faccc97f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:12:30.309 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.308+0000 7faccc97f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:12:30.679 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:30.370+0000 7faccc97f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:12:31.448 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:31.195+0000 7faccc97f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: Active manager daemon x restarted 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: Activating manager daemon x 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: mgrmap e10: x(active, starting, since 0.00349091s) 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: Manager daemon x is now available 2024-09-19T09:12:31.449 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:31.450 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:12:31.450 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.496+0000 7f85f6486640 1 Processor -- start 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.496+0000 7f85f6486640 1 -- start start 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.496+0000 7f85f6486640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.496+0000 7f85f6486640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85f0108110 con 0x7f85f0107740 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.497+0000 7f85effff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.497+0000 7f85effff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55010/0 (socket says 172.21.15.52:55010) 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.497+0000 7f85effff640 1 -- 172.21.15.52:0/206966512 learned_addr learned my addr 172.21.15.52:0/206966512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.497+0000 7f85effff640 1 -- 172.21.15.52:0/206966512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f0108940 con 0x7f85f0107740 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.497+0000 7f85effff640 1 --2- 172.21.15.52:0/206966512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009820 tx=0x7f85e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef8e1cb2f7e83e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85ef7fe640 1 -- 172.21.15.52:0/206966512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e0037070 con 0x7f85f0107740 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85ef7fe640 1 -- 172.21.15.52:0/206966512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e0032920 con 0x7f85f0107740 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85ef7fe640 1 -- 172.21.15.52:0/206966512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e0030810 con 0x7f85f0107740 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 -- 172.21.15.52:0/206966512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 msgr2=0x7f85f0107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 --2- 172.21.15.52:0/206966512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009820 tx=0x7f85e002a270 comp rx=0 tx=0).stop 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 -- 172.21.15.52:0/206966512 shutdown_connections 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 --2- 172.21.15.52:0/206966512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f0107b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 -- 172.21.15.52:0/206966512 >> 172.21.15.52:0/206966512 conn(0x7f85f0102ef0 msgr2=0x7f85f0105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 -- 172.21.15.52:0/206966512 shutdown_connections 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.498+0000 7f85f6486640 1 -- 172.21.15.52:0/206966512 wait complete. 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85f6486640 1 Processor -- start 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85f6486640 1 -- start start 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85f6486640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85f6486640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85f010bcf0 con 0x7f85f0107740 2024-09-19T09:12:32.966 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85effff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85effff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55022/0 (socket says 172.21.15.52:55022) 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.499+0000 7f85effff640 1 -- 172.21.15.52:0/2540246199 learned_addr learned my addr 172.21.15.52:0/2540246199 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85effff640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f019bc10 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85effff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097f0 tx=0x7f85e00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e0037040 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e0030c40 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f019bea0 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85e003a5b0 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.500+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f019eb90 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f85e003a7a0 con 0x7f85f0107740 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85edffb640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f85dc03be30 con 0x7f85dc039260 2024-09-19T09:12:32.967 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85e7fff640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 msgr2=0x7f85dc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f85e006c6a0 con 0x7f85f0107740 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.501+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.702+0000 7f85e7fff640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 msgr2=0x7f85dc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:28.702+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:29.103+0000 7f85e7fff640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 msgr2=0x7f85dc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:29.103+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:29.904+0000 7f85e7fff640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 msgr2=0x7f85dc03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.52:6800/561717915 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:29.904+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:31.199+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f85e002fd60 con 0x7f85f0107740 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:31.199+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 msgr2=0x7f85dc03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:31.199+0000 7f85edffb640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.200+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f85e0044920 con 0x7f85f0107740 2024-09-19T09:12:32.968 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.200+0000 7f85edffb640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 0x7f85dc03f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.200+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f85e0043e50 con 0x7f85dc03cd20 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.201+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 0x7f85dc03f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.202+0000 7f85e7fff640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 0x7f85dc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003980 tx=0x7f85d80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.202+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f85e0043e50 con 0x7f85dc03cd20 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.209+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f85f0107bc0 con 0x7f85dc03cd20 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.209+0000 7f85edffb640 1 -- 172.21.15.52:0/2540246199 <== mgr.14150 v2:172.21.15.52:6800/2340346787 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f85f0107bc0 con 0x7f85dc03cd20 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 msgr2=0x7f85dc03f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 0x7f85dc03f110 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85d8003980 tx=0x7f85d80092b0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 msgr2=0x7f85f019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097f0 tx=0x7f85e00327b0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 shutdown_connections 2024-09-19T09:12:32.969 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85dc03cd20 0x7f85dc03f110 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:6800/561717915,v1:172.21.15.52:6801/561717915] conn(0x7f85dc039260 0x7f85dc03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 --2- 172.21.15.52:0/2540246199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85f0107740 0x7f85f019b6d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 >> 172.21.15.52:0/2540246199 conn(0x7f85f0102ef0 msgr2=0x7f85f0103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 shutdown_connections 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:32.210+0000 7f85f6486640 1 -- 172.21.15.52:0/2540246199 wait complete. 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:mgr epoch 9 is available 2024-09-19T09:12:32.970 INFO:teuthology.orchestra.run.smithi052.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:12:33.382 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:33 smithi052 ceph-mon[30947]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:12:33.382 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:33 smithi052 ceph-mon[30947]: mgrmap e11: x(active, since 1.00574s) 2024-09-19T09:12:33.382 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:33 smithi052 ceph-mon[30947]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.399+0000 7fe96f9c4640 1 Processor -- start 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.399+0000 7fe96f9c4640 1 -- start start 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.399+0000 7fe96f9c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.399+0000 7fe96f9c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe96807be50 con 0x7fe968105fa0 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.399+0000 7fe96d760640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.400+0000 7fe96d760640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55082/0 (socket says 172.21.15.52:55082) 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.400+0000 7fe96d760640 1 -- 172.21.15.52:0/1508167514 learned_addr learned my addr 172.21.15.52:0/1508167514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.400+0000 7fe96d760640 1 -- 172.21.15.52:0/1508167514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9681068e0 con 0x7fe968105fa0 2024-09-19T09:12:34.269 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe96d760640 1 --2- 172.21.15.52:0/1508167514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe964009820 tx=0x7fe96402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4d50945e990cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe95ffff640 1 -- 172.21.15.52:0/1508167514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964037070 con 0x7fe968105fa0 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe95ffff640 1 -- 172.21.15.52:0/1508167514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe964032920 con 0x7fe968105fa0 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe95ffff640 1 -- 172.21.15.52:0/1508167514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964030810 con 0x7fe968105fa0 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe96f9c4640 1 -- 172.21.15.52:0/1508167514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 msgr2=0x7fe9681063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.401+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/1508167514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe964009820 tx=0x7fe96402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- 172.21.15.52:0/1508167514 shutdown_connections 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/1508167514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe9681063a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- 172.21.15.52:0/1508167514 >> 172.21.15.52:0/1508167514 conn(0x7fe968101d70 msgr2=0x7fe968104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- 172.21.15.52:0/1508167514 shutdown_connections 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- 172.21.15.52:0/1508167514 wait complete. 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 Processor -- start 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- start start 2024-09-19T09:12:34.270 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.402+0000 7fe96f9c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681079b0 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96d760640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96d760640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55084/0 (socket says 172.21.15.52:55084) 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96d760640 1 -- 172.21.15.52:0/3879258177 learned_addr learned my addr 172.21.15.52:0/3879258177 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96d760640 1 -- 172.21.15.52:0/3879258177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96819dda0 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96d760640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097f0 tx=0x7fe9640327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe964037040 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe964030cc0 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96403a6b0 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96819e030 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.403+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9681a0d20 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.404+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fe96403baf0 con 0x7fe968105fa0 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.404+0000 7fe95e7fc640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 0x7fe95403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:34.271 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.405+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe96406c8b0 con 0x7fe968105fa0 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.405+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9681063a0 con 0x7fe968105fa0 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.405+0000 7fe96cf5f640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 0x7fe95403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.405+0000 7fe96cf5f640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 0x7fe95403b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9580098c0 tx=0x7fe958006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.410+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe964042e10 con 0x7fe968105fa0 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.608+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fe96802d8d0 con 0x7fe954039260 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.677+0000 7fe95e7fc640 1 -- 172.21.15.52:0/3879258177 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fe96802d8d0 con 0x7fe954039260 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.679+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 msgr2=0x7fe95403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.679+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 0x7fe95403b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9580098c0 tx=0x7fe958006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.679+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 msgr2=0x7fe96819d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.679+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9640097f0 tx=0x7fe9640327b0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 shutdown_connections 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe954039260 0x7fe95403b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 --2- 172.21.15.52:0/3879258177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe968105fa0 0x7fe96819d860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 >> 172.21.15.52:0/3879258177 conn(0x7fe968101d70 msgr2=0x7fe968194500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 shutdown_connections 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:33.680+0000 7fe96f9c4640 1 -- 172.21.15.52:0/3879258177 wait complete. 2024-09-19T09:12:34.273 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial admin user... 2024-09-19T09:12:34.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-mon[30947]: mgrmap e12: x(active, since 2s) 2024-09-19T09:12:34.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:34.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:34.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:34.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:34] ENGINE Bus STARTING 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:34.170+0000 7fac37ad3640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:12:34] ENGINE Error in HTTPServer.serve 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: Traceback (most recent call last): 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._connections.run(self.expiration_interval) 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._run(expiration_interval) 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:12:34.388 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: s = self.context.wrap_socket( 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: return self.sslsocket_class._create( 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self.do_handshake() 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: self._sslobj.do_handshake() 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:12:34.389 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:12:34 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:12:35.717 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$3iUyHOvA4rKYKtyq6TvGb.1rYpqH.4YyCoEGMcIHVE/xs6V0lnMny", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726737155, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:12:35.717 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.671+0000 7fad3f88d640 1 Processor -- start 2024-09-19T09:12:35.717 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3f88d640 1 -- start start 2024-09-19T09:12:35.717 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3f88d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3f88d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad3807bed0 con 0x7fad38108130 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3d629640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3d629640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55094/0 (socket says 172.21.15.52:55094) 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3d629640 1 -- 172.21.15.52:0/3801008725 learned_addr learned my addr 172.21.15.52:0/3801008725 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.672+0000 7fad3d629640 1 -- 172.21.15.52:0/3801008725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3810aa60 con 0x7fad38108130 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.673+0000 7fad3d629640 1 --2- 172.21.15.52:0/3801008725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad34009820 tx=0x7fad3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e128f2b50d4a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.673+0000 7fad2ffff640 1 -- 172.21.15.52:0/3801008725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34037070 con 0x7fad38108130 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.673+0000 7fad2ffff640 1 -- 172.21.15.52:0/3801008725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad34032920 con 0x7fad38108130 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.673+0000 7fad2ffff640 1 -- 172.21.15.52:0/3801008725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34030810 con 0x7fad38108130 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 -- 172.21.15.52:0/3801008725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 msgr2=0x7fad3810a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 --2- 172.21.15.52:0/3801008725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fad34009820 tx=0x7fad3402a270 comp rx=0 tx=0).stop 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 -- 172.21.15.52:0/3801008725 shutdown_connections 2024-09-19T09:12:35.718 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 --2- 172.21.15.52:0/3801008725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad3810a520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 -- 172.21.15.52:0/3801008725 >> 172.21.15.52:0/3801008725 conn(0x7fad38101d70 msgr2=0x7fad38104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 -- 172.21.15.52:0/3801008725 shutdown_connections 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.674+0000 7fad3f88d640 1 -- 172.21.15.52:0/3801008725 wait complete. 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3f88d640 1 Processor -- start 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3f88d640 1 -- start start 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3f88d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3f88d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810bad0 con 0x7fad38108130 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3d629640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3d629640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55108/0 (socket says 172.21.15.52:55108) 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3d629640 1 -- 172.21.15.52:0/4264210218 learned_addr learned my addr 172.21.15.52:0/4264210218 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3d629640 1 -- 172.21.15.52:0/4264210218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad38107ef0 con 0x7fad38108130 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.675+0000 7fad3d629640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad34030380 tx=0x7fad34032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.719 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.676+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad34037040 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.676+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad34040070 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.676+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad381060e0 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.676+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad3403a7b0 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.676+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad38106620 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fad3403a9e0 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad2e7fc640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 0x7fad2403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fad3406c9c0 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad38108590 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad3ce28640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 0x7fad2403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.677+0000 7fad3ce28640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 0x7fad2403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad280098c0 tx=0x7fad28006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.682+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad34044c70 con 0x7fad38108130 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:34.872+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fad38106cd0 con 0x7fad24039260 2024-09-19T09:12:35.720 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.120+0000 7fad2e7fc640 1 -- 172.21.15.52:0/4264210218 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fad38106cd0 con 0x7fad24039260 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 msgr2=0x7fad2403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 0x7fad2403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad280098c0 tx=0x7fad28006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 msgr2=0x7fad381079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fad34030380 tx=0x7fad34032670 comp rx=0 tx=0).stop 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 shutdown_connections 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad24039260 0x7fad2403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 --2- 172.21.15.52:0/4264210218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38108130 0x7fad381079b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 >> 172.21.15.52:0/4264210218 conn(0x7fad38101d70 msgr2=0x7fad38102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 shutdown_connections 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:35.123+0000 7fad3f88d640 1 -- 172.21.15.52:0/4264210218 wait complete. 2024-09-19T09:12:35.721 INFO:teuthology.orchestra.run.smithi052.stdout:Fetching dashboard port number... 2024-09-19T09:12:36.327 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:34] ENGINE Serving on https://172.21.15.52:7150 2024-09-19T09:12:36.327 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:34] ENGINE Error in HTTPServer.serve 2024-09-19T09:12:36.327 INFO:journalctl@ceph.mon.a.smithi052.stdout: Traceback (most recent call last): 2024-09-19T09:12:36.327 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:12:36.327 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._run(expiration_interval) 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: s = self.context.wrap_socket( 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: return self.sslsocket_class._create( 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: self.do_handshake() 2024-09-19T09:12:36.328 INFO:journalctl@ceph.mon.a.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout: self._sslobj.do_handshake() 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:34] ENGINE Serving on http://172.21.15.52:8765 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: [19/Sep/2024:09:12:34] ENGINE Bus STARTED 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:36.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:37.028 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:12:37.028 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f434d474640 1 Processor -- start 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f434d474640 1 -- start start 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f434d474640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f434d474640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f434807bed0 con 0x7f4348108130 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55114/0 (socket says 172.21.15.52:55114) 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f4346ffd640 1 -- 172.21.15.52:0/1270279 learned_addr learned my addr 172.21.15.52:0/1270279 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.121+0000 7f4346ffd640 1 -- 172.21.15.52:0/1270279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434810aa60 con 0x7f4348108130 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.122+0000 7f4346ffd640 1 --2- 172.21.15.52:0/1270279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4338009820 tx=0x7f433802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f14769c349eacb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:37.029 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.122+0000 7f4345ffb640 1 -- 172.21.15.52:0/1270279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4338037070 con 0x7f4348108130 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.122+0000 7f4345ffb640 1 -- 172.21.15.52:0/1270279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4338032920 con 0x7f4348108130 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.122+0000 7f4345ffb640 1 -- 172.21.15.52:0/1270279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4338030810 con 0x7f4348108130 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 -- 172.21.15.52:0/1270279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 msgr2=0x7f434810a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 --2- 172.21.15.52:0/1270279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4338009820 tx=0x7f433802a270 comp rx=0 tx=0).stop 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 -- 172.21.15.52:0/1270279 shutdown_connections 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 --2- 172.21.15.52:0/1270279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434810a520 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 -- 172.21.15.52:0/1270279 >> 172.21.15.52:0/1270279 conn(0x7f4348101d70 msgr2=0x7f4348104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 -- 172.21.15.52:0/1270279 shutdown_connections 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.123+0000 7f434d474640 1 -- 172.21.15.52:0/1270279 wait complete. 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f434d474640 1 Processor -- start 2024-09-19T09:12:37.030 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f434d474640 1 -- start start 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f434d474640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f434d474640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f434810bad0 con 0x7f4348108130 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f4346ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55122/0 (socket says 172.21.15.52:55122) 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f4346ffd640 1 -- 172.21.15.52:0/2135883113 learned_addr learned my addr 172.21.15.52:0/2135883113 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.124+0000 7f4346ffd640 1 -- 172.21.15.52:0/2135883113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434819bba0 con 0x7f4348108130 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f4346ffd640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4338030380 tx=0x7f4338032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4338037040 con 0x7f4348108130 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4338040070 con 0x7f4348108130 2024-09-19T09:12:37.031 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434819be30 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f433803a7b0 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.125+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434819eb20 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f433803aa30 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f432ffff640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 0x7f433003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f433806ca20 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f43467fc640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 0x7f433003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4348108590 con 0x7f4348108130 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.126+0000 7f43467fc640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 0x7f433003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098c0 tx=0x7f433c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:37.032 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.131+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4338044c70 con 0x7f4348108130 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.326+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f434819efe0 con 0x7f4348108130 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.327+0000 7f432ffff640 1 -- 172.21.15.52:0/2135883113 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f4338041270 con 0x7f4348108130 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 msgr2=0x7f433003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 0x7f433003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f433c0098c0 tx=0x7f433c006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 msgr2=0x7f434819b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4338030380 tx=0x7f4338032670 comp rx=0 tx=0).stop 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 shutdown_connections 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4330039200 0x7f433003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 --2- 172.21.15.52:0/2135883113 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4348108130 0x7f434819b660 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 >> 172.21.15.52:0/2135883113 conn(0x7f4348101d70 msgr2=0x7f43481028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 shutdown_connections 2024-09-19T09:12:37.034 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:36.329+0000 7f434d474640 1 -- 172.21.15.52:0/2135883113 wait complete. 2024-09-19T09:12:37.035 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:12:37.035 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-19T09:12:37.043 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:12:37.043 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-19T09:12:37.043 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-19T09:12:37.043 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout:Ceph Dashboard is now available at: 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout: URL: https://smithi052.front.sepia.ceph.com:8443/ 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout: User: admin 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout: Password: tydvbc97ul 2024-09-19T09:12:37.045 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:37.046 INFO:teuthology.orchestra.run.smithi052.stdout:Saving cluster configuration to /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config directory 2024-09-19T09:12:37.168 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:37 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2135883113' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.490+0000 7f88f2e79640 1 Processor -- start 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f2e79640 1 -- start start 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f2e79640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f2e79640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec106f90 con 0x7f88ec1065c0 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f0c15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.697 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f0c15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55136/0 (socket says 172.21.15.52:55136) 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f0c15640 1 -- 172.21.15.52:0/3579232556 learned_addr learned my addr 172.21.15.52:0/3579232556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.491+0000 7f88f0c15640 1 -- 172.21.15.52:0/3579232556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec1077c0 con 0x7f88ec1065c0 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.492+0000 7f88f0c15640 1 --2- 172.21.15.52:0/3579232556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009820 tx=0x7f88e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c606566c7c1c601 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.492+0000 7f88eb7fe640 1 -- 172.21.15.52:0/3579232556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e0037070 con 0x7f88ec1065c0 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.492+0000 7f88eb7fe640 1 -- 172.21.15.52:0/3579232556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0032920 con 0x7f88ec1065c0 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.492+0000 7f88eb7fe640 1 -- 172.21.15.52:0/3579232556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e0030810 con 0x7f88ec1065c0 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 -- 172.21.15.52:0/3579232556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 msgr2=0x7f88ec1069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3579232556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009820 tx=0x7f88e002a270 comp rx=0 tx=0).stop 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 -- 172.21.15.52:0/3579232556 shutdown_connections 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3579232556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec1069c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 -- 172.21.15.52:0/3579232556 >> 172.21.15.52:0/3579232556 conn(0x7f88ec101d70 msgr2=0x7f88ec104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 -- 172.21.15.52:0/3579232556 shutdown_connections 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.493+0000 7f88f2e79640 1 -- 172.21.15.52:0/3579232556 wait complete. 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f2e79640 1 Processor -- start 2024-09-19T09:12:38.698 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f2e79640 1 -- start start 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f2e79640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f2e79640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec10ab70 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f0c15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f0c15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55144/0 (socket says 172.21.15.52:55144) 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.494+0000 7f88f0c15640 1 -- 172.21.15.52:0/3551249406 learned_addr learned my addr 172.21.15.52:0/3551249406 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88f0c15640 1 -- 172.21.15.52:0/3551249406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec19bbd0 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88f0c15640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88e0030560 tx=0x7f88e0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e0037040 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec19be60 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88e0040070 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88e003a740 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.495+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec19eb50 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.496+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f88e003a8e0 con 0x7f88ec1065c0 2024-09-19T09:12:38.699 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.496+0000 7f88e9ffb640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 0x7f88dc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.496+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f88e006ca00 con 0x7f88ec1065c0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.496+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec106a40 con 0x7f88ec1065c0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.497+0000 7f88ebfff640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 0x7f88dc03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.497+0000 7f88ebfff640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 0x7f88dc03b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88d80098c0 tx=0x7f88d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.501+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88e0044c70 con 0x7f88ec1065c0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.780+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f88ec02d900 con 0x7f88ec1065c0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.782+0000 7f88e9ffb640 1 -- 172.21.15.52:0/3551249406 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f88e0041270 con 0x7f88ec1065c0 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 msgr2=0x7f88dc03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 0x7f88dc03b720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88d80098c0 tx=0x7f88d8006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 msgr2=0x7f88ec19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f88e0030560 tx=0x7f88e0032670 comp rx=0 tx=0).stop 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 shutdown_connections 2024-09-19T09:12:38.700 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88dc039260 0x7f88dc03b720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 --2- 172.21.15.52:0/3551249406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88ec1065c0 0x7f88ec19b690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.784+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 >> 172.21.15.52:0/3551249406 conn(0x7f88ec101d70 msgr2=0x7f88ec102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.785+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 shutdown_connections 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr 2024-09-19T09:12:37.785+0000 7f88f2e79640 1 -- 172.21.15.52:0/3551249406 wait complete. 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:12:38.701 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout: ceph telemetry on 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:For more information see: 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:Bootstrap complete. 2024-09-19T09:12:38.746 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:12:38.746 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:12:38.746 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:12:38.764 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:12:38.764 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:12:38.764 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:12:38.822 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:12:38.822 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:12:38.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T09:12:38.891 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:12:38.891 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:12:38.892 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:12:38.948 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:12:38.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:12:39.003 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:38 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3551249406' entity='client.admin' 2024-09-19T09:12:39.003 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:38 smithi052 ceph-mon[30947]: mgrmap e13: x(active, since 6s) 2024-09-19T09:12:39.031 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:39.042 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:12:39.084 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:39.096 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:12:39.138 INFO:teuthology.orchestra.run.smithi169.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHAj3ux++8h34KANwjCuYzZEVWqYZT+qIj+qLWwxtNZVDeKxZxYFMLeI/Dli/PwW54fwk4W/SM1n0Xt2eSNE/ihOj3378B/Ds+jf4dAQOJlI1bTwWeLn6VqwpUEaTE8N7gR9NIcUQzrn6ScxRYNNC5xAMGvW4E0hPtyUOP9zCUZ54l9iO8UCtiWT6Eg56+p1T1/8UDIewIOfQqeJxNhWn8Nh0DJH9ykWPj6/RqKDOx5hcbHbkYBCU9qe+TAUaX1ivhvbQGbwwtTTFCbPNAqoA0AtHUoOMyRqiCpxxVn8vk+Yv9dG1DJ+7yEOtT2x1+Wj26jXT2uX6d7J+gvzPy79vfB+gpf3MghO4ia17QnJSmre6zgmxHI9LVSj+tAw+yGDC3AUKTquGOdWB63IWRAsnzm1ZIUfh6Gw4UMZviKucahrxyN392uImrjlABG8Os6AvMT2jb+4tjZVxxeUzFTGfyhGqcIt5aYy6RYNB1ilJC8mCNj8FbYdFoXciGxa9Xrbc= ceph-044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:12:39.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:12:39.406 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 -- 172.21.15.52:0/3857528138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 msgr2=0x7f278c1044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 --2- 172.21.15.52:0/3857528138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c1044c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f277c009880 tx=0x7f277c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 -- 172.21.15.52:0/3857528138 shutdown_connections 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 --2- 172.21.15.52:0/3857528138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c1044c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 -- 172.21.15.52:0/3857528138 >> 172.21.15.52:0/3857528138 conn(0x7f278c0fbcd0 msgr2=0x7f278c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 -- 172.21.15.52:0/3857528138 shutdown_connections 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.956+0000 7f2791e77640 1 -- 172.21.15.52:0/3857528138 wait complete. 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f2791e77640 1 Processor -- start 2024-09-19T09:12:40.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f2791e77640 1 -- start start 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f2791e77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f2791e77640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f278c107670 con 0x7f278c1020d0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f278b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f278b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55920/0 (socket says 172.21.15.52:55920) 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.957+0000 7f278b7fe640 1 -- 172.21.15.52:0/549362332 learned_addr learned my addr 172.21.15.52:0/549362332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f278b7fe640 1 -- 172.21.15.52:0/549362332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c101e90 con 0x7f278c1020d0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f278b7fe640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f277c004f60 tx=0x7f277c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c03f070 con 0x7f278c1020d0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c003ad0 con 0x7f278c1020d0 2024-09-19T09:12:40.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c100080 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f277c035030 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.958+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c1005c0 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.959+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f277c042070 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.959+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c107df0 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.959+0000 7f27897fa640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 0x7f277803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.959+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f277c06cee0 con 0x7f278c1020d0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.959+0000 7f2782ffd640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 0x7f277803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.960+0000 7f2782ffd640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 0x7f277803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27740098c0 tx=0x7f2774006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:39.964+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f277c02f300 con 0x7f278c1020d0 2024-09-19T09:12:40.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.141+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f278c1901d0 con 0x7f278c1020d0 2024-09-19T09:12:40.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.145+0000 7f27897fa640 1 -- 172.21.15.52:0/549362332 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f277c003c80 con 0x7f278c1020d0 2024-09-19T09:12:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 msgr2=0x7f277803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 0x7f277803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27740098c0 tx=0x7f2774006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 msgr2=0x7f278c101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f277c004f60 tx=0x7f277c0048f0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 shutdown_connections 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2778039480 0x7f277803b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 --2- 172.21.15.52:0/549362332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f278c1020d0 0x7f278c101950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 >> 172.21.15.52:0/549362332 conn(0x7f278c0fbcd0 msgr2=0x7f278c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 shutdown_connections 2024-09-19T09:12:40.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:40.147+0000 7f2791e77640 1 -- 172.21.15.52:0/549362332 wait complete. 2024-09-19T09:12:40.794 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:12:40.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:12:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:41.359 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:41 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/549362332' entity='client.admin' 2024-09-19T09:12:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 -- 172.21.15.52:0/360025378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 msgr2=0x7fbfe8101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/360025378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8101a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009880 tx=0x7fbfd802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 -- 172.21.15.52:0/360025378 shutdown_connections 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/360025378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8101a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 -- 172.21.15.52:0/360025378 >> 172.21.15.52:0/360025378 conn(0x7fbfe80fcdb0 msgr2=0x7fbfe80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 -- 172.21.15.52:0/360025378 shutdown_connections 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.653+0000 7fbfee9e0640 1 -- 172.21.15.52:0/360025378 wait complete. 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfee9e0640 1 Processor -- start 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfee9e0640 1 -- start start 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfee9e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfee9e0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe8107710 con 0x7fbfe8101600 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfe7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55936/0 (socket says 172.21.15.52:55936) 2024-09-19T09:12:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfe7fff640 1 -- 172.21.15.52:0/2118435305 learned_addr learned my addr 172.21.15.52:0/2118435305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.654+0000 7fbfe7fff640 1 -- 172.21.15.52:0/2118435305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe81972e0 con 0x7fbfe8101600 2024-09-19T09:12:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfe7fff640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004f60 tx=0x7fbfd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd803f070 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd8004d40 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe8197570 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfd8035030 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.655+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe819a220 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.656+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbfd8042070 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.656+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe8107e90 con 0x7fbfe8101600 2024-09-19T09:12:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.656+0000 7fbfe57fa640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 0x7fbfd003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:41.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.656+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbfd806d080 con 0x7fbfe8101600 2024-09-19T09:12:41.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.656+0000 7fbfe77fe640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 0x7fbfd003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:41.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.657+0000 7fbfe77fe640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 0x7fbfd003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0098c0 tx=0x7fbfdc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.661+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbfd803b4b0 con 0x7fbfe8101600 2024-09-19T09:12:41.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.844+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fbfe802d940 con 0x7fbfd0039300 2024-09-19T09:12:41.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.847+0000 7fbfe57fa640 1 -- 172.21.15.52:0/2118435305 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbfe802d940 con 0x7fbfd0039300 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 msgr2=0x7fbfd003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 0x7fbfd003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0098c0 tx=0x7fbfdc006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 msgr2=0x7fbfe8196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004f60 tx=0x7fbfd80048f0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 shutdown_connections 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbfd0039300 0x7fbfd003b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 --2- 172.21.15.52:0/2118435305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbfe8101600 0x7fbfe8196da0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 >> 172.21.15.52:0/2118435305 conn(0x7fbfe80fcdb0 msgr2=0x7fbfe80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 shutdown_connections 2024-09-19T09:12:41.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:41.850+0000 7fbfee9e0640 1 -- 172.21.15.52:0/2118435305 wait complete. 2024-09-19T09:12:42.608 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:42.608 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:42.608 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:42.608 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-19T09:12:42.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:42 smithi052 ceph-mon[30947]: Updating smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:12:42.638 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi086 2024-09-19T09:12:42.638 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:12:42.638 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:12:42.658 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:12:42.658 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:42.717 INFO:tasks.cephadm:Adding host smithi086 to orchestrator... 2024-09-19T09:12:42.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch host add smithi086 2024-09-19T09:12:42.971 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.375+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/3817228946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 msgr2=0x7f5a64106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.375+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/3817228946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009810 tx=0x7f5a6002a540 comp rx=0 tx=0).stop 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/3817228946 shutdown_connections 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/3817228946 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/3817228946 >> 172.21.15.52:0/3817228946 conn(0x7f5a64077310 msgr2=0x7f5a640fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/3817228946 shutdown_connections 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/3817228946 wait complete. 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 Processor -- start 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.376+0000 7f5a6b9f8640 1 -- start start 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a6b9f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a6b9f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6410ab70 con 0x7f5a64106540 2024-09-19T09:12:43.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a69794640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a69794640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55958/0 (socket says 172.21.15.52:55958) 2024-09-19T09:12:43.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a69794640 1 -- 172.21.15.52:0/1441917510 learned_addr learned my addr 172.21.15.52:0/1441917510 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a69794640 1 -- 172.21.15.52:0/1441917510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a64198510 con 0x7f5a64106540 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a69794640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a600045e0 tx=0x7f5a60004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60030e70 con 0x7f5a64106540 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a600318e0 con 0x7f5a64106540 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a600049c0 con 0x7f5a64106540 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.377+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a641987a0 con 0x7f5a64106540 2024-09-19T09:12:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.378+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a64198c00 con 0x7f5a64106540 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.378+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5a60039040 con 0x7f5a64106540 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.378+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a64101bb0 con 0x7f5a64106540 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.378+0000 7f5a5a7fc640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 0x7f5a5003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.379+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5a6006d590 con 0x7f5a64106540 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.379+0000 7f5a68f93640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 0x7f5a5003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.379+0000 7f5a68f93640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 0x7f5a5003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a540098c0 tx=0x7f5a54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.383+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a60040030 con 0x7f5a64106540 2024-09-19T09:12:43.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:43.565+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}) -- 0x7f5a641069a0 con 0x7f5a500392a0 2024-09-19T09:12:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:43 smithi052 ceph-mon[30947]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:43 smithi052 ceph-mon[30947]: Updating smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:12:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:44.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:45.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:44 smithi052 ceph-mon[30947]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:46.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:45 smithi052 ceph-mon[30947]: Deploying cephadm binary to smithi086 2024-09-19T09:12:47.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.418+0000 7f5a5a7fc640 1 -- 172.21.15.52:0/1441917510 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5a641069a0 con 0x7f5a500392a0 2024-09-19T09:12:47.418 INFO:teuthology.orchestra.run.smithi052.stdout:Added host 'smithi086' with addr '172.21.15.86' 2024-09-19T09:12:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 msgr2=0x7f5a5003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 0x7f5a5003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a540098c0 tx=0x7f5a54006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 msgr2=0x7f5a64197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:47.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a600045e0 tx=0x7f5a60004610 comp rx=0 tx=0).stop 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 shutdown_connections 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a500392a0 0x7f5a5003b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 --2- 172.21.15.52:0/1441917510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a64106540 0x7f5a64197fd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 >> 172.21.15.52:0/1441917510 conn(0x7f5a64077310 msgr2=0x7f5a640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 shutdown_connections 2024-09-19T09:12:47.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:47.420+0000 7f5a6b9f8640 1 -- 172.21.15.52:0/1441917510 wait complete. 2024-09-19T09:12:48.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:12:48.358 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:48.673 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:48.673 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:48 smithi052 ceph-mon[30947]: Added host smithi086 2024-09-19T09:12:48.673 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:48.673 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:48.673 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:48.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 -- 172.21.15.52:0/487745490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 msgr2=0x7f3840106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:48.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 --2- 172.21.15.52:0/487745490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840106920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f383c009810 tx=0x7f383c02a540 comp rx=0 tx=0).stop 2024-09-19T09:12:48.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 -- 172.21.15.52:0/487745490 shutdown_connections 2024-09-19T09:12:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 --2- 172.21.15.52:0/487745490 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840106920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 -- 172.21.15.52:0/487745490 >> 172.21.15.52:0/487745490 conn(0x7f3840077310 msgr2=0x7f38400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 -- 172.21.15.52:0/487745490 shutdown_connections 2024-09-19T09:12:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.755+0000 7f384797d640 1 -- 172.21.15.52:0/487745490 wait complete. 2024-09-19T09:12:48.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f384797d640 1 Processor -- start 2024-09-19T09:12:48.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f384797d640 1 -- start start 2024-09-19T09:12:48.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f384797d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:48.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f384797d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f384010ab70 con 0x7f3840106540 2024-09-19T09:12:48.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f3845719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:48.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f3845719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38422/0 (socket says 172.21.15.52:38422) 2024-09-19T09:12:48.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.756+0000 7f3845719640 1 -- 172.21.15.52:0/3311741583 learned_addr learned my addr 172.21.15.52:0/3311741583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:48.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f3845719640 1 -- 172.21.15.52:0/3311741583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3840197650 con 0x7f3840106540 2024-09-19T09:12:48.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f3845719640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f383c0045e0 tx=0x7f383c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:48.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c030e70 con 0x7f3840106540 2024-09-19T09:12:48.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f383c0318e0 con 0x7f3840106540 2024-09-19T09:12:48.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38401978e0 con 0x7f3840106540 2024-09-19T09:12:48.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f383c0049c0 con 0x7f3840106540 2024-09-19T09:12:48.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.757+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384019b9e0 con 0x7f3840106540 2024-09-19T09:12:48.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.758+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f383c039040 con 0x7f3840106540 2024-09-19T09:12:48.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.758+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3840101bb0 con 0x7f3840106540 2024-09-19T09:12:48.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.758+0000 7f38367fc640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 0x7f382c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:48.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.758+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f383c06d540 con 0x7f3840106540 2024-09-19T09:12:48.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.758+0000 7f3844f18640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 0x7f382c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:48.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.759+0000 7f3844f18640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 0x7f382c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38300098c0 tx=0x7f3830006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:48.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.763+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f383c040030 con 0x7f3840106540 2024-09-19T09:12:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.946+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3840198470 con 0x7f382c039300 2024-09-19T09:12:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.947+0000 7f38367fc640 1 -- 172.21.15.52:0/3311741583 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f3840198470 con 0x7f382c039300 2024-09-19T09:12:48.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:48.948 INFO:teuthology.orchestra.run.smithi052.stdout:[{"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}] 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.949+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 msgr2=0x7f382c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.949+0000 7f384797d640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 0x7f382c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f38300098c0 tx=0x7f3830006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 msgr2=0x7f3840197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f383c0045e0 tx=0x7f383c004610 comp rx=0 tx=0).stop 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 shutdown_connections 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f382c039300 0x7f382c03b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 --2- 172.21.15.52:0/3311741583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3840106540 0x7f3840197110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 >> 172.21.15.52:0/3311741583 conn(0x7f3840077310 msgr2=0x7f38400696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 shutdown_connections 2024-09-19T09:12:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:48.950+0000 7f384797d640 1 -- 172.21.15.52:0/3311741583 wait complete. 2024-09-19T09:12:49.534 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi169 2024-09-19T09:12:49.535 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:12:49.535 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:12:49.554 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:12:49.554 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:49.612 INFO:tasks.cephadm:Adding host smithi169 to orchestrator... 2024-09-19T09:12:49.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch host add smithi169 2024-09-19T09:12:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:50.011 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:50.011 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:49 smithi052 ceph-mon[30947]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:12:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.305+0000 7fe17f750640 1 -- 172.21.15.52:0/674459015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 msgr2=0x7fe1781006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.305+0000 7fe17f750640 1 --2- 172.21.15.52:0/674459015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781006c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe174009880 tx=0x7fe17402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.305+0000 7fe17f750640 1 -- 172.21.15.52:0/674459015 shutdown_connections 2024-09-19T09:12:50.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.305+0000 7fe17f750640 1 --2- 172.21.15.52:0/674459015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781006c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.305+0000 7fe17f750640 1 -- 172.21.15.52:0/674459015 >> 172.21.15.52:0/674459015 conn(0x7fe1780fc1b0 msgr2=0x7fe1780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 -- 172.21.15.52:0/674459015 shutdown_connections 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 -- 172.21.15.52:0/674459015 wait complete. 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 Processor -- start 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 -- start start 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:50.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17f750640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe17810dea0 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17d4ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17d4ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38438/0 (socket says 172.21.15.52:38438) 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.306+0000 7fe17d4ec640 1 -- 172.21.15.52:0/1150990786 learned_addr learned my addr 172.21.15.52:0/1150990786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe17d4ec640 1 -- 172.21.15.52:0/1150990786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178199910 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe17d4ec640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe174009230 tx=0x7fe174003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe17403f070 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe17403bc80 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe178199ba0 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe174035030 con 0x7fe1781002e0 2024-09-19T09:12:50.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.307+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17819a000 con 0x7fe1781002e0 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.308+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe174042070 con 0x7fe1781002e0 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.308+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17806a7b0 con 0x7fe1781002e0 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.308+0000 7fe16e7fc640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 0x7fe16403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.309+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe17406cff0 con 0x7fe1781002e0 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.309+0000 7fe17cceb640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 0x7fe16403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:50.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.309+0000 7fe17cceb640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 0x7fe16403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1680098c0 tx=0x7fe168006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:50.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.313+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe174031e20 con 0x7fe1781002e0 2024-09-19T09:12:50.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:50.496+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}) -- 0x7fe17819a790 con 0x7fe1640392a0 2024-09-19T09:12:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:51 smithi052 ceph-mon[30947]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi169", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:52.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:12:52.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: Updating smithi086:/etc/ceph/ceph.conf 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: Updating smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: Deploying cephadm binary to smithi169 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:53.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:53 smithi052 ceph-mon[30947]: Updating smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:12:54.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.568+0000 7fe16e7fc640 1 -- 172.21.15.52:0/1150990786 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe17819a790 con 0x7fe1640392a0 2024-09-19T09:12:54.569 INFO:teuthology.orchestra.run.smithi052.stdout:Added host 'smithi169' with addr '172.21.15.169' 2024-09-19T09:12:54.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 msgr2=0x7fe16403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:54.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 0x7fe16403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe1680098c0 tx=0x7fe168006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 msgr2=0x7fe1781993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe174009230 tx=0x7fe174003d40 comp rx=0 tx=0).stop 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 shutdown_connections 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1640392a0 0x7fe16403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 --2- 172.21.15.52:0/1150990786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1781002e0 0x7fe1781993d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.571+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 >> 172.21.15.52:0/1150990786 conn(0x7fe1780fc1b0 msgr2=0x7fe1780fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.572+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 shutdown_connections 2024-09-19T09:12:54.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:54.572+0000 7fe17f750640 1 -- 172.21.15.52:0/1150990786 wait complete. 2024-09-19T09:12:54.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:54 smithi052 ceph-mon[30947]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:12:54.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:54 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:54.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:54 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:55.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:12:55.412 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/1389025024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 msgr2=0x7f7d58106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/1389025024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009880 tx=0x7f7d4802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:55.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/1389025024 shutdown_connections 2024-09-19T09:12:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/1389025024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/1389025024 >> 172.21.15.52:0/1389025024 conn(0x7f7d580fc1b0 msgr2=0x7f7d580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/1389025024 shutdown_connections 2024-09-19T09:12:55.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.836+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/1389025024 wait complete. 2024-09-19T09:12:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5cc1d640 1 Processor -- start 2024-09-19T09:12:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5cc1d640 1 -- start start 2024-09-19T09:12:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5cc1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5cc1d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5810ab90 con 0x7f7d58106560 2024-09-19T09:12:55.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38448/0 (socket says 172.21.15.52:38448) 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5659c640 1 -- 172.21.15.52:0/39636441 learned_addr learned my addr 172.21.15.52:0/39636441 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.837+0000 7f7d5659c640 1 -- 172.21.15.52:0/39636441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d58196570 con 0x7f7d58106560 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d5659c640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009230 tx=0x7f7d48003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4803f070 con 0x7f7d58106560 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d58196800 con 0x7f7d58106560 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d4803bc80 con 0x7f7d58106560 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d48035030 con 0x7f7d58106560 2024-09-19T09:12:55.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.838+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5819a900 con 0x7f7d58106560 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.839+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7d48042070 con 0x7f7d58106560 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.839+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d58101bd0 con 0x7f7d58106560 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.839+0000 7f7d477fe640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 0x7f7d4003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.839+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7d4806cfc0 con 0x7f7d58106560 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.839+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 0x7f7d4003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:55.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.840+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 0x7f7d4003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0098c0 tx=0x7f7d4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:55.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:55.844+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d4804c350 con 0x7f7d58106560 2024-09-19T09:12:56.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.024+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d581069c0 con 0x7f7d400392a0 2024-09-19T09:12:56.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.025+0000 7f7d477fe640 1 -- 172.21.15.52:0/39636441 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f7d581069c0 con 0x7f7d400392a0 2024-09-19T09:12:56.025 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:12:56.026 INFO:teuthology.orchestra.run.smithi052.stdout:[{"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}, {"addr": "172.21.15.169", "hostname": "smithi169", "labels": [], "status": ""}] 2024-09-19T09:12:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 msgr2=0x7f7d4003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:56.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 0x7f7d4003b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0098c0 tx=0x7f7d4c006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 msgr2=0x7f7d58196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009230 tx=0x7f7d48003d40 comp rx=0 tx=0).stop 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 shutdown_connections 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d400392a0 0x7f7d4003b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 --2- 172.21.15.52:0/39636441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d58106560 0x7f7d58196030 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 >> 172.21.15.52:0/39636441 conn(0x7f7d580fc1b0 msgr2=0x7f7d580fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 shutdown_connections 2024-09-19T09:12:56.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:56.027+0000 7f7d5cc1d640 1 -- 172.21.15.52:0/39636441 wait complete. 2024-09-19T09:12:56.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:55 smithi052 ceph-mon[30947]: Added host smithi169 2024-09-19T09:12:56.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:56.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:56.678 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:12:56.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:12:56.933 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:57.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:56 smithi052 ceph-mon[30947]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:12:57.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:57.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:56 smithi052 ceph-mon[30947]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:12:57.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 -- 172.21.15.52:0/3593614442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 msgr2=0x7f564c1006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 --2- 172.21.15.52:0/3593614442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c1006c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f563c009880 tx=0x7f563c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 -- 172.21.15.52:0/3593614442 shutdown_connections 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 --2- 172.21.15.52:0/3593614442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c1006c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 -- 172.21.15.52:0/3593614442 >> 172.21.15.52:0/3593614442 conn(0x7f564c0fc1b0 msgr2=0x7f564c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 -- 172.21.15.52:0/3593614442 shutdown_connections 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.380+0000 7f565229c640 1 -- 172.21.15.52:0/3593614442 wait complete. 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.381+0000 7f565229c640 1 Processor -- start 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.381+0000 7f565229c640 1 -- start start 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.381+0000 7f565229c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.381+0000 7f565229c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f564c10dea0 con 0x7f564c1002e0 2024-09-19T09:12:57.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f564bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f564bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38466/0 (socket says 172.21.15.52:38466) 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f564bfff640 1 -- 172.21.15.52:0/482906121 learned_addr learned my addr 172.21.15.52:0/482906121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f564bfff640 1 -- 172.21.15.52:0/482906121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c1998b0 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f564bfff640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f563c009230 tx=0x7f563c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c03f070 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c199b40 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f563c03bc80 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f563c035030 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.382+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c199fa0 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.383+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f563c042070 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.383+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564c06a7b0 con 0x7f564c1002e0 2024-09-19T09:12:57.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.383+0000 7f5649ffb640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 0x7f563803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:57.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.384+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f563c06cfd0 con 0x7f564c1002e0 2024-09-19T09:12:57.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.384+0000 7f5643fff640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 0x7f563803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:57.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.384+0000 7f5643fff640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 0x7f563803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56340098c0 tx=0x7f5634006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:57.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.388+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f563c031e20 con 0x7f564c1002e0 2024-09-19T09:12:57.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.573+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f564c19a730 con 0x7f564c1002e0 2024-09-19T09:12:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.941+0000 7f5649ffb640 1 -- 172.21.15.52:0/482906121 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f563c0372d0 con 0x7f564c1002e0 2024-09-19T09:12:57.942 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-19T09:12:57.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 msgr2=0x7f563803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 0x7f563803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56340098c0 tx=0x7f5634006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 msgr2=0x7f564c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f563c009230 tx=0x7f563c003d40 comp rx=0 tx=0).stop 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 shutdown_connections 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56380392a0 0x7f563803b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 --2- 172.21.15.52:0/482906121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f564c1002e0 0x7f564c199370 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.944+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 >> 172.21.15.52:0/482906121 conn(0x7f564c0fc1b0 msgr2=0x7f564c0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.945+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 shutdown_connections 2024-09-19T09:12:57.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:12:57.945+0000 7f565229c640 1 -- 172.21.15.52:0/482906121 wait complete. 2024-09-19T09:12:58.255 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:57 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/482906121' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:12:58.524 INFO:tasks.cephadm:Adding mon.a on smithi052 2024-09-19T09:12:58.524 INFO:tasks.cephadm:Adding mon.b on smithi086 2024-09-19T09:12:58.524 INFO:tasks.cephadm:Adding mon.c on smithi169 2024-09-19T09:12:58.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi052:172.21.15.52=a;smithi086:172.21.15.86=b;smithi169:172.21.15.169=c' 2024-09-19T09:12:58.790 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:12:58.836 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 -- 172.21.15.169:0/4056842824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 msgr2=0x7fc798100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/4056842824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc798100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009880 tx=0x7fc78c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 -- 172.21.15.169:0/4056842824 shutdown_connections 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/4056842824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc798100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 -- 172.21.15.169:0/4056842824 >> 172.21.15.169:0/4056842824 conn(0x7fc7980fbcd0 msgr2=0x7fc7980fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:59.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 -- 172.21.15.169:0/4056842824 shutdown_connections 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.265+0000 7fc79ed3e640 1 -- 172.21.15.169:0/4056842824 wait complete. 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79ed3e640 1 Processor -- start 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79ed3e640 1 -- start start 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79ed3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79ed3e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981065f0 con 0x7fc798100540 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79cada640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79cada640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.169:35534/0 (socket says 172.21.15.169:35534) 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.266+0000 7fc79cada640 1 -- 172.21.15.169:0/3986400772 learned_addr learned my addr 172.21.15.169:0/3986400772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc79cada640 1 -- 172.21.15.169:0/3986400772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc798199a70 con 0x7fc798100540 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc79cada640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc78c004f60 tx=0x7fc78c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c03f070 con 0x7fc798100540 2024-09-19T09:12:59.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc798199c40 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc78c004d40 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c035030 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.267+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79819a060 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.268+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc78c042070 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.268+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc798106d70 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.269+0000 7fc795ffb640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 0x7fc78803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.269+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc78c06d000 con 0x7fc798100540 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.269+0000 7fc797fff640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 0x7fc78803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.269+0000 7fc797fff640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 0x7fc78803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098c0 tx=0x7fc784006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:59.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.274+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc78c04a260 con 0x7fc798100540 2024-09-19T09:12:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:12:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/482906121' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:12:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:12:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:12:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi169", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:59.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.462+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi052:172.21.15.52=a;smithi086:172.21.15.86=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}) -- 0x7fc79802da80 con 0x7fc7880392a0 2024-09-19T09:12:59.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.467+0000 7fc795ffb640 1 -- 172.21.15.169:0/3986400772 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc79802da80 con 0x7fc7880392a0 2024-09-19T09:12:59.467 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mon update... 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 msgr2=0x7fc78803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 0x7fc78803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7840098c0 tx=0x7fc784006db0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 msgr2=0x7fc79806a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc78c004f60 tx=0x7fc78c0048f0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 shutdown_connections 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7880392a0 0x7fc78803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 --2- 172.21.15.169:0/3986400772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc798100540 0x7fc79806a170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 >> 172.21.15.169:0/3986400772 conn(0x7fc7980fbcd0 msgr2=0x7fc7980fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 shutdown_connections 2024-09-19T09:12:59.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:12:59.470+0000 7fc79ed3e640 1 -- 172.21.15.169:0/3986400772 wait complete. 2024-09-19T09:13:00.085 DEBUG:teuthology.orchestra.run.smithi086:mon.b> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T09:13:00.088 DEBUG:teuthology.orchestra.run.smithi169:mon.c> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T09:13:00.091 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:13:00.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: Updating smithi169:/etc/ceph/ceph.conf 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: Updating smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: Updating smithi169:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:00.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:00.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:12:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:01.110 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:00 smithi052 ceph-mon[30947]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:00 smithi052 ceph-mon[30947]: Updating smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:13:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:00 smithi052 ceph-mon[30947]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi052:172.21.15.52=a;smithi086:172.21.15.86=b;smithi169:172.21.15.169=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:00 smithi052 ceph-mon[30947]: Saving service mon spec with placement smithi052:172.21.15.52=a;smithi086:172.21.15.86=b;smithi169:172.21.15.169=c;count:3 2024-09-19T09:13:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:00 smithi052 ceph-mon[30947]: Deploying daemon mon.c on smithi169 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 -- 172.21.15.169:0/1970993433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 msgr2=0x7f5eb8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/1970993433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb8107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009880 tx=0x7f5eac02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 -- 172.21.15.169:0/1970993433 shutdown_connections 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/1970993433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb8107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 -- 172.21.15.169:0/1970993433 >> 172.21.15.169:0/1970993433 conn(0x7f5eb80fd290 msgr2=0x7f5eb80ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:01.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 -- 172.21.15.169:0/1970993433 shutdown_connections 2024-09-19T09:13:01.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.685+0000 7f5ec06d1640 1 -- 172.21.15.169:0/1970993433 wait complete. 2024-09-19T09:13:01.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ec06d1640 1 Processor -- start 2024-09-19T09:13:01.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ec06d1640 1 -- start start 2024-09-19T09:13:01.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ec06d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:01.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ec06d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb810bc90 con 0x7f5eb8107660 2024-09-19T09:13:01.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ebe46d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ebe46d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.169:35538/0 (socket says 172.21.15.169:35538) 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ebe46d640 1 -- 172.21.15.169:0/3596178463 learned_addr learned my addr 172.21.15.169:0/3596178463 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.686+0000 7f5ebe46d640 1 -- 172.21.15.169:0/3596178463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb8197600 con 0x7f5eb8107660 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5ebe46d640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009230 tx=0x7f5eac003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eac03f070 con 0x7f5eb8107660 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb8197890 con 0x7f5eb8107660 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eac03bc80 con 0x7f5eb8107660 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eac035030 con 0x7f5eb8107660 2024-09-19T09:13:01.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.687+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb819b990 con 0x7f5eb8107660 2024-09-19T09:13:01.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.688+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5eac042070 con 0x7f5eb8107660 2024-09-19T09:13:01.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.688+0000 7f5eab7fe640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 0x7f5ea403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:01.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.688+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb8102cd0 con 0x7f5eb8107660 2024-09-19T09:13:01.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.688+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5eac06cfb0 con 0x7f5eb8107660 2024-09-19T09:13:01.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.688+0000 7f5ebdc6c640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 0x7f5ea403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:01.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.689+0000 7f5ebdc6c640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 0x7f5ea403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40098c0 tx=0x7f5eb4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:01.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.694+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5eac04c350 con 0x7f5eb8107660 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.930+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5eb8198420 con 0x7f5eb8107660 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.931+0000 7f5eab7fe640 1 -- 172.21.15.169:0/3596178463 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f5eac031e20 con 0x7f5eb8107660 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","modified":"2024-09-19T09:11:34.459294Z","created":"2024-09-19T09:11:34.459294Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 msgr2=0x7f5ea403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 0x7f5ea403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40098c0 tx=0x7f5eb4006db0 comp rx=0 tx=0).stop 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 msgr2=0x7f5eb81970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009230 tx=0x7f5eac003d40 comp rx=0 tx=0).stop 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 shutdown_connections 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ea40392a0 0x7f5ea403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 --2- 172.21.15.169:0/3596178463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb8107660 0x7f5eb81970c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 >> 172.21.15.169:0/3596178463 conn(0x7f5eb80fd290 msgr2=0x7f5eb80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 shutdown_connections 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:01.933+0000 7f5ec06d1640 1 -- 172.21.15.169:0/3596178463 wait complete. 2024-09-19T09:13:02.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/3596178463' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:02 smithi052 ceph-mon[30947]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:03.638 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:13:03.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:13:03.898 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:04.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.415+0000 7f9a24911640 1 -- 172.21.15.169:0/3308439454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 msgr2=0x7f9a20106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.415+0000 7f9a24911640 1 --2- 172.21.15.169:0/3308439454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20106a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009880 tx=0x7f9a0802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 -- 172.21.15.169:0/3308439454 shutdown_connections 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 --2- 172.21.15.169:0/3308439454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20106a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 -- 172.21.15.169:0/3308439454 >> 172.21.15.169:0/3308439454 conn(0x7f9a200fc220 msgr2=0x7f9a200fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 -- 172.21.15.169:0/3308439454 shutdown_connections 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 -- 172.21.15.169:0/3308439454 wait complete. 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 Processor -- start 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.416+0000 7f9a24911640 1 -- start start 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a24911640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:04.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a24911640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2010ac60 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.169:35552/0 (socket says 172.21.15.169:35552) 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a1e59c640 1 -- 172.21.15.169:0/51443626 learned_addr learned my addr 172.21.15.169:0/51443626 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a1e59c640 1 -- 172.21.15.169:0/51443626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a20196310 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.417+0000 7f9a1e59c640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009230 tx=0x7f9a08003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.418+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a0803f070 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.418+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201965a0 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.418+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0803bc80 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.418+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a20196a00 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.418+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08049060 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.419+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a20101ca0 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.419+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9a08042070 con 0x7f9a20106630 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.419+0000 7f9a177fe640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 0x7f9a0c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:04.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.419+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9a0806d320 con 0x7f9a20106630 2024-09-19T09:13:04.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.419+0000 7f9a1dd9b640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 0x7f9a0c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:04.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.420+0000 7f9a1dd9b640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 0x7f9a0c03b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a100098c0 tx=0x7f9a10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:04.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.424+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a08031d60 con 0x7f9a20106630 2024-09-19T09:13:04.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.662+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9a20106a90 con 0x7f9a20106630 2024-09-19T09:13:04.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.663+0000 7f9a177fe640 1 -- 172.21.15.169:0/51443626 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f9a080314c0 con 0x7f9a20106630 2024-09-19T09:13:04.665 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:13:04.665 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":1,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","modified":"2024-09-19T09:11:34.459294Z","created":"2024-09-19T09:11:34.459294Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 1 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 msgr2=0x7f9a0c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 0x7f9a0c03b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a100098c0 tx=0x7f9a10006db0 comp rx=0 tx=0).stop 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 msgr2=0x7f9a20195dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009230 tx=0x7f9a08003d40 comp rx=0 tx=0).stop 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 shutdown_connections 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a0c0392a0 0x7f9a0c03b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 --2- 172.21.15.169:0/51443626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20106630 0x7f9a20195dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 >> 172.21.15.169:0/51443626 conn(0x7f9a200fc220 msgr2=0x7f9a200fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:04.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 shutdown_connections 2024-09-19T09:13:04.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:04.665+0000 7f9a24911640 1 -- 172.21.15.169:0/51443626 wait complete. 2024-09-19T09:13:05.416 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:05 smithi169 systemd[1]: Started Ceph mon.c for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:13:05.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:04 smithi052 ceph-mon[30947]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:05.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/51443626' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:06.445 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:13:06.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:13:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:10.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 -- 172.21.15.169:0/1847933097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 msgr2=0x7f250c005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:10.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 --2- 172.21.15.169:0/1847933097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f250c005580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2514011c50 tx=0x7f251402be50 comp rx=0 tx=0).stop 2024-09-19T09:13:10.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 -- 172.21.15.169:0/1847933097 shutdown_connections 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 --2- 172.21.15.169:0/1847933097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f250c005580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 -- 172.21.15.169:0/1847933097 >> 172.21.15.169:0/1847933097 conn(0x7f25240fc280 msgr2=0x7f25240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 -- 172.21.15.169:0/1847933097 shutdown_connections 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.166+0000 7f2528f18640 1 -- 172.21.15.169:0/1847933097 wait complete. 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 Processor -- start 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 -- start start 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f25241994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2524108690 con 0x7f2524106650 2024-09-19T09:13:10.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.167+0000 7f2528f18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2524108510 con 0x7f25241999e0 2024-09-19T09:13:10.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:10.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:59714/0 (socket says 172.21.15.169:59714) 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 -- 172.21.15.169:0/4051731751 learned_addr learned my addr 172.21.15.169:0/4051731751 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 -- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 msgr2=0x7f252419dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 -- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 msgr2=0x7f252419dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f2521d9b640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f252259c640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f25241994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f252259c640 1 -- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 msgr2=0x7f252419dd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f252259c640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f252259c640 1 -- 172.21.15.169:0/4051731751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252419a000 con 0x7f2524106650 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.168+0000 7f252259c640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f25241994a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2514005f50 tx=0x7f2514005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.169+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f25140055f0 con 0x7f2524106650 2024-09-19T09:13:10.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.169+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25140108b0 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.169+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252419e2b0 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.169+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2514040420 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.169+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f252419e870 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.170+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f25140405c0 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.170+0000 7f25137fe640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 0x7f250403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.170+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2524101cc0 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.170+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f251403b070 con 0x7f2524106650 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.170+0000 7f2521d9b640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 0x7f250403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:10.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.171+0000 7f2521d9b640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 0x7f250403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2518009100 tx=0x7f2518008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:10.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.176+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2514039e20 con 0x7f2524106650 2024-09-19T09:13:10.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.410+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f252419eb50 con 0x7f2524106650 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: mon.a calling monitor election 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: mon.c calling monitor election 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: monmap epoch 2 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: last_changed 2024-09-19T09:13:05.003354+0000 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: min_mon_release 19 (squid) 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: election_strategy: 1 2024-09-19T09:13:10.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: fsmap 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: mgrmap e13: x(active, since 38s) 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: overall HEALTH_OK 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:10.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:10.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.411+0000 7f25137fe640 1 -- 172.21.15.169:0/4051731751 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f25140353b0 con 0x7f2524106650 2024-09-19T09:13:10.415 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:13:10.415 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","modified":"2024-09-19T09:13:05.003354Z","created":"2024-09-19T09:11:34.459294Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 msgr2=0x7f250403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 0x7f250403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2518009100 tx=0x7f2518008040 comp rx=0 tx=0).stop 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 msgr2=0x7f25241994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f25241994a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2514005f50 tx=0x7f2514005270 comp rx=0 tx=0).stop 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 shutdown_connections 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2504039090 0x7f250403b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f25241999e0 0x7f252419dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 --2- 172.21.15.169:0/4051731751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2524106650 0x7f25241994a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 >> 172.21.15.169:0/4051731751 conn(0x7f25240fc280 msgr2=0x7f2524069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:10.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 shutdown_connections 2024-09-19T09:13:10.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:10.413+0000 7f2528f18640 1 -- 172.21.15.169:0/4051731751 wait complete. 2024-09-19T09:13:10.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: mon.a calling monitor election 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: mon.c calling monitor election 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: monmap epoch 2 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: last_changed 2024-09-19T09:13:05.003354+0000 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: election_strategy: 1 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: fsmap 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:10.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: mgrmap e13: x(active, since 38s) 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: overall HEALTH_OK 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:10.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:11 smithi052 ceph-mon[30947]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:11 smithi052 ceph-mon[30947]: Deploying daemon mon.b on smithi086 2024-09-19T09:13:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:11 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/4051731751' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:11.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:11 smithi169 ceph-mon[35454]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:11 smithi169 ceph-mon[35454]: Deploying daemon mon.b on smithi086 2024-09-19T09:13:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:11 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/4051731751' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:11.991 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:13:11.991 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:13:12.243 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 -- 172.21.15.169:0/3729862547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 msgr2=0x7f638c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 --2- 172.21.15.169:0/3729862547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c107a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f637c009880 tx=0x7f637c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 -- 172.21.15.169:0/3729862547 shutdown_connections 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 --2- 172.21.15.169:0/3729862547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c107a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 -- 172.21.15.169:0/3729862547 >> 172.21.15.169:0/3729862547 conn(0x7f638c0fd320 msgr2=0x7f638c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 -- 172.21.15.169:0/3729862547 shutdown_connections 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 -- 172.21.15.169:0/3729862547 wait complete. 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.629+0000 7f6392927640 1 Processor -- start 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f6392927640 1 -- start start 2024-09-19T09:13:12.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f6392927640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f6392927640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f6392927640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10bd20 con 0x7f638c107660 2024-09-19T09:13:12.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f6392927640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f638c10bba0 con 0x7f638c074a30 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.169:40282/0 (socket says 172.21.15.169:40282) 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638bfff640 1 -- 172.21.15.169:0/3273365705 learned_addr learned my addr 172.21.15.169:0/3273365705 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638b7fe640 1 -- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 msgr2=0x7f638c074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638b7fe640 1 -- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 msgr2=0x7f638c074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638b7fe640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.630+0000 7f638b7fe640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f638bfff640 1 -- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 msgr2=0x7f638c074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f638bfff640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f638bfff640 1 -- 172.21.15.169:0/3273365705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638c0763e0 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f638bfff640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f637c032c50 tx=0x7f637c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f637c035070 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c003ce0 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f637c03bc20 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638c1a35f0 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.631+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f638c1a3b80 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.632+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f637c042030 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.632+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638c102da0 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.632+0000 7f63897fa640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 0x7f637403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.632+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f637c040070 con 0x7f638c107660 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.633+0000 7f638b7fe640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 0x7f637403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.633+0000 7f638b7fe640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 0x7f637403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6380006fd0 tx=0x7f6380008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.638+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f637c038350 con 0x7f638c107660 2024-09-19T09:13:12.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.866+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f638c1a3e30 con 0x7f638c107660 2024-09-19T09:13:12.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.867+0000 7f63897fa640 1 -- 172.21.15.169:0/3273365705 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f637c03bdc0 con 0x7f638c107660 2024-09-19T09:13:12.868 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:13:12.868 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":2,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","modified":"2024-09-19T09:13:05.003354Z","created":"2024-09-19T09:11:34.459294Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:13:12.868 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 2 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.868+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 msgr2=0x7f637403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.868+0000 7f6392927640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 0x7f637403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6380006fd0 tx=0x7f6380008040 comp rx=0 tx=0).stop 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 msgr2=0x7f638c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f637c032c50 tx=0x7f637c032c80 comp rx=0 tx=0).stop 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 shutdown_connections 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6374039040 0x7f637403b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c074a30 0x7f638c074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 --2- 172.21.15.169:0/3273365705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f638c107660 0x7f638c0744f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 >> 172.21.15.169:0/3273365705 conn(0x7f638c0fd320 msgr2=0x7f638c0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 shutdown_connections 2024-09-19T09:13:12.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:12.869+0000 7f6392927640 1 -- 172.21.15.169:0/3273365705 wait complete. 2024-09-19T09:13:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:13 smithi169 ceph-mon[35454]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:13 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/3273365705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:13 smithi052 ceph-mon[30947]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:13 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/3273365705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:13.794 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:13 smithi086 ceph-mon[34813]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T09:13:14.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:13 smithi086 bash[34793]: 48be049d55c65f5e2f697d288a9a8bdde36d54f2f1e6020d235c765348394655 2024-09-19T09:13:14.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:13 smithi086 systemd[1]: Started Ceph mon.b for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:13:14.474 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:13:14.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:13:14.719 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:19.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: mon.c calling monitor election 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: mon.a calling monitor election 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: monmap epoch 3 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: election_strategy: 1 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: fsmap 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: mgrmap e13: x(active, since 47s) 2024-09-19T09:13:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: overall HEALTH_OK 2024-09-19T09:13:19.182 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.182 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.182 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.182 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: mon.c calling monitor election 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: mon.a calling monitor election 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: monmap epoch 3 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: min_mon_release 19 (squid) 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: election_strategy: 1 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:19.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: fsmap 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: mgrmap e13: x(active, since 47s) 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: overall HEALTH_OK 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 -- 172.21.15.169:0/3193793062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff640106630 msgr2=0x7ff62c005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 --2- 172.21.15.169:0/3193793062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff640106630 0x7ff62c005580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff63c012c60 tx=0x7ff63c02c620 comp rx=0 tx=0).stop 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 -- 172.21.15.169:0/3193793062 shutdown_connections 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 --2- 172.21.15.169:0/3193793062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff640106630 0x7ff62c005580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 -- 172.21.15.169:0/3193793062 >> 172.21.15.169:0/3193793062 conn(0x7ff6400fc220 msgr2=0x7ff6400fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 -- 172.21.15.169:0/3193793062 shutdown_connections 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 -- 172.21.15.169:0/3193793062 wait complete. 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.556+0000 7ff648775640 1 Processor -- start 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 -- start start 2024-09-19T09:13:19.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 0x7ff64019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff640108660 con 0x7ff6401977f0 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401084e0 con 0x7ff640106630 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff648775640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401087e0 con 0x7ff64019c0c0 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 0x7ff64019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39642/0 (socket says 172.21.15.169:39642) 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 -- 172.21.15.169:0/794473969 learned_addr learned my addr 172.21.15.169:0/794473969 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 msgr2=0x7ff64019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 msgr2=0x7ff64019c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:13:19.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646d12640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646511640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 msgr2=0x7ff64019c570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646511640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 msgr2=0x7ff6401972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646511640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 msgr2=0x7ff6401972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 msgr2=0x7ff6401972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646511640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff646511640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.557+0000 7ff645d10640 1 -- 172.21.15.169:0/794473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6401a3e30 con 0x7ff6401977f0 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff645d10640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 0x7ff64019bb80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b450 tx=0x7ff63400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:19.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634004230 con 0x7ff6401977f0 2024-09-19T09:13:19.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6340043d0 con 0x7ff6401977f0 2024-09-19T09:13:19.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634003cb0 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6401a4060 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.558+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6401a45a0 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.559+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff640109750 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.559+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff63400f050 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.559+0000 7ff6337fe640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 0x7ff62403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.559+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff63404c010 con 0x7ff6401977f0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.560+0000 7ff646511640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 0x7ff62403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:19.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.560+0000 7ff646511640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 0x7ff62403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff63c02cc10 tx=0x7ff63c005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:19.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.564+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff63400d040 con 0x7ff6401977f0 2024-09-19T09:13:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.799+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff6401a4940 con 0x7ff6401977f0 2024-09-19T09:13:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.800+0000 7ff6337fe640 1 -- 172.21.15.169:0/794473969 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7ff634011d00 con 0x7ff6401977f0 2024-09-19T09:13:19.801 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:13:19.801 INFO:teuthology.orchestra.run.smithi169.stdout:{"epoch":3,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","modified":"2024-09-19T09:13:13.777988Z","created":"2024-09-19T09:11:34.459294Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:3300","nonce":0},{"type":"v1","addr":"172.21.15.169:6789","nonce":0}]},"addr":"172.21.15.169:6789/0","public_addr":"172.21.15.169:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:13:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:dumped monmap epoch 3 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 msgr2=0x7ff62403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 0x7ff62403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff63c02cc10 tx=0x7ff63c005d10 comp rx=0 tx=0).stop 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 msgr2=0x7ff64019bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 0x7ff64019bb80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff63400b450 tx=0x7ff63400b910 comp rx=0 tx=0).stop 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 shutdown_connections 2024-09-19T09:13:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff624039730 0x7ff62403bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff64019c0c0 0x7ff64019c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6401977f0 0x7ff64019bb80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 --2- 172.21.15.169:0/794473969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff640106630 0x7ff6401972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 >> 172.21.15.169:0/794473969 conn(0x7ff6400fc220 msgr2=0x7ff64006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 shutdown_connections 2024-09-19T09:13:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:19.802+0000 7ff648775640 1 -- 172.21.15.169:0/794473969 wait complete. 2024-09-19T09:13:20.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:20.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:20.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:19 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/794473969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:19 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/794473969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:20.625 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:13:20.625 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:13:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: mon.c calling monitor election 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: mon.a calling monitor election 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: monmap epoch 3 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: min_mon_release 19 (squid) 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: election_strategy: 1 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: fsmap 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:21.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: mgrmap e13: x(active, since 47s) 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: overall HEALTH_OK 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:21.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:20 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/794473969' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:13:21.440 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:13:21.870 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mon.b calling monitor election 2024-09-19T09:13:21.870 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: Updating smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: Updating smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: Updating smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: Reconfiguring daemon mon.a on smithi052 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mon.b calling monitor election 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mon.c calling monitor election 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mon.a calling monitor election 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: monmap epoch 3 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:21.871 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: min_mon_release 19 (squid) 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: election_strategy: 1 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: fsmap 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: mgrmap e13: x(active, since 49s) 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: overall HEALTH_OK 2024-09-19T09:13:21.872 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1969200456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c106560 msgr2=0x7f6c0c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1969200456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c106560 0x7f6c0c106940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009880 tx=0x7f6c0802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1969200456 shutdown_connections 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1969200456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c106560 0x7f6c0c106940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1969200456 >> 172.21.15.52:0/1969200456 conn(0x7f6c0c0fc1b0 msgr2=0x7f6c0c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1969200456 shutdown_connections 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.869+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1969200456 wait complete. 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 Processor -- start 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 -- start start 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 0x7f6c0c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 0x7f6c0c1a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c10ab90 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c10aa10 con 0x7f6c0c1a3580 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c13ff4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c10ad10 con 0x7f6c0c106560 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50484/0 (socket says 172.21.15.52:50484) 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 -- 172.21.15.52:0/1851979866 learned_addr learned my addr 172.21.15.52:0/1851979866 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c12591640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 0x7f6c0c1a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 -- 172.21.15.52:0/1851979866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 msgr2=0x7f6c0c0fc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c11d90640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 0x7f6c0c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 0x7f6c0c0fc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 -- 172.21.15.52:0/1851979866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 msgr2=0x7f6c0c1a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 0x7f6c0c1a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c1158f640 1 -- 172.21.15.52:0/1851979866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c1a6040 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c12591640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 0x7f6c0c1a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.870+0000 7f6c11d90640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 0x7f6c0c0fc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c1158f640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b520 tx=0x7f6bfc00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc004230 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bfc0043d0 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c1a6330 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc003d60 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.871+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c1a6870 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6bfc00e070 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c1069c0 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c02ffd640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 0x7f6bf803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6bfc04bda0 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c11d90640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 0x7f6bf803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.872+0000 7f6c11d90640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 0x7f6bf803bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005ab0 tx=0x7f6c08005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:21.877+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bfc014020 con 0x7f6c0c0fcba0 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mon.b calling monitor election 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: Updating smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: Updating smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: Updating smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:13:21.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: Reconfiguring daemon mon.a on smithi052 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mon.b calling monitor election 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mon.c calling monitor election 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mon.a calling monitor election 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: monmap epoch 3 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: min_mon_release 19 (squid) 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: election_strategy: 1 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:21.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: fsmap 2024-09-19T09:13:21.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:21.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: mgrmap e13: x(active, since 49s) 2024-09-19T09:13:21.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: overall HEALTH_OK 2024-09-19T09:13:21.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mon.b calling monitor election 2024-09-19T09:13:22.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: Updating smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:22.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: Updating smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:22.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: Updating smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: Reconfiguring daemon mon.a on smithi052 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mon.b calling monitor election 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mon.c calling monitor election 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mon.a calling monitor election 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: monmap epoch 3 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: last_changed 2024-09-19T09:13:13.777988+0000 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: created 2024-09-19T09:11:34.459294+0000 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: min_mon_release 19 (squid) 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: election_strategy: 1 2024-09-19T09:13:22.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: 1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.c 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: 2: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: fsmap 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: mgrmap e13: x(active, since 49s) 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: overall HEALTH_OK 2024-09-19T09:13:22.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.058+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6c0c1a6b30 con 0x7f6c0c0fcba0 2024-09-19T09:13:22.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.058+0000 7f6c02ffd640 1 -- 172.21.15.52:0/1851979866 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f6bfc00f3e0 con 0x7f6c0c0fcba0 2024-09-19T09:13:22.059 INFO:teuthology.orchestra.run.smithi052.stdout:# minimal ceph.conf for 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:22.060 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-19T09:13:22.060 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:13:22.060 INFO:teuthology.orchestra.run.smithi052.stdout: mon_host = [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 msgr2=0x7f6bf803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 0x7f6bf803bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c08005ab0 tx=0x7f6c08005a20 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 msgr2=0x7f6c0c0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00b520 tx=0x7f6bfc00b9e0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 shutdown_connections 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c0c1a3580 0x7f6c0c1a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c0c0fcba0 0x7f6c0c0fd000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6bf8039730 0x7f6bf803bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 --2- 172.21.15.52:0/1851979866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c0c106560 0x7f6c0c0fc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 >> 172.21.15.52:0/1851979866 conn(0x7f6c0c0fc1b0 msgr2=0x7f6c0c104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 shutdown_connections 2024-09-19T09:13:22.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:22.060+0000 7f6c13ff4640 1 -- 172.21.15.52:0/1851979866 wait complete. 2024-09-19T09:13:22.808 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1851979866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:22.809 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:13:22.777+0000 7fac6b688640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1851979866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.881 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:22.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:22.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:22.909 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:13:22.910 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:13:22.910 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:13:22.937 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:13:22.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:13:22.941 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:22.941 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1851979866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.004 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:13:23.004 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:13:23.032 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:13:23.032 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:13:23.099 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:13:23.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:13:23.132 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:13:23.132 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:13:23.200 INFO:tasks.cephadm:Adding mgr.x on smithi052 2024-09-19T09:13:23.200 INFO:tasks.cephadm:Adding mgr.y on smithi086 2024-09-19T09:13:23.200 INFO:tasks.cephadm:Adding mgr.z on smithi169 2024-09-19T09:13:23.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi052=x;smithi086=y;smithi169=z' 2024-09-19T09:13:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:23.852 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:23 smithi169 ceph-mon[35454]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:13:23.852 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:23 smithi169 ceph-mon[35454]: Reconfiguring daemon mon.b on smithi086 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 -- 172.21.15.169:0/4015039329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4781016e0 msgr2=0x7fa478101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 --2- 172.21.15.169:0/4015039329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4781016e0 0x7fa478101ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009880 tx=0x7fa46c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 -- 172.21.15.169:0/4015039329 shutdown_connections 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 --2- 172.21.15.169:0/4015039329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4781016e0 0x7fa478101ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 -- 172.21.15.169:0/4015039329 >> 172.21.15.169:0/4015039329 conn(0x7fa4780fce90 msgr2=0x7fa4780ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 -- 172.21.15.169:0/4015039329 shutdown_connections 2024-09-19T09:13:23.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.862+0000 7fa47f183640 1 -- 172.21.15.169:0/4015039329 wait complete. 2024-09-19T09:13:23.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 Processor -- start 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 -- start start 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4781016e0 0x7fa478196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 0x7fa47819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781077d0 con 0x7fa478197990 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa478107650 con 0x7fa4781016e0 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47f183640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa478107950 con 0x7fa478197510 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa477fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa477fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39644/0 (socket says 172.21.15.169:39644) 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa477fff640 1 -- 172.21.15.169:0/1605267978 learned_addr learned my addr 172.21.15.169:0/1605267978 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47d720640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 0x7fa47819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.863+0000 7fa47cf1f640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4781016e0 0x7fa478196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 -- 172.21.15.169:0/1605267978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4781016e0 msgr2=0x7fa478196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4781016e0 0x7fa478196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 -- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 msgr2=0x7fa47819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 0x7fa47819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 -- 172.21.15.169:0/1605267978 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47819f3d0 con 0x7fa478197510 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa47d720640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 0x7fa47819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa477fff640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b520 tx=0x7fa46400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464004230 con 0x7fa478197510 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47819f6c0 con 0x7fa478197510 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4640043d0 con 0x7fa478197510 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464003d60 con 0x7fa478197510 2024-09-19T09:13:23.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.864+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47819fcd0 con 0x7fa478197510 2024-09-19T09:13:23.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.865+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa46400e070 con 0x7fa478197510 2024-09-19T09:13:23.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.865+0000 7fa475ffb640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 0x7fa46803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.866+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa46404bdb0 con 0x7fa478197510 2024-09-19T09:13:23.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.865+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa478190590 con 0x7fa478197510 2024-09-19T09:13:23.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.866+0000 7fa47cf1f640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 0x7fa46803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.866+0000 7fa47cf1f640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 0x7fa46803bbf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009230 tx=0x7fa46c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:23.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:23.871+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa464014020 con 0x7fa478197510 2024-09-19T09:13:23.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:23 smithi052 ceph-mon[30947]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:13:23.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:23 smithi052 ceph-mon[30947]: Reconfiguring daemon mon.b on smithi086 2024-09-19T09:13:24.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:23 smithi086 ceph-mon[34813]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:13:24.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:23 smithi086 ceph-mon[34813]: Reconfiguring daemon mon.b on smithi086 2024-09-19T09:13:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.056+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi052=x;smithi086=y;smithi169=z", "target": ["mon-mgr", ""]}) -- 0x7fa478062780 con 0x7fa468039730 2024-09-19T09:13:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.061+0000 7fa475ffb640 1 -- 172.21.15.169:0/1605267978 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa478062780 con 0x7fa468039730 2024-09-19T09:13:24.062 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mgr update... 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 msgr2=0x7fa46803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 0x7fa46803bbf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009230 tx=0x7fa46c0315d0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 msgr2=0x7fa47819c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa46400b520 tx=0x7fa46400b9e0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 shutdown_connections 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa478197990 0x7fa47819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa468039730 0x7fa46803bbf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa478197510 0x7fa47819c580 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 --2- 172.21.15.169:0/1605267978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4781016e0 0x7fa478196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 >> 172.21.15.169:0/1605267978 conn(0x7fa4780fce90 msgr2=0x7fa4780fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 shutdown_connections 2024-09-19T09:13:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:13:24.065+0000 7fa47f183640 1 -- 172.21.15.169:0/1605267978 wait complete. 2024-09-19T09:13:24.654 DEBUG:teuthology.orchestra.run.smithi086:mgr.y> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T09:13:24.657 DEBUG:teuthology.orchestra.run.smithi169:mgr.z> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T09:13:24.659 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:13:24.660 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:13:24.660 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:13:24.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:13:24.678 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-19 09:12:39.583269713 +0000 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-19 09:08:14.852967640 +0000 2024-09-19T09:13:24.737 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-19 09:08:14.852967640 +0000 2024-09-19T09:13:24.738 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-19 09:08:14.852967640 +0000 2024-09-19T09:13:24.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:13:24.804 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-19T09:13:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-19T09:13:24.805 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000118551 s, 4.3 MB/s 2024-09-19T09:13:24.806 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:13:24.842 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: Reconfiguring daemon mon.c on smithi169 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi052=x;smithi086=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: Saving service mgr spec with placement smithi052=x;smithi086=y;smithi169=z;count:3 2024-09-19T09:13:24.843 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.864 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-19T09:13:24.920 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-19 09:12:39.612269355 +0000 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-19 09:08:15.179963801 +0000 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-19 09:08:15.179963801 +0000 2024-09-19T09:13:24.921 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-19 09:08:15.179963801 +0000 2024-09-19T09:13:24.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: Reconfiguring daemon mon.c on smithi169 2024-09-19T09:13:24.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi052=x;smithi086=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:24.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: Saving service mgr spec with placement smithi052=x;smithi086=y;smithi169=z;count:3 2024-09-19T09:13:24.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-19T09:13:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-19T09:13:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000113295 s, 4.5 MB/s 2024-09-19T09:13:24.955 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:13:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:13:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: Reconfiguring daemon mon.c on smithi169 2024-09-19T09:13:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi052=x;smithi086=y;smithi169=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: Saving service mgr spec with placement smithi052=x;smithi086=y;smithi169=z;count:3 2024-09-19T09:13:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:25.013 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-19 09:12:39.642268985 +0000 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-19 09:08:15.501960021 +0000 2024-09-19T09:13:25.070 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-19 09:08:15.501960021 +0000 2024-09-19T09:13:25.071 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-19 09:08:15.501960021 +0000 2024-09-19T09:13:25.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:13:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-19T09:13:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-19T09:13:25.134 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000113126 s, 4.5 MB/s 2024-09-19T09:13:25.136 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:13:25.193 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.250 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-19 09:12:39.671268627 +0000 2024-09-19T09:13:25.251 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-19 09:08:15.819956288 +0000 2024-09-19T09:13:25.251 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-19 09:08:15.819956288 +0000 2024-09-19T09:13:25.251 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-19 09:08:15.819956288 +0000 2024-09-19T09:13:25.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:13:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-19T09:13:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-19T09:13:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000110401 s, 4.6 MB/s 2024-09-19T09:13:25.315 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:13:25.372 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-19T09:13:25.373 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:13:25.392 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:13:25.392 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-19T09:13:25.450 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:13:25.450 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 09:13:13.239618449 +0000 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 09:08:20.392870468 +0000 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 09:08:20.392870468 +0000 2024-09-19T09:13:25.451 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 09:08:20.392870468 +0000 2024-09-19T09:13:25.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:13:25.517 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T09:13:25.517 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T09:13:25.517 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.00028311 s, 1.8 MB/s 2024-09-19T09:13:25.518 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:13:25.576 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 09:13:13.240618427 +0000 2024-09-19T09:13:25.633 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 09:08:20.715863569 +0000 2024-09-19T09:13:25.634 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 09:08:20.715863569 +0000 2024-09-19T09:13:25.634 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 09:08:20.715863569 +0000 2024-09-19T09:13:25.634 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:13:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T09:13:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T09:13:25.698 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000204178 s, 2.5 MB/s 2024-09-19T09:13:25.699 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:13:25.756 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-19T09:13:25.812 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:13:25.812 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.812 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 09:13:13.240618427 +0000 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 09:08:21.056856284 +0000 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 09:08:21.056856284 +0000 2024-09-19T09:13:25.813 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 09:08:21.056856284 +0000 2024-09-19T09:13:25.813 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:13:25.876 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T09:13:25.876 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T09:13:25.876 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000175312 s, 2.9 MB/s 2024-09-19T09:13:25.877 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:13:25.933 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-19T09:13:25.989 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-19 09:13:13.240618427 +0000 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-19 09:08:21.385849257 +0000 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-19 09:08:21.385849257 +0000 2024-09-19T09:13:25.990 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-19 09:08:21.385849257 +0000 2024-09-19T09:13:25.990 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:13:26.053 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-19T09:13:26.054 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-19T09:13:26.054 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000264993 s, 1.9 MB/s 2024-09-19T09:13:26.055 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:13:26.112 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-09-19T09:13:26.112 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:13:26.128 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:13:26.128 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 09:13:03.987053173 +0000 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 09:08:28.136947231 +0000 2024-09-19T09:13:26.183 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 09:08:28.136947231 +0000 2024-09-19T09:13:26.184 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 09:08:28.136947231 +0000 2024-09-19T09:13:26.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:13:26.248 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T09:13:26.248 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T09:13:26.248 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000249571 s, 2.1 MB/s 2024-09-19T09:13:26.249 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:13:26.305 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-09-19T09:13:26.361 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:13:26.361 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:26.361 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 09:13:03.988053153 +0000 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 09:08:28.445941031 +0000 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 09:08:28.445941031 +0000 2024-09-19T09:13:26.362 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 09:08:28.445941031 +0000 2024-09-19T09:13:26.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:13:26.425 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T09:13:26.425 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T09:13:26.425 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000209066 s, 2.4 MB/s 2024-09-19T09:13:26.426 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:13:26.482 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 09:13:03.988053153 +0000 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 09:08:28.771934491 +0000 2024-09-19T09:13:26.538 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 09:08:28.771934491 +0000 2024-09-19T09:13:26.539 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 09:08:28.771934491 +0000 2024-09-19T09:13:26.539 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:13:26.601 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T09:13:26.601 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T09:13:26.601 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000219635 s, 2.3 MB/s 2024-09-19T09:13:26.602 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:13:26.658 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-09-19T09:13:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:26 smithi052 ceph-mon[30947]: Deploying daemon mgr.z on smithi169 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:26 smithi169 ceph-mon[35454]: Deploying daemon mgr.z on smithi169 2024-09-19T09:13:26.707 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:13:26.707 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:26.707 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T09:13:26.707 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:26.708 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:26.708 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-09-19 09:13:03.989053134 +0000 2024-09-19T09:13:26.708 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-09-19 09:08:29.104927810 +0000 2024-09-19T09:13:26.708 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-09-19 09:08:29.104927810 +0000 2024-09-19T09:13:26.708 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-09-19 09:08:29.104927810 +0000 2024-09-19T09:13:26.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:26 smithi086 ceph-mon[34813]: Deploying daemon mgr.z on smithi169 2024-09-19T09:13:26.772 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-09-19T09:13:26.773 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-09-19T09:13:26.773 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000177943 s, 2.9 MB/s 2024-09-19T09:13:26.774 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:13:26.836 INFO:tasks.cephadm:Deploying osd.0 on smithi052 with /dev/vg_nvme/lv_4... 2024-09-19T09:13:26.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:13:27.099 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:13:27.442 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 podman[37242]: 2024-09-19 09:13:27.256339436 +0000 UTC m=+0.015597508 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 podman[37242]: 2024-09-19 09:13:27.541265927 +0000 UTC m=+0.300523987 container init a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 podman[37242]: 2024-09-19 09:13:27.544347424 +0000 UTC m=+0.303605476 container start a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 ceph-mgr[37261]: -- 172.21.15.169:0/1634412642 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bd639d0e0 con 0x559bd637b000 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 bash[37242]: a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 systemd[1]: Started Ceph mgr.z for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:27.665+0000 7f033fff3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:13:27.726 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:27.724+0000 7f033fff3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:28.082 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:27.871+0000 7f033fff3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:13:28.082 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:27.936+0000 7f033fff3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:13:28.082 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:28.080+0000 7f033fff3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:28.442 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:28.219+0000 7f033fff3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:13:28.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:28 smithi052 ceph-mon[30947]: Deploying daemon mgr.y on smithi086 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-mon[35454]: Deploying daemon mgr.y on smithi086 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:28.531+0000 7f033fff3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:13:28.942 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:28.592+0000 7f033fff3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:13:28.943 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:28.775+0000 7f033fff3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:13:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:28 smithi086 ceph-mon[34813]: Deploying daemon mgr.y on smithi086 2024-09-19T09:13:29.306 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:13:29.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2024-09-19T09:13:29.588 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:13:29.670 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 systemd[1]: Starting Ceph mgr.y for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:13:29.942 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:29.652+0000 7f033fff3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:13:29.942 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:29.719+0000 7f033fff3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:13:29.955 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 podman[36162]: 2024-09-19 09:13:29.670152385 +0000 UTC m=+0.110176560 container create 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:13:29.955 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 podman[36162]: 2024-09-19 09:13:29.575762363 +0000 UTC m=+0.015786542 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:13:29.955 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 podman[36162]: 2024-09-19 09:13:29.872449805 +0000 UTC m=+0.312473979 container init 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:13:29.956 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 podman[36162]: 2024-09-19 09:13:29.875172526 +0000 UTC m=+0.315196701 container start 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:13:29.956 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 ceph-mgr[36181]: -- 172.21.15.86:0/8541464 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f656cc50e0 con 0x55f656ca3400 2024-09-19T09:13:29.956 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 bash[36162]: 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 -- 172.21.15.52:0/3977923896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748103930 msgr2=0x7f574810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 --2- 172.21.15.52:0/3977923896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748103930 0x7f574810a1c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5740009cd0 tx=0x7f574002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 -- 172.21.15.52:0/3977923896 shutdown_connections 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 --2- 172.21.15.52:0/3977923896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748103930 0x7f574810a1c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 --2- 172.21.15.52:0/3977923896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748102f70 0x7f57481033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 --2- 172.21.15.52:0/3977923896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f57481002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 -- 172.21.15.52:0/3977923896 >> 172.21.15.52:0/3977923896 conn(0x7f57480fba40 msgr2=0x7f57480fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 -- 172.21.15.52:0/3977923896 shutdown_connections 2024-09-19T09:13:30.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.003+0000 7f574de8b640 1 -- 172.21.15.52:0/3977923896 wait complete. 2024-09-19T09:13:30.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 Processor -- start 2024-09-19T09:13:30.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 -- start start 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f5748197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748103930 0x7f574819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f574810d880 con 0x7f5748102f70 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f574810d700 con 0x7f57480ffef0 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f574de8b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f574810da00 con 0x7f5748103930 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f573effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f573effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50526/0 (socket says 172.21.15.52:50526) 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f573effd640 1 -- 172.21.15.52:0/1654253934 learned_addr learned my addr 172.21.15.52:0/1654253934 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f57477fe640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f5748197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.004+0000 7f5747fff640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748103930 0x7f574819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 -- 172.21.15.52:0/1654253934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748103930 msgr2=0x7f574819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748103930 0x7f574819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 -- 172.21.15.52:0/1654253934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 msgr2=0x7f5748197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f5748197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 -- 172.21.15.52:0/1654253934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574819fb40 con 0x7f5748102f70 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f57477fe640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f5748197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f573effd640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f573000d950 tx=0x7f573000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730017030 con 0x7f5748102f70 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5730004020 con 0x7f5748102f70 2024-09-19T09:13:30.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300047a0 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574819fe30 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.005+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57481a02e0 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.006+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5730004940 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.006+0000 7f57457fa640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 0x7f573403b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.006+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f573004c030 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.006+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57481091c0 con 0x7f5748102f70 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.006+0000 7f57477fe640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 0x7f573403b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.007+0000 7f57477fe640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 0x7f573403b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f574806a4d0 tx=0x7f5738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.011+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57300035f0 con 0x7f5748102f70 2024-09-19T09:13:30.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:30.217+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5748062630 con 0x7f5734039500 2024-09-19T09:13:30.220 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:29 smithi086 systemd[1]: Started Ceph mgr.y for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:13:30.220 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.004+0000 7ff1ca086040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:13:30.220 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.063+0000 7ff1ca086040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:30.220 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.219+0000 7ff1ca086040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:13:30.507 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.289+0000 7ff1ca086040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:13:30.507 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.447+0000 7ff1ca086040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:30.742 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:30.468+0000 7f033fff3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:13:30.742 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:30.596+0000 7f033fff3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:13:30.742 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:30.740+0000 7f033fff3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:30.864 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.603+0000 7ff1ca086040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:13:31.029 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:30.805+0000 7f033fff3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:13:31.029 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:30.961+0000 7f033fff3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:13:31.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:31.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:31.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.184 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.929+0000 7ff1ca086040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:13:31.184 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:30.991+0000 7ff1ca086040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:13:31.184 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:31.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:31.335 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:31.336 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.032+0000 7f033fff3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:13:31.336 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.094+0000 7f033fff3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:13:31.336 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.267+0000 7f033fff3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:13:31.336 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.334+0000 7f033fff3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:13:31.507 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:31.183+0000 7ff1ca086040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:13:31.602 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.401+0000 7f033fff3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:13:31.602 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.484+0000 7f033fff3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:31.602 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.543+0000 7f033fff3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:13:31.603 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:31.601+0000 7f033fff3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:13:32.387 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:32.387 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.387 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.387 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:32.388 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:32.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:32.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:32.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.507 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:32.078+0000 7ff1ca086040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:13:32.507 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:32.144+0000 7ff1ca086040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:13:32.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:32.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:13:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:13:32.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:32.692 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:13:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z[37257]: 2024-09-19T09:13:32.386+0000 7f033fff3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:13:33.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:33.039+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f57300041d0 con 0x7f5748102f70 2024-09-19T09:13:33.117 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:32.859+0000 7ff1ca086040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:13:33.117 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:32.973+0000 7ff1ca086040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:13:33.117 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.116+0000 7ff1ca086040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:33.117 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: Reconfiguring daemon mgr.x on smithi052 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: Standby manager daemon z started 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]: dispatch 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]': finished 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:13:33.118 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:33.390 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.177+0000 7ff1ca086040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:13:33.390 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.322+0000 7ff1ca086040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:13:33.390 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.389+0000 7ff1ca086040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:13:33.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: Reconfiguring daemon mgr.x on smithi052 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: Standby manager daemon z started 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:13:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:33.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]: dispatch 2024-09-19T09:13:33.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]': finished 2024-09-19T09:13:33.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:13:33.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: Reconfiguring daemon mgr.x on smithi052 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: Standby manager daemon z started 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.169:0/2156782828' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]: dispatch 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/251322795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ffb4240a-2009-4628-bcd3-1c228b520686"}]': finished 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:13:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:33.669 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.448+0000 7ff1ca086040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:13:33.670 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.605+0000 7ff1ca086040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:13:33.670 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.669+0000 7ff1ca086040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:13:33.935 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.734+0000 7ff1ca086040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:13:33.935 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.817+0000 7ff1ca086040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:33.935 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.875+0000 7ff1ca086040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:13:33.935 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:33.934+0000 7ff1ca086040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:13:34.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:34 smithi086 ceph-mon[34813]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:13:34.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:34 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/667516887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:34.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:13:34.338 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:34 smithi052 ceph-mon[30947]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:13:34.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:34 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/667516887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:34.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:13:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:34 smithi169 ceph-mon[35454]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:13:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:34 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/667516887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:13:35.007 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:13:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y[36177]: 2024-09-19T09:13:34.715+0000 7ff1ca086040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:13:35.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:35.059+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mon.0 v2:172.21.15.52:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f5730003b10 con 0x7f5748102f70 2024-09-19T09:13:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: Standby manager daemon y started 2024-09-19T09:13:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:13:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:13:35.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:35 smithi052 ceph-mon[30947]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: Standby manager daemon y started 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:13:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:35 smithi169 ceph-mon[35454]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: Standby manager daemon y started 2024-09-19T09:13:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:13:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:13:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:13:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:35 smithi086 ceph-mon[34813]: from='mgr.? 172.21.15.86:0/3534689930' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:13:36.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:36 smithi052 ceph-mon[30947]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:13:36.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:13:36.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:36 smithi169 ceph-mon[35454]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:13:36.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:13:36.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:36 smithi086 ceph-mon[34813]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:13:36.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:13:37.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:37 smithi052 ceph-mon[30947]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:37 smithi169 ceph-mon[35454]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:37.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:37 smithi086 ceph-mon[34813]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:39.255 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:39 smithi052 ceph-mon[30947]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:39 smithi169 ceph-mon[35454]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:39.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:39 smithi086 ceph-mon[34813]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:40.275 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.275 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.275 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:40.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:40.408 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:40.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:41.253 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:41 smithi052 ceph-mon[30947]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:41.254 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:41.254 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:41.254 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:41.361 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:41 smithi169 ceph-mon[35454]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:41.361 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:41.361 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:41.361 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:41 smithi086 ceph-mon[34813]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:42.353 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:13:42.353 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:13:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:42.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:13:42.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:43.266 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:43 smithi052 ceph-mon[30947]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:43.266 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:43 smithi052 ceph-mon[30947]: Deploying daemon osd.0 on smithi052 2024-09-19T09:13:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:43 smithi169 ceph-mon[35454]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:43 smithi169 ceph-mon[35454]: Deploying daemon osd.0 on smithi052 2024-09-19T09:13:43.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:43 smithi086 ceph-mon[34813]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:43.584 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:43 smithi086 ceph-mon[34813]: Deploying daemon osd.0 on smithi052 2024-09-19T09:13:45.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:45 smithi052 ceph-mon[30947]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:45 smithi169 ceph-mon[35454]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:45 smithi086 ceph-mon[34813]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:47.427 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:47 smithi052 ceph-mon[30947]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:47.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:47 smithi169 ceph-mon[35454]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:47 smithi086 ceph-mon[34813]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:48.289 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:48.289 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:48.289 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:48.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:48.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:48.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:48.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:48.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:48.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:49.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:49 smithi052 ceph-mon[30947]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:49.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:49 smithi169 ceph-mon[35454]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:49 smithi086 ceph-mon[34813]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:51.220 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:51.220 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.220 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.220 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:51.221 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:51.221 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.219+0000 7f57457fa640 1 -- 172.21.15.52:0/1654253934 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5748062630 con 0x7f5734039500 2024-09-19T09:13:51.221 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 0 on host 'smithi052' 2024-09-19T09:13:51.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 msgr2=0x7f573403b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 0x7f573403b9c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f574806a4d0 tx=0x7f5738005f90 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 msgr2=0x7f5748198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f573000d950 tx=0x7f573000de10 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 shutdown_connections 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5734039500 0x7f573403b9c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5748103930 0x7f574819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5748102f70 0x7f5748198450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 --2- 172.21.15.52:0/1654253934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57480ffef0 0x7f5748197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 >> 172.21.15.52:0/1654253934 conn(0x7f57480fba40 msgr2=0x7f5748106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.222+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 shutdown_connections 2024-09-19T09:13:51.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:13:51.223+0000 7f574de8b640 1 -- 172.21.15.52:0/1654253934 wait complete. 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:51.851 DEBUG:teuthology.orchestra.run.smithi052:osd.0> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:13:51.854 INFO:tasks.cephadm:Deploying osd.1 on smithi086 with /dev/vg_nvme/lv_4... 2024-09-19T09:13:51.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:13:52.092 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:13:52.360 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:52.360 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:52.360 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:52.411 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:52.411 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:52.411 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:52.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:52.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:52.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:53.291 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:53 smithi052 ceph-mon[30947]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:53.440 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:53 smithi086 ceph-mon[34813]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:53.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:53 smithi169 ceph-mon[35454]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:54.147 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:54 smithi052 ceph-mon[30947]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:13:54.148 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:13:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:13:53.895+0000 7f0cb5ec9640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:13:54.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:54 smithi169 ceph-mon[35454]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:13:54.462 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:54 smithi086 ceph-mon[34813]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:13:54.465 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:13:54.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-09-19T09:13:54.758 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 -- 172.21.15.86:0/1836951223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1444102660 msgr2=0x7f1444104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 --2- 172.21.15.86:0/1836951223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1444102660 0x7f1444104a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f143c009ca0 tx=0x7f143c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 -- 172.21.15.86:0/1836951223 shutdown_connections 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 --2- 172.21.15.86:0/1836951223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14441078c0 0x7f1444109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 --2- 172.21.15.86:0/1836951223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444104f90 0x7f1444107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 --2- 172.21.15.86:0/1836951223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1444102660 0x7f1444104a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 -- 172.21.15.86:0/1836951223 >> 172.21.15.86:0/1836951223 conn(0x7f14440fc280 msgr2=0x7f14440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 -- 172.21.15.86:0/1836951223 shutdown_connections 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 -- 172.21.15.86:0/1836951223 wait complete. 2024-09-19T09:13:55.237 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.234+0000 7f144942e640 1 Processor -- start 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 -- start start 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444102660 0x7f1444197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1444104f90 0x7f1444198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f144410d870 con 0x7f1444102660 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f144410d6f0 con 0x7f14441078c0 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f144942e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f144410d9f0 con 0x7f1444104f90 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:34742/0 (socket says 172.21.15.86:34742) 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 -- 172.21.15.86:0/906749369 learned_addr learned my addr 172.21.15.86:0/906749369 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f1442ffd640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444102660 0x7f1444197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.238 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14427fc640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1444104f90 0x7f1444198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 -- 172.21.15.86:0/906749369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1444104f90 msgr2=0x7f1444198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1444104f90 0x7f1444198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 -- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444102660 msgr2=0x7f1444197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444102660 0x7f1444197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 -- 172.21.15.86:0/906749369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144419fb50 con 0x7f14441078c0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.235+0000 7f14437fe640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f143400d750 tx=0x7f143400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.236+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434017070 con 0x7f14441078c0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.236+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1434005500 con 0x7f14441078c0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.236+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144419fe40 con 0x7f14441078c0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.236+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434004d90 con 0x7f14441078c0 2024-09-19T09:13:55.239 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.236+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441a02f0 con 0x7f14441078c0 2024-09-19T09:13:55.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.237+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14440fdd70 con 0x7f14441078c0 2024-09-19T09:13:55.240 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.238+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f1434004f30 con 0x7f14441078c0 2024-09-19T09:13:55.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.238+0000 7f142bfff640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 0x7f142c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.239+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f14340cd9a0 con 0x7f14441078c0 2024-09-19T09:13:55.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.239+0000 7f1442ffd640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 0x7f142c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.241 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.239+0000 7f1442ffd640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 0x7f142c0a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f143c006010 tx=0x7f143c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.242 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.242+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f143409bc80 con 0x7f14441078c0 2024-09-19T09:13:55.417 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:13:55.417+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1444062630 con 0x7f142c0a3260 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:55.418 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.419 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:55.419 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:55.419 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:13:56.111 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:13:55.803+0000 7f0cb1629640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:13:56.111 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:13:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:13:55.806+0000 7f0ca9c5b640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi052 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:56 smithi052 ceph-mon[30947]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi052 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:56.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:56.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:56.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:56 smithi169 ceph-mon[35454]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' 2024-09-19T09:13:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi052 2024-09-19T09:13:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:56 smithi086 ceph-mon[34813]: from='osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976]' entity='osd.0' 2024-09-19T09:13:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:13:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:13:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:57.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] boot 2024-09-19T09:13:57.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:13:57.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:57 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:13:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:13:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] boot 2024-09-19T09:13:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:13:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:57 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: osd.0 [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] boot 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:13:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:57 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:13:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:58 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/147824878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:58 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:58 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]': finished 2024-09-19T09:13:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:58 smithi052 ceph-mon[30947]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:13:58.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:13:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:58 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/147824878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:58 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:58 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]': finished 2024-09-19T09:13:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:58 smithi169 ceph-mon[35454]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:13:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:13:58.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:58 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/147824878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:58 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]: dispatch 2024-09-19T09:13:58.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:58 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a590cdeb-d3d8-4648-8b73-60f4c8a49f67"}]': finished 2024-09-19T09:13:58.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:58 smithi086 ceph-mon[34813]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T09:13:58.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:13:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:59 smithi052 ceph-mon[30947]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:13:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:13:59 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/38977400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:59 smithi169 ceph-mon[35454]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:13:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:13:59 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/38977400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:59 smithi086 ceph-mon[34813]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:13:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:13:59 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/38977400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:01 smithi052 ceph-mon[30947]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:01 smithi169 ceph-mon[35454]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:01 smithi086 ceph-mon[34813]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:03 smithi086 ceph-mon[34813]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:03 smithi052 ceph-mon[30947]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:03 smithi169 ceph-mon[35454]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:05.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:05 smithi052 ceph-mon[30947]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:05.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:05 smithi169 ceph-mon[35454]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:05.448 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:05 smithi086 ceph-mon[34813]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:06.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:14:06.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:14:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:06.464 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:14:06.464 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:07.397 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:07 smithi086 ceph-mon[34813]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:07.398 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:07 smithi086 ceph-mon[34813]: Deploying daemon osd.1 on smithi086 2024-09-19T09:14:07.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:07 smithi052 ceph-mon[30947]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:07.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:07 smithi052 ceph-mon[30947]: Deploying daemon osd.1 on smithi086 2024-09-19T09:14:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:07 smithi169 ceph-mon[35454]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:07 smithi169 ceph-mon[35454]: Deploying daemon osd.1 on smithi086 2024-09-19T09:14:09.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:09 smithi052 ceph-mon[30947]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:09.441 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:09 smithi086 ceph-mon[34813]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:09.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:09 smithi169 ceph-mon[35454]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:11.396 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:11 smithi086 ceph-mon[34813]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:11 smithi052 ceph-mon[30947]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:11 smithi169 ceph-mon[35454]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:13 smithi052 ceph-mon[30947]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:13 smithi169 ceph-mon[35454]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:13 smithi086 ceph-mon[34813]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:16.461 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.460+0000 7f142bfff640 1 -- 172.21.15.86:0/906749369 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1444062630 con 0x7f142c0a3260 2024-09-19T09:14:16.461 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 1 on host 'smithi086' 2024-09-19T09:14:16.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 msgr2=0x7f142c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.462 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 0x7f142c0a5720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f143c006010 tx=0x7f143c000f40 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 msgr2=0x7f144419f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f143400d750 tx=0x7f143400dc10 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 shutdown_connections 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14441078c0 0x7f144419f4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f142c0a3260 0x7f142c0a5720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1444104f90 0x7f1444198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 --2- 172.21.15.86:0/906749369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1444102660 0x7f1444197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 >> 172.21.15.86:0/906749369 conn(0x7f14440fc280 msgr2=0x7f1444103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 shutdown_connections 2024-09-19T09:14:16.463 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:14:16.462+0000 7f144942e640 1 -- 172.21.15.86:0/906749369 wait complete. 2024-09-19T09:14:17.027 DEBUG:teuthology.orchestra.run.smithi086:osd.1> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:14:17.030 INFO:tasks.cephadm:Deploying osd.2 on smithi169 with /dev/vg_nvme/lv_4... 2024-09-19T09:14:17.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:14:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:17 smithi086 ceph-mon[34813]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:17 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:17 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:17 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:17.287 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:14:17.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:17 smithi169 ceph-mon[35454]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:17.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:17 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:17.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:17 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:17.400 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:17 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:17 smithi052 ceph-mon[30947]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:17 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:17 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:17 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:19.008 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:14:18.643+0000 7fa88dd37640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:14:19.396 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:19 smithi086 ceph-mon[34813]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:19.396 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:19 smithi086 ceph-mon[34813]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.396 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:19 smithi086 ceph-mon[34813]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:19 smithi052 ceph-mon[30947]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:19 smithi052 ceph-mon[30947]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:19 smithi052 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:19 smithi169 ceph-mon[35454]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:19 smithi169 ceph-mon[35454]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:19 smithi169 ceph-mon[35454]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:14:19.583 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:14:19.608 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_4 2024-09-19T09:14:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:14:20.265 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:20.266 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.267 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:20 smithi169 ceph-mon[35454]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:14:20.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 -- 172.21.15.169:0/1549088753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d201037c0 msgr2=0x7f6d2010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 --2- 172.21.15.169:0/1549088753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d201037c0 0x7f6d2010a050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009ca0 tx=0x7f6d1002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 -- 172.21.15.169:0/1549088753 shutdown_connections 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 --2- 172.21.15.169:0/1549088753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d201037c0 0x7f6d2010a050 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 --2- 172.21.15.169:0/1549088753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20102e00 0x7f6d20103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 --2- 172.21.15.169:0/1549088753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d20101c00 0x7f6d20102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 -- 172.21.15.169:0/1549088753 >> 172.21.15.169:0/1549088753 conn(0x7f6d200fd390 msgr2=0x7f6d200ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 -- 172.21.15.169:0/1549088753 shutdown_connections 2024-09-19T09:14:20.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.295+0000 7f6d28385640 1 -- 172.21.15.169:0/1549088753 wait complete. 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 Processor -- start 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 -- start start 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20101c00 0x7f6d20197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d201037c0 0x7f6d2019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2010d8e0 con 0x7f6d20101c00 2024-09-19T09:14:20.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2010d760 con 0x7f6d201037c0 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d28385640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2010da60 con 0x7f6d20102e00 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d25920640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d25920640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:41252/0 (socket says 172.21.15.169:41252) 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d25920640 1 -- 172.21.15.169:0/2260121912 learned_addr learned my addr 172.21.15.169:0/2260121912 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.296+0000 7f6d26922640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d201037c0 0x7f6d2019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d26121640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20101c00 0x7f6d20197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 -- 172.21.15.169:0/2260121912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d201037c0 msgr2=0x7f6d2019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d201037c0 0x7f6d2019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 -- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20101c00 msgr2=0x7f6d20197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20101c00 0x7f6d20197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 -- 172.21.15.169:0/2260121912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2019fb10 con 0x7f6d20102e00 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d25920640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400b4a0 tx=0x7f6d1400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14014070 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d14010af0 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2019fe00 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14017d10 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.297+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d201a0300 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.298+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d20108f80 con 0x7f6d20102e00 2024-09-19T09:14:20.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.300+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f6d14017070 con 0x7f6d20102e00 2024-09-19T09:14:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.301+0000 7f6d1f7fe640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 0x7f6d080a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.301+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f6d140cd5d0 con 0x7f6d20102e00 2024-09-19T09:14:20.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.301+0000 7f6d26121640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 0x7f6d080a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.302+0000 7f6d26121640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 0x7f6d080a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005d00 tx=0x7f6d18005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.304+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d1409bc60 con 0x7f6d20102e00 2024-09-19T09:14:20.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:20.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:20.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:20.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:20 smithi052 ceph-mon[30947]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:14:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:20.482+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6d20062630 con 0x7f6d080a3260 2024-09-19T09:14:20.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:14:20.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:14:20.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:20.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-mon[34813]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:14:21.257 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:14:20.924+0000 7fa889497640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:14:21.257 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:14:20.929+0000 7fa881ac9640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:14:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi086 2024-09-19T09:14:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 17088M 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='osd.1 ' entity='osd.1' 2024-09-19T09:14:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi086 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 17088M 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:21.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:21.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:21.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='osd.1 ' entity='osd.1' 2024-09-19T09:14:21.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi086 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 17088M 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='osd.1 ' entity='osd.1' 2024-09-19T09:14:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:22.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:14:22.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:14:22.365 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:22.366 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] boot 2024-09-19T09:14:22.366 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:14:22.366 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:14:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:14:22.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:22.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] boot 2024-09-19T09:14:22.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:14:22.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:22.462 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:14:22.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:14:22.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:22.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: osd.1 [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] boot 2024-09-19T09:14:22.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T09:14:22.463 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/73128268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]': finished 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:14:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/73128268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]': finished 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:14:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/73128268' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]: dispatch 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46efd319-b3bd-4ac6-b9e8-9655c2327275"}]': finished 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: osdmap e13: 3 total, 2 up, 3 in 2024-09-19T09:14:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:24.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:24 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/359389223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:24.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:24 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/359389223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:24.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:24 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/359389223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:25 smithi169 ceph-mon[35454]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:25.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:25 smithi086 ceph-mon[34813]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:25.580 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:25 smithi052 ceph-mon[30947]: pgmap v59: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:26.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:26 smithi086 ceph-mon[34813]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:26.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:26 smithi052 ceph-mon[30947]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:26.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:26 smithi169 ceph-mon[35454]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:28.398 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:28 smithi169 ceph-mon[35454]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:28.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:28 smithi052 ceph-mon[30947]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:28.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:28 smithi086 ceph-mon[34813]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:30.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:30 smithi052 ceph-mon[30947]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:30.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:30 smithi169 ceph-mon[35454]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:30.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:30 smithi086 ceph-mon[34813]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:31.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:14:31.547 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:31.548 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:31 smithi169 ceph-mon[35454]: Deploying daemon osd.2 on smithi169 2024-09-19T09:14:31.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:14:31.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:31.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:31 smithi052 ceph-mon[30947]: Deploying daemon osd.2 on smithi169 2024-09-19T09:14:31.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:14:31.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:31.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:31 smithi086 ceph-mon[34813]: Deploying daemon osd.2 on smithi169 2024-09-19T09:14:32.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:32 smithi169 ceph-mon[35454]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:32.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:32 smithi052 ceph-mon[30947]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:32.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:32 smithi086 ceph-mon[34813]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:34.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:34 smithi052 ceph-mon[30947]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:34.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:34 smithi169 ceph-mon[35454]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:34.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:34 smithi086 ceph-mon[34813]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:36.565 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:36 smithi169 ceph-mon[35454]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:36.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:36 smithi052 ceph-mon[30947]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:36.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:36 smithi086 ceph-mon[34813]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:37.578 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:37.578 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:37.578 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:37.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:37.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:37.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:37.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:37.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:37.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:39.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:39 smithi169 ceph-mon[35454]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:39.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:39 smithi052 ceph-mon[30947]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:39.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:39 smithi086 ceph-mon[34813]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:40.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:40.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.242 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 2 on host 'smithi169' 2024-09-19T09:14:41.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.241+0000 7f6d1f7fe640 1 -- 172.21.15.169:0/2260121912 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6d20062630 con 0x7f6d080a3260 2024-09-19T09:14:41.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 msgr2=0x7f6d080a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 0x7f6d080a5720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d18005d00 tx=0x7f6d18005c50 comp rx=0 tx=0).stop 2024-09-19T09:14:41.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 msgr2=0x7f6d20198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400b4a0 tx=0x7f6d1400b960 comp rx=0 tx=0).stop 2024-09-19T09:14:41.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 shutdown_connections 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d201037c0 0x7f6d2019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d080a3260 0x7f6d080a5720 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d20102e00 0x7f6d20198420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 --2- 172.21.15.169:0/2260121912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d20101c00 0x7f6d20197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 >> 172.21.15.169:0/2260121912 conn(0x7f6d200fd390 msgr2=0x7f6d20106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 shutdown_connections 2024-09-19T09:14:41.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:14:41.244+0000 7f6d28385640 1 -- 172.21.15.169:0/2260121912 wait complete. 2024-09-19T09:14:41.537 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:41.537 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.537 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:41.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.840 DEBUG:teuthology.orchestra.run.smithi169:osd.2> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:14:41.843 INFO:tasks.cephadm:Deploying osd.3 on smithi052 with /dev/vg_nvme/lv_3... 2024-09-19T09:14:41.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:14:41.868 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:41.868 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:41.868 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:42.100 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:14:42.491 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:42 smithi052 ceph-mon[30947]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:42.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:42 smithi169 ceph-mon[35454]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:42.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:42 smithi086 ceph-mon[34813]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:43.692 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:14:43.487+0000 7f09779ce640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:14:44.501 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:44 smithi052 ceph-mon[30947]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:44.501 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:44 smithi052 ceph-mon[30947]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.501 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:44 smithi052 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:14:44.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2024-09-19T09:14:44.609 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:44 smithi169 ceph-mon[35454]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:44.610 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:44 smithi169 ceph-mon[35454]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.610 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:44 smithi169 ceph-mon[35454]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:44 smithi086 ceph-mon[34813]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:44 smithi086 ceph-mon[34813]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:44 smithi086 ceph-mon[34813]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:14:44.856 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 -- 172.21.15.52:0/1116585898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 msgr2=0x7fa848100870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 --2- 172.21.15.52:0/1116585898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa848100870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa844009900 tx=0x7fa84402a410 comp rx=0 tx=0).stop 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 -- 172.21.15.52:0/1116585898 shutdown_connections 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 --2- 172.21.15.52:0/1116585898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848101750 0x7fa848101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 --2- 172.21.15.52:0/1116585898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848100db0 0x7fa848101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 --2- 172.21.15.52:0/1116585898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa848100870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 -- 172.21.15.52:0/1116585898 >> 172.21.15.52:0/1116585898 conn(0x7fa8480fc280 msgr2=0x7fa8480fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 -- 172.21.15.52:0/1116585898 shutdown_connections 2024-09-19T09:14:45.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.291+0000 7fa84fec9640 1 -- 172.21.15.52:0/1116585898 wait complete. 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 Processor -- start 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 -- start start 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848100db0 0x7fa84819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 0x7fa8481a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa84810fa60 con 0x7fa848100470 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa84810f8e0 con 0x7fa848100db0 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84fec9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa84810fbe0 con 0x7fa848101750 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84dc65640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84dc65640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41394/0 (socket says 172.21.15.52:41394) 2024-09-19T09:14:45.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84dc65640 1 -- 172.21.15.52:0/2993272917 learned_addr learned my addr 172.21.15.52:0/2993272917 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84e466640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 0x7fa8481a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.292+0000 7fa84d464640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848100db0 0x7fa84819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 -- 172.21.15.52:0/2993272917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 msgr2=0x7fa8481a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 0x7fa8481a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 -- 172.21.15.52:0/2993272917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848100db0 msgr2=0x7fa84819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848100db0 0x7fa84819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 -- 172.21.15.52:0/2993272917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481a1cf0 con 0x7fa848100470 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84e466640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 0x7fa8481a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:45.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84dc65640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa844009230 tx=0x7fa844004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84403f030 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa844003ce0 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8481a1f80 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844035070 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.293+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8481a2370 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.294+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84810b1c0 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.295+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa844042030 con 0x7fa848100470 2024-09-19T09:14:45.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.296+0000 7fa83effd640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 0x7fa8340a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.296+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2445+0+0 (secure 0 0 0) 0x7fa8440ee700 con 0x7fa848100470 2024-09-19T09:14:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.296+0000 7fa84d464640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 0x7fa8340a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.297+0000 7fa84d464640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 0x7fa8340a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa84819b5e0 tx=0x7fa83800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.300+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8440bc500 con 0x7fa848100470 2024-09-19T09:14:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:45.486+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa848062630 con 0x7fa8340a3260 2024-09-19T09:14:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:14:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:14:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi169 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.873 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi169 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:45.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi169 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 17088M 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:45.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:46.692 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:14:46.273+0000 7f097312e640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:14:46.692 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:14:46.282+0000 7f096b760640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:14:46.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:14:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:14:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:46.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:46.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:46.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:46.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:46 smithi169 ceph-mon[35454]: from='osd.2 ' entity='osd.2' 2024-09-19T09:14:46.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:46.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:14:46.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:46 smithi086 ceph-mon[34813]: from='osd.2 ' entity='osd.2' 2024-09-19T09:14:46.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:46.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:14:46.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:14:46.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:46 smithi052 ceph-mon[30947]: from='osd.2 ' entity='osd.2' 2024-09-19T09:14:47.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:14:47.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:14:47.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:47.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] boot 2024-09-19T09:14:47.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:14:47.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:47 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] boot 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:14:48.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:47 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:14:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:14:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: osd.2 [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] boot 2024-09-19T09:14:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: osdmap e16: 3 total, 3 up, 3 in 2024-09-19T09:14:48.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:47 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:14:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]: dispatch 2024-09-19T09:14:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]': finished 2024-09-19T09:14:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T09:14:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:48 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4093404440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]: dispatch 2024-09-19T09:14:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]': finished 2024-09-19T09:14:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T09:14:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:48 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4093404440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]: dispatch 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3323845790' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9318aae9-50c2-4e6b-bbbb-2345588faaab"}]': finished 2024-09-19T09:14:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: osdmap e17: 4 total, 3 up, 4 in 2024-09-19T09:14:49.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:49.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:14:49.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:48 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4093404440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:49.921 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[46883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:49.921 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[46883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:49.921 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[46883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:49.921 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[46883]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:49.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:14:49.938+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa8440b8b70 con 0x7fa848100470 2024-09-19T09:14:50.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:50.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:49 smithi052 ceph-mon[30947]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:14:50.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:50.180 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[47255]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:50.180 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[47255]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:50.180 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[47255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:50.180 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:14:49 smithi052 sudo[47255]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:50.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:50.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:49 smithi169 ceph-mon[35454]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:14:50.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:50.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:14:50.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:49 smithi086 ceph-mon[34813]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T09:14:50.197 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:50.452 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43156]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:50.452 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43156]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:50.453 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:50.453 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43156]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:50.757 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43159]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:50.757 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43159]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:50.757 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:50.757 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:14:50 smithi086 sudo[43159]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:50.976 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:50.976 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:14:50.976 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:14:50.976 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:50.976 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:50.977 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:50 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:50.977 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:50.977 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:50.977 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:50.977 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44086]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:51.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:51.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:14:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:14:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:50 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:14:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:14:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:14:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:50 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:51.442 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44089]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:51.442 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44089]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:51.442 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:51.442 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:14:50 smithi169 sudo[44089]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:51.917 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47639]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:51.917 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47639]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:51.917 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:51.917 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47639]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:52.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47646]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:52.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47646]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:52.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:52.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:51 smithi052 sudo[47646]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:52.413 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44092]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:52.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44092]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:52.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:52.414 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44092]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44095]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 sudo[44095]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:52.931 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43165]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:14:52.932 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:52.932 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:52.932 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43165]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.111 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43168]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:14:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43168]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:14:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 sudo[43168]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:53.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:53 smithi169 ceph-mon[35454]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:54.210 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:54.210 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.210 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:54.210 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.210 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:54.211 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:54.211 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:54.211 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:53 smithi052 ceph-mon[30947]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:14:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:14:54.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:14:54.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:53 smithi086 ceph-mon[34813]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:14:55.078 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:54 smithi052 ceph-mon[30947]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:55.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:54 smithi086 ceph-mon[34813]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:54 smithi169 ceph-mon[35454]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:56 smithi086 ceph-mon[34813]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:14:57.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:56 smithi052 ceph-mon[30947]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:14:57.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:56 smithi169 ceph-mon[35454]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:14:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:14:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:58.162 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:57 smithi052 ceph-mon[30947]: Deploying daemon osd.3 on smithi052 2024-09-19T09:14:58.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:57 smithi086 ceph-mon[34813]: Deploying daemon osd.3 on smithi052 2024-09-19T09:14:58.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:57 smithi169 ceph-mon[35454]: Deploying daemon osd.3 on smithi052 2024-09-19T09:14:59.073 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:14:58 smithi052 ceph-mon[30947]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:14:59.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:14:58 smithi086 ceph-mon[34813]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:14:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:14:58 smithi169 ceph-mon[35454]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:15:01.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:00 smithi086 ceph-mon[34813]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:15:01.358 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:00 smithi052 ceph-mon[30947]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:15:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:00 smithi169 ceph-mon[35454]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:15:03.246 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:02 smithi052 ceph-mon[30947]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:15:03.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:03.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:03.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:02 smithi086 ceph-mon[34813]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:15:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:02 smithi169 ceph-mon[35454]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:15:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:04 smithi052 ceph-mon[30947]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:15:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:04 smithi086 ceph-mon[34813]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:15:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:04 smithi169 ceph-mon[35454]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:15:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:06.202 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:05 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.243+0000 7fa83effd640 1 -- 172.21.15.52:0/2993272917 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa848062630 con 0x7fa8340a3260 2024-09-19T09:15:06.243 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 3 on host 'smithi052' 2024-09-19T09:15:06.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 msgr2=0x7fa8340a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:06.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 0x7fa8340a5720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa84819b5e0 tx=0x7fa83800b390 comp rx=0 tx=0).stop 2024-09-19T09:15:06.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 msgr2=0x7fa84819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:06.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa844009230 tx=0x7fa844004360 comp rx=0 tx=0).stop 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 shutdown_connections 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8340a3260 0x7fa8340a5720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa848101750 0x7fa8481a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa848100db0 0x7fa84819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 --2- 172.21.15.52:0/2993272917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa848100470 0x7fa84819a0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 >> 172.21.15.52:0/2993272917 conn(0x7fa8480fc280 msgr2=0x7fa8480fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 shutdown_connections 2024-09-19T09:15:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:06.245+0000 7fa84fec9640 1 -- 172.21.15.52:0/2993272917 wait complete. 2024-09-19T09:15:06.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:05 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:05 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:06.830 DEBUG:teuthology.orchestra.run.smithi052:osd.3> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:15:06.833 INFO:tasks.cephadm:Deploying osd.4 on smithi086 with /dev/vg_nvme/lv_3... 2024-09-19T09:15:06.833 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:15:07.086 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:15:07.113 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:06 smithi052 ceph-mon[30947]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:07.113 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:07.113 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:07.113 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:07.208 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:06 smithi086 ceph-mon[34813]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:07.208 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:07.208 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:07.208 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:06 smithi169 ceph-mon[35454]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:09.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:08 smithi052 ceph-mon[30947]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:09.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:08 smithi052 ceph-mon[30947]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:15:09.180 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:15:08 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:15:08.839+0000 7fb8c2ba7640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:15:09.215 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:08 smithi086 ceph-mon[34813]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:09.215 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:08 smithi086 ceph-mon[34813]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:15:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:08 smithi169 ceph-mon[35454]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:15:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:08 smithi169 ceph-mon[35454]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:15:09.452 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:15:09.478 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_3 2024-09-19T09:15:09.728 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.103 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.104 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:10.104 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:10.104 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.104 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:09 smithi086 ceph-mon[34813]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- 172.21.15.86:0/734308735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 msgr2=0x7f628c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 --2- 172.21.15.86:0/734308735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c100ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6280009900 tx=0x7f628002a410 comp rx=0 tx=0).stop 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- 172.21.15.86:0/734308735 shutdown_connections 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 --2- 172.21.15.86:0/734308735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c102690 0x7f628c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 --2- 172.21.15.86:0/734308735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c101cd0 0x7f628c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 --2- 172.21.15.86:0/734308735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c100ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.190 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- 172.21.15.86:0/734308735 >> 172.21.15.86:0/734308735 conn(0x7f628c0fc280 msgr2=0x7f628c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- 172.21.15.86:0/734308735 shutdown_connections 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- 172.21.15.86:0/734308735 wait complete. 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 Processor -- start 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.187+0000 7f6292d3b640 1 -- start start 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c101cd0 0x7f628c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c102690 0x7f628c19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10c760 con 0x7f628c102690 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10c5e0 con 0x7f628c100ad0 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6292d3b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f628c10c8e0 con 0x7f628c101cd0 2024-09-19T09:15:10.191 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:52104/0 (socket says 172.21.15.86:52104) 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 -- 172.21.15.86:0/2074946895 learned_addr learned my addr 172.21.15.86:0/2074946895 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f62912d8640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c102690 0x7f628c19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f628bfff640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c101cd0 0x7f628c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 -- 172.21.15.86:0/2074946895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c101cd0 msgr2=0x7f628c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c101cd0 0x7f628c197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 -- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c102690 msgr2=0x7f628c19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c102690 0x7f628c19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 -- 172.21.15.86:0/2074946895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c19ea50 con 0x7f628c100ad0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6290ad7640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6280031610 tx=0x7f62800043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.188+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628003f030 con 0x7f628c100ad0 2024-09-19T09:15:10.192 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.189+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6280003ce0 con 0x7f628c100ad0 2024-09-19T09:15:10.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.189+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280035070 con 0x7f628c100ad0 2024-09-19T09:15:10.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.189+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c069f70 con 0x7f628c100ad0 2024-09-19T09:15:10.193 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.189+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c06a4a0 con 0x7f628c100ad0 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.190+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c100ed0 con 0x7f628c100ad0 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.191+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6280042030 con 0x7f628c100ad0 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.191+0000 7f6289ffb640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 0x7f627c0a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.192+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3389+0+0 (secure 0 0 0) 0x7f62800eeaf0 con 0x7f628c100ad0 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.192+0000 7f628bfff640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 0x7f627c0a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.194 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.192+0000 7f628bfff640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 0x7f627c0a79c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6278005d00 tx=0x7f6278005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.196 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.196+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62800bcb50 con 0x7f628c100ad0 2024-09-19T09:15:10.378 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:10.378+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f628c06a7c0 con 0x7f627c0a5500 2024-09-19T09:15:10.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:15:10.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:09 smithi052 ceph-mon[30947]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:10.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:10.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:10.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:10.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:09 smithi169 ceph-mon[35454]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:15:10.988 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:15:10.696+0000 7fb8be307640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:15:10.988 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:15:10.701+0000 7fb8b6939640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi052 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:11.039 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:11.040 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:11.040 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' 2024-09-19T09:15:11.040 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] boot 2024-09-19T09:15:11.040 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:15:11.040 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:15:11.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi052 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] boot 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:15:11.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi052 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878]' entity='osd.3' 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: osd.3 [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] boot 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: osdmap e22: 4 total, 4 up, 4 in 2024-09-19T09:15:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:15:12.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:11 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:15:12.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:11 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:15:12.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:11 smithi086 ceph-mon[34813]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:12.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:11 smithi086 ceph-mon[34813]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T09:15:12.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:11 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:15:12.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:11 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:15:12.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:11 smithi052 ceph-mon[30947]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:12.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:11 smithi052 ceph-mon[30947]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T09:15:12.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:11 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:15:12.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:11 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:15:12.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:11 smithi169 ceph-mon[35454]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:12.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:11 smithi169 ceph-mon[35454]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/3073289618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]': finished 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:15:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/3073289618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]': finished 2024-09-19T09:15:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:15:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/3073289618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]: dispatch 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76a0dea0-afb1-4fb8-8659-1b4dd0622faa"}]': finished 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: osdmap e24: 5 total, 4 up, 5 in 2024-09-19T09:15:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:14.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:14 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/3749433614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:14.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:14 smithi052 ceph-mon[30947]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:15:14.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:14.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:14 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/3749433614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:14.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:14 smithi169 ceph-mon[35454]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:15:14.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:14 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/3749433614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:14 smithi086 ceph-mon[34813]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T09:15:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:15 smithi052 ceph-mon[30947]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:15 smithi052 ceph-mon[30947]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:15:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:15 smithi169 ceph-mon[35454]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:15 smithi169 ceph-mon[35454]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:15:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:15 smithi086 ceph-mon[34813]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:15 smithi086 ceph-mon[34813]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T09:15:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:17 smithi052 ceph-mon[30947]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:17 smithi169 ceph-mon[35454]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:17 smithi086 ceph-mon[34813]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 136 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:19.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:19 smithi086 ceph-mon[34813]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T09:15:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:19 smithi052 ceph-mon[30947]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T09:15:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:19 smithi169 ceph-mon[35454]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-19T09:15:21.129 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:21 smithi086 ceph-mon[34813]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:15:21.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:21 smithi052 ceph-mon[30947]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:15:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:21 smithi169 ceph-mon[35454]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T09:15:22.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:15:22.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:22.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:22 smithi086 ceph-mon[34813]: Deploying daemon osd.4 on smithi086 2024-09-19T09:15:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:15:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:22 smithi052 ceph-mon[30947]: Deploying daemon osd.4 on smithi086 2024-09-19T09:15:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:15:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:22 smithi169 ceph-mon[35454]: Deploying daemon osd.4 on smithi086 2024-09-19T09:15:23.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:23 smithi086 ceph-mon[34813]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:23 smithi052 ceph-mon[30947]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:23 smithi169 ceph-mon[35454]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:25.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:25 smithi052 ceph-mon[30947]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:15:25.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:25 smithi169 ceph-mon[35454]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:15:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:25 smithi086 ceph-mon[34813]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T09:15:27.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:27 smithi086 ceph-mon[34813]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:15:27.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:27 smithi052 ceph-mon[30947]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:15:27.441 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:27 smithi169 ceph-mon[35454]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T09:15:28.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:28.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:28.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:28.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:28.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:29.343 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:29 smithi086 ceph-mon[34813]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:15:29.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:29 smithi052 ceph-mon[30947]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:15:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:29 smithi169 ceph-mon[35454]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:30.813 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.853 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.852+0000 7f6289ffb640 1 -- 172.21.15.86:0/2074946895 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f628c06a7c0 con 0x7f627c0a5500 2024-09-19T09:15:30.853 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 4 on host 'smithi086' 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 msgr2=0x7f627c0a79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 0x7f627c0a79c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6278005d00 tx=0x7f6278005c50 comp rx=0 tx=0).stop 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 msgr2=0x7f628c196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6280031610 tx=0x7f62800043b0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 shutdown_connections 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f628c102690 0x7f628c19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.855 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f627c0a5500 0x7f627c0a79c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f628c101cd0 0x7f628c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 --2- 172.21.15.86:0/2074946895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f628c100ad0 0x7f628c196e20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.854+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 >> 172.21.15.86:0/2074946895 conn(0x7f628c0fc280 msgr2=0x7f628c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:30.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.855+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 shutdown_connections 2024-09-19T09:15:30.856 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:15:30.855+0000 7f6292d3b640 1 -- 172.21.15.86:0/2074946895 wait complete. 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.476 DEBUG:teuthology.orchestra.run.smithi086:osd.4> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:15:31.478 INFO:tasks.cephadm:Deploying osd.5 on smithi169 with /dev/vg_nvme/lv_3... 2024-09-19T09:15:31.478 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:15:31.700 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.700 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.700 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.734 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:15:31.854 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.855 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.855 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:31.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:32.865 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:32 smithi169 ceph-mon[35454]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:33.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:32 smithi052 ceph-mon[30947]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:33.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:32 smithi086 ceph-mon[34813]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:33.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:15:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:15:32.852+0000 7f15f04dc640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:15:33.889 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:15:33.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_3 2024-09-19T09:15:34.154 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:15:34.179 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:33 smithi086 ceph-mon[34813]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.179 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:33 smithi086 ceph-mon[34813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:33 smithi052 ceph-mon[30947]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:33 smithi052 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:33 smithi169 ceph-mon[35454]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:33 smithi169 ceph-mon[35454]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 -- 172.21.15.169:0/3664185016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8105040 msgr2=0x7f96e8107430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 --2- 172.21.15.169:0/3664185016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8105040 0x7f96e8107430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009900 tx=0x7f96d802a410 comp rx=0 tx=0).stop 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 -- 172.21.15.169:0/3664185016 shutdown_connections 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 --2- 172.21.15.169:0/3664185016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 0x7f96e8109d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 --2- 172.21.15.169:0/3664185016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8105040 0x7f96e8107430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 --2- 172.21.15.169:0/3664185016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8102710 0x7f96e8104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 -- 172.21.15.169:0/3664185016 >> 172.21.15.169:0/3664185016 conn(0x7f96e80fc290 msgr2=0x7f96e80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 -- 172.21.15.169:0/3664185016 shutdown_connections 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.622+0000 7f96f0228640 1 -- 172.21.15.169:0/3664185016 wait complete. 2024-09-19T09:15:34.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 Processor -- start 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 -- start start 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8105040 0x7f96e81006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 0x7f96e8100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810d880 con 0x7f96e8105040 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810d700 con 0x7f96e8107970 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96f0228640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f96e810da00 con 0x7f96e8102710 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96edfc4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96edfc4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:42922/0 (socket says 172.21.15.169:42922) 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96edfc4640 1 -- 172.21.15.169:0/3381152223 learned_addr learned my addr 172.21.15.169:0/3381152223 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.623+0000 7f96ee7c5640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 0x7f96e8100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96ed7c3640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8105040 0x7f96e81006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 -- 172.21.15.169:0/3381152223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 msgr2=0x7f96e8100c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 0x7f96e8100c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 -- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8105040 msgr2=0x7f96e81006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8105040 0x7f96e81006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 -- 172.21.15.169:0/3381152223 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e81014c0 con 0x7f96e8102710 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96edfc4640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d950 tx=0x7f96e400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4017030 con 0x7f96e8102710 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96e4004020 con 0x7f96e8102710 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e81a20f0 con 0x7f96e8102710 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e40047a0 con 0x7f96e8102710 2024-09-19T09:15:34.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.624+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e81a2600 con 0x7f96e8102710 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.625+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e80fdd80 con 0x7f96e8102710 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.626+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f96e40041d0 con 0x7f96e8102710 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.627+0000 7f96deffd640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.627+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3805+0+0 (secure 0 0 0) 0x7f96e40ce280 con 0x7f96e8102710 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.627+0000 7f96ed7c3640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.628+0000 7f96ed7c3640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 0x7f96d40a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96d8006010 tx=0x7f96d8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.631+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96e409c0a0 con 0x7f96e8102710 2024-09-19T09:15:34.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:34.806+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f96e8062630 con 0x7f96d40a3240 2024-09-19T09:15:35.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:35.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:35.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:34 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:35.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:34 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:35.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:35.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:15:35.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:35.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:34 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:36.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:15:36.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi086 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-mon[34813]: from='osd.4 ' entity='osd.4' 2024-09-19T09:15:36.009 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:15:35.632+0000 7f15ebc3c640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:15:36.009 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:15:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:15:35.643+0000 7f15e426e640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:15:36.128 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi086 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:15:36.129 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.130 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.130 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:35 smithi169 ceph-mon[35454]: from='osd.4 ' entity='osd.4' 2024-09-19T09:15:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:15:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:15:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi086 2024-09-19T09:15:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 8544M 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:35 smithi052 ceph-mon[30947]: from='osd.4 ' entity='osd.4' 2024-09-19T09:15:36.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:36 smithi052 ceph-mon[30947]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:36.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:36.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:36 smithi052 ceph-mon[30947]: osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] boot 2024-09-19T09:15:36.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:36 smithi052 ceph-mon[30947]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:15:36.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:36 smithi169 ceph-mon[35454]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:36 smithi169 ceph-mon[35454]: osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] boot 2024-09-19T09:15:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:36 smithi169 ceph-mon[35454]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:15:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:36 smithi086 ceph-mon[34813]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:15:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:36 smithi086 ceph-mon[34813]: osd.4 [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] boot 2024-09-19T09:15:37.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:36 smithi086 ceph-mon[34813]: osdmap e29: 5 total, 5 up, 5 in 2024-09-19T09:15:37.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:15:37.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/1690144576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:37.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:37.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]': finished 2024-09-19T09:15:37.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:15:37.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:37.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:37 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/2495150224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:38.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/1690144576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:38.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]': finished 2024-09-19T09:15:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:15:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:37 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/2495150224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/1690144576' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]: dispatch 2024-09-19T09:15:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "591fa0a5-b621-4110-a02f-72e3532df5ed"}]': finished 2024-09-19T09:15:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: osdmap e30: 6 total, 5 up, 6 in 2024-09-19T09:15:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:38.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:37 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/2495150224' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:39.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:39 smithi052 ceph-mon[30947]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:39.679 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:39 smithi086 ceph-mon[34813]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:39.679 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:39 smithi169 ceph-mon[35454]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:41.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:41 smithi052 ceph-mon[30947]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:41.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:41 smithi169 ceph-mon[35454]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:41 smithi086 ceph-mon[34813]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:43.187 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:43 smithi169 ceph-mon[35454]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:43.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:43 smithi052 ceph-mon[30947]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:43.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:43 smithi086 ceph-mon[34813]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:45.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:45 smithi052 ceph-mon[30947]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:45 smithi169 ceph-mon[35454]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:45 smithi086 ceph-mon[34813]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:46 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:46.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:15:46.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:46 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:46.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:15:46.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:46 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:47.325 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:47 smithi169 ceph-mon[35454]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:47.325 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:47 smithi169 ceph-mon[35454]: Deploying daemon osd.5 on smithi169 2024-09-19T09:15:47.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:47 smithi052 ceph-mon[30947]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:47.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:47 smithi052 ceph-mon[30947]: Deploying daemon osd.5 on smithi169 2024-09-19T09:15:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:47 smithi086 ceph-mon[34813]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:47 smithi086 ceph-mon[34813]: Deploying daemon osd.5 on smithi169 2024-09-19T09:15:49.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:49 smithi052 ceph-mon[30947]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:49 smithi169 ceph-mon[35454]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:49 smithi086 ceph-mon[34813]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:51.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:51 smithi169 ceph-mon[35454]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:51 smithi052 ceph-mon[30947]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:51 smithi086 ceph-mon[34813]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:52.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:52.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:52.259 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:52.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:52.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:52.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:52.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:52.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:52.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:53 smithi169 ceph-mon[35454]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:53.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:53 smithi052 ceph-mon[30947]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:53.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:53 smithi086 ceph-mon[34813]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:55.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.221+0000 7f96deffd640 1 -- 172.21.15.169:0/3381152223 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f96e8062630 con 0x7f96d40a3240 2024-09-19T09:15:55.222 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 5 on host 'smithi169' 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:55.223 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 msgr2=0x7f96d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 0x7f96d40a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96d8006010 tx=0x7f96d8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 msgr2=0x7f96e8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f96e400d950 tx=0x7f96e400de10 comp rx=0 tx=0).stop 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 shutdown_connections 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96e8107970 0x7f96e8100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f96e8105040 0x7f96e81006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:55.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 --2- 172.21.15.169:0/3381152223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96e8102710 0x7f96e8102070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:55.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 >> 172.21.15.169:0/3381152223 conn(0x7f96e80fc290 msgr2=0x7f96e81030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:55.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 shutdown_connections 2024-09-19T09:15:55.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:15:55.224+0000 7f96f0228640 1 -- 172.21.15.169:0/3381152223 wait complete. 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:55.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:55.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:55.798 DEBUG:teuthology.orchestra.run.smithi169:osd.5> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:15:55.800 INFO:tasks.cephadm:Deploying osd.6 on smithi052 with /dev/vg_nvme/lv_2... 2024-09-19T09:15:55.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:56.072 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:56.109 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:56.110 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:56.110 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:57.143 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:57 smithi169 ceph-mon[35454]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:57.297 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:57 smithi052 ceph-mon[30947]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:57.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:57 smithi086 ceph-mon[34813]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:58.030 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:15:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:15:57.793+0000 7f938cce7640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:15:58.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:58 smithi052 ceph-mon[30947]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:58 smithi052 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.381 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:58 smithi169 ceph-mon[35454]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.381 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:58 smithi169 ceph-mon[35454]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:15:58.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2024-09-19T09:15:58.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:58 smithi086 ceph-mon[34813]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:58 smithi086 ceph-mon[34813]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:15:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:59.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:59.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:15:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 -- 172.21.15.52:0/3058227258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 msgr2=0x7f13ac103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 --2- 172.21.15.52:0/3058227258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac103280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009900 tx=0x7f13a002a410 comp rx=0 tx=0).stop 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 -- 172.21.15.52:0/3058227258 shutdown_connections 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 --2- 172.21.15.52:0/3058227258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 0x7f13ac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 --2- 172.21.15.52:0/3058227258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac103280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 --2- 172.21.15.52:0/3058227258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 -- 172.21.15.52:0/3058227258 >> 172.21.15.52:0/3058227258 conn(0x7f13ac0fd390 msgr2=0x7f13ac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:59.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 -- 172.21.15.52:0/3058227258 shutdown_connections 2024-09-19T09:15:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.322+0000 7f13b253a640 1 -- 172.21.15.52:0/3058227258 wait complete. 2024-09-19T09:15:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 Processor -- start 2024-09-19T09:15:59.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 -- start start 2024-09-19T09:15:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:59.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 0x7f13ac1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10d880 con 0x7f13ac102e00 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10d700 con 0x7f13ac101c00 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13b253a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac10da00 con 0x7f13ac1037c0 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13abfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13abfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:58504/0 (socket says 172.21.15.52:58504) 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.323+0000 7f13abfff640 1 -- 172.21.15.52:0/1153280017 learned_addr learned my addr 172.21.15.52:0/1153280017 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13b0ad7640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 0x7f13ac1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 -- 172.21.15.52:0/1153280017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 msgr2=0x7f13ac1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 0x7f13ac1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:59.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 -- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 msgr2=0x7f13ac19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 -- 172.21.15.52:0/1153280017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac1a1d30 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13ab7fe640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13abfff640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f139c00d770 tx=0x7f139c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c017070 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c009c30 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac1a1fc0 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c003dd0 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.324+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac1a2470 con 0x7f13ac101c00 2024-09-19T09:15:59.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.325+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac1a26a0 con 0x7f13ac101c00 2024-09-19T09:15:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.326+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f139c004000 con 0x7f13ac101c00 2024-09-19T09:15:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.327+0000 7f13a97fa640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 0x7f13940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.327+0000 7f13ab7fe640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 0x7f13940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.327+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4253+0+0 (secure 0 0 0) 0x7f139c0ce310 con 0x7f13ac101c00 2024-09-19T09:15:59.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.328+0000 7f13ab7fe640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 0x7f13940a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13a00314e0 tx=0x7f13a0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:59.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.330+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f139c009de0 con 0x7f13ac101c00 2024-09-19T09:15:59.442 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:15:59.044+0000 7f9388447640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:15:59.442 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:15:59.050+0000 7f9384a81640 -1 osd.5 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:59.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:59.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:15:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:15:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:15:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T09:15:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:15:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:15:59.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:15:59.515+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f13ac1a2870 con 0x7f13940a32f0 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi169 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.215 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.216 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:00.216 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:00.216 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi169 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:00.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:00.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:00.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi169 2024-09-19T09:16:00.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 8544M 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:00.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] boot 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: osdmap e33: 6 total, 6 up, 6 in 2024-09-19T09:16:01.331 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] boot 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: osdmap e33: 6 total, 6 up, 6 in 2024-09-19T09:16:01.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:16:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:16:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:16:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: osd.5 [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] boot 2024-09-19T09:16:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: osdmap e33: 6 total, 6 up, 6 in 2024-09-19T09:16:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:16:02.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:02 smithi052 ceph-mon[30947]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:16:02.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:02 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]: dispatch 2024-09-19T09:16:02.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:02 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]': finished 2024-09-19T09:16:02.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:02 smithi052 ceph-mon[30947]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:16:02.405 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:02.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:02 smithi169 ceph-mon[35454]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:16:02.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:02 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]: dispatch 2024-09-19T09:16:02.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:02 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]': finished 2024-09-19T09:16:02.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:02 smithi169 ceph-mon[35454]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:16:02.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:02 smithi086 ceph-mon[34813]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T09:16:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:02 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]: dispatch 2024-09-19T09:16:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:02 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/523767609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5"}]': finished 2024-09-19T09:16:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:02 smithi086 ceph-mon[34813]: osdmap e35: 7 total, 6 up, 7 in 2024-09-19T09:16:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:03 smithi052 ceph-mon[30947]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2416238957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:03 smithi052 ceph-mon[30947]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:16:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:03 smithi169 ceph-mon[35454]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:03 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2416238957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:03 smithi169 ceph-mon[35454]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:16:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:03 smithi086 ceph-mon[34813]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:03 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2416238957' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:03 smithi086 ceph-mon[34813]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T09:16:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:05.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:04 smithi086 ceph-mon[34813]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:16:05.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:04 smithi086 ceph-mon[34813]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:16:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:04 smithi052 ceph-mon[30947]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:16:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:04 smithi052 ceph-mon[30947]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:16:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:04 smithi169 ceph-mon[35454]: pgmap v132: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:16:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:04 smithi169 ceph-mon[35454]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T09:16:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:06.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:06 smithi052 ceph-mon[30947]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T09:16:07.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:06 smithi086 ceph-mon[34813]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T09:16:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:06 smithi169 ceph-mon[35454]: pgmap v134: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-09-19T09:16:08.975 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:08 smithi052 ceph-mon[30947]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:16:09.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:08 smithi086 ceph-mon[34813]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:16:09.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:08 smithi169 ceph-mon[35454]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:16:10.928 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:10 smithi052 ceph-mon[30947]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:16:10.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:16:10.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:10 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:10.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:10 smithi052 ceph-mon[30947]: Deploying daemon osd.6 on smithi052 2024-09-19T09:16:11.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:10 smithi086 ceph-mon[34813]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:16:11.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:16:11.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:10 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:10 smithi086 ceph-mon[34813]: Deploying daemon osd.6 on smithi052 2024-09-19T09:16:11.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:10 smithi169 ceph-mon[35454]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T09:16:11.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:16:11.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:10 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:11.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:10 smithi169 ceph-mon[35454]: Deploying daemon osd.6 on smithi052 2024-09-19T09:16:12.887 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:12 smithi052 ceph-mon[30947]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:13.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:12 smithi086 ceph-mon[34813]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:13.009 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:12 smithi169 ceph-mon[35454]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:14.875 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:14 smithi052 ceph-mon[30947]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:14 smithi086 ceph-mon[34813]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:14 smithi169 ceph-mon[35454]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:16.860 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:16 smithi052 ceph-mon[30947]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:16.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:16 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:16.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:16 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:16.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:16 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:16 smithi169 ceph-mon[35454]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:16 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:16 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:16 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:16 smithi086 ceph-mon[34813]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:16 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:16 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:16 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:18.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:18 smithi052 ceph-mon[30947]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:18 smithi169 ceph-mon[35454]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:19.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:18 smithi086 ceph-mon[34813]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:19.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.779+0000 7f13a97fa640 1 -- 172.21.15.52:0/1153280017 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13ac1a2870 con 0x7f13940a32f0 2024-09-19T09:16:19.779 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 6 on host 'smithi052' 2024-09-19T09:16:19.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 msgr2=0x7f13940a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 0x7f13940a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13a00314e0 tx=0x7f13a0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 msgr2=0x7f13ac19a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f139c00d770 tx=0x7f139c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 shutdown_connections 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13940a32f0 0x7f13940a57b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13ac1037c0 0x7f13ac1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13ac102e00 0x7f13ac19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 --2- 172.21.15.52:0/1153280017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13ac101c00 0x7f13ac19a100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 >> 172.21.15.52:0/1153280017 conn(0x7f13ac0fd390 msgr2=0x7f13ac1085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 shutdown_connections 2024-09-19T09:16:19.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:16:19.781+0000 7f13b253a640 1 -- 172.21.15.52:0/1153280017 wait complete. 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:20.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.087 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:20.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:20.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:20.415 DEBUG:teuthology.orchestra.run.smithi052:osd.6> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T09:16:20.417 INFO:tasks.cephadm:Deploying osd.7 on smithi086 with /dev/vg_nvme/lv_2... 2024-09-19T09:16:20.418 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:16:20.671 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:16:21.122 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:20 smithi086 ceph-mon[34813]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:21.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:20 smithi052 ceph-mon[30947]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:21.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:20 smithi169 ceph-mon[35454]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:22.680 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:16:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:16:22.400+0000 7f0ac5905640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:16:23.077 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:16:23.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_2 2024-09-19T09:16:23.115 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:22 smithi086 ceph-mon[34813]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:23.116 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:22 smithi086 ceph-mon[34813]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:16:23.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:22 smithi052 ceph-mon[30947]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:23.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:22 smithi052 ceph-mon[30947]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:16:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:22 smithi169 ceph-mon[35454]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:22 smithi169 ceph-mon[35454]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:16:23.354 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:16:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- 172.21.15.86:0/1763426623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d901026a0 msgr2=0x7f1d90104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:23.827 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- 172.21.15.86:0/1763426623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d901026a0 0x7f1d90104a90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009900 tx=0x7f1d8402a410 comp rx=0 tx=0).stop 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- 172.21.15.86:0/1763426623 shutdown_connections 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- 172.21.15.86:0/1763426623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d90107900 0x7f1d90109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- 172.21.15.86:0/1763426623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 0x7f1d901073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- 172.21.15.86:0/1763426623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d901026a0 0x7f1d90104a90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- 172.21.15.86:0/1763426623 >> 172.21.15.86:0/1763426623 conn(0x7f1d900fc280 msgr2=0x7f1d900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- 172.21.15.86:0/1763426623 shutdown_connections 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- 172.21.15.86:0/1763426623 wait complete. 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 Processor -- start 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 -- start start 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 0x7f1d90102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 0x7f1d90100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:23.828 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.795+0000 7f1d96df1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d96df1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9010d8e0 con 0x7f1d90104fd0 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d96df1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9010d760 con 0x7f1d90107900 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d96df1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9010da60 con 0x7f1d901026a0 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:33124/0 (socket says 172.21.15.86:33124) 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 -- 172.21.15.86:0/2326070912 learned_addr learned my addr 172.21.15.86:0/2326070912 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d8ffff640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 0x7f1d90100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d94b8d640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 0x7f1d90102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 -- 172.21.15.86:0/2326070912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 msgr2=0x7f1d90102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 0x7f1d90102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 -- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 msgr2=0x7f1d90100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:23.829 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 0x7f1d90100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 -- 172.21.15.86:0/2326070912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d90101450 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d94b8d640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 0x7f1d90102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d9538e640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800b970 tx=0x7f1d8800bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88019070 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d901a20c0 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d88014440 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.796+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d880075d0 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.797+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d901a2650 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.797+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d900fdd70 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.799+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d8801c070 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.799+0000 7f1d8dffb640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 0x7f1d800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.799+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4669+0+0 (secure 0 0 0) 0x7f1d880ce080 con 0x7f1d90107900 2024-09-19T09:16:23.830 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.799+0000 7f1d94b8d640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 0x7f1d800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.800+0000 7f1d94b8d640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 0x7f1d800a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d84031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:23.831 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.804+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d8809bbe0 con 0x7f1d90107900 2024-09-19T09:16:23.989 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:23.988+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1d90062630 con 0x7f1d800a3240 2024-09-19T09:16:23.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:16:23.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:16:23.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:16:23.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:23.989 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:23.990 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:23 smithi086 ceph-mon[34813]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:16:24.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:24.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:23 smithi052 ceph-mon[30947]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:23 smithi169 ceph-mon[35454]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:16:24.857 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:16:24.567+0000 7f0ac209c640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:16:24.857 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:16:24.575+0000 7f0ab9697640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:16:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi052 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:24 smithi086 ceph-mon[34813]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' 2024-09-19T09:16:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi052 2024-09-19T09:16:25.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:24 smithi052 ceph-mon[30947]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi052 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:25.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:25.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:25.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:24 smithi169 ceph-mon[35454]: from='osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530]' entity='osd.6' 2024-09-19T09:16:26.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:16:26.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:16:26.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] boot 2024-09-19T09:16:26.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: osdmap e40: 7 total, 7 up, 7 in 2024-09-19T09:16:26.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:16:26.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:16:26.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] boot 2024-09-19T09:16:26.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: osdmap e40: 7 total, 7 up, 7 in 2024-09-19T09:16:26.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: osd.6 [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] boot 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: osdmap e40: 7 total, 7 up, 7 in 2024-09-19T09:16:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:16:26.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:26.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/1022397132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:26.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:26.944 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]': finished 2024-09-19T09:16:26.945 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: osdmap e41: 8 total, 7 up, 8 in 2024-09-19T09:16:26.945 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:27.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:27.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/1022397132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:27.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:27.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]': finished 2024-09-19T09:16:27.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: osdmap e41: 8 total, 7 up, 8 in 2024-09-19T09:16:27.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/1022397132' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]: dispatch 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e13e68f3-9922-4795-a513-b311f5bf755f"}]': finished 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: osdmap e41: 8 total, 7 up, 8 in 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:28.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/652074038' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:28.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:27 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/652074038' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:28.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:27 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/652074038' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:29.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:28 smithi052 ceph-mon[30947]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:29.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:28 smithi169 ceph-mon[35454]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:29.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:28 smithi086 ceph-mon[34813]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:31.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:30 smithi052 ceph-mon[30947]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:30 smithi169 ceph-mon[35454]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:31.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:30 smithi086 ceph-mon[34813]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:33.120 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:32 smithi086 ceph-mon[34813]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:33.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:32 smithi052 ceph-mon[30947]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:32 smithi169 ceph-mon[35454]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:35.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:34 smithi086 ceph-mon[34813]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:35.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:34 smithi052 ceph-mon[30947]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:34 smithi169 ceph-mon[35454]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:36.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:16:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:35 smithi086 ceph-mon[34813]: Deploying daemon osd.7 on smithi086 2024-09-19T09:16:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:16:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:36.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:35 smithi052 ceph-mon[30947]: Deploying daemon osd.7 on smithi086 2024-09-19T09:16:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:16:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:35 smithi169 ceph-mon[35454]: Deploying daemon osd.7 on smithi086 2024-09-19T09:16:37.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:36 smithi052 ceph-mon[30947]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:36 smithi169 ceph-mon[35454]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:36 smithi086 ceph-mon[34813]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:39.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:38 smithi052 ceph-mon[30947]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:38 smithi169 ceph-mon[35454]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:38 smithi086 ceph-mon[34813]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:41.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:40 smithi052 ceph-mon[30947]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:41.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:41.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:41.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:40 smithi169 ceph-mon[35454]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:41.221 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:40 smithi086 ceph-mon[34813]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:41.221 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:41.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:41.222 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:43.150 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:42 smithi086 ceph-mon[34813]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:43.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:42 smithi052 ceph-mon[30947]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:43.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:42 smithi169 ceph-mon[35454]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:44.522 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.521+0000 7f1d8dffb640 1 -- 172.21.15.86:0/2326070912 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d90062630 con 0x7f1d800a3240 2024-09-19T09:16:44.522 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 7 on host 'smithi086' 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 msgr2=0x7f1d800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 0x7f1d800a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d84000c00 tx=0x7f1d84031400 comp rx=0 tx=0).stop 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 msgr2=0x7f1d90100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800b970 tx=0x7f1d8800bd70 comp rx=0 tx=0).stop 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 shutdown_connections 2024-09-19T09:16:44.524 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d90107900 0x7f1d90100b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d90104fd0 0x7f1d90100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1d800a3240 0x7f1d800a5700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 --2- 172.21.15.86:0/2326070912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d901026a0 0x7f1d90102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 >> 172.21.15.86:0/2326070912 conn(0x7f1d900fc280 msgr2=0x7f1d90102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 shutdown_connections 2024-09-19T09:16:44.525 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:16:44.523+0000 7f1d96df1640 1 -- 172.21.15.86:0/2326070912 wait complete. 2024-09-19T09:16:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:44 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:44.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:44 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:44 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:45.196 DEBUG:teuthology.orchestra.run.smithi086:osd.7> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T09:16:45.239 INFO:tasks.cephadm:Deploying osd.8 on smithi169 with /dev/vg_nvme/lv_2... 2024-09-19T09:16:45.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:16:45.496 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:16:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:45.617 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:45.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:45.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:45.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:46.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:46 smithi086 ceph-mon[34813]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:46.771 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:46 smithi169 ceph-mon[35454]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:46.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:46 smithi052 ceph-mon[30947]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:47.445 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:16:47 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:16:47.080+0000 7f7b6c7b3640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:16:47.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:47 smithi086 ceph-mon[34813]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:47.720 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:47 smithi086 ceph-mon[34813]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:47.790 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:47 smithi169 ceph-mon[35454]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:47.791 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:47 smithi169 ceph-mon[35454]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:47.794 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:16:47.820 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_2 2024-09-19T09:16:47.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:47 smithi052 ceph-mon[30947]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:47.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:47 smithi052 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:16:48.068 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.485+0000 7f1080d73640 1 -- 172.21.15.169:0/1623262983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 msgr2=0x7f107c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.485+0000 7f1080d73640 1 --2- 172.21.15.169:0/1623262983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c109d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1074009ca0 tx=0x7f107402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 -- 172.21.15.169:0/1623262983 shutdown_connections 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 --2- 172.21.15.169:0/1623262983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c109d50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 --2- 172.21.15.169:0/1623262983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c104fd0 0x7f107c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 --2- 172.21.15.169:0/1623262983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c1026a0 0x7f107c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 -- 172.21.15.169:0/1623262983 >> 172.21.15.169:0/1623262983 conn(0x7f107c0fc2a0 msgr2=0x7f107c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:48.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 -- 172.21.15.169:0/1623262983 shutdown_connections 2024-09-19T09:16:48.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 -- 172.21.15.169:0/1623262983 wait complete. 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 Processor -- start 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.486+0000 7f1080d73640 1 -- start start 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c1026a0 0x7f107c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 0x7f107c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10d8c0 con 0x7f107c1026a0 2024-09-19T09:16:48.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10d740 con 0x7f107c104fd0 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f107c10da40 con 0x7f107c107900 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:49994/0 (socket says 172.21.15.169:49994) 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 -- 172.21.15.169:0/4172358679 learned_addr learned my addr 172.21.15.169:0/4172358679 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107a59c640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c1026a0 0x7f107c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1079d9b640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 0x7f107c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 -- 172.21.15.169:0/4172358679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 msgr2=0x7f107c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 0x7f107c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 -- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c1026a0 msgr2=0x7f107c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c1026a0 0x7f107c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 -- 172.21.15.169:0/4172358679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107c19fb20 con 0x7f107c107900 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1079d9b640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 0x7f107c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:48.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f107ad9d640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1074005e30 tx=0x7f1074031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074003c30 con 0x7f107c107900 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1074003dd0 con 0x7f107c107900 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.487+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107c19fdb0 con 0x7f107c107900 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.488+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107402fde0 con 0x7f107c107900 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.488+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f107c1a0260 con 0x7f107c107900 2024-09-19T09:16:48.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.488+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107c0fdd90 con 0x7f107c107900 2024-09-19T09:16:48.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.490+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1074004050 con 0x7f107c107900 2024-09-19T09:16:48.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.490+0000 7f106b7fe640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 0x7f10640a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:48.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.490+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5101+0+0 (secure 0 0 0) 0x7f10740f0120 con 0x7f107c107900 2024-09-19T09:16:48.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.491+0000 7f107a59c640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 0x7f10640a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:48.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.491+0000 7f107a59c640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 0x7f10640a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f106c005fd0 tx=0x7f106c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:48.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.493+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10740bdad0 con 0x7f107c107900 2024-09-19T09:16:48.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:16:48.671+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f107c062630 con 0x7f10640a3270 2024-09-19T09:16:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:48.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi086 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:48.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi086 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:48.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:49.007 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:16:48.536+0000 7f7b67f13640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:16:49.007 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:16:48.546+0000 7f7b6454d640 -1 osd.7 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: osdmap e42: 8 total, 7 up, 8 in 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi086 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:16:49.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 5696M 2024-09-19T09:16:49.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:49.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:49.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:49.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:16:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:16:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:16:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:49 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:49.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:16:49.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:49.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:49 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:50.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:16:50.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T09:16:50.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:50.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:50.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:50.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:16:50.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:16:50.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:49 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:50.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:16:50.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:16:50.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] boot 2024-09-19T09:16:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: osdmap e44: 8 total, 8 up, 8 in 2024-09-19T09:16:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:50 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] boot 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: osdmap e44: 8 total, 8 up, 8 in 2024-09-19T09:16:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:50 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:51.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:16:51.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:16:51.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:16:51.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:51.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: osd.7 [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] boot 2024-09-19T09:16:51.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: osdmap e44: 8 total, 8 up, 8 in 2024-09-19T09:16:51.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:50 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:16:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: osdmap e45: 8 total, 8 up, 8 in 2024-09-19T09:16:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/369902201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]': finished 2024-09-19T09:16:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: osdmap e46: 9 total, 8 up, 9 in 2024-09-19T09:16:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:51 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/3603704750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:51.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: osdmap e45: 8 total, 8 up, 8 in 2024-09-19T09:16:51.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/369902201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:51.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:51.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]': finished 2024-09-19T09:16:51.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: osdmap e46: 9 total, 8 up, 9 in 2024-09-19T09:16:51.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:51.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:51 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/3603704750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:52.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: osdmap e45: 8 total, 8 up, 8 in 2024-09-19T09:16:52.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/369902201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:52.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]: dispatch 2024-09-19T09:16:52.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "117090d0-d86d-49de-ba8e-5b3bacea18ce"}]': finished 2024-09-19T09:16:52.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: osdmap e46: 9 total, 8 up, 9 in 2024-09-19T09:16:52.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:52.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:51 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/3603704750' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:16:53.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:52 smithi052 ceph-mon[30947]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:52 smithi052 ceph-mon[30947]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:16:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:52 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:52 smithi169 ceph-mon[35454]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:52 smithi169 ceph-mon[35454]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:16:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:52 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:52 smithi086 ceph-mon[34813]: pgmap v166: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:52 smithi086 ceph-mon[34813]: osdmap e47: 9 total, 8 up, 9 in 2024-09-19T09:16:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:52 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:54.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:53 smithi052 ceph-mon[30947]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:16:54.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:53 smithi169 ceph-mon[35454]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:16:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:53 smithi086 ceph-mon[34813]: osdmap e48: 9 total, 8 up, 9 in 2024-09-19T09:16:54.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:16:55.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:54 smithi052 ceph-mon[30947]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:55.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:54 smithi169 ceph-mon[35454]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:55.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:54 smithi086 ceph-mon[34813]: pgmap v169: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:57.169 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:56 smithi169 ceph-mon[35454]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:56 smithi052 ceph-mon[30947]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:56 smithi086 ceph-mon[34813]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:59.063 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:58 smithi169 ceph-mon[35454]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:59.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:58 smithi052 ceph-mon[30947]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:16:59.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:58 smithi086 ceph-mon[34813]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:00.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:17:00.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:59 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:00.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:16:59 smithi052 ceph-mon[30947]: Deploying daemon osd.8 on smithi169 2024-09-19T09:17:00.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:17:00.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:59 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:00.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:16:59 smithi169 ceph-mon[35454]: Deploying daemon osd.8 on smithi169 2024-09-19T09:17:00.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:17:00.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:59 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:00.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:16:59 smithi086 ceph-mon[34813]: Deploying daemon osd.8 on smithi169 2024-09-19T09:17:01.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:00 smithi052 ceph-mon[30947]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:01.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:00 smithi169 ceph-mon[35454]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:01.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:00 smithi086 ceph-mon[34813]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:03.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:02 smithi052 ceph-mon[30947]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:03.195 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:02 smithi169 ceph-mon[35454]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:03.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:02 smithi086 ceph-mon[34813]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:05.143 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:04 smithi169 ceph-mon[35454]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:05.143 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:05.143 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:05.143 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:04 smithi052 ceph-mon[30947]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:04 smithi086 ceph-mon[34813]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:07.005 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:06 smithi169 ceph-mon[35454]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:07.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:06 smithi052 ceph-mon[30947]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:07.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:06 smithi086 ceph-mon[34813]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:07.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.703+0000 7f106b7fe640 1 -- 172.21.15.169:0/4172358679 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f107c062630 con 0x7f10640a3270 2024-09-19T09:17:07.704 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 8 on host 'smithi169' 2024-09-19T09:17:07.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 msgr2=0x7f10640a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 0x7f10640a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f106c005fd0 tx=0x7f106c00b390 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 msgr2=0x7f107c19f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1074005e30 tx=0x7f1074031ee0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 shutdown_connections 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10640a3270 0x7f10640a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f107c107900 0x7f107c19f4b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c104fd0 0x7f107c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 --2- 172.21.15.169:0/4172358679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f107c1026a0 0x7f107c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 >> 172.21.15.169:0/4172358679 conn(0x7f107c0fc2a0 msgr2=0x7f107c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.706+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 shutdown_connections 2024-09-19T09:17:07.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:17:07.707+0000 7f1080d73640 1 -- 172.21.15.169:0/4172358679 wait complete. 2024-09-19T09:17:08.219 DEBUG:teuthology.orchestra.run.smithi169:osd.8> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T09:17:08.222 INFO:tasks.cephadm:Deploying osd.9 on smithi052 with /dev/vg_nvme/lv_1... 2024-09-19T09:17:08.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:17:08.495 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:08.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:08 smithi052 ceph-mon[30947]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:08.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.861 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.978 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:08 smithi169 ceph-mon[35454]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:08.978 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.978 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.978 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:08.978 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:09.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:08 smithi086 ceph-mon[34813]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:09.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:09.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:10 smithi086 ceph-mon[34813]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:11.079 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:10 smithi169 ceph-mon[35454]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:11.079 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:17:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:17:10.784+0000 7f703134c640 -1 osd.8 0 log_to_monitors true 2024-09-19T09:17:11.158 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:10 smithi052 ceph-mon[30947]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:11.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:17:11.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_1 2024-09-19T09:17:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:11.736 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:11.737 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:11.738 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:11.738 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- 172.21.15.52:0/4257527607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368101cd0 msgr2=0x7ff368102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 --2- 172.21.15.52:0/4257527607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368101cd0 0x7ff368102150 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff350009900 tx=0x7ff35002a410 comp rx=0 tx=0).stop 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- 172.21.15.52:0/4257527607 shutdown_connections 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 --2- 172.21.15.52:0/4257527607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368102690 0x7ff368108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 --2- 172.21.15.52:0/4257527607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368101cd0 0x7ff368102150 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 --2- 172.21.15.52:0/4257527607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368100ad0 0x7ff368100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- 172.21.15.52:0/4257527607 >> 172.21.15.52:0/4257527607 conn(0x7ff3680fc280 msgr2=0x7ff3680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- 172.21.15.52:0/4257527607 shutdown_connections 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- 172.21.15.52:0/4257527607 wait complete. 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 Processor -- start 2024-09-19T09:17:11.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.931+0000 7ff36eb05640 1 -- start start 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368101cd0 0x7ff3681030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 0x7ff3681035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810c730 con 0x7ff368100ad0 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810c5b0 con 0x7ff368102690 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36eb05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff36810c8b0 con 0x7ff368101cd0 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56702/0 (socket says 172.21.15.52:56702) 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 -- 172.21.15.52:0/2135085899 learned_addr learned my addr 172.21.15.52:0/2135085899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff367fff640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368101cd0 0x7ff3681030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36d0a2640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 0x7ff3681035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 -- 172.21.15.52:0/2135085899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368101cd0 msgr2=0x7ff3681030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368101cd0 0x7ff3681030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 -- 172.21.15.52:0/2135085899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 msgr2=0x7ff3681035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 0x7ff3681035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 -- 172.21.15.52:0/2135085899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368103eb0 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36d0a2640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 0x7ff3681035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff36c8a1640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ea80 tx=0x7ff35800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.932+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35800ce40 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.933+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff358011950 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.933+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3681a2090 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.933+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35801ab80 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.933+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681a25a0 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.934+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3681a2830 con 0x7ff368100ad0 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.935+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff358011b00 con 0x7ff368100ad0 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.935+0000 7ff365ffb640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.936+0000 7ff367fff640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.936+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5533+0+0 (secure 0 0 0) 0x7ff3580cf500 con 0x7ff368100ad0 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.936+0000 7ff367fff640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 0x7ff3540a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3500314e0 tx=0x7ff350000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:11.940+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff358016030 con 0x7ff368100ad0 2024-09-19T09:17:12.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:12.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:12.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:12.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:12.126+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff3681a2a00 con 0x7ff3540a3240 2024-09-19T09:17:12.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:12.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:17:12.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:12.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi169 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:12.858 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:12.859 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:12.859 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:13.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:13.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi169 2024-09-19T09:17:13.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T09:17:13.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi169 2024-09-19T09:17:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 5696M 2024-09-19T09:17:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:17:13.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:13.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:13.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:17:13.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:17:13.882 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:17:13.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.883 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:13 smithi052 ceph-mon[30947]: from='osd.8 ' entity='osd.8' 2024-09-19T09:17:13.942 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:17:13.502+0000 7f702caac640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T09:17:13.942 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:17:13.517+0000 7f70250de640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:17:13.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:13 smithi169 ceph-mon[35454]: from='osd.8 ' entity='osd.8' 2024-09-19T09:17:14.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:17:14.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T09:17:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:17:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:13 smithi086 ceph-mon[34813]: from='osd.8 ' entity='osd.8' 2024-09-19T09:17:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:17:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:17:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] boot 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: osdmap e52: 9 total, 9 up, 9 in 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]: dispatch 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]': finished 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: osdmap e53: 10 total, 9 up, 10 in 2024-09-19T09:17:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:15.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] boot 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: osdmap e52: 9 total, 9 up, 9 in 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]: dispatch 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]': finished 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: osdmap e53: 10 total, 9 up, 10 in 2024-09-19T09:17:15.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: osd.8 [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] boot 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: osdmap e52: 9 total, 9 up, 9 in 2024-09-19T09:17:15.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:17:15.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]: dispatch 2024-09-19T09:17:15.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4106435362' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03810cd0-6516-45f0-9945-be3a82e57bee"}]': finished 2024-09-19T09:17:15.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: osdmap e53: 10 total, 9 up, 10 in 2024-09-19T09:17:15.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:15.720 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:15 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1341834163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:15.720 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:15 smithi052 ceph-mon[30947]: osdmap e54: 10 total, 9 up, 10 in 2024-09-19T09:17:15.720 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:15 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1341834163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:15 smithi086 ceph-mon[34813]: osdmap e54: 10 total, 9 up, 10 in 2024-09-19T09:17:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:16.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:15 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1341834163' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:16.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:15 smithi169 ceph-mon[35454]: osdmap e54: 10 total, 9 up, 10 in 2024-09-19T09:17:16.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:17.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:16 smithi086 ceph-mon[34813]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:17.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:16 smithi052 ceph-mon[30947]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:16 smithi169 ceph-mon[35454]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:18.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:17 smithi086 ceph-mon[34813]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T09:17:18.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:17 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:18.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:17 smithi052 ceph-mon[30947]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T09:17:18.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:17 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:18.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:17 smithi169 ceph-mon[35454]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T09:17:18.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:17 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:19.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:18 smithi086 ceph-mon[34813]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:19.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:18 smithi086 ceph-mon[34813]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:17:19.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:18 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:19.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:18 smithi052 ceph-mon[30947]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:19.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:18 smithi052 ceph-mon[30947]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:17:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:18 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:18 smithi169 ceph-mon[35454]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:18 smithi169 ceph-mon[35454]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T09:17:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:18 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:20.996 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:20 smithi052 ceph-mon[30947]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:21.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:20 smithi086 ceph-mon[34813]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:21.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:20 smithi169 ceph-mon[35454]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:22.835 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:22 smithi052 ceph-mon[30947]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:17:23.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:22 smithi086 ceph-mon[34813]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:17:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:22 smithi169 ceph-mon[35454]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:17:23.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:17:23.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:23.965 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:17:23.965 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:24.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:17:24.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:24 smithi052 ceph-mon[30947]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:17:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:24 smithi052 ceph-mon[30947]: Deploying daemon osd.9 on smithi052 2024-09-19T09:17:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:24 smithi086 ceph-mon[34813]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:17:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:24 smithi086 ceph-mon[34813]: Deploying daemon osd.9 on smithi052 2024-09-19T09:17:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:24 smithi169 ceph-mon[35454]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T09:17:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:24 smithi169 ceph-mon[35454]: Deploying daemon osd.9 on smithi052 2024-09-19T09:17:27.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:26 smithi086 ceph-mon[34813]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:17:27.018 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:26 smithi052 ceph-mon[30947]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:17:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:26 smithi169 ceph-mon[35454]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T09:17:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:28 smithi086 ceph-mon[34813]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:17:29.022 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:28 smithi052 ceph-mon[30947]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:17:29.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:28 smithi169 ceph-mon[35454]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:17:29.893 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:29.893 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:29.893 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:30.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:30.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:30.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:30.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:30.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:30.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:31.351 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:31 smithi052 ceph-mon[30947]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T09:17:31.454 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:31 smithi169 ceph-mon[35454]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T09:17:31.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:31 smithi086 ceph-mon[34813]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T09:17:32.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.653+0000 7ff365ffb640 1 -- 172.21.15.52:0/2135085899 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff3681a2a00 con 0x7ff3540a3240 2024-09-19T09:17:32.655 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 9 on host 'smithi052' 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 msgr2=0x7ff3540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 0x7ff3540a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff3500314e0 tx=0x7ff350000bc0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 msgr2=0x7ff368104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff35800ea80 tx=0x7ff35800ef40 comp rx=0 tx=0).stop 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 shutdown_connections 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff368102690 0x7ff3681035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff368101cd0 0x7ff3681030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 --2- 172.21.15.52:0/2135085899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff368100ad0 0x7ff368104a60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 >> 172.21.15.52:0/2135085899 conn(0x7ff3680fc280 msgr2=0x7ff36806a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 shutdown_connections 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:17:32.655+0000 7ff36eb05640 1 -- 172.21.15.52:0/2135085899 wait complete. 2024-09-19T09:17:32.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:17:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:17:33.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:33.366 DEBUG:teuthology.orchestra.run.smithi052:osd.9> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:17:33.369 INFO:tasks.cephadm:Deploying osd.10 on smithi086 with /dev/vg_nvme/lv_1... 2024-09-19T09:17:33.369 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:17:33.624 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:34.929 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:34 smithi086 ceph-mon[34813]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:35.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:34 smithi052 ceph-mon[30947]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:34 smithi169 ceph-mon[35454]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:35.679 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:17:35 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:17:35.179+0000 7f5fab88a640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:17:36.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:35 smithi086 ceph-mon[34813]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:35 smithi086 ceph-mon[34813]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.043 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-19T09:17:36.070 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_1 2024-09-19T09:17:36.137 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:35 smithi052 ceph-mon[30947]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.137 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:35 smithi052 ceph-mon[30947]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:35 smithi169 ceph-mon[35454]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:35 smithi169 ceph-mon[35454]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:17:36.316 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:17:36.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- 172.21.15.86:0/3084232819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8102700 msgr2=0x7f6ec8104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:36.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- 172.21.15.86:0/3084232819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8102700 0x7f6ec8104af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009900 tx=0x7f6ebc02a410 comp rx=0 tx=0).stop 2024-09-19T09:17:36.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- 172.21.15.86:0/3084232819 shutdown_connections 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- 172.21.15.86:0/3084232819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8107960 0x7f6ec8109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- 172.21.15.86:0/3084232819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8105030 0x7f6ec8107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- 172.21.15.86:0/3084232819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8102700 0x7f6ec8104af0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- 172.21.15.86:0/3084232819 >> 172.21.15.86:0/3084232819 conn(0x7f6ec80fc2a0 msgr2=0x7f6ec80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- 172.21.15.86:0/3084232819 shutdown_connections 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- 172.21.15.86:0/3084232819 wait complete. 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 Processor -- start 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- start start 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8102700 0x7f6ec8102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:36.738 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8107960 0x7f6ec8100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.734+0000 7f6eceb50640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec810d9e0 con 0x7f6ec8107960 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6eceb50640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec810d860 con 0x7f6ec8105030 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6eceb50640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec810db60 con 0x7f6ec8102700 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:57790/0 (socket says 172.21.15.86:57790) 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 -- 172.21.15.86:0/2987919986 learned_addr learned my addr 172.21.15.86:0/2987919986 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ecc8ec640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8102700 0x7f6ec8102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ecd0ed640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8107960 0x7f6ec8100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 -- 172.21.15.86:0/2987919986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8102700 msgr2=0x7f6ec8102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:36.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8102700 0x7f6ec8102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 -- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8107960 msgr2=0x7f6ec8100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8107960 0x7f6ec8100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 -- 172.21.15.86:0/2987919986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec81014b0 con 0x7f6ec8105030 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec7fff640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b450 tx=0x7f6eb400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4015020 con 0x7f6ec8105030 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec81a2200 con 0x7f6ec8105030 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eb4011d70 con 0x7f6ec8105030 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.735+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400f340 con 0x7f6ec8105030 2024-09-19T09:17:36.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.736+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec81a2790 con 0x7f6ec8105030 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.736+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec80fdd90 con 0x7f6ec8105030 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.737+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6eb4018020 con 0x7f6ec8105030 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.738+0000 7f6ec5ffb640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 0x7f6eb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.738+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5965+0+0 (secure 0 0 0) 0x7f6eb40cea60 con 0x7f6ec8105030 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.738+0000 7f6ecc8ec640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 0x7f6eb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:36.742 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.739+0000 7f6ecc8ec640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 0x7f6eb80a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc031440 tx=0x7f6ebc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:36.744 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.742+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6eb401f020 con 0x7f6ec8105030 2024-09-19T09:17:36.925 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:36.923+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6ec8062630 con 0x7f6eb80a3240 2024-09-19T09:17:37.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi052 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:37.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi052 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:37.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:17:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T09:17:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi052 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:37.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:37.839 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:17:37.530+0000 7f5fa6fea640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:17:37.840 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:17:37.541+0000 7f5f9f61c640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:17:38.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:38.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:37 smithi086 ceph-mon[34813]: from='osd.9 ' entity='osd.9' 2024-09-19T09:17:38.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:17:38.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:37 smithi052 ceph-mon[30947]: from='osd.9 ' entity='osd.9' 2024-09-19T09:17:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-19T09:17:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:17:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:17:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:17:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:38.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:37 smithi169 ceph-mon[35454]: from='osd.9 ' entity='osd.9' 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] boot 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: osdmap e59: 10 total, 10 up, 10 in 2024-09-19T09:17:39.135 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] boot 2024-09-19T09:17:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: osdmap e59: 10 total, 10 up, 10 in 2024-09-19T09:17:39.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:17:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:17:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:17:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: osd.9 [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] boot 2024-09-19T09:17:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: osdmap e59: 10 total, 10 up, 10 in 2024-09-19T09:17:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:17:40.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/30499501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]': finished 2024-09-19T09:17:40.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: osdmap e60: 11 total, 10 up, 11 in 2024-09-19T09:17:40.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:17:40.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:39 smithi052 ceph-mon[30947]: from='client.? 172.21.15.86:0/634017468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:40.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/30499501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]': finished 2024-09-19T09:17:40.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: osdmap e60: 11 total, 10 up, 11 in 2024-09-19T09:17:40.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:17:40.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:39 smithi169 ceph-mon[35454]: from='client.? 172.21.15.86:0/634017468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:40.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/30499501' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]: dispatch 2024-09-19T09:17:40.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00f8d84c-9ca3-4e10-a2a6-8bde20432f13"}]': finished 2024-09-19T09:17:40.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: osdmap e60: 11 total, 10 up, 11 in 2024-09-19T09:17:40.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:17:40.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:39 smithi086 ceph-mon[34813]: from='client.? 172.21.15.86:0/634017468' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:17:41.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:40 smithi052 ceph-mon[30947]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:40 smithi169 ceph-mon[35454]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:41.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:40 smithi086 ceph-mon[34813]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:43.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:42 smithi052 ceph-mon[30947]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:43.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:42 smithi169 ceph-mon[35454]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:43.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:42 smithi086 ceph-mon[34813]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:44.974 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:44 smithi086 ceph-mon[34813]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:45.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:44 smithi052 ceph-mon[30947]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:45.247 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:44 smithi169 ceph-mon[35454]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:47.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:46 smithi086 ceph-mon[34813]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:47.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:46 smithi052 ceph-mon[30947]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:47.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:46 smithi169 ceph-mon[35454]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:48 smithi086 ceph-mon[34813]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:17:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:48 smithi086 ceph-mon[34813]: Deploying daemon osd.10 on smithi086 2024-09-19T09:17:49.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:48 smithi052 ceph-mon[30947]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:49.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:17:49.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:49.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:48 smithi052 ceph-mon[30947]: Deploying daemon osd.10 on smithi086 2024-09-19T09:17:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:48 smithi169 ceph-mon[35454]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:17:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:48 smithi169 ceph-mon[35454]: Deploying daemon osd.10 on smithi086 2024-09-19T09:17:51.001 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:50 smithi086 ceph-mon[34813]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:51.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:50 smithi052 ceph-mon[30947]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:51.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:50 smithi169 ceph-mon[35454]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:53.151 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:52 smithi086 ceph-mon[34813]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:53.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:52 smithi052 ceph-mon[30947]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:52 smithi169 ceph-mon[35454]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:54.129 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:54.129 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:54.129 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:54.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:54.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:54.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:54.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:55.095 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:54 smithi086 ceph-mon[34813]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:55.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:54 smithi052 ceph-mon[30947]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:55.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:54 smithi169 ceph-mon[35454]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:57.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:57.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.056 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.055+0000 7f6ec5ffb640 1 -- 172.21.15.86:0/2987919986 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6ec8062630 con 0x7f6eb80a3240 2024-09-19T09:17:57.056 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 10 on host 'smithi086' 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 msgr2=0x7f6eb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 0x7f6eb80a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc031440 tx=0x7f6ebc0315b0 comp rx=0 tx=0).stop 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 msgr2=0x7f6ec81006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400b450 tx=0x7f6eb400b910 comp rx=0 tx=0).stop 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 shutdown_connections 2024-09-19T09:17:57.058 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ec8107960 0x7f6ec8100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ec8105030 0x7f6ec81006b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6eb80a3240 0x7f6eb80a5700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 --2- 172.21.15.86:0/2987919986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec8102700 0x7f6ec8102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 >> 172.21.15.86:0/2987919986 conn(0x7f6ec80fc2a0 msgr2=0x7f6ec8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.057+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 shutdown_connections 2024-09-19T09:17:57.059 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-19T09:17:57.058+0000 7f6eceb50640 1 -- 172.21.15.86:0/2987919986 wait complete. 2024-09-19T09:17:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:57.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:57.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:57.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.644 DEBUG:teuthology.orchestra.run.smithi086:osd.10> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:17:57.646 INFO:tasks.cephadm:Deploying osd.11 on smithi169 with /dev/vg_nvme/lv_1... 2024-09-19T09:17:57.646 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:17:57.893 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:57 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:57.893 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:57 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.893 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:57 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.902 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:17:57.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:57 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:57.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:57 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:57.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:57 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:58.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:57 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:58.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:57 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:58.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:57 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:17:59.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:17:59 smithi086 ceph-mon[34813]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:59.316 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:17:59 smithi169 ceph-mon[35454]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:17:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:17:59 smithi052 ceph-mon[30947]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:00.256 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:00 smithi086 ceph-mon[34813]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.256 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:00 smithi086 ceph-mon[34813]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.256 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:18:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:18:00.011+0000 7f5e5b73b640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:18:00.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:00 smithi169 ceph-mon[35454]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.396 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:00 smithi169 ceph-mon[35454]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:00 smithi052 ceph-mon[30947]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:00 smithi052 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:18:00.512 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-09-19T09:18:00.538 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi169:vg_nvme/lv_1 2024-09-19T09:18:00.790 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: osdmap e61: 11 total, 10 up, 11 in 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:01.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 -- 172.21.15.169:0/3688296478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60102660 msgr2=0x7f4c60104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 --2- 172.21.15.169:0/3688296478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60102660 0x7f4c60104a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009900 tx=0x7f4c5402a410 comp rx=0 tx=0).stop 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 -- 172.21.15.169:0/3688296478 shutdown_connections 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 --2- 172.21.15.169:0/3688296478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c601078c0 0x7f4c60109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 --2- 172.21.15.169:0/3688296478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c60104f90 0x7f4c60107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 --2- 172.21.15.169:0/3688296478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60102660 0x7f4c60104a50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 -- 172.21.15.169:0/3688296478 >> 172.21.15.169:0/3688296478 conn(0x7f4c600fc280 msgr2=0x7f4c600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 -- 172.21.15.169:0/3688296478 shutdown_connections 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.205+0000 7f4c661ed640 1 -- 172.21.15.169:0/3688296478 wait complete. 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 Processor -- start 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 -- start start 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 0x7f4c60197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c601078c0 0x7f4c6019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6010d890 con 0x7f4c60102660 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6010d710 con 0x7f4c601078c0 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c661ed640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6010da10 con 0x7f4c60104f90 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c5effd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:54106/0 (socket says 172.21.15.169:54106) 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c5effd640 1 -- 172.21.15.169:0/2884457763 learned_addr learned my addr 172.21.15.169:0/2884457763 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c5ffff640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c601078c0 0x7f4c6019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.206+0000 7f4c5f7fe640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 0x7f4c60197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 -- 172.21.15.169:0/2884457763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c601078c0 msgr2=0x7f4c6019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c601078c0 0x7f4c6019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 -- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 msgr2=0x7f4c60197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 0x7f4c60197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 -- 172.21.15.169:0/2884457763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6019fb50 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5f7fe640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 0x7f4c60197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5effd640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d740 tx=0x7f4c5000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50017070 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c5000de50 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50004e00 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6019fe40 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.207+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c601a02a0 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.208+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c600fdd70 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.210+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4c50004fa0 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.211+0000 7f4c5cff9640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 0x7f4c480a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.211+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6414+0+0 (secure 0 0 0) 0x7f4c500ceeb0 con 0x7f4c60104f90 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.211+0000 7f4c5f7fe640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 0x7f4c480a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.212+0000 7f4c5f7fe640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 0x7f4c480a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c54000c00 tx=0x7f4c54031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.214+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c500fe210 con 0x7f4c60104f90 2024-09-19T09:18:01.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:01.397+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4c60062630 con 0x7f4c480a3270 2024-09-19T09:18:01.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: osdmap e61: 11 total, 10 up, 11 in 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.433 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:01.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:01.434 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: osdmap e61: 11 total, 10 up, 11 in 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:02.181 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi086 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:18:02.182 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:02.183 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:02 smithi169 ceph-mon[35454]: from='osd.10 ' entity='osd.10' 2024-09-19T09:18:02.257 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:18:01.841+0000 7f5e57ed2640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:18:02.257 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:18:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:18:01.857+0000 7f5e4f4cd640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi086 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:02 smithi086 ceph-mon[34813]: from='osd.10 ' entity='osd.10' 2024-09-19T09:18:02.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi086 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 4272M 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:02.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:02 smithi052 ceph-mon[30947]: from='osd.10 ' entity='osd.10' 2024-09-19T09:18:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:18:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:18:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] boot 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: osdmap e63: 11 total, 11 up, 11 in 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:03 smithi052 ceph-mon[30947]: osdmap e64: 11 total, 11 up, 11 in 2024-09-19T09:18:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:18:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:18:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] boot 2024-09-19T09:18:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: osdmap e63: 11 total, 11 up, 11 in 2024-09-19T09:18:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:03 smithi169 ceph-mon[35454]: osdmap e64: 11 total, 11 up, 11 in 2024-09-19T09:18:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi169:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: osd.10 [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] boot 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: osdmap e63: 11 total, 11 up, 11 in 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:18:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:03 smithi086 ceph-mon[34813]: osdmap e64: 11 total, 11 up, 11 in 2024-09-19T09:18:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:05.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/2255724043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]': finished 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: osdmap e66: 12 total, 11 up, 12 in 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:05.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.169:0/3941436052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:18:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:18:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/2255724043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]': finished 2024-09-19T09:18:05.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: osdmap e66: 12 total, 11 up, 12 in 2024-09-19T09:18:05.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:05.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:04 smithi169 ceph-mon[35454]: from='client.? 172.21.15.169:0/3941436052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:18:05.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/2255724043' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]: dispatch 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a"}]': finished 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: osdmap e66: 12 total, 11 up, 12 in 2024-09-19T09:18:05.266 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:05.267 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:04 smithi086 ceph-mon[34813]: from='client.? 172.21.15.169:0/3941436052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:18:06.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:06 smithi052 ceph-mon[30947]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:18:06.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:06 smithi169 ceph-mon[35454]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:18:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:06.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:06 smithi086 ceph-mon[34813]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T09:18:06.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:07.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:07 smithi052 ceph-mon[30947]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:07.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:07 smithi052 ceph-mon[30947]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:18:07.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:07 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:07 smithi169 ceph-mon[35454]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:07 smithi169 ceph-mon[35454]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:18:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:07 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:07.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:07 smithi086 ceph-mon[34813]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:07.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:07 smithi086 ceph-mon[34813]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T09:18:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:07 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:09.187 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:09 smithi169 ceph-mon[35454]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:18:09.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:09 smithi052 ceph-mon[30947]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:18:09.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:09 smithi086 ceph-mon[34813]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 757 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:18:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:11 smithi052 ceph-mon[30947]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:18:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:11 smithi169 ceph-mon[35454]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:18:11.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:11 smithi086 ceph-mon[34813]: pgmap v227: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T09:18:13.354 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:13 smithi169 ceph-mon[35454]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T09:18:13.354 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:18:13.354 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:13 smithi052 ceph-mon[30947]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T09:18:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:18:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:13 smithi086 ceph-mon[34813]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T09:18:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:18:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:14.190 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:14 smithi169 ceph-mon[35454]: Deploying daemon osd.11 on smithi169 2024-09-19T09:18:14.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:14 smithi052 ceph-mon[30947]: Deploying daemon osd.11 on smithi169 2024-09-19T09:18:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:14 smithi086 ceph-mon[34813]: Deploying daemon osd.11 on smithi169 2024-09-19T09:18:15.330 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:15 smithi169 ceph-mon[35454]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T09:18:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:15 smithi052 ceph-mon[30947]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T09:18:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:15 smithi086 ceph-mon[34813]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T09:18:17.162 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:17 smithi169 ceph-mon[35454]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:18:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:17 smithi052 ceph-mon[30947]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:18:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:17 smithi086 ceph-mon[34813]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:18:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:19 smithi052 ceph-mon[30947]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:19 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:19 smithi169 ceph-mon[35454]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:19 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:19 smithi086 ceph-mon[34813]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:19 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:21.417 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:21 smithi169 ceph-mon[35454]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:21.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:21 smithi052 ceph-mon[30947]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:21.457 INFO:teuthology.orchestra.run.smithi169.stdout:Created osd(s) 11 on host 'smithi169' 2024-09-19T09:18:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.455+0000 7f4c5cff9640 1 -- 172.21.15.169:0/2884457763 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4c60062630 con 0x7f4c480a3270 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 msgr2=0x7f4c480a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 0x7f4c480a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4c54000c00 tx=0x7f4c54031400 comp rx=0 tx=0).stop 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 msgr2=0x7f4c60198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000d740 tx=0x7f4c5000dc00 comp rx=0 tx=0).stop 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 shutdown_connections 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c601078c0 0x7f4c6019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c480a3270 0x7f4c480a5730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c60104f90 0x7f4c60198460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 --2- 172.21.15.169:0/2884457763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c60102660 0x7f4c60197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 >> 172.21.15.169:0/2884457763 conn(0x7f4c600fc280 msgr2=0x7f4c60102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 shutdown_connections 2024-09-19T09:18:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:21.458+0000 7f4c661ed640 1 -- 172.21.15.169:0/2884457763 wait complete. 2024-09-19T09:18:21.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:21 smithi086 ceph-mon[34813]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:22.065 DEBUG:teuthology.orchestra.run.smithi169:osd.11> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:18:22.068 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:18:22.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:18:22.339 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:22.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:22 smithi169 ceph-mon[35454]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:22.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.714 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:22 smithi086 ceph-mon[34813]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:22.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.764 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:22 smithi052 ceph-mon[30947]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:22.764 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.764 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.764 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.764 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:22.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 -- 172.21.15.52:0/3948989394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d0102660 msgr2=0x7fd5d0104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/3948989394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d0102660 0x7fd5d0104a50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009900 tx=0x7fd5c002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 -- 172.21.15.52:0/3948989394 shutdown_connections 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/3948989394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d01078c0 0x7fd5d0109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/3948989394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/3948989394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d0102660 0x7fd5d0104a50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 -- 172.21.15.52:0/3948989394 >> 172.21.15.52:0/3948989394 conn(0x7fd5d00fc280 msgr2=0x7fd5d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 -- 172.21.15.52:0/3948989394 shutdown_connections 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.763+0000 7fd5d67a1640 1 -- 172.21.15.52:0/3948989394 wait complete. 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 Processor -- start 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 -- start start 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d0102660 0x7fd5d0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 0x7fd5d019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d010d870 con 0x7fd5d01078c0 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d010d6f0 con 0x7fd5d0102660 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d67a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d010d9f0 con 0x7fd5d0104f90 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5cf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5d4d3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 0x7fd5d019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5cf7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d01983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:36500/0 (socket says 172.21.15.52:36500) 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.764+0000 7fd5cf7fe640 1 -- 172.21.15.52:0/2333199043 learned_addr learned my addr 172.21.15.52:0/2333199043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:22.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5cffff640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d0102660 0x7fd5d0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 -- 172.21.15.52:0/2333199043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 msgr2=0x7fd5d01983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d01983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 -- 172.21.15.52:0/2333199043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d0102660 msgr2=0x7fd5d0197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d0102660 0x7fd5d0197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 -- 172.21.15.52:0/2333199043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d019fad0 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.765+0000 7fd5d4d3e640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 0x7fd5d019f460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800e940 tx=0x7fd5c800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.766+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8004d20 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.766+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5c8005020 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.766+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d01004b0 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.766+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80116b0 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.767+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d01009f0 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.767+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d00fdd70 con 0x7fd5d01078c0 2024-09-19T09:18:22.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.769+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd5c80054d0 con 0x7fd5d01078c0 2024-09-19T09:18:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.769+0000 7fd5cd7fa640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 0x7fd5b80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.769+0000 7fd5cffff640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 0x7fd5b80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.769+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6809+0+0 (secure 0 0 0) 0x7fd5c80cf3a0 con 0x7fd5d01078c0 2024-09-19T09:18:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.770+0000 7fd5cffff640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 0x7fd5b80a57b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0000c00 tx=0x7fd5c00315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:22.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.774+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5c8016030 con 0x7fd5d01078c0 2024-09-19T09:18:22.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.950+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd5d0101e30 con 0x7fd5d01078c0 2024-09-19T09:18:22.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.950+0000 7fd5cd7fa640 1 -- 172.21.15.52:0/2333199043 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fd5c809c6a0 con 0x7fd5d01078c0 2024-09-19T09:18:22.951 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 msgr2=0x7fd5b80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 0x7fd5b80a57b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0000c00 tx=0x7fd5c00315d0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 msgr2=0x7fd5d019f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 0x7fd5d019f460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800e940 tx=0x7fd5c800ee00 comp rx=0 tx=0).stop 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 shutdown_connections 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5d01078c0 0x7fd5d019f460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd5b80a32f0 0x7fd5b80a57b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.952+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5d0104f90 0x7fd5d01983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.953+0000 7fd5d67a1640 1 --2- 172.21.15.52:0/2333199043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5d0102660 0x7fd5d0197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.953+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 >> 172.21.15.52:0/2333199043 conn(0x7fd5d00fc280 msgr2=0x7fd5d0102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.953+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 shutdown_connections 2024-09-19T09:18:22.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:22.953+0000 7fd5d67a1640 1 -- 172.21.15.52:0/2333199043 wait complete. 2024-09-19T09:18:23.645 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:23 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2333199043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:23.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:23 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2333199043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:23.715 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726737482,"num_in_osds":12,"osd_in_since":1726737483,"num_remapped_pgs":0} 2024-09-19T09:18:23.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:23 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2333199043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:24.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:24 smithi052 ceph-mon[30947]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:24.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:18:24.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:24 smithi086 ceph-mon[34813]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:24.918 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:24 smithi169 ceph-mon[35454]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:24.918 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:18:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:18:24.692+0000 7f68ef0d6640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:18:24.979 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 -- 172.21.15.52:0/465409568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c102700 msgr2=0x7ff81c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 --2- 172.21.15.52:0/465409568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c102700 0x7ff81c104af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009ca0 tx=0x7ff80c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 -- 172.21.15.52:0/465409568 shutdown_connections 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 --2- 172.21.15.52:0/465409568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 0x7ff81c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 --2- 172.21.15.52:0/465409568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c105030 0x7ff81c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 --2- 172.21.15.52:0/465409568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c102700 0x7ff81c104af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 -- 172.21.15.52:0/465409568 >> 172.21.15.52:0/465409568 conn(0x7ff81c0fc280 msgr2=0x7ff81c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 -- 172.21.15.52:0/465409568 shutdown_connections 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 -- 172.21.15.52:0/465409568 wait complete. 2024-09-19T09:18:25.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.387+0000 7ff82175b640 1 Processor -- start 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 -- start start 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 0x7ff81c102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 0x7ff81c100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10d880 con 0x7ff81c105030 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10d700 con 0x7ff81c102700 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff82175b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10da00 con 0x7ff81c107960 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48178/0 (socket says 172.21.15.52:48178) 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 -- 172.21.15.52:0/2678366086 learned_addr learned my addr 172.21.15.52:0/2678366086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81affd640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 0x7ff81c102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81b7fe640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 0x7ff81c100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 -- 172.21.15.52:0/2678366086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 msgr2=0x7ff81c100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 0x7ff81c100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 -- 172.21.15.52:0/2678366086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 msgr2=0x7ff81c102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 0x7ff81c102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81a7fc640 1 -- 172.21.15.52:0/2678366086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c1014b0 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.388+0000 7ff81affd640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 0x7ff81c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff81a7fc640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c970 tx=0x7ff81000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810014070 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c1a2060 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff810004440 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81000f450 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.389+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c1a2570 con 0x7ff81c105030 2024-09-19T09:18:25.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.390+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c0fdd70 con 0x7ff81c105030 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.391+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff810017070 con 0x7ff81c105030 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.392+0000 7ff803fff640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 0x7ff8040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.392+0000 7ff81affd640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 0x7ff8040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.392+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6809+0+0 (secure 0 0 0) 0x7ff8100cf150 con 0x7ff81c105030 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.392+0000 7ff81affd640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 0x7ff8040a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff80c031c10 tx=0x7ff80c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.396+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff81001e020 con 0x7ff81c105030 2024-09-19T09:18:25.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.582+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff81c02da10 con 0x7ff81c105030 2024-09-19T09:18:25.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.583+0000 7ff803fff640 1 -- 172.21.15.52:0/2678366086 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7ff81009c450 con 0x7ff81c105030 2024-09-19T09:18:25.583 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:25.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 msgr2=0x7ff8040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 0x7ff8040a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff80c031c10 tx=0x7ff80c009360 comp rx=0 tx=0).stop 2024-09-19T09:18:25.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 msgr2=0x7ff81c1006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c970 tx=0x7ff81000ce30 comp rx=0 tx=0).stop 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 shutdown_connections 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8040a3240 0x7ff8040a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff81c107960 0x7ff81c100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff81c105030 0x7ff81c1006b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 --2- 172.21.15.52:0/2678366086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff81c102700 0x7ff81c102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 >> 172.21.15.52:0/2678366086 conn(0x7ff81c0fc280 msgr2=0x7ff81c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 shutdown_connections 2024-09-19T09:18:25.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:25.585+0000 7ff82175b640 1 -- 172.21.15.52:0/2678366086 wait complete. 2024-09-19T09:18:25.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:25 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:25.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:25.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:25 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:18:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:25.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:25 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:26.183 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726737482,"num_in_osds":12,"osd_in_since":1726737483,"num_remapped_pgs":0} 2024-09-19T09:18:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: Detected new or changed devices on smithi169 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2678366086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:26.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: Detected new or changed devices on smithi169 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:26.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:26.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:26.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2678366086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:26.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: Detected new or changed devices on smithi169 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 4272M 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]: dispatch 2024-09-19T09:18:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:26.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:26.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:26.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:26.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2678366086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:27.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:18:27.453 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:27.692 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:18:27.255+0000 7f68ea836640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:18:27.692 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:18:27.270+0000 7f68e2e68640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:18:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-mon[35454]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:18:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-mon[35454]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:18:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:27 smithi169 ceph-mon[35454]: from='osd.11 ' entity='osd.11' 2024-09-19T09:18:27.729 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:27 smithi052 ceph-mon[30947]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:18:27.729 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:27 smithi052 ceph-mon[30947]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:18:27.729 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:27 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.729 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:27 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.729 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:27 smithi052 ceph-mon[30947]: from='osd.11 ' entity='osd.11' 2024-09-19T09:18:27.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:27 smithi086 ceph-mon[34813]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi169", "root=default"]}]': finished 2024-09-19T09:18:27.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:27 smithi086 ceph-mon[34813]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:18:27.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:27 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:27 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:27.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:27 smithi086 ceph-mon[34813]: from='osd.11 ' entity='osd.11' 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 -- 172.21.15.52:0/2128303392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 msgr2=0x7ff240103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 --2- 172.21.15.52:0/2128303392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff240103280 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff230009900 tx=0x7ff23002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 -- 172.21.15.52:0/2128303392 shutdown_connections 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 --2- 172.21.15.52:0/2128303392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2401037c0 0x7ff24010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 --2- 172.21.15.52:0/2128303392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff240103280 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 --2- 172.21.15.52:0/2128303392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff240101c00 0x7ff240102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 -- 172.21.15.52:0/2128303392 >> 172.21.15.52:0/2128303392 conn(0x7ff2400fd390 msgr2=0x7ff2400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 -- 172.21.15.52:0/2128303392 shutdown_connections 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.937+0000 7ff248292640 1 -- 172.21.15.52:0/2128303392 wait complete. 2024-09-19T09:18:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 Processor -- start 2024-09-19T09:18:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 -- start start 2024-09-19T09:18:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 0x7ff24019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 0x7ff2401a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010d880 con 0x7ff240102e00 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010d700 con 0x7ff240101c00 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff248292640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010da00 con 0x7ff2401037c0 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff24582d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff24582d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48196/0 (socket says 172.21.15.52:48196) 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.938+0000 7ff24582d640 1 -- 172.21.15.52:0/4149984977 learned_addr learned my addr 172.21.15.52:0/4149984977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24682f640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 0x7ff2401a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24602e640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 0x7ff24019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 -- 172.21.15.52:0/4149984977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 msgr2=0x7ff2401a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 0x7ff2401a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 -- 172.21.15.52:0/4149984977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 msgr2=0x7ff24019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 0x7ff24019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 -- 172.21.15.52:0/4149984977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2401a1d50 con 0x7ff240102e00 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24602e640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 0x7ff24019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24682f640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 0x7ff2401a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff24582d640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff230009230 tx=0x7ff2300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23003f030 con 0x7ff240102e00 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff230003ce0 con 0x7ff240102e00 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2401a1fe0 con 0x7ff240102e00 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230035070 con 0x7ff240102e00 2024-09-19T09:18:27.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.939+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2401a2440 con 0x7ff240102e00 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.941+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2401a2730 con 0x7ff240102e00 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.942+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff230042030 con 0x7ff240102e00 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.942+0000 7ff2377fe640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 0x7ff22c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.942+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6847+0+0 (secure 0 0 0) 0x7ff2300ef850 con 0x7ff240102e00 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.942+0000 7ff24602e640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 0x7ff22c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.943+0000 7ff24602e640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 0x7ff22c0a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff240102c60 tx=0x7ff23c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:27.946+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2300bcb30 con 0x7ff240102e00 2024-09-19T09:18:28.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.123+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff2401a2db0 con 0x7ff240102e00 2024-09-19T09:18:28.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.124+0000 7ff2377fe640 1 -- 172.21.15.52:0/4149984977 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7ff2300bc430 con 0x7ff240102e00 2024-09-19T09:18:28.125 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 msgr2=0x7ff22c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 0x7ff22c0a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff240102c60 tx=0x7ff23c005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 msgr2=0x7ff24019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff230009230 tx=0x7ff2300042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 shutdown_connections 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff22c0a32f0 0x7ff22c0a57b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2401037c0 0x7ff2401a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff240102e00 0x7ff24019a660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 --2- 172.21.15.52:0/4149984977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff240101c00 0x7ff24019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 >> 172.21.15.52:0/4149984977 conn(0x7ff2400fd390 msgr2=0x7ff240074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 shutdown_connections 2024-09-19T09:18:28.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:28.126+0000 7ff248292640 1 -- 172.21.15.52:0/4149984977 wait complete. 2024-09-19T09:18:28.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: purged_snaps scrub starts 2024-09-19T09:18:28.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: purged_snaps scrub ok 2024-09-19T09:18:28.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:28.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:28.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4149984977' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:28.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] boot 2024-09-19T09:18:28.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: osdmap e71: 12 total, 12 up, 12 in 2024-09-19T09:18:28.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:28.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: purged_snaps scrub starts 2024-09-19T09:18:28.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: purged_snaps scrub ok 2024-09-19T09:18:28.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:28.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:28.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4149984977' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:28.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] boot 2024-09-19T09:18:28.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: osdmap e71: 12 total, 12 up, 12 in 2024-09-19T09:18:28.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:28.796 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726737482,"num_in_osds":12,"osd_in_since":1726737483,"num_remapped_pgs":0} 2024-09-19T09:18:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: purged_snaps scrub starts 2024-09-19T09:18:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: purged_snaps scrub ok 2024-09-19T09:18:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:18:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4149984977' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:28.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: osd.11 [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] boot 2024-09-19T09:18:28.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: osdmap e71: 12 total, 12 up, 12 in 2024-09-19T09:18:28.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:18:29.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:18:30.068 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 -- 172.21.15.52:0/94359920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 msgr2=0x7fb32c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 --2- 172.21.15.52:0/94359920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c102000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb328009900 tx=0x7fb32802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 -- 172.21.15.52:0/94359920 shutdown_connections 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 --2- 172.21.15.52:0/94359920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb32c1037c0 0x7fb32c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 --2- 172.21.15.52:0/94359920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 0x7fb32c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 --2- 172.21.15.52:0/94359920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c102000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 -- 172.21.15.52:0/94359920 >> 172.21.15.52:0/94359920 conn(0x7fb32c0fd390 msgr2=0x7fb32c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 -- 172.21.15.52:0/94359920 shutdown_connections 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.466+0000 7fb334270640 1 -- 172.21.15.52:0/94359920 wait complete. 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 Processor -- start 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 -- start start 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 0x7fb32c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb32c1037c0 0x7fb32c19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10d9b0 con 0x7fb32c101c00 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10d830 con 0x7fb32c102e00 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb334270640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c10db30 con 0x7fb32c1037c0 2024-09-19T09:18:30.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34194/0 (socket says 172.21.15.52:34194) 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 -- 172.21.15.52:0/2668649836 learned_addr learned my addr 172.21.15.52:0/2668649836 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33180b640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 0x7fb32c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 -- 172.21.15.52:0/2668649836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb32c1037c0 msgr2=0x7fb32c19f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb32c1037c0 0x7fb32c19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 -- 172.21.15.52:0/2668649836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 msgr2=0x7fb32c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 0x7fb32c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.467+0000 7fb33200c640 1 -- 172.21.15.52:0/2668649836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c19fca0 con 0x7fb32c101c00 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb33200c640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb32802aa00 tx=0x7fb328032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32803f030 con 0x7fb32c101c00 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328003ce0 con 0x7fb32c101c00 2024-09-19T09:18:30.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c074420 con 0x7fb32c101c00 2024-09-19T09:18:30.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328035070 con 0x7fb32c101c00 2024-09-19T09:18:30.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.468+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c074980 con 0x7fb32c101c00 2024-09-19T09:18:30.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.469+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32c1090a0 con 0x7fb32c101c00 2024-09-19T09:18:30.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.470+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb328042030 con 0x7fb32c101c00 2024-09-19T09:18:30.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.471+0000 7fb3237fe640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 0x7fb3180a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.471+0000 7fb33180b640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 0x7fb3180a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.471+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fb3280ef890 con 0x7fb32c101c00 2024-09-19T09:18:30.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.471+0000 7fb33180b640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 0x7fb3180a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb32c199590 tx=0x7fb31c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.475+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3280bc9b0 con 0x7fb32c101c00 2024-09-19T09:18:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.651+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb32c075e20 con 0x7fb32c101c00 2024-09-19T09:18:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.652+0000 7fb3237fe640 1 -- 172.21.15.52:0/2668649836 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fb3280b6e20 con 0x7fb32c101c00 2024-09-19T09:18:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 msgr2=0x7fb3180a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 0x7fb3180a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb32c199590 tx=0x7fb31c009110 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 msgr2=0x7fb32c198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb32802aa00 tx=0x7fb328032da0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 shutdown_connections 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3180a3270 0x7fb3180a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb32c1037c0 0x7fb32c19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb32c102e00 0x7fb32c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 --2- 172.21.15.52:0/2668649836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb32c101c00 0x7fb32c198070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 >> 172.21.15.52:0/2668649836 conn(0x7fb32c0fd390 msgr2=0x7fb32c106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 shutdown_connections 2024-09-19T09:18:30.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:30.654+0000 7fb334270640 1 -- 172.21.15.52:0/2668649836 wait complete. 2024-09-19T09:18:30.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:30 smithi086 ceph-mon[34813]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:30.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:30 smithi086 ceph-mon[34813]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:18:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:30 smithi052 ceph-mon[30947]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:30.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:30 smithi052 ceph-mon[30947]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:18:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:30 smithi169 ceph-mon[35454]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:30 smithi169 ceph-mon[35454]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T09:18:31.389 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1726737508,"num_in_osds":12,"osd_in_since":1726737483,"num_remapped_pgs":0} 2024-09-19T09:18:31.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:18:31.650 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:31.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:31 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2668649836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:31.770 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:31 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2668649836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:31.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:31 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2668649836' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 -- 172.21.15.52:0/152053965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 msgr2=0x7f4434101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 --2- 172.21.15.52:0/152053965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434101200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4424009900 tx=0x7f442402a480 comp rx=0 tx=0).stop 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 -- 172.21.15.52:0/152053965 shutdown_connections 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 --2- 172.21.15.52:0/152053965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102ef0 0x7f443410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 --2- 172.21.15.52:0/152053965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102570 0x7f44341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 --2- 172.21.15.52:0/152053965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434101200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 -- 172.21.15.52:0/152053965 >> 172.21.15.52:0/152053965 conn(0x7f44340fc7d0 msgr2=0x7f44340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 -- 172.21.15.52:0/152053965 shutdown_connections 2024-09-19T09:18:32.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.067+0000 7f443ab56640 1 -- 172.21.15.52:0/152053965 wait complete. 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 Processor -- start 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 -- start start 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 0x7f4434198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 0x7f443419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4434110fc0 con 0x7f4434100e20 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4434110e40 con 0x7f4434102570 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f443ab56640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4434111140 con 0x7f4434102ef0 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34212/0 (socket says 172.21.15.52:34212) 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 -- 172.21.15.52:0/3562254658 learned_addr learned my addr 172.21.15.52:0/3562254658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:32.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f4433fff640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 0x7f4434198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 -- 172.21.15.52:0/3562254658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 msgr2=0x7f443419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44390f3640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 0x7f443419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 0x7f443419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 -- 172.21.15.52:0/3562254658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 msgr2=0x7f4434198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 0x7f4434198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44388f2640 1 -- 172.21.15.52:0/3562254658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443419d540 con 0x7f4434100e20 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f4433fff640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 0x7f4434198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.068+0000 7f44390f3640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 0x7f443419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f44388f2640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4424006010 tx=0x7f4424003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442403f070 con 0x7f4434100e20 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4424031c30 con 0x7f4434100e20 2024-09-19T09:18:32.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443419d7d0 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4424035030 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.069+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44341a5110 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.070+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4434101200 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.071+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4424042070 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.072+0000 7f4431ffb640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 0x7f441c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.072+0000 7f4433fff640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 0x7f441c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.072+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f44240efd90 con 0x7f4434100e20 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.072+0000 7f4433fff640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 0x7f441c0a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44340ffee0 tx=0x7f4428005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:32.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.076+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4424031de0 con 0x7f4434100e20 2024-09-19T09:18:32.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.253+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44341a5340 con 0x7f4434100e20 2024-09-19T09:18:32.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.254+0000 7f4431ffb640 1 -- 172.21.15.52:0/3562254658 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18441 (secure 0 0 0) 0x7f44240bcf50 con 0x7f4434100e20 2024-09-19T09:18:32.256 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:32.256 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":72,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:18:29.473046+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 msgr2=0x7f441c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 0x7f441c0a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f44340ffee0 tx=0x7f4428005e50 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 msgr2=0x7f4434198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4424006010 tx=0x7f4424003c10 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 shutdown_connections 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f441c0a3240 0x7f441c0a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4434102ef0 0x7f443419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4434102570 0x7f4434198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 --2- 172.21.15.52:0/3562254658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4434100e20 0x7f4434198590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 >> 172.21.15.52:0/3562254658 conn(0x7f44340fc7d0 msgr2=0x7f443406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 shutdown_connections 2024-09-19T09:18:32.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:32.256+0000 7f443ab56640 1 -- 172.21.15.52:0/3562254658 wait complete. 2024-09-19T09:18:32.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:32 smithi086 ceph-mon[34813]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:32.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:32 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3562254658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:32.899 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:32 smithi052 ceph-mon[30947]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:32.899 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:32 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3562254658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:32.931 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:14:47.724048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:18:32.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:18:32.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:32 smithi169 ceph-mon[35454]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:32.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:32 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3562254658' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:33.186 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/766426129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8103700 msgr2=0x7fe9e810bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/766426129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8103700 0x7fe9e810bbf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009900 tx=0x7fe9dc02a480 comp rx=0 tx=0).stop 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/766426129 shutdown_connections 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/766426129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e810c180 0x7fe9e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/766426129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8103700 0x7fe9e810bbf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/766426129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e8102de0 0x7fe9e81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/766426129 >> 172.21.15.52:0/766426129 conn(0x7fe9e80fc7a0 msgr2=0x7fe9e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/766426129 shutdown_connections 2024-09-19T09:18:33.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/766426129 wait complete. 2024-09-19T09:18:33.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.637+0000 7fe9ecc3e640 1 Processor -- start 2024-09-19T09:18:33.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 -- start start 2024-09-19T09:18:33.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 0x7fe9e8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e810c180 0x7fe9e819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8111f70 con 0x7fe9e8102de0 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8111df0 con 0x7fe9e810c180 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9ecc3e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e81120f0 con 0x7fe9e8103700 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34244/0 (socket says 172.21.15.52:34244) 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 -- 172.21.15.52:0/2928545980 learned_addr learned my addr 172.21.15.52:0/2928545980 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e5d9b640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 0x7fe9e8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e6d9d640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e810c180 0x7fe9e819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 -- 172.21.15.52:0/2928545980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 msgr2=0x7fe9e8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 0x7fe9e8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 -- 172.21.15.52:0/2928545980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e810c180 msgr2=0x7fe9e819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e810c180 0x7fe9e819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 -- 172.21.15.52:0/2928545980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e819d3c0 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e5d9b640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 0x7fe9e8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.638+0000 7fe9e659c640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c890 tx=0x7fe9d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.639+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8004220 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.639+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9d80043c0 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.639+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e819d6b0 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.639+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80049e0 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.639+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e81a4f90 con 0x7fe9e8102de0 2024-09-19T09:18:33.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.640+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e81031c0 con 0x7fe9e8102de0 2024-09-19T09:18:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.641+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe9d80079b0 con 0x7fe9e8102de0 2024-09-19T09:18:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.642+0000 7fe9d77fe640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 0x7fe9d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.642+0000 7fe9e5d9b640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 0x7fe9d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.642+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe9d80cf4f0 con 0x7fe9e8102de0 2024-09-19T09:18:33.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.642+0000 7fe9e5d9b640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 0x7fe9d00a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80feda0 tx=0x7fe9dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:33.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.646+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9d8014030 con 0x7fe9e8102de0 2024-09-19T09:18:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.820+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe9e802d7c0 con 0x7fe9e8102de0 2024-09-19T09:18:33.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.820+0000 7fe9d77fe640 1 -- 172.21.15.52:0/2928545980 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fe9d809c6b0 con 0x7fe9e8102de0 2024-09-19T09:18:33.822 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-19T09:18:33.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 msgr2=0x7fe9d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 0x7fe9d00a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe9e80feda0 tx=0x7fe9dc005a20 comp rx=0 tx=0).stop 2024-09-19T09:18:33.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 msgr2=0x7fe9e8198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800c890 tx=0x7fe9d800cd50 comp rx=0 tx=0).stop 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 shutdown_connections 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9e810c180 0x7fe9e819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9d00a32c0 0x7fe9d00a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9e8103700 0x7fe9e8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 --2- 172.21.15.52:0/2928545980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9e8102de0 0x7fe9e8198410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 >> 172.21.15.52:0/2928545980 conn(0x7fe9e80fc7a0 msgr2=0x7fe9e80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 shutdown_connections 2024-09-19T09:18:33.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:33.822+0000 7fe9ecc3e640 1 -- 172.21.15.52:0/2928545980 wait complete. 2024-09-19T09:18:34.461 INFO:tasks.cephadm:Adding mds.a on smithi052 2024-09-19T09:18:34.461 INFO:tasks.cephadm:Adding mds.d on smithi052 2024-09-19T09:18:34.461 INFO:tasks.cephadm:Adding mds.g on smithi052 2024-09-19T09:18:34.461 INFO:tasks.cephadm:Adding mds.j on smithi052 2024-09-19T09:18:34.461 INFO:tasks.cephadm:Adding mds.b on smithi086 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.e on smithi086 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.h on smithi086 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.k on smithi086 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.c on smithi169 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.f on smithi169 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.i on smithi169 2024-09-19T09:18:34.462 INFO:tasks.cephadm:Adding mds.l on smithi169 2024-09-19T09:18:34.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l' 2024-09-19T09:18:34.724 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:18:34.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:34 smithi086 ceph-mon[34813]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:34.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:34 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2928545980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:34.844 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:34 smithi169 ceph-mon[35454]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:34.845 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:34 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2928545980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:34.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:34 smithi052 ceph-mon[30947]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:34.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:34 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2928545980' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:35.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 -- 172.21.15.169:0/201580876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034101cd0 msgr2=0x7f3034102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 --2- 172.21.15.169:0/201580876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034101cd0 0x7f3034102150 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3028009900 tx=0x7f302802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 -- 172.21.15.169:0/201580876 shutdown_connections 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 --2- 172.21.15.169:0/201580876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034102690 0x7f3034108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 --2- 172.21.15.169:0/201580876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034101cd0 0x7f3034102150 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 --2- 172.21.15.169:0/201580876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 0x7f3034100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 -- 172.21.15.169:0/201580876 >> 172.21.15.169:0/201580876 conn(0x7f30340fc280 msgr2=0x7f30340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 -- 172.21.15.169:0/201580876 shutdown_connections 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.147+0000 7f303950f640 1 -- 172.21.15.169:0/201580876 wait complete. 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 Processor -- start 2024-09-19T09:18:35.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 -- start start 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 0x7f303406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 0x7f303419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f303410c730 con 0x7f3034101cd0 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f303410c5b0 con 0x7f3034100ad0 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f303950f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f303410c8b0 con 0x7f3034102690 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f30337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f30337fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:50806/0 (socket says 172.21.15.169:50806) 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f30337fe640 1 -- 172.21.15.169:0/2057051281 learned_addr learned my addr 172.21.15.169:0/2057051281 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f3032ffd640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 0x7f303406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.148+0000 7f30327fc640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 0x7f303419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 -- 172.21.15.169:0/2057051281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 msgr2=0x7f303406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 0x7f303406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 -- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 msgr2=0x7f303419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 0x7f303419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 -- 172.21.15.169:0/2057051281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303419fa50 con 0x7f3034102690 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30327fc640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 0x7f303419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f30337fe640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f302c00eaa0 tx=0x7f302c00ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c00cdb0 con 0x7f3034102690 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3034196970 con 0x7f3034102690 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f302c005020 con 0x7f3034102690 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0116b0 con 0x7f3034102690 2024-09-19T09:18:35.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.149+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3034196e80 con 0x7f3034102690 2024-09-19T09:18:35.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.150+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3034107e80 con 0x7f3034102690 2024-09-19T09:18:35.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.151+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f302c005560 con 0x7f3034102690 2024-09-19T09:18:35.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.152+0000 7f301bfff640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 0x7f301c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.152+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f302c0cfab0 con 0x7f3034102690 2024-09-19T09:18:35.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.152+0000 7f3032ffd640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 0x7f301c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.153+0000 7f3032ffd640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 0x7f301c0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f303406b050 tx=0x7f3024005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.155+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f302c016030 con 0x7f3034102690 2024-09-19T09:18:35.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.341+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}) -- 0x7f3034198430 con 0x7f301c0a3240 2024-09-19T09:18:35.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.349+0000 7f301bfff640 1 -- 172.21.15.169:0/2057051281 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3034198430 con 0x7f301c0a3240 2024-09-19T09:18:35.350 INFO:teuthology.orchestra.run.smithi169.stdout:Scheduled mds.all update... 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.351+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 msgr2=0x7f301c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.351+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 0x7f301c0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f303406b050 tx=0x7f3024005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.351+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 msgr2=0x7f303419f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.351+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f302c00eaa0 tx=0x7f302c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 shutdown_connections 2024-09-19T09:18:35.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f301c0a3240 0x7f301c0a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3034102690 0x7f303419f190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3034101cd0 0x7f303419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 --2- 172.21.15.169:0/2057051281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3034100ad0 0x7f303406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 >> 172.21.15.169:0/2057051281 conn(0x7f30340fc280 msgr2=0x7f3034105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 shutdown_connections 2024-09-19T09:18:35.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-09-19T09:18:35.352+0000 7f303950f640 1 -- 172.21.15.169:0/2057051281 wait complete. 2024-09-19T09:18:36.188 DEBUG:teuthology.orchestra.run.smithi052:mds.a> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:18:36.191 DEBUG:teuthology.orchestra.run.smithi052:mds.d> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:18:36.234 DEBUG:teuthology.orchestra.run.smithi052:mds.g> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:18:36.277 DEBUG:teuthology.orchestra.run.smithi052:mds.j> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:18:36.320 DEBUG:teuthology.orchestra.run.smithi086:mds.b> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:18:36.323 DEBUG:teuthology.orchestra.run.smithi086:mds.e> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:18:36.366 DEBUG:teuthology.orchestra.run.smithi086:mds.h> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:18:36.408 DEBUG:teuthology.orchestra.run.smithi086:mds.k> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:18:36.411 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: Saving service mds.all spec with placement smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.412 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:36 smithi169 ceph-mon[35454]: Deploying daemon mds.l on smithi169 2024-09-19T09:18:36.453 DEBUG:teuthology.orchestra.run.smithi169:mds.c> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:18:36.455 DEBUG:teuthology.orchestra.run.smithi169:mds.f> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:18:36.498 DEBUG:teuthology.orchestra.run.smithi169:mds.i> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:18:36.542 DEBUG:teuthology.orchestra.run.smithi169:mds.l> sudo journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:18:36.585 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:18:36.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:36.609 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: Saving service mds.all spec with placement smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.610 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:36 smithi052 ceph-mon[30947]: Deploying daemon mds.l on smithi169 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: Saving service mds.all spec with placement smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:36.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:36 smithi086 ceph-mon[34813]: Deploying daemon mds.l on smithi169 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 -- 172.21.15.52:0/232640102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0106f10 msgr2=0x7f05d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 --2- 172.21.15.52:0/232640102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0106f10 0x7f05d010ea90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009ca0 tx=0x7f05c802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 -- 172.21.15.52:0/232640102 shutdown_connections 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 --2- 172.21.15.52:0/232640102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0106f10 0x7f05d010ea90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 --2- 172.21.15.52:0/232640102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0102790 0x7f05d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 --2- 172.21.15.52:0/232640102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d0101de0 0x7f05d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 -- 172.21.15.52:0/232640102 >> 172.21.15.52:0/232640102 conn(0x7f05d00fd8c0 msgr2=0x7f05d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 -- 172.21.15.52:0/232640102 shutdown_connections 2024-09-19T09:18:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.303+0000 7f05d5a61640 1 -- 172.21.15.52:0/232640102 wait complete. 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 Processor -- start 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 -- start start 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0101de0 0x7f05d01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d0106f10 0x7f05d019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05d0111f70 con 0x7f05d0102790 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05d0111df0 con 0x7f05d0106f10 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05d5a61640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05d01120f0 con 0x7f05d0101de0 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05ce7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05ce7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34254/0 (socket says 172.21.15.52:34254) 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05ceffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0101de0 0x7f05d01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:37.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.304+0000 7f05ce7fc640 1 -- 172.21.15.52:0/3703238065 learned_addr learned my addr 172.21.15.52:0/3703238065 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 -- 172.21.15.52:0/3703238065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0101de0 msgr2=0x7f05d01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0101de0 0x7f05d01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 -- 172.21.15.52:0/3703238065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d0106f10 msgr2=0x7f05d019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d0106f10 0x7f05d019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 -- 172.21.15.52:0/3703238065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d019d3a0 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05ce7fc640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e9f0 tx=0x7f05c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400cd80 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d019d690 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05c4005500 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4010690 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.305+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d01a4f70 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.306+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d01021c0 con 0x7f05d0102790 2024-09-19T09:18:37.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.307+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f05c40046c0 con 0x7f05d0102790 2024-09-19T09:18:37.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.308+0000 7f05d4a5f640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:37.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.308+0000 7f05ceffd640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:37.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.308+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f05c40cf8c0 con 0x7f05d0102790 2024-09-19T09:18:37.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.308+0000 7f05ceffd640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 0x7f05b80a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05c0005d00 tx=0x7f05c000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:37.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.312+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05c409ca80 con 0x7f05d0102790 2024-09-19T09:18:37.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.525+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05d002d7c0 con 0x7f05d0102790 2024-09-19T09:18:37.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.525+0000 7f05d4a5f640 1 -- 172.21.15.52:0/3703238065 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f05c409c380 con 0x7f05d0102790 2024-09-19T09:18:37.527 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:37.527 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"btime":"2024-09-19T09:11:37:433536+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:18:37.527 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 1 2024-09-19T09:18:37.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 msgr2=0x7f05b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 0x7f05b80a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05c0005d00 tx=0x7f05c000b410 comp rx=0 tx=0).stop 2024-09-19T09:18:37.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 msgr2=0x7f05d0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e9f0 tx=0x7f05c400edf0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 shutdown_connections 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05d0106f10 0x7f05d019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05d0102790 0x7f05d0198930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05b80a3240 0x7f05b80a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 --2- 172.21.15.52:0/3703238065 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05d0101de0 0x7f05d01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 >> 172.21.15.52:0/3703238065 conn(0x7f05d00fd8c0 msgr2=0x7f05d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 shutdown_connections 2024-09-19T09:18:37.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:37.528+0000 7f05d5a61640 1 -- 172.21.15.52:0/3703238065 wait complete. 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3703238065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6832/3295968296,v1:172.21.15.169:6833/3295968296] up:boot 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: fsmap 1 up:standby 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:38.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3703238065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6832/3295968296,v1:172.21.15.169:6833/3295968296] up:boot 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: fsmap 1 up:standby 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:38.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:38.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3703238065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6832/3295968296,v1:172.21.15.169:6833/3295968296] up:boot 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: fsmap 1 up:standby 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:39.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:39.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:39.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:39 smithi052 ceph-mon[30947]: Deploying daemon mds.k on smithi086 2024-09-19T09:18:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:39 smithi169 ceph-mon[35454]: Deploying daemon mds.k on smithi086 2024-09-19T09:18:39.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:39.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:39.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:39 smithi086 ceph-mon[34813]: Deploying daemon mds.k on smithi086 2024-09-19T09:18:40.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:40.364 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 systemd[1]: Starting Ceph mds.k for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:40.457 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:40.578 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:40 smithi052 ceph-mon[30947]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:40.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:40 smithi169 ceph-mon[35454]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:40.707 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:40 smithi086 ceph-mon[34813]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:40.707 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 podman[64392]: 2024-09-19 09:18:40.397648164 +0000 UTC m=+0.015807445 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:40.707 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 podman[64392]: 2024-09-19 09:18:40.496622048 +0000 UTC m=+0.114781367 container create dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:18:40.707 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 podman[64392]: 2024-09-19 09:18:40.707135283 +0000 UTC m=+0.325294561 container init dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 -- 172.21.15.52:0/1433860597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0790101270 msgr2=0x7f079010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 --2- 172.21.15.52:0/1433860597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0790101270 0x7f079010d7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0788009cd0 tx=0x7f078802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 -- 172.21.15.52:0/1433860597 shutdown_connections 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 --2- 172.21.15.52:0/1433860597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0790101270 0x7f079010d7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 --2- 172.21.15.52:0/1433860597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f07901008d0 0x7f0790100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 --2- 172.21.15.52:0/1433860597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07901068d0 0x7f0790106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 -- 172.21.15.52:0/1433860597 >> 172.21.15.52:0/1433860597 conn(0x7f07900fc610 msgr2=0x7f07900fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 -- 172.21.15.52:0/1433860597 shutdown_connections 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.849+0000 7f07955a2640 1 -- 172.21.15.52:0/1433860597 wait complete. 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 Processor -- start 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 -- start start 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 0x7f07901976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07901068d0 0x7f079019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0790110cd0 con 0x7f07901008d0 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0790110b50 con 0x7f0790101270 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f07955a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0790110e50 con 0x7f07901068d0 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f078ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f078ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50452/0 (socket says 172.21.15.52:50452) 2024-09-19T09:18:40.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f078ffff640 1 -- 172.21.15.52:0/96353007 learned_addr learned my addr 172.21.15.52:0/96353007 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.850+0000 7f0787fff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 0x7f07901976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f0787fff640 1 -- 172.21.15.52:0/96353007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07901068d0 msgr2=0x7f079019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f0787fff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07901068d0 0x7f079019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f0787fff640 1 -- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 msgr2=0x7f0790197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f0787fff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f0787fff640 1 -- 172.21.15.52:0/96353007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079019c120 con 0x7f0790101270 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.851+0000 7f078ffff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f0787fff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 0x7f07901976b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f077800e9f0 tx=0x7f077800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077800ccc0 con 0x7f0790101270 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778010910 con 0x7f0790101270 2024-09-19T09:18:40.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079019c410 con 0x7f0790101270 2024-09-19T09:18:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778018960 con 0x7f0790101270 2024-09-19T09:18:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.852+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0790069f70 con 0x7f0790101270 2024-09-19T09:18:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.854+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0790100d30 con 0x7f0790101270 2024-09-19T09:18:40.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.854+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0778010430 con 0x7f0790101270 2024-09-19T09:18:40.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.855+0000 7f078dffb640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 0x7f077c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.855+0000 7f078ffff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 0x7f077c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.855+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f07780cf8c0 con 0x7f0790101270 2024-09-19T09:18:40.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.856+0000 7f078ffff640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 0x7f077c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07800094d0 tx=0x7f078000d620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:40.864+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f077809ca60 con 0x7f0790101270 2024-09-19T09:18:41.007 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 podman[64392]: 2024-09-19 09:18:40.710059244 +0000 UTC m=+0.328218527 container start dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:41.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 ceph-mds[64411]: -- 172.21.15.86:0/4237268531 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c796fb1860 con 0x55c796f8f000 2024-09-19T09:18:41.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k[64407]: starting mds.k at 2024-09-19T09:18:41.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 bash[64392]: dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 2024-09-19T09:18:41.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:18:40 smithi086 systemd[1]: Started Ceph mds.k for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.079+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f079006aa20 con 0x7f0790101270 2024-09-19T09:18:41.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.080+0000 7f078dffb640 1 -- 172.21.15.52:0/96353007 <== mon.2 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f077809c360 con 0x7f0790101270 2024-09-19T09:18:41.082 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:41.082 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"btime":"2024-09-19T09:18:38:210949+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:18:41.082 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 msgr2=0x7f077c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 0x7f077c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f07800094d0 tx=0x7f078000d620 comp rx=0 tx=0).stop 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 msgr2=0x7f07901976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 0x7f07901976b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f077800e9f0 tx=0x7f077800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 shutdown_connections 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f077c0a32c0 0x7f077c0a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f07901068d0 0x7f079019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0790101270 0x7f07901976b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.082+0000 7f07955a2640 1 --2- 172.21.15.52:0/96353007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07901008d0 0x7f0790197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.083+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 >> 172.21.15.52:0/96353007 conn(0x7f07900fc610 msgr2=0x7f07900fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.083+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 shutdown_connections 2024-09-19T09:18:41.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:41.083+0000 7f07955a2640 1 -- 172.21.15.52:0/96353007 wait complete. 2024-09-19T09:18:42.056 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: Deploying daemon mds.j on smithi052 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/96353007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6832/700754353,v1:172.21.15.86:6833/700754353] up:boot 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: fsmap 2 up:standby 2024-09-19T09:18:42.057 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:42.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: Deploying daemon mds.j on smithi052 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/96353007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6832/700754353,v1:172.21.15.86:6833/700754353] up:boot 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: fsmap 2 up:standby 2024-09-19T09:18:42.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:42.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: Deploying daemon mds.j on smithi052 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/96353007' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6832/700754353,v1:172.21.15.86:6833/700754353] up:boot 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: fsmap 2 up:standby 2024-09-19T09:18:42.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:18:43.124 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:42 smithi086 ceph-mon[34813]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:43.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:42 smithi052 ceph-mon[30947]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:43.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:42 smithi169 ceph-mon[35454]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:43.679 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 systemd[1]: Starting Ceph mds.j for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:43.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:43.952 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 podman[67622]: 2024-09-19 09:18:43.605442696 +0000 UTC m=+0.016995736 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:43.953 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 podman[67622]: 2024-09-19 09:18:43.725286837 +0000 UTC m=+0.136839877 container create f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:43.953 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 podman[67622]: 2024-09-19 09:18:43.952791984 +0000 UTC m=+0.364345023 container init f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:18:44.162 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:44.286 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 podman[67622]: 2024-09-19 09:18:43.957507887 +0000 UTC m=+0.369060927 container start f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:18:44.287 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 ceph-mds[67671]: -- 172.21.15.52:0/1465717009 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e914317860 con 0x55e9142f4800 2024-09-19T09:18:44.287 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:43 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j[67655]: starting mds.j at 2024-09-19T09:18:44.287 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:44 smithi052 bash[67622]: f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b 2024-09-19T09:18:44.287 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:18:44 smithi052 systemd[1]: Started Ceph mds.j for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 -- 172.21.15.52:0/1636816516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a01082a0 msgr2=0x7f13a010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1636816516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a01082a0 0x7f13a010ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1398009930 tx=0x7f139802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 -- 172.21.15.52:0/1636816516 shutdown_connections 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1636816516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a01082a0 0x7f13a010ec40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1636816516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 0x7f13a0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1636816516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a0102d30 0x7f13a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 -- 172.21.15.52:0/1636816516 >> 172.21.15.52:0/1636816516 conn(0x7f13a00fc7d0 msgr2=0x7f13a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 -- 172.21.15.52:0/1636816516 shutdown_connections 2024-09-19T09:18:44.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.622+0000 7f13a5eac640 1 -- 172.21.15.52:0/1636816516 wait complete. 2024-09-19T09:18:44.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 Processor -- start 2024-09-19T09:18:44.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 -- start start 2024-09-19T09:18:44.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 0x7f13a0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a01082a0 0x7f13a0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13a01120a0 con 0x7f13a0102d30 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0111f20 con 0x7f13a01082a0 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f13a5eac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13a0112220 con 0x7f13a01036e0 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f139f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f139f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50492/0 (socket says 172.21.15.52:50492) 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f139f7fe640 1 -- 172.21.15.52:0/1362950364 learned_addr learned my addr 172.21.15.52:0/1362950364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f139effd640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 0x7f13a0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.623+0000 7f139ffff640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a01082a0 0x7f13a0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 -- 172.21.15.52:0/1362950364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 msgr2=0x7f13a0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 0x7f13a0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 -- 172.21.15.52:0/1362950364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a01082a0 msgr2=0x7f13a0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a01082a0 0x7f13a0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 -- 172.21.15.52:0/1362950364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a01a6a20 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139f7fe640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f139000ebc0 tx=0x7f139000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390010630 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a01a6d10 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a01a7240 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1390010cb0 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.624+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390018bd0 con 0x7f13a0102d30 2024-09-19T09:18:44.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.625+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138c005290 con 0x7f13a0102d30 2024-09-19T09:18:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.627+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f13900107d0 con 0x7f13a0102d30 2024-09-19T09:18:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.628+0000 7f139cff9640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 0x7f13880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.628+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f13900cfb70 con 0x7f13a0102d30 2024-09-19T09:18:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.628+0000 7f139effd640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 0x7f13880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.629+0000 7f139effd640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 0x7f13880a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13a0102420 tx=0x7f139400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.631+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f139009c6e0 con 0x7f13a0102d30 2024-09-19T09:18:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.856+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138c005580 con 0x7f13a0102d30 2024-09-19T09:18:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.856+0000 7f139cff9640 1 -- 172.21.15.52:0/1362950364 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f13900a09e0 con 0x7f13a0102d30 2024-09-19T09:18:44.858 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:44.858 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"btime":"2024-09-19T09:18:41:362180+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:18:44.858 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.858+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 msgr2=0x7f13880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 0x7f13880a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f13a0102420 tx=0x7f139400a250 comp rx=0 tx=0).stop 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 msgr2=0x7f13a0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f139000ebc0 tx=0x7f139000c6a0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 shutdown_connections 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13a01082a0 0x7f13a0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13880a32c0 0x7f13880a5780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13a01036e0 0x7f13a0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 --2- 172.21.15.52:0/1362950364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13a0102d30 0x7f13a0100990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 >> 172.21.15.52:0/1362950364 conn(0x7f13a00fc7d0 msgr2=0x7f13a0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 shutdown_connections 2024-09-19T09:18:44.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:44.859+0000 7f13a5eac640 1 -- 172.21.15.52:0/1362950364 wait complete. 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: Deploying daemon mds.d on smithi052 2024-09-19T09:18:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1362950364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.52:6834/2692323672,v1:172.21.15.52:6835/2692323672] up:boot 2024-09-19T09:18:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: fsmap 3 up:standby 2024-09-19T09:18:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:45 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: Deploying daemon mds.d on smithi052 2024-09-19T09:18:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1362950364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.52:6834/2692323672,v1:172.21.15.52:6835/2692323672] up:boot 2024-09-19T09:18:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: fsmap 3 up:standby 2024-09-19T09:18:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:45 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:18:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: Deploying daemon mds.d on smithi052 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1362950364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.52:6834/2692323672,v1:172.21.15.52:6835/2692323672] up:boot 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: fsmap 3 up:standby 2024-09-19T09:18:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:45 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:18:47.132 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:46 smithi052 systemd[1]: Starting Ceph mds.d for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:47.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:47 smithi052 ceph-mon[30947]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:47.430 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 podman[68036]: 2024-09-19 09:18:47.080858597 +0000 UTC m=+0.016147181 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:47.430 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 podman[68036]: 2024-09-19 09:18:47.205309969 +0000 UTC m=+0.140598578 container create f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:18:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:47 smithi169 ceph-mon[35454]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:47 smithi086 ceph-mon[34813]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:47.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:47.836 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:47.929 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 podman[68036]: 2024-09-19 09:18:47.44109917 +0000 UTC m=+0.376387738 container init f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:47.930 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 podman[68036]: 2024-09-19 09:18:47.44401866 +0000 UTC m=+0.379307224 container start f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:47.930 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 ceph-mds[68055]: -- 172.21.15.52:0/2261844986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558e5893c20 con 0x5558e5871000 2024-09-19T09:18:47.930 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d[68051]: starting mds.d at 2024-09-19T09:18:47.930 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 bash[68036]: f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 2024-09-19T09:18:47.930 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:18:47 smithi052 systemd[1]: Started Ceph mds.d for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 -- 172.21.15.52:0/155970434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 msgr2=0x7f802010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 --2- 172.21.15.52:0/155970434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802010e600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8018009ca0 tx=0x7f801802a950 comp rx=0 tx=0).stop 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 -- 172.21.15.52:0/155970434 shutdown_connections 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 --2- 172.21.15.52:0/155970434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802010e600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 --2- 172.21.15.52:0/155970434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80201036c0 0x7f802010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 --2- 172.21.15.52:0/155970434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8020102da0 0x7f8020103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 -- 172.21.15.52:0/155970434 >> 172.21.15.52:0/155970434 conn(0x7f80200fc7a0 msgr2=0x7f80200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 -- 172.21.15.52:0/155970434 shutdown_connections 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.301+0000 7f8027b4d640 1 -- 172.21.15.52:0/155970434 wait complete. 2024-09-19T09:18:48.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 Processor -- start 2024-09-19T09:18:48.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 -- start start 2024-09-19T09:18:48.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8020102da0 0x7f8020198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80201036c0 0x7f8020198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8020111fa0 con 0x7f802010c180 2024-09-19T09:18:48.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8020111e20 con 0x7f80201036c0 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f8027b4d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8020112120 con 0x7f8020102da0 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f80260ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f80260ea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38752/0 (socket says 172.21.15.52:38752) 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f80260ea640 1 -- 172.21.15.52:0/3327981646 learned_addr learned my addr 172.21.15.52:0/3327981646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f80258e9640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8020102da0 0x7f8020198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.302+0000 7f80250e8640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80201036c0 0x7f8020198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 -- 172.21.15.52:0/3327981646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8020102da0 msgr2=0x7f8020198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8020102da0 0x7f8020198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 -- 172.21.15.52:0/3327981646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80201036c0 msgr2=0x7f8020198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80201036c0 0x7f8020198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 -- 172.21.15.52:0/3327981646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802019d3f0 con 0x7f802010c180 2024-09-19T09:18:48.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f80260ea640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f801802ae70 tx=0x7f801802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018034040 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802019d680 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8018030920 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80180047b0 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.303+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201a4fc0 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.304+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8020103180 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.306+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8018037020 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.306+0000 7f8016ffd640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 0x7f800c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.306+0000 7f80258e9640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 0x7f800c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.306+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f80180f0360 con 0x7f802010c180 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.307+0000 7f80258e9640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 0x7f800c0a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f801c005d00 tx=0x7f801c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.310+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80180bd520 con 0x7f802010c180 2024-09-19T09:18:48.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.521+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8020107200 con 0x7f802010c180 2024-09-19T09:18:48.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.521+0000 7f8016ffd640 1 -- 172.21.15.52:0/3327981646 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f80180bce20 con 0x7f802010c180 2024-09-19T09:18:48.523 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:48.523 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"btime":"2024-09-19T09:18:48:132350+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:18:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 5 2024-09-19T09:18:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 msgr2=0x7f800c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 0x7f800c0a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f801c005d00 tx=0x7f801c00b410 comp rx=0 tx=0).stop 2024-09-19T09:18:48.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 msgr2=0x7f802019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f801802ae70 tx=0x7f801802f5b0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 shutdown_connections 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f802010c180 0x7f802019cd10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80201036c0 0x7f8020198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f800c0a3240 0x7f800c0a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 --2- 172.21.15.52:0/3327981646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8020102da0 0x7f8020198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 >> 172.21.15.52:0/3327981646 conn(0x7f80200fc7a0 msgr2=0x7f80200fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 shutdown_connections 2024-09-19T09:18:48.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:48.523+0000 7f8027b4d640 1 -- 172.21.15.52:0/3327981646 wait complete. 2024-09-19T09:18:48.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: Deploying daemon mds.e on smithi086 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.52:6836/2830628688,v1:172.21.15.52:6837/2830628688] up:boot 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: fsmap 4 up:standby 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:18:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:48 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3327981646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:48.831 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:48.832 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: Deploying daemon mds.e on smithi086 2024-09-19T09:18:48.832 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.52:6836/2830628688,v1:172.21.15.52:6837/2830628688] up:boot 2024-09-19T09:18:48.832 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: fsmap 4 up:standby 2024-09-19T09:18:48.832 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:18:48.832 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:48 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3327981646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:48.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:48.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: Deploying daemon mds.e on smithi086 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.52:6836/2830628688,v1:172.21.15.52:6837/2830628688] up:boot 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: fsmap 4 up:standby 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:18:48.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:48 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3327981646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:49.507 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 systemd[1]: Starting Ceph mds.e for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:49.911 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 podman[64707]: 2024-09-19 09:18:49.549470682 +0000 UTC m=+0.015947415 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:49.911 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 podman[64707]: 2024-09-19 09:18:49.68300791 +0000 UTC m=+0.149484629 container create a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:18:49.912 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 podman[64707]: 2024-09-19 09:18:49.885146548 +0000 UTC m=+0.351623267 container init a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:18:49.912 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 podman[64707]: 2024-09-19 09:18:49.887826832 +0000 UTC m=+0.354303551 container start a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:18:50.257 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 ceph-mds[64726]: -- 172.21.15.86:0/1236530257 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a99b1d860 con 0x561a99afb000 2024-09-19T09:18:50.257 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:49 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: starting mds.e at 2024-09-19T09:18:50.257 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:50 smithi086 bash[64707]: a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 2024-09-19T09:18:50.257 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:18:50 smithi086 systemd[1]: Started Ceph mds.e for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:51.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:51.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.197 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:51.197 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:51.197 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:51.197 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: Deploying daemon mds.f on smithi169 2024-09-19T09:18:51.198 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6834/4246812720,v1:172.21.15.86:6835/4246812720] up:boot 2024-09-19T09:18:51.198 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: fsmap 5 up:standby 2024-09-19T09:18:51.198 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:51 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:51.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:51.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: Deploying daemon mds.f on smithi169 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6834/4246812720,v1:172.21.15.86:6835/4246812720] up:boot 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: fsmap 5 up:standby 2024-09-19T09:18:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:51 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: Deploying daemon mds.f on smithi169 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6834/4246812720,v1:172.21.15.86:6835/4246812720] up:boot 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: fsmap 5 up:standby 2024-09-19T09:18:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:51 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:18:51.514 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- 172.21.15.52:0/3476746415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 msgr2=0x7f43f4107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/3476746415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4107bc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009930 tx=0x7f43e802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- 172.21.15.52:0/3476746415 shutdown_connections 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/3476746415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4108300 0x7f43f410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/3476746415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4107bc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/3476746415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4102dd0 0x7f43f41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- 172.21.15.52:0/3476746415 >> 172.21.15.52:0/3476746415 conn(0x7f43f40fc7d0 msgr2=0x7f43f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- 172.21.15.52:0/3476746415 shutdown_connections 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- 172.21.15.52:0/3476746415 wait complete. 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 Processor -- start 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.940+0000 7f43fb0c0640 1 -- start start 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4102dd0 0x7f43f4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4108300 0x7f43f419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4112070 con 0x7f43f4103780 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43f4111ef0 con 0x7f43f4102dd0 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43f41121f0 con 0x7f43f4108300 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38768/0 (socket says 172.21.15.52:38768) 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 -- 172.21.15.52:0/34470661 learned_addr learned my addr 172.21.15.52:0/34470661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f965d640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4108300 0x7f43f419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f8e5c640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4102dd0 0x7f43f4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 -- 172.21.15.52:0/34470661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4108300 msgr2=0x7f43f419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4108300 0x7f43f419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 -- 172.21.15.52:0/34470661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4102dd0 msgr2=0x7f43f4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4102dd0 0x7f43f4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 -- 172.21.15.52:0/34470661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f419d620 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f3fff640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43e8005940 tx=0x7f43e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e803f030 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43e8003ce0 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f419d8b0 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.941+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8035070 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.942+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f41a51f0 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.943+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f41031b0 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.944+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f43e8042030 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.945+0000 7f43f1ffb640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 0x7f43dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.945+0000 7f43f8e5c640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 0x7f43dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.945+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f43e80efbc0 con 0x7f43f4103780 2024-09-19T09:18:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.945+0000 7f43f8e5c640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 0x7f43dc0a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:51.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:51.948+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43e80bcce0 con 0x7f43f4103780 2024-09-19T09:18:52.104 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:51 smithi169 systemd[1]: Starting Ceph mds.f for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.160+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43f410a290 con 0x7f43f4103780 2024-09-19T09:18:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.160+0000 7f43f1ffb640 1 -- 172.21.15.52:0/34470661 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f43e80bc5e0 con 0x7f43f4103780 2024-09-19T09:18:52.162 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:52.162 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"btime":"2024-09-19T09:18:50:584085+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:18:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-09-19T09:18:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 msgr2=0x7f43dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 0x7f43dc0a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f43e4005fd0 tx=0x7f43e4005850 comp rx=0 tx=0).stop 2024-09-19T09:18:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 msgr2=0x7f43f4198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43e8005940 tx=0x7f43e80042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 shutdown_connections 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43dc0a32c0 0x7f43dc0a5780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f4108300 0x7f43f419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f4103780 0x7f43f4198bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 --2- 172.21.15.52:0/34470661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f4102dd0 0x7f43f4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 >> 172.21.15.52:0/34470661 conn(0x7f43f40fc7d0 msgr2=0x7f43f4105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 shutdown_connections 2024-09-19T09:18:52.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:52.163+0000 7f43fb0c0640 1 -- 172.21.15.52:0/34470661 wait complete. 2024-09-19T09:18:52.399 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 podman[65031]: 2024-09-19 09:18:52.006174433 +0000 UTC m=+0.015719959 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:52.399 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 podman[65031]: 2024-09-19 09:18:52.129982796 +0000 UTC m=+0.139528311 container create 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:18:52.399 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 podman[65031]: 2024-09-19 09:18:52.399097246 +0000 UTC m=+0.408642756 container init 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:18:52.692 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 podman[65031]: 2024-09-19 09:18:52.402178453 +0000 UTC m=+0.411723965 container start 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:18:52.692 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 ceph-mds[65051]: -- 172.21.15.169:0/706819342 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5ff5ab860 con 0x55e5ff589000 2024-09-19T09:18:52.693 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: starting mds.f at 2024-09-19T09:18:52.693 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 bash[65031]: 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 2024-09-19T09:18:52.693 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:18:52 smithi169 systemd[1]: Started Ceph mds.f for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:53.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/34470661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:53 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:53.244 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:53.244 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/34470661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:53.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:53 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:53.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/34470661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:53 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:54.148 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-mon[35454]: Deploying daemon mds.c on smithi169 2024-09-19T09:18:54.149 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6834/144132383,v1:172.21.15.169:6835/144132383] up:boot 2024-09-19T09:18:54.149 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-mon[35454]: fsmap 6 up:standby 2024-09-19T09:18:54.149 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:54.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:54 smithi052 ceph-mon[30947]: Deploying daemon mds.c on smithi169 2024-09-19T09:18:54.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:54 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6834/144132383,v1:172.21.15.169:6835/144132383] up:boot 2024-09-19T09:18:54.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:54 smithi052 ceph-mon[30947]: fsmap 6 up:standby 2024-09-19T09:18:54.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:54 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:54.442 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 systemd[1]: Starting Ceph mds.c for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:54.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:54 smithi086 ceph-mon[34813]: Deploying daemon mds.c on smithi169 2024-09-19T09:18:54.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:54 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6834/144132383,v1:172.21.15.169:6835/144132383] up:boot 2024-09-19T09:18:54.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:54 smithi086 ceph-mon[34813]: fsmap 6 up:standby 2024-09-19T09:18:54.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:54 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:18:54.802 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 podman[65336]: 2024-09-19 09:18:54.541008828 +0000 UTC m=+0.105349136 container create cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:18:54.803 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 podman[65336]: 2024-09-19 09:18:54.452085917 +0000 UTC m=+0.016426226 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:54.803 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 podman[65336]: 2024-09-19 09:18:54.802783493 +0000 UTC m=+0.367123802 container init cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:18:54.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:55.072 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 podman[65336]: 2024-09-19 09:18:54.805646145 +0000 UTC m=+0.369986469 container start cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:18:55.073 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-mds[65355]: -- 172.21.15.169:0/1767697560 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626c91cdc20 con 0x5626c91ab400 2024-09-19T09:18:55.073 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: starting mds.c at 2024-09-19T09:18:55.073 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 bash[65336]: cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 2024-09-19T09:18:55.073 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:18:54 smithi169 systemd[1]: Started Ceph mds.c for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:55.326 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:55 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:55.393 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:55.393 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.393 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.393 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.393 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:55.394 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:55.394 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:55 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:55 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/1731534177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102570 msgr2=0x7fb0f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/1731534177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102570 0x7fb0f41029b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009900 tx=0x7fb0dc02a480 comp rx=0 tx=0).stop 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/1731534177 shutdown_connections 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/1731534177 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4102ef0 0x7fb0f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/1731534177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102570 0x7fb0f41029b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/1731534177 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4100e20 0x7fb0f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/1731534177 >> 172.21.15.52:0/1731534177 conn(0x7fb0f40fc7d0 msgr2=0x7fb0f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/1731534177 shutdown_connections 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.677+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/1731534177 wait complete. 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 Processor -- start 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 -- start start 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 0x7fb0f419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4102570 0x7fb0f419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4110f50 con 0x7fb0f4102ef0 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f4110dd0 con 0x7fb0f4100e20 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.678+0000 7fb0fa4eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f41110d0 con 0x7fb0f4102570 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38780/0 (socket says 172.21.15.52:38780) 2024-09-19T09:18:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 0x7fb0f419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 -- 172.21.15.52:0/3516228887 learned_addr learned my addr 172.21.15.52:0/3516228887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0ebfff640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4102570 0x7fb0f419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 -- 172.21.15.52:0/3516228887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4102570 msgr2=0x7fb0f419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4102570 0x7fb0f419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 -- 172.21.15.52:0/3516228887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 msgr2=0x7fb0f419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 0x7fb0f419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 -- 172.21.15.52:0/3516228887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f419f690 con 0x7fb0f4102ef0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f3fff640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 0x7fb0f419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f8a88640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00eaa0 tx=0x7fb0ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec00cdb0 con 0x7fb0f4102ef0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0ec005020 con 0x7fb0f4102ef0 2024-09-19T09:18:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0116b0 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f419f980 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.679+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f41a7260 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.680+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f4101200 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.682+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb0ec005560 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.682+0000 7fb0f1ffb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 0x7fb0e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.682+0000 7fb0f3fff640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 0x7fb0e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.682+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fb0ec0cf5b0 con 0x7fb0f4102ef0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.683+0000 7fb0f3fff640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 0x7fb0e00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005d00 tx=0x7fb0e400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.687+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0ec016030 con 0x7fb0f4102ef0 2024-09-19T09:18:55.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.899+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0f41a7430 con 0x7fb0f4102ef0 2024-09-19T09:18:55.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.899+0000 7fb0f1ffb640 1 -- 172.21.15.52:0/3516228887 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7fb0ec09c120 con 0x7fb0f4102ef0 2024-09-19T09:18:55.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:55.901 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"btime":"2024-09-19T09:18:55:067865+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:18:55.902 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2024-09-19T09:18:55.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 msgr2=0x7fb0e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 0x7fb0e00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4005d00 tx=0x7fb0e400b410 comp rx=0 tx=0).stop 2024-09-19T09:18:55.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 msgr2=0x7fb0f419efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00eaa0 tx=0x7fb0ec00ef60 comp rx=0 tx=0).stop 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 shutdown_connections 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0f4102ef0 0x7fb0f419efb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0e00a3240 0x7fb0e00a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0f4102570 0x7fb0f419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 --2- 172.21.15.52:0/3516228887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0f4100e20 0x7fb0f419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 >> 172.21.15.52:0/3516228887 conn(0x7fb0f40fc7d0 msgr2=0x7fb0f406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 shutdown_connections 2024-09-19T09:18:55.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:55.902+0000 7fb0fa4eb640 1 -- 172.21.15.52:0/3516228887 wait complete. 2024-09-19T09:18:56.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:56 smithi052 ceph-mon[30947]: Deploying daemon mds.h on smithi086 2024-09-19T09:18:56.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:56 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6836/1790018144,v1:172.21.15.169:6837/1790018144] up:boot 2024-09-19T09:18:56.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:56 smithi052 ceph-mon[30947]: fsmap 7 up:standby 2024-09-19T09:18:56.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:56 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:56.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:56 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3516228887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:56.397 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:56 smithi086 ceph-mon[34813]: Deploying daemon mds.h on smithi086 2024-09-19T09:18:56.397 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:56 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6836/1790018144,v1:172.21.15.169:6837/1790018144] up:boot 2024-09-19T09:18:56.397 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:56 smithi086 ceph-mon[34813]: fsmap 7 up:standby 2024-09-19T09:18:56.398 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:56 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:56.398 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:56 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3516228887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:56 smithi169 ceph-mon[35454]: Deploying daemon mds.h on smithi086 2024-09-19T09:18:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:56 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6836/1790018144,v1:172.21.15.169:6837/1790018144] up:boot 2024-09-19T09:18:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:56 smithi169 ceph-mon[35454]: fsmap 7 up:standby 2024-09-19T09:18:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:56 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:18:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:56 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3516228887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:57.007 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:56 smithi086 systemd[1]: Starting Ceph mds.h for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:57 smithi052 ceph-mon[30947]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:57.354 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:57 smithi086 ceph-mon[34813]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:57.355 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 podman[65009]: 2024-09-19 09:18:57.008395921 +0000 UTC m=+0.015722989 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:57.355 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 podman[65009]: 2024-09-19 09:18:57.127281575 +0000 UTC m=+0.134608648 container create f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:18:57.355 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 podman[65009]: 2024-09-19 09:18:57.354786736 +0000 UTC m=+0.362113804 container init f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:18:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:57 smithi169 ceph-mon[35454]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:57.757 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 podman[65009]: 2024-09-19 09:18:57.357784958 +0000 UTC m=+0.365112026 container start f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:18:57.758 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 ceph-mds[65028]: -- 172.21.15.86:0/537181579 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fbeb4e1860 con 0x55fbeb4bf000 2024-09-19T09:18:57.758 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: starting mds.h at 2024-09-19T09:18:57.758 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 bash[65009]: f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 2024-09-19T09:18:57.758 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:18:57 smithi086 systemd[1]: Started Ceph mds.h for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:18:58.514 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:58.514 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.515 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.515 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.515 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:58.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: Deploying daemon mds.i on smithi169 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:boot 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: fsmap 8 up:standby 2024-09-19T09:18:58.834 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:18:58 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:58.900 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:58.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: Deploying daemon mds.i on smithi169 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:boot 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: fsmap 8 up:standby 2024-09-19T09:18:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:18:58 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:59.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:18:59.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: Deploying daemon mds.i on smithi169 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:boot 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: fsmap 8 up:standby 2024-09-19T09:18:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:18:58 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:18:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 -- 172.21.15.52:0/1164418992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab601082a0 msgr2=0x7fab6010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 --2- 172.21.15.52:0/1164418992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab601082a0 0x7fab6010ec40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab50009cd0 tx=0x7fab5002a910 comp rx=0 tx=0).stop 2024-09-19T09:18:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 -- 172.21.15.52:0/1164418992 shutdown_connections 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 --2- 172.21.15.52:0/1164418992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab601082a0 0x7fab6010ec40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 --2- 172.21.15.52:0/1164418992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601036e0 0x7fab60107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 --2- 172.21.15.52:0/1164418992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab60102d30 0x7fab60103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 -- 172.21.15.52:0/1164418992 >> 172.21.15.52:0/1164418992 conn(0x7fab600fc7d0 msgr2=0x7fab600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 -- 172.21.15.52:0/1164418992 shutdown_connections 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 -- 172.21.15.52:0/1164418992 wait complete. 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.335+0000 7fab654a0640 1 Processor -- start 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 -- start start 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab601036e0 0x7fab60100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 0x7fab60101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab601120e0 con 0x7fab60102d30 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab60111f60 con 0x7fab601036e0 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab654a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab60112260 con 0x7fab601082a0 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33262/0 (socket says 172.21.15.52:33262) 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 -- 172.21.15.52:0/2810019462 learned_addr learned my addr 172.21.15.52:0/2810019462 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5f7fe640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 0x7fab60101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5e7fc640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab601036e0 0x7fab60100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 -- 172.21.15.52:0/2810019462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 msgr2=0x7fab60101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 0x7fab60101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 -- 172.21.15.52:0/2810019462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab601036e0 msgr2=0x7fab60100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab601036e0 0x7fab60100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 -- 172.21.15.52:0/2810019462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab601a6a90 con 0x7fab60102d30 2024-09-19T09:18:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5f7fe640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 0x7fab60101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.336+0000 7fab5effd640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c890 tx=0x7fab5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.337+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58004220 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.337+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab580043c0 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.337+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab601a6d80 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.337+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580049e0 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.337+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab601a7240 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.338+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab60103110 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.339+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fab580079b0 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.340+0000 7fab57fff640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 0x7fab4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.340+0000 7fab5e7fc640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 0x7fab4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.340+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fab580cf500 con 0x7fab60102d30 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.340+0000 7fab5e7fc640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 0x7fab4c0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab600fec50 tx=0x7fab48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.344+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab58014030 con 0x7fab60102d30 2024-09-19T09:18:59.442 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 systemd[1]: Starting Ceph mds.i for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:18:59.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.563+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab6010a2b0 con 0x7fab60102d30 2024-09-19T09:18:59.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.563+0000 7fab57fff640 1 -- 172.21.15.52:0/2810019462 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7fab5809c6c0 con 0x7fab60102d30 2024-09-19T09:18:59.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:18:59.564 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":9,"btime":"2024-09-19T09:18:58:078808+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:18:59.564 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 9 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 msgr2=0x7fab4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 0x7fab4c0a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab600fec50 tx=0x7fab48008040 comp rx=0 tx=0).stop 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 msgr2=0x7fab60100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c890 tx=0x7fab5800cd50 comp rx=0 tx=0).stop 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 shutdown_connections 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab4c0a32c0 0x7fab4c0a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab601082a0 0x7fab60101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab601036e0 0x7fab60100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.565+0000 7fab654a0640 1 --2- 172.21.15.52:0/2810019462 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab60102d30 0x7fab60100990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.566+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 >> 172.21.15.52:0/2810019462 conn(0x7fab600fc7d0 msgr2=0x7fab60106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.566+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 shutdown_connections 2024-09-19T09:18:59.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:18:59.566+0000 7fab654a0640 1 -- 172.21.15.52:0/2810019462 wait complete. 2024-09-19T09:18:59.790 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 podman[65639]: 2024-09-19 09:18:59.417026961 +0000 UTC m=+0.015958715 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:18:59.944 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 podman[65639]: 2024-09-19 09:18:59.536692476 +0000 UTC m=+0.135624223 container create 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:18:59.944 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 podman[65639]: 2024-09-19 09:18:59.730708786 +0000 UTC m=+0.329640531 container init 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:18:59.944 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 podman[65639]: 2024-09-19 09:18:59.733470827 +0000 UTC m=+0.332402574 container start 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:18:59.944 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 ceph-mds[65658]: -- 172.21.15.169:0/1459875995 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56438fd97860 con 0x56438fd75400 2024-09-19T09:18:59.944 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: starting mds.i at 2024-09-19T09:18:59.945 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 bash[65639]: 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 2024-09-19T09:19:00.192 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:18:59 smithi169 systemd[1]: Started Ceph mds.i for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:19:00.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2810019462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:00 smithi052 ceph-mon[30947]: Deploying daemon mds.g on smithi052 2024-09-19T09:19:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2810019462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:00.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:00 smithi169 ceph-mon[35454]: Deploying daemon mds.g on smithi052 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2810019462' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:01.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:00 smithi086 ceph-mon[34813]: Deploying daemon mds.g on smithi052 2024-09-19T09:19:01.773 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:01 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:boot 2024-09-19T09:19:01.773 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:01 smithi052 ceph-mon[30947]: fsmap 9 up:standby 2024-09-19T09:19:01.773 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:01 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:19:01.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:01 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:boot 2024-09-19T09:19:01.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:01 smithi169 ceph-mon[35454]: fsmap 9 up:standby 2024-09-19T09:19:01.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:01 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:19:02.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:01 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:boot 2024-09-19T09:19:02.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:01 smithi086 ceph-mon[34813]: fsmap 9 up:standby 2024-09-19T09:19:02.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:01 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:19:02.173 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:01 smithi052 systemd[1]: Starting Ceph mds.g for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:19:02.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:02.430 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 podman[68807]: 2024-09-19 09:19:02.07567724 +0000 UTC m=+0.016381474 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:02.430 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 podman[68807]: 2024-09-19 09:19:02.174356371 +0000 UTC m=+0.115060607 container create 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:19:02.600 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:02 smithi052 ceph-mon[30947]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 podman[68807]: 2024-09-19 09:19:02.452786318 +0000 UTC m=+0.393490549 container init 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 podman[68807]: 2024-09-19 09:19:02.45634322 +0000 UTC m=+0.397047460 container start 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 ceph-mds[68856]: -- 172.21.15.52:0/4138455841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5647c258d860 con 0x5647c256a800 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g[68840]: starting mds.g at 2024-09-19T09:19:02.724 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 bash[68807]: 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 2024-09-19T09:19:02.725 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:19:02 smithi052 systemd[1]: Started Ceph mds.g for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:19:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:02 smithi169 ceph-mon[35454]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:03.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:02 smithi086 ceph-mon[34813]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:03.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 -- 172.21.15.52:0/851754357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 msgr2=0x7f61f010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 --2- 172.21.15.52:0/851754357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f010bb40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009900 tx=0x7f61e402a480 comp rx=0 tx=0).stop 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 -- 172.21.15.52:0/851754357 shutdown_connections 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 --2- 172.21.15.52:0/851754357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 0x7f61f010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 --2- 172.21.15.52:0/851754357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f010bb40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 --2- 172.21.15.52:0/851754357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 -- 172.21.15.52:0/851754357 >> 172.21.15.52:0/851754357 conn(0x7f61f00fc790 msgr2=0x7f61f00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 -- 172.21.15.52:0/851754357 shutdown_connections 2024-09-19T09:19:03.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.058+0000 7f61f65a1640 1 -- 172.21.15.52:0/851754357 wait complete. 2024-09-19T09:19:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 Processor -- start 2024-09-19T09:19:03.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 -- start start 2024-09-19T09:19:03.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 0x7f61f019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0111fa0 con 0x7f61f0103650 2024-09-19T09:19:03.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0111e20 con 0x7f61f010c160 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61f65a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0112120 con 0x7f61f0102d30 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.059+0000 7f61ef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33310/0 (socket says 172.21.15.52:33310) 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 -- 172.21.15.52:0/1232616412 learned_addr learned my addr 172.21.15.52:0/1232616412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61f4b3e640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 0x7f61f019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61effff640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 -- 172.21.15.52:0/1232616412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 msgr2=0x7f61f01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 -- 172.21.15.52:0/1232616412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 msgr2=0x7f61f019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 0x7f61f019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 -- 172.21.15.52:0/1232616412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f019d450 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61effff640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ef7fe640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61e4006010 tx=0x7f61e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e403f030 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f019d6e0 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e4003ce0 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4035070 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.060+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f01a5020 con 0x7f61f0103650 2024-09-19T09:19:03.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.061+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f006b070 con 0x7f61f0103650 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.062+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f61e4042030 con 0x7f61f0103650 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.063+0000 7f61ed7fa640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 0x7f61d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.063+0000 7f61effff640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 0x7f61d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.063+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f61e40efa50 con 0x7f61f0103650 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.064+0000 7f61effff640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 0x7f61d80a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009930 tx=0x7f61e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.067+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61e40bccd0 con 0x7f61f0103650 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.303+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61f01071d0 con 0x7f61f0103650 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.304+0000 7f61ed7fa640 1 -- 172.21.15.52:0/1232616412 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7f61e40bc5d0 con 0x7f61f0103650 2024-09-19T09:19:03.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:03.658 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":11,"btime":"2024-09-19T09:19:02:527502+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 11 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 msgr2=0x7f61d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 0x7f61d80a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009930 tx=0x7f61e0008040 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 msgr2=0x7f61f01989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61e4006010 tx=0x7f61e40042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 shutdown_connections 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61f010c160 0x7f61f019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61f0103650 0x7f61f01989e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61d80a3240 0x7f61d80a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 --2- 172.21.15.52:0/1232616412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0102d30 0x7f61f01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 >> 172.21.15.52:0/1232616412 conn(0x7f61f00fc790 msgr2=0x7f61f00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 shutdown_connections 2024-09-19T09:19:03.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:03.306+0000 7f61f65a1640 1 -- 172.21.15.52:0/1232616412 wait complete. 2024-09-19T09:19:03.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.52:6838/362105670,v1:172.21.15.52:6839/362105670] up:boot 2024-09-19T09:19:03.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: fsmap 10 up:standby 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: Deploying daemon mds.a on smithi052 2024-09-19T09:19:03.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1232616412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:03.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.52:6838/362105670,v1:172.21.15.52:6839/362105670] up:boot 2024-09-19T09:19:03.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: fsmap 10 up:standby 2024-09-19T09:19:03.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:19:03.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: Deploying daemon mds.a on smithi052 2024-09-19T09:19:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:03 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1232616412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:04.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.52:6838/362105670,v1:172.21.15.52:6839/362105670] up:boot 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: fsmap 10 up:standby 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: Deploying daemon mds.a on smithi052 2024-09-19T09:19:04.009 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:03 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1232616412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:04.843 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:04 smithi052 ceph-mon[30947]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:04.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:04 smithi169 ceph-mon[35454]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:05.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:04 smithi086 ceph-mon[34813]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:05.429 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 systemd[1]: Starting Ceph mds.a for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:19:05.810 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 podman[69221]: 2024-09-19 09:19:05.45683265 +0000 UTC m=+0.016446466 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:05.810 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 podman[69221]: 2024-09-19 09:19:05.55428846 +0000 UTC m=+0.113902263 container create 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:19:05.810 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 podman[69221]: 2024-09-19 09:19:05.782321982 +0000 UTC m=+0.341935799 container init 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:19:05.811 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 podman[69221]: 2024-09-19 09:19:05.785322038 +0000 UTC m=+0.344935843 container start 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:19:05.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:06.179 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 ceph-mds[69240]: -- 172.21.15.52:0/2151435362 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb3f887860 con 0x55bb3f864800 2024-09-19T09:19:06.179 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a[69236]: starting mds.a at 2024-09-19T09:19:06.180 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 bash[69221]: 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 2024-09-19T09:19:06.180 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:19:05 smithi052 systemd[1]: Started Ceph mds.a for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:19:06.243 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 -- 172.21.15.52:0/56209860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074f40 msgr2=0x7f294010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 --2- 172.21.15.52:0/56209860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074f40 0x7f294010de80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2930009900 tx=0x7f293002a480 comp rx=0 tx=0).stop 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 -- 172.21.15.52:0/56209860 shutdown_connections 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 --2- 172.21.15.52:0/56209860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 0x7f2940110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 --2- 172.21.15.52:0/56209860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074f40 0x7f294010de80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 --2- 172.21.15.52:0/56209860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074620 0x7f2940074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 -- 172.21.15.52:0/56209860 >> 172.21.15.52:0/56209860 conn(0x7f29400fd8c0 msgr2=0x7f29400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 -- 172.21.15.52:0/56209860 shutdown_connections 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.694+0000 7f2947e7d640 1 -- 172.21.15.52:0/56209860 wait complete. 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 Processor -- start 2024-09-19T09:19:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 -- start start 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074f40 0x7f294019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 0x7f294019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2940114140 con 0x7f2940074620 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2940113fc0 con 0x7f294010e3c0 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.695+0000 7f2947e7d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f29401142c0 con 0x7f2940074f40 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33344/0 (socket says 172.21.15.52:33344) 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 -- 172.21.15.52:0/2570711369 learned_addr learned my addr 172.21.15.52:0/2570711369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945418640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074f40 0x7f294019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f294641a640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 0x7f294019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 -- 172.21.15.52:0/2570711369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074f40 msgr2=0x7f294019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074f40 0x7f294019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 -- 172.21.15.52:0/2570711369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 msgr2=0x7f294019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 0x7f294019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 -- 172.21.15.52:0/2570711369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294019f630 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2945c19640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d950 tx=0x7f293c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c017070 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f293c009c30 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294019f920 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c00f6b0 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.696+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29401a7200 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.697+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2940074a00 con 0x7f2940074620 2024-09-19T09:19:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.698+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f293c0109d0 con 0x7f2940074620 2024-09-19T09:19:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.699+0000 7f2936ffd640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 0x7f292c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.699+0000 7f2945418640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 0x7f292c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.699+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f293c0cf0a0 con 0x7f2940074620 2024-09-19T09:19:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.700+0000 7f2945418640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 0x7f292c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2930009230 tx=0x7f29300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.702+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f293c009de0 con 0x7f2940074620 2024-09-19T09:19:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.920+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f294019b9e0 con 0x7f2940074620 2024-09-19T09:19:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.920+0000 7f2936ffd640 1 -- 172.21.15.52:0/2570711369 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9689 (secure 0 0 0) 0x7f293c09bb70 con 0x7f2940074620 2024-09-19T09:19:06.921 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:06.922 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":12,"btime":"2024-09-19T09:19:06:631325+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:19:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 12 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 msgr2=0x7f292c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 0x7f292c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2930009230 tx=0x7f29300058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 msgr2=0x7f294019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f293c00d950 tx=0x7f293c00de10 comp rx=0 tx=0).stop 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 shutdown_connections 2024-09-19T09:19:06.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f294010e3c0 0x7f294019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f292c0a3240 0x7f292c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2940074f40 0x7f294019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 --2- 172.21.15.52:0/2570711369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2940074620 0x7f294019a680 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 >> 172.21.15.52:0/2570711369 conn(0x7f29400fd8c0 msgr2=0x7f29400fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 shutdown_connections 2024-09-19T09:19:06.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:06.923+0000 7f2947e7d640 1 -- 172.21.15.52:0/2570711369 wait complete. 2024-09-19T09:19:07.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:07.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: Deploying daemon mds.b on smithi086 2024-09-19T09:19:07.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.52:6840/3428587988,v1:172.21.15.52:6841/3428587988] up:boot 2024-09-19T09:19:07.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: fsmap 11 up:standby 2024-09-19T09:19:07.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:19:07.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2570711369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: Deploying daemon mds.b on smithi086 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.52:6840/3428587988,v1:172.21.15.52:6841/3428587988] up:boot 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: fsmap 11 up:standby 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:19:07.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2570711369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: Deploying daemon mds.b on smithi086 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.52:6840/3428587988,v1:172.21.15.52:6841/3428587988] up:boot 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: fsmap 11 up:standby 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:19:07.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2570711369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:07.976 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:07 smithi086 systemd[1]: Starting Ceph mds.b for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:19:08.250 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:07 smithi086 podman[65306]: 2024-09-19 09:19:07.878375575 +0000 UTC m=+0.015861308 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:19:08.250 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 podman[65306]: 2024-09-19 09:19:08.005516727 +0000 UTC m=+0.143002497 container create 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:19:08.250 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 podman[65306]: 2024-09-19 09:19:08.249704586 +0000 UTC m=+0.387190311 container init 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:19:08.507 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 podman[65306]: 2024-09-19 09:19:08.252628424 +0000 UTC m=+0.390114148 container start 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:19:08.508 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mds[65325]: -- 172.21.15.86:0/928139583 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d4efcb860 con 0x562d4efa9400 2024-09-19T09:19:08.508 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: starting mds.b at 2024-09-19T09:19:08.508 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 bash[65306]: 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 2024-09-19T09:19:08.508 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:08 smithi086 systemd[1]: Started Ceph mds.b for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:19:09.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:09.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:08 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:09.240 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:09.240 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.240 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.240 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.240 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.241 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.241 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:08 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:09.246 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:09.247 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:08 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:09.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:09.852 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:10.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:boot 2024-09-19T09:19:10.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: fsmap 12 up:standby 2024-09-19T09:19:10.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:19:10.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.248 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.248 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:09 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:boot 2024-09-19T09:19:10.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: fsmap 12 up:standby 2024-09-19T09:19:10.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:19:10.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:09 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 -- 172.21.15.52:0/2148936584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020100a80 msgr2=0x7fa020100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 --2- 172.21.15.52:0/2148936584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020100a80 0x7fa020100ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009930 tx=0x7fa01c02a420 comp rx=0 tx=0).stop 2024-09-19T09:19:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 -- 172.21.15.52:0/2148936584 shutdown_connections 2024-09-19T09:19:10.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 --2- 172.21.15.52:0/2148936584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa02010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 --2- 172.21.15.52:0/2148936584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020100a80 0x7fa020100ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 --2- 172.21.15.52:0/2148936584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020106a80 0x7fa020106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.331+0000 7fa0272eb640 1 -- 172.21.15.52:0/2148936584 >> 172.21.15.52:0/2148936584 conn(0x7fa0200fc7a0 msgr2=0x7fa0200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- 172.21.15.52:0/2148936584 shutdown_connections 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- 172.21.15.52:0/2148936584 wait complete. 2024-09-19T09:19:10.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 Processor -- start 2024-09-19T09:19:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- start start 2024-09-19T09:19:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 0x7fa0201970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa020197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa020110e80 con 0x7fa020106a80 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa020110d00 con 0x7fa020101420 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.332+0000 7fa0272eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa020111000 con 0x7fa020100a80 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55084/0 (socket says 172.21.15.52:55084) 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 -- 172.21.15.52:0/3046857194 learned_addr learned my addr 172.21.15.52:0/3046857194 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:10.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa024886640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa020197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025087640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 0x7fa0201970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 -- 172.21.15.52:0/3046857194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 msgr2=0x7fa0201970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 0x7fa0201970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 -- 172.21.15.52:0/3046857194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 msgr2=0x7fa020197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa020197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 -- 172.21.15.52:0/3046857194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0201a6950 con 0x7fa020106a80 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025087640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 0x7fa0201970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa024886640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa020197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa025888640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa01800d950 tx=0x7fa01800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:10.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018017030 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa018004020 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0201a6c40 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018003c00 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.333+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0201a7150 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.334+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020100ee0 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.336+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa01801a070 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.336+0000 7fa0127fc640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 0x7fa00c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.337+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa0180cefb0 con 0x7fa020106a80 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.337+0000 7fa025087640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 0x7fa00c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.337+0000 7fa025087640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 0x7fa00c0a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa01400a2e0 tx=0x7fa01400a270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:10.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.340+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa018021070 con 0x7fa020106a80 2024-09-19T09:19:10.445 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:boot 2024-09-19T09:19:10.445 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: fsmap 12 up:standby 2024-09-19T09:19:10.445 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:19:10.446 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.446 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.446 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.446 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:09 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.556+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa02002d7c0 con 0x7fa020106a80 2024-09-19T09:19:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.556+0000 7fa0127fc640 1 -- 172.21.15.52:0/3046857194 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7fa01809c1f0 con 0x7fa020106a80 2024-09-19T09:19:10.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:10.557 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":13,"btime":"2024-09-19T09:19:08:934156+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:19:10.558 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 13 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 msgr2=0x7fa00c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 0x7fa00c0a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa01400a2e0 tx=0x7fa01400a270 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 msgr2=0x7fa020197b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa01800d950 tx=0x7fa01800de10 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 shutdown_connections 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa020106a80 0x7fa020197b60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa020101420 0x7fa020197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa00c0a32c0 0x7fa00c0a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 --2- 172.21.15.52:0/3046857194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa020100a80 0x7fa0201970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 >> 172.21.15.52:0/3046857194 conn(0x7fa0200fc7a0 msgr2=0x7fa0200fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.559+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 shutdown_connections 2024-09-19T09:19:10.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:10.560+0000 7fa0272eb640 1 -- 172.21.15.52:0/3046857194 wait complete. 2024-09-19T09:19:11.176 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:11.177 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:11 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3046857194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:11.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:11.261 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:11 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3046857194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:11.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:11 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3046857194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:12 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 -- 172.21.15.52:0/4234706074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4101de0 msgr2=0x7f24c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/4234706074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4101de0 0x7f24c41021c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009900 tx=0x7f24b402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 -- 172.21.15.52:0/4234706074 shutdown_connections 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/4234706074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4106f10 0x7f24c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/4234706074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4102790 0x7f24c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/4234706074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4101de0 0x7f24c41021c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 -- 172.21.15.52:0/4234706074 >> 172.21.15.52:0/4234706074 conn(0x7f24c40fd8c0 msgr2=0x7f24c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 -- 172.21.15.52:0/4234706074 shutdown_connections 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.499+0000 7f24c9fa6640 1 -- 172.21.15.52:0/4234706074 wait complete. 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 Processor -- start 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 -- start start 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 0x7f24c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4102790 0x7f24c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4111f70 con 0x7f24c4106f10 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f24c4111df0 con 0x7f24c4101de0 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c9fa6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f24c41120f0 con 0x7f24c4102790 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55106/0 (socket says 172.21.15.52:55106) 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 -- 172.21.15.52:0/909701851 learned_addr learned my addr 172.21.15.52:0/909701851 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c2ffd640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4102790 0x7f24c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c37fe640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 0x7f24c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 -- 172.21.15.52:0/909701851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4102790 msgr2=0x7f24c4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4102790 0x7f24c4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 -- 172.21.15.52:0/909701851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 msgr2=0x7f24c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 0x7f24c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c3fff640 1 -- 172.21.15.52:0/909701851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c41a68f0 con 0x7f24c4106f10 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.500+0000 7f24c37fe640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 0x7f24c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c3fff640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00eaa0 tx=0x7f24bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00cdb0 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24bc005020 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c41a6be0 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0116b0 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.501+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c41a7120 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.502+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c41021c0 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.503+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f24bc005560 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.504+0000 7f24c0ff9640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 0x7f24ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.504+0000 7f24c37fe640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 0x7f24ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.504+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f24bc0cfa80 con 0x7f24c4106f10 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.505+0000 7f24c37fe640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 0x7f24ac0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24b4005ab0 tx=0x7f24b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.508+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24bc016030 con 0x7f24c4106f10 2024-09-19T09:19:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:12 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.697+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24c4075a20 con 0x7f24c4106f10 2024-09-19T09:19:12.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.697+0000 7f24c0ff9640 1 -- 172.21.15.52:0/909701851 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f24c4075a20 con 0x7f24c4106f10 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:19:12.698 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-09-19T09:19:12.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 msgr2=0x7f24ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 0x7f24ac0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f24b4005ab0 tx=0x7f24b4005a20 comp rx=0 tx=0).stop 2024-09-19T09:19:12.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 msgr2=0x7f24c4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00eaa0 tx=0x7f24bc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 shutdown_connections 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24c4106f10 0x7f24c4074f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f24ac0a3240 0x7f24ac0a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24c4102790 0x7f24c4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 --2- 172.21.15.52:0/909701851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24c4101de0 0x7f24c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 >> 172.21.15.52:0/909701851 conn(0x7f24c40fd8c0 msgr2=0x7f24c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 shutdown_connections 2024-09-19T09:19:12.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:12.700+0000 7f24c9fa6640 1 -- 172.21.15.52:0/909701851 wait complete. 2024-09-19T09:19:12.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:12 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:13.337 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:19:13.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:19:13.605 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:13.619 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:13 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/909701851' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:19:13.659 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:13 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/909701851' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:19:13.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:13 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/909701851' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 -- 172.21.15.52:0/847659527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598102790 msgr2=0x7f05981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 --2- 172.21.15.52:0/847659527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598102790 0x7f05981067e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f058c009900 tx=0x7f058c02a410 comp rx=0 tx=0).stop 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 -- 172.21.15.52:0/847659527 shutdown_connections 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 --2- 172.21.15.52:0/847659527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598106f10 0x7f059810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 --2- 172.21.15.52:0/847659527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598102790 0x7f05981067e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 --2- 172.21.15.52:0/847659527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598101de0 0x7f05981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 -- 172.21.15.52:0/847659527 >> 172.21.15.52:0/847659527 conn(0x7f05980fd8c0 msgr2=0x7f05980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 -- 172.21.15.52:0/847659527 shutdown_connections 2024-09-19T09:19:14.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.034+0000 7f059ebf8640 1 -- 172.21.15.52:0/847659527 wait complete. 2024-09-19T09:19:14.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 Processor -- start 2024-09-19T09:19:14.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 -- start start 2024-09-19T09:19:14.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598102790 0x7f0598198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0598111f30 con 0x7f0598106f10 2024-09-19T09:19:14.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0598111db0 con 0x7f0598101de0 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059ebf8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05981120b0 con 0x7f0598102790 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059d195640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:36778/0 (socket says 172.21.15.52:36778) 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059d195640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55120/0 (socket says 172.21.15.52:55120) 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 -- 172.21.15.52:0/499285349 learned_addr learned my addr 172.21.15.52:0/499285349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f0597fff640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598102790 0x7f0598198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 -- 172.21.15.52:0/499285349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598102790 msgr2=0x7f0598198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598102790 0x7f0598198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 -- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 msgr2=0x7f059819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.035+0000 7f059c994640 1 -- 172.21.15.52:0/499285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059819d3c0 con 0x7f0598101de0 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f059d195640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:14.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f059c994640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f058800d950 tx=0x7f058800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588017030 con 0x7f0598101de0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059819d6b0 con 0x7f0598101de0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0588004020 con 0x7f0598101de0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880047a0 con 0x7f0598101de0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.036+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05981a4f90 con 0x7f0598101de0 2024-09-19T09:19:14.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.037+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05981021c0 con 0x7f0598101de0 2024-09-19T09:19:14.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.038+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f05880041d0 con 0x7f0598101de0 2024-09-19T09:19:14.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.039+0000 7f0595ffb640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 0x7f05800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.039+0000 7f0597fff640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 0x7f05800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.039+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f05880cee40 con 0x7f0598101de0 2024-09-19T09:19:14.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.040+0000 7f0597fff640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 0x7f05800a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f058c009230 tx=0x7f058c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.044+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f058809bf60 con 0x7f0598101de0 2024-09-19T09:19:14.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.219+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f059802d7c0 con 0x7f0598101de0 2024-09-19T09:19:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.705+0000 7f0595ffb640 1 -- 172.21.15.52:0/499285349 <== mon.2 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f058809b860 con 0x7f0598101de0 2024-09-19T09:19:14.706 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 msgr2=0x7f05800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 0x7f05800a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f058c009230 tx=0x7f058c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 msgr2=0x7f0598198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f058800d950 tx=0x7f058800de10 comp rx=0 tx=0).stop 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 shutdown_connections 2024-09-19T09:19:14.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0598106f10 0x7f059819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05800a3240 0x7f05800a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0598102790 0x7f0598198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 --2- 172.21.15.52:0/499285349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0598101de0 0x7f0598198410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 >> 172.21.15.52:0/499285349 conn(0x7f05980fd8c0 msgr2=0x7f05980fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 shutdown_connections 2024-09-19T09:19:14.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:14.709+0000 7f059ebf8640 1 -- 172.21.15.52:0/499285349 wait complete. 2024-09-19T09:19:14.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:14 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:14 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:14 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:19:15.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:19:15.607 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:15.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:15 smithi052 ceph-mon[30947]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:15.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:15 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/499285349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:15.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:15 smithi052 ceph-mon[30947]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:15.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:15 smithi052 ceph-mon[30947]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:19:15.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:15 smithi052 ceph-mon[30947]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:19:15.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:15 smithi169 ceph-mon[35454]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:15.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:15 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/499285349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:15.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:15 smithi169 ceph-mon[35454]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:15.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:15 smithi169 ceph-mon[35454]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:19:15.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:15 smithi169 ceph-mon[35454]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:19:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:15 smithi086 ceph-mon[34813]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:15 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/499285349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:16.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:15 smithi086 ceph-mon[34813]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:19:16.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:15 smithi086 ceph-mon[34813]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:19:16.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:15 smithi086 ceph-mon[34813]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T09:19:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- 172.21.15.52:0/2943912097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01036e0 msgr2=0x7fcca0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2943912097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01036e0 0x7fcca0107b90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009930 tx=0x7fcc9402a420 comp rx=0 tx=0).stop 2024-09-19T09:19:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- 172.21.15.52:0/2943912097 shutdown_connections 2024-09-19T09:19:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2943912097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca01082a0 0x7fcca010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2943912097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01036e0 0x7fcca0107b90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2943912097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca0102d30 0x7fcca0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- 172.21.15.52:0/2943912097 >> 172.21.15.52:0/2943912097 conn(0x7fcca00fc7d0 msgr2=0x7fcca00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- 172.21.15.52:0/2943912097 shutdown_connections 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- 172.21.15.52:0/2943912097 wait complete. 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 Processor -- start 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.145+0000 7fcca74ba640 1 -- start start 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca0102d30 0x7fcca0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca01036e0 0x7fcca0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcca01120a0 con 0x7fcca01082a0 2024-09-19T09:19:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0111f20 con 0x7fcca01036e0 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca74ba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0112220 con 0x7fcca0102d30 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55136/0 (socket says 172.21.15.52:55136) 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 -- 172.21.15.52:0/2124003934 learned_addr learned my addr 172.21.15.52:0/2124003934 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca4a55640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca01036e0 0x7fcca0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5256640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca0102d30 0x7fcca0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 -- 172.21.15.52:0/2124003934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca0102d30 msgr2=0x7fcca0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca0102d30 0x7fcca0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 -- 172.21.15.52:0/2124003934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca01036e0 msgr2=0x7fcca0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca01036e0 0x7fcca0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 -- 172.21.15.52:0/2124003934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01a6aa0 con 0x7fcca01082a0 2024-09-19T09:19:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.146+0000 7fcca5a57640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000eaa0 tx=0x7fcc9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.147+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000cdb0 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.147+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01a6d90 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.147+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc90005020 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.147+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc900116d0 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.147+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca01a7250 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.148+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0103110 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.149+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcc900054d0 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.150+0000 7fcc9e7fc640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 0x7fcc880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.150+0000 7fcca5256640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 0x7fcc880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.150+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7fcc900cfb20 con 0x7fcca01082a0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.150+0000 7fcca5256640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 0x7fcc880a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005d00 tx=0x7fcc9800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.154+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc90016030 con 0x7fcca01082a0 2024-09-19T09:19:16.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.332+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcca0101ec0 con 0x7fcca01082a0 2024-09-19T09:19:16.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.776+0000 7fcc9e7fc640 1 -- 172.21.15.52:0/2124003934 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7fcc9009c480 con 0x7fcca01082a0 2024-09-19T09:19:16.777 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-09-19T09:19:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 msgr2=0x7fcc880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 0x7fcc880a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005d00 tx=0x7fcc9800b410 comp rx=0 tx=0).stop 2024-09-19T09:19:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 msgr2=0x7fcca0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000eaa0 tx=0x7fcc9000ef60 comp rx=0 tx=0).stop 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 shutdown_connections 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca01082a0 0x7fcca0101410 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcca01036e0 0x7fcca0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc880a3240 0x7fcc880a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 --2- 172.21.15.52:0/2124003934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcca0102d30 0x7fcca0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 >> 172.21.15.52:0/2124003934 conn(0x7fcca00fc7d0 msgr2=0x7fcca0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 shutdown_connections 2024-09-19T09:19:16.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:16.779+0000 7fcca74ba640 1 -- 172.21.15.52:0/2124003934 wait complete. 2024-09-19T09:19:17.084 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:16 smithi052 ceph-mon[30947]: pgmap v265: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:17.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:16 smithi052 ceph-mon[30947]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:19:17.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:16 smithi052 ceph-mon[30947]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:19:17.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:16 smithi169 ceph-mon[35454]: pgmap v265: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:17.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:16 smithi169 ceph-mon[35454]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:19:17.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:16 smithi169 ceph-mon[35454]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:19:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:16 smithi086 ceph-mon[34813]: pgmap v265: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:17.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:16 smithi086 ceph-mon[34813]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:19:17.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:16 smithi086 ceph-mon[34813]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T09:19:17.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:19:17.658 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:18.064 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:19:18.064 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:19:18.064 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:17 smithi052 ceph-mon[30947]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:19:18.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/3309790338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98106f10 msgr2=0x7f2f9810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/3309790338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98106f10 0x7f2f9810ea90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009ca0 tx=0x7f2f9002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/3309790338 shutdown_connections 2024-09-19T09:19:18.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/3309790338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98106f10 0x7f2f9810ea90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/3309790338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98102790 0x7f2f981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/3309790338 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98101de0 0x7f2f981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/3309790338 >> 172.21.15.52:0/3309790338 conn(0x7f2f980fd8c0 msgr2=0x7f2f980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/3309790338 shutdown_connections 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.149+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/3309790338 wait complete. 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 Processor -- start 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 -- start start 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 0x7f2f98198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 0x7f2f9819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98111f70 con 0x7f2f98102790 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2f98111df0 con 0x7f2f98106f10 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f9c8b5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f981120f0 con 0x7f2f98101de0 2024-09-19T09:19:18.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45732/0 (socket says 172.21.15.52:45732) 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.150+0000 7f2f8ffff640 1 -- 172.21.15.52:0/129902290 learned_addr learned my addr 172.21.15.52:0/129902290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f96d9d640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 0x7f2f9819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f9659c640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 0x7f2f98198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 -- 172.21.15.52:0/129902290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 msgr2=0x7f2f98198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 0x7f2f98198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 -- 172.21.15.52:0/129902290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 msgr2=0x7f2f9819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 0x7f2f9819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 -- 172.21.15.52:0/129902290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9819d2f0 con 0x7f2f98102790 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f9659c640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 0x7f2f98198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f96d9d640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 0x7f2f9819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:18.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8ffff640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c920 tx=0x7f2f8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80007c70 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9819d5e0 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f80007e10 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80018890 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.151+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f981a4ec0 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.152+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f981021c0 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.154+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2f80018b10 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.154+0000 7f2f8f7fe640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 0x7f2f840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.154+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7879+0+0 (secure 0 0 0) 0x7f2f800cfb70 con 0x7f2f98102790 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.154+0000 7f2f9659c640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 0x7f2f840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.155+0000 7f2f9659c640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 0x7f2f840a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f880058c0 tx=0x7f2f88005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:18.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.158+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f80014030 con 0x7f2f98102790 2024-09-19T09:19:18.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:19:18.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:19:18.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:17 smithi169 ceph-mon[35454]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:19:18.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:19:18.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2124003934' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:19:18.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:17 smithi086 ceph-mon[34813]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:19:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.373+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2f9802d7c0 con 0x7f2f98102790 2024-09-19T09:19:18.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.783+0000 7f2f8f7fe640 1 -- 172.21.15.52:0/129902290 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2f8001f300 con 0x7f2f98102790 2024-09-19T09:19:18.784 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 msgr2=0x7f2f840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 0x7f2f840a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2f880058c0 tx=0x7f2f88005d30 comp rx=0 tx=0).stop 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 msgr2=0x7f2f98198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c920 tx=0x7f2f8000cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 shutdown_connections 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f98106f10 0x7f2f9819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f98102790 0x7f2f98198880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2f840a3240 0x7f2f840a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.786+0000 7f2f9c8b5640 1 --2- 172.21.15.52:0/129902290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f98101de0 0x7f2f98198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.787+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 >> 172.21.15.52:0/129902290 conn(0x7f2f980fd8c0 msgr2=0x7f2f980febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:18.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.787+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 shutdown_connections 2024-09-19T09:19:18.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:18.787+0000 7f2f9c8b5640 1 -- 172.21.15.52:0/129902290 wait complete. 2024-09-19T09:19:19.084 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:18 smithi052 ceph-mon[30947]: pgmap v268: 97 pgs: 15 active+clean, 25 creating+peering, 57 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:19.084 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:18 smithi052 ceph-mon[30947]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:19:19.084 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:18 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:19:19.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:18 smithi052 ceph-mon[30947]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:19:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:18 smithi169 ceph-mon[35454]: pgmap v268: 97 pgs: 15 active+clean, 25 creating+peering, 57 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:18 smithi169 ceph-mon[35454]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:19:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:18 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:19:19.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:18 smithi169 ceph-mon[35454]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:19:19.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:18 smithi086 ceph-mon[34813]: pgmap v268: 97 pgs: 15 active+clean, 25 creating+peering, 57 unknown; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:19:19.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:18 smithi086 ceph-mon[34813]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:19:19.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:18 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:19:19.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:18 smithi086 ceph-mon[34813]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:19:19.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:19:19.633 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:20.044 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:19 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:19:20.044 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:19 smithi052 ceph-mon[30947]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:19:20.044 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:19 smithi052 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:19:20.044 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:19 smithi052 ceph-mon[30947]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 -- 172.21.15.52:0/3053603378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 msgr2=0x7f15c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 --2- 172.21.15.52:0/3053603378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c810ea90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ca0 tx=0x7f15c002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 -- 172.21.15.52:0/3053603378 shutdown_connections 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 --2- 172.21.15.52:0/3053603378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c810ea90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 --2- 172.21.15.52:0/3053603378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8102790 0x7f15c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 --2- 172.21.15.52:0/3053603378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8101de0 0x7f15c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 -- 172.21.15.52:0/3053603378 >> 172.21.15.52:0/3053603378 conn(0x7f15c80fd8c0 msgr2=0x7f15c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 -- 172.21.15.52:0/3053603378 shutdown_connections 2024-09-19T09:19:20.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.043+0000 7f15ce5da640 1 -- 172.21.15.52:0/3053603378 wait complete. 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 Processor -- start 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 -- start start 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8101de0 0x7f15c8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8102790 0x7f15c81987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15c8111f70 con 0x7f15c8106f10 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15c8111df0 con 0x7f15c8101de0 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.044+0000 7f15ce5da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81120f0 con 0x7f15c8102790 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45756/0 (socket says 172.21.15.52:45756) 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 -- 172.21.15.52:0/477316838 learned_addr learned my addr 172.21.15.52:0/477316838 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15c77fe640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8102790 0x7f15c81987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15c7fff640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8101de0 0x7f15c8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 -- 172.21.15.52:0/477316838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8102790 msgr2=0x7f15c81987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8102790 0x7f15c81987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 -- 172.21.15.52:0/477316838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8101de0 msgr2=0x7f15c8198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8101de0 0x7f15c8198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 -- 172.21.15.52:0/477316838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c819d230 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ccb77640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15c0031a60 tx=0x7f15c0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0003c30 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c819d4c0 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0003dd0 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c00047e0 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.045+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c81a4e00 con 0x7f15c8106f10 2024-09-19T09:19:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.047+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c81021c0 con 0x7f15c8106f10 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.048+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f15c002f790 con 0x7f15c8106f10 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.048+0000 7f15c57fa640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 0x7f15b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.048+0000 7f15c7fff640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 0x7f15b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.048+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f15c00f0ca0 con 0x7f15c8106f10 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.049+0000 7f15c7fff640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 0x7f15b00a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005e10 tx=0x7f15b8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.052+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15c00bdb10 con 0x7f15c8106f10 2024-09-19T09:19:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:19 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:19:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:19 smithi169 ceph-mon[35454]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:19:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:19 smithi169 ceph-mon[35454]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:19:20.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:19 smithi169 ceph-mon[35454]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:19:20.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.228+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15c81a4fd0 con 0x7f15c8106f10 2024-09-19T09:19:20.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.230+0000 7f15c57fa640 1 -- 172.21.15.52:0/477316838 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22252 (secure 0 0 0) 0x7f15c00bd410 con 0x7f15c8106f10 2024-09-19T09:19:20.230 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:20.230 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:18.374684+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:20.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 msgr2=0x7f15b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 0x7f15b00a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005e10 tx=0x7f15b8005da0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 msgr2=0x7f15c819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f15c0031a60 tx=0x7f15c0031a90 comp rx=0 tx=0).stop 2024-09-19T09:19:20.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 shutdown_connections 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c8106f10 0x7f15c819cb50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15b00a3240 0x7f15b00a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15c8102790 0x7f15c81987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 --2- 172.21.15.52:0/477316838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15c8101de0 0x7f15c8198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 >> 172.21.15.52:0/477316838 conn(0x7f15c80fd8c0 msgr2=0x7f15c80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 shutdown_connections 2024-09-19T09:19:20.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:20.232+0000 7f15ce5da640 1 -- 172.21.15.52:0/477316838 wait complete. 2024-09-19T09:19:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:19 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/129902290' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:19:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:19 smithi086 ceph-mon[34813]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:19:20.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:19 smithi086 ceph-mon[34813]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:19:20.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:19 smithi086 ceph-mon[34813]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:19:20.922 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:19:21.178 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:21.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: pgmap v271: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:19:21.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:19:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: Cluster is now healthy 2024-09-19T09:19:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:active 2024-09-19T09:19:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:20 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/477316838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:21.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: pgmap v271: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:19:21.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:19:21.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: Cluster is now healthy 2024-09-19T09:19:21.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:active 2024-09-19T09:19:21.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.194 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:20 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/477316838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: pgmap v271: 97 pgs: 37 active+clean, 29 creating+peering, 31 unknown; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-19T09:19:21.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:19:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: Cluster is now healthy 2024-09-19T09:19:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] up:active 2024-09-19T09:19:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:21.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:20 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/477316838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 -- 172.21.15.52:0/541405568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a881027a0 msgr2=0x7f2a881067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 --2- 172.21.15.52:0/541405568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a881027a0 0x7f2a881067f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009900 tx=0x7f2a7802a410 comp rx=0 tx=0).stop 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 -- 172.21.15.52:0/541405568 shutdown_connections 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 --2- 172.21.15.52:0/541405568 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88106f20 0x7f2a8810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 --2- 172.21.15.52:0/541405568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a881027a0 0x7f2a881067f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 --2- 172.21.15.52:0/541405568 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a88101df0 0x7f2a881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 -- 172.21.15.52:0/541405568 >> 172.21.15.52:0/541405568 conn(0x7f2a880fd8f0 msgr2=0x7f2a880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 -- 172.21.15.52:0/541405568 shutdown_connections 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.610+0000 7f2a90427640 1 -- 172.21.15.52:0/541405568 wait complete. 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 Processor -- start 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 -- start start 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88101df0 0x7f2a88198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 0x7f2a88198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111fa0 con 0x7f2a88106f20 2024-09-19T09:19:21.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111e20 con 0x7f2a88101df0 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.611+0000 7f2a90427640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88112120 con 0x7f2a881027a0 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e1c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88101df0 0x7f2a88198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45770/0 (socket says 172.21.15.52:45770) 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 -- 172.21.15.52:0/3230505287 learned_addr learned my addr 172.21.15.52:0/3230505287 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8d9c2640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 0x7f2a88198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 -- 172.21.15.52:0/3230505287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 msgr2=0x7f2a88198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 0x7f2a88198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 -- 172.21.15.52:0/3230505287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88101df0 msgr2=0x7f2a88198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88101df0 0x7f2a88198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8e9c4640 1 -- 172.21.15.52:0/3230505287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8819d4d0 con 0x7f2a88106f20 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.612+0000 7f2a8d9c2640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 0x7f2a88198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a8e9c4640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a80012eb0 tx=0x7f2a8000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80004b20 con 0x7f2a88106f20 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a80004cc0 con 0x7f2a88106f20 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8819d7c0 con 0x7f2a88106f20 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8001a8d0 con 0x7f2a88106f20 2024-09-19T09:19:21.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.613+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a88074420 con 0x7f2a88106f20 2024-09-19T09:19:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.614+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a881021d0 con 0x7f2a88106f20 2024-09-19T09:19:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.616+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2a8001aa70 con 0x7f2a88106f20 2024-09-19T09:19:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.617+0000 7f2a7f7fe640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 0x7f2a740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.617+0000 7f2a8e1c3640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 0x7f2a740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.617+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f2a800d3d80 con 0x7f2a88106f20 2024-09-19T09:19:21.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.617+0000 7f2a8e1c3640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 0x7f2a740a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009890 tx=0x7f2a84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.620+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a800a0b50 con 0x7f2a88106f20 2024-09-19T09:19:21.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.796+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a8810a100 con 0x7f2a88106f20 2024-09-19T09:19:21.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.800+0000 7f2a7f7fe640 1 -- 172.21.15.52:0/3230505287 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22252 (secure 0 0 0) 0x7f2a800a0450 con 0x7f2a88106f20 2024-09-19T09:19:21.801 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:21.801 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":77,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:18.374684+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:21.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 msgr2=0x7f2a740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 0x7f2a740a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2a84009890 tx=0x7f2a84008040 comp rx=0 tx=0).stop 2024-09-19T09:19:21.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 msgr2=0x7f2a8819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a80012eb0 tx=0x7f2a8000c640 comp rx=0 tx=0).stop 2024-09-19T09:19:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 shutdown_connections 2024-09-19T09:19:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a88106f20 0x7f2a8819cdf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a740a32c0 0x7f2a740a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a881027a0 0x7f2a88198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 --2- 172.21.15.52:0/3230505287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a88101df0 0x7f2a88198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 >> 172.21.15.52:0/3230505287 conn(0x7f2a880fd8f0 msgr2=0x7f2a880fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 shutdown_connections 2024-09-19T09:19:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:21.802+0000 7f2a90427640 1 -- 172.21.15.52:0/3230505287 wait complete. 2024-09-19T09:19:22.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:19:22.704 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:23.128 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:22 smithi052 ceph-mon[30947]: pgmap v272: 97 pgs: 77 active+clean, 20 creating+peering; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 735 B/s wr, 5 op/s 2024-09-19T09:19:23.128 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3230505287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:22 smithi169 ceph-mon[35454]: pgmap v272: 97 pgs: 77 active+clean, 20 creating+peering; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 735 B/s wr, 5 op/s 2024-09-19T09:19:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3230505287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:23.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 -- 172.21.15.52:0/1531702358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 msgr2=0x7f994410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 --2- 172.21.15.52:0/1531702358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994410eac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f993c009ca0 tx=0x7f993c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 -- 172.21.15.52:0/1531702358 shutdown_connections 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 --2- 172.21.15.52:0/1531702358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994410eac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 --2- 172.21.15.52:0/1531702358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f99441027c0 0x7f9944106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 --2- 172.21.15.52:0/1531702358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9944101e10 0x7f99441021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 -- 172.21.15.52:0/1531702358 >> 172.21.15.52:0/1531702358 conn(0x7f99440fd8d0 msgr2=0x7f99440ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 -- 172.21.15.52:0/1531702358 shutdown_connections 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.212+0000 7f9949103640 1 -- 172.21.15.52:0/1531702358 wait complete. 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 Processor -- start 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 -- start start 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 0x7f9944198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441027c0 0x7f9944198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111fa0 con 0x7f9944106f40 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111e20 con 0x7f9944101e10 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.213+0000 7f9949103640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9944112120 con 0x7f99441027c0 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441027c0 0x7f9944198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45790/0 (socket says 172.21.15.52:45790) 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 -- 172.21.15.52:0/455849553 learned_addr learned my addr 172.21.15.52:0/455849553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f9942d9d640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 0x7f9944198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 -- 172.21.15.52:0/455849553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441027c0 msgr2=0x7f9944198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441027c0 0x7f9944198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 -- 172.21.15.52:0/455849553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 msgr2=0x7f9944198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 0x7f9944198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 -- 172.21.15.52:0/455849553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994419d3b0 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f9942d9d640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 0x7f9944198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f994359e640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f993c031a20 tx=0x7f993c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c003c30 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993c003dd0 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994419d640 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c02fc40 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.214+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a4f80 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.215+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99441021f0 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.217+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f993c004b40 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.217+0000 7f992bfff640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 0x7f992c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.218+0000 7f9942d9d640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 0x7f992c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.218+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f993c0f0b40 con 0x7f9944106f40 2024-09-19T09:19:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.218+0000 7f9942d9d640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 0x7f992c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f99340058c0 tx=0x7f9934005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.221+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f993c0bda40 con 0x7f9944106f40 2024-09-19T09:19:23.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:22 smithi086 ceph-mon[34813]: pgmap v272: 97 pgs: 77 active+clean, 20 creating+peering; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 735 B/s wr, 5 op/s 2024-09-19T09:19:23.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3230505287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:23.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.436+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9944199760 con 0x7f9944106f40 2024-09-19T09:19:23.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.804+0000 7f992bfff640 1 -- 172.21.15.52:0/455849553 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9944199760 con 0x7f9944106f40 2024-09-19T09:19:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 msgr2=0x7f992c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 0x7f992c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f99340058c0 tx=0x7f9934005850 comp rx=0 tx=0).stop 2024-09-19T09:19:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 msgr2=0x7f994419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f993c031a20 tx=0x7f993c031a50 comp rx=0 tx=0).stop 2024-09-19T09:19:23.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 shutdown_connections 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9944106f40 0x7f994419ccd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f992c0a3240 0x7f992c0a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99441027c0 0x7f9944198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.807+0000 7f9949103640 1 --2- 172.21.15.52:0/455849553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9944101e10 0x7f9944198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.808+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 >> 172.21.15.52:0/455849553 conn(0x7f99440fd8d0 msgr2=0x7f99440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.808+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 shutdown_connections 2024-09-19T09:19:23.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:23.808+0000 7f9949103640 1 -- 172.21.15.52:0/455849553 wait complete. 2024-09-19T09:19:24.083 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:23 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:19:24.172 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:23 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:19:24.257 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: 2024-09-19T09:19:23.941+0000 7f6ac390d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:19:24.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:23 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:19:24.466 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T09:19:24.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T09:19:24.729 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:24.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:24 smithi169 ceph-mon[35454]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:19:24.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:24 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:19:24.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:24 smithi169 ceph-mon[35454]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:25.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:24 smithi052 ceph-mon[30947]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:19:25.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:24 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:19:25.085 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:24 smithi052 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:25.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 -- 172.21.15.52:0/773682847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102ef0 msgr2=0x7fe86410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 --2- 172.21.15.52:0/773682847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102ef0 0x7fe86410da40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe85c009900 tx=0x7fe85c02a480 comp rx=0 tx=0).stop 2024-09-19T09:19:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 -- 172.21.15.52:0/773682847 shutdown_connections 2024-09-19T09:19:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 --2- 172.21.15.52:0/773682847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102ef0 0x7fe86410da40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 --2- 172.21.15.52:0/773682847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864102570 0x7fe8641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 --2- 172.21.15.52:0/773682847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864100e20 0x7fe864101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 -- 172.21.15.52:0/773682847 >> 172.21.15.52:0/773682847 conn(0x7fe8640fc7d0 msgr2=0x7fe8640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 -- 172.21.15.52:0/773682847 shutdown_connections 2024-09-19T09:19:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.171+0000 7fe86c38b640 1 -- 172.21.15.52:0/773682847 wait complete. 2024-09-19T09:19:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 Processor -- start 2024-09-19T09:19:25.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 -- start start 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 0x7fe864197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864102ef0 0x7fe86419c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe864110fa0 con 0x7fe864102570 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe864110e20 con 0x7fe864100e20 2024-09-19T09:19:25.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86c38b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe864111120 con 0x7fe864102ef0 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe869926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86a127640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 0x7fe864197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe869926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45800/0 (socket says 172.21.15.52:45800) 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86a127640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 0x7fe864197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47620/0 (socket says 172.21.15.52:47620) 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe869926640 1 -- 172.21.15.52:0/3473317796 learned_addr learned my addr 172.21.15.52:0/3473317796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:25.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.172+0000 7fe86a928640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864102ef0 0x7fe86419c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 -- 172.21.15.52:0/3473317796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864102ef0 msgr2=0x7fe86419c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864102ef0 0x7fe86419c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 -- 172.21.15.52:0/3473317796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 msgr2=0x7fe864197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 0x7fe864197050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 -- 172.21.15.52:0/3473317796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86419c5e0 con 0x7fe864102570 2024-09-19T09:19:25.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe869926640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c920 tx=0x7fe85800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858007c70 con 0x7fe864102570 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86419c8d0 con 0x7fe864102570 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe858007e10 con 0x7fe864102570 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858018890 con 0x7fe864102570 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.173+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86419ce60 con 0x7fe864102570 2024-09-19T09:19:25.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.174+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8641021b0 con 0x7fe864102570 2024-09-19T09:19:25.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.175+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe858018a70 con 0x7fe864102570 2024-09-19T09:19:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.176+0000 7fe8577fe640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 0x7fe8500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.176+0000 7fe86a127640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 0x7fe8500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.176+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fe8580cf910 con 0x7fe864102570 2024-09-19T09:19:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.176+0000 7fe86a127640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 0x7fe8500a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe86000a400 tx=0x7fe86000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.180+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe858014030 con 0x7fe864102570 2024-09-19T09:19:25.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:24 smithi086 ceph-mon[34813]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T09:19:25.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:24 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/455849553' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:19:25.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:24 smithi086 ceph-mon[34813]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.394+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fe86406a5a0 con 0x7fe864102570 2024-09-19T09:19:25.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.810+0000 7fe8577fe640 1 -- 172.21.15.52:0/3473317796 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fe85809c780 con 0x7fe864102570 2024-09-19T09:19:25.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.813+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 msgr2=0x7fe8500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.813+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 0x7fe8500a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe86000a400 tx=0x7fe86000d040 comp rx=0 tx=0).stop 2024-09-19T09:19:25.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 msgr2=0x7fe864197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c920 tx=0x7fe85800cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 shutdown_connections 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe8500a3240 0x7fe8500a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe864102ef0 0x7fe86419c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe864102570 0x7fe864197590 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 --2- 172.21.15.52:0/3473317796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe864100e20 0x7fe864197050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 >> 172.21.15.52:0/3473317796 conn(0x7fe8640fc7d0 msgr2=0x7fe864106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 shutdown_connections 2024-09-19T09:19:25.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:25.814+0000 7fe86c38b640 1 -- 172.21.15.52:0/3473317796 wait complete. 2024-09-19T09:19:26.146 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:25 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:19:26.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:25 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:19:26.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:25 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T09:19:26.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:19:26.738 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:27.159 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:19:27.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:26 smithi052 ceph-mon[30947]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:19:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:19:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:19:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:19:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:19:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:19:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:26 smithi169 ceph-mon[35454]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:19:27.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3473317796' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T09:19:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:26 smithi086 ceph-mon[34813]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 -- 172.21.15.52:0/2524975069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 msgr2=0x7f4cc8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 --2- 172.21.15.52:0/2524975069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8106840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009930 tx=0x7f4cb802a420 comp rx=0 tx=0).stop 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 -- 172.21.15.52:0/2524975069 shutdown_connections 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 --2- 172.21.15.52:0/2524975069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 --2- 172.21.15.52:0/2524975069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8106840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 --2- 172.21.15.52:0/2524975069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 -- 172.21.15.52:0/2524975069 >> 172.21.15.52:0/2524975069 conn(0x7f4cc8077210 msgr2=0x7f4cc80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 -- 172.21.15.52:0/2524975069 shutdown_connections 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.245+0000 7f4ccf426640 1 -- 172.21.15.52:0/2524975069 wait complete. 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 Processor -- start 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 -- start start 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111f60 con 0x7f4cc8100ca0 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8111de0 con 0x7f4cc8106f50 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccf426640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81120e0 con 0x7f4cc81002f0 2024-09-19T09:19:27.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccc9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccc9c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45828/0 (socket says 172.21.15.52:45828) 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.246+0000 7f4ccc9c1640 1 -- 172.21.15.52:0/26928000 learned_addr learned my addr 172.21.15.52:0/26928000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccd1c2640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccd9c3640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 -- 172.21.15.52:0/26928000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 msgr2=0x7f4cc8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 -- 172.21.15.52:0/26928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 msgr2=0x7f4cc819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 -- 172.21.15.52:0/26928000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819d3f0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccd1c2640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccd9c3640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccc9c1640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8005940 tx=0x7f4cb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb803f030 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819d680 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb8003ce0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8035070 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.247+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a4fc0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.248+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc81006d0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.249+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4cb8042030 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.250+0000 7f4cbe7fc640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.250+0000 7f4ccd1c2640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.250+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f4cb80f00d0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.251+0000 7f4ccd1c2640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 0x7f4cb40a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400abe0 tx=0x7f4cc400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.253+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cb80bcea0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.469+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f4cc810a120 con 0x7f4cc8100ca0 2024-09-19T09:19:27.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.784+0000 7f4cbe7fc640 1 -- 172.21.15.52:0/26928000 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f4cb80bc7a0 con 0x7f4cc8100ca0 2024-09-19T09:19:27.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 msgr2=0x7f4cb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 0x7f4cb40a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4cc400abe0 tx=0x7f4cc400a5c0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 msgr2=0x7f4cc8198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8005940 tx=0x7f4cb80042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 shutdown_connections 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4cc8106f50 0x7f4cc819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4cc8100ca0 0x7f4cc8198980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cb40a3240 0x7f4cb40a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 --2- 172.21.15.52:0/26928000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cc81002f0 0x7f4cc8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 >> 172.21.15.52:0/26928000 conn(0x7f4cc8077210 msgr2=0x7f4cc80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 shutdown_connections 2024-09-19T09:19:27.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:27.787+0000 7f4ccf426640 1 -- 172.21.15.52:0/26928000 wait complete. 2024-09-19T09:19:28.097 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:active 2024-09-19T09:19:28.097 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:19:28.097 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: Cluster is now healthy 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:active 2024-09-19T09:19:28.098 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:27 smithi052 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:28.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:active 2024-09-19T09:19:28.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: Cluster is now healthy 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:active 2024-09-19T09:19:28.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:27 smithi169 ceph-mon[35454]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:28.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] up:active 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: Cluster is now healthy 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T09:19:28.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:19:28.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/26928000' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:19:28.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] up:active 2024-09-19T09:19:28.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:27 smithi086 ceph-mon[34813]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:28.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:19:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:29.050 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:28 smithi052 ceph-mon[30947]: pgmap v275: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-19T09:19:29.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 -- 172.21.15.52:0/4281777134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 msgr2=0x7fcb0810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 --2- 172.21.15.52:0/4281777134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0810ec40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcb00009930 tx=0x7fcb0002a420 comp rx=0 tx=0).stop 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 -- 172.21.15.52:0/4281777134 shutdown_connections 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 --2- 172.21.15.52:0/4281777134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0810ec40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 --2- 172.21.15.52:0/4281777134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb081036e0 0x7fcb08107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 --2- 172.21.15.52:0/4281777134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb08102d30 0x7fcb08103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 -- 172.21.15.52:0/4281777134 >> 172.21.15.52:0/4281777134 conn(0x7fcb080fc7d0 msgr2=0x7fcb080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 -- 172.21.15.52:0/4281777134 shutdown_connections 2024-09-19T09:19:29.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.136+0000 7fcb0debf640 1 -- 172.21.15.52:0/4281777134 wait complete. 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 Processor -- start 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 -- start start 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb08102d30 0x7fcb08198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 0x7fcb08198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb081120a0 con 0x7fcb081082a0 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08111f20 con 0x7fcb08102d30 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb0debf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb08112220 con 0x7fcb081036e0 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34334/0 (socket says 172.21.15.52:34334) 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb07fff640 1 -- 172.21.15.52:0/1318895786 learned_addr learned my addr 172.21.15.52:0/1318895786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb077fe640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb08102d30 0x7fcb08198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.137+0000 7fcb06ffd640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 0x7fcb08198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 -- 172.21.15.52:0/1318895786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 msgr2=0x7fcb08198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 0x7fcb08198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 -- 172.21.15.52:0/1318895786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb08102d30 msgr2=0x7fcb08198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb08102d30 0x7fcb08198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 -- 172.21.15.52:0/1318895786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0819d4e0 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb06ffd640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 0x7fcb08198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb07fff640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcb00005ab0 tx=0x7fcb000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0003f030 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb00003ce0 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0819d770 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00035070 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.138+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb081a50b0 con 0x7fcb081082a0 2024-09-19T09:19:29.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.139+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb08103110 con 0x7fcb081082a0 2024-09-19T09:19:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.140+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcb00042030 con 0x7fcb081082a0 2024-09-19T09:19:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.141+0000 7fcb04ff9640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 0x7fcaf00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.141+0000 7fcb077fe640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 0x7fcaf00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.141+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fcb000efc80 con 0x7fcb081082a0 2024-09-19T09:19:29.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.141+0000 7fcb077fe640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 0x7fcaf00a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005fd0 tx=0x7fcaf8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.145+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb000bca50 con 0x7fcb081082a0 2024-09-19T09:19:29.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:28 smithi169 ceph-mon[35454]: pgmap v275: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-19T09:19:29.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:28 smithi086 ceph-mon[34813]: pgmap v275: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-09-19T09:19:29.258 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: 2024-09-19T09:19:28.941+0000 7f6ac390d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T09:19:29.258 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:19:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: 2024-09-19T09:19:28.941+0000 7f6ac390d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:19:29.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.357+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fcb0810a2b0 con 0x7fcb081082a0 2024-09-19T09:19:29.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.833+0000 7fcb04ff9640 1 -- 172.21.15.52:0/1318895786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fcb000bc350 con 0x7fcb081082a0 2024-09-19T09:19:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.835+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 msgr2=0x7fcaf00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.835+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 0x7fcaf00a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8005fd0 tx=0x7fcaf8009680 comp rx=0 tx=0).stop 2024-09-19T09:19:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.835+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 msgr2=0x7fcb0819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.835+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcb00005ab0 tx=0x7fcb000042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 shutdown_connections 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb081082a0 0x7fcb0819ce00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcaf00a32c0 0x7fcaf00a5780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb081036e0 0x7fcb08198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 --2- 172.21.15.52:0/1318895786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb08102d30 0x7fcb08198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 >> 172.21.15.52:0/1318895786 conn(0x7fcb080fc7d0 msgr2=0x7fcb08105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 shutdown_connections 2024-09-19T09:19:29.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:29.836+0000 7fcb0debf640 1 -- 172.21.15.52:0/1318895786 wait complete. 2024-09-19T09:19:30.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:29 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:19:30.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:29 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:19:30.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:29 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:19:30.490 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T09:19:30.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:19:30.753 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:31.166 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:30 smithi052 ceph-mon[30947]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 487 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:19:31.166 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:30 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:19:31.166 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:30 smithi052 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:30 smithi169 ceph-mon[35454]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 487 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:19:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:30 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:19:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:30 smithi169 ceph-mon[35454]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:31.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:30 smithi086 ceph-mon[34813]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 487 B/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:19:31.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:30 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1318895786' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:19:31.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:30 smithi086 ceph-mon[34813]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:19:31.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 -- 172.21.15.52:0/2808292915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 msgr2=0x7fb83c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:31.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 --2- 172.21.15.52:0/2808292915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c100ee0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009930 tx=0x7fb82c02a420 comp rx=0 tx=0).stop 2024-09-19T09:19:31.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 -- 172.21.15.52:0/2808292915 shutdown_connections 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 --2- 172.21.15.52:0/2808292915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c101420 0x7fb83c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 --2- 172.21.15.52:0/2808292915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c100ee0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 --2- 172.21.15.52:0/2808292915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c106a80 0x7fb83c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 -- 172.21.15.52:0/2808292915 >> 172.21.15.52:0/2808292915 conn(0x7fb83c0fc7a0 msgr2=0x7fb83c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 -- 172.21.15.52:0/2808292915 shutdown_connections 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.250+0000 7fb84304f640 1 -- 172.21.15.52:0/2808292915 wait complete. 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 Processor -- start 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 -- start start 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 0x7fb83c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c106a80 0x7fb83c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:31.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c110ea0 con 0x7fb83c100a80 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c110d20 con 0x7fb83c101420 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb84304f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c111020 con 0x7fb83c106a80 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb840deb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb840deb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34356/0 (socket says 172.21.15.52:34356) 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.251+0000 7fb840deb640 1 -- 172.21.15.52:0/693577376 learned_addr learned my addr 172.21.15.52:0/693577376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb833fff640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 0x7fb83c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb8415ec640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c106a80 0x7fb83c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 -- 172.21.15.52:0/693577376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c106a80 msgr2=0x7fb83c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c106a80 0x7fb83c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 -- 172.21.15.52:0/693577376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 msgr2=0x7fb83c197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 0x7fb83c197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 -- 172.21.15.52:0/693577376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c19c370 con 0x7fb83c100a80 2024-09-19T09:19:31.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb833fff640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 0x7fb83c197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb840deb640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d950 tx=0x7fb83800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838017070 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb838009c30 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c19c660 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83800f6b0 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.252+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c1a3f40 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.253+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb83c100ee0 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.255+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb8380109d0 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.256+0000 7fb831ffb640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 0x7fb8240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.257+0000 7fb833fff640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 0x7fb8240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.257+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fb8380cf5a0 con 0x7fb83c100a80 2024-09-19T09:19:31.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.257+0000 7fb833fff640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 0x7fb8240a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb82c000c00 tx=0x7fb82c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:31.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.261+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb838009de0 con 0x7fb83c100a80 2024-09-19T09:19:31.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.463+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb83c062630 con 0x7fb8240a3240 2024-09-19T09:19:31.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.486+0000 7fb831ffb640 1 -- 172.21.15.52:0/693577376 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb83c062630 con 0x7fb8240a3240 2024-09-19T09:19:31.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.488+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 msgr2=0x7fb8240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.488+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 0x7fb8240a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb82c000c00 tx=0x7fb82c005a20 comp rx=0 tx=0).stop 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.488+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 msgr2=0x7fb83c1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.488+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d950 tx=0x7fb83800de10 comp rx=0 tx=0).stop 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 shutdown_connections 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb8240a3240 0x7fb8240a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb83c106a80 0x7fb83c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb83c101420 0x7fb83c197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 --2- 172.21.15.52:0/693577376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb83c100a80 0x7fb83c1973c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 >> 172.21.15.52:0/693577376 conn(0x7fb83c0fc7a0 msgr2=0x7fb83c0fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 shutdown_connections 2024-09-19T09:19:31.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:31.489+0000 7fb84304f640 1 -- 172.21.15.52:0/693577376 wait complete. 2024-09-19T09:19:31.811 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:19:31.468+0000 7fac38514640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:19:31.812 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:19:31.468+0000 7fac38514640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:19:31.812 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:19:31.468+0000 7fac38514640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:19:31.812 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:19:31.468+0000 7fac38514640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:19:31.812 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:19:31.468+0000 7fac38514640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T09:19:32.130 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:19:32.130 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T09:19:32.130 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.130 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:19:32.201 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.202 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T09:19:32.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T09:19:32.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2024-09-19T09:19:32.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-19T09:19:32.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-19T09:19:32.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T09:19:32.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:19:32.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]: dispatch 2024-09-19T09:19:32.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T09:19:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:32.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-19T09:19:32.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T09:19:32.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:32 smithi052 ceph-mon[30947]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:19:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/3326412777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 msgr2=0x7fa9bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/3326412777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc1021c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009900 tx=0x7fa9ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:19:32.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/3326412777 shutdown_connections 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/3326412777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc106f10 0x7fa9bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/3326412777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc102790 0x7fa9bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.874+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/3326412777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc1021c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/3326412777 >> 172.21.15.52:0/3326412777 conn(0x7fa9bc0fd8c0 msgr2=0x7fa9bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/3326412777 shutdown_connections 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/3326412777 wait complete. 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 Processor -- start 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- start start 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 0x7fa9bc198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 0x7fa9bc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc111f70 con 0x7fa9bc101de0 2024-09-19T09:19:32.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc111df0 con 0x7fa9bc102790 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.875+0000 7fa9c2f0d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc1120f0 con 0x7fa9bc106f10 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34394/0 (socket says 172.21.15.52:34394) 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 -- 172.21.15.52:0/206886267 learned_addr learned my addr 172.21.15.52:0/206886267 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c14aa640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 0x7fa9bc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9bbfff640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 0x7fa9bc198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 -- 172.21.15.52:0/206886267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 msgr2=0x7fa9bc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 0x7fa9bc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 -- 172.21.15.52:0/206886267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 msgr2=0x7fa9bc198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 0x7fa9bc198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 -- 172.21.15.52:0/206886267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc19d2b0 con 0x7fa9bc101de0 2024-09-19T09:19:32.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c14aa640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 0x7fa9bc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9bbfff640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 0x7fa9bc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c0ca9640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005ab0 tx=0x7fa9ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac03f030 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc19d540 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9ac003ce0 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.876+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac035070 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.877+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc1a4e80 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.877+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc1032c0 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.879+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa9ac042030 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.879+0000 7fa9b9ffb640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 0x7fa9a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.879+0000 7fa9bbfff640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 0x7fa9a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.879+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fa9ac0f02f0 con 0x7fa9bc101de0 2024-09-19T09:19:32.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.880+0000 7fa9bbfff640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 0x7fa9a40a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc108880 tx=0x7fa9b0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:32.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:32.884+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa9ac0bcff0 con 0x7fa9bc101de0 2024-09-19T09:19:33.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.086+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa9bc10a160 con 0x7fa9a40a3240 2024-09-19T09:19:33.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.109+0000 7fa9b9ffb640 1 -- 172.21.15.52:0/206886267 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa9b000da80 con 0x7fa9a40a3240 2024-09-19T09:19:33.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.111+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 msgr2=0x7fa9a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:33.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.111+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 0x7fa9a40a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc108880 tx=0x7fa9b0005d90 comp rx=0 tx=0).stop 2024-09-19T09:19:33.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 msgr2=0x7fa9bc198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:33.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005ab0 tx=0x7fa9ac0042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 shutdown_connections 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9a40a3240 0x7fa9a40a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9bc106f10 0x7fa9bc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9bc102790 0x7fa9bc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 --2- 172.21.15.52:0/206886267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9bc101de0 0x7fa9bc198300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 >> 172.21.15.52:0/206886267 conn(0x7fa9bc0fd8c0 msgr2=0x7fa9bc0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 shutdown_connections 2024-09-19T09:19:33.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:33.112+0000 7fa9c2f0d640 1 -- 172.21.15.52:0/206886267 wait complete. 2024-09-19T09:19:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-19T09:19:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:33.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T09:19:33.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:32 smithi169 ceph-mon[35454]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:19:33.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-19T09:19:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T09:19:33.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:32 smithi086 ceph-mon[34813]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:19:33.767 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:19:34.033 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:34.155 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:33 smithi052 ceph-mon[30947]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:19:34.155 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:33 smithi052 ceph-mon[30947]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:34.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:33 smithi169 ceph-mon[35454]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:19:34.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:33 smithi169 ceph-mon[35454]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:34.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:33 smithi086 ceph-mon[34813]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:19:34.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:33 smithi086 ceph-mon[34813]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:34.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 -- 172.21.15.52:0/2848221097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 msgr2=0x7fe98c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 --2- 172.21.15.52:0/2848221097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c1021c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe988009900 tx=0x7fe98802a410 comp rx=0 tx=0).stop 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 -- 172.21.15.52:0/2848221097 shutdown_connections 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 --2- 172.21.15.52:0/2848221097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c106f10 0x7fe98c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 --2- 172.21.15.52:0/2848221097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c102790 0x7fe98c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 --2- 172.21.15.52:0/2848221097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c1021c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 -- 172.21.15.52:0/2848221097 >> 172.21.15.52:0/2848221097 conn(0x7fe98c0fd8c0 msgr2=0x7fe98c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 -- 172.21.15.52:0/2848221097 shutdown_connections 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.500+0000 7fe994362640 1 -- 172.21.15.52:0/2848221097 wait complete. 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 Processor -- start 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 -- start start 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 0x7fe98c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:34.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c106f10 0x7fe98c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c112010 con 0x7fe98c101de0 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c111e90 con 0x7fe98c106f10 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe994362640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c112190 con 0x7fe98c102790 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe9920fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe9920fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34412/0 (socket says 172.21.15.52:34412) 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.501+0000 7fe9920fe640 1 -- 172.21.15.52:0/2893296467 learned_addr learned my addr 172.21.15.52:0/2893296467 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9918fd640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 0x7fe98c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9928ff640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c106f10 0x7fe98c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 -- 172.21.15.52:0/2893296467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 msgr2=0x7fe98c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 0x7fe98c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 -- 172.21.15.52:0/2893296467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c106f10 msgr2=0x7fe98c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:34.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c106f10 0x7fe98c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 -- 172.21.15.52:0/2893296467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c1a6a70 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9918fd640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 0x7fe98c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9920fe640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe988005ab0 tx=0x7fe9880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98803f030 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe988003ce0 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c1a6d00 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988035070 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.502+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c1a7190 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.503+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98c102240 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.504+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe988042030 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.505+0000 7fe9837fe640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 0x7fe9780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.505+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fe9880f04e0 con 0x7fe98c101de0 2024-09-19T09:19:34.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.505+0000 7fe9918fd640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 0x7fe9780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:34.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.505+0000 7fe9918fd640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 0x7fe9780a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe98c075f80 tx=0x7fe97c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:34.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.509+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9880bd020 con 0x7fe98c101de0 2024-09-19T09:19:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.716+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe98c062630 con 0x7fe9780a32d0 2024-09-19T09:19:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.721+0000 7fe9837fe640 1 -- 172.21.15.52:0/2893296467 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe98c062630 con 0x7fe9780a32d0 2024-09-19T09:19:34.721 INFO:teuthology.orchestra.run.smithi052.stdout:/volumes/qa/sv_0/c39c18e5-d920-4471-a204-873521e06612 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 msgr2=0x7fe9780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 0x7fe9780a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe98c075f80 tx=0x7fe97c008040 comp rx=0 tx=0).stop 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 msgr2=0x7fe98c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe988005ab0 tx=0x7fe9880042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 shutdown_connections 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe98c106f10 0x7fe98c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9780a32d0 0x7fe9780a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe98c102790 0x7fe98c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 --2- 172.21.15.52:0/2893296467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe98c101de0 0x7fe98c0744f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:34.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.723+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 >> 172.21.15.52:0/2893296467 conn(0x7fe98c0fd8c0 msgr2=0x7fe98c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:34.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.724+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 shutdown_connections 2024-09-19T09:19:34.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:34.724+0000 7fe994362640 1 -- 172.21.15.52:0/2893296467 wait complete. 2024-09-19T09:19:35.075 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:34 smithi052 ceph-mon[30947]: pgmap v280: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:19:35.076 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:34 smithi052 ceph-mon[30947]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:19:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:34 smithi169 ceph-mon[35454]: pgmap v280: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:19:35.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:34 smithi169 ceph-mon[35454]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:19:35.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:34 smithi086 ceph-mon[34813]: pgmap v280: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 16 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:19:35.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:34 smithi086 ceph-mon[34813]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:19:35.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:19:35.660 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:36.083 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:35 smithi052 ceph-mon[30947]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- 172.21.15.52:0/3258856228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c10c170 msgr2=0x7fc38c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 --2- 172.21.15.52:0/3258856228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c10c170 0x7fc38c10e610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc384009ca0 tx=0x7fc38402a950 comp rx=0 tx=0).stop 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- 172.21.15.52:0/3258856228 shutdown_connections 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 --2- 172.21.15.52:0/3258856228 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c10c170 0x7fc38c10e610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 --2- 172.21.15.52:0/3258856228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 0x7fc38c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 --2- 172.21.15.52:0/3258856228 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c102d40 0x7fc38c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- 172.21.15.52:0/3258856228 >> 172.21.15.52:0/3258856228 conn(0x7fc38c0fc7a0 msgr2=0x7fc38c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- 172.21.15.52:0/3258856228 shutdown_connections 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- 172.21.15.52:0/3258856228 wait complete. 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 Processor -- start 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.082+0000 7fc391a6f640 1 -- start start 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 0x7fc38c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c10c170 0x7fc38c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c111f70 con 0x7fc38c102d40 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c111df0 con 0x7fc38c103660 2024-09-19T09:19:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc391a6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1120f0 con 0x7fc38c10c170 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34424/0 (socket says 172.21.15.52:34424) 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 -- 172.21.15.52:0/4033864847 learned_addr learned my addr 172.21.15.52:0/4033864847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38bfff640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c10c170 0x7fc38c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc382ffd640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 0x7fc38c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 -- 172.21.15.52:0/4033864847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c10c170 msgr2=0x7fc38c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c10c170 0x7fc38c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 -- 172.21.15.52:0/4033864847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 msgr2=0x7fc38c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 0x7fc38c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.083+0000 7fc38b7fe640 1 -- 172.21.15.52:0/4033864847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c19d320 con 0x7fc38c102d40 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc38b7fe640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c920 tx=0x7fc37c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c007c70 con 0x7fc38c102d40 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c19d610 con 0x7fc38c102d40 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c007e10 con 0x7fc38c102d40 2024-09-19T09:19:36.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c018890 con 0x7fc38c102d40 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.084+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c1a4ef0 con 0x7fc38c102d40 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.085+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc38c103120 con 0x7fc38c102d40 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.086+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc37c018a50 con 0x7fc38c102d40 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.087+0000 7fc3897fa640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 0x7fc3780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.087+0000 7fc382ffd640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 0x7fc3780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.087+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fc37c0cfc30 con 0x7fc38c102d40 2024-09-19T09:19:36.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.088+0000 7fc382ffd640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 0x7fc3780a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc374005fd0 tx=0x7fc374005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:36.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.091+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc37c014030 con 0x7fc38c102d40 2024-09-19T09:19:36.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:35 smithi169 ceph-mon[35454]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:36.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:35 smithi086 ceph-mon[34813]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.292+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc38c0feac0 con 0x7fc3780a32d0 2024-09-19T09:19:36.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.315+0000 7fc3897fa640 1 -- 172.21.15.52:0/4033864847 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc38c0feac0 con 0x7fc3780a32d0 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 msgr2=0x7fc3780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 0x7fc3780a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc374005fd0 tx=0x7fc374005f60 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 msgr2=0x7fc38c198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c920 tx=0x7fc37c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 shutdown_connections 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3780a32d0 0x7fc3780a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc38c10c170 0x7fc38c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc38c103660 0x7fc38c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 --2- 172.21.15.52:0/4033864847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc38c102d40 0x7fc38c198370 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 >> 172.21.15.52:0/4033864847 conn(0x7fc38c0fc7a0 msgr2=0x7fc38c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:36.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 shutdown_connections 2024-09-19T09:19:36.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:36.317+0000 7fc391a6f640 1 -- 172.21.15.52:0/4033864847 wait complete. 2024-09-19T09:19:36.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:36 smithi052 ceph-mon[30947]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:36.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:19:37.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:36 smithi169 ceph-mon[35454]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:37.246 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:36 smithi086 ceph-mon[34813]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.9 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 -- 172.21.15.52:0/2767403244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4106a80 msgr2=0x7ffae4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/2767403244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4106a80 0x7ffae4106e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009930 tx=0x7ffad402a420 comp rx=0 tx=0).stop 2024-09-19T09:19:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 -- 172.21.15.52:0/2767403244 shutdown_connections 2024-09-19T09:19:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/2767403244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 0x7ffae410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/2767403244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4100a80 0x7ffae4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/2767403244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4106a80 0x7ffae4106e60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 -- 172.21.15.52:0/2767403244 >> 172.21.15.52:0/2767403244 conn(0x7ffae40fc7a0 msgr2=0x7ffae40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 -- 172.21.15.52:0/2767403244 shutdown_connections 2024-09-19T09:19:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.716+0000 7ffae9ae7640 1 -- 172.21.15.52:0/2767403244 wait complete. 2024-09-19T09:19:37.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 Processor -- start 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 -- start start 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 0x7ffae41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4106a80 0x7ffae419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4111fe0 con 0x7ffae4100a80 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4111e60 con 0x7ffae4106a80 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae9ae7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4112160 con 0x7ffae4101420 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34444/0 (socket says 172.21.15.52:34444) 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae37fe640 1 -- 172.21.15.52:0/257368848 learned_addr learned my addr 172.21.15.52:0/257368848 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae2ffd640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 0x7ffae41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae3fff640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4106a80 0x7ffae419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.717+0000 7ffae37fe640 1 -- 172.21.15.52:0/257368848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 msgr2=0x7ffae41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae37fe640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 0x7ffae41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae37fe640 1 -- 172.21.15.52:0/257368848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4106a80 msgr2=0x7ffae419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae37fe640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4106a80 0x7ffae419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae37fe640 1 -- 172.21.15.52:0/257368848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae419d410 con 0x7ffae4100a80 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae37fe640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffad402a940 tx=0x7ffad4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad403f070 con 0x7ffae4100a80 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad4031c90 con 0x7ffae4100a80 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae419d6a0 con 0x7ffae4100a80 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad4035030 con 0x7ffae4100a80 2024-09-19T09:19:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.718+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae41a4fe0 con 0x7ffae4100a80 2024-09-19T09:19:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.719+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae4100ee0 con 0x7ffae4100a80 2024-09-19T09:19:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.720+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffad4042070 con 0x7ffae4100a80 2024-09-19T09:19:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.721+0000 7ffae0ff9640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 0x7ffacc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.721+0000 7ffae2ffd640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 0x7ffacc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.721+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7ffad40efee0 con 0x7ffae4100a80 2024-09-19T09:19:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.722+0000 7ffae2ffd640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 0x7ffacc0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffae4106060 tx=0x7ffad800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.726+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffad40bca80 con 0x7ffae4100a80 2024-09-19T09:19:37.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:37 smithi052 ceph-mon[30947]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:37.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.935+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ffae4109060 con 0x7ffacc0a32d0 2024-09-19T09:19:37.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.940+0000 7ffae0ff9640 1 -- 172.21.15.52:0/257368848 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffad8010be0 con 0x7ffacc0a32d0 2024-09-19T09:19:37.940 INFO:teuthology.orchestra.run.smithi052.stdout:/volumes/qa/sv_1/34170925-e3b3-4a44-9507-364cc762ea7f 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 msgr2=0x7ffacc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 0x7ffacc0a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffae4106060 tx=0x7ffad800b390 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 msgr2=0x7ffae4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffad402a940 tx=0x7ffad4003b90 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 shutdown_connections 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae4106a80 0x7ffae419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffacc0a32d0 0x7ffacc0a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae4101420 0x7ffae41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 --2- 172.21.15.52:0/257368848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae4100a80 0x7ffae4198460 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 >> 172.21.15.52:0/257368848 conn(0x7ffae40fc7a0 msgr2=0x7ffae40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 shutdown_connections 2024-09-19T09:19:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:37.942+0000 7ffae9ae7640 1 -- 172.21.15.52:0/257368848 wait complete. 2024-09-19T09:19:38.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:37 smithi169 ceph-mon[35454]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:38.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:37 smithi086 ceph-mon[34813]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:38.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:38.908 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:38.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:38 smithi052 ceph-mon[30947]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:38.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:38 smithi052 ceph-mon[30947]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:38 smithi169 ceph-mon[35454]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:39.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:38 smithi169 ceph-mon[35454]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:38 smithi086 ceph-mon[34813]: pgmap v282: 97 pgs: 97 active+clean; 588 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 12 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:38 smithi086 ceph-mon[34813]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:19:39.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 -- 172.21.15.52:0/2713136082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65981082e0 msgr2=0x7f659810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 --2- 172.21.15.52:0/2713136082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65981082e0 0x7f659810ec50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6590009930 tx=0x7f659002a420 comp rx=0 tx=0).stop 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 -- 172.21.15.52:0/2713136082 shutdown_connections 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 --2- 172.21.15.52:0/2713136082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65981082e0 0x7f659810ec50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 --2- 172.21.15.52:0/2713136082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6598103760 0x7f6598107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 --2- 172.21.15.52:0/2713136082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 0x7f6598103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 -- 172.21.15.52:0/2713136082 >> 172.21.15.52:0/2713136082 conn(0x7f65980fc7d0 msgr2=0x7f65980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 -- 172.21.15.52:0/2713136082 shutdown_connections 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 -- 172.21.15.52:0/2713136082 wait complete. 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.343+0000 7f659eefc640 1 Processor -- start 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 -- start start 2024-09-19T09:19:39.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 0x7f6598198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65981082e0 0x7f659819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f65981120b0 con 0x7f6598103760 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6598111f30 con 0x7f65981082e0 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659eefc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6598112230 con 0x7f6598102db0 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51666/0 (socket says 172.21.15.52:51666) 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 -- 172.21.15.52:0/663346822 learned_addr learned my addr 172.21.15.52:0/663346822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659cc98640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 0x7f6598198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f659d499640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65981082e0 0x7f659819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 -- 172.21.15.52:0/663346822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 msgr2=0x7f6598198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 0x7f6598198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 -- 172.21.15.52:0/663346822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65981082e0 msgr2=0x7f659819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65981082e0 0x7f659819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.344+0000 7f6597fff640 1 -- 172.21.15.52:0/663346822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659819d500 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f6597fff640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f658000e9f0 tx=0x7f658000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658000ccc0 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6580010910 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659819d7f0 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6580018920 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.345+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981a50d0 con 0x7f6598103760 2024-09-19T09:19:39.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.346+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6598103190 con 0x7f6598103760 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.347+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6580010ac0 con 0x7f6598103760 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.348+0000 7f6595ffb640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 0x7f65840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.348+0000 7f659cc98640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 0x7f65840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.348+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f65800cfdf0 con 0x7f6598103760 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.348+0000 7f659cc98640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 0x7f65840a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6588005fd0 tx=0x7f6588009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.352+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f658009c930 con 0x7f6598103760 2024-09-19T09:19:39.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.563+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f659810a2f0 con 0x7f6598103760 2024-09-19T09:19:39.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.564+0000 7f6595ffb640 1 -- 172.21.15.52:0/663346822 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7f658009c230 con 0x7f6598103760 2024-09-19T09:19:39.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:39.565 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:19:39.565 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 msgr2=0x7f65840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 0x7f65840a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6588005fd0 tx=0x7f6588009760 comp rx=0 tx=0).stop 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 msgr2=0x7f6598198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f658000e9f0 tx=0x7f658000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 shutdown_connections 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65981082e0 0x7f659819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6598103760 0x7f6598198a90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65840a32d0 0x7f65840a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 --2- 172.21.15.52:0/663346822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6598102db0 0x7f6598198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 >> 172.21.15.52:0/663346822 conn(0x7f65980fc7d0 msgr2=0x7f6598105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.566+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 shutdown_connections 2024-09-19T09:19:39.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:39.567+0000 7f659eefc640 1 -- 172.21.15.52:0/663346822 wait complete. 2024-09-19T09:19:40.173 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:39 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/663346822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:40.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:39 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/663346822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:40.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:19:40.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:39 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/663346822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:40.457 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 -- 172.21.15.52:0/4077435765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc1036e0 msgr2=0x7f79bc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 --2- 172.21.15.52:0/4077435765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc1036e0 0x7f79bc107b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009930 tx=0x7f79b002a420 comp rx=0 tx=0).stop 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 -- 172.21.15.52:0/4077435765 shutdown_connections 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 --2- 172.21.15.52:0/4077435765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1082a0 0x7f79bc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 --2- 172.21.15.52:0/4077435765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc1036e0 0x7f79bc107b90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 --2- 172.21.15.52:0/4077435765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc102d30 0x7f79bc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 -- 172.21.15.52:0/4077435765 >> 172.21.15.52:0/4077435765 conn(0x7f79bc0fc7d0 msgr2=0x7f79bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 -- 172.21.15.52:0/4077435765 shutdown_connections 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 -- 172.21.15.52:0/4077435765 wait complete. 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.908+0000 7f79c1f08640 1 Processor -- start 2024-09-19T09:19:40.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 -- start start 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1036e0 0x7f79bc198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc1082a0 0x7f79bc19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc1120c0 con 0x7f79bc102d30 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc111f40 con 0x7f79bc1036e0 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79c1f08640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f79bc112240 con 0x7f79bc1082a0 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51690/0 (socket says 172.21.15.52:51690) 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 -- 172.21.15.52:0/298734843 learned_addr learned my addr 172.21.15.52:0/298734843 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79baffd640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1036e0 0x7f79bc198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bbfff640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc1082a0 0x7f79bc19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 -- 172.21.15.52:0/298734843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc1082a0 msgr2=0x7f79bc19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc1082a0 0x7f79bc19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 -- 172.21.15.52:0/298734843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1036e0 msgr2=0x7f79bc198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1036e0 0x7f79bc198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 -- 172.21.15.52:0/298734843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79bc19d520 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.909+0000 7f79bb7fe640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00b4a0 tx=0x7f79ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.910+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac014070 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.910+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ac010af0 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.910+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79bc19d810 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.910+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac017d10 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.910+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79bc1a50f0 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.911+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79bc06a850 con 0x7f79bc102d30 2024-09-19T09:19:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.912+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f79ac017070 con 0x7f79bc102d30 2024-09-19T09:19:40.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.913+0000 7f79b8ff9640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 0x7f79a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.913+0000 7f79baffd640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 0x7f79a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.913+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f79ac0cf1c0 con 0x7f79bc102d30 2024-09-19T09:19:40.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.913+0000 7f79baffd640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 0x7f79a40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:40.916+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79ac09be70 con 0x7f79bc102d30 2024-09-19T09:19:41.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.093+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79bc103110 con 0x7f79bc102d30 2024-09-19T09:19:41.094 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:40 smithi052 ceph-mon[30947]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:41.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.095+0000 7f79b8ff9640 1 -- 172.21.15.52:0/298734843 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22724 (secure 0 0 0) 0x7f79bc103110 con 0x7f79bc102d30 2024-09-19T09:19:41.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:41.096 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:32.840326+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 msgr2=0x7f79a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 0x7f79a40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009900 tx=0x7f79b0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 msgr2=0x7f79bc198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f79ac00b4a0 tx=0x7f79ac00b960 comp rx=0 tx=0).stop 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 shutdown_connections 2024-09-19T09:19:41.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f79a40a32d0 0x7f79a40a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79bc1082a0 0x7f79bc19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79bc1036e0 0x7f79bc198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 --2- 172.21.15.52:0/298734843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79bc102d30 0x7f79bc198570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.097+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 >> 172.21.15.52:0/298734843 conn(0x7f79bc0fc7d0 msgr2=0x7f79bc105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.098+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 shutdown_connections 2024-09-19T09:19:41.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:41.098+0000 7f79c1f08640 1 -- 172.21.15.52:0/298734843 wait complete. 2024-09-19T09:19:41.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:40 smithi169 ceph-mon[35454]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:41.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:40 smithi086 ceph-mon[34813]: pgmap v283: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 4 B/s, 2 keys/s, 1 objects/s recovering 2024-09-19T09:19:41.720 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:19:41.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:19:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:42.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:41 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/298734843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:42.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:41 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/298734843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:42.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:41 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/298734843' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 -- 172.21.15.52:0/3868939558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44106f10 msgr2=0x7efe4410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 --2- 172.21.15.52:0/3868939558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44106f10 0x7efe4410ea90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009ca0 tx=0x7efe3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 -- 172.21.15.52:0/3868939558 shutdown_connections 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 --2- 172.21.15.52:0/3868939558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44106f10 0x7efe4410ea90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 --2- 172.21.15.52:0/3868939558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 0x7efe441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 --2- 172.21.15.52:0/3868939558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44101de0 0x7efe441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 -- 172.21.15.52:0/3868939558 >> 172.21.15.52:0/3868939558 conn(0x7efe440fd8c0 msgr2=0x7efe440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 -- 172.21.15.52:0/3868939558 shutdown_connections 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.431+0000 7efe49d0f640 1 -- 172.21.15.52:0/3868939558 wait complete. 2024-09-19T09:19:42.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 Processor -- start 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 -- start start 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 0x7efe44198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44106f10 0x7efe4419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe44111f70 con 0x7efe44101de0 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe44111df0 con 0x7efe44106f10 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe49d0f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe441120f0 con 0x7efe44102790 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51704/0 (socket says 172.21.15.52:51704) 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 -- 172.21.15.52:0/1368188036 learned_addr learned my addr 172.21.15.52:0/1368188036 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe42ffd640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 0x7efe44198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe43fff640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44106f10 0x7efe4419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 -- 172.21.15.52:0/1368188036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 msgr2=0x7efe44198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 0x7efe44198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 -- 172.21.15.52:0/1368188036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44106f10 msgr2=0x7efe4419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44106f10 0x7efe4419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.432+0000 7efe437fe640 1 -- 172.21.15.52:0/1368188036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4419d2e0 con 0x7efe44101de0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe437fe640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c920 tx=0x7efe3400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34007c70 con 0x7efe44101de0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4419d5d0 con 0x7efe44101de0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe34007e10 con 0x7efe44101de0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34018890 con 0x7efe44101de0 2024-09-19T09:19:42.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.433+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe441a4eb0 con 0x7efe44101de0 2024-09-19T09:19:42.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.434+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe441021c0 con 0x7efe44101de0 2024-09-19T09:19:42.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.435+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efe34018a70 con 0x7efe44101de0 2024-09-19T09:19:42.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.436+0000 7efe40ff9640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 0x7efe2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.436+0000 7efe42ffd640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 0x7efe2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.436+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7efe340cfbc0 con 0x7efe44101de0 2024-09-19T09:19:42.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.436+0000 7efe42ffd640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 0x7efe2c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe44108880 tx=0x7efe3800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:42.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.440+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe34014030 con 0x7efe44101de0 2024-09-19T09:19:42.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.613+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe44062630 con 0x7efe2c0a32d0 2024-09-19T09:19:42.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.620+0000 7efe40ff9640 1 -- 172.21.15.52:0/1368188036 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258736 (secure 0 0 0) 0x7efe44062630 con 0x7efe2c0a32d0 2024-09-19T09:19:42.623 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:42.624 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 msgr2=0x7efe2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 0x7efe2c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe44108880 tx=0x7efe3800b390 comp rx=0 tx=0).stop 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 msgr2=0x7efe44198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c920 tx=0x7efe3400cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 shutdown_connections 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe44106f10 0x7efe4419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe2c0a32d0 0x7efe2c0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe44102790 0x7efe44198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 --2- 172.21.15.52:0/1368188036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe44101de0 0x7efe44198330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 >> 172.21.15.52:0/1368188036 conn(0x7efe440fd8c0 msgr2=0x7efe440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 shutdown_connections 2024-09-19T09:19:42.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:42.623+0000 7efe49d0f640 1 -- 172.21.15.52:0/1368188036 wait complete. 2024-09-19T09:19:43.159 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:42 smithi086 ceph-mon[34813]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:43.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:42 smithi052 ceph-mon[30947]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:43.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:42 smithi169 ceph-mon[35454]: pgmap v284: 97 pgs: 97 active+clean; 621 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.2 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:43.379 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-19T09:19:41.283095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635670,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":221,"num_read_kb":206,"num_write":331,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407328,"kb_used_data":12276,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534496,"statfs":{"total":1151940427776,"available":1151523323904,"internally_reserved":0,"allocated":12570624,"data_stored":7012188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40080,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":79,"num_write":25,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.441852"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844770+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:19:32.844770+0000","last_peered":"2024-09-19T09:19:32.844770+0000","last_clean":"2024-09-19T09:19:32.844770+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:19:32.844770+0000","last_undegraded":"2024-09-19T09:19:32.844770+0000","last_fullsized":"2024-09-19T09:19:32.844770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846379+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:19:32.846379+0000","last_peered":"2024-09-19T09:19:32.846379+0000","last_clean":"2024-09-19T09:19:32.846379+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:19:32.846379+0000","last_undegraded":"2024-09-19T09:19:32.846379+0000","last_fullsized":"2024-09-19T09:19:32.846379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846367+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:19:32.846367+0000","last_peered":"2024-09-19T09:19:32.846367+0000","last_clean":"2024-09-19T09:19:32.846367+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:19:32.846367+0000","last_undegraded":"2024-09-19T09:19:32.846367+0000","last_fullsized":"2024-09-19T09:19:32.846367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883949+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:19:32.883949+0000","last_peered":"2024-09-19T09:19:32.883949+0000","last_clean":"2024-09-19T09:19:32.883949+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:19:32.883949+0000","last_undegraded":"2024-09-19T09:19:32.883949+0000","last_fullsized":"2024-09-19T09:19:32.883949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845445+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:19:32.845445+0000","last_peered":"2024-09-19T09:19:32.845445+0000","last_clean":"2024-09-19T09:19:32.845445+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:19:32.845445+0000","last_undegraded":"2024-09-19T09:19:32.845445+0000","last_fullsized":"2024-09-19T09:19:32.845445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844658+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:19:32.844658+0000","last_peered":"2024-09-19T09:19:32.844658+0000","last_clean":"2024-09-19T09:19:32.844658+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:19:32.844658+0000","last_undegraded":"2024-09-19T09:19:32.844658+0000","last_fullsized":"2024-09-19T09:19:32.844658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851709+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:19:32.851709+0000","last_peered":"2024-09-19T09:19:32.851709+0000","last_clean":"2024-09-19T09:19:32.851709+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:19:32.851709+0000","last_undegraded":"2024-09-19T09:19:32.851709+0000","last_fullsized":"2024-09-19T09:19:32.851709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843340+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:19:32.843340+0000","last_peered":"2024-09-19T09:19:32.843340+0000","last_clean":"2024-09-19T09:19:32.843340+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:19:32.843340+0000","last_undegraded":"2024-09-19T09:19:32.843340+0000","last_fullsized":"2024-09-19T09:19:32.843340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.885245+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:19:32.885245+0000","last_peered":"2024-09-19T09:19:32.885245+0000","last_clean":"2024-09-19T09:19:32.885245+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:19:32.885245+0000","last_undegraded":"2024-09-19T09:19:32.885245+0000","last_fullsized":"2024-09-19T09:19:32.885245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845115+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:19:32.845115+0000","last_peered":"2024-09-19T09:19:32.845115+0000","last_clean":"2024-09-19T09:19:32.845115+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:19:32.845115+0000","last_undegraded":"2024-09-19T09:19:32.845115+0000","last_fullsized":"2024-09-19T09:19:32.845115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847894+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:19:32.847894+0000","last_peered":"2024-09-19T09:19:32.847894+0000","last_clean":"2024-09-19T09:19:32.847894+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:19:32.847894+0000","last_undegraded":"2024-09-19T09:19:32.847894+0000","last_fullsized":"2024-09-19T09:19:32.847894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884019+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:19:32.884019+0000","last_peered":"2024-09-19T09:19:32.884019+0000","last_clean":"2024-09-19T09:19:32.884019+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:19:32.884019+0000","last_undegraded":"2024-09-19T09:19:32.884019+0000","last_fullsized":"2024-09-19T09:19:32.884019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847227+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:19:32.847227+0000","last_peered":"2024-09-19T09:19:32.847227+0000","last_clean":"2024-09-19T09:19:32.847227+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:19:32.847227+0000","last_undegraded":"2024-09-19T09:19:32.847227+0000","last_fullsized":"2024-09-19T09:19:32.847227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846212+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:19:32.846212+0000","last_peered":"2024-09-19T09:19:32.846212+0000","last_clean":"2024-09-19T09:19:32.846212+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:19:32.846212+0000","last_undegraded":"2024-09-19T09:19:32.846212+0000","last_fullsized":"2024-09-19T09:19:32.846212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846172+0000","last_change":"2024-09-19T09:19:17.802304+0000","last_active":"2024-09-19T09:19:32.846172+0000","last_peered":"2024-09-19T09:19:32.846172+0000","last_clean":"2024-09-19T09:19:32.846172+0000","last_became_active":"2024-09-19T09:19:17.801658+0000","last_became_peered":"2024-09-19T09:19:17.801658+0000","last_unstale":"2024-09-19T09:19:32.846172+0000","last_undegraded":"2024-09-19T09:19:32.846172+0000","last_fullsized":"2024-09-19T09:19:32.846172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:47.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884023+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:19:32.884023+0000","last_peered":"2024-09-19T09:19:32.884023+0000","last_clean":"2024-09-19T09:19:32.884023+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:19:32.884023+0000","last_undegraded":"2024-09-19T09:19:32.884023+0000","last_fullsized":"2024-09-19T09:19:32.884023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844811+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:19:32.844811+0000","last_peered":"2024-09-19T09:19:32.844811+0000","last_clean":"2024-09-19T09:19:32.844811+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:19:32.844811+0000","last_undegraded":"2024-09-19T09:19:32.844811+0000","last_fullsized":"2024-09-19T09:19:32.844811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846300+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:19:32.846300+0000","last_peered":"2024-09-19T09:19:32.846300+0000","last_clean":"2024-09-19T09:19:32.846300+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:19:32.846300+0000","last_undegraded":"2024-09-19T09:19:32.846300+0000","last_fullsized":"2024-09-19T09:19:32.846300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849580+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:19:32.849580+0000","last_peered":"2024-09-19T09:19:32.849580+0000","last_clean":"2024-09-19T09:19:32.849580+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:19:32.849580+0000","last_undegraded":"2024-09-19T09:19:32.849580+0000","last_fullsized":"2024-09-19T09:19:32.849580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844346+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:19:32.844346+0000","last_peered":"2024-09-19T09:19:32.844346+0000","last_clean":"2024-09-19T09:19:32.844346+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:19:32.844346+0000","last_undegraded":"2024-09-19T09:19:32.844346+0000","last_fullsized":"2024-09-19T09:19:32.844346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847322+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:19:32.847322+0000","last_peered":"2024-09-19T09:19:32.847322+0000","last_clean":"2024-09-19T09:19:32.847322+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:19:32.847322+0000","last_undegraded":"2024-09-19T09:19:32.847322+0000","last_fullsized":"2024-09-19T09:19:32.847322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884352+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:19:32.884352+0000","last_peered":"2024-09-19T09:19:32.884352+0000","last_clean":"2024-09-19T09:19:32.884352+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:19:32.884352+0000","last_undegraded":"2024-09-19T09:19:32.884352+0000","last_fullsized":"2024-09-19T09:19:32.884352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843342+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:19:32.843342+0000","last_peered":"2024-09-19T09:19:32.843342+0000","last_clean":"2024-09-19T09:19:32.843342+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:19:32.843342+0000","last_undegraded":"2024-09-19T09:19:32.843342+0000","last_fullsized":"2024-09-19T09:19:32.843342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851217+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:19:32.851217+0000","last_peered":"2024-09-19T09:19:32.851217+0000","last_clean":"2024-09-19T09:19:32.851217+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:19:32.851217+0000","last_undegraded":"2024-09-19T09:19:32.851217+0000","last_fullsized":"2024-09-19T09:19:32.851217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843604+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:19:32.843604+0000","last_peered":"2024-09-19T09:19:32.843604+0000","last_clean":"2024-09-19T09:19:32.843604+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:19:32.843604+0000","last_undegraded":"2024-09-19T09:19:32.843604+0000","last_fullsized":"2024-09-19T09:19:32.843604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850101+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:19:32.850101+0000","last_peered":"2024-09-19T09:19:32.850101+0000","last_clean":"2024-09-19T09:19:32.850101+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:19:32.850101+0000","last_undegraded":"2024-09-19T09:19:32.850101+0000","last_fullsized":"2024-09-19T09:19:32.850101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844566+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:19:32.844566+0000","last_peered":"2024-09-19T09:19:32.844566+0000","last_clean":"2024-09-19T09:19:32.844566+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:19:32.844566+0000","last_undegraded":"2024-09-19T09:19:32.844566+0000","last_fullsized":"2024-09-19T09:19:32.844566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846511+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:19:32.846511+0000","last_peered":"2024-09-19T09:19:32.846511+0000","last_clean":"2024-09-19T09:19:32.846511+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:19:32.846511+0000","last_undegraded":"2024-09-19T09:19:32.846511+0000","last_fullsized":"2024-09-19T09:19:32.846511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846232+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:19:32.846232+0000","last_peered":"2024-09-19T09:19:32.846232+0000","last_clean":"2024-09-19T09:19:32.846232+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:19:32.846232+0000","last_undegraded":"2024-09-19T09:19:32.846232+0000","last_fullsized":"2024-09-19T09:19:32.846232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848116+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:19:32.848116+0000","last_peered":"2024-09-19T09:19:32.848116+0000","last_clean":"2024-09-19T09:19:32.848116+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:19:32.848116+0000","last_undegraded":"2024-09-19T09:19:32.848116+0000","last_fullsized":"2024-09-19T09:19:32.848116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848127+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:19:32.848127+0000","last_peered":"2024-09-19T09:19:32.848127+0000","last_clean":"2024-09-19T09:19:32.848127+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:19:32.848127+0000","last_undegraded":"2024-09-19T09:19:32.848127+0000","last_fullsized":"2024-09-19T09:19:32.848127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844176+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:19:32.844176+0000","last_peered":"2024-09-19T09:19:32.844176+0000","last_clean":"2024-09-19T09:19:32.844176+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:19:32.844176+0000","last_undegraded":"2024-09-19T09:19:32.844176+0000","last_fullsized":"2024-09-19T09:19:32.844176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845655+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:19:32.845655+0000","last_peered":"2024-09-19T09:19:32.845655+0000","last_clean":"2024-09-19T09:19:32.845655+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:19:32.845655+0000","last_undegraded":"2024-09-19T09:19:32.845655+0000","last_fullsized":"2024-09-19T09:19:32.845655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:39.812366+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:19:39.812366+0000","last_peered":"2024-09-19T09:19:39.812366+0000","last_clean":"2024-09-19T09:19:39.812366+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:19:39.812366+0000","last_undegraded":"2024-09-19T09:19:39.812366+0000","last_fullsized":"2024-09-19T09:19:39.812366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850691+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:19:32.850691+0000","last_peered":"2024-09-19T09:19:32.850691+0000","last_clean":"2024-09-19T09:19:32.850691+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:19:32.850691+0000","last_undegraded":"2024-09-19T09:19:32.850691+0000","last_fullsized":"2024-09-19T09:19:32.850691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.888269+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:19:32.888269+0000","last_peered":"2024-09-19T09:19:32.888269+0000","last_clean":"2024-09-19T09:19:32.888269+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:19:32.888269+0000","last_undegraded":"2024-09-19T09:19:32.888269+0000","last_fullsized":"2024-09-19T09:19:32.888269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847552+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:19:32.847552+0000","last_peered":"2024-09-19T09:19:32.847552+0000","last_clean":"2024-09-19T09:19:32.847552+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:19:32.847552+0000","last_undegraded":"2024-09-19T09:19:32.847552+0000","last_fullsized":"2024-09-19T09:19:32.847552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843550+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:19:32.843550+0000","last_peered":"2024-09-19T09:19:32.843550+0000","last_clean":"2024-09-19T09:19:32.843550+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:19:32.843550+0000","last_undegraded":"2024-09-19T09:19:32.843550+0000","last_fullsized":"2024-09-19T09:19:32.843550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846285+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:19:32.846285+0000","last_peered":"2024-09-19T09:19:32.846285+0000","last_clean":"2024-09-19T09:19:32.846285+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:19:32.846285+0000","last_undegraded":"2024-09-19T09:19:32.846285+0000","last_fullsized":"2024-09-19T09:19:32.846285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845647+0000","last_change":"2024-09-19T09:19:17.803446+0000","last_active":"2024-09-19T09:19:32.845647+0000","last_peered":"2024-09-19T09:19:32.845647+0000","last_clean":"2024-09-19T09:19:32.845647+0000","last_became_active":"2024-09-19T09:19:17.803092+0000","last_became_peered":"2024-09-19T09:19:17.803092+0000","last_unstale":"2024-09-19T09:19:32.845647+0000","last_undegraded":"2024-09-19T09:19:32.845647+0000","last_fullsized":"2024-09-19T09:19:32.845647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:46.709525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:36.806606+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:19:36.806606+0000","last_peered":"2024-09-19T09:19:36.806606+0000","last_clean":"2024-09-19T09:19:36.806606+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:19:36.806606+0000","last_undegraded":"2024-09-19T09:19:36.806606+0000","last_fullsized":"2024-09-19T09:19:36.806606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884972+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:19:32.884972+0000","last_peered":"2024-09-19T09:19:32.884972+0000","last_clean":"2024-09-19T09:19:32.884972+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:19:32.884972+0000","last_undegraded":"2024-09-19T09:19:32.884972+0000","last_fullsized":"2024-09-19T09:19:32.884972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847777+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:19:32.847777+0000","last_peered":"2024-09-19T09:19:32.847777+0000","last_clean":"2024-09-19T09:19:32.847777+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:19:32.847777+0000","last_undegraded":"2024-09-19T09:19:32.847777+0000","last_fullsized":"2024-09-19T09:19:32.847777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846616+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:19:32.846616+0000","last_peered":"2024-09-19T09:19:32.846616+0000","last_clean":"2024-09-19T09:19:32.846616+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:19:32.846616+0000","last_undegraded":"2024-09-19T09:19:32.846616+0000","last_fullsized":"2024-09-19T09:19:32.846616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884593+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:19:32.884593+0000","last_peered":"2024-09-19T09:19:32.884593+0000","last_clean":"2024-09-19T09:19:32.884593+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:19:32.884593+0000","last_undegraded":"2024-09-19T09:19:32.884593+0000","last_fullsized":"2024-09-19T09:19:32.884593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'21","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:37.808731+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:19:37.808731+0000","last_peered":"2024-09-19T09:19:37.808731+0000","last_clean":"2024-09-19T09:19:37.808731+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:19:37.808731+0000","last_undegraded":"2024-09-19T09:19:37.808731+0000","last_fullsized":"2024-09-19T09:19:37.808731+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846623+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:19:32.846623+0000","last_peered":"2024-09-19T09:19:32.846623+0000","last_clean":"2024-09-19T09:19:32.846623+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:19:32.846623+0000","last_undegraded":"2024-09-19T09:19:32.846623+0000","last_fullsized":"2024-09-19T09:19:32.846623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.861670+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:19:32.861670+0000","last_peered":"2024-09-19T09:19:32.861670+0000","last_clean":"2024-09-19T09:19:32.861670+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:19:32.861670+0000","last_undegraded":"2024-09-19T09:19:32.861670+0000","last_fullsized":"2024-09-19T09:19:32.861670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850543+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:19:32.850543+0000","last_peered":"2024-09-19T09:19:32.850543+0000","last_clean":"2024-09-19T09:19:32.850543+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:19:32.850543+0000","last_undegraded":"2024-09-19T09:19:32.850543+0000","last_fullsized":"2024-09-19T09:19:32.850543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846921+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:19:32.846921+0000","last_peered":"2024-09-19T09:19:32.846921+0000","last_clean":"2024-09-19T09:19:32.846921+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:19:32.846921+0000","last_undegraded":"2024-09-19T09:19:32.846921+0000","last_fullsized":"2024-09-19T09:19:32.846921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.852142+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:19:32.852142+0000","last_peered":"2024-09-19T09:19:32.852142+0000","last_clean":"2024-09-19T09:19:32.852142+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:19:32.852142+0000","last_undegraded":"2024-09-19T09:19:32.852142+0000","last_fullsized":"2024-09-19T09:19:32.852142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":39,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:35.807314+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:19:35.807314+0000","last_peered":"2024-09-19T09:19:35.807314+0000","last_clean":"2024-09-19T09:19:35.807314+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:19:35.807314+0000","last_undegraded":"2024-09-19T09:19:35.807314+0000","last_fullsized":"2024-09-19T09:19:35.807314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847080+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:19:32.847080+0000","last_peered":"2024-09-19T09:19:32.847080+0000","last_clean":"2024-09-19T09:19:32.847080+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:19:32.847080+0000","last_undegraded":"2024-09-19T09:19:32.847080+0000","last_fullsized":"2024-09-19T09:19:32.847080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845870+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:19:32.845870+0000","last_peered":"2024-09-19T09:19:32.845870+0000","last_clean":"2024-09-19T09:19:32.845870+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:19:32.845870+0000","last_undegraded":"2024-09-19T09:19:32.845870+0000","last_fullsized":"2024-09-19T09:19:32.845870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846715+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:19:32.846715+0000","last_peered":"2024-09-19T09:19:32.846715+0000","last_clean":"2024-09-19T09:19:32.846715+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:19:32.846715+0000","last_undegraded":"2024-09-19T09:19:32.846715+0000","last_fullsized":"2024-09-19T09:19:32.846715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845885+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:19:32.845885+0000","last_peered":"2024-09-19T09:19:32.845885+0000","last_clean":"2024-09-19T09:19:32.845885+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:19:32.845885+0000","last_undegraded":"2024-09-19T09:19:32.845885+0000","last_fullsized":"2024-09-19T09:19:32.845885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844440+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:19:32.844440+0000","last_peered":"2024-09-19T09:19:32.844440+0000","last_clean":"2024-09-19T09:19:32.844440+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:19:32.844440+0000","last_undegraded":"2024-09-19T09:19:32.844440+0000","last_fullsized":"2024-09-19T09:19:32.844440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846865+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:19:32.846865+0000","last_peered":"2024-09-19T09:19:32.846865+0000","last_clean":"2024-09-19T09:19:32.846865+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:19:32.846865+0000","last_undegraded":"2024-09-19T09:19:32.846865+0000","last_fullsized":"2024-09-19T09:19:32.846865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847897+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:19:32.847897+0000","last_peered":"2024-09-19T09:19:32.847897+0000","last_clean":"2024-09-19T09:19:32.847897+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:19:32.847897+0000","last_undegraded":"2024-09-19T09:19:32.847897+0000","last_fullsized":"2024-09-19T09:19:32.847897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846620+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:19:32.846620+0000","last_peered":"2024-09-19T09:19:32.846620+0000","last_clean":"2024-09-19T09:19:32.846620+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:19:32.846620+0000","last_undegraded":"2024-09-19T09:19:32.846620+0000","last_fullsized":"2024-09-19T09:19:32.846620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847757+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:19:32.847757+0000","last_peered":"2024-09-19T09:19:32.847757+0000","last_clean":"2024-09-19T09:19:32.847757+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:19:32.847757+0000","last_undegraded":"2024-09-19T09:19:32.847757+0000","last_fullsized":"2024-09-19T09:19:32.847757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849461+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:19:32.849461+0000","last_peered":"2024-09-19T09:19:32.849461+0000","last_clean":"2024-09-19T09:19:32.849461+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:19:32.849461+0000","last_undegraded":"2024-09-19T09:19:32.849461+0000","last_fullsized":"2024-09-19T09:19:32.849461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847947+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:19:32.847947+0000","last_peered":"2024-09-19T09:19:32.847947+0000","last_clean":"2024-09-19T09:19:32.847947+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:19:32.847947+0000","last_undegraded":"2024-09-19T09:19:32.847947+0000","last_fullsized":"2024-09-19T09:19:32.847947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847294+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:19:32.847294+0000","last_peered":"2024-09-19T09:19:32.847294+0000","last_clean":"2024-09-19T09:19:32.847294+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:19:32.847294+0000","last_undegraded":"2024-09-19T09:19:32.847294+0000","last_fullsized":"2024-09-19T09:19:32.847294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883786+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:19:32.883786+0000","last_peered":"2024-09-19T09:19:32.883786+0000","last_clean":"2024-09-19T09:19:32.883786+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:19:32.883786+0000","last_undegraded":"2024-09-19T09:19:32.883786+0000","last_fullsized":"2024-09-19T09:19:32.883786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843580+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:19:32.843580+0000","last_peered":"2024-09-19T09:19:32.843580+0000","last_clean":"2024-09-19T09:19:32.843580+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:19:32.843580+0000","last_undegraded":"2024-09-19T09:19:32.843580+0000","last_fullsized":"2024-09-19T09:19:32.843580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847240+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:19:32.847240+0000","last_peered":"2024-09-19T09:19:32.847240+0000","last_clean":"2024-09-19T09:19:32.847240+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:19:32.847240+0000","last_undegraded":"2024-09-19T09:19:32.847240+0000","last_fullsized":"2024-09-19T09:19:32.847240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847530+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:19:32.847530+0000","last_peered":"2024-09-19T09:19:32.847530+0000","last_clean":"2024-09-19T09:19:32.847530+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:19:32.847530+0000","last_undegraded":"2024-09-19T09:19:32.847530+0000","last_fullsized":"2024-09-19T09:19:32.847530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:39.812639+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:19:39.812639+0000","last_peered":"2024-09-19T09:19:39.812639+0000","last_clean":"2024-09-19T09:19:39.812639+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:19:39.812639+0000","last_undegraded":"2024-09-19T09:19:39.812639+0000","last_fullsized":"2024-09-19T09:19:39.812639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846075+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:19:32.846075+0000","last_peered":"2024-09-19T09:19:32.846075+0000","last_clean":"2024-09-19T09:19:32.846075+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:19:32.846075+0000","last_undegraded":"2024-09-19T09:19:32.846075+0000","last_fullsized":"2024-09-19T09:19:32.846075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847411+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:19:32.847411+0000","last_peered":"2024-09-19T09:19:32.847411+0000","last_clean":"2024-09-19T09:19:32.847411+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:19:32.847411+0000","last_undegraded":"2024-09-19T09:19:32.847411+0000","last_fullsized":"2024-09-19T09:19:32.847411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844785+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:19:32.844785+0000","last_peered":"2024-09-19T09:19:32.844785+0000","last_clean":"2024-09-19T09:19:32.844785+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:19:32.844785+0000","last_undegraded":"2024-09-19T09:19:32.844785+0000","last_fullsized":"2024-09-19T09:19:32.844785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844973+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:19:32.844973+0000","last_peered":"2024-09-19T09:19:32.844973+0000","last_clean":"2024-09-19T09:19:32.844973+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:19:32.844973+0000","last_undegraded":"2024-09-19T09:19:32.844973+0000","last_fullsized":"2024-09-19T09:19:32.844973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846736+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:19:32.846736+0000","last_peered":"2024-09-19T09:19:32.846736+0000","last_clean":"2024-09-19T09:19:32.846736+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:19:32.846736+0000","last_undegraded":"2024-09-19T09:19:32.846736+0000","last_fullsized":"2024-09-19T09:19:32.846736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846605+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:19:32.846605+0000","last_peered":"2024-09-19T09:19:32.846605+0000","last_clean":"2024-09-19T09:19:32.846605+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:19:32.846605+0000","last_undegraded":"2024-09-19T09:19:32.846605+0000","last_fullsized":"2024-09-19T09:19:32.846605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'7","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:36.793784+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:19:36.793784+0000","last_peered":"2024-09-19T09:19:36.793784+0000","last_clean":"2024-09-19T09:19:36.793784+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:19:36.793784+0000","last_undegraded":"2024-09-19T09:19:36.793784+0000","last_fullsized":"2024-09-19T09:19:36.793784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843716+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:19:32.843716+0000","last_peered":"2024-09-19T09:19:32.843716+0000","last_clean":"2024-09-19T09:19:32.843716+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:19:32.843716+0000","last_undegraded":"2024-09-19T09:19:32.843716+0000","last_fullsized":"2024-09-19T09:19:32.843716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884108+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:19:32.884108+0000","last_peered":"2024-09-19T09:19:32.884108+0000","last_clean":"2024-09-19T09:19:32.884108+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:19:32.884108+0000","last_undegraded":"2024-09-19T09:19:32.884108+0000","last_fullsized":"2024-09-19T09:19:32.884108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850919+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:19:32.850919+0000","last_peered":"2024-09-19T09:19:32.850919+0000","last_clean":"2024-09-19T09:19:32.850919+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:19:32.850919+0000","last_undegraded":"2024-09-19T09:19:32.850919+0000","last_fullsized":"2024-09-19T09:19:32.850919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884611+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:19:32.884611+0000","last_peered":"2024-09-19T09:19:32.884611+0000","last_clean":"2024-09-19T09:19:32.884611+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:19:32.884611+0000","last_undegraded":"2024-09-19T09:19:32.884611+0000","last_fullsized":"2024-09-19T09:19:32.884611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845457+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:19:32.845457+0000","last_peered":"2024-09-19T09:19:32.845457+0000","last_clean":"2024-09-19T09:19:32.845457+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:19:32.845457+0000","last_undegraded":"2024-09-19T09:19:32.845457+0000","last_fullsized":"2024-09-19T09:19:32.845457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843698+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:19:32.843698+0000","last_peered":"2024-09-19T09:19:32.843698+0000","last_clean":"2024-09-19T09:19:32.843698+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:19:32.843698+0000","last_undegraded":"2024-09-19T09:19:32.843698+0000","last_fullsized":"2024-09-19T09:19:32.843698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844286+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:19:32.844286+0000","last_peered":"2024-09-19T09:19:32.844286+0000","last_clean":"2024-09-19T09:19:32.844286+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:19:32.844286+0000","last_undegraded":"2024-09-19T09:19:32.844286+0000","last_fullsized":"2024-09-19T09:19:32.844286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847996+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:19:32.847996+0000","last_peered":"2024-09-19T09:19:32.847996+0000","last_clean":"2024-09-19T09:19:32.847996+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:19:32.847996+0000","last_undegraded":"2024-09-19T09:19:32.847996+0000","last_fullsized":"2024-09-19T09:19:32.847996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843584+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:19:32.843584+0000","last_peered":"2024-09-19T09:19:32.843584+0000","last_clean":"2024-09-19T09:19:32.843584+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:19:32.843584+0000","last_undegraded":"2024-09-19T09:19:32.843584+0000","last_fullsized":"2024-09-19T09:19:32.843584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845593+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:19:32.845593+0000","last_peered":"2024-09-19T09:19:32.845593+0000","last_clean":"2024-09-19T09:19:32.845593+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:19:32.845593+0000","last_undegraded":"2024-09-19T09:19:32.845593+0000","last_fullsized":"2024-09-19T09:19:32.845593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847264+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:19:32.847264+0000","last_peered":"2024-09-19T09:19:32.847264+0000","last_clean":"2024-09-19T09:19:32.847264+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:19:32.847264+0000","last_undegraded":"2024-09-19T09:19:32.847264+0000","last_fullsized":"2024-09-19T09:19:32.847264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846386+0000","last_change":"2024-09-19T09:19:17.796414+0000","last_active":"2024-09-19T09:19:32.846386+0000","last_peered":"2024-09-19T09:19:32.846386+0000","last_clean":"2024-09-19T09:19:32.846386+0000","last_became_active":"2024-09-19T09:19:17.796031+0000","last_became_peered":"2024-09-19T09:19:17.796031+0000","last_unstale":"2024-09-19T09:19:32.846386+0000","last_undegraded":"2024-09-19T09:19:32.846386+0000","last_fullsized":"2024-09-19T09:19:32.846386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:40.707180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884344+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:19:32.884344+0000","last_peered":"2024-09-19T09:19:32.884344+0000","last_clean":"2024-09-19T09:19:32.884344+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:19:32.884344+0000","last_undegraded":"2024-09-19T09:19:32.884344+0000","last_fullsized":"2024-09-19T09:19:32.884344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.889702+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:19:32.889702+0000","last_peered":"2024-09-19T09:19:32.889702+0000","last_clean":"2024-09-19T09:19:32.889702+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:19:32.889702+0000","last_undegraded":"2024-09-19T09:19:32.889702+0000","last_fullsized":"2024-09-19T09:19:32.889702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843993+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:19:32.843993+0000","last_peered":"2024-09-19T09:19:32.843993+0000","last_clean":"2024-09-19T09:19:32.843993+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:19:32.843993+0000","last_undegraded":"2024-09-19T09:19:32.843993+0000","last_fullsized":"2024-09-19T09:19:32.843993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843830+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:19:32.843830+0000","last_peered":"2024-09-19T09:19:32.843830+0000","last_clean":"2024-09-19T09:19:32.843830+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:19:32.843830+0000","last_undegraded":"2024-09-19T09:19:32.843830+0000","last_fullsized":"2024-09-19T09:19:32.843830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846113+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:19:32.846113+0000","last_peered":"2024-09-19T09:19:32.846113+0000","last_clean":"2024-09-19T09:19:32.846113+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:19:32.846113+0000","last_undegraded":"2024-09-19T09:19:32.846113+0000","last_fullsized":"2024-09-19T09:19:32.846113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45068,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":95,"num_read_kb":97,"num_write":148,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":135204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":427224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32696,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712456,"statfs":{"total":95995035648,"available":95961554944,"internally_reserved":0,"allocated":1548288,"data_stored":1060129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":427426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":427346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561061,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1019278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":426815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920815,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1018569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":427645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476797,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":468989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":453555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":897024,"data_stored":428086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":42381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:19:43.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:19:43.646 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:44.050 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:43 smithi052 ceph-mon[30947]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 -- 172.21.15.52:0/887400434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 msgr2=0x7fdb6810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/887400434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb6810bb50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009900 tx=0x7fdb5c02a480 comp rx=0 tx=0).stop 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 -- 172.21.15.52:0/887400434 shutdown_connections 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/887400434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/887400434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb6810bb50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/887400434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb68103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 -- 172.21.15.52:0/887400434 >> 172.21.15.52:0/887400434 conn(0x7fdb680fc7a0 msgr2=0x7fdb680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 -- 172.21.15.52:0/887400434 shutdown_connections 2024-09-19T09:19:44.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.132+0000 7fdb6fcde640 1 -- 172.21.15.52:0/887400434 wait complete. 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.133+0000 7fdb6fcde640 1 Processor -- start 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.133+0000 7fdb6fcde640 1 -- start start 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.133+0000 7fdb6fcde640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb681984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.133+0000 7fdb6fcde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.133+0000 7fdb6fcde640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6fcde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb68111f70 con 0x7fdb68103660 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6fcde640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb68111df0 con 0x7fdb68102d40 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6fcde640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb681120f0 con 0x7fdb6810c170 2024-09-19T09:19:44.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51726/0 (socket says 172.21.15.52:51726) 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 -- 172.21.15.52:0/2299000889 learned_addr learned my addr 172.21.15.52:0/2299000889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6da7a640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb681984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6e27b640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 -- 172.21.15.52:0/2299000889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 msgr2=0x7fdb6819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 -- 172.21.15.52:0/2299000889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 msgr2=0x7fdb681984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb681984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 -- 172.21.15.52:0/2299000889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6819d470 con 0x7fdb68103660 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6da7a640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb681984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6e27b640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6d279640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c006010 tx=0x7fdb5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c03f030 con 0x7fdb68103660 2024-09-19T09:19:44.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6819d700 con 0x7fdb68103660 2024-09-19T09:19:44.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5c003ce0 con 0x7fdb68103660 2024-09-19T09:19:44.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.134+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c035070 con 0x7fdb68103660 2024-09-19T09:19:44.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.135+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb681a5040 con 0x7fdb68103660 2024-09-19T09:19:44.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.135+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6806b070 con 0x7fdb68103660 2024-09-19T09:19:44.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.137+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb5c042030 con 0x7fdb68103660 2024-09-19T09:19:44.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.137+0000 7fdb5affd640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 0x7fdb540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.137+0000 7fdb6da7a640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 0x7fdb540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.137+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fdb5c0f0150 con 0x7fdb68103660 2024-09-19T09:19:44.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.138+0000 7fdb6da7a640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 0x7fdb540a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb640058c0 tx=0x7fdb64005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.142+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb5c0bcdb0 con 0x7fdb68103660 2024-09-19T09:19:44.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:43 smithi169 ceph-mon[35454]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:44.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:43 smithi086 ceph-mon[34813]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.313+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb68062630 con 0x7fdb540a32d0 2024-09-19T09:19:44.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.320+0000 7fdb5affd640 1 -- 172.21.15.52:0/2299000889 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7fdb68062630 con 0x7fdb540a32d0 2024-09-19T09:19:44.322 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:44.323 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 msgr2=0x7fdb540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 0x7fdb540a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdb640058c0 tx=0x7fdb64005850 comp rx=0 tx=0).stop 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 msgr2=0x7fdb68198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c006010 tx=0x7fdb5c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 shutdown_connections 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb540a32d0 0x7fdb540a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb6810c170 0x7fdb6819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb68103660 0x7fdb68198a00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 --2- 172.21.15.52:0/2299000889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb68102d40 0x7fdb681984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 >> 172.21.15.52:0/2299000889 conn(0x7fdb680fc7a0 msgr2=0x7fdb680fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 shutdown_connections 2024-09-19T09:19:44.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:44.323+0000 7fdb6fcde640 1 -- 172.21.15.52:0/2299000889 wait complete. 2024-09-19T09:19:44.950 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:44 smithi052 ceph-mon[30947]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:44.951 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T09:19:43.283584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646705,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":242,"num_read_kb":227,"num_write":336,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407368,"kb_used_data":12324,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534456,"statfs":{"total":1151940427776,"available":1151523282944,"internally_reserved":0,"allocated":12619776,"data_stored":7059411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50722,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":92,"num_write":29,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.441426"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844770+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:19:32.844770+0000","last_peered":"2024-09-19T09:19:32.844770+0000","last_clean":"2024-09-19T09:19:32.844770+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:19:32.844770+0000","last_undegraded":"2024-09-19T09:19:32.844770+0000","last_fullsized":"2024-09-19T09:19:32.844770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846379+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:19:32.846379+0000","last_peered":"2024-09-19T09:19:32.846379+0000","last_clean":"2024-09-19T09:19:32.846379+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:19:32.846379+0000","last_undegraded":"2024-09-19T09:19:32.846379+0000","last_fullsized":"2024-09-19T09:19:32.846379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846367+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:19:32.846367+0000","last_peered":"2024-09-19T09:19:32.846367+0000","last_clean":"2024-09-19T09:19:32.846367+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:19:32.846367+0000","last_undegraded":"2024-09-19T09:19:32.846367+0000","last_fullsized":"2024-09-19T09:19:32.846367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883949+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:19:32.883949+0000","last_peered":"2024-09-19T09:19:32.883949+0000","last_clean":"2024-09-19T09:19:32.883949+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:19:32.883949+0000","last_undegraded":"2024-09-19T09:19:32.883949+0000","last_fullsized":"2024-09-19T09:19:32.883949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845445+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:19:32.845445+0000","last_peered":"2024-09-19T09:19:32.845445+0000","last_clean":"2024-09-19T09:19:32.845445+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:19:32.845445+0000","last_undegraded":"2024-09-19T09:19:32.845445+0000","last_fullsized":"2024-09-19T09:19:32.845445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844658+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:19:32.844658+0000","last_peered":"2024-09-19T09:19:32.844658+0000","last_clean":"2024-09-19T09:19:32.844658+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:19:32.844658+0000","last_undegraded":"2024-09-19T09:19:32.844658+0000","last_fullsized":"2024-09-19T09:19:32.844658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851709+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:19:32.851709+0000","last_peered":"2024-09-19T09:19:32.851709+0000","last_clean":"2024-09-19T09:19:32.851709+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:19:32.851709+0000","last_undegraded":"2024-09-19T09:19:32.851709+0000","last_fullsized":"2024-09-19T09:19:32.851709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843340+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:19:32.843340+0000","last_peered":"2024-09-19T09:19:32.843340+0000","last_clean":"2024-09-19T09:19:32.843340+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:19:32.843340+0000","last_undegraded":"2024-09-19T09:19:32.843340+0000","last_fullsized":"2024-09-19T09:19:32.843340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.885245+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:19:32.885245+0000","last_peered":"2024-09-19T09:19:32.885245+0000","last_clean":"2024-09-19T09:19:32.885245+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:19:32.885245+0000","last_undegraded":"2024-09-19T09:19:32.885245+0000","last_fullsized":"2024-09-19T09:19:32.885245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845115+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:19:32.845115+0000","last_peered":"2024-09-19T09:19:32.845115+0000","last_clean":"2024-09-19T09:19:32.845115+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:19:32.845115+0000","last_undegraded":"2024-09-19T09:19:32.845115+0000","last_fullsized":"2024-09-19T09:19:32.845115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847894+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:19:32.847894+0000","last_peered":"2024-09-19T09:19:32.847894+0000","last_clean":"2024-09-19T09:19:32.847894+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:19:32.847894+0000","last_undegraded":"2024-09-19T09:19:32.847894+0000","last_fullsized":"2024-09-19T09:19:32.847894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884019+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:19:32.884019+0000","last_peered":"2024-09-19T09:19:32.884019+0000","last_clean":"2024-09-19T09:19:32.884019+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:19:32.884019+0000","last_undegraded":"2024-09-19T09:19:32.884019+0000","last_fullsized":"2024-09-19T09:19:32.884019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847227+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:19:32.847227+0000","last_peered":"2024-09-19T09:19:32.847227+0000","last_clean":"2024-09-19T09:19:32.847227+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:19:32.847227+0000","last_undegraded":"2024-09-19T09:19:32.847227+0000","last_fullsized":"2024-09-19T09:19:32.847227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846212+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:19:32.846212+0000","last_peered":"2024-09-19T09:19:32.846212+0000","last_clean":"2024-09-19T09:19:32.846212+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:19:32.846212+0000","last_undegraded":"2024-09-19T09:19:32.846212+0000","last_fullsized":"2024-09-19T09:19:32.846212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846172+0000","last_change":"2024-09-19T09:19:17.802304+0000","last_active":"2024-09-19T09:19:32.846172+0000","last_peered":"2024-09-19T09:19:32.846172+0000","last_clean":"2024-09-19T09:19:32.846172+0000","last_became_active":"2024-09-19T09:19:17.801658+0000","last_became_peered":"2024-09-19T09:19:17.801658+0000","last_unstale":"2024-09-19T09:19:32.846172+0000","last_undegraded":"2024-09-19T09:19:32.846172+0000","last_fullsized":"2024-09-19T09:19:32.846172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:47.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884023+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:19:32.884023+0000","last_peered":"2024-09-19T09:19:32.884023+0000","last_clean":"2024-09-19T09:19:32.884023+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:19:32.884023+0000","last_undegraded":"2024-09-19T09:19:32.884023+0000","last_fullsized":"2024-09-19T09:19:32.884023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844811+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:19:32.844811+0000","last_peered":"2024-09-19T09:19:32.844811+0000","last_clean":"2024-09-19T09:19:32.844811+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:19:32.844811+0000","last_undegraded":"2024-09-19T09:19:32.844811+0000","last_fullsized":"2024-09-19T09:19:32.844811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846300+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:19:32.846300+0000","last_peered":"2024-09-19T09:19:32.846300+0000","last_clean":"2024-09-19T09:19:32.846300+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:19:32.846300+0000","last_undegraded":"2024-09-19T09:19:32.846300+0000","last_fullsized":"2024-09-19T09:19:32.846300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849580+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:19:32.849580+0000","last_peered":"2024-09-19T09:19:32.849580+0000","last_clean":"2024-09-19T09:19:32.849580+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:19:32.849580+0000","last_undegraded":"2024-09-19T09:19:32.849580+0000","last_fullsized":"2024-09-19T09:19:32.849580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844346+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:19:32.844346+0000","last_peered":"2024-09-19T09:19:32.844346+0000","last_clean":"2024-09-19T09:19:32.844346+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:19:32.844346+0000","last_undegraded":"2024-09-19T09:19:32.844346+0000","last_fullsized":"2024-09-19T09:19:32.844346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847322+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:19:32.847322+0000","last_peered":"2024-09-19T09:19:32.847322+0000","last_clean":"2024-09-19T09:19:32.847322+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:19:32.847322+0000","last_undegraded":"2024-09-19T09:19:32.847322+0000","last_fullsized":"2024-09-19T09:19:32.847322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884352+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:19:32.884352+0000","last_peered":"2024-09-19T09:19:32.884352+0000","last_clean":"2024-09-19T09:19:32.884352+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:19:32.884352+0000","last_undegraded":"2024-09-19T09:19:32.884352+0000","last_fullsized":"2024-09-19T09:19:32.884352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843342+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:19:32.843342+0000","last_peered":"2024-09-19T09:19:32.843342+0000","last_clean":"2024-09-19T09:19:32.843342+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:19:32.843342+0000","last_undegraded":"2024-09-19T09:19:32.843342+0000","last_fullsized":"2024-09-19T09:19:32.843342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851217+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:19:32.851217+0000","last_peered":"2024-09-19T09:19:32.851217+0000","last_clean":"2024-09-19T09:19:32.851217+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:19:32.851217+0000","last_undegraded":"2024-09-19T09:19:32.851217+0000","last_fullsized":"2024-09-19T09:19:32.851217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843604+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:19:32.843604+0000","last_peered":"2024-09-19T09:19:32.843604+0000","last_clean":"2024-09-19T09:19:32.843604+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:19:32.843604+0000","last_undegraded":"2024-09-19T09:19:32.843604+0000","last_fullsized":"2024-09-19T09:19:32.843604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850101+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:19:32.850101+0000","last_peered":"2024-09-19T09:19:32.850101+0000","last_clean":"2024-09-19T09:19:32.850101+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:19:32.850101+0000","last_undegraded":"2024-09-19T09:19:32.850101+0000","last_fullsized":"2024-09-19T09:19:32.850101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844566+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:19:32.844566+0000","last_peered":"2024-09-19T09:19:32.844566+0000","last_clean":"2024-09-19T09:19:32.844566+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:19:32.844566+0000","last_undegraded":"2024-09-19T09:19:32.844566+0000","last_fullsized":"2024-09-19T09:19:32.844566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846511+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:19:32.846511+0000","last_peered":"2024-09-19T09:19:32.846511+0000","last_clean":"2024-09-19T09:19:32.846511+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:19:32.846511+0000","last_undegraded":"2024-09-19T09:19:32.846511+0000","last_fullsized":"2024-09-19T09:19:32.846511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846232+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:19:32.846232+0000","last_peered":"2024-09-19T09:19:32.846232+0000","last_clean":"2024-09-19T09:19:32.846232+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:19:32.846232+0000","last_undegraded":"2024-09-19T09:19:32.846232+0000","last_fullsized":"2024-09-19T09:19:32.846232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848116+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:19:32.848116+0000","last_peered":"2024-09-19T09:19:32.848116+0000","last_clean":"2024-09-19T09:19:32.848116+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:19:32.848116+0000","last_undegraded":"2024-09-19T09:19:32.848116+0000","last_fullsized":"2024-09-19T09:19:32.848116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848127+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:19:32.848127+0000","last_peered":"2024-09-19T09:19:32.848127+0000","last_clean":"2024-09-19T09:19:32.848127+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:19:32.848127+0000","last_undegraded":"2024-09-19T09:19:32.848127+0000","last_fullsized":"2024-09-19T09:19:32.848127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844176+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:19:32.844176+0000","last_peered":"2024-09-19T09:19:32.844176+0000","last_clean":"2024-09-19T09:19:32.844176+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:19:32.844176+0000","last_undegraded":"2024-09-19T09:19:32.844176+0000","last_fullsized":"2024-09-19T09:19:32.844176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845655+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:19:32.845655+0000","last_peered":"2024-09-19T09:19:32.845655+0000","last_clean":"2024-09-19T09:19:32.845655+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:19:32.845655+0000","last_undegraded":"2024-09-19T09:19:32.845655+0000","last_fullsized":"2024-09-19T09:19:32.845655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:39.812366+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:19:39.812366+0000","last_peered":"2024-09-19T09:19:39.812366+0000","last_clean":"2024-09-19T09:19:39.812366+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:19:39.812366+0000","last_undegraded":"2024-09-19T09:19:39.812366+0000","last_fullsized":"2024-09-19T09:19:39.812366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850691+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:19:32.850691+0000","last_peered":"2024-09-19T09:19:32.850691+0000","last_clean":"2024-09-19T09:19:32.850691+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:19:32.850691+0000","last_undegraded":"2024-09-19T09:19:32.850691+0000","last_fullsized":"2024-09-19T09:19:32.850691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.888269+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:19:32.888269+0000","last_peered":"2024-09-19T09:19:32.888269+0000","last_clean":"2024-09-19T09:19:32.888269+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:19:32.888269+0000","last_undegraded":"2024-09-19T09:19:32.888269+0000","last_fullsized":"2024-09-19T09:19:32.888269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847552+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:19:32.847552+0000","last_peered":"2024-09-19T09:19:32.847552+0000","last_clean":"2024-09-19T09:19:32.847552+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:19:32.847552+0000","last_undegraded":"2024-09-19T09:19:32.847552+0000","last_fullsized":"2024-09-19T09:19:32.847552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843550+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:19:32.843550+0000","last_peered":"2024-09-19T09:19:32.843550+0000","last_clean":"2024-09-19T09:19:32.843550+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:19:32.843550+0000","last_undegraded":"2024-09-19T09:19:32.843550+0000","last_fullsized":"2024-09-19T09:19:32.843550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846285+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:19:32.846285+0000","last_peered":"2024-09-19T09:19:32.846285+0000","last_clean":"2024-09-19T09:19:32.846285+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:19:32.846285+0000","last_undegraded":"2024-09-19T09:19:32.846285+0000","last_fullsized":"2024-09-19T09:19:32.846285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845647+0000","last_change":"2024-09-19T09:19:17.803446+0000","last_active":"2024-09-19T09:19:32.845647+0000","last_peered":"2024-09-19T09:19:32.845647+0000","last_clean":"2024-09-19T09:19:32.845647+0000","last_became_active":"2024-09-19T09:19:17.803092+0000","last_became_peered":"2024-09-19T09:19:17.803092+0000","last_unstale":"2024-09-19T09:19:32.845647+0000","last_undegraded":"2024-09-19T09:19:32.845647+0000","last_fullsized":"2024-09-19T09:19:32.845647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:46.709525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.814474+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:19:41.814474+0000","last_peered":"2024-09-19T09:19:41.814474+0000","last_clean":"2024-09-19T09:19:41.814474+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:19:41.814474+0000","last_undegraded":"2024-09-19T09:19:41.814474+0000","last_fullsized":"2024-09-19T09:19:41.814474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884972+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:19:32.884972+0000","last_peered":"2024-09-19T09:19:32.884972+0000","last_clean":"2024-09-19T09:19:32.884972+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:19:32.884972+0000","last_undegraded":"2024-09-19T09:19:32.884972+0000","last_fullsized":"2024-09-19T09:19:32.884972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847777+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:19:32.847777+0000","last_peered":"2024-09-19T09:19:32.847777+0000","last_clean":"2024-09-19T09:19:32.847777+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:19:32.847777+0000","last_undegraded":"2024-09-19T09:19:32.847777+0000","last_fullsized":"2024-09-19T09:19:32.847777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846616+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:19:32.846616+0000","last_peered":"2024-09-19T09:19:32.846616+0000","last_clean":"2024-09-19T09:19:32.846616+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:19:32.846616+0000","last_undegraded":"2024-09-19T09:19:32.846616+0000","last_fullsized":"2024-09-19T09:19:32.846616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884593+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:19:32.884593+0000","last_peered":"2024-09-19T09:19:32.884593+0000","last_clean":"2024-09-19T09:19:32.884593+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:19:32.884593+0000","last_undegraded":"2024-09-19T09:19:32.884593+0000","last_fullsized":"2024-09-19T09:19:32.884593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'26","reported_seq":86,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:42.815865+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:19:42.815865+0000","last_peered":"2024-09-19T09:19:42.815865+0000","last_clean":"2024-09-19T09:19:42.815865+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:19:42.815865+0000","last_undegraded":"2024-09-19T09:19:42.815865+0000","last_fullsized":"2024-09-19T09:19:42.815865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52100,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":69,"num_write":27,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846623+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:19:32.846623+0000","last_peered":"2024-09-19T09:19:32.846623+0000","last_clean":"2024-09-19T09:19:32.846623+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:19:32.846623+0000","last_undegraded":"2024-09-19T09:19:32.846623+0000","last_fullsized":"2024-09-19T09:19:32.846623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.861670+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:19:32.861670+0000","last_peered":"2024-09-19T09:19:32.861670+0000","last_clean":"2024-09-19T09:19:32.861670+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:19:32.861670+0000","last_undegraded":"2024-09-19T09:19:32.861670+0000","last_fullsized":"2024-09-19T09:19:32.861670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850543+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:19:32.850543+0000","last_peered":"2024-09-19T09:19:32.850543+0000","last_clean":"2024-09-19T09:19:32.850543+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:19:32.850543+0000","last_undegraded":"2024-09-19T09:19:32.850543+0000","last_fullsized":"2024-09-19T09:19:32.850543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846921+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:19:32.846921+0000","last_peered":"2024-09-19T09:19:32.846921+0000","last_clean":"2024-09-19T09:19:32.846921+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:19:32.846921+0000","last_undegraded":"2024-09-19T09:19:32.846921+0000","last_fullsized":"2024-09-19T09:19:32.846921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.852142+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:19:32.852142+0000","last_peered":"2024-09-19T09:19:32.852142+0000","last_clean":"2024-09-19T09:19:32.852142+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:19:32.852142+0000","last_undegraded":"2024-09-19T09:19:32.852142+0000","last_fullsized":"2024-09-19T09:19:32.852142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.814264+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:19:40.814264+0000","last_peered":"2024-09-19T09:19:40.814264+0000","last_clean":"2024-09-19T09:19:40.814264+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:19:40.814264+0000","last_undegraded":"2024-09-19T09:19:40.814264+0000","last_fullsized":"2024-09-19T09:19:40.814264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847080+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:19:32.847080+0000","last_peered":"2024-09-19T09:19:32.847080+0000","last_clean":"2024-09-19T09:19:32.847080+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:19:32.847080+0000","last_undegraded":"2024-09-19T09:19:32.847080+0000","last_fullsized":"2024-09-19T09:19:32.847080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845870+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:19:32.845870+0000","last_peered":"2024-09-19T09:19:32.845870+0000","last_clean":"2024-09-19T09:19:32.845870+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:19:32.845870+0000","last_undegraded":"2024-09-19T09:19:32.845870+0000","last_fullsized":"2024-09-19T09:19:32.845870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846715+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:19:32.846715+0000","last_peered":"2024-09-19T09:19:32.846715+0000","last_clean":"2024-09-19T09:19:32.846715+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:19:32.846715+0000","last_undegraded":"2024-09-19T09:19:32.846715+0000","last_fullsized":"2024-09-19T09:19:32.846715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845885+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:19:32.845885+0000","last_peered":"2024-09-19T09:19:32.845885+0000","last_clean":"2024-09-19T09:19:32.845885+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:19:32.845885+0000","last_undegraded":"2024-09-19T09:19:32.845885+0000","last_fullsized":"2024-09-19T09:19:32.845885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844440+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:19:32.844440+0000","last_peered":"2024-09-19T09:19:32.844440+0000","last_clean":"2024-09-19T09:19:32.844440+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:19:32.844440+0000","last_undegraded":"2024-09-19T09:19:32.844440+0000","last_fullsized":"2024-09-19T09:19:32.844440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846865+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:19:32.846865+0000","last_peered":"2024-09-19T09:19:32.846865+0000","last_clean":"2024-09-19T09:19:32.846865+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:19:32.846865+0000","last_undegraded":"2024-09-19T09:19:32.846865+0000","last_fullsized":"2024-09-19T09:19:32.846865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847897+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:19:32.847897+0000","last_peered":"2024-09-19T09:19:32.847897+0000","last_clean":"2024-09-19T09:19:32.847897+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:19:32.847897+0000","last_undegraded":"2024-09-19T09:19:32.847897+0000","last_fullsized":"2024-09-19T09:19:32.847897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846620+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:19:32.846620+0000","last_peered":"2024-09-19T09:19:32.846620+0000","last_clean":"2024-09-19T09:19:32.846620+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:19:32.846620+0000","last_undegraded":"2024-09-19T09:19:32.846620+0000","last_fullsized":"2024-09-19T09:19:32.846620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847757+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:19:32.847757+0000","last_peered":"2024-09-19T09:19:32.847757+0000","last_clean":"2024-09-19T09:19:32.847757+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:19:32.847757+0000","last_undegraded":"2024-09-19T09:19:32.847757+0000","last_fullsized":"2024-09-19T09:19:32.847757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849461+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:19:32.849461+0000","last_peered":"2024-09-19T09:19:32.849461+0000","last_clean":"2024-09-19T09:19:32.849461+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:19:32.849461+0000","last_undegraded":"2024-09-19T09:19:32.849461+0000","last_fullsized":"2024-09-19T09:19:32.849461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847947+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:19:32.847947+0000","last_peered":"2024-09-19T09:19:32.847947+0000","last_clean":"2024-09-19T09:19:32.847947+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:19:32.847947+0000","last_undegraded":"2024-09-19T09:19:32.847947+0000","last_fullsized":"2024-09-19T09:19:32.847947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847294+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:19:32.847294+0000","last_peered":"2024-09-19T09:19:32.847294+0000","last_clean":"2024-09-19T09:19:32.847294+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:19:32.847294+0000","last_undegraded":"2024-09-19T09:19:32.847294+0000","last_fullsized":"2024-09-19T09:19:32.847294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883786+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:19:32.883786+0000","last_peered":"2024-09-19T09:19:32.883786+0000","last_clean":"2024-09-19T09:19:32.883786+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:19:32.883786+0000","last_undegraded":"2024-09-19T09:19:32.883786+0000","last_fullsized":"2024-09-19T09:19:32.883786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843580+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:19:32.843580+0000","last_peered":"2024-09-19T09:19:32.843580+0000","last_clean":"2024-09-19T09:19:32.843580+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:19:32.843580+0000","last_undegraded":"2024-09-19T09:19:32.843580+0000","last_fullsized":"2024-09-19T09:19:32.843580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847240+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:19:32.847240+0000","last_peered":"2024-09-19T09:19:32.847240+0000","last_clean":"2024-09-19T09:19:32.847240+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:19:32.847240+0000","last_undegraded":"2024-09-19T09:19:32.847240+0000","last_fullsized":"2024-09-19T09:19:32.847240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847530+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:19:32.847530+0000","last_peered":"2024-09-19T09:19:32.847530+0000","last_clean":"2024-09-19T09:19:32.847530+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:19:32.847530+0000","last_undegraded":"2024-09-19T09:19:32.847530+0000","last_fullsized":"2024-09-19T09:19:32.847530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:39.812639+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:19:39.812639+0000","last_peered":"2024-09-19T09:19:39.812639+0000","last_clean":"2024-09-19T09:19:39.812639+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:19:39.812639+0000","last_undegraded":"2024-09-19T09:19:39.812639+0000","last_fullsized":"2024-09-19T09:19:39.812639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846075+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:19:32.846075+0000","last_peered":"2024-09-19T09:19:32.846075+0000","last_clean":"2024-09-19T09:19:32.846075+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:19:32.846075+0000","last_undegraded":"2024-09-19T09:19:32.846075+0000","last_fullsized":"2024-09-19T09:19:32.846075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847411+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:19:32.847411+0000","last_peered":"2024-09-19T09:19:32.847411+0000","last_clean":"2024-09-19T09:19:32.847411+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:19:32.847411+0000","last_undegraded":"2024-09-19T09:19:32.847411+0000","last_fullsized":"2024-09-19T09:19:32.847411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844785+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:19:32.844785+0000","last_peered":"2024-09-19T09:19:32.844785+0000","last_clean":"2024-09-19T09:19:32.844785+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:19:32.844785+0000","last_undegraded":"2024-09-19T09:19:32.844785+0000","last_fullsized":"2024-09-19T09:19:32.844785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844973+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:19:32.844973+0000","last_peered":"2024-09-19T09:19:32.844973+0000","last_clean":"2024-09-19T09:19:32.844973+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:19:32.844973+0000","last_undegraded":"2024-09-19T09:19:32.844973+0000","last_fullsized":"2024-09-19T09:19:32.844973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846736+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:19:32.846736+0000","last_peered":"2024-09-19T09:19:32.846736+0000","last_clean":"2024-09-19T09:19:32.846736+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:19:32.846736+0000","last_undegraded":"2024-09-19T09:19:32.846736+0000","last_fullsized":"2024-09-19T09:19:32.846736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846605+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:19:32.846605+0000","last_peered":"2024-09-19T09:19:32.846605+0000","last_clean":"2024-09-19T09:19:32.846605+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:19:32.846605+0000","last_undegraded":"2024-09-19T09:19:32.846605+0000","last_fullsized":"2024-09-19T09:19:32.846605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'7","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:36.793784+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:19:36.793784+0000","last_peered":"2024-09-19T09:19:36.793784+0000","last_clean":"2024-09-19T09:19:36.793784+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:19:36.793784+0000","last_undegraded":"2024-09-19T09:19:36.793784+0000","last_fullsized":"2024-09-19T09:19:36.793784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843716+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:19:32.843716+0000","last_peered":"2024-09-19T09:19:32.843716+0000","last_clean":"2024-09-19T09:19:32.843716+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:19:32.843716+0000","last_undegraded":"2024-09-19T09:19:32.843716+0000","last_fullsized":"2024-09-19T09:19:32.843716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884108+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:19:32.884108+0000","last_peered":"2024-09-19T09:19:32.884108+0000","last_clean":"2024-09-19T09:19:32.884108+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:19:32.884108+0000","last_undegraded":"2024-09-19T09:19:32.884108+0000","last_fullsized":"2024-09-19T09:19:32.884108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850919+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:19:32.850919+0000","last_peered":"2024-09-19T09:19:32.850919+0000","last_clean":"2024-09-19T09:19:32.850919+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:19:32.850919+0000","last_undegraded":"2024-09-19T09:19:32.850919+0000","last_fullsized":"2024-09-19T09:19:32.850919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884611+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:19:32.884611+0000","last_peered":"2024-09-19T09:19:32.884611+0000","last_clean":"2024-09-19T09:19:32.884611+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:19:32.884611+0000","last_undegraded":"2024-09-19T09:19:32.884611+0000","last_fullsized":"2024-09-19T09:19:32.884611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845457+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:19:32.845457+0000","last_peered":"2024-09-19T09:19:32.845457+0000","last_clean":"2024-09-19T09:19:32.845457+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:19:32.845457+0000","last_undegraded":"2024-09-19T09:19:32.845457+0000","last_fullsized":"2024-09-19T09:19:32.845457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843698+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:19:32.843698+0000","last_peered":"2024-09-19T09:19:32.843698+0000","last_clean":"2024-09-19T09:19:32.843698+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:19:32.843698+0000","last_undegraded":"2024-09-19T09:19:32.843698+0000","last_fullsized":"2024-09-19T09:19:32.843698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844286+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:19:32.844286+0000","last_peered":"2024-09-19T09:19:32.844286+0000","last_clean":"2024-09-19T09:19:32.844286+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:19:32.844286+0000","last_undegraded":"2024-09-19T09:19:32.844286+0000","last_fullsized":"2024-09-19T09:19:32.844286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847996+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:19:32.847996+0000","last_peered":"2024-09-19T09:19:32.847996+0000","last_clean":"2024-09-19T09:19:32.847996+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:19:32.847996+0000","last_undegraded":"2024-09-19T09:19:32.847996+0000","last_fullsized":"2024-09-19T09:19:32.847996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843584+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:19:32.843584+0000","last_peered":"2024-09-19T09:19:32.843584+0000","last_clean":"2024-09-19T09:19:32.843584+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:19:32.843584+0000","last_undegraded":"2024-09-19T09:19:32.843584+0000","last_fullsized":"2024-09-19T09:19:32.843584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845593+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:19:32.845593+0000","last_peered":"2024-09-19T09:19:32.845593+0000","last_clean":"2024-09-19T09:19:32.845593+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:19:32.845593+0000","last_undegraded":"2024-09-19T09:19:32.845593+0000","last_fullsized":"2024-09-19T09:19:32.845593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847264+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:19:32.847264+0000","last_peered":"2024-09-19T09:19:32.847264+0000","last_clean":"2024-09-19T09:19:32.847264+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:19:32.847264+0000","last_undegraded":"2024-09-19T09:19:32.847264+0000","last_fullsized":"2024-09-19T09:19:32.847264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846386+0000","last_change":"2024-09-19T09:19:17.796414+0000","last_active":"2024-09-19T09:19:32.846386+0000","last_peered":"2024-09-19T09:19:32.846386+0000","last_clean":"2024-09-19T09:19:32.846386+0000","last_became_active":"2024-09-19T09:19:17.796031+0000","last_became_peered":"2024-09-19T09:19:17.796031+0000","last_unstale":"2024-09-19T09:19:32.846386+0000","last_undegraded":"2024-09-19T09:19:32.846386+0000","last_fullsized":"2024-09-19T09:19:32.846386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:40.707180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884344+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:19:32.884344+0000","last_peered":"2024-09-19T09:19:32.884344+0000","last_clean":"2024-09-19T09:19:32.884344+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:19:32.884344+0000","last_undegraded":"2024-09-19T09:19:32.884344+0000","last_fullsized":"2024-09-19T09:19:32.884344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.889702+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:19:32.889702+0000","last_peered":"2024-09-19T09:19:32.889702+0000","last_clean":"2024-09-19T09:19:32.889702+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:19:32.889702+0000","last_undegraded":"2024-09-19T09:19:32.889702+0000","last_fullsized":"2024-09-19T09:19:32.889702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843993+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:19:32.843993+0000","last_peered":"2024-09-19T09:19:32.843993+0000","last_clean":"2024-09-19T09:19:32.843993+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:19:32.843993+0000","last_undegraded":"2024-09-19T09:19:32.843993+0000","last_fullsized":"2024-09-19T09:19:32.843993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843830+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:19:32.843830+0000","last_peered":"2024-09-19T09:19:32.843830+0000","last_clean":"2024-09-19T09:19:32.843830+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:19:32.843830+0000","last_undegraded":"2024-09-19T09:19:32.843830+0000","last_fullsized":"2024-09-19T09:19:32.843830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846113+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:19:32.846113+0000","last_peered":"2024-09-19T09:19:32.846113+0000","last_clean":"2024-09-19T09:19:32.846113+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:19:32.846113+0000","last_undegraded":"2024-09-19T09:19:32.846113+0000","last_fullsized":"2024-09-19T09:19:32.846113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56103,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":116,"num_read_kb":118,"num_write":153,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":168309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":427224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1560576,"data_stored":1071164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":888832,"data_stored":427426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":427346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561061,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1019278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":426815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920815,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1018569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":427645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280567,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476798,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":480024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":478708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":897024,"data_stored":428086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":53416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:19:44.955 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:19:44.955 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:19:44.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:19:45.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:44 smithi169 ceph-mon[35454]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:45.212 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:45.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:44 smithi086 ceph-mon[34813]: pgmap v285: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 KiB/s wr, 10 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- 172.21.15.52:0/1079883874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4102e00 msgr2=0x7f4ce4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 --2- 172.21.15.52:0/1079883874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4102e00 0x7f4ce4103280 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009900 tx=0x7f4ccc02a410 comp rx=0 tx=0).stop 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- 172.21.15.52:0/1079883874 shutdown_connections 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 --2- 172.21.15.52:0/1079883874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce41037c0 0x7f4ce410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 --2- 172.21.15.52:0/1079883874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4102e00 0x7f4ce4103280 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 --2- 172.21.15.52:0/1079883874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce4101c00 0x7f4ce4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- 172.21.15.52:0/1079883874 >> 172.21.15.52:0/1079883874 conn(0x7f4ce40fd390 msgr2=0x7f4ce40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- 172.21.15.52:0/1079883874 shutdown_connections 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- 172.21.15.52:0/1079883874 wait complete. 2024-09-19T09:19:45.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 Processor -- start 2024-09-19T09:19:45.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 -- start start 2024-09-19T09:19:45.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.672+0000 7f4cea636640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce4102e00 0x7f4ce41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 0x7f4ce419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce410d860 con 0x7f4ce4101c00 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce410d6e0 con 0x7f4ce41037c0 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce410d9e0 con 0x7f4ce4102e00 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51754/0 (socket says 172.21.15.52:51754) 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 -- 172.21.15.52:0/1757049034 learned_addr learned my addr 172.21.15.52:0/1757049034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cdbfff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce4102e00 0x7f4ce41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce8bd3640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 0x7f4ce419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 -- 172.21.15.52:0/1757049034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce4102e00 msgr2=0x7f4ce41983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce4102e00 0x7f4ce41983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 -- 172.21.15.52:0/1757049034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 msgr2=0x7f4ce419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 0x7f4ce419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 -- 172.21.15.52:0/1757049034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce419fab0 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce8bd3640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 0x7f4ce419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce3fff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400d770 tx=0x7f4cd400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4017070 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce419fda0 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cd4009c30 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4003dd0 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.673+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce41a0250 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.674+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce4108fd0 con 0x7f4ce4101c00 2024-09-19T09:19:45.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.676+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4cd4004000 con 0x7f4ce4101c00 2024-09-19T09:19:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.676+0000 7f4ce1ffb640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 0x7f4cd00a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.676+0000 7f4cdbfff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 0x7f4cd00a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.676+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f4cd40cf490 con 0x7f4ce4101c00 2024-09-19T09:19:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.677+0000 7f4cdbfff640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 0x7f4cd00a5840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:45.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.680+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cd4009de0 con 0x7f4ce4101c00 2024-09-19T09:19:45.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.925+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4ce402d7c0 con 0x7f4ce4101c00 2024-09-19T09:19:45.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.927+0000 7f4ce1ffb640 1 -- 172.21.15.52:0/1757049034 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f4cd409c030 con 0x7f4ce4101c00 2024-09-19T09:19:45.927 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-19T09:19:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCx7Otmo00yNxAAQjkkwEu76vufhNfPM+MvXA== 2024-09-19T09:19:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 msgr2=0x7f4cd00a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 0x7f4cd00a5840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc0315d0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 msgr2=0x7f4ce4197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400d770 tx=0x7f4cd400dc30 comp rx=0 tx=0).stop 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 shutdown_connections 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ce41037c0 0x7f4ce419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4cd00a3380 0x7f4cd00a5840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce4102e00 0x7f4ce41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 --2- 172.21.15.52:0/1757049034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ce4101c00 0x7f4ce4197e80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 >> 172.21.15.52:0/1757049034 conn(0x7f4ce40fd390 msgr2=0x7f4ce41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 shutdown_connections 2024-09-19T09:19:45.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:45.929+0000 7f4cea636640 1 -- 172.21.15.52:0/1757049034 wait complete. 2024-09-19T09:19:46.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:45 smithi052 ceph-mon[30947]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:46.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:45 smithi169 ceph-mon[35454]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:46.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:45 smithi086 ceph-mon[34813]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:19:46.672 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:19:46.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:19:46.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:19:46.714 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:19:46.715 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:19:46.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:19:47.012 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:47.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:46 smithi052 ceph-mon[30947]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:19:47.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:46 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:19:47.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:46 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:19:47.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:46 smithi169 ceph-mon[35454]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:19:47.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:46 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:19:47.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:46 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:19:47.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:46 smithi086 ceph-mon[34813]: pgmap v286: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T09:19:47.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:46 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:19:47.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:46 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1757049034' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:19:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 -- 172.21.15.52:0/4032296354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 msgr2=0x7f7ce010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 --2- 172.21.15.52:0/4032296354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce010e610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009ca0 tx=0x7f7cd802a950 comp rx=0 tx=0).stop 2024-09-19T09:19:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 -- 172.21.15.52:0/4032296354 shutdown_connections 2024-09-19T09:19:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 --2- 172.21.15.52:0/4032296354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce010e610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 --2- 172.21.15.52:0/4032296354 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0103660 0x7f7ce010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 --2- 172.21.15.52:0/4032296354 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0102d40 0x7f7ce0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 -- 172.21.15.52:0/4032296354 >> 172.21.15.52:0/4032296354 conn(0x7f7ce00fc7a0 msgr2=0x7f7ce00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 -- 172.21.15.52:0/4032296354 shutdown_connections 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.478+0000 7f7ce7735640 1 -- 172.21.15.52:0/4032296354 wait complete. 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 Processor -- start 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 -- start start 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0102d40 0x7f7ce019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0103660 0x7f7ce019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce0111f70 con 0x7f7ce010c170 2024-09-19T09:19:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce0111df0 con 0x7f7ce0103660 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce7735640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce01120f0 con 0x7f7ce0102d40 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51776/0 (socket says 172.21.15.52:51776) 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 -- 172.21.15.52:0/3661857303 learned_addr learned my addr 172.21.15.52:0/3661857303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce4cd0640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0103660 0x7f7ce019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce54d1640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0102d40 0x7f7ce019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 -- 172.21.15.52:0/3661857303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0102d40 msgr2=0x7f7ce019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0102d40 0x7f7ce019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 -- 172.21.15.52:0/3661857303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0103660 msgr2=0x7f7ce019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0103660 0x7f7ce019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.479+0000 7f7ce5cd2640 1 -- 172.21.15.52:0/3661857303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce019f590 con 0x7f7ce010c170 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7ce5cd2640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7cd802ae70 tx=0x7f7cd802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8034040 con 0x7f7ce010c170 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cd8030920 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce019f820 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8045480 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.480+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce01a7160 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.481+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce0103120 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.482+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7cd8037020 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.483+0000 7f7cd67fc640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 0x7f7ccc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.483+0000 7f7ce54d1640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 0x7f7ccc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.483+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f7cd80f09b0 con 0x7f7ce010c170 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.483+0000 7f7ce54d1640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 0x7f7ccc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00bbe0 tx=0x7f7cdc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.486+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cd8081210 con 0x7f7ce010c170 2024-09-19T09:19:47.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.710+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7ce01a7330 con 0x7f7ce010c170 2024-09-19T09:19:47.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.714+0000 7f7cd67fc640 1 -- 172.21.15.52:0/3661857303 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7f7cd80bd660 con 0x7f7ce010c170 2024-09-19T09:19:47.721 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 msgr2=0x7f7ccc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 0x7f7ccc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00bbe0 tx=0x7f7cdc00b390 comp rx=0 tx=0).stop 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 msgr2=0x7f7ce019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7cd802ae70 tx=0x7f7cd802f5b0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 shutdown_connections 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce010c170 0x7f7ce019eeb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ce0103660 0x7f7ce019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ccc0a3350 0x7f7ccc0a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 --2- 172.21.15.52:0/3661857303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ce0102d40 0x7f7ce019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 >> 172.21.15.52:0/3661857303 conn(0x7f7ce00fc7a0 msgr2=0x7f7ce00fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 shutdown_connections 2024-09-19T09:19:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:47.719+0000 7f7ce7735640 1 -- 172.21.15.52:0/3661857303 wait complete. 2024-09-19T09:19:48.131 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3661857303' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:19:48.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3661857303' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:19:48.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3661857303' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:19:48.373 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":2340346787},{"type":"v1","addr":"172.21.15.52:6801","nonce":2340346787}]},"active_addr":"172.21.15.52:6801/2340346787","active_change":"2024-09-19T09:12:31.197787+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.52:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":473527176}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":304195286}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2604048988}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":4030105672}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2626790066}]}]} 2024-09-19T09:19:48.378 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:19:48.378 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:19:48.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:19:48.637 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:49.072 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:48 smithi052 ceph-mon[30947]: pgmap v287: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:19:49.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 -- 172.21.15.52:0/1914574721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14101de0 msgr2=0x7fdb141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1914574721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14101de0 0x7fdb141021c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009900 tx=0x7fdb1002a410 comp rx=0 tx=0).stop 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 -- 172.21.15.52:0/1914574721 shutdown_connections 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1914574721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1914574721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14102790 0x7fdb141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1914574721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14101de0 0x7fdb141021c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 -- 172.21.15.52:0/1914574721 >> 172.21.15.52:0/1914574721 conn(0x7fdb140fd8c0 msgr2=0x7fdb140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 -- 172.21.15.52:0/1914574721 shutdown_connections 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.152+0000 7fdb1b535640 1 -- 172.21.15.52:0/1914574721 wait complete. 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 Processor -- start 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 -- start start 2024-09-19T09:19:49.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14101de0 0x7fdb14198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14111f90 con 0x7fdb14102790 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14111e10 con 0x7fdb14101de0 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb1b535640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14112110 con 0x7fdb14106f10 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb192d1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14101de0 0x7fdb14198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46550/0 (socket says 172.21.15.52:46550) 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 -- 172.21.15.52:0/1419175058 learned_addr learned my addr 172.21.15.52:0/1419175058 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb19ad2640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 -- 172.21.15.52:0/1419175058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 msgr2=0x7fdb1419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 -- 172.21.15.52:0/1419175058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14101de0 msgr2=0x7fdb14198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.153+0000 7fdb18ad0640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14101de0 0x7fdb14198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb18ad0640 1 -- 172.21.15.52:0/1419175058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1419d430 con 0x7fdb14102790 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb19ad2640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb18ad0640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400d950 tx=0x7fdb0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04017070 con 0x7fdb14102790 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb04009c30 con 0x7fdb14102790 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1419d720 con 0x7fdb14102790 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400f6b0 con 0x7fdb14102790 2024-09-19T09:19:49.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.154+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141a5000 con 0x7fdb14102790 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.155+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb141021c0 con 0x7fdb14102790 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.156+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb040109d0 con 0x7fdb14102790 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.157+0000 7fdb0a7fc640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 0x7fdb000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.157+0000 7fdb192d1640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 0x7fdb000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.157+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fdb040cf680 con 0x7fdb14102790 2024-09-19T09:19:49.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.157+0000 7fdb192d1640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 0x7fdb000a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009230 tx=0x7fdb100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.160+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb04009de0 con 0x7fdb14102790 2024-09-19T09:19:49.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:48 smithi169 ceph-mon[35454]: pgmap v287: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:19:49.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:48 smithi086 ceph-mon[34813]: pgmap v287: 97 pgs: 97 active+clean; 632 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:19:49.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.340+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb141997e0 con 0x7fdb14102790 2024-09-19T09:19:49.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.341+0000 7fdb0a7fc640 1 -- 172.21.15.52:0/1419175058 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22724 (secure 0 0 0) 0x7fdb141997e0 con 0x7fdb14102790 2024-09-19T09:19:49.343 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:49.343 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:32.840326+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 msgr2=0x7fdb000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 0x7fdb000a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009230 tx=0x7fdb100058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 msgr2=0x7fdb141989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400d950 tx=0x7fdb0400de10 comp rx=0 tx=0).stop 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 shutdown_connections 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb000a3350 0x7fdb000a5810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb14106f10 0x7fdb1419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb14102790 0x7fdb141989c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 --2- 172.21.15.52:0/1419175058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb14101de0 0x7fdb14198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 >> 172.21.15.52:0/1419175058 conn(0x7fdb140fd8c0 msgr2=0x7fdb140fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 shutdown_connections 2024-09-19T09:19:49.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:49.344+0000 7fdb1b535640 1 -- 172.21.15.52:0/1419175058 wait complete. 2024-09-19T09:19:50.084 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:49 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1419175058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:50.114 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:19:50.114 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:19:50.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:49 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1419175058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:50.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:49 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1419175058' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:50.371 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 -- 172.21.15.52:0/1301829161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018106f10 msgr2=0x7ff01810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 --2- 172.21.15.52:0/1301829161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018106f10 0x7ff01810ea90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff010009ca0 tx=0x7ff01002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 -- 172.21.15.52:0/1301829161 shutdown_connections 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 --2- 172.21.15.52:0/1301829161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018106f10 0x7ff01810ea90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 --2- 172.21.15.52:0/1301829161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018102790 0x7ff0181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 --2- 172.21.15.52:0/1301829161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018101de0 0x7ff0181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.817+0000 7ff020456640 1 -- 172.21.15.52:0/1301829161 >> 172.21.15.52:0/1301829161 conn(0x7ff0180fd8c0 msgr2=0x7ff0180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- 172.21.15.52:0/1301829161 shutdown_connections 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- 172.21.15.52:0/1301829161 wait complete. 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 Processor -- start 2024-09-19T09:19:50.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- start start 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018101de0 0x7ff0180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018106f10 0x7ff018074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff018111f70 con 0x7ff018102790 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff018111df0 con 0x7ff018101de0 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.818+0000 7ff020456640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0181120f0 con 0x7ff018106f10 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46574/0 (socket says 172.21.15.52:46574) 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 -- 172.21.15.52:0/753890316 learned_addr learned my addr 172.21.15.52:0/753890316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01e1f2640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018101de0 0x7ff0180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01e9f3640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018106f10 0x7ff018074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 -- 172.21.15.52:0/753890316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018106f10 msgr2=0x7ff018074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018106f10 0x7ff018074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 -- 172.21.15.52:0/753890316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018101de0 msgr2=0x7ff0180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018101de0 0x7ff0180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 -- 172.21.15.52:0/753890316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0181a68b0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff01d9f1640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff00800d950 tx=0x7ff00800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008017070 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff008009c30 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0181a6ba0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00800f6b0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.819+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0181a70e0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.820+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0181021c0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.821+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff0080109d0 con 0x7ff018102790 2024-09-19T09:19:50.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.822+0000 7ff00f7fe640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 0x7ff0040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.822+0000 7ff01e1f2640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 0x7ff0040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.822+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7ff0080cf660 con 0x7ff018102790 2024-09-19T09:19:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.823+0000 7ff01e1f2640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 0x7ff0040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0140058c0 tx=0x7ff01400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:50.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:50.826+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff008009de0 con 0x7ff018102790 2024-09-19T09:19:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.004+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff018109bc0 con 0x7ff018102790 2024-09-19T09:19:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.006+0000 7ff00f7fe640 1 -- 172.21.15.52:0/753890316 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22724 (secure 0 0 0) 0x7ff00809c200 con 0x7ff018102790 2024-09-19T09:19:51.007 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:19:51.008 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:32.840326+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 msgr2=0x7ff0040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 0x7ff0040a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0140058c0 tx=0x7ff01400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 msgr2=0x7ff018074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff00800d950 tx=0x7ff00800de10 comp rx=0 tx=0).stop 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 shutdown_connections 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0040a32d0 0x7ff0040a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff018106f10 0x7ff018074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff018102790 0x7ff018074a30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 --2- 172.21.15.52:0/753890316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff018101de0 0x7ff0180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 >> 172.21.15.52:0/753890316 conn(0x7ff0180fd8c0 msgr2=0x7ff0180feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 shutdown_connections 2024-09-19T09:19:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:51.008+0000 7ff020456640 1 -- 172.21.15.52:0/753890316 wait complete. 2024-09-19T09:19:51.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:50 smithi052 ceph-mon[30947]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-19T09:19:51.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:50 smithi169 ceph-mon[35454]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-19T09:19:51.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:50 smithi086 ceph-mon[34813]: pgmap v288: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-09-19T09:19:51.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:19:51.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:19:51.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:19:51.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:19:51.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:19:51.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:19:51.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:19:51.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:19:51.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:19:51.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:19:51.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:19:51.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:19:52.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:51 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/753890316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:52.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:51 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/753890316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:52.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:51 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/753890316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:19:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:52.305 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:52.341 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:53.016 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:52 smithi052 ceph-mon[30947]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:19:53.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/877525796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b810c170 msgr2=0x7fc1b810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/877525796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b810c170 0x7fc1b810e610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009ca0 tx=0x7fc1b002a950 comp rx=0 tx=0).stop 2024-09-19T09:19:53.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/877525796 shutdown_connections 2024-09-19T09:19:53.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/877525796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b810c170 0x7fc1b810e610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/877525796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b8103660 0x7fc1b810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/877525796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 0x7fc1b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/877525796 >> 172.21.15.52:0/877525796 conn(0x7fc1b80fc7a0 msgr2=0x7fc1b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/877525796 shutdown_connections 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.014+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/877525796 wait complete. 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 Processor -- start 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 -- start start 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 0x7fc1b81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8103660 0x7fc1b8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b810c170 0x7fc1b819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b8111f70 con 0x7fc1b8103660 2024-09-19T09:19:53.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b8111df0 con 0x7fc1b810c170 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.015+0000 7fc1bfe6b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b81120f0 con 0x7fc1b8102d40 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bdc07640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 0x7fc1b81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8103660 0x7fc1b8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bdc07640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 0x7fc1b81984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:51404/0 (socket says 172.21.15.52:51404) 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bdc07640 1 -- 172.21.15.52:0/3337655670 learned_addr learned my addr 172.21.15.52:0/3337655670 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1be408640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b810c170 0x7fc1b819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 -- 172.21.15.52:0/3337655670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 msgr2=0x7fc1b81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1b8102d40 0x7fc1b81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 -- 172.21.15.52:0/3337655670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b810c170 msgr2=0x7fc1b819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b810c170 0x7fc1b819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b819d4a0 con 0x7fc1b8103660 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1be408640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1b810c170 0x7fc1b819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bd406640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8103660 0x7fc1b8198a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d680 tx=0x7fc1a800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8017070 con 0x7fc1b8103660 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b819d790 con 0x7fc1b8103660 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a80097c0 con 0x7fc1b8103660 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a8004c60 con 0x7fc1b8103660 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.016+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b81a5070 con 0x7fc1b8103660 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.017+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1b8062900 con 0x7fc1b8103660 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.019+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc1a8009970 con 0x7fc1b8103660 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1aeffd640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1a40a32d0 0x7fc1a40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1bdc07640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1a40a32d0 0x7fc1a40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fc1a80cf750 con 0x7fc1b8103660 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1aeffd640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] conn(0x7fc1a40acf80 0x7fc1a40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1a40afaf0 con 0x7fc1a40acf80 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc1a80cfb00 con 0x7fc1b8103660 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1be408640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] conn(0x7fc1a40acf80 0x7fc1a40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1bdc07640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1a40a32d0 0x7fc1a40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400bca0 tx=0x7fc1b400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.020+0000 7fc1be408640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] conn(0x7fc1a40acf80 0x7fc1a40af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.021+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== osd.9 v2:172.21.15.52:6826/2842026931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1a40afaf0 con 0x7fc1a40acf80 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 --> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1b8062d00 con 0x7fc1a40acf80 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1aeffd640 1 -- 172.21.15.52:0/3337655670 <== osd.9 v2:172.21.15.52:6826/2842026931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1b8062d00 con 0x7fc1a40acf80 2024-09-19T09:19:53.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] conn(0x7fc1a40acf80 msgr2=0x7fc1a40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] conn(0x7fc1a40acf80 0x7fc1a40af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1a40a32d0 msgr2=0x7fc1a40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1a40a32d0 0x7fc1a40a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400bca0 tx=0x7fc1b400b410 comp rx=0 tx=0).stop 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8103660 msgr2=0x7fc1b8198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 --2- 172.21.15.52:0/3337655670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8103660 0x7fc1b8198a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc1a800d680 tx=0x7fc1a800db40 comp rx=0 tx=0).stop 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1be408640 1 -- 172.21.15.52:0/3337655670 reap_dead start 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 shutdown_connections 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.035+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 >> 172.21.15.52:0/3337655670 conn(0x7fc1b80fc7a0 msgr2=0x7fc1b80fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.036+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 shutdown_connections 2024-09-19T09:19:53.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.036+0000 7fc1bfe6b640 1 -- 172.21.15.52:0/3337655670 wait complete. 2024-09-19T09:19:53.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:52 smithi169 ceph-mon[35454]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 -- 172.21.15.52:0/2154789298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910100a80 msgr2=0x7f3910100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2154789298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910100a80 0x7f3910100ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3900009930 tx=0x7f390002a420 comp rx=0 tx=0).stop 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 -- 172.21.15.52:0/2154789298 shutdown_connections 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2154789298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910101420 0x7f391010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2154789298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910100a80 0x7f3910100ee0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2154789298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 0x7f3910106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 -- 172.21.15.52:0/2154789298 >> 172.21.15.52:0/2154789298 conn(0x7f39100fc7a0 msgr2=0x7f39100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 -- 172.21.15.52:0/2154789298 shutdown_connections 2024-09-19T09:19:53.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.223+0000 7f3917fcd640 1 -- 172.21.15.52:0/2154789298 wait complete. 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 Processor -- start 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 -- start start 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910100a80 0x7f3910198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 0x7f3910198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 0x7f391019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111f60 con 0x7f3910101420 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3910111de0 con 0x7f3910106a80 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3917fcd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39101120e0 con 0x7f3910100a80 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3915568640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 0x7f3910198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3915568640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 0x7f3910198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46600/0 (socket says 172.21.15.52:46600) 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3915568640 1 -- 172.21.15.52:0/2719764047 learned_addr learned my addr 172.21.15.52:0/2719764047 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f3915d69640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910100a80 0x7f3910198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.224+0000 7f391656a640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 0x7f391019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 -- 172.21.15.52:0/2719764047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910100a80 msgr2=0x7f3910198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910100a80 0x7f3910198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 -- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 msgr2=0x7f391019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 0x7f391019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391019d3b0 con 0x7f3910101420 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915d69640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3910100a80 0x7f3910198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f391656a640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3910106a80 0x7f391019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3915568640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 0x7f3910198940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3900009230 tx=0x7f3900004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390003f030 con 0x7f3910101420 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3900003ad0 con 0x7f3910101420 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391019d640 con 0x7f3910101420 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900035070 con 0x7f3910101420 2024-09-19T09:19:53.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.225+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101a4f80 con 0x7f3910101420 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.226+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3910062980 con 0x7f3910101420 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.227+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3900042030 con 0x7f3910101420 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3906ffd640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f38fc0a3350 0x7f38fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f39000f0430 con 0x7f3910101420 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3915d69640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f38fc0a3350 0x7f38fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3906ffd640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] conn(0x7f38fc0ad000 0x7f38fc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38fc0afb70 con 0x7f38fc0ad000 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f39000f0880 con 0x7f3910101420 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f3915d69640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f38fc0a3350 0x7f38fc0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f390c005e00 tx=0x7f390c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.228+0000 7f391656a640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] conn(0x7f38fc0ad000 0x7f38fc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.229+0000 7f391656a640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] conn(0x7f38fc0ad000 0x7f38fc0af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.230+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== osd.1 v2:172.21.15.86:6800/740812264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38fc0afb70 con 0x7f38fc0ad000 2024-09-19T09:19:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.243+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 --> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3910062d80 con 0x7f38fc0ad000 2024-09-19T09:19:53.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3906ffd640 1 -- 172.21.15.52:0/2719764047 <== osd.1 v2:172.21.15.86:6800/740812264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3910062d80 con 0x7f38fc0ad000 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] conn(0x7f38fc0ad000 msgr2=0x7f38fc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] conn(0x7f38fc0ad000 0x7f38fc0af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f38fc0a3350 msgr2=0x7f38fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f38fc0a3350 0x7f38fc0a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f390c005e00 tx=0x7f390c005c70 comp rx=0 tx=0).stop 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 msgr2=0x7f3910198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 --2- 172.21.15.52:0/2719764047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3910101420 0x7f3910198940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3900009230 tx=0x7f3900004270 comp rx=0 tx=0).stop 2024-09-19T09:19:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f391656a640 1 -- 172.21.15.52:0/2719764047 reap_dead start 2024-09-19T09:19:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.244+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 shutdown_connections 2024-09-19T09:19:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.245+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 >> 172.21.15.52:0/2719764047 conn(0x7f39100fc7a0 msgr2=0x7f39100fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.245+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 shutdown_connections 2024-09-19T09:19:53.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:53.245+0000 7f3917fcd640 1 -- 172.21.15.52:0/2719764047 wait complete. 2024-09-19T09:19:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:52 smithi086 ceph-mon[34813]: pgmap v289: 97 pgs: 97 active+clean; 636 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:19:53.970 INFO:teuthology.orchestra.run.smithi052.stdout:51539607622 2024-09-19T09:19:53.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:19:54.638 INFO:teuthology.orchestra.run.smithi052.stdout:253403070494 2024-09-19T09:19:54.638 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:19:54.701 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.702 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.718 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.722 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.723 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.731 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:55.116 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:54 smithi052 ceph-mon[30947]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:19:55.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:54 smithi169 ceph-mon[35454]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:19:55.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:54 smithi086 ceph-mon[34813]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 -- 172.21.15.52:0/1153757944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264101df0 msgr2=0x7f92641021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 --2- 172.21.15.52:0/1153757944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264101df0 0x7f92641021d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9254009900 tx=0x7f925402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 -- 172.21.15.52:0/1153757944 shutdown_connections 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 --2- 172.21.15.52:0/1153757944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9264106f20 0x7f926410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 --2- 172.21.15.52:0/1153757944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f92641027a0 0x7f92641067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 --2- 172.21.15.52:0/1153757944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264101df0 0x7f92641021d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 -- 172.21.15.52:0/1153757944 >> 172.21.15.52:0/1153757944 conn(0x7f92640fd8f0 msgr2=0x7f92640ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 -- 172.21.15.52:0/1153757944 shutdown_connections 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.643+0000 7f926a636640 1 -- 172.21.15.52:0/1153757944 wait complete. 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.644+0000 7f926a636640 1 Processor -- start 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.644+0000 7f926a636640 1 -- start start 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.644+0000 7f926a636640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9264101df0 0x7f92641985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.644+0000 7f926a636640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92641027a0 0x7f9264198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 0x7f926419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9264112020 con 0x7f9264106f20 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9264111ea0 con 0x7f92641027a0 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f92641121a0 con 0x7f9264101df0 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 0x7f926419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 0x7f926419ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46618/0 (socket says 172.21.15.52:46618) 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 -- 172.21.15.52:0/2648217769 learned_addr learned my addr 172.21.15.52:0/2648217769 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f92637fe640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92641027a0 0x7f9264198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9263fff640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9264101df0 0x7f92641985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 -- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9264101df0 msgr2=0x7f92641985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9264101df0 0x7f92641985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 -- 172.21.15.52:0/2648217769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92641027a0 msgr2=0x7f9264198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f92641027a0 0x7f9264198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926419d550 con 0x7f9264106f20 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f9268bd3640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 0x7f926419ce70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b970 tx=0x7f925c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c019070 con 0x7f9264106f20 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926419d840 con 0x7f9264106f20 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925c014440 con 0x7f9264106f20 2024-09-19T09:19:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0075d0 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.645+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92641a5120 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.646+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9264062980 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.648+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f925c01c070 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.648+0000 7f92617fa640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f924c0a32d0 0x7f924c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.648+0000 7f9263fff640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f924c0a32d0 0x7f924c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.648+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f925c0cf7d0 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f92617fa640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] conn(0x7f924c0acf80 0x7f924c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f924c0afaf0 con 0x7f924c0acf80 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f925c0cfc20 con 0x7f9264106f20 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f9263fff640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f924c0a32d0 0x7f924c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92540096c0 tx=0x7f9254031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f92637fe640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] conn(0x7f924c0acf80 0x7f924c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.649+0000 7f92637fe640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] conn(0x7f924c0acf80 0x7f924c0af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.650+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== osd.2 v2:172.21.15.169:6800/2551130038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f924c0afaf0 con 0x7f924c0acf80 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.664+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 --> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9264062e00 con 0x7f924c0acf80 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.664+0000 7f92617fa640 1 -- 172.21.15.52:0/2648217769 <== osd.2 v2:172.21.15.169:6800/2551130038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9264062e00 con 0x7f924c0acf80 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] conn(0x7f924c0acf80 msgr2=0x7f924c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] conn(0x7f924c0acf80 0x7f924c0af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f924c0a32d0 msgr2=0x7f924c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f924c0a32d0 0x7f924c0a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f92540096c0 tx=0x7f9254031490 comp rx=0 tx=0).stop 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 msgr2=0x7f926419ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 --2- 172.21.15.52:0/2648217769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9264106f20 0x7f926419ce70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f925c00b970 tx=0x7f925c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f9268bd3640 1 -- 172.21.15.52:0/2648217769 reap_dead start 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 shutdown_connections 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 >> 172.21.15.52:0/2648217769 conn(0x7f92640fd8f0 msgr2=0x7f92640fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 shutdown_connections 2024-09-19T09:19:55.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:55.665+0000 7f926a636640 1 -- 172.21.15.52:0/2648217769 wait complete. 2024-09-19T09:19:56.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 -- 172.21.15.52:0/2109567381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc100e20 msgr2=0x7f9fcc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2109567381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc100e20 0x7f9fcc101200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009900 tx=0x7f9fc802a480 comp rx=0 tx=0).stop 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 -- 172.21.15.52:0/2109567381 shutdown_connections 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2109567381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fcc102ef0 0x7f9fcc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2109567381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102570 0x7f9fcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2109567381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc100e20 0x7f9fcc101200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 -- 172.21.15.52:0/2109567381 >> 172.21.15.52:0/2109567381 conn(0x7f9fcc0fc7d0 msgr2=0x7f9fcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 -- 172.21.15.52:0/2109567381 shutdown_connections 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.055+0000 7f9fd4120640 1 -- 172.21.15.52:0/2109567381 wait complete. 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 Processor -- start 2024-09-19T09:19:56.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 -- start start 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fcc100e20 0x7f9fcc199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 0x7f9fcc1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102ef0 0x7f9fcc1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc110fa0 con 0x7f9fcc102570 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc110e20 con 0x7f9fcc102ef0 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd4120640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc111120 con 0x7f9fcc100e20 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd16bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 0x7f9fcc1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd16bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 0x7f9fcc1998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46638/0 (socket says 172.21.15.52:46638) 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.056+0000 7f9fd16bb640 1 -- 172.21.15.52:0/2841980219 learned_addr learned my addr 172.21.15.52:0/2841980219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd1ebc640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fcc100e20 0x7f9fcc199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd26bd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102ef0 0x7f9fcc1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 -- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fcc100e20 msgr2=0x7f9fcc199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9fcc100e20 0x7f9fcc199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 -- 172.21.15.52:0/2841980219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102ef0 msgr2=0x7f9fcc1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102ef0 0x7f9fcc1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc1a4950 con 0x7f9fcc102570 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd26bd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fcc102ef0 0x7f9fcc1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd16bb640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 0x7f9fcc1998d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00d950 tx=0x7f9fbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc017030 con 0x7f9fcc102570 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fbc004020 con 0x7f9fcc102570 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc1a4b20 con 0x7f9fcc102570 2024-09-19T09:19:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0047a0 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.057+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc1a5060 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.058+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fcc062940 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9fbc0041d0 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9fb80a3350 0x7f9fb80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fd1ebc640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9fb80a3350 0x7f9fb80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f9fbc0cfaf0 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] conn(0x7f9fb80ad000 0x7f9fb80af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9fbc01ee70 con 0x7f9fb80ad000 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.060+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f9fbc0cff40 con 0x7f9fcc102570 2024-09-19T09:19:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.061+0000 7f9fd1ebc640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9fb80a3350 0x7f9fb80a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009230 tx=0x7f9fc80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.061+0000 7f9fd26bd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] conn(0x7f9fb80ad000 0x7f9fb80af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.061+0000 7f9fd26bd640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] conn(0x7f9fb80ad000 0x7f9fb80af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.062+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== osd.5 v2:172.21.15.169:6808/1256666547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9fbc01ee70 con 0x7f9fb80ad000 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.076+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 --> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fcc062dc0 con 0x7f9fb80ad000 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.076+0000 7f9fc2ffd640 1 -- 172.21.15.52:0/2841980219 <== osd.5 v2:172.21.15.169:6808/1256666547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9fcc062dc0 con 0x7f9fb80ad000 2024-09-19T09:19:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.076+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] conn(0x7f9fb80ad000 msgr2=0x7f9fb80af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.076+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] conn(0x7f9fb80ad000 0x7f9fb80af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9fb80a3350 msgr2=0x7f9fb80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9fb80a3350 0x7f9fb80a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009230 tx=0x7f9fc80058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 msgr2=0x7f9fcc1998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 --2- 172.21.15.52:0/2841980219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fcc102570 0x7f9fcc1998d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00d950 tx=0x7f9fbc00de10 comp rx=0 tx=0).stop 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd26bd640 1 -- 172.21.15.52:0/2841980219 reap_dead start 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 shutdown_connections 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 >> 172.21.15.52:0/2841980219 conn(0x7f9fcc0fc7d0 msgr2=0x7f9fcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 shutdown_connections 2024-09-19T09:19:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.077+0000 7f9fd4120640 1 -- 172.21.15.52:0/2841980219 wait complete. 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- 172.21.15.52:0/943173981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c101440 msgr2=0x7f6f7c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 --2- 172.21.15.52:0/943173981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c101440 0x7f6f7c10df30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009900 tx=0x7f6f7002a410 comp rx=0 tx=0).stop 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- 172.21.15.52:0/943173981 shutdown_connections 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 --2- 172.21.15.52:0/943173981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 0x7f6f7c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 --2- 172.21.15.52:0/943173981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c101440 0x7f6f7c10df30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 --2- 172.21.15.52:0/943173981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f7c100b20 0x7f6f7c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- 172.21.15.52:0/943173981 >> 172.21.15.52:0/943173981 conn(0x7f6f7c0fc7d0 msgr2=0x7f6f7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- 172.21.15.52:0/943173981 shutdown_connections 2024-09-19T09:19:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- 172.21.15.52:0/943173981 wait complete. 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 Processor -- start 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.666+0000 7f6f83c20640 1 -- start start 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 0x7f6f7c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f7c101440 0x7f6f7c1a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 0x7f6f7c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c114250 con 0x7f6f7c100b20 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c1140d0 con 0x7f6f7c10e500 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c1143d0 con 0x7f6f7c101440 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 0x7f6f7c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 0x7f6f7c1a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46654/0 (socket says 172.21.15.52:46654) 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 -- 172.21.15.52:0/1994444115 learned_addr learned my addr 172.21.15.52:0/1994444115 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f821bd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 0x7f6f7c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f811bb640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f7c101440 0x7f6f7c1a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 -- 172.21.15.52:0/1994444115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f7c101440 msgr2=0x7f6f7c1a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f7c101440 0x7f6f7c1a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 -- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 msgr2=0x7f6f7c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 0x7f6f7c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c19ad30 con 0x7f6f7c100b20 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f821bd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f7c10e500 0x7f6f7c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f819bc640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 0x7f6f7c1a0440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c890 tx=0x7f6f7400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74004220 con 0x7f6f7c100b20 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c19b020 con 0x7f6f7c100b20 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f740043c0 con 0x7f6f7c100b20 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f740049e0 con 0x7f6f7c100b20 2024-09-19T09:19:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.667+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c1a7310 con 0x7f6f7c100b20 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.668+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f7c062980 con 0x7f6f7c100b20 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6f740079b0 con 0x7f6f7c100b20 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f640a32d0 0x7f6f640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f6f740cfe70 con 0x7f6f7c100b20 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f811bb640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f640a32d0 0x7f6f640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] conn(0x7f6f640acf80 0x7f6f640af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f640afaf0 con 0x7f6f640acf80 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.670+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f6f740d02c0 con 0x7f6f7c100b20 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.671+0000 7f6f811bb640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f640a32d0 0x7f6f640a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000c00 tx=0x7f6f70005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.671+0000 7f6f821bd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] conn(0x7f6f640acf80 0x7f6f640af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.671+0000 7f6f821bd640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] conn(0x7f6f640acf80 0x7f6f640af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.672+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== osd.4 v2:172.21.15.86:6808/1147748892 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f640afaf0 con 0x7f6f640acf80 2024-09-19T09:19:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.686+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 --> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f7c062e00 con 0x7f6f640acf80 2024-09-19T09:19:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.686+0000 7f6f7affd640 1 -- 172.21.15.52:0/1994444115 <== osd.4 v2:172.21.15.86:6808/1147748892 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6f7c062e00 con 0x7f6f640acf80 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] conn(0x7f6f640acf80 msgr2=0x7f6f640af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] conn(0x7f6f640acf80 0x7f6f640af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f640a32d0 msgr2=0x7f6f640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f640a32d0 0x7f6f640a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000c00 tx=0x7f6f70005a20 comp rx=0 tx=0).stop 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 msgr2=0x7f6f7c1a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 --2- 172.21.15.52:0/1994444115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6f7c100b20 0x7f6f7c1a0440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c890 tx=0x7f6f7400cd50 comp rx=0 tx=0).stop 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f821bd640 1 -- 172.21.15.52:0/1994444115 reap_dead start 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 shutdown_connections 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 >> 172.21.15.52:0/1994444115 conn(0x7f6f7c0fc7d0 msgr2=0x7f6f7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 shutdown_connections 2024-09-19T09:19:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:56.687+0000 7f6f83c20640 1 -- 172.21.15.52:0/1994444115 wait complete. 2024-09-19T09:19:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:56 smithi052 ceph-mon[30947]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:19:57.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:56 smithi169 ceph-mon[35454]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:19:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:56 smithi086 ceph-mon[34813]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T09:19:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 -- 172.21.15.52:0/1149500466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c106f10 msgr2=0x7f5e0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 --2- 172.21.15.52:0/1149500466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c106f10 0x7f5e0c10ea90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009ca0 tx=0x7f5e0402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 -- 172.21.15.52:0/1149500466 shutdown_connections 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 --2- 172.21.15.52:0/1149500466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c106f10 0x7f5e0c10ea90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 --2- 172.21.15.52:0/1149500466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c102790 0x7f5e0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 --2- 172.21.15.52:0/1149500466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 -- 172.21.15.52:0/1149500466 >> 172.21.15.52:0/1149500466 conn(0x7f5e0c0fd8c0 msgr2=0x7f5e0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 -- 172.21.15.52:0/1149500466 shutdown_connections 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.314+0000 7f5e13094640 1 -- 172.21.15.52:0/1149500466 wait complete. 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 Processor -- start 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 -- start start 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c102790 0x7f5e0c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c106f10 0x7f5e0c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c111fc0 con 0x7f5e0c101de0 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c111e40 con 0x7f5e0c102790 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e13094640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c112140 con 0x7f5e0c106f10 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46660/0 (socket says 172.21.15.52:46660) 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 -- 172.21.15.52:0/1748871046 learned_addr learned my addr 172.21.15.52:0/1748871046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e0bfff640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c102790 0x7f5e0c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e11631640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c106f10 0x7f5e0c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 -- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c106f10 msgr2=0x7f5e0c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c106f10 0x7f5e0c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 -- 172.21.15.52:0/1748871046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c102790 msgr2=0x7f5e0c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c102790 0x7f5e0c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c19d290 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e11631640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e0c106f10 0x7f5e0c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e0bfff640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5e0c102790 0x7f5e0c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.315+0000 7f5e10e30640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1982e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c920 tx=0x7f5df400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.316+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4007c70 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.316+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df4007e10 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.316+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c19d580 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.316+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4018890 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.316+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c1a4e60 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.317+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e0c0fed00 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.318+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5df4018a30 con 0x7f5e0c101de0 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5df80a32d0 0x7f5df80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e0bfff640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5df80a32d0 0x7f5df80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f5df40d00d0 con 0x7f5e0c101de0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] conn(0x7f5df80acf80 0x7f5df80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5df80afaf0 con 0x7f5df80acf80 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f5df40d0520 con 0x7f5e0c101de0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e0bfff640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5df80a32d0 0x7f5df80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005e10 tx=0x7f5dfc005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.319+0000 7f5e11631640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] conn(0x7f5df80acf80 0x7f5df80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.320+0000 7f5e11631640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] conn(0x7f5df80acf80 0x7f5df80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.321+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== osd.8 v2:172.21.15.169:6816/1059670873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5df80afaf0 con 0x7f5df80acf80 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.334+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 --> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e0c1032c0 con 0x7f5df80acf80 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1748871046 <== osd.8 v2:172.21.15.169:6816/1059670873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e0c1032c0 con 0x7f5df80acf80 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] conn(0x7f5df80acf80 msgr2=0x7f5df80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] conn(0x7f5df80acf80 0x7f5df80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5df80a32d0 msgr2=0x7f5df80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5df80a32d0 0x7f5df80a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc005e10 tx=0x7f5dfc005da0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 msgr2=0x7f5e0c1982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 --2- 172.21.15.52:0/1748871046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c101de0 0x7f5e0c1982e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c920 tx=0x7f5df400cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e11631640 1 -- 172.21.15.52:0/1748871046 reap_dead start 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 shutdown_connections 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 >> 172.21.15.52:0/1748871046 conn(0x7f5e0c0fd8c0 msgr2=0x7f5e0c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.335+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 shutdown_connections 2024-09-19T09:19:57.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.336+0000 7f5e13094640 1 -- 172.21.15.52:0/1748871046 wait complete. 2024-09-19T09:19:57.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 -- 172.21.15.52:0/3039722142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374102570 msgr2=0x7f33741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 --2- 172.21.15.52:0/3039722142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374102570 0x7f33741029b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3360009900 tx=0x7f336002a4a0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 -- 172.21.15.52:0/3039722142 shutdown_connections 2024-09-19T09:19:57.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 --2- 172.21.15.52:0/3039722142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3374102ef0 0x7f337410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 --2- 172.21.15.52:0/3039722142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374102570 0x7f33741029b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 --2- 172.21.15.52:0/3039722142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3374100e20 0x7f3374101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 -- 172.21.15.52:0/3039722142 >> 172.21.15.52:0/3039722142 conn(0x7f33740fc7d0 msgr2=0x7f33740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 -- 172.21.15.52:0/3039722142 shutdown_connections 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.800+0000 7f337ab5c640 1 -- 172.21.15.52:0/3039722142 wait complete. 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 Processor -- start 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 -- start start 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 0x7f33740fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3374102570 0x7f33740fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3374102ef0 0x7f33740fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3374110f80 con 0x7f3374100e20 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3374110e00 con 0x7f3374102ef0 2024-09-19T09:19:57.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f337ab5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3374111100 con 0x7f3374102570 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 0x7f33740fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 0x7f33740fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46682/0 (socket says 172.21.15.52:46682) 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 -- 172.21.15.52:0/333303878 learned_addr learned my addr 172.21.15.52:0/333303878 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f3373fff640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3374102570 0x7f33740fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33790f9640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3374102ef0 0x7f33740fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 -- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3374102570 msgr2=0x7f33740fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3374102570 0x7f33740fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 -- 172.21.15.52:0/333303878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3374102ef0 msgr2=0x7f33740fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3374102ef0 0x7f33740fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.801+0000 7f33788f8640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33741a6a10 con 0x7f3374100e20 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f33788f8640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 0x7f33740fcc80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f336800e9f0 tx=0x7f336800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336800cd80 con 0x7f3374100e20 2024-09-19T09:19:57.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33741a6d00 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3368010910 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33680188f0 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.802+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33741a7200 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.803+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33740628c0 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.805+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3368010ac0 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3371ffb640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f33640a32d0 0x7f33640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3373fff640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f33640a32d0 0x7f33640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f33680d0530 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3371ffb640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] conn(0x7f33640acf80 0x7f33640af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f33640afaf0 con 0x7f33640acf80 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f33680d08e0 con 0x7f3374100e20 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f3373fff640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f33640a32d0 0x7f33640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3360009230 tx=0x7f33600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.806+0000 7f33790f9640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] conn(0x7f33640acf80 0x7f33640af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.807+0000 7f33790f9640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] conn(0x7f33640acf80 0x7f33640af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.807+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== osd.11 v2:172.21.15.169:6824/3787808833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f33640afaf0 con 0x7f33640acf80 2024-09-19T09:19:57.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.832+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 --> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3374062d40 con 0x7f33640acf80 2024-09-19T09:19:57.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.832+0000 7f3371ffb640 1 -- 172.21.15.52:0/333303878 <== osd.11 v2:172.21.15.169:6824/3787808833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3374062d40 con 0x7f33640acf80 2024-09-19T09:19:57.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] conn(0x7f33640acf80 msgr2=0x7f33640af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] conn(0x7f33640acf80 0x7f33640af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f33640a32d0 msgr2=0x7f33640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f33640a32d0 0x7f33640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3360009230 tx=0x7f33600058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 msgr2=0x7f33740fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 --2- 172.21.15.52:0/333303878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3374100e20 0x7f33740fcc80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f336800e9f0 tx=0x7f336800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f33790f9640 1 -- 172.21.15.52:0/333303878 reap_dead start 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 shutdown_connections 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 >> 172.21.15.52:0/333303878 conn(0x7f33740fc7d0 msgr2=0x7f337406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 shutdown_connections 2024-09-19T09:19:57.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:57.833+0000 7f337ab5c640 1 -- 172.21.15.52:0/333303878 wait complete. 2024-09-19T09:19:58.561 INFO:teuthology.orchestra.run.smithi052.stdout:223338299428 2024-09-19T09:19:58.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:19:58.879 INFO:teuthology.orchestra.run.smithi052.stdout:124554051639 2024-09-19T09:19:58.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:19:59.101 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:19:58 smithi052 ceph-mon[30947]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:19:59.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:19:58 smithi169 ceph-mon[35454]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:19:59.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:19:58 smithi086 ceph-mon[34813]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1899238707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8101de0 msgr2=0x7fd9e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1899238707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8101de0 0x7fd9e81021c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009900 tx=0x7fd9dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1899238707 shutdown_connections 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1899238707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e8106f10 0x7fd9e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1899238707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8102790 0x7fd9e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1899238707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8101de0 0x7fd9e81021c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1899238707 >> 172.21.15.52:0/1899238707 conn(0x7fd9e80fd8c0 msgr2=0x7fd9e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1899238707 shutdown_connections 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.406+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1899238707 wait complete. 2024-09-19T09:19:59.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 Processor -- start 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 -- start start 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8101de0 0x7fd9e8198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e8102790 0x7fd9e8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 0x7fd9e819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8111f70 con 0x7fd9e8106f10 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e8111df0 con 0x7fd9e8101de0 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9eefc7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e81120f0 con 0x7fd9e8102790 2024-09-19T09:19:59.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9ed564640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 0x7fd9e819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9ed564640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 0x7fd9e819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36906/0 (socket says 172.21.15.52:36906) 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.407+0000 7fd9ed564640 1 -- 172.21.15.52:0/1753108513 learned_addr learned my addr 172.21.15.52:0/1753108513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9e7fff640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e8102790 0x7fd9e8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ecd63640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8101de0 0x7fd9e8198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 -- 172.21.15.52:0/1753108513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e8102790 msgr2=0x7fd9e8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd9e8102790 0x7fd9e8198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 -- 172.21.15.52:0/1753108513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8101de0 msgr2=0x7fd9e8198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd9e8101de0 0x7fd9e8198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e819d3d0 con 0x7fd9e8106f10 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9ed564640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 0x7fd9e819ccf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000eaa0 tx=0x7fd9e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:59.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e000cdb0 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e0005020 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e819d6c0 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00116b0 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.408+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e81a4fa0 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.409+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9e8062980 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.410+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd9e0005560 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e5ffb640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9d80a32d0 0x7fd9d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fd9e00d0080 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9ecd63640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9d80a32d0 0x7fd9d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e5ffb640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] conn(0x7fd9d80acf80 0x7fd9d80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9e0014ec0 con 0x7fd9d80acf80 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fd9e00d0430 con 0x7fd9e8106f10 2024-09-19T09:19:59.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.411+0000 7fd9e7fff640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] conn(0x7fd9d80acf80 0x7fd9d80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.412+0000 7fd9ecd63640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9d80a32d0 0x7fd9d80a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009230 tx=0x7fd9dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.412+0000 7fd9e7fff640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] conn(0x7fd9d80acf80 0x7fd9d80af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.412+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== osd.6 v2:172.21.15.52:6818/517383530 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9e0014ec0 con 0x7fd9d80acf80 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.426+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 --> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9e8062e00 con 0x7fd9d80acf80 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.427+0000 7fd9e5ffb640 1 -- 172.21.15.52:0/1753108513 <== osd.6 v2:172.21.15.52:6818/517383530 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd9e8062e00 con 0x7fd9d80acf80 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.427+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] conn(0x7fd9d80acf80 msgr2=0x7fd9d80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.427+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] conn(0x7fd9d80acf80 0x7fd9d80af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9d80a32d0 msgr2=0x7fd9d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9d80a32d0 0x7fd9d80a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009230 tx=0x7fd9dc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 msgr2=0x7fd9e819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 --2- 172.21.15.52:0/1753108513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9e8106f10 0x7fd9e819ccf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000eaa0 tx=0x7fd9e000ef60 comp rx=0 tx=0).stop 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9ed564640 1 -- 172.21.15.52:0/1753108513 reap_dead start 2024-09-19T09:19:59.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 shutdown_connections 2024-09-19T09:19:59.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 >> 172.21.15.52:0/1753108513 conn(0x7fd9e80fd8c0 msgr2=0x7fd9e80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:59.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 shutdown_connections 2024-09-19T09:19:59.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:19:59.428+0000 7fd9eefc7640 1 -- 172.21.15.52:0/1753108513 wait complete. 2024-09-19T09:20:00.128 INFO:teuthology.orchestra.run.smithi052.stdout:68719476801 2024-09-19T09:20:00.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 -- 172.21.15.52:0/2574999316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 msgr2=0x7f41bc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/2574999316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc100ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41a4009930 tx=0x7f41a402a420 comp rx=0 tx=0).stop 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 -- 172.21.15.52:0/2574999316 shutdown_connections 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/2574999316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41bc101420 0x7f41bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/2574999316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc100ee0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/2574999316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc106a80 0x7f41bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 -- 172.21.15.52:0/2574999316 >> 172.21.15.52:0/2574999316 conn(0x7f41bc0fc7a0 msgr2=0x7f41bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 -- 172.21.15.52:0/2574999316 shutdown_connections 2024-09-19T09:20:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.316+0000 7f41c0cbd640 1 -- 172.21.15.52:0/2574999316 wait complete. 2024-09-19T09:20:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 Processor -- start 2024-09-19T09:20:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 -- start start 2024-09-19T09:20:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc0fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc101420 0x7f41bc0fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41bc106a80 0x7f41bc0fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc110ed0 con 0x7f41bc100a80 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc110d50 con 0x7f41bc101420 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41c0cbd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc111050 con 0x7f41bc106a80 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc0fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc0fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36924/0 (socket says 172.21.15.52:36924) 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 -- 172.21.15.52:0/1708857734 learned_addr learned my addr 172.21.15.52:0/1708857734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41b3fff640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc101420 0x7f41bc0fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41bad9d640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41bc106a80 0x7f41bc0fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 -- 172.21.15.52:0/1708857734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41bc106a80 msgr2=0x7f41bc0fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41bc106a80 0x7f41bc0fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 -- 172.21.15.52:0/1708857734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc101420 msgr2=0x7f41bc0fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc101420 0x7f41bc0fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41ba59c640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc1a6950 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.317+0000 7f41b3fff640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41bc101420 0x7f41bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41ba59c640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc0fcde0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00d950 tx=0x7f41ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac017070 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc1a6c40 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41ac009c30 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00f6b0 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.318+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc1a71a0 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.319+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41bc0628c0 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.320+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f41ac0109d0 con 0x7f41bc100a80 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b37fe640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41a80a32d0 0x7f41a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b3fff640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41a80a32d0 0x7f41a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f41ac0cfae0 con 0x7f41bc100a80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b37fe640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] conn(0x7f41a80acf80 0x7f41a80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41a80afaf0 con 0x7f41a80acf80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f41ac0cff30 con 0x7f41bc100a80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.321+0000 7f41bad9d640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] conn(0x7f41a80acf80 0x7f41a80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.322+0000 7f41b3fff640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41a80a32d0 0x7f41a80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006010 tx=0x7f41a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.322+0000 7f41bad9d640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] conn(0x7f41a80acf80 0x7f41a80af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.323+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== osd.3 v2:172.21.15.52:6810/3702275878 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41a80afaf0 con 0x7f41a80acf80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.337+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 --> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41bc062d40 con 0x7f41a80acf80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.337+0000 7f41b37fe640 1 -- 172.21.15.52:0/1708857734 <== osd.3 v2:172.21.15.52:6810/3702275878 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f41bc062d40 con 0x7f41a80acf80 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] conn(0x7f41a80acf80 msgr2=0x7f41a80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] conn(0x7f41a80acf80 0x7f41a80af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41a80a32d0 msgr2=0x7f41a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41a80a32d0 0x7f41a80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006010 tx=0x7f41a4005a20 comp rx=0 tx=0).stop 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 msgr2=0x7f41bc0fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 --2- 172.21.15.52:0/1708857734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f41bc100a80 0x7f41bc0fcde0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00d950 tx=0x7f41ac00de10 comp rx=0 tx=0).stop 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41bad9d640 1 -- 172.21.15.52:0/1708857734 reap_dead start 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 shutdown_connections 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 >> 172.21.15.52:0/1708857734 conn(0x7f41bc0fc7a0 msgr2=0x7f41bc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 shutdown_connections 2024-09-19T09:20:00.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:00.338+0000 7f41c0cbd640 1 -- 172.21.15.52:0/1708857734 wait complete. 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi052.stdout:94489280571 2024-09-19T09:20:01.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:20:01.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:00 smithi169 ceph-mon[35454]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:20:01.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:00 smithi169 ceph-mon[35454]: overall HEALTH_OK 2024-09-19T09:20:01.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:00 smithi086 ceph-mon[34813]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:20:01.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:00 smithi086 ceph-mon[34813]: overall HEALTH_OK 2024-09-19T09:20:01.311 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:00 smithi052 ceph-mon[30947]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-19T09:20:01.312 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:00 smithi052 ceph-mon[30947]: overall HEALTH_OK 2024-09-19T09:20:01.796 INFO:teuthology.orchestra.run.smithi052.stdout:141733920819 2024-09-19T09:20:01.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:20:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 -- 172.21.15.52:0/1746695827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc1036c0 msgr2=0x7f91cc10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 --2- 172.21.15.52:0/1746695827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc1036c0 0x7f91cc10bbb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009900 tx=0x7f91bc02a480 comp rx=0 tx=0).stop 2024-09-19T09:20:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 -- 172.21.15.52:0/1746695827 shutdown_connections 2024-09-19T09:20:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 --2- 172.21.15.52:0/1746695827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91cc10c180 0x7f91cc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 --2- 172.21.15.52:0/1746695827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc1036c0 0x7f91cc10bbb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 --2- 172.21.15.52:0/1746695827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91cc102da0 0x7f91cc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 -- 172.21.15.52:0/1746695827 >> 172.21.15.52:0/1746695827 conn(0x7f91cc0fc7a0 msgr2=0x7f91cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 -- 172.21.15.52:0/1746695827 shutdown_connections 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.305+0000 7f91d3889640 1 -- 172.21.15.52:0/1746695827 wait complete. 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 Processor -- start 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 -- start start 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 0x7f91cc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91cc1036c0 0x7f91cc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91cc10c180 0x7f91cc19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc111f60 con 0x7f91cc102da0 2024-09-19T09:20:02.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc111de0 con 0x7f91cc1036c0 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d3889640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1120e0 con 0x7f91cc10c180 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 0x7f91cc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 0x7f91cc19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36936/0 (socket says 172.21.15.52:36936) 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 -- 172.21.15.52:0/3395175519 learned_addr learned my addr 172.21.15.52:0/3395175519 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d0e24640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91cc1036c0 0x7f91cc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1e26640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91cc10c180 0x7f91cc19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 -- 172.21.15.52:0/3395175519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91cc10c180 msgr2=0x7f91cc19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91cc10c180 0x7f91cc19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 -- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91cc1036c0 msgr2=0x7f91cc19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91cc1036c0 0x7f91cc19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc19f600 con 0x7f91cc102da0 2024-09-19T09:20:02.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.306+0000 7f91d1625640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 0x7f91cc19a650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f91c800c970 tx=0x7f91c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8007bb0 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc19f8f0 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c8007d50 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c800f450 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1a71d0 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.307+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91cc102670 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.309+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91c8004fa0 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.309+0000 7f91c27fc640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a32d0 0x7f91b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91d0e24640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a32d0 0x7f91b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f91c80cfd70 con 0x7f91cc102da0 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91c27fc640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] conn(0x7f91b80acf80 0x7f91b80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91b80afaf0 con 0x7f91b80acf80 2024-09-19T09:20:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f91c80d0120 con 0x7f91cc102da0 2024-09-19T09:20:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91d1e26640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] conn(0x7f91b80acf80 0x7f91b80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91d0e24640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a32d0 0x7f91b80a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0fec70 tx=0x7f91bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.310+0000 7f91d1e26640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] conn(0x7f91b80acf80 0x7f91b80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.311+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== osd.10 v2:172.21.15.86:6824/3726855330 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91b80afaf0 con 0x7f91b80acf80 2024-09-19T09:20:02.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.325+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 --> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91cc06b010 con 0x7f91b80acf80 2024-09-19T09:20:02.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91c27fc640 1 -- 172.21.15.52:0/3395175519 <== osd.10 v2:172.21.15.86:6824/3726855330 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f91cc06b010 con 0x7f91b80acf80 2024-09-19T09:20:02.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] conn(0x7f91b80acf80 msgr2=0x7f91b80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] conn(0x7f91b80acf80 0x7f91b80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a32d0 msgr2=0x7f91b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a32d0 0x7f91b80a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0fec70 tx=0x7f91bc005a20 comp rx=0 tx=0).stop 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 msgr2=0x7f91cc19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 --2- 172.21.15.52:0/3395175519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91cc102da0 0x7f91cc19a650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f91c800c970 tx=0x7f91c800ce30 comp rx=0 tx=0).stop 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d1e26640 1 -- 172.21.15.52:0/3395175519 reap_dead start 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 shutdown_connections 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 >> 172.21.15.52:0/3395175519 conn(0x7f91cc0fc7a0 msgr2=0x7f91cc101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 shutdown_connections 2024-09-19T09:20:02.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.326+0000 7f91d3889640 1 -- 172.21.15.52:0/3395175519 wait complete. 2024-09-19T09:20:02.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 -- 172.21.15.52:0/2251729423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210101de0 msgr2=0x7fe2101021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 --2- 172.21.15.52:0/2251729423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210101de0 0x7fe2101021c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009900 tx=0x7fe20c02a410 comp rx=0 tx=0).stop 2024-09-19T09:20:02.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 -- 172.21.15.52:0/2251729423 shutdown_connections 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 --2- 172.21.15.52:0/2251729423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe210106f10 0x7fe21010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 --2- 172.21.15.52:0/2251729423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe210102790 0x7fe2101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 --2- 172.21.15.52:0/2251729423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210101de0 0x7fe2101021c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 -- 172.21.15.52:0/2251729423 >> 172.21.15.52:0/2251729423 conn(0x7fe2100fd8c0 msgr2=0x7fe2100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 -- 172.21.15.52:0/2251729423 shutdown_connections 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.965+0000 7fe2172c7640 1 -- 172.21.15.52:0/2251729423 wait complete. 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 Processor -- start 2024-09-19T09:20:02.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 -- start start 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe210101de0 0x7fe2101983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe210102790 0x7fe210198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 0x7fe21019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe210111f90 con 0x7fe210106f10 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe210111e10 con 0x7fe210102790 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe2172c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe210112110 con 0x7fe210101de0 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.966+0000 7fe215864640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 0x7fe21019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 0x7fe21019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36968/0 (socket says 172.21.15.52:36968) 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 -- 172.21.15.52:0/4069772072 learned_addr learned my addr 172.21.15.52:0/4069772072 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215063640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe210101de0 0x7fe2101983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe214862640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe210102790 0x7fe210198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 -- 172.21.15.52:0/4069772072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe210101de0 msgr2=0x7fe2101983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe210101de0 0x7fe2101983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 -- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe210102790 msgr2=0x7fe210198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe210102790 0x7fe210198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21019d380 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe215864640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 0x7fe21019cca0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe20800b970 tx=0x7fe20800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208019070 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe208014440 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21019d670 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080075d0 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.967+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe210074420 con 0x7fe210106f10 2024-09-19T09:20:02.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.968+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe210062980 con 0x7fe210106f10 2024-09-19T09:20:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.970+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe20801c070 con 0x7fe210106f10 2024-09-19T09:20:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe2067fc640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1fc0a32d0 0x7fe1fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe215063640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1fc0a32d0 0x7fe1fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fe2080cf780 con 0x7fe210106f10 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe2067fc640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] conn(0x7fe1fc0acf80 0x7fe1fc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1fc0afaf0 con 0x7fe1fc0acf80 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fe2080cfb30 con 0x7fe210106f10 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe215063640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1fc0a32d0 0x7fe1fc0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000c00 tx=0x7fe20c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.971+0000 7fe214862640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] conn(0x7fe1fc0acf80 0x7fe1fc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.972+0000 7fe214862640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] conn(0x7fe1fc0acf80 0x7fe1fc0af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.973+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== osd.7 v2:172.21.15.86:6816/2917689244 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe1fc0afaf0 con 0x7fe1fc0acf80 2024-09-19T09:20:02.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.987+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 --> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe210062d80 con 0x7fe1fc0acf80 2024-09-19T09:20:02.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2067fc640 1 -- 172.21.15.52:0/4069772072 <== osd.7 v2:172.21.15.86:6816/2917689244 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe210062d80 con 0x7fe1fc0acf80 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] conn(0x7fe1fc0acf80 msgr2=0x7fe1fc0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] conn(0x7fe1fc0acf80 0x7fe1fc0af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1fc0a32d0 msgr2=0x7fe1fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1fc0a32d0 0x7fe1fc0a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000c00 tx=0x7fe20c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 msgr2=0x7fe21019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 --2- 172.21.15.52:0/4069772072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe210106f10 0x7fe21019cca0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe20800b970 tx=0x7fe20800bd70 comp rx=0 tx=0).stop 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe215864640 1 -- 172.21.15.52:0/4069772072 reap_dead start 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 shutdown_connections 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 >> 172.21.15.52:0/4069772072 conn(0x7fe2100fd8c0 msgr2=0x7fe2100fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 shutdown_connections 2024-09-19T09:20:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:02.988+0000 7fe2172c7640 1 -- 172.21.15.52:0/4069772072 wait complete. 2024-09-19T09:20:03.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:02 smithi052 ceph-mon[30947]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:03.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:02 smithi169 ceph-mon[35454]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:02 smithi086 ceph-mon[34813]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:03.526 INFO:teuthology.orchestra.run.smithi052.stdout:270582939674 2024-09-19T09:20:03.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:20:04.071 INFO:teuthology.orchestra.run.smithi052.stdout:304942678037 2024-09-19T09:20:04.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 -- 172.21.15.52:0/3435705606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 msgr2=0x7fc5e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 --2- 172.21.15.52:0/3435705606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e810ea90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009ca0 tx=0x7fc5e002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 -- 172.21.15.52:0/3435705606 shutdown_connections 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 --2- 172.21.15.52:0/3435705606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e810ea90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 --2- 172.21.15.52:0/3435705606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 0x7fc5e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 --2- 172.21.15.52:0/3435705606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5e8101de0 0x7fc5e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 -- 172.21.15.52:0/3435705606 >> 172.21.15.52:0/3435705606 conn(0x7fc5e80fd8c0 msgr2=0x7fc5e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:04.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 -- 172.21.15.52:0/3435705606 shutdown_connections 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.324+0000 7fc5ee787640 1 -- 172.21.15.52:0/3435705606 wait complete. 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 Processor -- start 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 -- start start 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5e8101de0 0x7fc5e8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 0x7fc5e8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8111f90 con 0x7fc5e8106f10 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8111e10 con 0x7fc5e8102790 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.325+0000 7fc5ee787640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e8112110 con 0x7fc5e8101de0 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36982/0 (socket says 172.21.15.52:36982) 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 -- 172.21.15.52:0/214049644 learned_addr learned my addr 172.21.15.52:0/214049644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:04.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e7fff640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5e8101de0 0x7fc5e8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e77fe640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 0x7fc5e8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 -- 172.21.15.52:0/214049644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5e8101de0 msgr2=0x7fc5e8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5e8101de0 0x7fc5e8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 -- 172.21.15.52:0/214049644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 msgr2=0x7fc5e8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 0x7fc5e8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e819d3c0 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e77fe640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e8102790 0x7fc5e8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ecd24640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e819cce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0031a60 tx=0x7fc5e0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003b70 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e819d650 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5e0003d10 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004770 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.326+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e81a4f90 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.327+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5e8062900 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.328+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc5e002f790 con 0x7fc5e8106f10 2024-09-19T09:20:04.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.329+0000 7fc5e57fa640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5d00a32d0 0x7fc5d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.329+0000 7fc5e7fff640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5d00a32d0 0x7fc5d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.329+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fc5e00f0f50 con 0x7fc5e8106f10 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.329+0000 7fc5e57fa640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] conn(0x7fc5d00acf80 0x7fc5d00af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.330+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5d00afaf0 con 0x7fc5d00acf80 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.330+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc5e00f13a0 con 0x7fc5e8106f10 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.330+0000 7fc5e77fe640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] conn(0x7fc5d00acf80 0x7fc5d00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.330+0000 7fc5e7fff640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5d00a32d0 0x7fc5d00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009990 tx=0x7fc5d8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.330+0000 7fc5e77fe640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] conn(0x7fc5d00acf80 0x7fc5d00af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.331+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== osd.0 v2:172.21.15.52:6802/1361807976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5d00afaf0 con 0x7fc5d00acf80 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.345+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 --> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5e8062d00 con 0x7fc5d00acf80 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5e57fa640 1 -- 172.21.15.52:0/214049644 <== osd.0 v2:172.21.15.52:6802/1361807976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc5e8062d00 con 0x7fc5d00acf80 2024-09-19T09:20:04.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] conn(0x7fc5d00acf80 msgr2=0x7fc5d00af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] conn(0x7fc5d00acf80 0x7fc5d00af420 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5d00a32d0 msgr2=0x7fc5d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5d00a32d0 0x7fc5d00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009990 tx=0x7fc5d8009110 comp rx=0 tx=0).stop 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 msgr2=0x7fc5e819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 --2- 172.21.15.52:0/214049644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5e8106f10 0x7fc5e819cce0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0031a60 tx=0x7fc5e0031a90 comp rx=0 tx=0).stop 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ecd24640 1 -- 172.21.15.52:0/214049644 reap_dead start 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 shutdown_connections 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 >> 172.21.15.52:0/214049644 conn(0x7fc5e80fd8c0 msgr2=0x7fc5e80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 shutdown_connections 2024-09-19T09:20:04.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:04.346+0000 7fc5ee787640 1 -- 172.21.15.52:0/214049644 wait complete. 2024-09-19T09:20:04.962 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:04 smithi052 ceph-mon[30947]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:04.997 INFO:teuthology.orchestra.run.smithi052.stdout:188978561066 2024-09-19T09:20:04.998 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:20:05.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:04 smithi169 ceph-mon[35454]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:05.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:04 smithi086 ceph-mon[34813]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:20:05.471 INFO:teuthology.orchestra.run.smithi052.stdout:34359738444 2024-09-19T09:20:05.472 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:20:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.898 INFO:teuthology.orchestra.run.smithi052.stdout:171798691886 2024-09-19T09:20:05.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:20:05.984 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.985 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.994 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.996 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.997 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.998 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:05.999 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:06.008 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:07.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:06 smithi169 ceph-mon[35454]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:07.257 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:06 smithi052 ceph-mon[30947]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:06 smithi086 ceph-mon[34813]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:07.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- 172.21.15.52:0/1222927983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2610102d30 msgr2=0x7f2610103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 --2- 172.21.15.52:0/1222927983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2610102d30 0x7f2610103110 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2600009930 tx=0x7f260002a420 comp rx=0 tx=0).stop 2024-09-19T09:20:07.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- 172.21.15.52:0/1222927983 shutdown_connections 2024-09-19T09:20:07.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 --2- 172.21.15.52:0/1222927983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 0x7f261010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 --2- 172.21.15.52:0/1222927983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26101036e0 0x7f2610107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 --2- 172.21.15.52:0/1222927983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2610102d30 0x7f2610103110 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- 172.21.15.52:0/1222927983 >> 172.21.15.52:0/1222927983 conn(0x7f26100fc7d0 msgr2=0x7f26100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- 172.21.15.52:0/1222927983 shutdown_connections 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- 172.21.15.52:0/1222927983 wait complete. 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 Processor -- start 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.543+0000 7f26161dc640 1 -- start start 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610102d30 0x7f26101a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 0x7f261019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26101120a0 con 0x7f26101036e0 2024-09-19T09:20:07.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2610111f20 con 0x7f2610102d30 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f26161dc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2610112220 con 0x7f26101082a0 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37032/0 (socket says 172.21.15.52:37032) 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 -- 172.21.15.52:0/176963787 learned_addr learned my addr 172.21.15.52:0/176963787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f260f7fe640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610102d30 0x7f26101a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f260ffff640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 0x7f261019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 -- 172.21.15.52:0/176963787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 msgr2=0x7f261019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 0x7f261019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 -- 172.21.15.52:0/176963787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610102d30 msgr2=0x7f26101a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610102d30 0x7f26101a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.544+0000 7f2607fff640 1 -- 172.21.15.52:0/176963787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261019ad20 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f2607fff640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25f800e9f0 tx=0x7f25f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f800ccc0 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25f8010910 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f261019b010 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8018920 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.545+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26101a7300 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.546+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261006a850 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.547+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f25f8010ac0 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.548+0000 7f260d7fa640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 0x7f25fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.548+0000 7f260f7fe640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 0x7f25fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.548+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f25f80cfd80 con 0x7f26101036e0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.549+0000 7f260f7fe640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 0x7f25fc0a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2600009900 tx=0x7f26000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.552+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25f809c920 con 0x7f26101036e0 2024-09-19T09:20:07.892 INFO:teuthology.orchestra.run.smithi052.stdout:68719476803 2024-09-19T09:20:07.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.738+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f261010c2c0 con 0x7f26101036e0 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.738+0000 7f260d7fa640 1 -- 172.21.15.52:0/176963787 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25f809c220 con 0x7f26101036e0 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.738+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 msgr2=0x7f25fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.738+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 0x7f25fc0a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2600009900 tx=0x7f26000058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 msgr2=0x7f26101a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25f800e9f0 tx=0x7f25f800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 shutdown_connections 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f25fc0a3350 0x7f25fc0a5810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26101082a0 0x7f261019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26101036e0 0x7f26101a0970 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 --2- 172.21.15.52:0/176963787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2610102d30 0x7f26101a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 >> 172.21.15.52:0/176963787 conn(0x7f26100fc7d0 msgr2=0x7f2610100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 shutdown_connections 2024-09-19T09:20:07.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.741+0000 7f26161dc640 1 -- 172.21.15.52:0/176963787 wait complete. 2024-09-19T09:20:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:07 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1039066153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:20:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:07 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2799682417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:20:08.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:07 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/176963787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:20:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.456+0000 7fb487d1f640 1 -- 172.21.15.52:0/1726798304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb480102d30 msgr2=0x7fb480103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.456+0000 7fb487d1f640 1 --2- 172.21.15.52:0/1726798304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb480102d30 0x7fb480103110 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb478009930 tx=0x7fb47802a420 comp rx=0 tx=0).stop 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 -- 172.21.15.52:0/1726798304 shutdown_connections 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 --2- 172.21.15.52:0/1726798304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 0x7fb48010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 --2- 172.21.15.52:0/1726798304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4801036e0 0x7fb480107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 --2- 172.21.15.52:0/1726798304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb480102d30 0x7fb480103110 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 -- 172.21.15.52:0/1726798304 >> 172.21.15.52:0/1726798304 conn(0x7fb4800fc7d0 msgr2=0x7fb4800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 -- 172.21.15.52:0/1726798304 shutdown_connections 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 -- 172.21.15.52:0/1726798304 wait complete. 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.457+0000 7fb487d1f640 1 Processor -- start 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 -- start start 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 0x7fb4801985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 0x7fb48019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4801120a0 con 0x7fb4801036e0 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb480111f20 con 0x7fb480102d30 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb487d1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb480112220 con 0x7fb4801082a0 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37010/0 (socket says 172.21.15.52:37010) 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 -- 172.21.15.52:0/2799682417 learned_addr learned my addr 172.21.15.52:0/2799682417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb485abb640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 0x7fb4801985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4862bc640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 0x7fb48019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 -- 172.21.15.52:0/2799682417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 msgr2=0x7fb48019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 0x7fb48019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 -- 172.21.15.52:0/2799682417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 msgr2=0x7fb4801985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 0x7fb4801985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb4852ba640 1 -- 172.21.15.52:0/2799682417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48019d5a0 con 0x7fb4801036e0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.458+0000 7fb485abb640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 0x7fb4801985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb4852ba640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb47400d740 tx=0x7fb47400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474017070 con 0x7fb4801036e0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48019d890 con 0x7fb4801036e0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb47400de50 con 0x7fb4801036e0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4801a5170 con 0x7fb4801036e0 2024-09-19T09:20:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.459+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47400f6b0 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.460+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48006a850 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.461+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb47401a070 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.462+0000 7fb47effd640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 0x7fb4680a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.463+0000 7fb485abb640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 0x7fb4680a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.463+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fb4740cf8d0 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.463+0000 7fb485abb640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 0x7fb4680a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb478005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.466+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb47409c490 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.651+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb48010a2b0 con 0x7fb4801036e0 2024-09-19T09:20:08.219 INFO:teuthology.orchestra.run.smithi052.stdout:253403070497 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.651+0000 7fb47effd640 1 -- 172.21.15.52:0/2799682417 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb47409bd90 con 0x7fb4801036e0 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 msgr2=0x7fb4680a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 0x7fb4680a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb478005a20 comp rx=0 tx=0).stop 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 msgr2=0x7fb480198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb47400d740 tx=0x7fb47400dc00 comp rx=0 tx=0).stop 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 shutdown_connections 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4680a3350 0x7fb4680a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4801082a0 0x7fb48019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4801036e0 0x7fb480198b30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 --2- 172.21.15.52:0/2799682417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb480102d30 0x7fb4801985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 >> 172.21.15.52:0/2799682417 conn(0x7fb4800fc7d0 msgr2=0x7fb480105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 shutdown_connections 2024-09-19T09:20:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.654+0000 7fb487d1f640 1 -- 172.21.15.52:0/2799682417 wait complete. 2024-09-19T09:20:08.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:07 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1039066153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:20:08.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:07 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2799682417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:20:08.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:07 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/176963787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:20:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:07 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1039066153' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:20:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:07 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2799682417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:20:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:07 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/176963787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:20:08.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070494 got 253403070497 for osd.9 2024-09-19T09:20:08.923 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 -- 172.21.15.52:0/258221046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190106f10 msgr2=0x7f419010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 --2- 172.21.15.52:0/258221046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190106f10 0x7f419010ea90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4188009ca0 tx=0x7f418802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 -- 172.21.15.52:0/258221046 shutdown_connections 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 --2- 172.21.15.52:0/258221046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190106f10 0x7f419010ea90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 --2- 172.21.15.52:0/258221046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 0x7f41901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 --2- 172.21.15.52:0/258221046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190101de0 0x7f41901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 -- 172.21.15.52:0/258221046 >> 172.21.15.52:0/258221046 conn(0x7f41900fd8c0 msgr2=0x7f41900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 -- 172.21.15.52:0/258221046 shutdown_connections 2024-09-19T09:20:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.091+0000 7f4197e28640 1 -- 172.21.15.52:0/258221046 wait complete. 2024-09-19T09:20:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 Processor -- start 2024-09-19T09:20:09.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 -- start start 2024-09-19T09:20:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 0x7f4190074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190106f10 0x7f4190074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4190111f70 con 0x7f4190101de0 2024-09-19T09:20:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4190111df0 con 0x7f4190106f10 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4197e28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41901120f0 con 0x7f4190102790 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4195bc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4195bc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37484/0 (socket says 172.21.15.52:37484) 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f4195bc4640 1 -- 172.21.15.52:0/3995091283 learned_addr learned my addr 172.21.15.52:0/3995091283 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f41963c5640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190106f10 0x7f4190074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.092+0000 7f41953c3640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 0x7f4190074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 -- 172.21.15.52:0/3995091283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 msgr2=0x7f4190074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 0x7f4190074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 -- 172.21.15.52:0/3995091283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190106f10 msgr2=0x7f4190074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190106f10 0x7f4190074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 -- 172.21.15.52:0/3995091283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41901a6850 con 0x7f4190101de0 2024-09-19T09:20:09.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4195bc4640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c920 tx=0x7f418c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c007c70 con 0x7f4190101de0 2024-09-19T09:20:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41901a6b40 con 0x7f4190101de0 2024-09-19T09:20:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418c007e10 con 0x7f4190101de0 2024-09-19T09:20:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c018890 con 0x7f4190101de0 2024-09-19T09:20:09.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.093+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41901a7080 con 0x7f4190101de0 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.094+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41901021c0 con 0x7f4190101de0 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.095+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f418c018a50 con 0x7f4190101de0 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.096+0000 7f4186ffd640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 0x7f417c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.096+0000 7f41953c3640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 0x7f417c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.096+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f418c0cfef0 con 0x7f4190101de0 2024-09-19T09:20:09.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.097+0000 7f41953c3640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 0x7f417c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4180005d90 tx=0x7f4180005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.100+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f418c0ff210 con 0x7f4190101de0 2024-09-19T09:20:09.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:08 smithi052 ceph-mon[30947]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:09.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:08 smithi086 ceph-mon[34813]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.275+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f41901a72b0 con 0x7f4190101de0 2024-09-19T09:20:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.275+0000 7f4186ffd640 1 -- 172.21.15.52:0/3995091283 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f418c014030 con 0x7f4190101de0 2024-09-19T09:20:09.277 INFO:teuthology.orchestra.run.smithi052.stdout:51539607625 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 msgr2=0x7f417c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 0x7f417c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4180005d90 tx=0x7f4180005d20 comp rx=0 tx=0).stop 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 msgr2=0x7f41900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f418c00c920 tx=0x7f418c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 shutdown_connections 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4190106f10 0x7f4190074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f417c0a32d0 0x7f417c0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4190102790 0x7f4190074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 --2- 172.21.15.52:0/3995091283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4190101de0 0x7f41900744f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 >> 172.21.15.52:0/3995091283 conn(0x7f41900fd8c0 msgr2=0x7f41900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.277+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 shutdown_connections 2024-09-19T09:20:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.278+0000 7f4197e28640 1 -- 172.21.15.52:0/3995091283 wait complete. 2024-09-19T09:20:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:08 smithi169 ceph-mon[35454]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 -- 172.21.15.52:0/3927903697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 msgr2=0x7f910410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 --2- 172.21.15.52:0/3927903697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f910410bb50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009900 tx=0x7f90f802a480 comp rx=0 tx=0).stop 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 -- 172.21.15.52:0/3927903697 shutdown_connections 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 --2- 172.21.15.52:0/3927903697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 0x7f910410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 --2- 172.21.15.52:0/3927903697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f910410bb50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 --2- 172.21.15.52:0/3927903697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 0x7f9104103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 -- 172.21.15.52:0/3927903697 >> 172.21.15.52:0/3927903697 conn(0x7f91040fc7a0 msgr2=0x7f91040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 -- 172.21.15.52:0/3927903697 shutdown_connections 2024-09-19T09:20:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.783+0000 7f9109141640 1 -- 172.21.15.52:0/3927903697 wait complete. 2024-09-19T09:20:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 Processor -- start 2024-09-19T09:20:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 -- start start 2024-09-19T09:20:09.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 0x7f91041009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 0x7f9104101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9104111f70 con 0x7f9104103660 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9104111df0 con 0x7f9104102d40 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f9109141640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91041120f0 con 0x7f910410c170 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f910259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.784+0000 7f910259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37502/0 (socket says 172.21.15.52:37502) 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 -- 172.21.15.52:0/549608076 learned_addr learned my addr 172.21.15.52:0/549608076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910359e640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 0x7f9104101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f9102d9d640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 0x7f91041009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 -- 172.21.15.52:0/549608076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 msgr2=0x7f9104101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 0x7f9104101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 -- 172.21.15.52:0/549608076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 msgr2=0x7f91041009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 0x7f91041009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 -- 172.21.15.52:0/549608076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91041a6930 con 0x7f9104103660 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f910259c640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006010 tx=0x7f90f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f803f030 con 0x7f9104103660 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f8003ce0 con 0x7f9104103660 2024-09-19T09:20:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91041a6bc0 con 0x7f9104103660 2024-09-19T09:20:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8035070 con 0x7f9104103660 2024-09-19T09:20:09.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.785+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91041a70a0 con 0x7f9104103660 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.787+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9104103120 con 0x7f9104103660 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.787+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f90f8042030 con 0x7f9104103660 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.788+0000 7f90ebfff640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 0x7f90ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.788+0000 7f9102d9d640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 0x7f90ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.788+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f90f80efff0 con 0x7f9104103660 2024-09-19T09:20:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.789+0000 7f9102d9d640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 0x7f90ec0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005d00 tx=0x7f90f400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.792+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f90f80bc600 con 0x7f9104103660 2024-09-19T09:20:09.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.979+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f91041071e0 con 0x7f9104103660 2024-09-19T09:20:09.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.979+0000 7f90ebfff640 1 -- 172.21.15.52:0/549608076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f90f80c0900 con 0x7f9104103660 2024-09-19T09:20:09.981 INFO:teuthology.orchestra.run.smithi052.stdout:304942678040 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 msgr2=0x7f90ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 0x7f90ec0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005d00 tx=0x7f90f400b410 comp rx=0 tx=0).stop 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 msgr2=0x7f9104100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90f8006010 tx=0x7f90f80042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 shutdown_connections 2024-09-19T09:20:09.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a32d0 0x7f90ec0a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f910410c170 0x7f9104101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104103660 0x7f9104100ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.982+0000 7f9109141640 1 --2- 172.21.15.52:0/549608076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9104102d40 0x7f91041009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.983+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 >> 172.21.15.52:0/549608076 conn(0x7f91040fc7a0 msgr2=0x7f91040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.983+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 shutdown_connections 2024-09-19T09:20:09.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.983+0000 7f9109141640 1 -- 172.21.15.52:0/549608076 wait complete. 2024-09-19T09:20:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 -- 172.21.15.52:0/4260700659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474100a90 msgr2=0x7ff474100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4260700659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474100a90 0x7ff474100ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff464009930 tx=0x7ff46402a420 comp rx=0 tx=0).stop 2024-09-19T09:20:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 -- 172.21.15.52:0/4260700659 shutdown_connections 2024-09-19T09:20:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4260700659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474101430 0x7ff47410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4260700659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474100a90 0x7ff474100ef0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4260700659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474106a90 0x7ff474106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 -- 172.21.15.52:0/4260700659 >> 172.21.15.52:0/4260700659 conn(0x7ff4740fc7d0 msgr2=0x7ff4740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 -- 172.21.15.52:0/4260700659 shutdown_connections 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.958+0000 7ff47ba52640 1 -- 172.21.15.52:0/4260700659 wait complete. 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 Processor -- start 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 -- start start 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 0x7ff474197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474101430 0x7ff4741978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff474110e90 con 0x7ff474106a90 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff474110d10 con 0x7ff474100a90 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff47ba52640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff474111010 con 0x7ff474101430 2024-09-19T09:20:09.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff4797ee640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 0x7ff474197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37530/0 (socket says 172.21.15.52:37530) 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 -- 172.21.15.52:0/4146894322 learned_addr learned my addr 172.21.15.52:0/4146894322 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff478fed640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474101430 0x7ff4741978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 -- 172.21.15.52:0/4146894322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474101430 msgr2=0x7ff4741978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474101430 0x7ff4741978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 -- 172.21.15.52:0/4146894322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 msgr2=0x7ff474197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 0x7ff474197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff479fef640 1 -- 172.21.15.52:0/4146894322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47419c340 con 0x7ff474106a90 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.959+0000 7ff4797ee640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 0x7ff474197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff479fef640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00eca0 tx=0x7ff46c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c004b20 con 0x7ff474106a90 2024-09-19T09:20:09.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff46c004cc0 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47419c630 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c017650 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.960+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47406a790 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.961+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4741021d0 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.962+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff46c005020 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.963+0000 7ff46a7fc640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 0x7ff4600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.963+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7ff46c0d14f0 con 0x7ff474106a90 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.963+0000 7ff4797ee640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 0x7ff4600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.963+0000 7ff4797ee640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 0x7ff4600a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff470009f40 tx=0x7ff470005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:09.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:09.967+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff46c09da40 con 0x7ff474106a90 2024-09-19T09:20:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.159+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff47406b1b0 con 0x7ff474106a90 2024-09-19T09:20:10.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.160+0000 7ff46a7fc640 1 -- 172.21.15.52:0/4146894322 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff46c0a1d40 con 0x7ff474106a90 2024-09-19T09:20:10.161 INFO:teuthology.orchestra.run.smithi052.stdout:141733920821 2024-09-19T09:20:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 msgr2=0x7ff4600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:10.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 0x7ff4600a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff470009f40 tx=0x7ff470005f90 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 msgr2=0x7ff47419bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00eca0 tx=0x7ff46c00b690 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 shutdown_connections 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff474106a90 0x7ff47419bc60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4600a32d0 0x7ff4600a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff474101430 0x7ff4741978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 --2- 172.21.15.52:0/4146894322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff474100a90 0x7ff474197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 >> 172.21.15.52:0/4146894322 conn(0x7ff4740fc7d0 msgr2=0x7ff4740fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 shutdown_connections 2024-09-19T09:20:10.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:10.162+0000 7ff47ba52640 1 -- 172.21.15.52:0/4146894322 wait complete. 2024-09-19T09:20:10.226 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:09 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3995091283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:20:10.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:09 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3995091283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:20:10.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:09 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3995091283' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:20:10.837 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920819 got 141733920821 for osd.5 2024-09-19T09:20:10.838 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:11.061 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:10 smithi052 ceph-mon[30947]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:11.061 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:10 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/549608076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:20:11.061 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:10 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4146894322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:20:11.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.883+0000 7f81332de640 1 -- 172.21.15.52:0/224827894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c101280 msgr2=0x7f812c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.883+0000 7f81332de640 1 --2- 172.21.15.52:0/224827894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c101280 0x7f812c10df40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f811c009900 tx=0x7f811c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- 172.21.15.52:0/224827894 shutdown_connections 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- 172.21.15.52:0/224827894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c10e480 0x7f812c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- 172.21.15.52:0/224827894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c101280 0x7f812c10df40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- 172.21.15.52:0/224827894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c1008d0 0x7f812c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- 172.21.15.52:0/224827894 >> 172.21.15.52:0/224827894 conn(0x7f812c0fc7a0 msgr2=0x7f812c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- 172.21.15.52:0/224827894 shutdown_connections 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- 172.21.15.52:0/224827894 wait complete. 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 Processor -- start 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- start start 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c1008d0 0x7f812c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 0x7f812c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f812c114190 con 0x7f812c10e480 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f812c114010 con 0x7f812c101280 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.884+0000 7f81332de640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f812c114310 con 0x7f812c1008d0 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36992/0 (socket says 172.21.15.52:36992) 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813107a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c1008d0 0x7f812c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 -- 172.21.15.52:0/1039066153 learned_addr learned my addr 172.21.15.52:0/1039066153 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f8130879640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 0x7f812c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 -- 172.21.15.52:0/1039066153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c1008d0 msgr2=0x7f812c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c1008d0 0x7f812c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 -- 172.21.15.52:0/1039066153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 msgr2=0x7f812c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 0x7f812c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 -- 172.21.15.52:0/1039066153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c19f600 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f8130879640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 0x7f812c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f813187b640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f812400cce0 tx=0x7f812400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812400f450 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c19f8f0 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f812400fad0 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124018bd0 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.885+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c1a71d0 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.886+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c100cb0 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.887+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f812400fc80 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.888+0000 7f81227fc640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.888+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f81240d0140 con 0x7f812c10e480 2024-09-19T09:20:11.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.888+0000 7f813107a640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.889+0000 7f813107a640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 0x7f81180a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f812800bbe0 tx=0x7f812800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:06.892+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8124014030 con 0x7f812c10e480 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.073+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f812c109670 con 0x7f812c10e480 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stdout:223338299430 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.074+0000 7f81227fc640 1 -- 172.21.15.52:0/1039066153 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f812409cce0 con 0x7f812c10e480 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 msgr2=0x7f81180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 0x7f81180a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f812800bbe0 tx=0x7f812800b390 comp rx=0 tx=0).stop 2024-09-19T09:20:11.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 msgr2=0x7f812c19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f812400cce0 tx=0x7f812400a620 comp rx=0 tx=0).stop 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 shutdown_connections 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c10e480 0x7f812c19ef20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c101280 0x7f812c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f81180a32d0 0x7f81180a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 --2- 172.21.15.52:0/1039066153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f812c1008d0 0x7f812c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 >> 172.21.15.52:0/1039066153 conn(0x7f812c0fc7a0 msgr2=0x7f812c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 shutdown_connections 2024-09-19T09:20:11.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:07.076+0000 7f81332de640 1 -- 172.21.15.52:0/1039066153 wait complete. 2024-09-19T09:20:11.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:10 smithi086 ceph-mon[34813]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:11.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:10 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/549608076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:20:11.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:10 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4146894322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:20:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 -- 172.21.15.52:0/2142755685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc108290 msgr2=0x7f08cc10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 --2- 172.21.15.52:0/2142755685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc108290 0x7f08cc10ec30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009cd0 tx=0x7f08c402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 -- 172.21.15.52:0/2142755685 shutdown_connections 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 --2- 172.21.15.52:0/2142755685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc108290 0x7f08cc10ec30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 --2- 172.21.15.52:0/2142755685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc103740 0x7f08cc107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 --2- 172.21.15.52:0/2142755685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 0x7f08cc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 -- 172.21.15.52:0/2142755685 >> 172.21.15.52:0/2142755685 conn(0x7f08cc0fc7d0 msgr2=0x7f08cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 -- 172.21.15.52:0/2142755685 shutdown_connections 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.419+0000 7f08d2acb640 1 -- 172.21.15.52:0/2142755685 wait complete. 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 Processor -- start 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 -- start start 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 0x7f08cc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc108290 0x7f08cc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc112090 con 0x7f08cc103740 2024-09-19T09:20:11.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc111f10 con 0x7f08cc108290 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d2acb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc112210 con 0x7f08cc102d90 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37548/0 (socket says 172.21.15.52:37548) 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08c3fff640 1 -- 172.21.15.52:0/988759185 learned_addr learned my addr 172.21.15.52:0/988759185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.420+0000 7f08d0867640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 0x7f08cc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08d1068640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc108290 0x7f08cc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 -- 172.21.15.52:0/988759185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 msgr2=0x7f08cc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 0x7f08cc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 -- 172.21.15.52:0/988759185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc108290 msgr2=0x7f08cc101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc108290 0x7f08cc101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 -- 172.21.15.52:0/988759185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1a6a30 con 0x7f08cc103740 2024-09-19T09:20:11.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c3fff640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00d770 tx=0x7f08bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc017070 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc1a6d20 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08bc009c30 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00f620 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.421+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc1a7250 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.423+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08cc06a7f0 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.424+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08bc01a070 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.425+0000 7f08c1ffb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.425+0000 7f08d0867640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.425+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f08bc0cf4c0 con 0x7f08cc103740 2024-09-19T09:20:11.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.425+0000 7f08d0867640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 0x7f08b40a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005fd0 tx=0x7f08c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:11.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.429+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08bc009de0 con 0x7f08cc103740 2024-09-19T09:20:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:10 smithi169 ceph-mon[35454]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:10 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/549608076' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:20:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:10 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4146894322' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:20:11.455 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:11.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.623+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f08cc10a2a0 con 0x7f08cc103740 2024-09-19T09:20:11.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.624+0000 7f08c1ffb640 1 -- 172.21.15.52:0/988759185 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08bc09ba10 con 0x7f08cc103740 2024-09-19T09:20:11.626 INFO:teuthology.orchestra.run.smithi052.stdout:94489280573 2024-09-19T09:20:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 msgr2=0x7f08b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 0x7f08b40a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08c8005fd0 tx=0x7f08c800b390 comp rx=0 tx=0).stop 2024-09-19T09:20:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 msgr2=0x7f08cc100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:11.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00d770 tx=0x7f08bc00dc30 comp rx=0 tx=0).stop 2024-09-19T09:20:11.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 shutdown_connections 2024-09-19T09:20:11.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08cc108290 0x7f08cc101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08cc103740 0x7f08cc100f30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f08b40a32d0 0x7f08b40a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 --2- 172.21.15.52:0/988759185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08cc102d90 0x7f08cc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 >> 172.21.15.52:0/988759185 conn(0x7f08cc0fc7d0 msgr2=0x7f08cc105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 shutdown_connections 2024-09-19T09:20:11.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.626+0000 7f08d2acb640 1 -- 172.21.15.52:0/988759185 wait complete. 2024-09-19T09:20:11.877 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607622 got 51539607625 for osd.1 2024-09-19T09:20:11.877 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:12.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 -- 172.21.15.52:0/2855811929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102570 msgr2=0x7f7b301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 --2- 172.21.15.52:0/2855811929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102570 0x7f7b301029b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009900 tx=0x7f7b2402a480 comp rx=0 tx=0).stop 2024-09-19T09:20:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 -- 172.21.15.52:0/2855811929 shutdown_connections 2024-09-19T09:20:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 --2- 172.21.15.52:0/2855811929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102ef0 0x7f7b3010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 --2- 172.21.15.52:0/2855811929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102570 0x7f7b301029b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 --2- 172.21.15.52:0/2855811929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 -- 172.21.15.52:0/2855811929 >> 172.21.15.52:0/2855811929 conn(0x7f7b300fc7d0 msgr2=0x7f7b300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 -- 172.21.15.52:0/2855811929 shutdown_connections 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.335+0000 7f7b36522640 1 -- 172.21.15.52:0/2855811929 wait complete. 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.336+0000 7f7b36522640 1 Processor -- start 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.336+0000 7f7b36522640 1 -- start start 2024-09-19T09:20:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.336+0000 7f7b36522640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b36522640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102570 0x7f7b30198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b36522640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 0x7f7b3019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b36522640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30110fd0 con 0x7f7b30102ef0 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b36522640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30110e50 con 0x7f7b30102570 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b36522640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30111150 con 0x7f7b30100e20 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b34abf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 0x7f7b3019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:37734/0 (socket says 172.21.15.52:37734) 2024-09-19T09:20:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b34abf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 0x7f7b3019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37538/0 (socket says 172.21.15.52:37538) 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 -- 172.21.15.52:0/920853480 learned_addr learned my addr 172.21.15.52:0/920853480 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2f7fe640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102570 0x7f7b30198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 -- 172.21.15.52:0/920853480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102570 msgr2=0x7f7b30198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102570 0x7f7b30198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 -- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 msgr2=0x7f7b3019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 0x7f7b3019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 -- 172.21.15.52:0/920853480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3019d540 con 0x7f7b30100e20 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.337+0000 7f7b2ffff640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9f0 tx=0x7f7b2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.338+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000cd80 con 0x7f7b30100e20 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.338+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b20010910 con 0x7f7b30100e20 2024-09-19T09:20:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.338+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20018990 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.338+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3019d830 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.338+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b301a5110 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.339+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b301021b0 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.340+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7b20010ac0 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.341+0000 7f7b2d7fa640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 0x7f7b180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.341+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f7b200d0130 con 0x7f7b30100e20 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.341+0000 7f7b2f7fe640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 0x7f7b180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.341+0000 7f7b2f7fe640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 0x7f7b180a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b24005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.345+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b2009c680 con 0x7f7b30100e20 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.535+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7b30101200 con 0x7f7b30100e20 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.535+0000 7f7b2d7fa640 1 -- 172.21.15.52:0/920853480 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7b200a0980 con 0x7f7b30100e20 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stdout:270582939676 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 msgr2=0x7f7b180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 0x7f7b180a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b24000c00 tx=0x7f7b24005b50 comp rx=0 tx=0).stop 2024-09-19T09:20:12.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 msgr2=0x7f7b30198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e9f0 tx=0x7f7b2000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 shutdown_connections 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b30102ef0 0x7f7b3019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b30102570 0x7f7b30198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b180a32d0 0x7f7b180a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 --2- 172.21.15.52:0/920853480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b30100e20 0x7f7b30198590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.537+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 >> 172.21.15.52:0/920853480 conn(0x7f7b300fc7d0 msgr2=0x7f7b3006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.538+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 shutdown_connections 2024-09-19T09:20:12.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:11.538+0000 7f7b36522640 1 -- 172.21.15.52:0/920853480 wait complete. 2024-09-19T09:20:12.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:11 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/920853480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:20:12.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:11 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/988759185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:20:12.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:11 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/920853480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:20:12.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:11 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/988759185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:20:12.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:11 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/920853480' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:20:12.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:11 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/988759185' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:20:12.994 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299430 for osd.8 2024-09-19T09:20:12.994 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:13.095 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:12 smithi052 ceph-mon[30947]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:12 smithi086 ceph-mon[34813]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:13.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678037 got 304942678040 for osd.11 2024-09-19T09:20:13.412 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:12 smithi169 ceph-mon[35454]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:13.905 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476801 got 68719476803 for osd.2 2024-09-19T09:20:13.905 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:13.932 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:14.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:13 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:14.185 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:13 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:14.231 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:13 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:14.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280571 got 94489280573 for osd.3 2024-09-19T09:20:14.382 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:14.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 -- 172.21.15.52:0/292178997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0109120 msgr2=0x7fb4c0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 --2- 172.21.15.52:0/292178997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0109120 0x7fb4c0110ca0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009ca0 tx=0x7fb4b802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 -- 172.21.15.52:0/292178997 shutdown_connections 2024-09-19T09:20:14.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 --2- 172.21.15.52:0/292178997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c0109120 0x7fb4c0110ca0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 --2- 172.21.15.52:0/292178997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c01049a0 0x7fb4c01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 --2- 172.21.15.52:0/292178997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0103ff0 0x7fb4c01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 -- 172.21.15.52:0/292178997 >> 172.21.15.52:0/292178997 conn(0x7fb4c00ffa90 msgr2=0x7fb4c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 -- 172.21.15.52:0/292178997 shutdown_connections 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.656+0000 7fb4c782e640 1 -- 172.21.15.52:0/292178997 wait complete. 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 Processor -- start 2024-09-19T09:20:14.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 -- start start 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 0x7fb4c019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 0x7fb4c019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c0114130 con 0x7fb4c01049a0 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c0113fb0 con 0x7fb4c0109120 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c782e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c01142b0 con 0x7fb4c0103ff0 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c4dc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c55ca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 0x7fb4c019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c4dc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37556/0 (socket says 172.21.15.52:37556) 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c5dcb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 0x7fb4c019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.657+0000 7fb4c4dc9640 1 -- 172.21.15.52:0/3410917303 learned_addr learned my addr 172.21.15.52:0/3410917303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:14.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 -- 172.21.15.52:0/3410917303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 msgr2=0x7fb4c019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 0x7fb4c019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 -- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 msgr2=0x7fb4c019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 -- 172.21.15.52:0/3410917303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c019f580 con 0x7fb4c0103ff0 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c4dc9640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c5dcb640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 0x7fb4c019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c55ca640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 0x7fb4c019a5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e9f0 tx=0x7fb4bc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:14.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00ccc0 con 0x7fb4c0103ff0 2024-09-19T09:20:14.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c019f870 con 0x7fb4c0103ff0 2024-09-19T09:20:14.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4bc010910 con 0x7fb4c0103ff0 2024-09-19T09:20:14.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc018960 con 0x7fb4c0103ff0 2024-09-19T09:20:14.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.658+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c01a7150 con 0x7fb4c0103ff0 2024-09-19T09:20:14.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.659+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c01043d0 con 0x7fb4c0103ff0 2024-09-19T09:20:14.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.661+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb4bc010ac0 con 0x7fb4c0103ff0 2024-09-19T09:20:14.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.661+0000 7fb4b67fc640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 0x7fb4ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.661+0000 7fb4c4dc9640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 0x7fb4ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.661+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fb4bc0d0370 con 0x7fb4c0103ff0 2024-09-19T09:20:14.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.662+0000 7fb4c4dc9640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 0x7fb4ac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00ffeb0 tx=0x7fb4b000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:14.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.665+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb4bc09c860 con 0x7fb4c0103ff0 2024-09-19T09:20:14.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.842+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb4c010bdd0 con 0x7fb4c0103ff0 2024-09-19T09:20:14.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.842+0000 7fb4b67fc640 1 -- 172.21.15.52:0/3410917303 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb4bc0a0b60 con 0x7fb4c0103ff0 2024-09-19T09:20:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:124554051643 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 msgr2=0x7fb4ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 0x7fb4ac0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00ffeb0 tx=0x7fb4b000b4a0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 msgr2=0x7fb4c019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 0x7fb4c019a5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00e9f0 tx=0x7fb4bc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 shutdown_connections 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4c0109120 0x7fb4c019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4c01049a0 0x7fb4c019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4ac0a32d0 0x7fb4ac0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 --2- 172.21.15.52:0/3410917303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4c0103ff0 0x7fb4c019a5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 >> 172.21.15.52:0/3410917303 conn(0x7fb4c00ffa90 msgr2=0x7fb4c0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:14.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 shutdown_connections 2024-09-19T09:20:14.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:14.844+0000 7fb4c782e640 1 -- 172.21.15.52:0/3410917303 wait complete. 2024-09-19T09:20:15.142 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:15.244 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:14 smithi052 ceph-mon[30947]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:15.245 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:14 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3410917303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:20:15.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:14 smithi086 ceph-mon[34813]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:15.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:14 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3410917303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:20:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:14 smithi169 ceph-mon[35454]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:14 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3410917303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:20:15.573 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939674 got 270582939676 for osd.10 2024-09-19T09:20:15.573 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1744906553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4101de0 msgr2=0x7f06e41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1744906553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4101de0 0x7f06e41021c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009900 tx=0x7f06d402a410 comp rx=0 tx=0).stop 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1744906553 shutdown_connections 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1744906553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1744906553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4102790 0x7f06e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1744906553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4101de0 0x7f06e41021c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1744906553 >> 172.21.15.52:0/1744906553 conn(0x7f06e40fd8c0 msgr2=0x7f06e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1744906553 shutdown_connections 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1744906553 wait complete. 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 Processor -- start 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.729+0000 7f06ea8a8640 1 -- start start 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 0x7f06e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4111f70 con 0x7f06e4101de0 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4111df0 con 0x7f06e4102790 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06ea8a8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41120f0 con 0x7f06e4106f10 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37578/0 (socket says 172.21.15.52:37578) 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 -- 172.21.15.52:0/1387613511 learned_addr learned my addr 172.21.15.52:0/1387613511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e37fe640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 0x7f06e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e8e45640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 -- 172.21.15.52:0/1387613511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 msgr2=0x7f06e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 -- 172.21.15.52:0/1387613511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 msgr2=0x7f06e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 0x7f06e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 -- 172.21.15.52:0/1387613511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e41a68f0 con 0x7f06e4101de0 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e8e45640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e37fe640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 0x7f06e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.730+0000 7f06e3fff640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006010 tx=0x7f06d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.731+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d403f030 con 0x7f06e4101de0 2024-09-19T09:20:15.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.731+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e41a6b80 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.731+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d4003ce0 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.731+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4035070 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.731+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41a70b0 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.732+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e41021c0 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.733+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f06d4042030 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.734+0000 7f06e17fa640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 0x7f06cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.734+0000 7f06e37fe640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 0x7f06cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.734+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f06d40f03c0 con 0x7f06e4101de0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.734+0000 7f06e37fe640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 0x7f06cc0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06d80095f0 tx=0x7f06d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.737+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06d40bcfc0 con 0x7f06e4101de0 2024-09-19T09:20:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.922+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f06e410a0f0 con 0x7f06e4101de0 2024-09-19T09:20:15.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.922+0000 7f06e17fa640 1 -- 172.21.15.52:0/1387613511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06d40bc8c0 con 0x7f06e4101de0 2024-09-19T09:20:15.924 INFO:teuthology.orchestra.run.smithi052.stdout:34359738446 2024-09-19T09:20:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 msgr2=0x7f06cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 0x7f06cc0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f06d80095f0 tx=0x7f06d8005f90 comp rx=0 tx=0).stop 2024-09-19T09:20:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 msgr2=0x7f06e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f06d4006010 tx=0x7f06d40042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 shutdown_connections 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06cc0a32d0 0x7f06cc0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06e4106f10 0x7f06e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4102790 0x7f06e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 --2- 172.21.15.52:0/1387613511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06e4101de0 0x7f06e40744f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 >> 172.21.15.52:0/1387613511 conn(0x7f06e40fd8c0 msgr2=0x7f06e40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 shutdown_connections 2024-09-19T09:20:15.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:15.925+0000 7f06ea8a8640 1 -- 172.21.15.52:0/1387613511 wait complete. 2024-09-19T09:20:16.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:15 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:15 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1387613511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:20:16.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:15 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:15 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1387613511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:20:16.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 -- 172.21.15.52:0/4134411528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 msgr2=0x7f26c010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 --2- 172.21.15.52:0/4134411528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c010df30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009900 tx=0x7f26a802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 -- 172.21.15.52:0/4134411528 shutdown_connections 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 --2- 172.21.15.52:0/4134411528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c010e470 0x7f26c01108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 --2- 172.21.15.52:0/4134411528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c010df30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 --2- 172.21.15.52:0/4134411528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c00745a0 0x7f26c0074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 -- 172.21.15.52:0/4134411528 >> 172.21.15.52:0/4134411528 conn(0x7f26c00fd8d0 msgr2=0x7f26c00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 -- 172.21.15.52:0/4134411528 shutdown_connections 2024-09-19T09:20:16.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 -- 172.21.15.52:0/4134411528 wait complete. 2024-09-19T09:20:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.307+0000 7f26c4b97640 1 Processor -- start 2024-09-19T09:20:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 -- start start 2024-09-19T09:20:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 0x7f26c019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 0x7f26c019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01141d0 con 0x7f26c0074f50 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26c0114050 con 0x7f26c00745a0 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26c4b97640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26c0114350 con 0x7f26c010e470 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37590/0 (socket says 172.21.15.52:37590) 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 -- 172.21.15.52:0/1361581459 learned_addr learned my addr 172.21.15.52:0/1361581459 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26be59c640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 0x7f26c019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bed9d640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 0x7f26c019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 -- 172.21.15.52:0/1361581459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 msgr2=0x7f26c019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 0x7f26c019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 -- 172.21.15.52:0/1361581459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 msgr2=0x7f26c019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 0x7f26c019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 -- 172.21.15.52:0/1361581459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c019f620 con 0x7f26c0074f50 2024-09-19T09:20:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bed9d640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 0x7f26c019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26be59c640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 0x7f26c019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.308+0000 7f26bdd9b640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f26a8006010 tx=0x7f26a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.309+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a803f030 con 0x7f26c0074f50 2024-09-19T09:20:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.309+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c019f8b0 con 0x7f26c0074f50 2024-09-19T09:20:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.309+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26a8003ce0 con 0x7f26c0074f50 2024-09-19T09:20:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.309+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a8035070 con 0x7f26c0074f50 2024-09-19T09:20:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.309+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c01a71f0 con 0x7f26c0074f50 2024-09-19T09:20:16.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.310+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c0074980 con 0x7f26c0074f50 2024-09-19T09:20:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.311+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f26a8042030 con 0x7f26c0074f50 2024-09-19T09:20:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.312+0000 7f26b77fe640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 0x7f26ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.312+0000 7f26be59c640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 0x7f26ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.312+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f26a80f0690 con 0x7f26c0074f50 2024-09-19T09:20:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.313+0000 7f26be59c640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 0x7f26ac0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f26b80058c0 tx=0x7f26b8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.315+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26a8049060 con 0x7f26c0074f50 2024-09-19T09:20:16.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:15 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:16.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:15 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1387613511' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:20:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.494+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f26c01095f0 con 0x7f26c0074f50 2024-09-19T09:20:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.495+0000 7f26b77fe640 1 -- 172.21.15.52:0/1361581459 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26a80bd1d0 con 0x7f26c0074f50 2024-09-19T09:20:16.497 INFO:teuthology.orchestra.run.smithi052.stdout:188978561068 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 msgr2=0x7f26ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 0x7f26ac0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f26b80058c0 tx=0x7f26b8005850 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 msgr2=0x7f26c019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f26a8006010 tx=0x7f26a80042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 shutdown_connections 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26ac0a32d0 0x7f26ac0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26c010e470 0x7f26c019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c0074f50 0x7f26c019abb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 --2- 172.21.15.52:0/1361581459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26c00745a0 0x7f26c019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 >> 172.21.15.52:0/1361581459 conn(0x7f26c00fd8d0 msgr2=0x7f26c00fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 shutdown_connections 2024-09-19T09:20:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.497+0000 7f26c4b97640 1 -- 172.21.15.52:0/1361581459 wait complete. 2024-09-19T09:20:16.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.529+0000 7f4b84f71640 1 -- 172.21.15.52:0/3656647218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80101420 msgr2=0x7f4b8010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.529+0000 7f4b84f71640 1 --2- 172.21.15.52:0/3656647218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80101420 0x7f4b8010d950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009cd0 tx=0x7f4b7802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 -- 172.21.15.52:0/3656647218 shutdown_connections 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 --2- 172.21.15.52:0/3656647218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80101420 0x7f4b8010d950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 --2- 172.21.15.52:0/3656647218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 0x7f4b80100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 --2- 172.21.15.52:0/3656647218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80106a80 0x7f4b80106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 -- 172.21.15.52:0/3656647218 >> 172.21.15.52:0/3656647218 conn(0x7f4b800fc7a0 msgr2=0x7f4b800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 -- 172.21.15.52:0/3656647218 shutdown_connections 2024-09-19T09:20:16.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 -- 172.21.15.52:0/3656647218 wait complete. 2024-09-19T09:20:16.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 Processor -- start 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.530+0000 7f4b84f71640 1 -- start start 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 0x7f4b8019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80101420 0x7f4b8019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80110ed0 con 0x7f4b80106a80 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80110d50 con 0x7f4b80100a80 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b84f71640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80111050 con 0x7f4b80101420 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37604/0 (socket says 172.21.15.52:37604) 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 -- 172.21.15.52:0/2570713441 learned_addr learned my addr 172.21.15.52:0/2570713441 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b77fff640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80101420 0x7f4b8019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7e59c640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 0x7f4b8019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 -- 172.21.15.52:0/2570713441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80101420 msgr2=0x7f4b8019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80101420 0x7f4b8019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 -- 172.21.15.52:0/2570713441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 msgr2=0x7f4b8019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 0x7f4b8019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 -- 172.21.15.52:0/2570713441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8019f5b0 con 0x7f4b80106a80 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.531+0000 7f4b7ed9d640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b78033040 tx=0x7f4b78003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.532+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78004040 con 0x7f4b80106a80 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.532+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b780046c0 con 0x7f4b80106a80 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.532+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8019f840 con 0x7f4b80106a80 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.532+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78046480 con 0x7f4b80106a80 2024-09-19T09:20:16.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.532+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a7180 con 0x7f4b80106a80 2024-09-19T09:20:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.533+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80100ee0 con 0x7f4b80106a80 2024-09-19T09:20:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.534+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b780305a0 con 0x7f4b80106a80 2024-09-19T09:20:16.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.535+0000 7f4b777fe640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 0x7f4b6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.535+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f4b7802e030 con 0x7f4b80106a80 2024-09-19T09:20:16.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.535+0000 7f4b7e59c640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 0x7f4b6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.536+0000 7f4b7e59c640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 0x7f4b6c0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b70005d90 tx=0x7f4b70005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.538+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b7804b060 con 0x7f4b80106a80 2024-09-19T09:20:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.718+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4b801a73e0 con 0x7f4b80106a80 2024-09-19T09:20:16.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.718+0000 7f4b777fe640 1 -- 172.21.15.52:0/2570713441 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4b780bdf00 con 0x7f4b80106a80 2024-09-19T09:20:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:171798691889 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 msgr2=0x7f4b6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 0x7f4b6c0a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4b70005d90 tx=0x7f4b70005d20 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 msgr2=0x7f4b8019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b78033040 tx=0x7f4b78003970 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 shutdown_connections 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b80106a80 0x7f4b8019eed0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b6c0a3350 0x7f4b6c0a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b80101420 0x7f4b8019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 --2- 172.21.15.52:0/2570713441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b80100a80 0x7f4b8019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 >> 172.21.15.52:0/2570713441 conn(0x7f4b800fc7a0 msgr2=0x7f4b8006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 shutdown_connections 2024-09-19T09:20:16.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:16.720+0000 7f4b84f71640 1 -- 172.21.15.52:0/2570713441 wait complete. 2024-09-19T09:20:17.265 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:17 smithi052 ceph-mon[30947]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:17.266 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1361581459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:20:17.266 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2570713441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:20:17.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051639 got 124554051643 for osd.4 2024-09-19T09:20:17.296 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:17 smithi169 ceph-mon[35454]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1361581459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:20:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2570713441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:20:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:17 smithi086 ceph-mon[34813]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1361581459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:20:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2570713441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:20:17.991 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561066 got 188978561068 for osd.7 2024-09-19T09:20:17.991 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:18.446 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691886 got 171798691889 for osd.6 2024-09-19T09:20:18.446 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:18.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-19T09:20:18.862 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:18.862 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:20:18.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:20:19.078 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:19 smithi052 ceph-mon[30947]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:19 smithi169 ceph-mon[35454]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:19 smithi086 ceph-mon[34813]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:19.581 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 -- 172.21.15.52:0/994164366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184106f10 msgr2=0x7ff18410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 --2- 172.21.15.52:0/994164366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184106f10 0x7ff18410ea90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009ca0 tx=0x7ff17c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 -- 172.21.15.52:0/994164366 shutdown_connections 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 --2- 172.21.15.52:0/994164366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184106f10 0x7ff18410ea90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 --2- 172.21.15.52:0/994164366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 0x7ff1841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 --2- 172.21.15.52:0/994164366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184101de0 0x7ff1841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 -- 172.21.15.52:0/994164366 >> 172.21.15.52:0/994164366 conn(0x7ff1840fd8c0 msgr2=0x7ff1840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 -- 172.21.15.52:0/994164366 shutdown_connections 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.047+0000 7ff18afc0640 1 -- 172.21.15.52:0/994164366 wait complete. 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 Processor -- start 2024-09-19T09:20:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 -- start start 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 0x7ff184074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184106f10 0x7ff184074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff184111f70 con 0x7ff184101de0 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff184111df0 con 0x7ff184106f10 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff18afc0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1841120f0 con 0x7ff184102790 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.048+0000 7ff188d5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45324/0 (socket says 172.21.15.52:45324) 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 -- 172.21.15.52:0/1138590924 learned_addr learned my addr 172.21.15.52:0/1138590924 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff183fff640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 0x7ff184074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff18955d640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184106f10 0x7ff184074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 -- 172.21.15.52:0/1138590924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 msgr2=0x7ff184074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 0x7ff184074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 -- 172.21.15.52:0/1138590924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184106f10 msgr2=0x7ff184074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184106f10 0x7ff184074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 -- 172.21.15.52:0/1138590924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1841a6800 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.049+0000 7ff188d5c640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d950 tx=0x7ff17800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.051+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178017070 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.051+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff17800de80 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.051+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800f620 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.051+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1841a6af0 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.052+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1841a6fe0 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.053+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1841021c0 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.054+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff178009c30 con 0x7ff184101de0 2024-09-19T09:20:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.054+0000 7ff181ffb640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 0x7ff1740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.054+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7ff1780cf640 con 0x7ff184101de0 2024-09-19T09:20:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.054+0000 7ff183fff640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 0x7ff1740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.055+0000 7ff183fff640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 0x7ff1740a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff184075f80 tx=0x7ff17000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.059+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff17809c1e0 con 0x7ff184101de0 2024-09-19T09:20:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.250+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff184062630 con 0x7ff1740a3350 2024-09-19T09:20:20.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.259+0000 7ff181ffb640 1 -- 172.21.15.52:0/1138590924 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7ff184062630 con 0x7ff1740a3350 2024-09-19T09:20:20.262 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:20.264 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:20:20.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 msgr2=0x7ff1740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 0x7ff1740a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff184075f80 tx=0x7ff17000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 msgr2=0x7ff1840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff17800d950 tx=0x7ff17800dd50 comp rx=0 tx=0).stop 2024-09-19T09:20:20.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 shutdown_connections 2024-09-19T09:20:20.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff184106f10 0x7ff184074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1740a3350 0x7ff1740a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff184102790 0x7ff184074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 --2- 172.21.15.52:0/1138590924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff184101de0 0x7ff1840744f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 >> 172.21.15.52:0/1138590924 conn(0x7ff1840fd8c0 msgr2=0x7ff1840febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:20.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 shutdown_connections 2024-09-19T09:20:20.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:20.263+0000 7ff18afc0640 1 -- 172.21.15.52:0/1138590924 wait complete. 2024-09-19T09:20:20.861 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-19T09:20:19.292560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656357,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":454,"num_read_kb":343,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407384,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534440,"statfs":{"total":1151940427776,"available":1151523266560,"internally_reserved":0,"allocated":12644352,"data_stored":7088367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002973"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844770+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:19:32.844770+0000","last_peered":"2024-09-19T09:19:32.844770+0000","last_clean":"2024-09-19T09:19:32.844770+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:19:32.844770+0000","last_undegraded":"2024-09-19T09:19:32.844770+0000","last_fullsized":"2024-09-19T09:19:32.844770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846379+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:19:32.846379+0000","last_peered":"2024-09-19T09:19:32.846379+0000","last_clean":"2024-09-19T09:19:32.846379+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:19:32.846379+0000","last_undegraded":"2024-09-19T09:19:32.846379+0000","last_fullsized":"2024-09-19T09:19:32.846379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846367+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:19:32.846367+0000","last_peered":"2024-09-19T09:19:32.846367+0000","last_clean":"2024-09-19T09:19:32.846367+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:19:32.846367+0000","last_undegraded":"2024-09-19T09:19:32.846367+0000","last_fullsized":"2024-09-19T09:19:32.846367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883949+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:19:32.883949+0000","last_peered":"2024-09-19T09:19:32.883949+0000","last_clean":"2024-09-19T09:19:32.883949+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:19:32.883949+0000","last_undegraded":"2024-09-19T09:19:32.883949+0000","last_fullsized":"2024-09-19T09:19:32.883949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845445+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:19:32.845445+0000","last_peered":"2024-09-19T09:19:32.845445+0000","last_clean":"2024-09-19T09:19:32.845445+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:19:32.845445+0000","last_undegraded":"2024-09-19T09:19:32.845445+0000","last_fullsized":"2024-09-19T09:19:32.845445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844658+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:19:32.844658+0000","last_peered":"2024-09-19T09:19:32.844658+0000","last_clean":"2024-09-19T09:19:32.844658+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:19:32.844658+0000","last_undegraded":"2024-09-19T09:19:32.844658+0000","last_fullsized":"2024-09-19T09:19:32.844658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851709+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:19:32.851709+0000","last_peered":"2024-09-19T09:19:32.851709+0000","last_clean":"2024-09-19T09:19:32.851709+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:19:32.851709+0000","last_undegraded":"2024-09-19T09:19:32.851709+0000","last_fullsized":"2024-09-19T09:19:32.851709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843340+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:19:32.843340+0000","last_peered":"2024-09-19T09:19:32.843340+0000","last_clean":"2024-09-19T09:19:32.843340+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:19:32.843340+0000","last_undegraded":"2024-09-19T09:19:32.843340+0000","last_fullsized":"2024-09-19T09:19:32.843340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.885245+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:19:32.885245+0000","last_peered":"2024-09-19T09:19:32.885245+0000","last_clean":"2024-09-19T09:19:32.885245+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:19:32.885245+0000","last_undegraded":"2024-09-19T09:19:32.885245+0000","last_fullsized":"2024-09-19T09:19:32.885245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845115+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:19:32.845115+0000","last_peered":"2024-09-19T09:19:32.845115+0000","last_clean":"2024-09-19T09:19:32.845115+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:19:32.845115+0000","last_undegraded":"2024-09-19T09:19:32.845115+0000","last_fullsized":"2024-09-19T09:19:32.845115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847894+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:19:32.847894+0000","last_peered":"2024-09-19T09:19:32.847894+0000","last_clean":"2024-09-19T09:19:32.847894+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:19:32.847894+0000","last_undegraded":"2024-09-19T09:19:32.847894+0000","last_fullsized":"2024-09-19T09:19:32.847894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884019+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:19:32.884019+0000","last_peered":"2024-09-19T09:19:32.884019+0000","last_clean":"2024-09-19T09:19:32.884019+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:19:32.884019+0000","last_undegraded":"2024-09-19T09:19:32.884019+0000","last_fullsized":"2024-09-19T09:19:32.884019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847227+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:19:32.847227+0000","last_peered":"2024-09-19T09:19:32.847227+0000","last_clean":"2024-09-19T09:19:32.847227+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:19:32.847227+0000","last_undegraded":"2024-09-19T09:19:32.847227+0000","last_fullsized":"2024-09-19T09:19:32.847227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846212+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:19:32.846212+0000","last_peered":"2024-09-19T09:19:32.846212+0000","last_clean":"2024-09-19T09:19:32.846212+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:19:32.846212+0000","last_undegraded":"2024-09-19T09:19:32.846212+0000","last_fullsized":"2024-09-19T09:19:32.846212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846172+0000","last_change":"2024-09-19T09:19:17.802304+0000","last_active":"2024-09-19T09:19:32.846172+0000","last_peered":"2024-09-19T09:19:32.846172+0000","last_clean":"2024-09-19T09:19:32.846172+0000","last_became_active":"2024-09-19T09:19:17.801658+0000","last_became_peered":"2024-09-19T09:19:17.801658+0000","last_unstale":"2024-09-19T09:19:32.846172+0000","last_undegraded":"2024-09-19T09:19:32.846172+0000","last_fullsized":"2024-09-19T09:19:32.846172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:47.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884023+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:19:32.884023+0000","last_peered":"2024-09-19T09:19:32.884023+0000","last_clean":"2024-09-19T09:19:32.884023+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:19:32.884023+0000","last_undegraded":"2024-09-19T09:19:32.884023+0000","last_fullsized":"2024-09-19T09:19:32.884023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844811+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:19:32.844811+0000","last_peered":"2024-09-19T09:19:32.844811+0000","last_clean":"2024-09-19T09:19:32.844811+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:19:32.844811+0000","last_undegraded":"2024-09-19T09:19:32.844811+0000","last_fullsized":"2024-09-19T09:19:32.844811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846300+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:19:32.846300+0000","last_peered":"2024-09-19T09:19:32.846300+0000","last_clean":"2024-09-19T09:19:32.846300+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:19:32.846300+0000","last_undegraded":"2024-09-19T09:19:32.846300+0000","last_fullsized":"2024-09-19T09:19:32.846300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849580+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:19:32.849580+0000","last_peered":"2024-09-19T09:19:32.849580+0000","last_clean":"2024-09-19T09:19:32.849580+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:19:32.849580+0000","last_undegraded":"2024-09-19T09:19:32.849580+0000","last_fullsized":"2024-09-19T09:19:32.849580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844346+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:19:32.844346+0000","last_peered":"2024-09-19T09:19:32.844346+0000","last_clean":"2024-09-19T09:19:32.844346+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:19:32.844346+0000","last_undegraded":"2024-09-19T09:19:32.844346+0000","last_fullsized":"2024-09-19T09:19:32.844346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847322+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:19:32.847322+0000","last_peered":"2024-09-19T09:19:32.847322+0000","last_clean":"2024-09-19T09:19:32.847322+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:19:32.847322+0000","last_undegraded":"2024-09-19T09:19:32.847322+0000","last_fullsized":"2024-09-19T09:19:32.847322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884352+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:19:32.884352+0000","last_peered":"2024-09-19T09:19:32.884352+0000","last_clean":"2024-09-19T09:19:32.884352+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:19:32.884352+0000","last_undegraded":"2024-09-19T09:19:32.884352+0000","last_fullsized":"2024-09-19T09:19:32.884352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843342+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:19:32.843342+0000","last_peered":"2024-09-19T09:19:32.843342+0000","last_clean":"2024-09-19T09:19:32.843342+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:19:32.843342+0000","last_undegraded":"2024-09-19T09:19:32.843342+0000","last_fullsized":"2024-09-19T09:19:32.843342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851217+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:19:32.851217+0000","last_peered":"2024-09-19T09:19:32.851217+0000","last_clean":"2024-09-19T09:19:32.851217+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:19:32.851217+0000","last_undegraded":"2024-09-19T09:19:32.851217+0000","last_fullsized":"2024-09-19T09:19:32.851217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843604+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:19:32.843604+0000","last_peered":"2024-09-19T09:19:32.843604+0000","last_clean":"2024-09-19T09:19:32.843604+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:19:32.843604+0000","last_undegraded":"2024-09-19T09:19:32.843604+0000","last_fullsized":"2024-09-19T09:19:32.843604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850101+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:19:32.850101+0000","last_peered":"2024-09-19T09:19:32.850101+0000","last_clean":"2024-09-19T09:19:32.850101+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:19:32.850101+0000","last_undegraded":"2024-09-19T09:19:32.850101+0000","last_fullsized":"2024-09-19T09:19:32.850101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844566+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:19:32.844566+0000","last_peered":"2024-09-19T09:19:32.844566+0000","last_clean":"2024-09-19T09:19:32.844566+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:19:32.844566+0000","last_undegraded":"2024-09-19T09:19:32.844566+0000","last_fullsized":"2024-09-19T09:19:32.844566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846511+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:19:32.846511+0000","last_peered":"2024-09-19T09:19:32.846511+0000","last_clean":"2024-09-19T09:19:32.846511+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:19:32.846511+0000","last_undegraded":"2024-09-19T09:19:32.846511+0000","last_fullsized":"2024-09-19T09:19:32.846511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846232+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:19:32.846232+0000","last_peered":"2024-09-19T09:19:32.846232+0000","last_clean":"2024-09-19T09:19:32.846232+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:19:32.846232+0000","last_undegraded":"2024-09-19T09:19:32.846232+0000","last_fullsized":"2024-09-19T09:19:32.846232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848116+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:19:32.848116+0000","last_peered":"2024-09-19T09:19:32.848116+0000","last_clean":"2024-09-19T09:19:32.848116+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:19:32.848116+0000","last_undegraded":"2024-09-19T09:19:32.848116+0000","last_fullsized":"2024-09-19T09:19:32.848116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848127+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:19:32.848127+0000","last_peered":"2024-09-19T09:19:32.848127+0000","last_clean":"2024-09-19T09:19:32.848127+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:19:32.848127+0000","last_undegraded":"2024-09-19T09:19:32.848127+0000","last_fullsized":"2024-09-19T09:19:32.848127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844176+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:19:32.844176+0000","last_peered":"2024-09-19T09:19:32.844176+0000","last_clean":"2024-09-19T09:19:32.844176+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:19:32.844176+0000","last_undegraded":"2024-09-19T09:19:32.844176+0000","last_fullsized":"2024-09-19T09:19:32.844176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845655+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:19:32.845655+0000","last_peered":"2024-09-19T09:19:32.845655+0000","last_clean":"2024-09-19T09:19:32.845655+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:19:32.845655+0000","last_undegraded":"2024-09-19T09:19:32.845655+0000","last_fullsized":"2024-09-19T09:19:32.845655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:14.860264+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:20:14.860264+0000","last_peered":"2024-09-19T09:20:14.860264+0000","last_clean":"2024-09-19T09:20:14.860264+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:20:14.860264+0000","last_undegraded":"2024-09-19T09:20:14.860264+0000","last_fullsized":"2024-09-19T09:20:14.860264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850691+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:19:32.850691+0000","last_peered":"2024-09-19T09:19:32.850691+0000","last_clean":"2024-09-19T09:19:32.850691+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:19:32.850691+0000","last_undegraded":"2024-09-19T09:19:32.850691+0000","last_fullsized":"2024-09-19T09:19:32.850691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.888269+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:19:32.888269+0000","last_peered":"2024-09-19T09:19:32.888269+0000","last_clean":"2024-09-19T09:19:32.888269+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:19:32.888269+0000","last_undegraded":"2024-09-19T09:19:32.888269+0000","last_fullsized":"2024-09-19T09:19:32.888269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847552+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:19:32.847552+0000","last_peered":"2024-09-19T09:19:32.847552+0000","last_clean":"2024-09-19T09:19:32.847552+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:19:32.847552+0000","last_undegraded":"2024-09-19T09:19:32.847552+0000","last_fullsized":"2024-09-19T09:19:32.847552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843550+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:19:32.843550+0000","last_peered":"2024-09-19T09:19:32.843550+0000","last_clean":"2024-09-19T09:19:32.843550+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:19:32.843550+0000","last_undegraded":"2024-09-19T09:19:32.843550+0000","last_fullsized":"2024-09-19T09:19:32.843550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846285+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:19:32.846285+0000","last_peered":"2024-09-19T09:19:32.846285+0000","last_clean":"2024-09-19T09:19:32.846285+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:19:32.846285+0000","last_undegraded":"2024-09-19T09:19:32.846285+0000","last_fullsized":"2024-09-19T09:19:32.846285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845647+0000","last_change":"2024-09-19T09:19:17.803446+0000","last_active":"2024-09-19T09:19:32.845647+0000","last_peered":"2024-09-19T09:19:32.845647+0000","last_clean":"2024-09-19T09:19:32.845647+0000","last_became_active":"2024-09-19T09:19:17.803092+0000","last_became_peered":"2024-09-19T09:19:17.803092+0000","last_unstale":"2024-09-19T09:19:32.845647+0000","last_undegraded":"2024-09-19T09:19:32.845647+0000","last_fullsized":"2024-09-19T09:19:32.845647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:46.709525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:16.862177+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:20:16.862177+0000","last_peered":"2024-09-19T09:20:16.862177+0000","last_clean":"2024-09-19T09:20:16.862177+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:20:16.862177+0000","last_undegraded":"2024-09-19T09:20:16.862177+0000","last_fullsized":"2024-09-19T09:20:16.862177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884972+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:19:32.884972+0000","last_peered":"2024-09-19T09:19:32.884972+0000","last_clean":"2024-09-19T09:19:32.884972+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:19:32.884972+0000","last_undegraded":"2024-09-19T09:19:32.884972+0000","last_fullsized":"2024-09-19T09:19:32.884972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847777+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:19:32.847777+0000","last_peered":"2024-09-19T09:19:32.847777+0000","last_clean":"2024-09-19T09:19:32.847777+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:19:32.847777+0000","last_undegraded":"2024-09-19T09:19:32.847777+0000","last_fullsized":"2024-09-19T09:19:32.847777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846616+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:19:32.846616+0000","last_peered":"2024-09-19T09:19:32.846616+0000","last_clean":"2024-09-19T09:19:32.846616+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:19:32.846616+0000","last_undegraded":"2024-09-19T09:19:32.846616+0000","last_fullsized":"2024-09-19T09:19:32.846616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884593+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:19:32.884593+0000","last_peered":"2024-09-19T09:19:32.884593+0000","last_clean":"2024-09-19T09:19:32.884593+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:19:32.884593+0000","last_undegraded":"2024-09-19T09:19:32.884593+0000","last_fullsized":"2024-09-19T09:19:32.884593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'29","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:17.863416+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:20:17.863416+0000","last_peered":"2024-09-19T09:20:17.863416+0000","last_clean":"2024-09-19T09:20:17.863416+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:20:17.863416+0000","last_undegraded":"2024-09-19T09:20:17.863416+0000","last_fullsized":"2024-09-19T09:20:17.863416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":115,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846623+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:19:32.846623+0000","last_peered":"2024-09-19T09:19:32.846623+0000","last_clean":"2024-09-19T09:19:32.846623+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:19:32.846623+0000","last_undegraded":"2024-09-19T09:19:32.846623+0000","last_fullsized":"2024-09-19T09:19:32.846623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.861670+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:19:32.861670+0000","last_peered":"2024-09-19T09:19:32.861670+0000","last_clean":"2024-09-19T09:19:32.861670+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:19:32.861670+0000","last_undegraded":"2024-09-19T09:19:32.861670+0000","last_fullsized":"2024-09-19T09:19:32.861670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850543+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:19:32.850543+0000","last_peered":"2024-09-19T09:19:32.850543+0000","last_clean":"2024-09-19T09:19:32.850543+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:19:32.850543+0000","last_undegraded":"2024-09-19T09:19:32.850543+0000","last_fullsized":"2024-09-19T09:19:32.850543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846921+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:19:32.846921+0000","last_peered":"2024-09-19T09:19:32.846921+0000","last_clean":"2024-09-19T09:19:32.846921+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:19:32.846921+0000","last_undegraded":"2024-09-19T09:19:32.846921+0000","last_fullsized":"2024-09-19T09:19:32.846921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.852142+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:19:32.852142+0000","last_peered":"2024-09-19T09:19:32.852142+0000","last_clean":"2024-09-19T09:19:32.852142+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:19:32.852142+0000","last_undegraded":"2024-09-19T09:19:32.852142+0000","last_fullsized":"2024-09-19T09:19:32.852142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:15.861365+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:20:15.861365+0000","last_peered":"2024-09-19T09:20:15.861365+0000","last_clean":"2024-09-19T09:20:15.861365+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:20:15.861365+0000","last_undegraded":"2024-09-19T09:20:15.861365+0000","last_fullsized":"2024-09-19T09:20:15.861365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847080+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:19:32.847080+0000","last_peered":"2024-09-19T09:19:32.847080+0000","last_clean":"2024-09-19T09:19:32.847080+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:19:32.847080+0000","last_undegraded":"2024-09-19T09:19:32.847080+0000","last_fullsized":"2024-09-19T09:19:32.847080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845870+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:19:32.845870+0000","last_peered":"2024-09-19T09:19:32.845870+0000","last_clean":"2024-09-19T09:19:32.845870+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:19:32.845870+0000","last_undegraded":"2024-09-19T09:19:32.845870+0000","last_fullsized":"2024-09-19T09:19:32.845870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846715+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:19:32.846715+0000","last_peered":"2024-09-19T09:19:32.846715+0000","last_clean":"2024-09-19T09:19:32.846715+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:19:32.846715+0000","last_undegraded":"2024-09-19T09:19:32.846715+0000","last_fullsized":"2024-09-19T09:19:32.846715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845885+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:19:32.845885+0000","last_peered":"2024-09-19T09:19:32.845885+0000","last_clean":"2024-09-19T09:19:32.845885+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:19:32.845885+0000","last_undegraded":"2024-09-19T09:19:32.845885+0000","last_fullsized":"2024-09-19T09:19:32.845885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844440+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:19:32.844440+0000","last_peered":"2024-09-19T09:19:32.844440+0000","last_clean":"2024-09-19T09:19:32.844440+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:19:32.844440+0000","last_undegraded":"2024-09-19T09:19:32.844440+0000","last_fullsized":"2024-09-19T09:19:32.844440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846865+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:19:32.846865+0000","last_peered":"2024-09-19T09:19:32.846865+0000","last_clean":"2024-09-19T09:19:32.846865+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:19:32.846865+0000","last_undegraded":"2024-09-19T09:19:32.846865+0000","last_fullsized":"2024-09-19T09:19:32.846865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847897+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:19:32.847897+0000","last_peered":"2024-09-19T09:19:32.847897+0000","last_clean":"2024-09-19T09:19:32.847897+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:19:32.847897+0000","last_undegraded":"2024-09-19T09:19:32.847897+0000","last_fullsized":"2024-09-19T09:19:32.847897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846620+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:19:32.846620+0000","last_peered":"2024-09-19T09:19:32.846620+0000","last_clean":"2024-09-19T09:19:32.846620+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:19:32.846620+0000","last_undegraded":"2024-09-19T09:19:32.846620+0000","last_fullsized":"2024-09-19T09:19:32.846620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847757+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:19:32.847757+0000","last_peered":"2024-09-19T09:19:32.847757+0000","last_clean":"2024-09-19T09:19:32.847757+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:19:32.847757+0000","last_undegraded":"2024-09-19T09:19:32.847757+0000","last_fullsized":"2024-09-19T09:19:32.847757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849461+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:19:32.849461+0000","last_peered":"2024-09-19T09:19:32.849461+0000","last_clean":"2024-09-19T09:19:32.849461+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:19:32.849461+0000","last_undegraded":"2024-09-19T09:19:32.849461+0000","last_fullsized":"2024-09-19T09:19:32.849461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847947+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:19:32.847947+0000","last_peered":"2024-09-19T09:19:32.847947+0000","last_clean":"2024-09-19T09:19:32.847947+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:19:32.847947+0000","last_undegraded":"2024-09-19T09:19:32.847947+0000","last_fullsized":"2024-09-19T09:19:32.847947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847294+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:19:32.847294+0000","last_peered":"2024-09-19T09:19:32.847294+0000","last_clean":"2024-09-19T09:19:32.847294+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:19:32.847294+0000","last_undegraded":"2024-09-19T09:19:32.847294+0000","last_fullsized":"2024-09-19T09:19:32.847294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883786+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:19:32.883786+0000","last_peered":"2024-09-19T09:19:32.883786+0000","last_clean":"2024-09-19T09:19:32.883786+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:19:32.883786+0000","last_undegraded":"2024-09-19T09:19:32.883786+0000","last_fullsized":"2024-09-19T09:19:32.883786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843580+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:19:32.843580+0000","last_peered":"2024-09-19T09:19:32.843580+0000","last_clean":"2024-09-19T09:19:32.843580+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:19:32.843580+0000","last_undegraded":"2024-09-19T09:19:32.843580+0000","last_fullsized":"2024-09-19T09:19:32.843580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847240+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:19:32.847240+0000","last_peered":"2024-09-19T09:19:32.847240+0000","last_clean":"2024-09-19T09:19:32.847240+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:19:32.847240+0000","last_undegraded":"2024-09-19T09:19:32.847240+0000","last_fullsized":"2024-09-19T09:19:32.847240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847530+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:19:32.847530+0000","last_peered":"2024-09-19T09:19:32.847530+0000","last_clean":"2024-09-19T09:19:32.847530+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:19:32.847530+0000","last_undegraded":"2024-09-19T09:19:32.847530+0000","last_fullsized":"2024-09-19T09:19:32.847530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:14.859924+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:20:14.859924+0000","last_peered":"2024-09-19T09:20:14.859924+0000","last_clean":"2024-09-19T09:20:14.859924+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:20:14.859924+0000","last_undegraded":"2024-09-19T09:20:14.859924+0000","last_fullsized":"2024-09-19T09:20:14.859924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846075+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:19:32.846075+0000","last_peered":"2024-09-19T09:19:32.846075+0000","last_clean":"2024-09-19T09:19:32.846075+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:19:32.846075+0000","last_undegraded":"2024-09-19T09:19:32.846075+0000","last_fullsized":"2024-09-19T09:19:32.846075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847411+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:19:32.847411+0000","last_peered":"2024-09-19T09:19:32.847411+0000","last_clean":"2024-09-19T09:19:32.847411+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:19:32.847411+0000","last_undegraded":"2024-09-19T09:19:32.847411+0000","last_fullsized":"2024-09-19T09:19:32.847411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844785+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:19:32.844785+0000","last_peered":"2024-09-19T09:19:32.844785+0000","last_clean":"2024-09-19T09:19:32.844785+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:19:32.844785+0000","last_undegraded":"2024-09-19T09:19:32.844785+0000","last_fullsized":"2024-09-19T09:19:32.844785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844973+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:19:32.844973+0000","last_peered":"2024-09-19T09:19:32.844973+0000","last_clean":"2024-09-19T09:19:32.844973+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:19:32.844973+0000","last_undegraded":"2024-09-19T09:19:32.844973+0000","last_fullsized":"2024-09-19T09:19:32.844973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846736+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:19:32.846736+0000","last_peered":"2024-09-19T09:19:32.846736+0000","last_clean":"2024-09-19T09:19:32.846736+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:19:32.846736+0000","last_undegraded":"2024-09-19T09:19:32.846736+0000","last_fullsized":"2024-09-19T09:19:32.846736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846605+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:19:32.846605+0000","last_peered":"2024-09-19T09:19:32.846605+0000","last_clean":"2024-09-19T09:19:32.846605+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:19:32.846605+0000","last_undegraded":"2024-09-19T09:19:32.846605+0000","last_fullsized":"2024-09-19T09:19:32.846605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.794355+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:19:41.794355+0000","last_peered":"2024-09-19T09:19:41.794355+0000","last_clean":"2024-09-19T09:19:41.794355+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:19:41.794355+0000","last_undegraded":"2024-09-19T09:19:41.794355+0000","last_fullsized":"2024-09-19T09:19:41.794355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843716+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:19:32.843716+0000","last_peered":"2024-09-19T09:19:32.843716+0000","last_clean":"2024-09-19T09:19:32.843716+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:19:32.843716+0000","last_undegraded":"2024-09-19T09:19:32.843716+0000","last_fullsized":"2024-09-19T09:19:32.843716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884108+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:19:32.884108+0000","last_peered":"2024-09-19T09:19:32.884108+0000","last_clean":"2024-09-19T09:19:32.884108+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:19:32.884108+0000","last_undegraded":"2024-09-19T09:19:32.884108+0000","last_fullsized":"2024-09-19T09:19:32.884108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850919+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:19:32.850919+0000","last_peered":"2024-09-19T09:19:32.850919+0000","last_clean":"2024-09-19T09:19:32.850919+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:19:32.850919+0000","last_undegraded":"2024-09-19T09:19:32.850919+0000","last_fullsized":"2024-09-19T09:19:32.850919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884611+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:19:32.884611+0000","last_peered":"2024-09-19T09:19:32.884611+0000","last_clean":"2024-09-19T09:19:32.884611+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:19:32.884611+0000","last_undegraded":"2024-09-19T09:19:32.884611+0000","last_fullsized":"2024-09-19T09:19:32.884611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845457+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:19:32.845457+0000","last_peered":"2024-09-19T09:19:32.845457+0000","last_clean":"2024-09-19T09:19:32.845457+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:19:32.845457+0000","last_undegraded":"2024-09-19T09:19:32.845457+0000","last_fullsized":"2024-09-19T09:19:32.845457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843698+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:19:32.843698+0000","last_peered":"2024-09-19T09:19:32.843698+0000","last_clean":"2024-09-19T09:19:32.843698+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:19:32.843698+0000","last_undegraded":"2024-09-19T09:19:32.843698+0000","last_fullsized":"2024-09-19T09:19:32.843698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844286+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:19:32.844286+0000","last_peered":"2024-09-19T09:19:32.844286+0000","last_clean":"2024-09-19T09:19:32.844286+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:19:32.844286+0000","last_undegraded":"2024-09-19T09:19:32.844286+0000","last_fullsized":"2024-09-19T09:19:32.844286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847996+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:19:32.847996+0000","last_peered":"2024-09-19T09:19:32.847996+0000","last_clean":"2024-09-19T09:19:32.847996+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:19:32.847996+0000","last_undegraded":"2024-09-19T09:19:32.847996+0000","last_fullsized":"2024-09-19T09:19:32.847996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843584+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:19:32.843584+0000","last_peered":"2024-09-19T09:19:32.843584+0000","last_clean":"2024-09-19T09:19:32.843584+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:19:32.843584+0000","last_undegraded":"2024-09-19T09:19:32.843584+0000","last_fullsized":"2024-09-19T09:19:32.843584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845593+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:19:32.845593+0000","last_peered":"2024-09-19T09:19:32.845593+0000","last_clean":"2024-09-19T09:19:32.845593+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:19:32.845593+0000","last_undegraded":"2024-09-19T09:19:32.845593+0000","last_fullsized":"2024-09-19T09:19:32.845593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847264+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:19:32.847264+0000","last_peered":"2024-09-19T09:19:32.847264+0000","last_clean":"2024-09-19T09:19:32.847264+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:19:32.847264+0000","last_undegraded":"2024-09-19T09:19:32.847264+0000","last_fullsized":"2024-09-19T09:19:32.847264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846386+0000","last_change":"2024-09-19T09:19:17.796414+0000","last_active":"2024-09-19T09:19:32.846386+0000","last_peered":"2024-09-19T09:19:32.846386+0000","last_clean":"2024-09-19T09:19:32.846386+0000","last_became_active":"2024-09-19T09:19:17.796031+0000","last_became_peered":"2024-09-19T09:19:17.796031+0000","last_unstale":"2024-09-19T09:19:32.846386+0000","last_undegraded":"2024-09-19T09:19:32.846386+0000","last_fullsized":"2024-09-19T09:19:32.846386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:40.707180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884344+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:19:32.884344+0000","last_peered":"2024-09-19T09:19:32.884344+0000","last_clean":"2024-09-19T09:19:32.884344+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:19:32.884344+0000","last_undegraded":"2024-09-19T09:19:32.884344+0000","last_fullsized":"2024-09-19T09:19:32.884344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.889702+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:19:32.889702+0000","last_peered":"2024-09-19T09:19:32.889702+0000","last_clean":"2024-09-19T09:19:32.889702+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:19:32.889702+0000","last_undegraded":"2024-09-19T09:19:32.889702+0000","last_fullsized":"2024-09-19T09:19:32.889702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843993+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:19:32.843993+0000","last_peered":"2024-09-19T09:19:32.843993+0000","last_clean":"2024-09-19T09:19:32.843993+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:19:32.843993+0000","last_undegraded":"2024-09-19T09:19:32.843993+0000","last_fullsized":"2024-09-19T09:19:32.843993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843830+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:19:32.843830+0000","last_peered":"2024-09-19T09:19:32.843830+0000","last_clean":"2024-09-19T09:19:32.843830+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:19:32.843830+0000","last_undegraded":"2024-09-19T09:19:32.843830+0000","last_fullsized":"2024-09-19T09:19:32.843830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846113+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:19:32.846113+0000","last_peered":"2024-09-19T09:19:32.846113+0000","last_clean":"2024-09-19T09:19:32.846113+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:19:32.846113+0000","last_undegraded":"2024-09-19T09:19:32.846113+0000","last_fullsized":"2024-09-19T09:19:32.846113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65755,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":328,"num_read_kb":234,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":427224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1080816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299432,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":427346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561069,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1019278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":426815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920823,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1018569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":427645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280575,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476806,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":489676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":488360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":897024,"data_stored":428086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:20:20.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:20:21.132 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:21.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:21 smithi052 ceph-mon[30947]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:21 smithi052 ceph-mon[30947]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:21 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:21 smithi169 ceph-mon[35454]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:21 smithi169 ceph-mon[35454]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:21 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:21 smithi086 ceph-mon[34813]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:21 smithi086 ceph-mon[34813]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:21 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:21.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.649+0000 7f8f24e2f640 1 -- 172.21.15.52:0/791687180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20102dd0 msgr2=0x7f8f201031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.649+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/791687180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20102dd0 0x7f8f201031b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009cd0 tx=0x7f8f1002a8f0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 -- 172.21.15.52:0/791687180 shutdown_connections 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/791687180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/791687180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20103780 0x7f8f20107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/791687180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20102dd0 0x7f8f201031b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 -- 172.21.15.52:0/791687180 >> 172.21.15.52:0/791687180 conn(0x7f8f200fc7d0 msgr2=0x7f8f200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 -- 172.21.15.52:0/791687180 shutdown_connections 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 -- 172.21.15.52:0/791687180 wait complete. 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 Processor -- start 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.650+0000 7f8f24e2f640 1 -- start start 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20102dd0 0x7f8f201a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20112170 con 0x7f8f20103780 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20111ff0 con 0x7f8f20108300 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201122f0 con 0x7f8f20102dd0 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45344/0 (socket says 172.21.15.52:45344) 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 -- 172.21.15.52:0/2502943834 learned_addr learned my addr 172.21.15.52:0/2502943834 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1e59c640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20102dd0 0x7f8f201a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1ed9d640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 -- 172.21.15.52:0/2502943834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20102dd0 msgr2=0x7f8f201a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20102dd0 0x7f8f201a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 -- 172.21.15.52:0/2502943834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 msgr2=0x7f8f2019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 -- 172.21.15.52:0/2502943834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2019afd0 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1ed9d640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f1dd9b640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006fd0 tx=0x7f8f1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14011830 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2019b2c0 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f14016070 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400f2e0 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.651+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201a7610 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.652+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2006a7b0 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.654+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8f1400f480 con 0x7f8f20103780 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.655+0000 7f8f0f7fe640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 0x7f8f080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.655+0000 7f8f1e59c640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 0x7f8f080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.655+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f8f140cf790 con 0x7f8f20103780 2024-09-19T09:20:21.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.656+0000 7f8f1e59c640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 0x7f8f080a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009a60 tx=0x7f8f100093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.658+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8f1409c3e0 con 0x7f8f20103780 2024-09-19T09:20:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.834+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f20062630 con 0x7f8f080a32d0 2024-09-19T09:20:21.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.843+0000 7f8f0f7fe640 1 -- 172.21.15.52:0/2502943834 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258715 (secure 0 0 0) 0x7f8f20062630 con 0x7f8f080a32d0 2024-09-19T09:20:21.846 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:21.847 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:20:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.845+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 msgr2=0x7f8f080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.845+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 0x7f8f080a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009a60 tx=0x7f8f100093f0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 msgr2=0x7f8f201a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f14006fd0 tx=0x7f8f1400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 shutdown_connections 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f20108300 0x7f8f2019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f20103780 0x7f8f201a0bd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8f080a32d0 0x7f8f080a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 --2- 172.21.15.52:0/2502943834 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f20102dd0 0x7f8f201a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 >> 172.21.15.52:0/2502943834 conn(0x7f8f200fc7d0 msgr2=0x7f8f20100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 shutdown_connections 2024-09-19T09:20:21.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:21.846+0000 7f8f24e2f640 1 -- 172.21.15.52:0/2502943834 wait complete. 2024-09-19T09:20:22.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:22.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:22.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:22.477 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-19T09:20:21.293113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656357,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":464,"num_read_kb":348,"num_write":345,"num_write_kb":3050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407384,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534440,"statfs":{"total":1151940427776,"available":1151523266560,"internally_reserved":0,"allocated":12644352,"data_stored":7088367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003067"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844770+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:19:32.844770+0000","last_peered":"2024-09-19T09:19:32.844770+0000","last_clean":"2024-09-19T09:19:32.844770+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:19:32.844770+0000","last_undegraded":"2024-09-19T09:19:32.844770+0000","last_fullsized":"2024-09-19T09:19:32.844770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846379+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:19:32.846379+0000","last_peered":"2024-09-19T09:19:32.846379+0000","last_clean":"2024-09-19T09:19:32.846379+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:19:32.846379+0000","last_undegraded":"2024-09-19T09:19:32.846379+0000","last_fullsized":"2024-09-19T09:19:32.846379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846367+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:19:32.846367+0000","last_peered":"2024-09-19T09:19:32.846367+0000","last_clean":"2024-09-19T09:19:32.846367+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:19:32.846367+0000","last_undegraded":"2024-09-19T09:19:32.846367+0000","last_fullsized":"2024-09-19T09:19:32.846367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883949+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:19:32.883949+0000","last_peered":"2024-09-19T09:19:32.883949+0000","last_clean":"2024-09-19T09:19:32.883949+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:19:32.883949+0000","last_undegraded":"2024-09-19T09:19:32.883949+0000","last_fullsized":"2024-09-19T09:19:32.883949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845445+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:19:32.845445+0000","last_peered":"2024-09-19T09:19:32.845445+0000","last_clean":"2024-09-19T09:19:32.845445+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:19:32.845445+0000","last_undegraded":"2024-09-19T09:19:32.845445+0000","last_fullsized":"2024-09-19T09:19:32.845445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844658+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:19:32.844658+0000","last_peered":"2024-09-19T09:19:32.844658+0000","last_clean":"2024-09-19T09:19:32.844658+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:19:32.844658+0000","last_undegraded":"2024-09-19T09:19:32.844658+0000","last_fullsized":"2024-09-19T09:19:32.844658+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851709+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:19:32.851709+0000","last_peered":"2024-09-19T09:19:32.851709+0000","last_clean":"2024-09-19T09:19:32.851709+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:19:32.851709+0000","last_undegraded":"2024-09-19T09:19:32.851709+0000","last_fullsized":"2024-09-19T09:19:32.851709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843340+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:19:32.843340+0000","last_peered":"2024-09-19T09:19:32.843340+0000","last_clean":"2024-09-19T09:19:32.843340+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:19:32.843340+0000","last_undegraded":"2024-09-19T09:19:32.843340+0000","last_fullsized":"2024-09-19T09:19:32.843340+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.885245+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:19:32.885245+0000","last_peered":"2024-09-19T09:19:32.885245+0000","last_clean":"2024-09-19T09:19:32.885245+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:19:32.885245+0000","last_undegraded":"2024-09-19T09:19:32.885245+0000","last_fullsized":"2024-09-19T09:19:32.885245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845115+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:19:32.845115+0000","last_peered":"2024-09-19T09:19:32.845115+0000","last_clean":"2024-09-19T09:19:32.845115+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:19:32.845115+0000","last_undegraded":"2024-09-19T09:19:32.845115+0000","last_fullsized":"2024-09-19T09:19:32.845115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847894+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:19:32.847894+0000","last_peered":"2024-09-19T09:19:32.847894+0000","last_clean":"2024-09-19T09:19:32.847894+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:19:32.847894+0000","last_undegraded":"2024-09-19T09:19:32.847894+0000","last_fullsized":"2024-09-19T09:19:32.847894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884019+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:19:32.884019+0000","last_peered":"2024-09-19T09:19:32.884019+0000","last_clean":"2024-09-19T09:19:32.884019+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:19:32.884019+0000","last_undegraded":"2024-09-19T09:19:32.884019+0000","last_fullsized":"2024-09-19T09:19:32.884019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847227+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:19:32.847227+0000","last_peered":"2024-09-19T09:19:32.847227+0000","last_clean":"2024-09-19T09:19:32.847227+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:19:32.847227+0000","last_undegraded":"2024-09-19T09:19:32.847227+0000","last_fullsized":"2024-09-19T09:19:32.847227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846212+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:19:32.846212+0000","last_peered":"2024-09-19T09:19:32.846212+0000","last_clean":"2024-09-19T09:19:32.846212+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:19:32.846212+0000","last_undegraded":"2024-09-19T09:19:32.846212+0000","last_fullsized":"2024-09-19T09:19:32.846212+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846172+0000","last_change":"2024-09-19T09:19:17.802304+0000","last_active":"2024-09-19T09:19:32.846172+0000","last_peered":"2024-09-19T09:19:32.846172+0000","last_clean":"2024-09-19T09:19:32.846172+0000","last_became_active":"2024-09-19T09:19:17.801658+0000","last_became_peered":"2024-09-19T09:19:17.801658+0000","last_unstale":"2024-09-19T09:19:32.846172+0000","last_undegraded":"2024-09-19T09:19:32.846172+0000","last_fullsized":"2024-09-19T09:19:32.846172+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:47.998159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884023+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:19:32.884023+0000","last_peered":"2024-09-19T09:19:32.884023+0000","last_clean":"2024-09-19T09:19:32.884023+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:19:32.884023+0000","last_undegraded":"2024-09-19T09:19:32.884023+0000","last_fullsized":"2024-09-19T09:19:32.884023+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844811+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:19:32.844811+0000","last_peered":"2024-09-19T09:19:32.844811+0000","last_clean":"2024-09-19T09:19:32.844811+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:19:32.844811+0000","last_undegraded":"2024-09-19T09:19:32.844811+0000","last_fullsized":"2024-09-19T09:19:32.844811+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846300+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:19:32.846300+0000","last_peered":"2024-09-19T09:19:32.846300+0000","last_clean":"2024-09-19T09:19:32.846300+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:19:32.846300+0000","last_undegraded":"2024-09-19T09:19:32.846300+0000","last_fullsized":"2024-09-19T09:19:32.846300+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849580+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:19:32.849580+0000","last_peered":"2024-09-19T09:19:32.849580+0000","last_clean":"2024-09-19T09:19:32.849580+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:19:32.849580+0000","last_undegraded":"2024-09-19T09:19:32.849580+0000","last_fullsized":"2024-09-19T09:19:32.849580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844346+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:19:32.844346+0000","last_peered":"2024-09-19T09:19:32.844346+0000","last_clean":"2024-09-19T09:19:32.844346+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:19:32.844346+0000","last_undegraded":"2024-09-19T09:19:32.844346+0000","last_fullsized":"2024-09-19T09:19:32.844346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847322+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:19:32.847322+0000","last_peered":"2024-09-19T09:19:32.847322+0000","last_clean":"2024-09-19T09:19:32.847322+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:19:32.847322+0000","last_undegraded":"2024-09-19T09:19:32.847322+0000","last_fullsized":"2024-09-19T09:19:32.847322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884352+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:19:32.884352+0000","last_peered":"2024-09-19T09:19:32.884352+0000","last_clean":"2024-09-19T09:19:32.884352+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:19:32.884352+0000","last_undegraded":"2024-09-19T09:19:32.884352+0000","last_fullsized":"2024-09-19T09:19:32.884352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843342+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:19:32.843342+0000","last_peered":"2024-09-19T09:19:32.843342+0000","last_clean":"2024-09-19T09:19:32.843342+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:19:32.843342+0000","last_undegraded":"2024-09-19T09:19:32.843342+0000","last_fullsized":"2024-09-19T09:19:32.843342+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.851217+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:19:32.851217+0000","last_peered":"2024-09-19T09:19:32.851217+0000","last_clean":"2024-09-19T09:19:32.851217+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:19:32.851217+0000","last_undegraded":"2024-09-19T09:19:32.851217+0000","last_fullsized":"2024-09-19T09:19:32.851217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843604+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:19:32.843604+0000","last_peered":"2024-09-19T09:19:32.843604+0000","last_clean":"2024-09-19T09:19:32.843604+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:19:32.843604+0000","last_undegraded":"2024-09-19T09:19:32.843604+0000","last_fullsized":"2024-09-19T09:19:32.843604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850101+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:19:32.850101+0000","last_peered":"2024-09-19T09:19:32.850101+0000","last_clean":"2024-09-19T09:19:32.850101+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:19:32.850101+0000","last_undegraded":"2024-09-19T09:19:32.850101+0000","last_fullsized":"2024-09-19T09:19:32.850101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844566+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:19:32.844566+0000","last_peered":"2024-09-19T09:19:32.844566+0000","last_clean":"2024-09-19T09:19:32.844566+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:19:32.844566+0000","last_undegraded":"2024-09-19T09:19:32.844566+0000","last_fullsized":"2024-09-19T09:19:32.844566+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846511+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:19:32.846511+0000","last_peered":"2024-09-19T09:19:32.846511+0000","last_clean":"2024-09-19T09:19:32.846511+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:19:32.846511+0000","last_undegraded":"2024-09-19T09:19:32.846511+0000","last_fullsized":"2024-09-19T09:19:32.846511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846232+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:19:32.846232+0000","last_peered":"2024-09-19T09:19:32.846232+0000","last_clean":"2024-09-19T09:19:32.846232+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:19:32.846232+0000","last_undegraded":"2024-09-19T09:19:32.846232+0000","last_fullsized":"2024-09-19T09:19:32.846232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848116+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:19:32.848116+0000","last_peered":"2024-09-19T09:19:32.848116+0000","last_clean":"2024-09-19T09:19:32.848116+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:19:32.848116+0000","last_undegraded":"2024-09-19T09:19:32.848116+0000","last_fullsized":"2024-09-19T09:19:32.848116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.848127+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:19:32.848127+0000","last_peered":"2024-09-19T09:19:32.848127+0000","last_clean":"2024-09-19T09:19:32.848127+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:19:32.848127+0000","last_undegraded":"2024-09-19T09:19:32.848127+0000","last_fullsized":"2024-09-19T09:19:32.848127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844176+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:19:32.844176+0000","last_peered":"2024-09-19T09:19:32.844176+0000","last_clean":"2024-09-19T09:19:32.844176+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:19:32.844176+0000","last_undegraded":"2024-09-19T09:19:32.844176+0000","last_fullsized":"2024-09-19T09:19:32.844176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845655+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:19:32.845655+0000","last_peered":"2024-09-19T09:19:32.845655+0000","last_clean":"2024-09-19T09:19:32.845655+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:19:32.845655+0000","last_undegraded":"2024-09-19T09:19:32.845655+0000","last_fullsized":"2024-09-19T09:19:32.845655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:19.866921+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:20:19.866921+0000","last_peered":"2024-09-19T09:20:19.866921+0000","last_clean":"2024-09-19T09:20:19.866921+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:20:19.866921+0000","last_undegraded":"2024-09-19T09:20:19.866921+0000","last_fullsized":"2024-09-19T09:20:19.866921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850691+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:19:32.850691+0000","last_peered":"2024-09-19T09:19:32.850691+0000","last_clean":"2024-09-19T09:19:32.850691+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:19:32.850691+0000","last_undegraded":"2024-09-19T09:19:32.850691+0000","last_fullsized":"2024-09-19T09:19:32.850691+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.888269+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:19:32.888269+0000","last_peered":"2024-09-19T09:19:32.888269+0000","last_clean":"2024-09-19T09:19:32.888269+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:19:32.888269+0000","last_undegraded":"2024-09-19T09:19:32.888269+0000","last_fullsized":"2024-09-19T09:19:32.888269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847552+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:19:32.847552+0000","last_peered":"2024-09-19T09:19:32.847552+0000","last_clean":"2024-09-19T09:19:32.847552+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:19:32.847552+0000","last_undegraded":"2024-09-19T09:19:32.847552+0000","last_fullsized":"2024-09-19T09:19:32.847552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843550+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:19:32.843550+0000","last_peered":"2024-09-19T09:19:32.843550+0000","last_clean":"2024-09-19T09:19:32.843550+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:19:32.843550+0000","last_undegraded":"2024-09-19T09:19:32.843550+0000","last_fullsized":"2024-09-19T09:19:32.843550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846285+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:19:32.846285+0000","last_peered":"2024-09-19T09:19:32.846285+0000","last_clean":"2024-09-19T09:19:32.846285+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:19:32.846285+0000","last_undegraded":"2024-09-19T09:19:32.846285+0000","last_fullsized":"2024-09-19T09:19:32.846285+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845647+0000","last_change":"2024-09-19T09:19:17.803446+0000","last_active":"2024-09-19T09:19:32.845647+0000","last_peered":"2024-09-19T09:19:32.845647+0000","last_clean":"2024-09-19T09:19:32.845647+0000","last_became_active":"2024-09-19T09:19:17.803092+0000","last_became_peered":"2024-09-19T09:19:17.803092+0000","last_unstale":"2024-09-19T09:19:32.845647+0000","last_undegraded":"2024-09-19T09:19:32.845647+0000","last_fullsized":"2024-09-19T09:19:32.845647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:46.709525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:16.862177+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:20:16.862177+0000","last_peered":"2024-09-19T09:20:16.862177+0000","last_clean":"2024-09-19T09:20:16.862177+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:20:16.862177+0000","last_undegraded":"2024-09-19T09:20:16.862177+0000","last_fullsized":"2024-09-19T09:20:16.862177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884972+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:19:32.884972+0000","last_peered":"2024-09-19T09:19:32.884972+0000","last_clean":"2024-09-19T09:19:32.884972+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:19:32.884972+0000","last_undegraded":"2024-09-19T09:19:32.884972+0000","last_fullsized":"2024-09-19T09:19:32.884972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847777+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:19:32.847777+0000","last_peered":"2024-09-19T09:19:32.847777+0000","last_clean":"2024-09-19T09:19:32.847777+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:19:32.847777+0000","last_undegraded":"2024-09-19T09:19:32.847777+0000","last_fullsized":"2024-09-19T09:19:32.847777+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846616+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:19:32.846616+0000","last_peered":"2024-09-19T09:19:32.846616+0000","last_clean":"2024-09-19T09:19:32.846616+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:19:32.846616+0000","last_undegraded":"2024-09-19T09:19:32.846616+0000","last_fullsized":"2024-09-19T09:19:32.846616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884593+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:19:32.884593+0000","last_peered":"2024-09-19T09:19:32.884593+0000","last_clean":"2024-09-19T09:19:32.884593+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:19:32.884593+0000","last_undegraded":"2024-09-19T09:19:32.884593+0000","last_fullsized":"2024-09-19T09:19:32.884593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'29","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:17.863416+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:20:17.863416+0000","last_peered":"2024-09-19T09:20:17.863416+0000","last_clean":"2024-09-19T09:20:17.863416+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:20:17.863416+0000","last_undegraded":"2024-09-19T09:20:17.863416+0000","last_fullsized":"2024-09-19T09:20:17.863416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61752,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":110,"num_read_kb":115,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846623+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:19:32.846623+0000","last_peered":"2024-09-19T09:19:32.846623+0000","last_clean":"2024-09-19T09:19:32.846623+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:19:32.846623+0000","last_undegraded":"2024-09-19T09:19:32.846623+0000","last_fullsized":"2024-09-19T09:19:32.846623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.861670+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:19:32.861670+0000","last_peered":"2024-09-19T09:19:32.861670+0000","last_clean":"2024-09-19T09:19:32.861670+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:19:32.861670+0000","last_undegraded":"2024-09-19T09:19:32.861670+0000","last_fullsized":"2024-09-19T09:19:32.861670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850543+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:19:32.850543+0000","last_peered":"2024-09-19T09:19:32.850543+0000","last_clean":"2024-09-19T09:19:32.850543+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:19:32.850543+0000","last_undegraded":"2024-09-19T09:19:32.850543+0000","last_fullsized":"2024-09-19T09:19:32.850543+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846921+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:19:32.846921+0000","last_peered":"2024-09-19T09:19:32.846921+0000","last_clean":"2024-09-19T09:19:32.846921+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:19:32.846921+0000","last_undegraded":"2024-09-19T09:19:32.846921+0000","last_fullsized":"2024-09-19T09:19:32.846921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.852142+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:19:32.852142+0000","last_peered":"2024-09-19T09:19:32.852142+0000","last_clean":"2024-09-19T09:19:32.852142+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:19:32.852142+0000","last_undegraded":"2024-09-19T09:19:32.852142+0000","last_fullsized":"2024-09-19T09:19:32.852142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:15.861365+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:20:15.861365+0000","last_peered":"2024-09-19T09:20:15.861365+0000","last_clean":"2024-09-19T09:20:15.861365+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:20:15.861365+0000","last_undegraded":"2024-09-19T09:20:15.861365+0000","last_fullsized":"2024-09-19T09:20:15.861365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847080+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:19:32.847080+0000","last_peered":"2024-09-19T09:19:32.847080+0000","last_clean":"2024-09-19T09:19:32.847080+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:19:32.847080+0000","last_undegraded":"2024-09-19T09:19:32.847080+0000","last_fullsized":"2024-09-19T09:19:32.847080+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845870+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:19:32.845870+0000","last_peered":"2024-09-19T09:19:32.845870+0000","last_clean":"2024-09-19T09:19:32.845870+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:19:32.845870+0000","last_undegraded":"2024-09-19T09:19:32.845870+0000","last_fullsized":"2024-09-19T09:19:32.845870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846715+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:19:32.846715+0000","last_peered":"2024-09-19T09:19:32.846715+0000","last_clean":"2024-09-19T09:19:32.846715+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:19:32.846715+0000","last_undegraded":"2024-09-19T09:19:32.846715+0000","last_fullsized":"2024-09-19T09:19:32.846715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845885+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:19:32.845885+0000","last_peered":"2024-09-19T09:19:32.845885+0000","last_clean":"2024-09-19T09:19:32.845885+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:19:32.845885+0000","last_undegraded":"2024-09-19T09:19:32.845885+0000","last_fullsized":"2024-09-19T09:19:32.845885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844440+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:19:32.844440+0000","last_peered":"2024-09-19T09:19:32.844440+0000","last_clean":"2024-09-19T09:19:32.844440+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:19:32.844440+0000","last_undegraded":"2024-09-19T09:19:32.844440+0000","last_fullsized":"2024-09-19T09:19:32.844440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846865+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:19:32.846865+0000","last_peered":"2024-09-19T09:19:32.846865+0000","last_clean":"2024-09-19T09:19:32.846865+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:19:32.846865+0000","last_undegraded":"2024-09-19T09:19:32.846865+0000","last_fullsized":"2024-09-19T09:19:32.846865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847897+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:19:32.847897+0000","last_peered":"2024-09-19T09:19:32.847897+0000","last_clean":"2024-09-19T09:19:32.847897+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:19:32.847897+0000","last_undegraded":"2024-09-19T09:19:32.847897+0000","last_fullsized":"2024-09-19T09:19:32.847897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846620+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:19:32.846620+0000","last_peered":"2024-09-19T09:19:32.846620+0000","last_clean":"2024-09-19T09:19:32.846620+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:19:32.846620+0000","last_undegraded":"2024-09-19T09:19:32.846620+0000","last_fullsized":"2024-09-19T09:19:32.846620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847757+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:19:32.847757+0000","last_peered":"2024-09-19T09:19:32.847757+0000","last_clean":"2024-09-19T09:19:32.847757+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:19:32.847757+0000","last_undegraded":"2024-09-19T09:19:32.847757+0000","last_fullsized":"2024-09-19T09:19:32.847757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.849461+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:19:32.849461+0000","last_peered":"2024-09-19T09:19:32.849461+0000","last_clean":"2024-09-19T09:19:32.849461+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:19:32.849461+0000","last_undegraded":"2024-09-19T09:19:32.849461+0000","last_fullsized":"2024-09-19T09:19:32.849461+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847947+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:19:32.847947+0000","last_peered":"2024-09-19T09:19:32.847947+0000","last_clean":"2024-09-19T09:19:32.847947+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:19:32.847947+0000","last_undegraded":"2024-09-19T09:19:32.847947+0000","last_fullsized":"2024-09-19T09:19:32.847947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847294+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:19:32.847294+0000","last_peered":"2024-09-19T09:19:32.847294+0000","last_clean":"2024-09-19T09:19:32.847294+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:19:32.847294+0000","last_undegraded":"2024-09-19T09:19:32.847294+0000","last_fullsized":"2024-09-19T09:19:32.847294+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.883786+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:19:32.883786+0000","last_peered":"2024-09-19T09:19:32.883786+0000","last_clean":"2024-09-19T09:19:32.883786+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:19:32.883786+0000","last_undegraded":"2024-09-19T09:19:32.883786+0000","last_fullsized":"2024-09-19T09:19:32.883786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843580+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:19:32.843580+0000","last_peered":"2024-09-19T09:19:32.843580+0000","last_clean":"2024-09-19T09:19:32.843580+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:19:32.843580+0000","last_undegraded":"2024-09-19T09:19:32.843580+0000","last_fullsized":"2024-09-19T09:19:32.843580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847240+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:19:32.847240+0000","last_peered":"2024-09-19T09:19:32.847240+0000","last_clean":"2024-09-19T09:19:32.847240+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:19:32.847240+0000","last_undegraded":"2024-09-19T09:19:32.847240+0000","last_fullsized":"2024-09-19T09:19:32.847240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847530+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:19:32.847530+0000","last_peered":"2024-09-19T09:19:32.847530+0000","last_clean":"2024-09-19T09:19:32.847530+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:19:32.847530+0000","last_undegraded":"2024-09-19T09:19:32.847530+0000","last_fullsized":"2024-09-19T09:19:32.847530+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:20:19.866469+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:20:19.866469+0000","last_peered":"2024-09-19T09:20:19.866469+0000","last_clean":"2024-09-19T09:20:19.866469+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:20:19.866469+0000","last_undegraded":"2024-09-19T09:20:19.866469+0000","last_fullsized":"2024-09-19T09:20:19.866469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846075+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:19:32.846075+0000","last_peered":"2024-09-19T09:19:32.846075+0000","last_clean":"2024-09-19T09:19:32.846075+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:19:32.846075+0000","last_undegraded":"2024-09-19T09:19:32.846075+0000","last_fullsized":"2024-09-19T09:19:32.846075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847411+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:19:32.847411+0000","last_peered":"2024-09-19T09:19:32.847411+0000","last_clean":"2024-09-19T09:19:32.847411+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:19:32.847411+0000","last_undegraded":"2024-09-19T09:19:32.847411+0000","last_fullsized":"2024-09-19T09:19:32.847411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844785+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:19:32.844785+0000","last_peered":"2024-09-19T09:19:32.844785+0000","last_clean":"2024-09-19T09:19:32.844785+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:19:32.844785+0000","last_undegraded":"2024-09-19T09:19:32.844785+0000","last_fullsized":"2024-09-19T09:19:32.844785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844973+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:19:32.844973+0000","last_peered":"2024-09-19T09:19:32.844973+0000","last_clean":"2024-09-19T09:19:32.844973+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:19:32.844973+0000","last_undegraded":"2024-09-19T09:19:32.844973+0000","last_fullsized":"2024-09-19T09:19:32.844973+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846736+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:19:32.846736+0000","last_peered":"2024-09-19T09:19:32.846736+0000","last_clean":"2024-09-19T09:19:32.846736+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:19:32.846736+0000","last_undegraded":"2024-09-19T09:19:32.846736+0000","last_fullsized":"2024-09-19T09:19:32.846736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846605+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:19:32.846605+0000","last_peered":"2024-09-19T09:19:32.846605+0000","last_clean":"2024-09-19T09:19:32.846605+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:19:32.846605+0000","last_undegraded":"2024-09-19T09:19:32.846605+0000","last_fullsized":"2024-09-19T09:19:32.846605+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":44,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.794355+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:19:41.794355+0000","last_peered":"2024-09-19T09:19:41.794355+0000","last_clean":"2024-09-19T09:19:41.794355+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:19:41.794355+0000","last_undegraded":"2024-09-19T09:19:41.794355+0000","last_fullsized":"2024-09-19T09:19:41.794355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843716+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:19:32.843716+0000","last_peered":"2024-09-19T09:19:32.843716+0000","last_clean":"2024-09-19T09:19:32.843716+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:19:32.843716+0000","last_undegraded":"2024-09-19T09:19:32.843716+0000","last_fullsized":"2024-09-19T09:19:32.843716+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884108+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:19:32.884108+0000","last_peered":"2024-09-19T09:19:32.884108+0000","last_clean":"2024-09-19T09:19:32.884108+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:19:32.884108+0000","last_undegraded":"2024-09-19T09:19:32.884108+0000","last_fullsized":"2024-09-19T09:19:32.884108+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.850919+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:19:32.850919+0000","last_peered":"2024-09-19T09:19:32.850919+0000","last_clean":"2024-09-19T09:19:32.850919+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:19:32.850919+0000","last_undegraded":"2024-09-19T09:19:32.850919+0000","last_fullsized":"2024-09-19T09:19:32.850919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884611+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:19:32.884611+0000","last_peered":"2024-09-19T09:19:32.884611+0000","last_clean":"2024-09-19T09:19:32.884611+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:19:32.884611+0000","last_undegraded":"2024-09-19T09:19:32.884611+0000","last_fullsized":"2024-09-19T09:19:32.884611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845457+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:19:32.845457+0000","last_peered":"2024-09-19T09:19:32.845457+0000","last_clean":"2024-09-19T09:19:32.845457+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:19:32.845457+0000","last_undegraded":"2024-09-19T09:19:32.845457+0000","last_fullsized":"2024-09-19T09:19:32.845457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843698+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:19:32.843698+0000","last_peered":"2024-09-19T09:19:32.843698+0000","last_clean":"2024-09-19T09:19:32.843698+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:19:32.843698+0000","last_undegraded":"2024-09-19T09:19:32.843698+0000","last_fullsized":"2024-09-19T09:19:32.843698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.844286+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:19:32.844286+0000","last_peered":"2024-09-19T09:19:32.844286+0000","last_clean":"2024-09-19T09:19:32.844286+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:19:32.844286+0000","last_undegraded":"2024-09-19T09:19:32.844286+0000","last_fullsized":"2024-09-19T09:19:32.844286+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847996+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:19:32.847996+0000","last_peered":"2024-09-19T09:19:32.847996+0000","last_clean":"2024-09-19T09:19:32.847996+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:19:32.847996+0000","last_undegraded":"2024-09-19T09:19:32.847996+0000","last_fullsized":"2024-09-19T09:19:32.847996+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843584+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:19:32.843584+0000","last_peered":"2024-09-19T09:19:32.843584+0000","last_clean":"2024-09-19T09:19:32.843584+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:19:32.843584+0000","last_undegraded":"2024-09-19T09:19:32.843584+0000","last_fullsized":"2024-09-19T09:19:32.843584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845593+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:19:32.845593+0000","last_peered":"2024-09-19T09:19:32.845593+0000","last_clean":"2024-09-19T09:19:32.845593+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:19:32.845593+0000","last_undegraded":"2024-09-19T09:19:32.845593+0000","last_fullsized":"2024-09-19T09:19:32.845593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.847264+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:19:32.847264+0000","last_peered":"2024-09-19T09:19:32.847264+0000","last_clean":"2024-09-19T09:19:32.847264+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:19:32.847264+0000","last_undegraded":"2024-09-19T09:19:32.847264+0000","last_fullsized":"2024-09-19T09:19:32.847264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846386+0000","last_change":"2024-09-19T09:19:17.796414+0000","last_active":"2024-09-19T09:19:32.846386+0000","last_peered":"2024-09-19T09:19:32.846386+0000","last_clean":"2024-09-19T09:19:32.846386+0000","last_became_active":"2024-09-19T09:19:17.796031+0000","last_became_peered":"2024-09-19T09:19:17.796031+0000","last_unstale":"2024-09-19T09:19:32.846386+0000","last_undegraded":"2024-09-19T09:19:32.846386+0000","last_fullsized":"2024-09-19T09:19:32.846386+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:40.707180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.845946+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:19:32.845946+0000","last_peered":"2024-09-19T09:19:32.845946+0000","last_clean":"2024-09-19T09:19:32.845946+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:19:32.845946+0000","last_undegraded":"2024-09-19T09:19:32.845946+0000","last_fullsized":"2024-09-19T09:19:32.845946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.884344+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:19:32.884344+0000","last_peered":"2024-09-19T09:19:32.884344+0000","last_clean":"2024-09-19T09:19:32.884344+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:19:32.884344+0000","last_undegraded":"2024-09-19T09:19:32.884344+0000","last_fullsized":"2024-09-19T09:19:32.884344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.889702+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:19:32.889702+0000","last_peered":"2024-09-19T09:19:32.889702+0000","last_clean":"2024-09-19T09:19:32.889702+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:19:32.889702+0000","last_undegraded":"2024-09-19T09:19:32.889702+0000","last_fullsized":"2024-09-19T09:19:32.889702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846503+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:19:32.846503+0000","last_peered":"2024-09-19T09:19:32.846503+0000","last_clean":"2024-09-19T09:19:32.846503+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:19:32.846503+0000","last_undegraded":"2024-09-19T09:19:32.846503+0000","last_fullsized":"2024-09-19T09:19:32.846503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843993+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:19:32.843993+0000","last_peered":"2024-09-19T09:19:32.843993+0000","last_clean":"2024-09-19T09:19:32.843993+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:19:32.843993+0000","last_undegraded":"2024-09-19T09:19:32.843993+0000","last_fullsized":"2024-09-19T09:19:32.843993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.843830+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:19:32.843830+0000","last_peered":"2024-09-19T09:19:32.843830+0000","last_clean":"2024-09-19T09:19:32.843830+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:19:32.843830+0000","last_undegraded":"2024-09-19T09:19:32.843830+0000","last_fullsized":"2024-09-19T09:19:32.843830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":32,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T09:19:32.846113+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:19:32.846113+0000","last_peered":"2024-09-19T09:19:32.846113+0000","last_clean":"2024-09-19T09:19:32.846113+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:19:32.846113+0000","last_undegraded":"2024-09-19T09:19:32.846113+0000","last_fullsized":"2024-09-19T09:19:32.846113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65755,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":338,"num_read_kb":239,"num_write":162,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":197265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":876544,"data_stored":427224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1080816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":427426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":888832,"data_stored":427346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561070,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1019278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691891,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":426815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920824,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1495040,"data_stored":1018569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051644,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":427645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280576,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40376,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704776,"statfs":{"total":95995035648,"available":95953690624,"internally_reserved":0,"allocated":892928,"data_stored":427126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476806,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":489676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":488360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40388,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704764,"statfs":{"total":95995035648,"available":95953678336,"internally_reserved":0,"allocated":897024,"data_stored":428086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":63068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:20:22.482 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:20:22.482 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:20:22.482 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:20:22.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:20:22.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:22.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:22.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:20:22.742 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:23.155 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:23 smithi052 ceph-mon[30947]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:23.155 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:23 smithi052 ceph-mon[30947]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 -- 172.21.15.52:0/3998556396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881810e480 msgr2=0x7f8818110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 --2- 172.21.15.52:0/3998556396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881810e480 0x7f8818110870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8810009ca0 tx=0x7f881002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 -- 172.21.15.52:0/3998556396 shutdown_connections 2024-09-19T09:20:23.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 --2- 172.21.15.52:0/3998556396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881810e480 0x7f8818110870 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 --2- 172.21.15.52:0/3998556396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8818101280 0x7f881810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 --2- 172.21.15.52:0/3998556396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88181008d0 0x7f8818100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 -- 172.21.15.52:0/3998556396 >> 172.21.15.52:0/3998556396 conn(0x7f88180fc7a0 msgr2=0x7f88180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 -- 172.21.15.52:0/3998556396 shutdown_connections 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.154+0000 7f881fd66640 1 -- 172.21.15.52:0/3998556396 wait complete. 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 Processor -- start 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 -- start start 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 0x7f881819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881810e480 0x7f881819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88181141b0 con 0x7f8818101280 2024-09-19T09:20:23.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8818114030 con 0x7f88181008d0 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881fd66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8818114330 con 0x7f881810e480 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881d301640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881d301640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45362/0 (socket says 172.21.15.52:45362) 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.155+0000 7f881d301640 1 -- 172.21.15.52:0/1867770246 learned_addr learned my addr 172.21.15.52:0/1867770246 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881e303640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881810e480 0x7f881819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881db02640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 0x7f881819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 -- 172.21.15.52:0/1867770246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881810e480 msgr2=0x7f881819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881810e480 0x7f881819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 -- 172.21.15.52:0/1867770246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 msgr2=0x7f881819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 0x7f881819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 -- 172.21.15.52:0/1867770246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881819f6a0 con 0x7f8818101280 2024-09-19T09:20:23.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881db02640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 0x7f881819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881d301640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f880800d950 tx=0x7f880800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808017030 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8808004020 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881819f990 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88080047a0 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.156+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88181a7270 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.157+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8818100cb0 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.159+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f88080041d0 con 0x7f8818101280 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.159+0000 7f880effd640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 0x7f88040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.159+0000 7f881db02640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 0x7f88040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.159+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f88080cfa30 con 0x7f8818101280 2024-09-19T09:20:23.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.160+0000 7f881db02640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 0x7f88040a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88140058c0 tx=0x7f8814005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.163+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f880809c650 con 0x7f8818101280 2024-09-19T09:20:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.378+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f881819ba50 con 0x7f8818101280 2024-09-19T09:20:23.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.378+0000 7f880effd640 1 -- 172.21.15.52:0/1867770246 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f880809bf50 con 0x7f8818101280 2024-09-19T09:20:23.379 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:23.379 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:20:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.380+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 msgr2=0x7f88040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.380+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 0x7f88040a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88140058c0 tx=0x7f8814005850 comp rx=0 tx=0).stop 2024-09-19T09:20:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.380+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 msgr2=0x7f881819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.380+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f880800d950 tx=0x7f880800de10 comp rx=0 tx=0).stop 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 shutdown_connections 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a3350 0x7f88040a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881810e480 0x7f881819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8818101280 0x7f881819ac30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 --2- 172.21.15.52:0/1867770246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88181008d0 0x7f881819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 >> 172.21.15.52:0/1867770246 conn(0x7f88180fc7a0 msgr2=0x7f88180feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 shutdown_connections 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:23.381+0000 7f881fd66640 1 -- 172.21.15.52:0/1867770246 wait complete. 2024-09-19T09:20:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:23 smithi169 ceph-mon[35454]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:23 smithi169 ceph-mon[35454]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:23 smithi086 ceph-mon[34813]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:23 smithi086 ceph-mon[34813]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:20:24.066 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:20:24.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:24.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:24 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1867770246' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:20:24.328 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:24.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:24 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1867770246' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:20:24.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:24 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1867770246' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 -- 172.21.15.52:0/1866380267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 msgr2=0x7fe28c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1866380267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c10e610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe284009ca0 tx=0x7fe28402a950 comp rx=0 tx=0).stop 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 -- 172.21.15.52:0/1866380267 shutdown_connections 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1866380267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c10e610 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1866380267 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c103660 0x7fe28c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1866380267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c102d40 0x7fe28c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 -- 172.21.15.52:0/1866380267 >> 172.21.15.52:0/1866380267 conn(0x7fe28c0fc7a0 msgr2=0x7fe28c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 -- 172.21.15.52:0/1866380267 shutdown_connections 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.764+0000 7fe292bd1640 1 -- 172.21.15.52:0/1866380267 wait complete. 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 Processor -- start 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 -- start start 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c102d40 0x7fe28c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c103660 0x7fe28c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c111f50 con 0x7fe28c10c170 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c111dd0 con 0x7fe28c103660 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe292bd1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe28c1120d0 con 0x7fe28c102d40 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe29116e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe29096d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c102d40 0x7fe28c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe283fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c103660 0x7fe28c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe29116e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45386/0 (socket says 172.21.15.52:45386) 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.765+0000 7fe29116e640 1 -- 172.21.15.52:0/1494111511 learned_addr learned my addr 172.21.15.52:0/1494111511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 -- 172.21.15.52:0/1494111511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c102d40 msgr2=0x7fe28c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c102d40 0x7fe28c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 -- 172.21.15.52:0/1494111511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c103660 msgr2=0x7fe28c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c103660 0x7fe28c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 -- 172.21.15.52:0/1494111511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28c19d410 con 0x7fe28c10c170 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe29116e640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe28402ae70 tx=0x7fe28402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284034040 con 0x7fe28c10c170 2024-09-19T09:20:24.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe284030920 con 0x7fe28c10c170 2024-09-19T09:20:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28c19d6a0 con 0x7fe28c10c170 2024-09-19T09:20:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284039430 con 0x7fe28c10c170 2024-09-19T09:20:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.766+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28c1a4fe0 con 0x7fe28c10c170 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.767+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28c103120 con 0x7fe28c10c170 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.768+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe284037020 con 0x7fe28c10c170 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.769+0000 7fe281ffb640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 0x7fe2740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.769+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7fe2840f0950 con 0x7fe28c10c170 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.769+0000 7fe29096d640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 0x7fe2740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.770+0000 7fe29096d640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 0x7fe2740a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe28800bbe0 tx=0x7fe28800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:24.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.773+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2840bd600 con 0x7fe28c10c170 2024-09-19T09:20:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.986+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe28c1071e0 con 0x7fe28c10c170 2024-09-19T09:20:24.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.986+0000 7fe281ffb640 1 -- 172.21.15.52:0/1494111511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7fe2840bcf00 con 0x7fe28c10c170 2024-09-19T09:20:24.987 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:24.987 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:20:24.987 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 msgr2=0x7fe2740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 0x7fe2740a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe28800bbe0 tx=0x7fe28800b390 comp rx=0 tx=0).stop 2024-09-19T09:20:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 msgr2=0x7fe28c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe28402ae70 tx=0x7fe28402f5b0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 shutdown_connections 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe28c10c170 0x7fe28c19cd30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe28c103660 0x7fe28c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe2740a32d0 0x7fe2740a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 --2- 172.21.15.52:0/1494111511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe28c102d40 0x7fe28c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 >> 172.21.15.52:0/1494111511 conn(0x7fe28c0fc7a0 msgr2=0x7fe28c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 shutdown_connections 2024-09-19T09:20:24.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:24.989+0000 7fe292bd1640 1 -- 172.21.15.52:0/1494111511 wait complete. 2024-09-19T09:20:25.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:25 smithi052 ceph-mon[30947]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:25.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:25 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1494111511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:25 smithi169 ceph-mon[35454]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:25 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1494111511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:25.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:25 smithi086 ceph-mon[34813]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:25 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1494111511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:25.716 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:25.972 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:26.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 -- 172.21.15.52:0/3562000174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 msgr2=0x7f6670106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 --2- 172.21.15.52:0/3562000174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f6670106e60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6660009930 tx=0x7f666002a420 comp rx=0 tx=0).stop 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 -- 172.21.15.52:0/3562000174 shutdown_connections 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 --2- 172.21.15.52:0/3562000174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670101420 0x7f667010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 --2- 172.21.15.52:0/3562000174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670100a80 0x7f6670100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 --2- 172.21.15.52:0/3562000174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f6670106e60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 -- 172.21.15.52:0/3562000174 >> 172.21.15.52:0/3562000174 conn(0x7f66700fc7a0 msgr2=0x7f66700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 -- 172.21.15.52:0/3562000174 shutdown_connections 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.422+0000 7f667648f640 1 -- 172.21.15.52:0/3562000174 wait complete. 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 Processor -- start 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 -- start start 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670100a80 0x7f66701972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670101420 0x7f6670197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6670110e80 con 0x7f6670106a80 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6670110d00 con 0x7f6670100a80 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f667648f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6670111000 con 0x7f6670101420 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f6674a2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f6674a2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45414/0 (socket says 172.21.15.52:45414) 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f6674a2c640 1 -- 172.21.15.52:0/1766038752 learned_addr learned my addr 172.21.15.52:0/1766038752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.423+0000 7f666ffff640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670100a80 0x7f66701972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f666f7fe640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670101420 0x7f6670197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 -- 172.21.15.52:0/1766038752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670101420 msgr2=0x7f6670197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670101420 0x7f6670197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 -- 172.21.15.52:0/1766038752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670100a80 msgr2=0x7f66701972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670100a80 0x7f66701972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 -- 172.21.15.52:0/1766038752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667019c290 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f6674a2c640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6668009fd0 tx=0x7f666800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668017070 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6668003e50 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667019c580 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668010460 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.424+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66701a3e60 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.425+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6670100ee0 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.426+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6668003970 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.427+0000 7f666d7fa640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.427+0000 7f666ffff640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.427+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f66680cf670 con 0x7f6670106a80 2024-09-19T09:20:26.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.427+0000 7f666ffff640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 0x7f66580a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6660009900 tx=0x7f66600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.430+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f666809c1b0 con 0x7f6670106a80 2024-09-19T09:20:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.646+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6670198640 con 0x7f6670106a80 2024-09-19T09:20:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.646+0000 7f666d7fa640 1 -- 172.21.15.52:0/1766038752 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7f6670198640 con 0x7f6670106a80 2024-09-19T09:20:26.647 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:26.647 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:20:26.648 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:26.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 msgr2=0x7f66580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 0x7f66580a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6660009900 tx=0x7f66600058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 msgr2=0x7f667019bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6668009fd0 tx=0x7f666800def0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 shutdown_connections 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6670106a80 0x7f667019bbb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6670101420 0x7f6670197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 --2- 172.21.15.52:0/1766038752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6670100a80 0x7f66701972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 >> 172.21.15.52:0/1766038752 conn(0x7f66700fc7a0 msgr2=0x7f66700fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 shutdown_connections 2024-09-19T09:20:26.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:26.649+0000 7f667648f640 1 -- 172.21.15.52:0/1766038752 wait complete. 2024-09-19T09:20:27.332 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:27 smithi052 ceph-mon[30947]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:27.333 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1766038752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:27.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:20:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:27 smithi169 ceph-mon[35454]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:27 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1766038752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:27 smithi086 ceph-mon[34813]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:27 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1766038752' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:27.634 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 -- 172.21.15.52:0/1453050160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 msgr2=0x7f7f88101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/1453050160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88101200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009900 tx=0x7f7f7002a480 comp rx=0 tx=0).stop 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 -- 172.21.15.52:0/1453050160 shutdown_connections 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/1453050160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102ef0 0x7f7f8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/1453050160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102570 0x7f7f881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/1453050160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88101200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 -- 172.21.15.52:0/1453050160 >> 172.21.15.52:0/1453050160 conn(0x7f7f880fc7d0 msgr2=0x7f7f880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 -- 172.21.15.52:0/1453050160 shutdown_connections 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.084+0000 7f7f8eefd640 1 -- 172.21.15.52:0/1453050160 wait complete. 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 Processor -- start 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 -- start start 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102570 0x7f7f881976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102ef0 0x7f7f88197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88110f80 con 0x7f7f88100e20 2024-09-19T09:20:28.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88110e00 con 0x7f7f88102ef0 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8eefd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88111100 con 0x7f7f88102570 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.085+0000 7f7f8cc99640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f87fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102570 0x7f7f881976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52684/0 (socket says 172.21.15.52:52684) 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 -- 172.21.15.52:0/508605943 learned_addr learned my addr 172.21.15.52:0/508605943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8d49a640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102ef0 0x7f7f88197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 -- 172.21.15.52:0/508605943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102570 msgr2=0x7f7f881976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102570 0x7f7f881976c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 -- 172.21.15.52:0/508605943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102ef0 msgr2=0x7f7f88197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102ef0 0x7f7f88197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 -- 172.21.15.52:0/508605943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f881a69f0 con 0x7f7f88100e20 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8cc99640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f70006010 tx=0x7f7f70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:28.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7003f070 con 0x7f7f88100e20 2024-09-19T09:20:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f70031c30 con 0x7f7f88100e20 2024-09-19T09:20:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f881a6c80 con 0x7f7f88100e20 2024-09-19T09:20:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.086+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70035030 con 0x7f7f88100e20 2024-09-19T09:20:28.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.087+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f881a71b0 con 0x7f7f88100e20 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.088+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f88101200 con 0x7f7f88100e20 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.089+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f70042070 con 0x7f7f88100e20 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.090+0000 7f7f85ffb640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 0x7f7f740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.090+0000 7f7f87fff640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 0x7f7f740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.090+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f7f700eff30 con 0x7f7f88100e20 2024-09-19T09:20:28.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.090+0000 7f7f87fff640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 0x7f7f740a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f881992e0 tx=0x7f7f78009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:28.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.094+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f70031de0 con 0x7f7f88100e20 2024-09-19T09:20:28.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.274+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f88108b00 con 0x7f7f88100e20 2024-09-19T09:20:28.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.276+0000 7f7f85ffb640 1 -- 172.21.15.52:0/508605943 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22724 (secure 0 0 0) 0x7f7f700bc420 con 0x7f7f88100e20 2024-09-19T09:20:28.276 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:28.277 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":79,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:19:32.840326+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 msgr2=0x7f7f740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 0x7f7f740a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7f881992e0 tx=0x7f7f78009680 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 msgr2=0x7f7f88197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7f70006010 tx=0x7f7f70003c10 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 shutdown_connections 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f88102ef0 0x7f7f88197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f740a3350 0x7f7f740a5810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f88102570 0x7f7f881976c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 --2- 172.21.15.52:0/508605943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f88100e20 0x7f7f88197180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 >> 172.21.15.52:0/508605943 conn(0x7f7f880fc7d0 msgr2=0x7f7f880fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:28.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 shutdown_connections 2024-09-19T09:20:28.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:28.278+0000 7f7f8eefd640 1 -- 172.21.15.52:0/508605943 wait complete. 2024-09-19T09:20:28.966 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:29.264 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:29.379 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:29 smithi052 ceph-mon[30947]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:29.380 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:29 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/508605943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:29 smithi169 ceph-mon[35454]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:29 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/508605943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:29.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:29 smithi086 ceph-mon[34813]: pgmap v307: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:29 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/508605943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:29.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 -- 172.21.15.52:0/2847115624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398106a80 msgr2=0x7f7398106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:29.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2847115624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398106a80 0x7f7398106e60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7388009930 tx=0x7f738802a420 comp rx=0 tx=0).stop 2024-09-19T09:20:29.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 -- 172.21.15.52:0/2847115624 shutdown_connections 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2847115624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398101420 0x7f739810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2847115624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 0x7f7398100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2847115624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398106a80 0x7f7398106e60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 -- 172.21.15.52:0/2847115624 >> 172.21.15.52:0/2847115624 conn(0x7f73980fc7a0 msgr2=0x7f73980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 -- 172.21.15.52:0/2847115624 shutdown_connections 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.673+0000 7f739c8f3640 1 -- 172.21.15.52:0/2847115624 wait complete. 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 Processor -- start 2024-09-19T09:20:29.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 -- start start 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 0x7f73980fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398106a80 0x7f73980fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7398110e80 con 0x7f7398101420 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7398110d00 con 0x7f7398106a80 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f739c8f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7398111000 con 0x7f7398100a80 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.674+0000 7f7395d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52706/0 (socket says 172.21.15.52:52706) 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f739659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 0x7f73980fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 -- 172.21.15.52:0/2383268389 learned_addr learned my addr 172.21.15.52:0/2383268389 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7396d9d640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398106a80 0x7f73980fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:29.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 -- 172.21.15.52:0/2383268389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 msgr2=0x7f73980fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 0x7f73980fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 -- 172.21.15.52:0/2383268389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398106a80 msgr2=0x7f73980fd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398106a80 0x7f73980fd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 -- 172.21.15.52:0/2383268389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73981a6960 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f7395d9b640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d770 tx=0x7f738c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c017070 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f738c005500 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73981a6c50 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c004e00 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.675+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73981a7140 con 0x7f7398101420 2024-09-19T09:20:29.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.676+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7398100ee0 con 0x7f7398101420 2024-09-19T09:20:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.678+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f738c004fa0 con 0x7f7398101420 2024-09-19T09:20:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.678+0000 7f73877fe640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 0x7f73800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.678+0000 7f739659c640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 0x7f73800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.678+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f738c0cf840 con 0x7f7398101420 2024-09-19T09:20:29.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.679+0000 7f739659c640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 0x7f73800a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7388009900 tx=0x7f73880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:29.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.681+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f738c09bd90 con 0x7f7398101420 2024-09-19T09:20:29.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.898+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f739810a000 con 0x7f7398101420 2024-09-19T09:20:29.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.899+0000 7f73877fe640 1 -- 172.21.15.52:0/2383268389 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7f738c0a0090 con 0x7f7398101420 2024-09-19T09:20:29.899 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:29.899 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:20:29.900 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 msgr2=0x7f73800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 0x7f73800a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7388009900 tx=0x7f73880058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 msgr2=0x7f73980fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d770 tx=0x7f738c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 shutdown_connections 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7398106a80 0x7f73980fd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7398101420 0x7f73980fd390 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f73800a32d0 0x7f73800a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 --2- 172.21.15.52:0/2383268389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7398100a80 0x7f73980fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 >> 172.21.15.52:0/2383268389 conn(0x7f73980fc7a0 msgr2=0x7f739806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 shutdown_connections 2024-09-19T09:20:29.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:29.901+0000 7f739c8f3640 1 -- 172.21.15.52:0/2383268389 wait complete. 2024-09-19T09:20:30.383 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:30 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2383268389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:30.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:30 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2383268389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:30.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:30 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2383268389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:30.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:19:18.374880+0000', 'modified': '2024-09-19T09:19:29.358326+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24482, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/144132383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 144132383}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 144132383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/1790018144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 1790018144}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 1790018144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6835/4246812720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 4246812720}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 4246812720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.169:6839/3841296575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3841296575}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3841296575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.86:6837/546883569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 546883569}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 546883569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.86:6839/1882596213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 1882596213}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 1882596213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24509, 24482, 24466]} 2024-09-19T09:20:30.619 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:20:30.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:20:30.881 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:31.314 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:31 smithi052 ceph-mon[30947]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:31.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 -- 172.21.15.52:0/4128241161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 msgr2=0x7f1b301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 --2- 172.21.15.52:0/4128241161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301021c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009900 tx=0x7f1b2002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:31.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 -- 172.21.15.52:0/4128241161 shutdown_connections 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 --2- 172.21.15.52:0/4128241161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30106f10 0x7f1b3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 --2- 172.21.15.52:0/4128241161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30102790 0x7f1b301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 --2- 172.21.15.52:0/4128241161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301021c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 -- 172.21.15.52:0/4128241161 >> 172.21.15.52:0/4128241161 conn(0x7f1b300fd8c0 msgr2=0x7f1b300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 -- 172.21.15.52:0/4128241161 shutdown_connections 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.313+0000 7f1b3599a640 1 -- 172.21.15.52:0/4128241161 wait complete. 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.314+0000 7f1b3599a640 1 Processor -- start 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.314+0000 7f1b3599a640 1 -- start start 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.314+0000 7f1b3599a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.314+0000 7f1b3599a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30102790 0x7f1b301a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b3599a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30106f10 0x7f1b3010dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b3599a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30111f70 con 0x7f1b30101de0 2024-09-19T09:20:31.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b3599a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30111df0 con 0x7f1b30102790 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b3599a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301120f0 con 0x7f1b30106f10 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52722/0 (socket says 172.21.15.52:52722) 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 -- 172.21.15.52:0/414250253 learned_addr learned my addr 172.21.15.52:0/414250253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30106f10 0x7f1b3010dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30102790 0x7f1b301a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 -- 172.21.15.52:0/414250253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30106f10 msgr2=0x7f1b3010dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30106f10 0x7f1b3010dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 -- 172.21.15.52:0/414250253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30102790 msgr2=0x7f1b301a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30102790 0x7f1b301a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 -- 172.21.15.52:0/414250253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3010e3f0 con 0x7f1b30101de0 2024-09-19T09:20:31.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b2effd640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1b20006010 tx=0x7f1b200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.315+0000 7f1b34998640 1 -- 172.21.15.52:0/414250253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2003f030 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.316+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3010e680 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.316+0000 7f1b34998640 1 -- 172.21.15.52:0/414250253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b20003ce0 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.316+0000 7f1b34998640 1 -- 172.21.15.52:0/414250253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20035070 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.316+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301ab5c0 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.318+0000 7f1b34998640 1 -- 172.21.15.52:0/414250253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1b20042030 con 0x7f1b30101de0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.318+0000 7f1b37d73740 1 Processor -- start 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.318+0000 7f1b37d73740 1 -- start start 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.318+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8726db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.318+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8731670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8733fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b37d73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ef868d090 con 0x555ef87272f0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b37d73740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ef8634a70 con 0x555ef87269d0 2024-09-19T09:20:31.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b37d73740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ef8689050 con 0x555ef8731bb0 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8731670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8731670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52724/0 (socket says 172.21.15.52:52724) 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2effd640 1 -- 172.21.15.52:0/2487208824 learned_addr learned my addr 172.21.15.52:0/2487208824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8726db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8733fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b34998640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 0x7f1b180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 -- 172.21.15.52:0/2487208824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 msgr2=0x555ef8733fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8733fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 -- 172.21.15.52:0/2487208824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 msgr2=0x555ef8731670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8731670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 -- 172.21.15.52:0/2487208824 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ef8641130 con 0x555ef87269d0 2024-09-19T09:20:31.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 0x7f1b180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b34998640 1 -- 172.21.15.52:0/414250253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f1b200f0130 con 0x7f1b30101de0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.319+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8726db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009f40 tx=0x7f1b28010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d085093cda324903 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b15ffb640 1 -- 172.21.15.52:0/2487208824 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2801d910 con 0x555ef87269d0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b15ffb640 1 -- 172.21.15.52:0/2487208824 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b28011440 con 0x555ef87269d0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b15ffb640 1 -- 172.21.15.52:0/2487208824 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2801c6a0 con 0x555ef87269d0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 -- 172.21.15.52:0/2487208824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 msgr2=0x555ef8726db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8726db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009f40 tx=0x7f1b28010860 comp rx=0 tx=0).stop 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 0x7f1b180a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b28021000 tx=0x7f1b2801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 -- 172.21.15.52:0/2487208824 shutdown_connections 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8733fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8731670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2487208824 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8726db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 -- 172.21.15.52:0/2487208824 >> 172.21.15.52:0/2487208824 conn(0x555ef8722f60 msgr2=0x555ef8723340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 -- 172.21.15.52:0/2487208824 shutdown_connections 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.320+0000 7f1b37d73740 1 -- 172.21.15.52:0/2487208824 wait complete. 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 -- start start 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 Processor -- start 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef87272f0 0x555ef872e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 0x555ef872ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ef8734780 con 0x555ef87269d0 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ef8647f20 con 0x555ef8731bb0 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ef8734900 con 0x555ef87272f0 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b37d73740 10 client.0 _ll_register_callbacks cb 0x555ef8611030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52740/0 (socket says 172.21.15.52:52740) 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b2effd640 1 -- 172.21.15.52:0/1150218958 learned_addr learned my addr 172.21.15.52:0/1150218958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef87272f0 0x555ef872e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.321+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 0x555ef872ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 -- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef87272f0 msgr2=0x555ef872e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef87272f0 0x555ef872e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 -- 172.21.15.52:0/1150218958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 msgr2=0x555ef872ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 0x555ef872ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 -- 172.21.15.52:0/1150218958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ef83fe2b0 con 0x555ef87269d0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 0x555ef872ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b2effd640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1b200f03d0 tx=0x7f1b20005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc819eaff1af5123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20049070 con 0x555ef87269d0 2024-09-19T09:20:31.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f1b200edcb0 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b28011440 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1b200bc4b0 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b37d73740 10 client.14979 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x555ef87400c0 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b28011440 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f1b200bc940 con 0x555ef87269d0 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b37d73740 10 client.14979 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.322+0000 7f1b37d73740 10 client.14979 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b37d73740 20 client.14979 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef8742790 0x555ef8743c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b37d73740 4 client.14979 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ef869a600 con 0x555ef8742790 2024-09-19T09:20:31.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef8742790 0x555ef8743c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b0effd640 10 client.14979 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.323+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef8742790 0x555ef8743c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df7a9128d1b96693 server_cookie=8ac756ad1efbeee7 in_seq=0 out_seq=0 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b0effd640 1 -- 172.21.15.52:0/1150218958 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ef869a600 con 0x555ef8742790 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b0effd640 10 client.14979 handle_command_reply: tid=0 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 client.14979 shutdown 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 msgr2=0x555ef8731430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1b200f03d0 tx=0x7f1b20005b50 comp rx=0 tx=0).stop 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 shutdown_connections 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef8742790 0x555ef8743c00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef8731bb0 0x555ef872ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef87272f0 0x555ef872e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 --2- 172.21.15.52:0/1150218958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8731430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 >> 172.21.15.52:0/1150218958 conn(0x555ef8722f60 msgr2=0x555ef8728c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b0effd640 0 client.14979 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:31.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.324+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 shutdown_connections 2024-09-19T09:20:31.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.325+0000 7f1b37d73740 1 -- 172.21.15.52:0/1150218958 wait complete. 2024-09-19T09:20:31.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.325+0000 7f1b37d73740 20 client.14979 trim_cache size 0 max 16384 2024-09-19T09:20:31.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.345+0000 7f1b37d73740 1 Processor -- start 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.345+0000 7f1b37d73740 1 -- start start 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.345+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8742e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.345+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8741950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b37d73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ef8741f40 con 0x555ef87272f0 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b37d73740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ef8742610 con 0x555ef87269d0 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b37d73740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ef8742ce0 con 0x555ef8731bb0 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52750/0 (socket says 172.21.15.52:52750) 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 -- 172.21.15.52:0/3861974836 learned_addr learned my addr 172.21.15.52:0/3861974836 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2effd640 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8742e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 -- 172.21.15.52:0/3861974836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 msgr2=0x555ef8741950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8741950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 -- 172.21.15.52:0/3861974836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 msgr2=0x555ef8742e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8742e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 -- 172.21.15.52:0/3861974836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ef8726800 con 0x555ef87272f0 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b3019fc30 tx=0x7f1b2400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57655f6823216df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b157fa640 1 -- 172.21.15.52:0/3861974836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24003ea0 con 0x555ef87272f0 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b157fa640 1 -- 172.21.15.52:0/3861974836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b24005500 con 0x555ef87272f0 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.346+0000 7f1b157fa640 1 -- 172.21.15.52:0/3861974836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b240116a0 con 0x555ef87272f0 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 -- 172.21.15.52:0/3861974836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 msgr2=0x555ef8741410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1b3019fc30 tx=0x7f1b2400bdd0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 -- 172.21.15.52:0/3861974836 shutdown_connections 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef8741950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87272f0 0x555ef8741410 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 --2- 172.21.15.52:0/3861974836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87269d0 0x555ef8742e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 -- 172.21.15.52:0/3861974836 >> 172.21.15.52:0/3861974836 conn(0x555ef8722f60 msgr2=0x555ef871dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.347+0000 7f1b37d73740 1 -- 172.21.15.52:0/3861974836 shutdown_connections 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.348+0000 7f1b37d73740 1 -- 172.21.15.52:0/3861974836 wait complete. 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.348+0000 7f1b37d73740 1 -- start start 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.348+0000 7f1b37d73740 1 Processor -- start 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.348+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.348+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87272f0 0x555ef8747410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef87aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ef8743a80 con 0x555ef87269d0 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ef87433b0 con 0x555ef87272f0 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ef8744150 con 0x555ef8731bb0 2024-09-19T09:20:31.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 10 client.0 _ll_register_callbacks cb 0x7f1b20005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:31.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52764/0 (socket says 172.21.15.52:52764) 2024-09-19T09:20:31.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 -- 172.21.15.52:0/2047050274 learned_addr learned my addr 172.21.15.52:0/2047050274 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:31.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87272f0 0x555ef8747410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2f7fe640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef87aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 -- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 msgr2=0x555ef87aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef87aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 -- 172.21.15.52:0/2047050274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87272f0 msgr2=0x555ef8747410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87272f0 0x555ef8747410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 -- 172.21.15.52:0/2047050274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ef8747ca0 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b2effd640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b200c4d70 tx=0x7f1b200b8980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57921eee96125cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b0effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20049040 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8269+0+0 (secure 0 0 0) 0x7f1b200bbb30 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.349+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b24005500 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1b200044e0 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 10 client.14985 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x555ef87ac4a0 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b24005500 con 0x555ef87269d0 2024-09-19T09:20:31.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f1b200b8430 con 0x555ef87269d0 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 10 client.14985 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 10 client.14985 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 20 client.14985 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef87b0e60 0x555ef87afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 4 client.14985 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "status"}) -- 0x555ef8694b10 con 0x555ef87b0e60 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.350+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef87b0e60 0x555ef87afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b2e7fc640 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef87b0e60 0x555ef87afb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6388687312e2b895 server_cookie=a23f3701bf6e5e8c in_seq=0 out_seq=0 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b0effd640 10 client.14985 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b0effd640 1 -- 172.21.15.52:0/2047050274 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555ef8694b10 con 0x555ef87b0e60 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b0effd640 10 client.14985 handle_command_reply: tid=0 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 client.14985 shutdown 2024-09-19T09:20:31.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 msgr2=0x555ef8746ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b200c4d70 tx=0x7f1b200b8980 comp rx=0 tx=0).stop 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 shutdown_connections 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ef87b0e60 0x555ef87afb70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ef8731bb0 0x555ef87aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ef87272f0 0x555ef8747410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 --2- 172.21.15.52:0/2047050274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ef87269d0 0x555ef8746ed0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 >> 172.21.15.52:0/2047050274 conn(0x555ef8722f60 msgr2=0x555ef8723340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.351+0000 7f1b0effd640 0 client.14985 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 shutdown_connections 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b37d73740 1 -- 172.21.15.52:0/2047050274 wait complete. 2024-09-19T09:20:31.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b37d73740 20 client.14985 trim_cache size 0 max 16384 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 2, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24466, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 64.526647357000002, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 79, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:31.364 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 91.592761588000002 2024-09-19T09:20:31.365 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:31.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 msgr2=0x7f1b180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 0x7f1b180a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1b28021000 tx=0x7f1b2801e000 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 msgr2=0x7f1b301a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1b20006010 tx=0x7f1b200042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 shutdown_connections 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b180a32d0 0x7f1b180a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b30106f10 0x7f1b3010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b30102790 0x7f1b301a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 --2- 172.21.15.52:0/414250253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b30101de0 0x7f1b301a4780 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 >> 172.21.15.52:0/414250253 conn(0x7f1b300fd8c0 msgr2=0x7f1b300fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.352+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 shutdown_connections 2024-09-19T09:20:31.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:31.353+0000 7f1b3599a640 1 -- 172.21.15.52:0/414250253 wait complete. 2024-09-19T09:20:31.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:31 smithi169 ceph-mon[35454]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:31.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:31 smithi086 ceph-mon[34813]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:32.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:20:32.288 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:32.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-09-19T09:20:32.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]: dispatch 2024-09-19T09:20:32.410 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-19T09:20:32.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-09-19T09:20:32.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]: dispatch 2024-09-19T09:20:32.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-19T09:20:32.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-09-19T09:20:32.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]: dispatch 2024-09-19T09:20:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2024-09-19T09:20:32.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 -- 172.21.15.52:0/1937263116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 msgr2=0x7f6fac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/1937263116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1067e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009900 tx=0x7f6f9402a410 comp rx=0 tx=0).stop 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 -- 172.21.15.52:0/1937263116 shutdown_connections 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/1937263116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac106f10 0x7f6fac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/1937263116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1067e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/1937263116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac101de0 0x7f6fac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 -- 172.21.15.52:0/1937263116 >> 172.21.15.52:0/1937263116 conn(0x7f6fac0fd8c0 msgr2=0x7f6fac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 -- 172.21.15.52:0/1937263116 shutdown_connections 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.748+0000 7f6fb11c7640 1 -- 172.21.15.52:0/1937263116 wait complete. 2024-09-19T09:20:32.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 Processor -- start 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 -- start start 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 0x7f6fac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 0x7f6fac19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac111f70 con 0x7f6fac102790 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac111df0 con 0x7f6fac106f10 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fb11c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6fac1120f0 con 0x7f6fac101de0 2024-09-19T09:20:32.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52788/0 (socket says 172.21.15.52:52788) 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6fa3fff640 1 -- 172.21.15.52:0/2402743960 learned_addr learned my addr 172.21.15.52:0/2402743960 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.749+0000 7f6faad9d640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 0x7f6fac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 0x7f6fac19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 -- 172.21.15.52:0/2402743960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 msgr2=0x7f6fac198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 0x7f6fac198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 -- 172.21.15.52:0/2402743960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 msgr2=0x7f6fac19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 0x7f6fac19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 -- 172.21.15.52:0/2402743960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fac19d410 con 0x7f6fac102790 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 0x7f6fac19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6faad9d640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 0x7f6fac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006010 tx=0x7f6f94004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa8d99640 1 -- 172.21.15.52:0/2402743960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9403f030 con 0x7f6fac102790 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa8d99640 1 -- 172.21.15.52:0/2402743960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f94004440 con 0x7f6fac102790 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fac19d6a0 con 0x7f6fac102790 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fa8d99640 1 -- 172.21.15.52:0/2402743960 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94035070 con 0x7f6fac102790 2024-09-19T09:20:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.750+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fac1a4fe0 con 0x7f6fac102790 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.752+0000 7f6fa8d99640 1 -- 172.21.15.52:0/2402743960 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6f94042030 con 0x7f6fac102790 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 Processor -- start 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 -- start start 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd522db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd489090 con 0x55f1bd5232f0 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd430a70 con 0x55f1bd5229d0 2024-09-19T09:20:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd485050 con 0x55f1bd52dbb0 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.753+0000 7f6faad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52794/0 (socket says 172.21.15.52:52794) 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 -- 172.21.15.52:0/97163633 learned_addr learned my addr 172.21.15.52:0/97163633 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa8d99640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 0x7f6f980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fab59e640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd522db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 0x7f6f980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 -- 172.21.15.52:0/97163633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 msgr2=0x55f1bd52ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 -- 172.21.15.52:0/97163633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 msgr2=0x55f1bd522db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd522db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 -- 172.21.15.52:0/97163633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bd43d130 con 0x55f1bd5232f0 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa8d99640 1 -- 172.21.15.52:0/2402743960 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8364+0+0 (secure 0 0 0) 0x7f6f940eff00 con 0x7f6fac102790 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fab59e640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd522db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6faad9d640 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0115f0 tx=0x7f6f9c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a31c936cc5d147c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 0x7f6f980a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005c40 tx=0x7f6fa4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa17fa640 1 -- 172.21.15.52:0/97163633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c01e070 con 0x55f1bd5232f0 2024-09-19T09:20:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa17fa640 1 -- 172.21.15.52:0/97163633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c00fb20 con 0x55f1bd5232f0 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.754+0000 7f6fa17fa640 1 -- 172.21.15.52:0/97163633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c019c40 con 0x55f1bd5232f0 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 -- 172.21.15.52:0/97163633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 msgr2=0x55f1bd52d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0115f0 tx=0x7f6f9c011ab0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 -- 172.21.15.52:0/97163633 shutdown_connections 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52d670 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/97163633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd522db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 -- 172.21.15.52:0/97163633 >> 172.21.15.52:0/97163633 conn(0x55f1bd51ef60 msgr2=0x55f1bd51f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 -- 172.21.15.52:0/97163633 shutdown_connections 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.755+0000 7f6fb35a0740 1 -- 172.21.15.52:0/97163633 wait complete. 2024-09-19T09:20:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 -- start start 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 Processor -- start 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 0x55f1bd52d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd530780 con 0x55f1bd5232f0 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd443f20 con 0x55f1bd52dbb0 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd530900 con 0x55f1bd5229d0 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fb35a0740 10 client.0 _ll_register_callbacks cb 0x55f1bd40d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52798/0 (socket says 172.21.15.52:52798) 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 -- 172.21.15.52:0/1470968390 learned_addr learned my addr 172.21.15.52:0/1470968390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:32.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fab59e640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 0x55f1bd52d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 -- 172.21.15.52:0/1470968390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 msgr2=0x55f1bd52d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 0x55f1bd52d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 -- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 msgr2=0x55f1bd52ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6fa3fff640 1 -- 172.21.15.52:0/1470968390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bd1fa2b0 con 0x55f1bd5232f0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.756+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 0x55f1bd52d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f9408f130 tx=0x7f6f9408b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea816ef8053e2e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94049070 con 0x55f1bd5232f0 2024-09-19T09:20:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8364+0+0 (secure 0 0 0) 0x7f6f940b8950 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9c00fb20 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6f940bc2e0 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 10 client.14997 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f1bd53c070 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c00fb20 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6f940f1070 con 0x55f1bd5232f0 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 10 client.14997 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 10 client.14997 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 20 client.14997 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd53e6d0 0x55f1bd53fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 4 client.14997 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.757+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1bd496600 con 0x55f1bd53e6d0 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.758+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd53e6d0 0x55f1bd53fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.758+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd53e6d0 0x55f1bd53fb40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbd562d29d43a9eb server_cookie=5f78ff5a83a6c9d6 in_seq=0 out_seq=0 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.758+0000 7f6f927fc640 10 client.14997 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6f927fc640 1 -- 172.21.15.52:0/1470968390 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1bd496600 con 0x55f1bd53e6d0 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6f927fc640 10 client.14997 handle_command_reply: tid=0 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 client.14997 shutdown 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 msgr2=0x55f1bd52a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6f9408f130 tx=0x7f6f9408b020 comp rx=0 tx=0).stop 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 shutdown_connections 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd53e6d0 0x55f1bd53fb40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd52ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5232f0 0x55f1bd52a810 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1470968390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5229d0 0x55f1bd52d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6f927fc640 0 client.14997 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 >> 172.21.15.52:0/1470968390 conn(0x55f1bd51ef60 msgr2=0x55f1bd524c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 shutdown_connections 2024-09-19T09:20:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1470968390 wait complete. 2024-09-19T09:20:32.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.759+0000 7f6fb35a0740 20 client.14997 trim_cache size 0 max 16384 2024-09-19T09:20:32.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.777+0000 7f6fb35a0740 1 Processor -- start 2024-09-19T09:20:32.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.777+0000 7f6fb35a0740 1 -- start start 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd53d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd53d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd53de80 con 0x55f1bd5229d0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd53e550 con 0x55f1bd52dbb0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd53ec20 con 0x55f1bd5232f0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52808/0 (socket says 172.21.15.52:52808) 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 -- 172.21.15.52:0/1360009900 learned_addr learned my addr 172.21.15.52:0/1360009900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fab59e640 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd53d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd53d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 -- 172.21.15.52:0/1360009900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 msgr2=0x55f1bd53d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd53d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 -- 172.21.15.52:0/1360009900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 msgr2=0x55f1bd53d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd53d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.778+0000 7f6faad9d640 1 -- 172.21.15.52:0/1360009900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1bd52d0e0 con 0x55f1bd5229d0 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6faad9d640 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c01c040 tx=0x7f6f9c019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848f535da919450b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6fa0ff9640 1 -- 172.21.15.52:0/1360009900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c028030 con 0x55f1bd5229d0 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6fa0ff9640 1 -- 172.21.15.52:0/1360009900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c019e30 con 0x55f1bd5229d0 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6fa0ff9640 1 -- 172.21.15.52:0/1360009900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c01e040 con 0x55f1bd5229d0 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1360009900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 msgr2=0x55f1bd53eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.779+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c01c040 tx=0x7f6f9c019820 comp rx=0 tx=0).stop 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1360009900 shutdown_connections 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd52dbb0 0x55f1bd53d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd53d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/1360009900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd5229d0 0x55f1bd53eda0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1360009900 >> 172.21.15.52:0/1360009900 conn(0x55f1bd51ef60 msgr2=0x55f1bd519ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1360009900 shutdown_connections 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- 172.21.15.52:0/1360009900 wait complete. 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- start start 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 Processor -- start 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd5414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd541a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd53f9c0 con 0x55f1bd52dbb0 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd53f2f0 con 0x55f1bd5229d0 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1bd540090 con 0x55f1bd5232f0 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fb35a0740 10 client.0 _ll_register_callbacks cb 0x7f6f9403b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:32.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fab59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6faad9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd5414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fab59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52818/0 (socket says 172.21.15.52:52818) 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.780+0000 7f6fab59e640 1 -- 172.21.15.52:0/2934056180 learned_addr learned my addr 172.21.15.52:0/2934056180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd541a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 -- 172.21.15.52:0/2934056180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 msgr2=0x55f1bd541a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd541a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 -- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 msgr2=0x55f1bd5414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd5414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 -- 172.21.15.52:0/2934056180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1bd5a7340 con 0x55f1bd52dbb0 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fa3fff640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd541a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6faad9d640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd5414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fab59e640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400ee00 tx=0x7f6fa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c32dc7f6dae683 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6f927fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa402e060 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8364+0+0 (secure 0 0 0) 0x7f6fa401e630 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f9c019e30 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.781+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6fa4018070 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 10 client.15003 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55f1bd5a86a0 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f9c019e30 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6fa400f9b0 con 0x55f1bd52dbb0 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 10 client.15003 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 10 client.15003 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 20 client.15003 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd5ad320 0x55f1bd5ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 4 client.15003 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "status"}) -- 0x55f1bd490b10 con 0x55f1bd5ad320 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.782+0000 7f6faad9d640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd5ad320 0x55f1bd5ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6faad9d640 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd5ad320 0x55f1bd5ac030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a46314fe3867d51 server_cookie=acc1b13f8db37940 in_seq=0 out_seq=0 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6f927fc640 10 client.15003 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6f927fc640 1 -- 172.21.15.52:0/2934056180 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f1bd490b10 con 0x55f1bd5ad320 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6f927fc640 10 client.15003 handle_command_reply: tid=0 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 client.15003 shutdown 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 msgr2=0x55f1bd5a6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400ee00 tx=0x7f6fa4004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 shutdown_connections 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1bd52dbb0 0x55f1bd5a6dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1bd5232f0 0x55f1bd541a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55f1bd5ad320 0x55f1bd5ac030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 --2- 172.21.15.52:0/2934056180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1bd5229d0 0x55f1bd5414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 >> 172.21.15.52:0/2934056180 conn(0x55f1bd51ef60 msgr2=0x55f1bd52a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6f927fc640 0 client.15003 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 shutdown_connections 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 1 -- 172.21.15.52:0/2934056180 wait complete. 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.783+0000 7f6fb35a0740 20 client.15003 trim_cache size 0 max 16384 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:32.798 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 1, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24482, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 66.964613217999997, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 80, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 95.400082800999996 2024-09-19T09:20:32.799 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:32.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 msgr2=0x7f6f980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 0x7f6f980a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4005c40 tx=0x7f6fa4009500 comp rx=0 tx=0).stop 2024-09-19T09:20:32.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 msgr2=0x7f6fac1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6f94006010 tx=0x7f6f94004040 comp rx=0 tx=0).stop 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 shutdown_connections 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fac106f10 0x7f6fac19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6fac102790 0x7f6fac1989a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6f980a3350 0x7f6f980a5810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 --2- 172.21.15.52:0/2402743960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6fac101de0 0x7f6fac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 >> 172.21.15.52:0/2402743960 conn(0x7f6fac0fd8c0 msgr2=0x7f6fac0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 shutdown_connections 2024-09-19T09:20:32.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:32.784+0000 7f6fb11c7640 1 -- 172.21.15.52:0/2402743960 wait complete. 2024-09-19T09:20:33.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:33 smithi052 ceph-mon[30947]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:20:33.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-09-19T09:20:33.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]': finished 2024-09-19T09:20:33.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-19T09:20:33.378 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:33 smithi052 ceph-mon[30947]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:20:33.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:20:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:33 smithi169 ceph-mon[35454]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:20:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-09-19T09:20:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]': finished 2024-09-19T09:20:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-19T09:20:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:33 smithi169 ceph-mon[35454]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:20:33.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:33 smithi086 ceph-mon[34813]: pgmap v309: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T09:20:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-09-19T09:20:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [1, 2, 5, 9]}]': finished 2024-09-19T09:20:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-19T09:20:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:33 smithi086 ceph-mon[34813]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:20:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 -- 172.21.15.52:0/2707058480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 msgr2=0x7fdeb4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 --2- 172.21.15.52:0/2707058480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb4106e60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009930 tx=0x7fdea402a420 comp rx=0 tx=0).stop 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 -- 172.21.15.52:0/2707058480 shutdown_connections 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 --2- 172.21.15.52:0/2707058480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 --2- 172.21.15.52:0/2707058480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 0x7fdeb4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 --2- 172.21.15.52:0/2707058480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb4106e60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 -- 172.21.15.52:0/2707058480 >> 172.21.15.52:0/2707058480 conn(0x7fdeb40fc7a0 msgr2=0x7fdeb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 -- 172.21.15.52:0/2707058480 shutdown_connections 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.151+0000 7fdebab12640 1 -- 172.21.15.52:0/2707058480 wait complete. 2024-09-19T09:20:34.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 Processor -- start 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 -- start start 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 0x7fdeb41972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb4197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4110e40 con 0x7fdeb4106a80 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4110cc0 con 0x7fdeb4100a80 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdebab12640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb4110fc0 con 0x7fdeb4101420 2024-09-19T09:20:34.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdeb90af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdeb90af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52844/0 (socket says 172.21.15.52:52844) 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.152+0000 7fdeb90af640 1 -- 172.21.15.52:0/1437822697 learned_addr learned my addr 172.21.15.52:0/1437822697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb4197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 0x7fdeb41972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 -- 172.21.15.52:0/1437822697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 msgr2=0x7fdeb4197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb4197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 -- 172.21.15.52:0/1437822697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 msgr2=0x7fdeb41972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 0x7fdeb41972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 -- 172.21.15.52:0/1437822697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb419c290 con 0x7fdeb4106a80 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb4197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb90af640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00eaa0 tx=0x7fdeac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb1ffb640 1 -- 172.21.15.52:0/1437822697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00cdb0 con 0x7fdeb4106a80 2024-09-19T09:20:34.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb1ffb640 1 -- 172.21.15.52:0/1437822697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdeac005020 con 0x7fdeb4106a80 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb419c580 con 0x7fdeb4106a80 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdeb1ffb640 1 -- 172.21.15.52:0/1437822697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeac0116b0 con 0x7fdeb4106a80 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.153+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb41a3e60 con 0x7fdeb4106a80 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.155+0000 7fdeb1ffb640 1 -- 172.21.15.52:0/1437822697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdeac005560 con 0x7fdeb4106a80 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 Processor -- start 2024-09-19T09:20:34.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 -- start start 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6114870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b6115280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604b607b090 con 0x5604b6123c70 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604b6022a70 con 0x5604b6114e40 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdebceeb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604b6077050 con 0x5604b6116070 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.156+0000 7fdeb1ffb640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 0x7fde9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52846/0 (socket says 172.21.15.52:52846) 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 -- 172.21.15.52:0/524995452 learned_addr learned my addr 172.21.15.52:0/524995452 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6114870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb1ffb640 1 -- 172.21.15.52:0/1437822697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdeac0cfdc0 con 0x7fdeb4106a80 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb90af640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 0x7fde9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b6115280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 -- 172.21.15.52:0/524995452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 msgr2=0x5604b6114870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6114870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 -- 172.21.15.52:0/524995452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 msgr2=0x5604b6115280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b6115280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 -- 172.21.15.52:0/524995452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b602f130 con 0x5604b6123c70 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b6115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:34.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdea80249e0 tx=0x7fdea800b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c602f312bf5c0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.157+0000 7fdeb90af640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 0x7fde9c0a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdeac098bd0 tx=0x7fdeac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fde9affd640 1 -- 172.21.15.52:0/524995452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea80242d0 con 0x5604b6123c70 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fde9affd640 1 -- 172.21.15.52:0/524995452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea800e960 con 0x5604b6123c70 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fde9affd640 1 -- 172.21.15.52:0/524995452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8003970 con 0x5604b6123c70 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 -- 172.21.15.52:0/524995452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 msgr2=0x5604b6126060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdea80249e0 tx=0x7fdea800b500 comp rx=0 tx=0).stop 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 -- 172.21.15.52:0/524995452 shutdown_connections 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6123c70 0x5604b6126060 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b6115280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.158+0000 7fdebceeb740 1 --2- 172.21.15.52:0/524995452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6114870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- 172.21.15.52:0/524995452 >> 172.21.15.52:0/524995452 conn(0x5604b6110f60 msgr2=0x5604b6111340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- 172.21.15.52:0/524995452 shutdown_connections 2024-09-19T09:20:34.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- 172.21.15.52:0/524995452 wait complete. 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- start start 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 Processor -- start 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6120960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b6120f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604b6126b60 con 0x5604b6114e40 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604b6035f20 con 0x5604b6123c70 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604b6126ce0 con 0x5604b6116070 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.159+0000 7fdebceeb740 10 client.0 _ll_register_callbacks cb 0x5604b5fff030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52858/0 (socket says 172.21.15.52:52858) 2024-09-19T09:20:34.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 -- 172.21.15.52:0/2369391470 learned_addr learned my addr 172.21.15.52:0/2369391470 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6120960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b6120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 -- 172.21.15.52:0/2369391470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 msgr2=0x5604b6120960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6120960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 -- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 msgr2=0x5604b6120f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b6120f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 -- 172.21.15.52:0/2369391470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b5dec2b0 con 0x5604b6114e40 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdea80057c0 tx=0x7fdea80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cadc0a833db91d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fde93fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8005050 con 0x5604b6114e40 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea800e960 con 0x5604b6114e40 2024-09-19T09:20:34.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.160+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdea80051f0 con 0x5604b6114e40 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdea8043050 con 0x5604b6114e40 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 10 client.15015 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5604b6132520 con 0x5604b6114e40 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea800e960 con 0x5604b6114e40 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdea803c060 con 0x5604b6114e40 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 10 client.15015 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 10 client.15015 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 20 client.15015 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b6134780 0x5604b6135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 4 client.15015 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b6088600 con 0x5604b6134780 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.161+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b6134780 0x5604b6135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.162+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b6134780 0x5604b6135bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d963c29ce393eeb server_cookie=f1d6f714e896f546 in_seq=0 out_seq=0 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.162+0000 7fde93fff640 10 client.15015 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fde93fff640 1 -- 172.21.15.52:0/2369391470 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604b6088600 con 0x5604b6134780 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fde93fff640 10 client.15015 handle_command_reply: tid=0 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 client.15015 shutdown 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 msgr2=0x5604b6123610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdea80057c0 tx=0x7fdea80035f0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 shutdown_connections 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b6134780 0x5604b6135bf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b6120f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b6120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 --2- 172.21.15.52:0/2369391470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6123610 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 >> 172.21.15.52:0/2369391470 conn(0x5604b6110f60 msgr2=0x5604b6116c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fde93fff640 0 client.15015 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:34.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 shutdown_connections 2024-09-19T09:20:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 1 -- 172.21.15.52:0/2369391470 wait complete. 2024-09-19T09:20:34.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.163+0000 7fdebceeb740 20 client.15015 trim_cache size 0 max 16384 2024-09-19T09:20:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 Processor -- start 2024-09-19T09:20:34.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 -- start start 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b611f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b611f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604b6133f30 con 0x5604b6114e40 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604b6134600 con 0x5604b6123c70 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdebceeb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604b6134cd0 con 0x5604b6116070 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdeb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52860/0 (socket says 172.21.15.52:52860) 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.181+0000 7fdeb3fff640 1 -- 172.21.15.52:0/1731464853 learned_addr learned my addr 172.21.15.52:0/1731464853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b611f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 -- 172.21.15.52:0/1731464853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 msgr2=0x5604b611f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b611f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 -- 172.21.15.52:0/1731464853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 msgr2=0x5604b611f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b611f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 -- 172.21.15.52:0/1731464853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b6114bb0 con 0x5604b6114e40 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b540 tx=0x7fdea8005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcca2c61c72a6d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fde9a7fc640 1 -- 172.21.15.52:0/1731464853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea800e960 con 0x5604b6114e40 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fde9a7fc640 1 -- 172.21.15.52:0/1731464853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea8033040 con 0x5604b6114e40 2024-09-19T09:20:34.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fde9a7fc640 1 -- 172.21.15.52:0/1731464853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8022d50 con 0x5604b6114e40 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdebceeb740 1 -- 172.21.15.52:0/1731464853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 msgr2=0x5604b6135520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.182+0000 7fdebceeb740 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdea800b540 tx=0x7fdea8005f60 comp rx=0 tx=0).stop 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- 172.21.15.52:0/1731464853 shutdown_connections 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6123c70 0x5604b611f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6116070 0x5604b611f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- 172.21.15.52:0/1731464853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6114e40 0x5604b6135520 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- 172.21.15.52:0/1731464853 >> 172.21.15.52:0/1731464853 conn(0x5604b6110f60 msgr2=0x5604b610bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- 172.21.15.52:0/1731464853 shutdown_connections 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- 172.21.15.52:0/1731464853 wait complete. 2024-09-19T09:20:34.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- start start 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 Processor -- start 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b613e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6123c70 0x5604b612ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604b6135a70 con 0x5604b6116070 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604b61353a0 con 0x5604b6114e40 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.183+0000 7fdebceeb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604b6136140 con 0x5604b6123c70 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdebceeb740 10 client.0 _ll_register_callbacks cb 0x7fdea800bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52872/0 (socket says 172.21.15.52:52872) 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 -- 172.21.15.52:0/3607143368 learned_addr learned my addr 172.21.15.52:0/3607143368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b613e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6123c70 0x5604b612ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 -- 172.21.15.52:0/3607143368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6123c70 msgr2=0x5604b612ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6123c70 0x5604b612ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 -- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 msgr2=0x5604b613e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b613e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 -- 172.21.15.52:0/3607143368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b612f7a0 con 0x5604b6116070 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b613e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdeb88ae640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea40041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaf34bb66a49532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fde93fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4035040 con 0x5604b6116070 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdea4005040 con 0x5604b6116070 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea8033040 con 0x5604b6116070 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdea40044e0 con 0x5604b6116070 2024-09-19T09:20:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdebceeb740 10 client.15021 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.184+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5604b613c560 con 0x5604b6116070 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea8033040 con 0x5604b6116070 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdea40035f0 con 0x5604b6116070 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 10 client.15021 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 10 client.15021 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 20 client.15021 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b61a3420 0x5604b61a2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 4 client.15021 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "status"}) -- 0x5604b6082b10 con 0x5604b61a3420 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.185+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b61a3420 0x5604b61a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdeb3fff640 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b61a3420 0x5604b61a2130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41aa4bcca004d891 server_cookie=d0b80f370500f17b in_seq=0 out_seq=0 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fde93fff640 10 client.15021 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:34.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fde93fff640 1 -- 172.21.15.52:0/3607143368 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5604b6082b10 con 0x5604b61a3420 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fde93fff640 10 client.15021 handle_command_reply: tid=0 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 client.15021 shutdown 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 msgr2=0x5604b613e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea40041a0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 shutdown_connections 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604b61a3420 0x5604b61a2130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604b6123c70 0x5604b612ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604b6116070 0x5604b613e590 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 --2- 172.21.15.52:0/3607143368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604b6114e40 0x5604b613e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 >> 172.21.15.52:0/3607143368 conn(0x5604b6110f60 msgr2=0x5604b6116450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fde93fff640 0 client.15021 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 shutdown_connections 2024-09-19T09:20:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 1 -- 172.21.15.52:0/3607143368 wait complete. 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.186+0000 7fdebceeb740 20 client.15021 trim_cache size 0 max 16384 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24509, 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 75.401092661999996, 2024-09-19T09:20:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:20:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 85.907983630999993 2024-09-19T09:20:34.195 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 msgr2=0x7fde9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 0x7fde9c0a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdeac098bd0 tx=0x7fdeac0058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 msgr2=0x7fdeb419bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdeac00eaa0 tx=0x7fdeac00ef60 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 shutdown_connections 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb4106a80 0x7fdeb419bbb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde9c0a32d0 0x7fde9c0a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb4101420 0x7fdeb4197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 --2- 172.21.15.52:0/1437822697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb4100a80 0x7fdeb41972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 >> 172.21.15.52:0/1437822697 conn(0x7fdeb40fc7a0 msgr2=0x7fdeb40fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 shutdown_connections 2024-09-19T09:20:34.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:34.187+0000 7fdebab12640 1 -- 172.21.15.52:0/1437822697 wait complete. 2024-09-19T09:20:34.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:34 smithi052 ceph-mon[30947]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:20:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:34 smithi169 ceph-mon[35454]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:20:34.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:34 smithi086 ceph-mon[34813]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:20:34.876 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:20:34.876 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:20:34.886 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:20:34.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:20:35.095 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:35 smithi052 ceph-mon[30947]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T09:20:35.095 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:35 smithi052 ceph-mon[30947]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:20:35.147 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:35 smithi169 ceph-mon[35454]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T09:20:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:35 smithi169 ceph-mon[35454]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:20:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:35 smithi086 ceph-mon[34813]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-19T09:20:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:35 smithi086 ceph-mon[34813]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:20:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 -- 172.21.15.52:0/288113442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 msgr2=0x7f2ed41073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 --2- 172.21.15.52:0/288113442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed41073c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009900 tx=0x7f2ec002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 -- 172.21.15.52:0/288113442 shutdown_connections 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 --2- 172.21.15.52:0/288113442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed4107900 0x7f2ed4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 --2- 172.21.15.52:0/288113442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed41073c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 --2- 172.21.15.52:0/288113442 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed41026a0 0x7f2ed4104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 -- 172.21.15.52:0/288113442 >> 172.21.15.52:0/288113442 conn(0x7f2ed40fc2a0 msgr2=0x7f2ed40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 -- 172.21.15.52:0/288113442 shutdown_connections 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.572+0000 7f2edaaec640 1 -- 172.21.15.52:0/288113442 wait complete. 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 Processor -- start 2024-09-19T09:20:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 -- start start 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed41026a0 0x7f2ed4197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 0x7f2ed419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed410d880 con 0x7f2ed4104fd0 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed410d700 con 0x7f2ed41026a0 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2edaaec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed410da00 con 0x7f2ed4107900 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52878/0 (socket says 172.21.15.52:52878) 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 -- 172.21.15.52:0/489580904 learned_addr learned my addr 172.21.15.52:0/489580904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed8888640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed41026a0 0x7f2ed4197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed9089640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 0x7f2ed419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 -- 172.21.15.52:0/489580904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 msgr2=0x7f2ed419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 0x7f2ed419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 -- 172.21.15.52:0/489580904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed41026a0 msgr2=0x7f2ed4197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed41026a0 0x7f2ed4197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed3fff640 1 -- 172.21.15.52:0/489580904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed419fb40 con 0x7f2ed4104fd0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.573+0000 7f2ed9089640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 0x7f2ed419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2ed3fff640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0031610 tx=0x7f2ec00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec003f030 con 0x7f2ed4104fd0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec0003ce0 con 0x7f2ed4104fd0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed419fdd0 con 0x7f2ed4104fd0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0035070 con 0x7f2ed4104fd0 2024-09-19T09:20:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.574+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed41a0250 con 0x7f2ed4104fd0 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.575+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed40fdd90 con 0x7f2ed4104fd0 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.576+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2ec0042030 con 0x7f2ed4104fd0 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.577+0000 7f2ed1ffb640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 0x7f2ec40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.577+0000 7f2ed8888640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 0x7f2ec40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.577+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2ec00f0470 con 0x7f2ed4104fd0 2024-09-19T09:20:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.577+0000 7f2ed8888640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 0x7f2ec40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800abe0 tx=0x7f2ec800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.580+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ec00bcf50 con 0x7f2ed4104fd0 2024-09-19T09:20:35.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.771+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2ed4062630 con 0x7f2ec40a3300 2024-09-19T09:20:35.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.772+0000 7f2ed1ffb640 1 -- 172.21.15.52:0/489580904 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2ed4062630 con 0x7f2ec40a3300 2024-09-19T09:20:35.773 INFO:teuthology.orchestra.run.smithi052.stdout:Backend: cephadm 2024-09-19T09:20:35.773 INFO:teuthology.orchestra.run.smithi052.stdout:Available: Yes 2024-09-19T09:20:35.773 INFO:teuthology.orchestra.run.smithi052.stdout:Paused: No 2024-09-19T09:20:35.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 msgr2=0x7f2ec40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 0x7f2ec40a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800abe0 tx=0x7f2ec800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 msgr2=0x7f2ed4198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0031610 tx=0x7f2ec00043b0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 shutdown_connections 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ec40a3300 0x7f2ec40a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ed4107900 0x7f2ed419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ed4104fd0 0x7f2ed4198450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 --2- 172.21.15.52:0/489580904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ed41026a0 0x7f2ed4197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 >> 172.21.15.52:0/489580904 conn(0x7f2ed40fc2a0 msgr2=0x7f2ed4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 shutdown_connections 2024-09-19T09:20:35.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:35.775+0000 7f2edaaec640 1 -- 172.21.15.52:0/489580904 wait complete. 2024-09-19T09:20:36.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:20:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 -- 172.21.15.52:0/2927747283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 msgr2=0x7f3740109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 --2- 172.21.15.52:0/2927747283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f3740109d50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3738009ca0 tx=0x7f373802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 -- 172.21.15.52:0/2927747283 shutdown_connections 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 --2- 172.21.15.52:0/2927747283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f3740109d50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 --2- 172.21.15.52:0/2927747283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f37401073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 --2- 172.21.15.52:0/2927747283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 0x7f3740104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 -- 172.21.15.52:0/2927747283 >> 172.21.15.52:0/2927747283 conn(0x7f37400fc2a0 msgr2=0x7f37400fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 -- 172.21.15.52:0/2927747283 shutdown_connections 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 -- 172.21.15.52:0/2927747283 wait complete. 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.113+0000 7f3748143640 1 Processor -- start 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 -- start start 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 0x7f3740197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f3740198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f374010d910 con 0x7f3740107900 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f374010d790 con 0x7f37401026a0 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3748143640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f374010da90 con 0x7f3740104fd0 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52908/0 (socket says 172.21.15.52:52908) 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 -- 172.21.15.52:0/1739530821 learned_addr learned my addr 172.21.15.52:0/1739530821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f3745edf640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 0x7f3740197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37456de640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f3740198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 -- 172.21.15.52:0/1739530821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 msgr2=0x7f3740198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f3740198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 -- 172.21.15.52:0/1739530821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 msgr2=0x7f3740197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 0x7f3740197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 -- 172.21.15.52:0/1739530821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374019fb10 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37456de640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f3740198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.114+0000 7f37466e0640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37380319f0 tx=0x7f373802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.115+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3738003c70 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.115+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374019fda0 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.115+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3738003e10 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.115+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373802fd30 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.115+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37401a0250 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.116+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37400fdd90 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.117+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3738004040 con 0x7f3740107900 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.117+0000 7f3736ffd640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 0x7f372c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.118+0000 7f3745edf640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 0x7f372c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.118+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f37380f0fa0 con 0x7f3740107900 2024-09-19T09:20:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.118+0000 7f3745edf640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 0x7f372c0a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f373c005d00 tx=0x7f373c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.122+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37380bdbf0 con 0x7f3740107900 2024-09-19T09:20:37.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.305+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3740062630 con 0x7f372c0a3300 2024-09-19T09:20:37.306 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:37 smithi052 ceph-mon[30947]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T09:20:37.306 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:37 smithi052 ceph-mon[30947]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:37.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.319+0000 7f3736ffd640 1 -- 172.21.15.52:0/1739530821 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3740062630 con 0x7f372c0a3300 2024-09-19T09:20:37.319 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:20:37.319 INFO:teuthology.orchestra.run.smithi052.stdout:mds.a smithi052 running (91s) 16s ago 91s 15.8M - 19.1.1-361-g2f599a46 d2baa855c067 8827f81daa3a 2024-09-19T09:20:37.319 INFO:teuthology.orchestra.run.smithi052.stdout:mds.b smithi086 running (89s) 22s ago 88s 28.5M - 19.1.1-361-g2f599a46 d2baa855c067 858b18a02342 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.c smithi169 running (102s) 22s ago 102s 19.0M - 19.1.1-361-g2f599a46 d2baa855c067 cb88f9f5171c 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.d smithi052 running (110s) 16s ago 109s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 f959c16a4fc4 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.e smithi086 running (107s) 22s ago 107s 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 a8f5187a287a 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.f smithi169 running (105s) 22s ago 104s 21.1M - 19.1.1-361-g2f599a46 d2baa855c067 104c4616ec50 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.g smithi052 running (95s) 16s ago 94s 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 05d6e8eed157 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.h smithi086 running (100s) 22s ago 99s 17.1M - 19.1.1-361-g2f599a46 d2baa855c067 f219ed2b0b82 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.i smithi169 running (97s) 22s ago 97s 17.7M - 19.1.1-361-g2f599a46 d2baa855c067 7b958e05ae1c 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.j smithi052 running (113s) 16s ago 113s 15.4M - 19.1.1-361-g2f599a46 d2baa855c067 f7feed5b29bd 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.k smithi086 running (116s) 22s ago 116s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 dd9da82d6b20 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mds.l smithi169 running (119s) 22s ago 119s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 e596c6ed90ee 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.x smithi052 *:9283,8765 running (8m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 7dc719261761 2024-09-19T09:20:37.320 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.y smithi086 *:8443,8765 running (7m) 22s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 21312ba7e98f 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.z smithi169 *:8443,8765 running (7m) 22s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 a9a97a080289 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a smithi052 running (8m) 16s ago 8m 52.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 3b3079e1ad5d 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b smithi086 running (7m) 22s ago 7m 39.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 48be049d55c6 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c smithi169 running (7m) 22s ago 7m 41.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 0d7f735401b6 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (6m) 16s ago 6m 56.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 5b7d30b8cb9b 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi086 running (6m) 22s ago 6m 56.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4d5b807670f6 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi169 running (6m) 22s ago 6m 56.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 11b5d4434f7e 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi052 running (5m) 16s ago 5m 56.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 4ba25d54c961 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi086 running (5m) 22s ago 5m 52.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3b96b5058fe5 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi169 running (4m) 22s ago 4m 47.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c7656603d5ef 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.6 smithi052 running (4m) 16s ago 4m 51.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a8348ea1ba48 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.7 smithi086 running (3m) 22s ago 3m 49.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 90be88f526ef 2024-09-19T09:20:37.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.8 smithi169 running (3m) 22s ago 3m 54.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 27bf1e698997 2024-09-19T09:20:37.322 INFO:teuthology.orchestra.run.smithi052.stdout:osd.9 smithi052 running (3m) 16s ago 3m 50.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 8fc7a8335c1b 2024-09-19T09:20:37.322 INFO:teuthology.orchestra.run.smithi052.stdout:osd.10 smithi086 running (2m) 22s ago 2m 54.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 105dc685a83d 2024-09-19T09:20:37.322 INFO:teuthology.orchestra.run.smithi052.stdout:osd.11 smithi169 running (2m) 22s ago 2m 50.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6d0b738b98f9 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 msgr2=0x7f372c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 0x7f372c0a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f373c005d00 tx=0x7f373c00b410 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 msgr2=0x7f374019f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37380319f0 tx=0x7f373802f450 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 shutdown_connections 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3740107900 0x7f374019f4a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f372c0a3300 0x7f372c0a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3740104fd0 0x7f3740198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 --2- 172.21.15.52:0/1739530821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37401026a0 0x7f3740197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 >> 172.21.15.52:0/1739530821 conn(0x7f37400fc2a0 msgr2=0x7f3740102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 shutdown_connections 2024-09-19T09:20:37.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:37.321+0000 7f3748143640 1 -- 172.21.15.52:0/1739530821 wait complete. 2024-09-19T09:20:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:37 smithi169 ceph-mon[35454]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T09:20:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:37 smithi169 ceph-mon[35454]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:37.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:37 smithi086 ceph-mon[34813]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T09:20:37.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:37 smithi086 ceph-mon[34813]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:37.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:20:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:38.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:38 smithi052 ceph-mon[30947]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:20:38.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:38 smithi052 ceph-mon[30947]: Cluster is now healthy 2024-09-19T09:20:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:38 smithi169 ceph-mon[35454]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:20:38.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:38 smithi169 ceph-mon[35454]: Cluster is now healthy 2024-09-19T09:20:38.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:38 smithi086 ceph-mon[34813]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-19T09:20:38.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:38 smithi086 ceph-mon[34813]: Cluster is now healthy 2024-09-19T09:20:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 -- 172.21.15.52:0/3101557375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c64102e00 msgr2=0x7f7c64103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 --2- 172.21.15.52:0/3101557375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c64102e00 0x7f7c64103280 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009900 tx=0x7f7c5802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 -- 172.21.15.52:0/3101557375 shutdown_connections 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 --2- 172.21.15.52:0/3101557375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c641037c0 0x7f7c6410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 --2- 172.21.15.52:0/3101557375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c64102e00 0x7f7c64103280 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 --2- 172.21.15.52:0/3101557375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64101c00 0x7f7c64102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 -- 172.21.15.52:0/3101557375 >> 172.21.15.52:0/3101557375 conn(0x7f7c640fd390 msgr2=0x7f7c640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 -- 172.21.15.52:0/3101557375 shutdown_connections 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.663+0000 7f7c69530640 1 -- 172.21.15.52:0/3101557375 wait complete. 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 Processor -- start 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 -- start start 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 0x7f7c64197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 0x7f7c641983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410d860 con 0x7f7c641037c0 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410d6e0 con 0x7f7c64102e00 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c69530640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6410d9e0 con 0x7f7c64101c00 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60918/0 (socket says 172.21.15.52:60918) 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 -- 172.21.15.52:0/760250535 learned_addr learned my addr 172.21.15.52:0/760250535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c627fc640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 0x7f7c641983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c62ffd640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 0x7f7c64197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 -- 172.21.15.52:0/760250535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 msgr2=0x7f7c64197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 0x7f7c64197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 -- 172.21.15.52:0/760250535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 msgr2=0x7f7c641983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 0x7f7c641983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c637fe640 1 -- 172.21.15.52:0/760250535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6419fab0 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c627fc640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 0x7f7c641983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.664+0000 7f7c62ffd640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 0x7f7c64197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c637fe640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00cad0 tx=0x7f7c5c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00ae20 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6419fda0 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c005020 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00f6f0 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.665+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c641a0200 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.666+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64108fd0 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.667+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7c5c0051d0 con 0x7f7c641037c0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.668+0000 7f7c4bfff640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 0x7f7c4c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.668+0000 7f7c62ffd640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 0x7f7c4c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.668+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7c5c0cfc10 con 0x7f7c641037c0 2024-09-19T09:20:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.668+0000 7f7c62ffd640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 0x7f7c4c0a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c64102c60 tx=0x7f7c54005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.672+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c5c014030 con 0x7f7c641037c0 2024-09-19T09:20:38.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.859+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f7c64062630 con 0x7f7c4c0a3300 2024-09-19T09:20:38.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.865+0000 7f7c4bfff640 1 -- 172.21.15.52:0/760250535 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f7c64062630 con 0x7f7c4c0a3300 2024-09-19T09:20:38.866 INFO:teuthology.orchestra.run.smithi052.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:20:38.866 INFO:teuthology.orchestra.run.smithi052.stdout:mds.all 12/12 23s ago 2m smithi052=a;smithi052=d;smithi052=g;smithi052=j;smithi086=b;smithi086=e;smithi086=h;smithi086=k;smithi169=c;smithi169=f;smithi169=i;smithi169=l;count:12 2024-09-19T09:20:38.866 INFO:teuthology.orchestra.run.smithi052.stdout:mgr 3/3 23s ago 7m smithi052=x;smithi086=y;smithi169=z;count:3 2024-09-19T09:20:38.866 INFO:teuthology.orchestra.run.smithi052.stdout:mon 3/3 23s ago 7m smithi052:172.21.15.52=a;smithi086:172.21.15.86=b;smithi169:172.21.15.169=c;count:3 2024-09-19T09:20:38.866 INFO:teuthology.orchestra.run.smithi052.stdout:osd 12 23s ago - 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 msgr2=0x7f7c4c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 0x7f7c4c0a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c64102c60 tx=0x7f7c54005db0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 msgr2=0x7f7c6419f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00cad0 tx=0x7f7c5c00cf90 comp rx=0 tx=0).stop 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 shutdown_connections 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c641037c0 0x7f7c6419f440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c64102e00 0x7f7c641983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7c4c0a3300 0x7f7c4c0a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 --2- 172.21.15.52:0/760250535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c64101c00 0x7f7c64197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.867+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 >> 172.21.15.52:0/760250535 conn(0x7f7c640fd390 msgr2=0x7f7c641061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.868+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 shutdown_connections 2024-09-19T09:20:38.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:38.868+0000 7f7c69530640 1 -- 172.21.15.52:0/760250535 wait complete. 2024-09-19T09:20:39.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:39 smithi052 ceph-mon[30947]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:20:39.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:39 smithi052 ceph-mon[30947]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:39 smithi169 ceph-mon[35454]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:20:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:39 smithi169 ceph-mon[35454]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:39.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:20:39.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:39 smithi086 ceph-mon[34813]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-09-19T09:20:39.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:39 smithi086 ceph-mon[34813]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:39.724 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:40.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- 172.21.15.52:0/2065231091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948104f90 msgr2=0x7fa948107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/2065231091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948104f90 0x7fa948107380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa938009900 tx=0x7fa93802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- 172.21.15.52:0/2065231091 shutdown_connections 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/2065231091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9481078c0 0x7fa948109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/2065231091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948104f90 0x7fa948107380 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/2065231091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948102660 0x7fa948104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- 172.21.15.52:0/2065231091 >> 172.21.15.52:0/2065231091 conn(0x7fa9480fc280 msgr2=0x7fa9480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- 172.21.15.52:0/2065231091 shutdown_connections 2024-09-19T09:20:40.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- 172.21.15.52:0/2065231091 wait complete. 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 Processor -- start 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- start start 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948104f90 0x7fa94819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9481078c0 0x7fa9481a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa94810d8b0 con 0x7fa948102660 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa94810d730 con 0x7fa948104f90 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.159+0000 7fa94f9ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa94810da30 con 0x7fa9481078c0 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60940/0 (socket says 172.21.15.52:60940) 2024-09-19T09:20:40.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 -- 172.21.15.52:0/1407544587 learned_addr learned my addr 172.21.15.52:0/1407544587 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94cf8a640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948104f90 0x7fa94819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 -- 172.21.15.52:0/1407544587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9481078c0 msgr2=0x7fa9481a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9481078c0 0x7fa9481a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 -- 172.21.15.52:0/1407544587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948104f90 msgr2=0x7fa94819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948104f90 0x7fa94819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 -- 172.21.15.52:0/1407544587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9481a1d70 con 0x7fa948102660 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94d78b640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa94400e9f0 tx=0x7fa94400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400cd80 con 0x7fa948102660 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa944010910 con 0x7fa948102660 2024-09-19T09:20:40.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9481a2060 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944018990 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.160+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9481a25c0 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.161+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa948109410 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.163+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa944010ac0 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.163+0000 7fa93e7fc640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 0x7fa9340a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.163+0000 7fa94cf8a640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 0x7fa9340a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.163+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9440cfde0 con 0x7fa948102660 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.164+0000 7fa94cf8a640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 0x7fa9340a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa93802aa00 tx=0x7fa9380315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.168+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa94409c920 con 0x7fa948102660 2024-09-19T09:20:40.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.349+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa948062630 con 0x7fa9340a3380 2024-09-19T09:20:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.351+0000 7fa93e7fc640 1 -- 172.21.15.52:0/1407544587 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa948062630 con 0x7fa9340a3380 2024-09-19T09:20:40.351 INFO:teuthology.orchestra.run.smithi052.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:20:40.351 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052 172.21.15.52 2024-09-19T09:20:40.351 INFO:teuthology.orchestra.run.smithi052.stdout:smithi086 172.21.15.86 2024-09-19T09:20:40.351 INFO:teuthology.orchestra.run.smithi052.stdout:smithi169 172.21.15.169 2024-09-19T09:20:40.352 INFO:teuthology.orchestra.run.smithi052.stdout:3 hosts in cluster 2024-09-19T09:20:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 msgr2=0x7fa9340a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 0x7fa9340a5840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa93802aa00 tx=0x7fa9380315b0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 msgr2=0x7fa94819a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa94400e9f0 tx=0x7fa94400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 shutdown_connections 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9340a3380 0x7fa9340a5840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9481078c0 0x7fa9481a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa948104f90 0x7fa94819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 --2- 172.21.15.52:0/1407544587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa948102660 0x7fa94819a140 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 >> 172.21.15.52:0/1407544587 conn(0x7fa9480fc280 msgr2=0x7fa948101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 shutdown_connections 2024-09-19T09:20:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:40.353+0000 7fa94f9ef640 1 -- 172.21.15.52:0/1407544587 wait complete. 2024-09-19T09:20:40.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:40 smithi052 ceph-mon[30947]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:40.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:40 smithi169 ceph-mon[35454]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:40.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:40 smithi086 ceph-mon[34813]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:41.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:20:41.273 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:41.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:41 smithi052 ceph-mon[30947]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T09:20:41.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:41 smithi169 ceph-mon[35454]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T09:20:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:41 smithi086 ceph-mon[34813]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T09:20:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 -- 172.21.15.52:0/242689468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63501037c0 msgr2=0x7f635010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 --2- 172.21.15.52:0/242689468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63501037c0 0x7f635010a050 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6348009ca0 tx=0x7f634802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 -- 172.21.15.52:0/242689468 shutdown_connections 2024-09-19T09:20:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 --2- 172.21.15.52:0/242689468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63501037c0 0x7f635010a050 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 --2- 172.21.15.52:0/242689468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 0x7f6350103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 --2- 172.21.15.52:0/242689468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6350101c00 0x7f6350102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 -- 172.21.15.52:0/242689468 >> 172.21.15.52:0/242689468 conn(0x7f63500fd390 msgr2=0x7f63500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 -- 172.21.15.52:0/242689468 shutdown_connections 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.664+0000 7f63569a1640 1 -- 172.21.15.52:0/242689468 wait complete. 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 Processor -- start 2024-09-19T09:20:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 -- start start 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 0x7f6350198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63501037c0 0x7f635019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f635010d860 con 0x7f6350101c00 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f635010d6e0 con 0x7f63501037c0 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f63569a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f635010d9e0 con 0x7f6350102e00 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f634ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.665+0000 7f634ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60958/0 (socket says 172.21.15.52:60958) 2024-09-19T09:20:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 -- 172.21.15.52:0/1849054948 learned_addr learned my addr 172.21.15.52:0/1849054948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634f7fe640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 0x7f6350198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f6354f3e640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63501037c0 0x7f635019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 -- 172.21.15.52:0/1849054948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 msgr2=0x7f6350198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 0x7f6350198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 -- 172.21.15.52:0/1849054948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63501037c0 msgr2=0x7f635019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63501037c0 0x7f635019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 -- 172.21.15.52:0/1849054948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635019fa20 con 0x7f6350101c00 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634ffff640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f634000c970 tx=0x7f634000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340007b50 con 0x7f6350101c00 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6340007cf0 con 0x7f6350101c00 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635019fd10 con 0x7f6350101c00 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634000f870 con 0x7f6350101c00 2024-09-19T09:20:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.666+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63501a01a0 con 0x7f6350101c00 2024-09-19T09:20:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.668+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6350108e60 con 0x7f6350101c00 2024-09-19T09:20:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.669+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6340018480 con 0x7f6350101c00 2024-09-19T09:20:41.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.670+0000 7f634d7fa640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 0x7f63380a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.670+0000 7f634f7fe640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 0x7f63380a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.670+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f63400cfe60 con 0x7f6350101c00 2024-09-19T09:20:41.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.670+0000 7f634f7fe640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 0x7f63380a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6350199310 tx=0x7f634400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.674+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f634009ca30 con 0x7f6350101c00 2024-09-19T09:20:41.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.857+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6350062630 con 0x7f63380a3300 2024-09-19T09:20:41.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.859+0000 7f634d7fa640 1 -- 172.21.15.52:0/1849054948 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f6350062630 con 0x7f63380a3300 2024-09-19T09:20:41.859 INFO:teuthology.orchestra.run.smithi052.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:20:41.860 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:20:41.860 INFO:teuthology.orchestra.run.smithi052.stdout:smithi086 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UL400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:20:41.860 INFO:teuthology.orchestra.run.smithi052.stdout:smithi169 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300LN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 msgr2=0x7f63380a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 0x7f63380a57c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6350199310 tx=0x7f634400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 msgr2=0x7f6350197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f634000c970 tx=0x7f634000cd70 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 shutdown_connections 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63501037c0 0x7f635019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63380a3300 0x7f63380a57c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6350102e00 0x7f6350198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 --2- 172.21.15.52:0/1849054948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6350101c00 0x7f6350197df0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 >> 172.21.15.52:0/1849054948 conn(0x7f63500fd390 msgr2=0x7f6350106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 shutdown_connections 2024-09-19T09:20:41.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:41.861+0000 7f63569a1640 1 -- 172.21.15.52:0/1849054948 wait complete. 2024-09-19T09:20:42.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:42 smithi052 ceph-mon[30947]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:42 smithi169 ceph-mon[35454]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:42.493 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:20:42.501 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:20:42.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:20:42.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:42 smithi086 ceph-mon[34813]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:42.759 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:43.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 -- 172.21.15.52:0/3093177094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530107980 msgr2=0x7f5530109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 --2- 172.21.15.52:0/3093177094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530107980 0x7f5530109d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5528009900 tx=0x7f552802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:43.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 -- 172.21.15.52:0/3093177094 shutdown_connections 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 --2- 172.21.15.52:0/3093177094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530107980 0x7f5530109d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 --2- 172.21.15.52:0/3093177094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530105050 0x7f5530107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 --2- 172.21.15.52:0/3093177094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530102720 0x7f5530104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 -- 172.21.15.52:0/3093177094 >> 172.21.15.52:0/3093177094 conn(0x7f55300fc280 msgr2=0x7f55300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 -- 172.21.15.52:0/3093177094 shutdown_connections 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 -- 172.21.15.52:0/3093177094 wait complete. 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.280+0000 7f5536e56640 1 Processor -- start 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 -- start start 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530102720 0x7f5530197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530107980 0x7f553019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f553010d870 con 0x7f5530105050 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f553010d6f0 con 0x7f5530102720 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5536e56640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f553010d9f0 con 0x7f5530107980 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60984/0 (socket says 172.21.15.52:60984) 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 -- 172.21.15.52:0/3020453011 learned_addr learned my addr 172.21.15.52:0/3020453011 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f5534bf2640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530102720 0x7f5530197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f55353f3640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530107980 0x7f553019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 -- 172.21.15.52:0/3020453011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530107980 msgr2=0x7f553019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530107980 0x7f553019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 -- 172.21.15.52:0/3020453011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530102720 msgr2=0x7f5530197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530102720 0x7f5530197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 -- 172.21.15.52:0/3020453011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553019fa70 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.281+0000 7f552ffff640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f551800c970 tx=0x7f551800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.282+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518007bb0 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.282+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5518007d50 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.282+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553019fd60 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.282+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551800f450 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.282+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55301a0240 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.283+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55300fdd70 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.284+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f55180046c0 con 0x7f5530105050 2024-09-19T09:20:43.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.285+0000 7f552dffb640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 0x7f551c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.285+0000 7f5534bf2640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 0x7f551c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.285+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f55180cf7d0 con 0x7f5530105050 2024-09-19T09:20:43.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.285+0000 7f5534bf2640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 0x7f551c0a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5520007ec0 tx=0x7f55200075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.289+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5518014030 con 0x7f5530105050 2024-09-19T09:20:43.427 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:43 smithi086 ceph-mon[34813]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:20:43.427 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:43 smithi086 ceph-mon[34813]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:43.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:43 smithi052 ceph-mon[30947]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:20:43.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:43 smithi052 ceph-mon[30947]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:43 smithi169 ceph-mon[35454]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:20:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:43 smithi169 ceph-mon[35454]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:20:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.501+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f553002d9c0 con 0x7f5530105050 2024-09-19T09:20:43.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.501+0000 7f552dffb640 1 -- 172.21.15.52:0/3020453011 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3080 (secure 0 0 0) 0x7f551809c310 con 0x7f5530105050 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:e23 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-19T09:19:29:827958+0000 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:43.503 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 23 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-19T09:19:18.374880+0000 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-19T09:19:29.358326+0000 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 300 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-19T09:20:43.504 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 0 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 3 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1,2 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=24509,1=24482,2=24466} 2024-09-19T09:20:43.505 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data disabled 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 0 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 24509 members: 24509,24482,24466 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b{0:24509} state up:active seq 4 addr [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.e{0:24461} state up:standby-replay seq 1 addr [v2:172.21.15.86:6834/4246812720,v1:172.21.15.86:6835/4246812720] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.506 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.h{1:24482} state up:active seq 9 addr [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c{1:24448} state up:standby-replay seq 1 addr [v2:172.21.15.169:6836/1790018144,v1:172.21.15.169:6837/1790018144] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.i{2:24466} state up:active seq 8 addr [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.f{2:24442} state up:standby-replay seq 1 addr [v2:172.21.15.169:6834/144132383,v1:172.21.15.169:6835/144132383] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.j{-1:14550} state up:standby seq 1 addr [v2:172.21.15.52:6834/2692323672,v1:172.21.15.52:6835/2692323672] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.d{-1:14562} state up:standby seq 1 addr [v2:172.21.15.52:6836/2830628688,v1:172.21.15.52:6837/2830628688] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.g{-1:14613} state up:standby seq 1 addr [v2:172.21.15.52:6838/362105670,v1:172.21.15.52:6839/362105670] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a{-1:14625} state up:standby seq 1 addr [v2:172.21.15.52:6840/3428587988,v1:172.21.15.52:6841/3428587988] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.l{-1:24412} state up:standby seq 1 addr [v2:172.21.15.169:6832/3295968296,v1:172.21.15.169:6833/3295968296] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.507 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.k{-1:24425} state up:standby seq 1 addr [v2:172.21.15.86:6832/700754353,v1:172.21.15.86:6833/700754353] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:20:43.508 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:43.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 msgr2=0x7f551c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 0x7f551c0a57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5520007ec0 tx=0x7f55200075b0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 msgr2=0x7f5530198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f551800c970 tx=0x7f551800ce30 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 shutdown_connections 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f551c0a3300 0x7f551c0a57c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5530107980 0x7f553019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5530105050 0x7f5530198380 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 --2- 172.21.15.52:0/3020453011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5530102720 0x7f5530197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 >> 172.21.15.52:0/3020453011 conn(0x7f55300fc280 msgr2=0x7f5530102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 shutdown_connections 2024-09-19T09:20:43.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:43.505+0000 7f5536e56640 1 -- 172.21.15.52:0/3020453011 wait complete. 2024-09-19T09:20:44.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:20:44.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:44 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3020453011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:20:44.442 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:44.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:44 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3020453011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:20:44.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:44 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3020453011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 -- 172.21.15.52:0/3938947811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14101d10 msgr2=0x7f9c14102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 --2- 172.21.15.52:0/3938947811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14101d10 0x7f9c14102190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009900 tx=0x7f9c0802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 -- 172.21.15.52:0/3938947811 shutdown_connections 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 --2- 172.21.15.52:0/3938947811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c141026d0 0x7f9c14108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 --2- 172.21.15.52:0/3938947811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14101d10 0x7f9c14102190 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 --2- 172.21.15.52:0/3938947811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c14100b10 0x7f9c14100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 -- 172.21.15.52:0/3938947811 >> 172.21.15.52:0/3938947811 conn(0x7f9c140fc2a0 msgr2=0x7f9c140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:44.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 -- 172.21.15.52:0/3938947811 shutdown_connections 2024-09-19T09:20:44.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.889+0000 7f9c19538640 1 -- 172.21.15.52:0/3938947811 wait complete. 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 Processor -- start 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 -- start start 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c14101d10 0x7f9c1419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c141026d0 0x7f9c1419f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1410c810 con 0x7f9c14100b10 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1410c690 con 0x7f9c14101d10 2024-09-19T09:20:44.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c19538640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1410c990 con 0x7f9c141026d0 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c12ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c12ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32776/0 (socket says 172.21.15.52:32776) 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c12ffd640 1 -- 172.21.15.52:0/3378549870 learned_addr learned my addr 172.21.15.52:0/3378549870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.890+0000 7f9c127fc640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c14101d10 0x7f9c1419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c137fe640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c141026d0 0x7f9c1419f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 -- 172.21.15.52:0/3378549870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c141026d0 msgr2=0x7f9c1419f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c141026d0 0x7f9c1419f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 -- 172.21.15.52:0/3378549870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c14101d10 msgr2=0x7f9c1419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c14101d10 0x7f9c1419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 -- 172.21.15.52:0/3378549870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1419fc50 con 0x7f9c14100b10 2024-09-19T09:20:44.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c12ffd640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400b450 tx=0x7f9c0400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04015020 con 0x7f9c14100b10 2024-09-19T09:20:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1419fee0 con 0x7f9c14100b10 2024-09-19T09:20:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c04011d70 con 0x7f9c14100b10 2024-09-19T09:20:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.891+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c141a03c0 con 0x7f9c14100b10 2024-09-19T09:20:44.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.892+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400f340 con 0x7f9c14100b10 2024-09-19T09:20:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.893+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c000052c0 con 0x7f9c14100b10 2024-09-19T09:20:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.894+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9c04018020 con 0x7f9c14100b10 2024-09-19T09:20:44.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.894+0000 7f9bfbfff640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 0x7f9bfc0a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:44.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.895+0000 7f9c127fc640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 0x7f9bfc0a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:44.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.895+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9c040cf2f0 con 0x7f9c14100b10 2024-09-19T09:20:44.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.895+0000 7f9c127fc640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 0x7f9bfc0a56f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c080314e0 tx=0x7f9c08000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:44.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:44.899+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c0401f020 con 0x7f9c14100b10 2024-09-19T09:20:45.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.078+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9c00005880 con 0x7f9c14100b10 2024-09-19T09:20:45.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.079+0000 7f9bfbfff640 1 -- 172.21.15.52:0/3378549870 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5403 (secure 0 0 0) 0x7f9c0400d040 con 0x7f9c14100b10 2024-09-19T09:20:45.079 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 81 2024-09-19T09:20:45.079 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-19T09:11:37.433695+0000 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-19T09:20:33.079991+0000 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:crush_version 26 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:full_ratio 0.95 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:backfillfull_ratio 0.9 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:nearfull_ratio 0.85 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:require_min_compat_client luminous 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:min_compat_client luminous 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:require_osd_release squid 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:stretch_mode_enabled false 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:20:45.080 INFO:teuthology.orchestra.run.smithi052.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:max_osd 12 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6802/1361807976,v1:172.21.15.52:6803/1361807976] [v2:172.21.15.52:6804/1361807976,v1:172.21.15.52:6805/1361807976] exists,up ffb4240a-2009-4628-bcd3-1c228b520686 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 up in weight 1 up_from 12 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6800/740812264,v1:172.21.15.86:6801/740812264] [v2:172.21.15.86:6802/740812264,v1:172.21.15.86:6803/740812264] exists,up a590cdeb-d3d8-4648-8b73-60f4c8a49f67 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 up in weight 1 up_from 16 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6800/2551130038,v1:172.21.15.169:6801/2551130038] [v2:172.21.15.169:6802/2551130038,v1:172.21.15.169:6803/2551130038] exists,up 46efd319-b3bd-4ac6-b9e8-9655c2327275 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 up in weight 1 up_from 22 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6810/3702275878,v1:172.21.15.52:6811/3702275878] [v2:172.21.15.52:6812/3702275878,v1:172.21.15.52:6813/3702275878] exists,up 9318aae9-50c2-4e6b-bbbb-2345588faaab 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 up in weight 1 up_from 29 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6808/1147748892,v1:172.21.15.86:6809/1147748892] [v2:172.21.15.86:6810/1147748892,v1:172.21.15.86:6811/1147748892] exists,up 76a0dea0-afb1-4fb8-8659-1b4dd0622faa 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 up in weight 1 up_from 33 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6808/1256666547,v1:172.21.15.169:6809/1256666547] [v2:172.21.15.169:6810/1256666547,v1:172.21.15.169:6811/1256666547] exists,up 591fa0a5-b621-4110-a02f-72e3532df5ed 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.6 up in weight 1 up_from 40 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6818/517383530,v1:172.21.15.52:6819/517383530] [v2:172.21.15.52:6820/517383530,v1:172.21.15.52:6821/517383530] exists,up 2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.7 up in weight 1 up_from 44 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6816/2917689244,v1:172.21.15.86:6817/2917689244] [v2:172.21.15.86:6818/2917689244,v1:172.21.15.86:6819/2917689244] exists,up e13e68f3-9922-4795-a513-b311f5bf755f 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.8 up in weight 1 up_from 52 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6816/1059670873,v1:172.21.15.169:6817/1059670873] [v2:172.21.15.169:6818/1059670873,v1:172.21.15.169:6819/1059670873] exists,up 117090d0-d86d-49de-ba8e-5b3bacea18ce 2024-09-19T09:20:45.081 INFO:teuthology.orchestra.run.smithi052.stdout:osd.9 up in weight 1 up_from 59 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6826/2842026931,v1:172.21.15.52:6827/2842026931] [v2:172.21.15.52:6828/2842026931,v1:172.21.15.52:6829/2842026931] exists,up 03810cd0-6516-45f0-9945-be3a82e57bee 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:osd.10 up in weight 1 up_from 63 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.86:6824/3726855330,v1:172.21.15.86:6825/3726855330] [v2:172.21.15.86:6826/3726855330,v1:172.21.15.86:6827/3726855330] exists,up 00f8d84c-9ca3-4e10-a2a6-8bde20432f13 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:osd.11 up in weight 1 up_from 71 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.169:6824/3787808833,v1:172.21.15.169:6825/3787808833] [v2:172.21.15.169:6826/3787808833,v1:172.21.15.169:6827/3787808833] exists,up d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 2.6 [8,11] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 2.1a [8,4] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 2.1d [2,1] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.6 [4,6] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.12 [3,9] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.13 [4,9] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.19 [3,7] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.1b [4,7] 2024-09-19T09:20:45.082 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.1d [1,2,5,9] 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.28 [5,8] 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.31 [4,6] 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:pg_upmap_items 3.39 [5,8] 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/3212727743 expires 2024-09-20T09:12:31.197675+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:6800/561717915 expires 2024-09-20T09:12:31.197675+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/378801178 expires 2024-09-20T09:12:31.197675+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:6801/3194006990 expires 2024-09-20T09:12:07.900133+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:6800/3194006990 expires 2024-09-20T09:12:07.900133+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/2992795514 expires 2024-09-20T09:12:07.900133+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/266113391 expires 2024-09-20T09:12:07.900133+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/198451359 expires 2024-09-20T09:12:31.197675+0000 2024-09-19T09:20:45.083 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:6801/561717915 expires 2024-09-20T09:12:31.197675+0000 2024-09-19T09:20:45.084 INFO:teuthology.orchestra.run.smithi052.stdout:blocklist 172.21.15.52:0/1008400409 expires 2024-09-20T09:12:07.900133+0000 2024-09-19T09:20:45.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 msgr2=0x7f9bfc0a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 0x7f9bfc0a56f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c080314e0 tx=0x7f9c08000bc0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 msgr2=0x7f9c1406b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400b450 tx=0x7f9c0400b910 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 shutdown_connections 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9bfc0a3230 0x7f9bfc0a56f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c141026d0 0x7f9c1419f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c14101d10 0x7f9c1419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 --2- 172.21.15.52:0/3378549870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c14100b10 0x7f9c1406b2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 >> 172.21.15.52:0/3378549870 conn(0x7f9c140fc2a0 msgr2=0x7f9c14105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 shutdown_connections 2024-09-19T09:20:45.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:45.081+0000 7f9c19538640 1 -- 172.21.15.52:0/3378549870 wait complete. 2024-09-19T09:20:45.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:45 smithi052 ceph-mon[30947]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:45.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:45 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3378549870' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:20:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:45 smithi169 ceph-mon[35454]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:45 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3378549870' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:20:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:45 smithi086 ceph-mon[34813]: pgmap v317: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:45 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3378549870' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:20:45.763 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:20:45.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:46.040 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:46.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 -- 172.21.15.52:0/3396948716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c103660 msgr2=0x7fd35c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 --2- 172.21.15.52:0/3396948716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c103660 0x7fd35c10bb50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd358009900 tx=0x7fd35802a480 comp rx=0 tx=0).stop 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 -- 172.21.15.52:0/3396948716 shutdown_connections 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 --2- 172.21.15.52:0/3396948716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c10c170 0x7fd35c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 --2- 172.21.15.52:0/3396948716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c103660 0x7fd35c10bb50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 --2- 172.21.15.52:0/3396948716 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c102d40 0x7fd35c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 -- 172.21.15.52:0/3396948716 >> 172.21.15.52:0/3396948716 conn(0x7fd35c0fc7a0 msgr2=0x7fd35c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 -- 172.21.15.52:0/3396948716 shutdown_connections 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.516+0000 7fd363eb6640 1 -- 172.21.15.52:0/3396948716 wait complete. 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 Processor -- start 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 -- start start 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 0x7fd35c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:46.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c103660 0x7fd35c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c111fb0 con 0x7fd35c10c170 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c111e30 con 0x7fd35c102d40 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd363eb6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd35c112130 con 0x7fd35c103660 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32802/0 (socket says 172.21.15.52:32802) 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 -- 172.21.15.52:0/1700801684 learned_addr learned my addr 172.21.15.52:0/1700801684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd361451640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c103660 0x7fd35c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd361c52640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 0x7fd35c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 -- 172.21.15.52:0/1700801684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c103660 msgr2=0x7fd35c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c103660 0x7fd35c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 -- 172.21.15.52:0/1700801684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 msgr2=0x7fd35c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:46.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 0x7fd35c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 -- 172.21.15.52:0/1700801684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35c19f660 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd361c52640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 0x7fd35c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.517+0000 7fd362453640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd354009fd0 tx=0x7fd35400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.518+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd354011830 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.518+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd354016070 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.518+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35c19f950 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.518+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35400f2e0 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.518+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35c1a7230 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.519+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd35c103120 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.521+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd3540119d0 con 0x7fd35c10c170 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.521+0000 7fd34effd640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 0x7fd3480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.521+0000 7fd361c52640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 0x7fd3480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:46.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.521+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd3540cf750 con 0x7fd35c10c170 2024-09-19T09:20:46.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.522+0000 7fd361c52640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 0x7fd3480a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd350005fd0 tx=0x7fd350009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:46.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.524+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd35409c3a0 con 0x7fd35c10c170 2024-09-19T09:20:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.735+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd35c1a74d0 con 0x7fd35c10c170 2024-09-19T09:20:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.736+0000 7fd34effd640 1 -- 172.21.15.52:0/1700801684 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7fd35409bca0 con 0x7fd35c10c170 2024-09-19T09:20:46.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:46.737 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:20:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.738+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 msgr2=0x7fd3480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.738+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 0x7fd3480a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd350005fd0 tx=0x7fd350009520 comp rx=0 tx=0).stop 2024-09-19T09:20:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.738+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 msgr2=0x7fd35c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.738+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd354009fd0 tx=0x7fd35400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 shutdown_connections 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd35c10c170 0x7fd35c19ef80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd3480a32d0 0x7fd3480a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd35c103660 0x7fd35c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 --2- 172.21.15.52:0/1700801684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd35c102d40 0x7fd35c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 >> 172.21.15.52:0/1700801684 conn(0x7fd35c0fc7a0 msgr2=0x7fd35c0fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 shutdown_connections 2024-09-19T09:20:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:46.739+0000 7fd363eb6640 1 -- 172.21.15.52:0/1700801684 wait complete. 2024-09-19T09:20:47.369 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:47 smithi052 ceph-mon[30947]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:47.369 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1700801684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:47.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:47 smithi169 ceph-mon[35454]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1700801684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:47 smithi086 ceph-mon[34813]: pgmap v318: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1700801684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:47.665 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:48.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 -- 172.21.15.52:0/1825025820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860106a80 msgr2=0x7f7860106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 --2- 172.21.15.52:0/1825025820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860106a80 0x7f7860106e60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7850009cd0 tx=0x7f785002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 -- 172.21.15.52:0/1825025820 shutdown_connections 2024-09-19T09:20:48.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 --2- 172.21.15.52:0/1825025820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860101420 0x7f786010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 --2- 172.21.15.52:0/1825025820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860100a80 0x7f7860100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 --2- 172.21.15.52:0/1825025820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860106a80 0x7f7860106e60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 -- 172.21.15.52:0/1825025820 >> 172.21.15.52:0/1825025820 conn(0x7f78600fc7a0 msgr2=0x7f78600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 -- 172.21.15.52:0/1825025820 shutdown_connections 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 -- 172.21.15.52:0/1825025820 wait complete. 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.070+0000 7f786851a640 1 Processor -- start 2024-09-19T09:20:48.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 -- start start 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 0x7f78600fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 0x7f78600fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7860110e40 con 0x7f7860100a80 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7860110cc0 con 0x7f7860106a80 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f786851a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7860110fc0 con 0x7f7860101420 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37756/0 (socket says 172.21.15.52:37756) 2024-09-19T09:20:48.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 -- 172.21.15.52:0/433196381 learned_addr learned my addr 172.21.15.52:0/433196381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f7866ab7640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 0x7f78600fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f7865ab5640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 0x7f78600fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 -- 172.21.15.52:0/433196381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 msgr2=0x7f78600fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 0x7f78600fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 -- 172.21.15.52:0/433196381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 msgr2=0x7f78600fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 0x7f78600fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 -- 172.21.15.52:0/433196381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78601a6900 con 0x7f7860100a80 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f7866ab7640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 0x7f78600fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f7865ab5640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 0x7f78600fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:48.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.071+0000 7f78662b6640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7850005e30 tx=0x7f7850032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.072+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850004040 con 0x7f7860100a80 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.072+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78500046c0 con 0x7f7860100a80 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.072+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850046480 con 0x7f7860100a80 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.072+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78601a6b90 con 0x7f7860100a80 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.072+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78601a7120 con 0x7f7860100a80 2024-09-19T09:20:48.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.073+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7860100ee0 con 0x7f7860100a80 2024-09-19T09:20:48.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.074+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f78500305a0 con 0x7f7860100a80 2024-09-19T09:20:48.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.075+0000 7f785f7fe640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 0x7f78480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.075+0000 7f7865ab5640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 0x7f78480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.075+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f785002e030 con 0x7f7860100a80 2024-09-19T09:20:48.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.075+0000 7f7865ab5640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 0x7f78480a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78600fe8c0 tx=0x7f7854005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.078+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f785004b060 con 0x7f7860100a80 2024-09-19T09:20:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.291+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78600fe360 con 0x7f7860100a80 2024-09-19T09:20:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.292+0000 7f785f7fe640 1 -- 172.21.15.52:0/433196381 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11902 (secure 0 0 0) 0x7f78500bdf20 con 0x7f7860100a80 2024-09-19T09:20:48.293 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:48.293 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-19T09:19:29:827958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:19:29.358326+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24509,24482,24466]},"id":1}]} 2024-09-19T09:20:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 msgr2=0x7f78480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 0x7f78480a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78600fe8c0 tx=0x7f7854005d30 comp rx=0 tx=0).stop 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 msgr2=0x7f78600fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7850005e30 tx=0x7f7850032fb0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 shutdown_connections 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7860106a80 0x7f78600fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78480a3350 0x7f78480a5810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7860101420 0x7f78600fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 --2- 172.21.15.52:0/433196381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7860100a80 0x7f78600fce30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.294+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 >> 172.21.15.52:0/433196381 conn(0x7f78600fc7a0 msgr2=0x7f786006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.295+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 shutdown_connections 2024-09-19T09:20:48.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:48.295+0000 7f786851a640 1 -- 172.21.15.52:0/433196381 wait complete. 2024-09-19T09:20:48.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:20:49.243 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:49 smithi052 ceph-mon[30947]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:49 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/433196381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:49 smithi169 ceph-mon[35454]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:49 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/433196381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:49 smithi086 ceph-mon[34813]: pgmap v319: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:49 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/433196381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/2941229307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8102d40 msgr2=0x7f1dc8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/2941229307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8102d40 0x7f1dc8103120 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009900 tx=0x7f1db802a480 comp rx=0 tx=0).stop 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/2941229307 shutdown_connections 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/2941229307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc810c170 0x7f1dc810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/2941229307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc8103660 0x7f1dc810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/2941229307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8102d40 0x7f1dc8103120 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/2941229307 >> 172.21.15.52:0/2941229307 conn(0x7f1dc80fc7a0 msgr2=0x7f1dc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/2941229307 shutdown_connections 2024-09-19T09:20:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.746+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/2941229307 wait complete. 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 Processor -- start 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 -- start start 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc8102d40 0x7f1dc81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc810c170 0x7f1dc8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8111fc0 con 0x7f1dc8103660 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8111e40 con 0x7f1dc8102d40 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dcdfa2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8112140 con 0x7f1dc810c170 2024-09-19T09:20:49.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dc6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dc6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37782/0 (socket says 172.21.15.52:37782) 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dc6ffd640 1 -- 172.21.15.52:0/1356302068 learned_addr learned my addr 172.21.15.52:0/1356302068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dc77fe640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc8102d40 0x7f1dc81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.747+0000 7f1dc7fff640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc810c170 0x7f1dc8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 -- 172.21.15.52:0/1356302068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc810c170 msgr2=0x7f1dc8101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc810c170 0x7f1dc8101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 -- 172.21.15.52:0/1356302068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc8102d40 msgr2=0x7f1dc81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc8102d40 0x7f1dc81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 -- 172.21.15.52:0/1356302068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc81a68c0 con 0x7f1dc8103660 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc6ffd640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c970 tx=0x7f1dbc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc007bb0 con 0x7f1dc8103660 2024-09-19T09:20:49.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc81a6bb0 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dbc007d50 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc018820 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.748+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc81a7140 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.749+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc8103120 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.750+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1dbc0189c0 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.751+0000 7f1dc4ff9640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 0x7f1db00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.751+0000 7f1dc77fe640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 0x7f1db00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.751+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1dbc0cfb60 con 0x7f1dc8103660 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.751+0000 7f1dc77fe640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 0x7f1db00a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1db8000c00 tx=0x7f1db8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.755+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1dbc014030 con 0x7f1dc8103660 2024-09-19T09:20:49.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.932+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dc8106c50 con 0x7f1dc8103660 2024-09-19T09:20:49.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.934+0000 7f1dc4ff9640 1 -- 172.21.15.52:0/1356302068 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7f1dbc09c640 con 0x7f1dc8103660 2024-09-19T09:20:49.935 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:20:49.935 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:49.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 msgr2=0x7f1db00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 0x7f1db00a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1db8000c00 tx=0x7f1db8005b50 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 msgr2=0x7f1dc8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c970 tx=0x7f1dbc00ce30 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 shutdown_connections 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1db00a32d0 0x7f1db00a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dc810c170 0x7f1dc8101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dc8103660 0x7f1dc8100ee0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 --2- 172.21.15.52:0/1356302068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dc8102d40 0x7f1dc81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 >> 172.21.15.52:0/1356302068 conn(0x7f1dc80fc7a0 msgr2=0x7f1dc80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 shutdown_connections 2024-09-19T09:20:49.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:49.936+0000 7f1dcdfa2640 1 -- 172.21.15.52:0/1356302068 wait complete. 2024-09-19T09:20:50.304 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:50 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1356302068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:50.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:50 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1356302068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:50.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:50 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1356302068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:20:50.644 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:19:18.374880+0000', 'modified': '2024-09-19T09:19:29.358326+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24482, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/144132383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 144132383}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 144132383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/1790018144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 1790018144}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 1790018144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6835/4246812720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 4246812720}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 4246812720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.169:6839/3841296575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3841296575}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3841296575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.86:6837/546883569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 546883569}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 546883569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.86:6839/1882596213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 1882596213}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 1882596213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24509, 24482, 24466]} 2024-09-19T09:20:50.644 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:20:50.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:20:50.902 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:51.309 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:51 smithi052 ceph-mon[30947]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 -- 172.21.15.52:0/4021666663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270102790 msgr2=0x7fb2701067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 --2- 172.21.15.52:0/4021666663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270102790 0x7fb2701067e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb258009900 tx=0x7fb25802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 -- 172.21.15.52:0/4021666663 shutdown_connections 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 --2- 172.21.15.52:0/4021666663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270106f10 0x7fb27010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 --2- 172.21.15.52:0/4021666663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270102790 0x7fb2701067e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 --2- 172.21.15.52:0/4021666663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270101de0 0x7fb2701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 -- 172.21.15.52:0/4021666663 >> 172.21.15.52:0/4021666663 conn(0x7fb2700fd8c0 msgr2=0x7fb2700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 -- 172.21.15.52:0/4021666663 shutdown_connections 2024-09-19T09:20:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.392+0000 7fb2758a5640 1 -- 172.21.15.52:0/4021666663 wait complete. 2024-09-19T09:20:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 Processor -- start 2024-09-19T09:20:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 -- start start 2024-09-19T09:20:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101de0 0x7fb2700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 0x7fb270074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb270111f90 con 0x7fb270106f10 2024-09-19T09:20:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb270111e10 con 0x7fb270101de0 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2758a5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb270112110 con 0x7fb270102790 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37788/0 (socket says 172.21.15.52:37788) 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb26f7fe640 1 -- 172.21.15.52:0/1314896809 learned_addr learned my addr 172.21.15.52:0/1314896809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb26effd640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101de0 0x7fb2700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.393+0000 7fb2667fc640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 0x7fb270074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 -- 172.21.15.52:0/1314896809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 msgr2=0x7fb270074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 0x7fb270074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 -- 172.21.15.52:0/1314896809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101de0 msgr2=0x7fb2700744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101de0 0x7fb2700744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 -- 172.21.15.52:0/1314896809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2701a6950 con 0x7fb270106f10 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2667fc640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 0x7fb270074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb26f7fe640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb26800eaa0 tx=0x7fb26800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2748a3640 1 -- 172.21.15.52:0/1314896809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268004d20 con 0x7fb270106f10 2024-09-19T09:20:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2748a3640 1 -- 172.21.15.52:0/1314896809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268005020 con 0x7fb270106f10 2024-09-19T09:20:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2701a6c40 con 0x7fb270106f10 2024-09-19T09:20:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2748a3640 1 -- 172.21.15.52:0/1314896809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680116d0 con 0x7fb270106f10 2024-09-19T09:20:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.394+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2701a7130 con 0x7fb270106f10 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.396+0000 7fb2748a3640 1 -- 172.21.15.52:0/1314896809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb2680051d0 con 0x7fb270106f10 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 Processor -- start 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 -- start start 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d68db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d73670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f11ccf090 con 0x559f11d73bb0 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f11c76a70 con 0x559f11d692f0 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb277c7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f11ccb050 con 0x559f11d689d0 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb2667fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb2667fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37796/0 (socket says 172.21.15.52:37796) 2024-09-19T09:20:51.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb2667fc640 1 -- 172.21.15.52:0/3562117190 learned_addr learned my addr 172.21.15.52:0/3562117190 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb26effd640 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d73670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb2748a3640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 0x7fb25c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.397+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d68db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 -- 172.21.15.52:0/3562117190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 msgr2=0x559f11d68db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d68db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 -- 172.21.15.52:0/3562117190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 msgr2=0x559f11d73670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d73670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb26f7fe640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 0x7fb25c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 -- 172.21.15.52:0/3562117190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f11c83130 con 0x559f11d73bb0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2748a3640 1 -- 172.21.15.52:0/1314896809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2680cfdf0 con 0x7fb270106f10 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb258032fb0 tx=0x7fb258000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c140704beb31d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb265ffb640 1 -- 172.21.15.52:0/3562117190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258035040 con 0x559f11d73bb0 2024-09-19T09:20:51.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb26f7fe640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 0x7fb25c0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb268009270 tx=0x7fb26804b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb265ffb640 1 -- 172.21.15.52:0/3562117190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb258045070 con 0x559f11d73bb0 2024-09-19T09:20:51.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.398+0000 7fb265ffb640 1 -- 172.21.15.52:0/3562117190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258003bc0 con 0x559f11d73bb0 2024-09-19T09:20:51.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- 172.21.15.52:0/3562117190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 msgr2=0x559f11d75fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb258032fb0 tx=0x7fb258000bc0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- 172.21.15.52:0/3562117190 shutdown_connections 2024-09-19T09:20:51.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d75fa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d73670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3562117190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d68db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- 172.21.15.52:0/3562117190 >> 172.21.15.52:0/3562117190 conn(0x559f11d64f60 msgr2=0x559f11d65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- 172.21.15.52:0/3562117190 shutdown_connections 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- 172.21.15.52:0/3562117190 wait complete. 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 -- start start 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.399+0000 7fb277c7e740 1 Processor -- start 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d70740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f11d76780 con 0x559f11d73bb0 2024-09-19T09:20:51.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f11c89f20 con 0x559f11d692f0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f11d76900 con 0x559f11d689d0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb277c7e740 10 client.0 _ll_register_callbacks cb 0x559f11c53030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37812/0 (socket says 172.21.15.52:37812) 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 -- 172.21.15.52:0/3821662820 learned_addr learned my addr 172.21.15.52:0/3821662820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb26effd640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d70740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 -- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 msgr2=0x559f11d733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 -- 172.21.15.52:0/3821662820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 msgr2=0x559f11d70740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d70740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 -- 172.21.15.52:0/3821662820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f11a402b0 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb26effd640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d70740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb2667fc640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb258006010 tx=0x7fb258003880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47067de3da4d1db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.400+0000 7fb24effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25804c850 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb25804c9f0 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb258045070 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb25804cbf0 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 10 client.15093 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559f11d82070 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb258045070 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb25803a050 con 0x559f11d73bb0 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 10 client.15093 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 20 client.15093 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11d833c0 0x559f11d854e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 4 client.15093 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.401+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f11cdc600 con 0x559f11d833c0 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.402+0000 7fb26effd640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11d833c0 0x559f11d854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.402+0000 7fb26effd640 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11d833c0 0x559f11d854e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bcb48e78f12ee2c server_cookie=28ecf953981679ea in_seq=0 out_seq=0 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.402+0000 7fb24effd640 10 client.15093 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb24effd640 1 -- 172.21.15.52:0/3821662820 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f11cdc600 con 0x559f11d833c0 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb24effd640 10 client.15093 handle_command_reply: tid=0 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 client.15093 shutdown 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 msgr2=0x559f11d70c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb258006010 tx=0x7fb258003880 comp rx=0 tx=0).stop 2024-09-19T09:20:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 shutdown_connections 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11d833c0 0x559f11d854e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d73bb0 0x559f11d70c80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d692f0 0x559f11d70740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 --2- 172.21.15.52:0/3821662820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb24effd640 0 client.15093 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 >> 172.21.15.52:0/3821662820 conn(0x559f11d64f60 msgr2=0x559f11d6ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 shutdown_connections 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 1 -- 172.21.15.52:0/3821662820 wait complete. 2024-09-19T09:20:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.403+0000 7fb277c7e740 20 client.15093 trim_cache size 0 max 16384 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 Processor -- start 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 -- start start 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f11d83820 con 0x559f11d692f0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f11d83ef0 con 0x559f11d73bb0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb277c7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f11d845c0 con 0x559f11d689d0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37828/0 (socket says 172.21.15.52:37828) 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.421+0000 7fb26effd640 1 -- 172.21.15.52:0/1870084711 learned_addr learned my addr 172.21.15.52:0/1870084711 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2667fc640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2667fc640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 -- 172.21.15.52:0/1870084711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 msgr2=0x559f11d84070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d84070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 -- 172.21.15.52:0/1870084711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 msgr2=0x559f11d839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 -- 172.21.15.52:0/1870084711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f11d73010 con 0x559f11d692f0 2024-09-19T09:20:51.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2667fc640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb26effd640 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb260009bc0 tx=0x7fb260008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67a2fc725c75c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2657fa640 1 -- 172.21.15.52:0/1870084711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260021070 con 0x559f11d692f0 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2657fa640 1 -- 172.21.15.52:0/1870084711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb260009d50 con 0x559f11d692f0 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.422+0000 7fb2657fa640 1 -- 172.21.15.52:0/1870084711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb260015600 con 0x559f11d692f0 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- 172.21.15.52:0/1870084711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 msgr2=0x559f11d84e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb260009bc0 tx=0x7fb260008040 comp rx=0 tx=0).stop 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- 172.21.15.52:0/1870084711 shutdown_connections 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d84e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 --2- 172.21.15.52:0/1870084711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d84070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- 172.21.15.52:0/1870084711 >> 172.21.15.52:0/1870084711 conn(0x559f11d64f60 msgr2=0x559f11d65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- 172.21.15.52:0/1870084711 shutdown_connections 2024-09-19T09:20:51.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- 172.21.15.52:0/1870084711 wait complete. 2024-09-19T09:20:51.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 -- start start 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.423+0000 7fb277c7e740 1 Processor -- start 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f11d85360 con 0x559f11d692f0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f11d84c90 con 0x559f11d73bb0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f11d85a30 con 0x559f11d689d0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb277c7e740 10 client.0 _ll_register_callbacks cb 0x7fb2600093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37832/0 (socket says 172.21.15.52:37832) 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 -- 172.21.15.52:0/639785513 learned_addr learned my addr 172.21.15.52:0/639785513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb2667fc640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb2667fc640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 -- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 msgr2=0x559f11d8ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d8ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 -- 172.21.15.52:0/639785513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 msgr2=0x559f11d87660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d87660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 -- 172.21.15.52:0/639785513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f11d87dd0 con 0x559f11d692f0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb26effd640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb2600094d0 tx=0x7fb26001d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135dd9529f565edd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.424+0000 7fb24effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26002c070 con 0x559f11d692f0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb260009d50 con 0x559f11d692f0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb26001da80 con 0x559f11d692f0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb260038050 con 0x559f11d692f0 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 10 client.15099 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:51.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559f11dee780 con 0x559f11d692f0 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb260009d50 con 0x559f11d692f0 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fb2600153c0 con 0x559f11d692f0 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 10 client.15099 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 20 client.15099 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11df2eb0 0x559f11df1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 4 client.15099 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "status"}) -- 0x559f11cd6b10 con 0x559f11df2eb0 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.425+0000 7fb2667fc640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11df2eb0 0x559f11df1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb24effd640 10 client.15099 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:51.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb2667fc640 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11df2eb0 0x559f11df1bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61110a3cc72b96cc server_cookie=f2b813a8db48f4f5 in_seq=0 out_seq=0 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb24effd640 1 -- 172.21.15.52:0/639785513 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559f11cd6b10 con 0x559f11df2eb0 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb24effd640 10 client.15099 handle_command_reply: tid=0 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 client.15099 shutdown 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 msgr2=0x559f11d87120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb2600094d0 tx=0x7fb26001d500 comp rx=0 tx=0).stop 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 shutdown_connections 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x559f11df2eb0 0x559f11df1bc0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f11d73bb0 0x559f11d87660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f11d692f0 0x559f11d87120 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 --2- 172.21.15.52:0/639785513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f11d689d0 0x559f11d8ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 >> 172.21.15.52:0/639785513 conn(0x559f11d64f60 msgr2=0x559f11d65340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb24effd640 0 client.15099 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:20:51.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 shutdown_connections 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.426+0000 7fb277c7e740 1 -- 172.21.15.52:0/639785513 wait complete. 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb277c7e740 20 client.15099 trim_cache size 0 max 16384 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 2, 2024-09-19T09:20:51.433 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24466, 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 84.601626753999994, 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 111.66774111300001 2024-09-19T09:20:51.434 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 msgr2=0x7fb25c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 0x7fb25c0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb268009270 tx=0x7fb26804b040 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 msgr2=0x7fb270074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb26800eaa0 tx=0x7fb26800eea0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 shutdown_connections 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb270106f10 0x7fb270074f70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb25c0a32d0 0x7fb25c0a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb270102790 0x7fb270074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 --2- 172.21.15.52:0/1314896809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101de0 0x7fb2700744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:51.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 >> 172.21.15.52:0/1314896809 conn(0x7fb2700fd8c0 msgr2=0x7fb2700fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:51.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 shutdown_connections 2024-09-19T09:20:51.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:51.427+0000 7fb2758a5640 1 -- 172.21.15.52:0/1314896809 wait complete. 2024-09-19T09:20:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:51 smithi169 ceph-mon[35454]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:51.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:51 smithi086 ceph-mon[34813]: pgmap v320: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:52.153 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:20:52.411 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 -- 172.21.15.52:0/1047490440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c100e20 msgr2=0x7fba1c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 --2- 172.21.15.52:0/1047490440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c100e20 0x7fba1c101200 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009900 tx=0x7fba0c02a480 comp rx=0 tx=0).stop 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 -- 172.21.15.52:0/1047490440 shutdown_connections 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 --2- 172.21.15.52:0/1047490440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 --2- 172.21.15.52:0/1047490440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c102570 0x7fba1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 --2- 172.21.15.52:0/1047490440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c100e20 0x7fba1c101200 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 -- 172.21.15.52:0/1047490440 >> 172.21.15.52:0/1047490440 conn(0x7fba1c0fc7d0 msgr2=0x7fba1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 -- 172.21.15.52:0/1047490440 shutdown_connections 2024-09-19T09:20:52.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.859+0000 7fba212d4640 1 -- 172.21.15.52:0/1047490440 wait complete. 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 Processor -- start 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 -- start start 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c100e20 0x7fba1c103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c1041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c110f80 con 0x7fba1c102570 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c110e00 con 0x7fba1c102ef0 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.860+0000 7fba212d4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c111100 con 0x7fba1c100e20 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37852/0 (socket says 172.21.15.52:37852) 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 -- 172.21.15.52:0/216377397 learned_addr learned my addr 172.21.15.52:0/216377397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1affd640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c100e20 0x7fba1c103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c1041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 -- 172.21.15.52:0/216377397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c100e20 msgr2=0x7fba1c103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c100e20 0x7fba1c103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 -- 172.21.15.52:0/216377397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 msgr2=0x7fba1c1041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c1041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 -- 172.21.15.52:0/216377397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c1a69e0 con 0x7fba1c102570 2024-09-19T09:20:52.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d770 tx=0x7fba0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba13fff640 1 -- 172.21.15.52:0/216377397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04017070 con 0x7fba1c102570 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1c1a6cd0 con 0x7fba1c102570 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba13fff640 1 -- 172.21.15.52:0/216377397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04005500 con 0x7fba1c102570 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1c1a71c0 con 0x7fba1c102570 2024-09-19T09:20:52.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.861+0000 7fba13fff640 1 -- 172.21.15.52:0/216377397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04004e00 con 0x7fba1c102570 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.864+0000 7fba236ad740 1 Processor -- start 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.864+0000 7fba236ad740 1 -- start start 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba13fff640 1 -- 172.21.15.52:0/216377397 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba04004fa0 con 0x7fba1c102570 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f397db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f3a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de4f2fe090 con 0x55de4f3982f0 2024-09-19T09:20:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de4f2a5a70 con 0x55de4f3979d0 2024-09-19T09:20:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba236ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de4f2fa050 con 0x55de4f3a2bb0 2024-09-19T09:20:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37862/0 (socket says 172.21.15.52:37862) 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 -- 172.21.15.52:0/3079663992 learned_addr learned my addr 172.21.15.52:0/3079663992 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f397db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f3a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 -- 172.21.15.52:0/3079663992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 msgr2=0x55de4f3a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f3a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 -- 172.21.15.52:0/3079663992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 msgr2=0x55de4f397db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f397db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1affd640 1 -- 172.21.15.52:0/3079663992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de4f2b2130 con 0x55de4f3982f0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.865+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f3a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba13fff640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 0x7fba080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba1affd640 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02a9a0 tx=0x7fba0c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edec9a6f596f78eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 0x7fba080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba13fff640 1 -- 172.21.15.52:0/216377397 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba040cf550 con 0x7fba1c102570 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba117fa640 1 -- 172.21.15.52:0/3079663992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c035030 con 0x55de4f3982f0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba117fa640 1 -- 172.21.15.52:0/3079663992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c040070 con 0x55de4f3982f0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.866+0000 7fba117fa640 1 -- 172.21.15.52:0/3079663992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0319a0 con 0x55de4f3982f0 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- 172.21.15.52:0/3079663992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 msgr2=0x55de4f3a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 0x7fba080a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba14005fd0 tx=0x7fba140098d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02a9a0 tx=0x7fba0c0040c0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- 172.21.15.52:0/3079663992 shutdown_connections 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f3a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3982f0 0x55de4f3a2670 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- 172.21.15.52:0/3079663992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f397db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- 172.21.15.52:0/3079663992 >> 172.21.15.52:0/3079663992 conn(0x55de4f393f60 msgr2=0x55de4f394340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- 172.21.15.52:0/3079663992 shutdown_connections 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- 172.21.15.52:0/3079663992 wait complete. 2024-09-19T09:20:52.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 -- start start 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 Processor -- start 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f3a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f39f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.867+0000 7fba236ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba236ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3a5780 con 0x55de4f3a2bb0 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba236ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de4f2b8f20 con 0x55de4f3979d0 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba236ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3a5900 con 0x55de4f3982f0 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba236ad740 10 client.0 _ll_register_callbacks cb 0x55de4f282030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37874/0 (socket says 172.21.15.52:37874) 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 -- 172.21.15.52:0/1799413224 learned_addr learned my addr 172.21.15.52:0/1799413224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f39f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1affd640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f3a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 -- 172.21.15.52:0/1799413224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 msgr2=0x55de4f39f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f39f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 -- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 msgr2=0x55de4f3a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f3a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 -- 172.21.15.52:0/1799413224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4f06f2b0 con 0x55de4f3a2bb0 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f39f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:52.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba14009b30 tx=0x7fba14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549aec173b99a2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba027fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1401e820 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba1401e9c0 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.868+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba0c040070 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fba1402d030 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 10 client.15111 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55de4f3b1140 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c040070 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fba1400f040 con 0x55de4f3a2bb0 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 10 client.15111 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 10 client.15111 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 20 client.15111 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:52.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f3b3770 0x55de4f3b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 4 client.15111 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de4f30b600 con 0x55de4f3b3770 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.869+0000 7fba1affd640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f3b3770 0x55de4f3b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.870+0000 7fba027fc640 10 client.15111 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.870+0000 7fba1affd640 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f3b3770 0x55de4f3b4be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2bf668efcd18677 server_cookie=1d12475ec1ce9def in_seq=0 out_seq=0 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba027fc640 1 -- 172.21.15.52:0/1799413224 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de4f30b600 con 0x55de4f3b3770 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba027fc640 10 client.15111 handle_command_reply: tid=0 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 client.15111 shutdown 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 msgr2=0x55de4f39fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fba14009b30 tx=0x7fba14004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 shutdown_connections 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3a2bb0 0x55de4f39fc70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f39f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f3b3770 0x55de4f3b4be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 --2- 172.21.15.52:0/1799413224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3979d0 0x55de4f3a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba027fc640 0 client.15111 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 >> 172.21.15.52:0/1799413224 conn(0x55de4f393f60 msgr2=0x55de4f399c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 shutdown_connections 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 1 -- 172.21.15.52:0/1799413224 wait complete. 2024-09-19T09:20:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.871+0000 7fba236ad740 20 client.15111 trim_cache size 0 max 16384 2024-09-19T09:20:52.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 Processor -- start 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 -- start start 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f3b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3a2bb0 0x55de4f3b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b2f20 con 0x55de4f3979d0 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b35f0 con 0x55de4f3a2bb0 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba236ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b3cc0 con 0x55de4f3982f0 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37886/0 (socket says 172.21.15.52:37886) 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.889+0000 7fba1affd640 1 -- 172.21.15.52:0/749238941 learned_addr learned my addr 172.21.15.52:0/749238941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3a2bb0 0x55de4f3b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 -- 172.21.15.52:0/749238941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 msgr2=0x55de4f3b4be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f3b4be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 -- 172.21.15.52:0/749238941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3a2bb0 msgr2=0x55de4f3b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3a2bb0 0x55de4f3b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 -- 172.21.15.52:0/749238941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de4f393d90 con 0x55de4f3979d0 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba1affd640 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02a9a0 tx=0x7fba0c02ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d476a2419f55d5db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba10ff9640 1 -- 172.21.15.52:0/749238941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c035040 con 0x55de4f3979d0 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba10ff9640 1 -- 172.21.15.52:0/749238941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c040030 con 0x55de4f3979d0 2024-09-19T09:20:52.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.890+0000 7fba10ff9640 1 -- 172.21.15.52:0/749238941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c031660 con 0x55de4f3979d0 2024-09-19T09:20:52.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- 172.21.15.52:0/749238941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 msgr2=0x55de4f3b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02a9a0 tx=0x7fba0c02ab80 comp rx=0 tx=0).stop 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- 172.21.15.52:0/749238941 shutdown_connections 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3a2bb0 0x55de4f3b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3982f0 0x55de4f3b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 --2- 172.21.15.52:0/749238941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f3b3770 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- 172.21.15.52:0/749238941 >> 172.21.15.52:0/749238941 conn(0x55de4f393f60 msgr2=0x55de4f39f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- 172.21.15.52:0/749238941 shutdown_connections 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- 172.21.15.52:0/749238941 wait complete. 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 -- start start 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.891+0000 7fba236ad740 1 Processor -- start 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 0x55de4f39b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f39bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b4a60 con 0x55de4f3979d0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b4390 con 0x55de4f3982f0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de4f3b5130 con 0x55de4f3a2bb0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 10 client.0 _ll_register_callbacks cb 0x7fba14009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37894/0 (socket says 172.21.15.52:37894) 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 -- 172.21.15.52:0/2322054015 learned_addr learned my addr 172.21.15.52:0/2322054015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 0x55de4f39b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 -- 172.21.15.52:0/2322054015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 msgr2=0x55de4f39bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1b7fe640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f39bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f39bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 -- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 msgr2=0x55de4f39b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 0x55de4f39b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 -- 172.21.15.52:0/2322054015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de4f39c580 con 0x55de4f3979d0 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 0x55de4f39b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:52.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba1affd640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0044f0 tx=0x7fba0c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50b244208ca0e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba027fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c035030 con 0x55de4f3979d0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba0c0048d0 con 0x55de4f3979d0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.892+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba0c040030 con 0x55de4f3979d0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fba0c005000 con 0x55de4f3979d0 2024-09-19T09:20:52.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 10 client.15117 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55de4f3bcc30 con 0x55de4f3979d0 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c040030 con 0x55de4f3979d0 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fba0c031bc0 con 0x55de4f3979d0 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 10 client.15117 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 20 client.15117 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f421300 0x55de4f420010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 4 client.15117 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "status"}) -- 0x55de4f305b10 con 0x55de4f421300 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.893+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f421300 0x55de4f420010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba027fc640 10 client.15117 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba1a7fc640 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f421300 0x55de4f420010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ba5b1cc37e11275b server_cookie=d7ae96d82fabd1cf in_seq=0 out_seq=0 2024-09-19T09:20:52.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba027fc640 1 -- 172.21.15.52:0/2322054015 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55de4f305b10 con 0x55de4f421300 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba027fc640 10 client.15117 handle_command_reply: tid=0 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 client.15117 shutdown 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 msgr2=0x55de4f39d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0044f0 tx=0x7fba0c005c00 comp rx=0 tx=0).stop 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 shutdown_connections 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de4f3a2bb0 0x55de4f39bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55de4f421300 0x55de4f420010 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de4f3982f0 0x55de4f39b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 --2- 172.21.15.52:0/2322054015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de4f3979d0 0x55de4f39d0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 >> 172.21.15.52:0/2322054015 conn(0x55de4f393f60 msgr2=0x55de4f39f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba027fc640 0 client.15117 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 shutdown_connections 2024-09-19T09:20:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 1 -- 172.21.15.52:0/2322054015 wait complete. 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.894+0000 7fba236ad740 20 client.15117 trim_cache size 0 max 16384 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 1, 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24482, 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 87.075707495000003, 2024-09-19T09:20:52.905 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 115.511176443 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 msgr2=0x7fba080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 0x7fba080a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fba14005fd0 tx=0x7fba140098d0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 msgr2=0x7fba1c103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fba0400d770 tx=0x7fba0400dc30 comp rx=0 tx=0).stop 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 shutdown_connections 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba1c102ef0 0x7fba1c1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba1c102570 0x7fba1c103c90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba080a32d0 0x7fba080a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 --2- 172.21.15.52:0/216377397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba1c100e20 0x7fba1c103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:52.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 >> 172.21.15.52:0/216377397 conn(0x7fba1c0fc7d0 msgr2=0x7fba1c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:52.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 shutdown_connections 2024-09-19T09:20:52.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:52.895+0000 7fba212d4640 1 -- 172.21.15.52:0/216377397 wait complete. 2024-09-19T09:20:53.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:53 smithi169 ceph-mon[35454]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:53.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:53 smithi086 ceph-mon[34813]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:53.618 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:53 smithi052 ceph-mon[30947]: pgmap v321: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T09:20:53.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:20:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:54.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 -- 172.21.15.52:0/2775331574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8100a80 msgr2=0x7f6ef8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 --2- 172.21.15.52:0/2775331574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8100a80 0x7f6ef8100ee0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009930 tx=0x7f6eec02a420 comp rx=0 tx=0).stop 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 -- 172.21.15.52:0/2775331574 shutdown_connections 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 --2- 172.21.15.52:0/2775331574 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8101420 0x7f6ef810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 --2- 172.21.15.52:0/2775331574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8100a80 0x7f6ef8100ee0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 --2- 172.21.15.52:0/2775331574 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8106a80 0x7f6ef8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.396+0000 7f6efc973640 1 -- 172.21.15.52:0/2775331574 >> 172.21.15.52:0/2775331574 conn(0x7f6ef80fc7a0 msgr2=0x7f6ef80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 -- 172.21.15.52:0/2775331574 shutdown_connections 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 -- 172.21.15.52:0/2775331574 wait complete. 2024-09-19T09:20:54.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 Processor -- start 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 -- start start 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 0x7f6ef810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.397+0000 7f6efc973640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8106a80 0x7f6ef810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8111fa0 con 0x7f6ef8101420 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8111e20 con 0x7f6ef8106a80 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8112120 con 0x7f6ef8100a80 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37922/0 (socket says 172.21.15.52:37922) 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1843958661 learned_addr learned my addr 172.21.15.52:0/1843958661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8106a80 0x7f6ef810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 0x7f6ef810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1843958661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 msgr2=0x7f6ef810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 0x7f6ef810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1843958661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8106a80 msgr2=0x7f6ef810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8106a80 0x7f6ef810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1843958661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef81a6980 con 0x7f6ef8101420 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 0x7f6ef810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:54.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009a50 tx=0x7f6eec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ee77fe640 1 -- 172.21.15.52:0/1843958661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec03f030 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef81a6c10 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ee77fe640 1 -- 172.21.15.52:0/1843958661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eec003ce0 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6ee77fe640 1 -- 172.21.15.52:0/1843958661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec035070 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.398+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef81a7140 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6ee77fe640 1 -- 172.21.15.52:0/1843958661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6eec042030 con 0x7f6ef8101420 2024-09-19T09:20:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 Processor -- start 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 -- start start 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa283db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa28e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649aa1ea090 con 0x5649aa28ebb0 2024-09-19T09:20:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649aa191a70 con 0x5649aa2842f0 2024-09-19T09:20:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6efed4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649aa1e6050 con 0x5649aa2839d0 2024-09-19T09:20:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37936/0 (socket says 172.21.15.52:37936) 2024-09-19T09:20:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.401+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/3126802517 learned_addr learned my addr 172.21.15.52:0/3126802517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa283db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef659c640 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa28e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ee77fe640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 0x7f6ee00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/3126802517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 msgr2=0x5649aa283db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa283db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/3126802517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 msgr2=0x5649aa28e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa28e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/3126802517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649aa19e130 con 0x5649aa28ebb0 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 0x7f6ee00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ee77fe640 1 -- 172.21.15.52:0/1843958661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6eec0f00a0 con 0x7f6ef8101420 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ed910 tx=0x7f6eec02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d139542cd0abd6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ee4ff9640 1 -- 172.21.15.52:0/3126802517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0bc020 con 0x5649aa28ebb0 2024-09-19T09:20:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 0x7f6ee00a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000a2c0 tx=0x7f6ef0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ee4ff9640 1 -- 172.21.15.52:0/3126802517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eec04bbf0 con 0x5649aa28ebb0 2024-09-19T09:20:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.402+0000 7f6ee4ff9640 1 -- 172.21.15.52:0/3126802517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0f3ce0 con 0x5649aa28ebb0 2024-09-19T09:20:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- 172.21.15.52:0/3126802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 msgr2=0x5649aa290fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ed910 tx=0x7f6eec02a420 comp rx=0 tx=0).stop 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- 172.21.15.52:0/3126802517 shutdown_connections 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa28ebb0 0x5649aa290fa0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa28e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 --2- 172.21.15.52:0/3126802517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa283db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- 172.21.15.52:0/3126802517 >> 172.21.15.52:0/3126802517 conn(0x5649aa27ff60 msgr2=0x5649aa280340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- 172.21.15.52:0/3126802517 shutdown_connections 2024-09-19T09:20:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- 172.21.15.52:0/3126802517 wait complete. 2024-09-19T09:20:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.403+0000 7f6efed4c740 1 -- start start 2024-09-19T09:20:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 Processor -- start 2024-09-19T09:20:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa28e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa28ebb0 0x5649aa28bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649aa291540 con 0x5649aa2842f0 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649aa1a4f20 con 0x5649aa28ebb0 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649aa2916c0 con 0x5649aa2839d0 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6efed4c740 10 client.0 _ll_register_callbacks cb 0x5649aa16e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37946/0 (socket says 172.21.15.52:37946) 2024-09-19T09:20:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1641523471 learned_addr learned my addr 172.21.15.52:0/1641523471 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa28ebb0 0x5649aa28bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa28e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1641523471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 msgr2=0x5649aa28e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa28e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa28ebb0 msgr2=0x5649aa28bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa28ebb0 0x5649aa28bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 -- 172.21.15.52:0/1641523471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a9f5b2b0 con 0x5649aa2842f0 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ed910 tx=0x7f6eec0bc330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ef86cbbf39cfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.404+0000 7f6eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:54.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec04b990 con 0x5649aa2842f0 2024-09-19T09:20:54.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6eec0edc20 con 0x5649aa2842f0 2024-09-19T09:20:54.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649aa1f7600 con 0x5649aa2842f0 2024-09-19T09:20:54.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6eec0bbe40 con 0x5649aa2842f0 2024-09-19T09:20:54.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 10 client.15129 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:54.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5649aa291540 con 0x5649aa2842f0 2024-09-19T09:20:54.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5649aa1f7600 con 0x5649aa2842f0 2024-09-19T09:20:54.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6eec0b8b50 con 0x5649aa2842f0 2024-09-19T09:20:54.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 10 client.15129 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:54.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 10 client.15129 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 20 client.15129 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa29f1b0 0x5649aa2a0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 4 client.15129 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.405+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649aa1f1b10 con 0x5649aa29f1b0 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.406+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa29f1b0 0x5649aa2a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.406+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa29f1b0 0x5649aa2a0620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d2e1b75a7887b1 server_cookie=17dac64858b4c494 in_seq=0 out_seq=0 2024-09-19T09:20:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.406+0000 7f6eddffb640 10 client.15129 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6eddffb640 1 -- 172.21.15.52:0/1641523471 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649aa1f1b10 con 0x5649aa29f1b0 2024-09-19T09:20:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6eddffb640 10 client.15129 handle_command_reply: tid=0 2024-09-19T09:20:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 client.15129 shutdown 2024-09-19T09:20:54.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 msgr2=0x5649aa28b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ed910 tx=0x7f6eec0bc330 comp rx=0 tx=0).stop 2024-09-19T09:20:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 shutdown_connections 2024-09-19T09:20:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa29f1b0 0x5649aa2a0620 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa28ebb0 0x5649aa28bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2842f0 0x5649aa28b720 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1641523471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa2839d0 0x5649aa28e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 >> 172.21.15.52:0/1641523471 conn(0x5649aa27ff60 msgr2=0x5649aa285c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6eddffb640 0 client.15129 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 shutdown_connections 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.407+0000 7f6efed4c740 1 -- 172.21.15.52:0/1641523471 wait complete. 2024-09-19T09:20:54.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.408+0000 7f6efed4c740 20 client.15129 trim_cache size 0 max 16384 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.425+0000 7f6efed4c740 1 Processor -- start 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.425+0000 7f6efed4c740 1 -- start start 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa288980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa288ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649aa29e960 con 0x5649aa2839d0 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649aa29f030 con 0x5649aa2842f0 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6efed4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649aa29f700 con 0x5649aa28ebb0 2024-09-19T09:20:54.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37960/0 (socket says 172.21.15.52:37960) 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 -- 172.21.15.52:0/1325404944 learned_addr learned my addr 172.21.15.52:0/1325404944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa288980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa288ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 -- 172.21.15.52:0/1325404944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 msgr2=0x5649aa288ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa288ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 -- 172.21.15.52:0/1325404944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 msgr2=0x5649aa288980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa288980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 -- 172.21.15.52:0/1325404944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649aa27fd90 con 0x5649aa2839d0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8006d90 tx=0x7f6ee8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fd02377d47608d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.426+0000 7f6edffff640 1 -- 172.21.15.52:0/1325404944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800ce10 con 0x5649aa2839d0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6edffff640 1 -- 172.21.15.52:0/1325404944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee8015de0 con 0x5649aa2839d0 2024-09-19T09:20:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6edffff640 1 -- 172.21.15.52:0/1325404944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8024cf0 con 0x5649aa2839d0 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 -- 172.21.15.52:0/1325404944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 msgr2=0x5649aa29f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8006d90 tx=0x7f6ee8008040 comp rx=0 tx=0).stop 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 -- 172.21.15.52:0/1325404944 shutdown_connections 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa288ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa288980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1325404944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa29f1b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 -- 172.21.15.52:0/1325404944 >> 172.21.15.52:0/1325404944 conn(0x5649aa27ff60 msgr2=0x5649aa286de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 -- 172.21.15.52:0/1325404944 shutdown_connections 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.427+0000 7f6efed4c740 1 -- 172.21.15.52:0/1325404944 wait complete. 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 -- start start 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 Processor -- start 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa2a2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa3078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649aa2a04a0 con 0x5649aa2839d0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649aa29fdd0 con 0x5649aa2842f0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649aa2a0b70 con 0x5649aa28ebb0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6efed4c740 10 client.0 _ll_register_callbacks cb 0x7f6eec0f3f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37972/0 (socket says 172.21.15.52:37972) 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 -- 172.21.15.52:0/1037651231 learned_addr learned my addr 172.21.15.52:0/1037651231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa2a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef6d9d640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa3078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 -- 172.21.15.52:0/1037651231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 msgr2=0x5649aa3078b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa3078b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 -- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 msgr2=0x5649aa2a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa2a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.428+0000 7f6ef659c640 1 -- 172.21.15.52:0/1037651231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649aa29e790 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6ef659c640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8024b10 tx=0x7f6ee8006e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8808f2abe6c6c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee802a070 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6ee8015900 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee8015de0 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6ee8015b00 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 10 client.15135 fetch_fsmap learned FSMap version 23 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5649aa308e30 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee8015de0 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f6ee80134c0 con 0x5649aa2839d0 2024-09-19T09:20:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 10 client.15135 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 20 client.15135 populate_metadata read hostname 'smithi052' 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.429+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa30d600 0x5649aa30c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 4 client.15135 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "status"}) -- 0x5649aa16e0e0 con 0x5649aa30d600 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa30d600 0x5649aa30c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6ef5d9b640 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa30d600 0x5649aa30c310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfa9d59c8f7e09a server_cookie=a5e06f90cbf9e89b in_seq=0 out_seq=0 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6eddffb640 10 client.15135 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6eddffb640 1 -- 172.21.15.52:0/1037651231 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5649aa16e0e0 con 0x5649aa30d600 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6eddffb640 10 client.15135 handle_command_reply: tid=0 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 client.15135 shutdown 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 msgr2=0x5649aa2a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8024b10 tx=0x7f6ee8006e50 comp rx=0 tx=0).stop 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 shutdown_connections 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649aa30d600 0x5649aa30c310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649aa28ebb0 0x5649aa3078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.430+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649aa2842f0 0x5649aa2a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efed4c740 1 --2- 172.21.15.52:0/1037651231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649aa2839d0 0x5649aa2a1dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 >> 172.21.15.52:0/1037651231 conn(0x5649aa27ff60 msgr2=0x5649aa289ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6eddffb640 0 client.15135 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 shutdown_connections 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efed4c740 1 -- 172.21.15.52:0/1037651231 wait complete. 2024-09-19T09:20:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efed4c740 20 client.15135 trim_cache size 0 max 16384 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24509, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 95.645619027999999, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 23, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 77, 2024-09-19T09:20:54.448 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 106.152508907 2024-09-19T09:20:54.449 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:20:54.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 msgr2=0x7f6ee00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 0x7f6ee00a5790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000a2c0 tx=0x7f6ef0004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:54.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 msgr2=0x7f6ef810e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:54.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009a50 tx=0x7f6eec004270 comp rx=0 tx=0).stop 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 shutdown_connections 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef8106a80 0x7f6ef810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6ef8101420 0x7f6ef810e920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6ee00a32d0 0x7f6ee00a5790 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 --2- 172.21.15.52:0/1843958661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ef8100a80 0x7f6ef810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 >> 172.21.15.52:0/1843958661 conn(0x7f6ef80fc7a0 msgr2=0x7f6ef80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 shutdown_connections 2024-09-19T09:20:54.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:54.431+0000 7f6efc973640 1 -- 172.21.15.52:0/1843958661 wait complete. 2024-09-19T09:20:55.157 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:20:55.435 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:20:55.435 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:20:55.435 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:20:55.436 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:20:55.678 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:20:55.678 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:20:55.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:55.679 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-19T09:20:55.680 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:55 smithi086 ceph-mon[34813]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:55.680 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:55 smithi169 ceph-mon[35454]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:55.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:55 smithi052 ceph-mon[30947]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:20:55.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:55.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-19T09:20:55.775 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-19T09:20:55.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:20:55.778 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T09:20:55.778 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:20:55.778 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:55.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:20:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 -- 172.21.15.52:0/3348653602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 msgr2=0x7ff308107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 --2- 172.21.15.52:0/3348653602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308107b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009930 tx=0x7ff2f802a420 comp rx=0 tx=0).stop 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 -- 172.21.15.52:0/3348653602 shutdown_connections 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 --2- 172.21.15.52:0/3348653602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 --2- 172.21.15.52:0/3348653602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308107b80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 --2- 172.21.15.52:0/3348653602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 0x7ff308103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 -- 172.21.15.52:0/3348653602 >> 172.21.15.52:0/3348653602 conn(0x7ff3080fc7d0 msgr2=0x7ff3080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 -- 172.21.15.52:0/3348653602 shutdown_connections 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.540+0000 7ff30f58d640 1 -- 172.21.15.52:0/3348653602 wait complete. 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 Processor -- start 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 -- start start 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 0x7ff3081985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081120a0 con 0x7ff308103740 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff308111f20 con 0x7ff308102d90 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30f58d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff308112220 con 0x7ff308108290 2024-09-19T09:20:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37982/0 (socket says 172.21.15.52:37982) 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 -- 172.21.15.52:0/1271208522 learned_addr learned my addr 172.21.15.52:0/1271208522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30d329640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 0x7ff3081985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30db2a640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 -- 172.21.15.52:0/1271208522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 msgr2=0x7ff30819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 -- 172.21.15.52:0/1271208522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 msgr2=0x7ff3081985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 0x7ff3081985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30cb28640 1 -- 172.21.15.52:0/1271208522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30819d590 con 0x7ff308103740 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.541+0000 7ff30db2a640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff30cb28640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802a940 tx=0x7ff2f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f803f070 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30819d820 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f8031c90 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8035030 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.542+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a5160 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.543+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30806a7f0 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.545+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff2f8042070 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.546+0000 7ff2fe7fc640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 0x7ff2f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.546+0000 7ff30d329640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 0x7ff2f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.546+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff2f80f0910 con 0x7ff308103740 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.546+0000 7ff30d329640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 0x7ff2f40a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3040058c0 tx=0x7ff30400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.548+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2f80bd450 con 0x7ff308103740 2024-09-19T09:20:56.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.765+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff30810a2a0 con 0x7ff308103740 2024-09-19T09:20:56.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.765+0000 7ff2fe7fc640 1 -- 172.21.15.52:0/1271208522 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7ff2f80bcd50 con 0x7ff308103740 2024-09-19T09:20:56.766 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:20:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 msgr2=0x7ff2f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 0x7ff2f40a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3040058c0 tx=0x7ff30400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 msgr2=0x7ff308198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff2f802a940 tx=0x7ff2f8003b90 comp rx=0 tx=0).stop 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 shutdown_connections 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2f40a32d0 0x7ff2f40a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff308108290 0x7ff30819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff308103740 0x7ff308198b20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 --2- 172.21.15.52:0/1271208522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff308102d90 0x7ff3081985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 >> 172.21.15.52:0/1271208522 conn(0x7ff3080fc7d0 msgr2=0x7ff308106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 shutdown_connections 2024-09-19T09:20:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:56.768+0000 7ff30f58d640 1 -- 172.21.15.52:0/1271208522 wait complete. 2024-09-19T09:20:57.431 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:20:57.432 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:20:57.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:57.432 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-19T09:20:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:57 smithi169 ceph-mon[35454]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:57 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1271208522' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:57.450 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-19T09:20:57.451 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:57.451 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:57.451 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-19T09:20:57.451 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:20:57.451 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42190sec preferred_lft 42190sec 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::ec4:7aff:febd:15de/64 scope link 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:57.452 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-19T09:20:57.453 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:20:57.453 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:57.453 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-19T09:20:57.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:20:57.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-09-19T09:20:57.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-09-19T09:20:57.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:20:57.454 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-19T09:20:57.478 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:57 smithi052 ceph-mon[30947]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:57.478 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:57 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1271208522' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:20:57.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:57 smithi086 ceph-mon[34813]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:20:57.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:57 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1271208522' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:20:57.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:57.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:57.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:57.655 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:20:57.681 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-19T09:20:57.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:57.683 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-19T09:20:57.757 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-19T09:20:57.758 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:20:57.758 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:20:57.758 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:20:57.758 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:20:57.758 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:57.758 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-19T09:20:57.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:20:57.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:20:57.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:20:57.759 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-19T09:20:57.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:58.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:58.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:58.045 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-19T09:20:58.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:58.061 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-09-19T09:20:58.117 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:58.117 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-19T09:20:58.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:20:58.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:20:58.117 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-19T09:20:58.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:58.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:58.240 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:20:58.241 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-19T09:20:58.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:58.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:58.372 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:58.372 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-19T09:20:58.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-19T09:20:58.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:20:58.372 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-19T09:20:58.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:58.451 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:58.452 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:58.467 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:20:58.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:58.468 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:58.523 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:20:58.523 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:20:58.523 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/34170925-e3b3-4a44-9507-364cc762ea7f 2024-09-19T09:20:58.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:58.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/34170925-e3b3-4a44-9507-364cc762ea7f /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:20:58.625 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:20:58.626 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T09:20:58.761 INFO:teuthology.orchestra.run.smithi052.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T09:20:58.761 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T09:20:58.761 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.86:3300,172.21.15.169:3300" 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: trying mount with new device syntax: 0@044f38fa-7667-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/34170925-e3b3-4a44-9507-364cc762ea7f 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.52:3300/172.21.15.86:3300/172.21.15.169:3300" will pass to kernel 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:20:58.762 INFO:teuthology.orchestra.run.smithi052.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:20:58.764 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:20:58.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:58.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:58.798 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:20:58.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:20:58.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:58.908 INFO:teuthology.orchestra.run.smithi052.stdout:client24911 2024-09-19T09:20:58.908 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:20:58.909 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:58.926 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:20:59.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:20:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:59.036 INFO:teuthology.orchestra.run.smithi052.stdout:client24911 2024-09-19T09:20:59.036 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:20:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:20:59.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:59.107 INFO:teuthology.orchestra.run.smithi052.stdout:client24911 2024-09-19T09:20:59.107 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/044f38fa-7667-11ef-bceb-c7b262605968.client24911/status') 2024-09-19T09:20:59.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:59.173 INFO:teuthology.orchestra.run.smithi052.stdout:instance: client.24911 (3)172.21.15.52:0/3480420507 2024-09-19T09:20:59.173 INFO:teuthology.orchestra.run.smithi052.stdout:blocklisted: false 2024-09-19T09:20:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records in 2024-09-19T09:20:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:0+1 records out 2024-09-19T09:20:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:71 bytes copied, 2.3457e-05 s, 3.0 MB/s 2024-09-19T09:20:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:59.181 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:20:59.194 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:20:59.194 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:20:59.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T09:20:59.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 -- 172.21.15.52:0/4015980933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67401025c0 msgr2=0x7f67401049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 --2- 172.21.15.52:0/4015980933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67401025c0 0x7f67401049b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6730009ca0 tx=0x7f673002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 -- 172.21.15.52:0/4015980933 shutdown_connections 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 --2- 172.21.15.52:0/4015980933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6740107820 0x7f6740109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 --2- 172.21.15.52:0/4015980933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 0x7f67401072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 --2- 172.21.15.52:0/4015980933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67401025c0 0x7f67401049b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 -- 172.21.15.52:0/4015980933 >> 172.21.15.52:0/4015980933 conn(0x7f67400fc1e0 msgr2=0x7f67400fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 -- 172.21.15.52:0/4015980933 shutdown_connections 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.298+0000 7f6747f8d640 1 -- 172.21.15.52:0/4015980933 wait complete. 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 Processor -- start 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 -- start start 2024-09-19T09:20:59.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67401025c0 0x7f6740101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 0x7f6740100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f674010d880 con 0x7f6740107820 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f674010d700 con 0x7f6740104ef0 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6747f8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f674010da00 con 0x7f67401025c0 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54832/0 (socket says 172.21.15.52:54832) 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 -- 172.21.15.52:0/1591953869 learned_addr learned my addr 172.21.15.52:0/1591953869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6745528640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 0x7f6740100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f6745d29640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67401025c0 0x7f6740101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 -- 172.21.15.52:0/1591953869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67401025c0 msgr2=0x7f6740101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67401025c0 0x7f6740101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 -- 172.21.15.52:0/1591953869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 msgr2=0x7f6740100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 0x7f6740100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 -- 172.21.15.52:0/1591953869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6740101340 con 0x7f6740107820 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f674652a640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f673800b3f0 tx=0x7f673800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.299+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738015020 con 0x7f6740107820 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.300+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6738011d10 con 0x7f6740107820 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.300+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67401a1f70 con 0x7f6740107820 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.300+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673800f2e0 con 0x7f6740107820 2024-09-19T09:20:59.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.300+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67401a2450 con 0x7f6740107820 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.301+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67400fdcd0 con 0x7f6740107820 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.302+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6738018020 con 0x7f6740107820 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.303+0000 7f673effd640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 0x7f67280a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.303+0000 7f6745d29640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 0x7f67280a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.303+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f67380cf2b0 con 0x7f6740107820 2024-09-19T09:20:59.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.303+0000 7f6745d29640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 0x7f67280a58d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6730004af0 tx=0x7f6730000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:59.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.307+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f673801f020 con 0x7f6740107820 2024-09-19T09:20:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:20:59 smithi052 ceph-mon[30947]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:20:59 smithi086 ceph-mon[34813]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:20:59.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:20:59.523+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f674002d7c0 con 0x7f6740107820 2024-09-19T09:20:59.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:20:59 smithi169 ceph-mon[35454]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:21:00.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.195+0000 7f673effd640 1 -- 172.21.15.52:0/1591953869 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f673809bf00 con 0x7f6740107820 2024-09-19T09:21:00.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 msgr2=0x7f67280a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 0x7f67280a58d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6730004af0 tx=0x7f6730000f40 comp rx=0 tx=0).stop 2024-09-19T09:21:00.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 msgr2=0x7f6740100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f673800b3f0 tx=0x7f673800b8b0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 shutdown_connections 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6740107820 0x7f6740100ab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6740104ef0 0x7f6740100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67280a3410 0x7f67280a58d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 --2- 172.21.15.52:0/1591953869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67401025c0 0x7f6740101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.197+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 >> 172.21.15.52:0/1591953869 conn(0x7f67400fc1e0 msgr2=0x7f6740102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.198+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 shutdown_connections 2024-09-19T09:21:00.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.198+0000 7f6747f8d640 1 -- 172.21.15.52:0/1591953869 wait complete. 2024-09-19T09:21:00.213 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:21:00.226 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:21:00.278 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:21:00.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 -- 172.21.15.52:0/1070994964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8104ee0 msgr2=0x7fdfb81072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 --2- 172.21.15.52:0/1070994964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8104ee0 0x7fdfb81072d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009900 tx=0x7fdfac02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:00.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 -- 172.21.15.52:0/1070994964 shutdown_connections 2024-09-19T09:21:00.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 --2- 172.21.15.52:0/1070994964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8107810 0x7fdfb8109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 --2- 172.21.15.52:0/1070994964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8104ee0 0x7fdfb81072d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 --2- 172.21.15.52:0/1070994964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 0x7fdfb81049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 -- 172.21.15.52:0/1070994964 >> 172.21.15.52:0/1070994964 conn(0x7fdfb80fc1b0 msgr2=0x7fdfb80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 -- 172.21.15.52:0/1070994964 shutdown_connections 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.391+0000 7fdfbe865640 1 -- 172.21.15.52:0/1070994964 wait complete. 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 Processor -- start 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 -- start start 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 0x7fdfb8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 0x7fdfb8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d7c0 con 0x7fdfb8107810 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d640 con 0x7fdfb81025b0 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbe865640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810d940 con 0x7fdfb8104ee0 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbce02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbce02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54856/0 (socket says 172.21.15.52:54856) 2024-09-19T09:21:00.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.392+0000 7fdfbce02640 1 -- 172.21.15.52:0/663241910 learned_addr learned my addr 172.21.15.52:0/663241910 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb77fe640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 0x7fdfb8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb7fff640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 0x7fdfb8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 -- 172.21.15.52:0/663241910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 msgr2=0x7fdfb8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 0x7fdfb8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 -- 172.21.15.52:0/663241910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 msgr2=0x7fdfb8197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 0x7fdfb8197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 -- 172.21.15.52:0/663241910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb819faf0 con 0x7fdfb8107810 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb77fe640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 0x7fdfb8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbce02640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cab0 tx=0x7fdfb000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000ae20 con 0x7fdfb8107810 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb000f930 con 0x7fdfb8107810 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb819fde0 con 0x7fdfb8107810 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0018b80 con 0x7fdfb8107810 2024-09-19T09:21:00.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.393+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a0250 con 0x7fdfb8107810 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.394+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb80fdca0 con 0x7fdfb8107810 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.395+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdfb000fae0 con 0x7fdfb8107810 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.396+0000 7fdfb57fa640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 0x7fdfa00a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.396+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdfb00d0490 con 0x7fdfb8107810 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.396+0000 7fdfb7fff640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 0x7fdfa00a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.397+0000 7fdfb7fff640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 0x7fdfa00a57a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:00.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.399+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfb0014030 con 0x7fdfb8107810 2024-09-19T09:21:00.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:00 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:21:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.579+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfb802da10 con 0x7fdfb8107810 2024-09-19T09:21:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.581+0000 7fdfb57fa640 1 -- 172.21.15.52:0/663241910 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7fdfb009d060 con 0x7fdfb8107810 2024-09-19T09:21:00.582 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:00.582 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 msgr2=0x7fdfa00a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 0x7fdfa00a57a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8005fd0 tx=0x7fdfa8005c70 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 msgr2=0x7fdfb819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cab0 tx=0x7fdfb000cf70 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 shutdown_connections 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfb8107810 0x7fdfb819f480 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfa00a32e0 0x7fdfa00a57a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb8104ee0 0x7fdfb8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 --2- 172.21.15.52:0/663241910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfb81025b0 0x7fdfb8197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 >> 172.21.15.52:0/663241910 conn(0x7fdfb80fc1b0 msgr2=0x7fdfb8102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:00.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 shutdown_connections 2024-09-19T09:21:00.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.583+0000 7fdfbe865640 1 -- 172.21.15.52:0/663241910 wait complete. 2024-09-19T09:21:00.593 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:00 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:21:00.595 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:14:47.724048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:19:14.651004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:19:16.771140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:21:00.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:21:00.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:00 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:21:00.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.701+0000 7f6a0c8af640 1 -- 172.21.15.52:0/4211673747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 msgr2=0x7f6a08109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.701+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/4211673747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a08109c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009ca0 tx=0x7f6a0002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 -- 172.21.15.52:0/4211673747 shutdown_connections 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/4211673747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a08109c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/4211673747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08104eb0 0x7f6a081072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/4211673747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08102580 0x7f6a08104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 -- 172.21.15.52:0/4211673747 >> 172.21.15.52:0/4211673747 conn(0x7f6a080fc140 msgr2=0x7f6a080fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 -- 172.21.15.52:0/4211673747 shutdown_connections 2024-09-19T09:21:00.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 -- 172.21.15.52:0/4211673747 wait complete. 2024-09-19T09:21:00.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 Processor -- start 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.702+0000 7f6a0c8af640 1 -- start start 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 0x7f6a08197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08104eb0 0x7f6a081983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0810d7c0 con 0x7f6a081077e0 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0810d640 con 0x7f6a08102580 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0810d940 con 0x7f6a08104eb0 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54878/0 (socket says 172.21.15.52:54878) 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 -- 172.21.15.52:0/3349809427 learned_addr learned my addr 172.21.15.52:0/3349809427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a05d9b640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08104eb0 0x7f6a081983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0659c640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 0x7f6a08197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 -- 172.21.15.52:0/3349809427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08104eb0 msgr2=0x7f6a081983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08104eb0 0x7f6a081983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 -- 172.21.15.52:0/3349809427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 msgr2=0x7f6a08197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 0x7f6a08197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 -- 172.21.15.52:0/3349809427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0819fac0 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0659c640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 0x7f6a08197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a06d9d640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a00031a40 tx=0x7f6a00031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00003c30 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a00003dd0 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0819fd50 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0002fdb0 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.703+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a081a0240 con 0x7f6a081077e0 2024-09-19T09:21:00.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.705+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a080fdc30 con 0x7f6a081077e0 2024-09-19T09:21:00.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.706+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6a00004050 con 0x7f6a081077e0 2024-09-19T09:21:00.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.707+0000 7f69f77fe640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 0x7f69f00a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:00.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.707+0000 7f6a0659c640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 0x7f69f00a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:00.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.707+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6a000f0ee0 con 0x7f6a081077e0 2024-09-19T09:21:00.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.707+0000 7f6a0659c640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 0x7f69f00a57a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009b40 tx=0x7f69f8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:00.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.710+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a000bdb30 con 0x7f6a081077e0 2024-09-19T09:21:00.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.887+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a08062e90 con 0x7f6a081077e0 2024-09-19T09:21:00.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.887+0000 7f69f77fe640 1 -- 172.21.15.52:0/3349809427 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f6a000eee20 con 0x7f6a081077e0 2024-09-19T09:21:00.888 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 msgr2=0x7f69f00a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 0x7f69f00a57a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009b40 tx=0x7f69f8005e50 comp rx=0 tx=0).stop 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 msgr2=0x7f6a0819f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a00031a40 tx=0x7f6a00031ee0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 shutdown_connections 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a081077e0 0x7f6a0819f450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69f00a32e0 0x7f69f00a57a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a08104eb0 0x7f6a081983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 --2- 172.21.15.52:0/3349809427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a08102580 0x7f6a08197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 >> 172.21.15.52:0/3349809427 conn(0x7f6a080fc140 msgr2=0x7f6a08102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 shutdown_connections 2024-09-19T09:21:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:00.889+0000 7f6a0c8af640 1 -- 172.21.15.52:0/3349809427 wait complete. 2024-09-19T09:21:00.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 -- 172.21.15.52:0/4266085361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450100a30 msgr2=0x7f3450100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 --2- 172.21.15.52:0/4266085361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450100a30 0x7f3450100e30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f344c009900 tx=0x7f344c02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 -- 172.21.15.52:0/4266085361 shutdown_connections 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 --2- 172.21.15.52:0/4266085361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34501025e0 0x7f3450108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 --2- 172.21.15.52:0/4266085361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3450101c20 0x7f34501020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 --2- 172.21.15.52:0/4266085361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450100a30 0x7f3450100e30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.008+0000 7f3457352640 1 -- 172.21.15.52:0/4266085361 >> 172.21.15.52:0/4266085361 conn(0x7f34500fc1b0 msgr2=0x7f34500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- 172.21.15.52:0/4266085361 shutdown_connections 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- 172.21.15.52:0/4266085361 wait complete. 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 Processor -- start 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- start start 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3450100a30 0x7f34501049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34501025e0 0x7f3450103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f345010c690 con 0x7f3450101c20 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f345010c510 con 0x7f34501025e0 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f3457352640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f345010c810 con 0x7f3450100a30 2024-09-19T09:21:01.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.009+0000 7f34548ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54906/0 (socket says 172.21.15.52:54906) 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 -- 172.21.15.52:0/317533832 learned_addr learned my addr 172.21.15.52:0/317533832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34550ee640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3450100a30 0x7f34501049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34558ef640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34501025e0 0x7f3450103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 -- 172.21.15.52:0/317533832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3450100a30 msgr2=0x7f34501049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3450100a30 0x7f34501049c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 -- 172.21.15.52:0/317533832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34501025e0 msgr2=0x7f3450103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34501025e0 0x7f3450103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 -- 172.21.15.52:0/317533832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3450103dd0 con 0x7f3450101c20 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34548ed640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f344000c920 tx=0x7f344000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440007c70 con 0x7f3450101c20 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3440007e10 con 0x7f3450101c20 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34501a1ff0 con 0x7f3450101c20 2024-09-19T09:21:01.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440018890 con 0x7f3450101c20 2024-09-19T09:21:01.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.010+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34501a2460 con 0x7f3450101c20 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.011+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34501a2780 con 0x7f3450101c20 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.013+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3440018a70 con 0x7f3450101c20 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.013+0000 7f34467fc640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 0x7f343c0a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.014+0000 7f34550ee640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 0x7f343c0a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.014+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f34400cfbd0 con 0x7f3450101c20 2024-09-19T09:21:01.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.014+0000 7f34550ee640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 0x7f343c0a5820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f344c009230 tx=0x7f344c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.018+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3440014030 con 0x7f3450101c20 2024-09-19T09:21:01.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.193+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f34501a2950 con 0x7f3450101c20 2024-09-19T09:21:01.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.193+0000 7f34467fc640 1 -- 172.21.15.52:0/317533832 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f344009c710 con 0x7f3450101c20 2024-09-19T09:21:01.194 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-09-19T09:21:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.195+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 msgr2=0x7f343c0a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.195+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 0x7f343c0a5820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f344c009230 tx=0x7f344c0315b0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.195+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 msgr2=0x7f3450103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.195+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f344000c920 tx=0x7f344000cde0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 shutdown_connections 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34501025e0 0x7f3450103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3450101c20 0x7f3450103000 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f343c0a3360 0x7f343c0a5820 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 --2- 172.21.15.52:0/317533832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3450100a30 0x7f34501049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 >> 172.21.15.52:0/317533832 conn(0x7f34500fc1b0 msgr2=0x7f345006a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 shutdown_connections 2024-09-19T09:21:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.196+0000 7f3457352640 1 -- 172.21.15.52:0/317533832 wait complete. 2024-09-19T09:21:01.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:21:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 -- 172.21.15.52:0/2543154724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec104eb0 msgr2=0x7f67ec1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 --2- 172.21.15.52:0/2543154724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec104eb0 0x7f67ec1072a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009900 tx=0x7f67e002a410 comp rx=0 tx=0).stop 2024-09-19T09:21:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 -- 172.21.15.52:0/2543154724 shutdown_connections 2024-09-19T09:21:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 --2- 172.21.15.52:0/2543154724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec1077e0 0x7f67ec109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 --2- 172.21.15.52:0/2543154724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec104eb0 0x7f67ec1072a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 --2- 172.21.15.52:0/2543154724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec102580 0x7f67ec104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 -- 172.21.15.52:0/2543154724 >> 172.21.15.52:0/2543154724 conn(0x7f67ec0fc140 msgr2=0x7f67ec0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 -- 172.21.15.52:0/2543154724 shutdown_connections 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.336+0000 7f67f09d6640 1 -- 172.21.15.52:0/2543154724 wait complete. 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 Processor -- start 2024-09-19T09:21:01.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 -- start start 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 0x7f67ec197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec104eb0 0x7f67ec198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec10d7c0 con 0x7f67ec1077e0 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec10d640 con 0x7f67ec104eb0 2024-09-19T09:21:01.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67f09d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67ec10d940 con 0x7f67ec102580 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54924/0 (socket says 172.21.15.52:54924) 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 -- 172.21.15.52:0/709965718 learned_addr learned my addr 172.21.15.52:0/709965718 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67e9d9b640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec104eb0 0x7f67ec198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ea59c640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 0x7f67ec197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 -- 172.21.15.52:0/709965718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 msgr2=0x7f67ec197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 0x7f67ec197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 -- 172.21.15.52:0/709965718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec104eb0 msgr2=0x7f67ec198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec104eb0 0x7f67ec198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ead9d640 1 -- 172.21.15.52:0/709965718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ec19fa60 con 0x7f67ec1077e0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.337+0000 7f67ea59c640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 0x7f67ec197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67ead9d640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67e400e9d0 tx=0x7f67e400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e400cd80 con 0x7f67ec1077e0 2024-09-19T09:21:01.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e4005020 con 0x7f67ec1077e0 2024-09-19T09:21:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ec19fd50 con 0x7f67ec1077e0 2024-09-19T09:21:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e40116d0 con 0x7f67ec1077e0 2024-09-19T09:21:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.338+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ec1a0210 con 0x7f67ec1077e0 2024-09-19T09:21:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.339+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ec0fdc30 con 0x7f67ec1077e0 2024-09-19T09:21:01.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.340+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f67e40051d0 con 0x7f67ec1077e0 2024-09-19T09:21:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.341+0000 7f67db7fe640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 0x7f67d40a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.341+0000 7f67ea59c640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 0x7f67d40a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.341+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f67e40d00e0 con 0x7f67ec1077e0 2024-09-19T09:21:01.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.341+0000 7f67ea59c640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 0x7f67d40a57a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00baa0 tx=0x7f67dc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:01.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.345+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67e4016030 con 0x7f67ec1077e0 2024-09-19T09:21:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:21:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:21:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:21:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/663241910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3349809427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/317533832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.521+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f67ec062e90 con 0x7f67ec1077e0 2024-09-19T09:21:01.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.522+0000 7f67db7fe640 1 -- 172.21.15.52:0/709965718 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f67e409cbc0 con 0x7f67ec1077e0 2024-09-19T09:21:01.522 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 msgr2=0x7f67d40a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 0x7f67d40a57a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00baa0 tx=0x7f67dc005d90 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 msgr2=0x7f67ec19f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67e400e9d0 tx=0x7f67e400ee90 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 shutdown_connections 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67ec1077e0 0x7f67ec19f3f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67ec104eb0 0x7f67ec198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67d40a32e0 0x7f67d40a57a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 --2- 172.21.15.52:0/709965718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67ec102580 0x7f67ec197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 >> 172.21.15.52:0/709965718 conn(0x7f67ec0fc140 msgr2=0x7f67ec102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 shutdown_connections 2024-09-19T09:21:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:01.524+0000 7f67f09d6640 1 -- 172.21.15.52:0/709965718 wait complete. 2024-09-19T09:21:01.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:21:01.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:21:01.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:21:01.535 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/663241910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:01.535 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3349809427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.535 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/317533832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.537 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:21:01.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:01.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:21:01.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1591953869' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:21:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T09:21:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/663241910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3349809427' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/317533832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:21:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:02.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.256+0000 7faddb330640 1 -- 172.21.15.52:0/3724856300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 msgr2=0x7fadd41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 --2- 172.21.15.52:0/3724856300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41021c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009900 tx=0x7fadd002a410 comp rx=0 tx=0).stop 2024-09-19T09:21:02.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 -- 172.21.15.52:0/3724856300 shutdown_connections 2024-09-19T09:21:02.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 --2- 172.21.15.52:0/3724856300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 0x7fadd410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 --2- 172.21.15.52:0/3724856300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 0x7fadd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 --2- 172.21.15.52:0/3724856300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41021c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 -- 172.21.15.52:0/3724856300 >> 172.21.15.52:0/3724856300 conn(0x7fadd40fd8c0 msgr2=0x7fadd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 -- 172.21.15.52:0/3724856300 shutdown_connections 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 -- 172.21.15.52:0/3724856300 wait complete. 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 Processor -- start 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.257+0000 7faddb330640 1 -- start start 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 0x7fadd4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 0x7fadd419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4111f70 con 0x7fadd4101de0 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fadd4111df0 con 0x7fadd4106f10 2024-09-19T09:21:02.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fadd41120f0 con 0x7fadd4102790 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54950/0 (socket says 172.21.15.52:54950) 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 -- 172.21.15.52:0/1437263696 learned_addr learned my addr 172.21.15.52:0/1437263696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd98cd640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 0x7fadd419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd88cb640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 0x7fadd4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 -- 172.21.15.52:0/1437263696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 msgr2=0x7fadd4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 0x7fadd4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 -- 172.21.15.52:0/1437263696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 msgr2=0x7fadd419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 0x7fadd419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 -- 172.21.15.52:0/1437263696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd419d480 con 0x7fadd4101de0 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadd90cc640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006010 tx=0x7fadd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd003f030 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd419d710 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd0003ce0 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0035070 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.258+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd41a5050 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.260+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd41021c0 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.261+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fadd0042030 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.261+0000 7fadca7fc640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 0x7fadc00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.261+0000 7fadd88cb640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 0x7fadc00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.261+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fadd00eff10 con 0x7fadd4101de0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.262+0000 7fadd88cb640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 0x7fadc00a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadd40ff840 tx=0x7fadc400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.266+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fadd00bc620 con 0x7fadd4101de0 2024-09-19T09:21:02.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:02 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/709965718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:21:02.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.476+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadd410a0f0 con 0x7fadd4101de0 2024-09-19T09:21:02.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.477+0000 7fadca7fc640 1 -- 172.21.15.52:0/1437263696 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fadd00c0920 con 0x7fadd4101de0 2024-09-19T09:21:02.478 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:02.478 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:02.478 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 msgr2=0x7fadc00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 0x7fadc00a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fadd40ff840 tx=0x7fadc400b390 comp rx=0 tx=0).stop 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 msgr2=0x7fadd41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006010 tx=0x7fadd00042f0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 shutdown_connections 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fadd4106f10 0x7fadd419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fadc00a3240 0x7fadc00a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd4102790 0x7fadd4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 --2- 172.21.15.52:0/1437263696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd4101de0 0x7fadd41984d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 >> 172.21.15.52:0/1437263696 conn(0x7fadd40fd8c0 msgr2=0x7fadd40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 shutdown_connections 2024-09-19T09:21:02.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:02.479+0000 7faddb330640 1 -- 172.21.15.52:0/1437263696 wait complete. 2024-09-19T09:21:02.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:02 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/709965718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:21:02.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:02 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/709965718' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:21:03.250 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:21:03.250 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:21:03.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:21:03.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 -- 172.21.15.52:0/3873579473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d041077f0 msgr2=0x7f7d04109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 --2- 172.21.15.52:0/3873579473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d041077f0 0x7f7d04109c60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009ca0 tx=0x7f7cfc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 -- 172.21.15.52:0/3873579473 shutdown_connections 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 --2- 172.21.15.52:0/3873579473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d041077f0 0x7f7d04109c60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 --2- 172.21.15.52:0/3873579473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d04104ec0 0x7f7d041072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 --2- 172.21.15.52:0/3873579473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04102590 0x7f7d04104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 -- 172.21.15.52:0/3873579473 >> 172.21.15.52:0/3873579473 conn(0x7f7d040fc170 msgr2=0x7f7d040fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:03.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 -- 172.21.15.52:0/3873579473 shutdown_connections 2024-09-19T09:21:03.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.363+0000 7f7d09206640 1 -- 172.21.15.52:0/3873579473 wait complete. 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 Processor -- start 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 -- start start 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 0x7f7d041982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 0x7f7d0419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0410d7b0 con 0x7f7d04102590 2024-09-19T09:21:03.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0410d630 con 0x7f7d04104ec0 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d09206640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0410d930 con 0x7f7d041077f0 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54976/0 (socket says 172.21.15.52:54976) 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d02d9d640 1 -- 172.21.15.52:0/1025243159 learned_addr learned my addr 172.21.15.52:0/1025243159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d0359e640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 0x7f7d0419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.364+0000 7f7d0259c640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 0x7f7d041982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 -- 172.21.15.52:0/1025243159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 msgr2=0x7f7d0419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 0x7f7d0419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 -- 172.21.15.52:0/1025243159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 msgr2=0x7f7d041982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 0x7f7d041982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 -- 172.21.15.52:0/1025243159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0419f980 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d0259c640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 0x7f7d041982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d0359e640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 0x7f7d0419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d02d9d640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c920 tx=0x7f7cf400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4007c70 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0419fc70 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf4007e10 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4018890 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.365+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d041a01c0 con 0x7f7d04102590 2024-09-19T09:21:03.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.366+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d040fdc60 con 0x7f7d04102590 2024-09-19T09:21:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.367+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7cf4018a70 con 0x7f7d04102590 2024-09-19T09:21:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.368+0000 7f7cebfff640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 0x7f7cec0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.368+0000 7f7d0259c640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 0x7f7cec0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.368+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7cf40cfbf0 con 0x7f7d04102590 2024-09-19T09:21:03.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.368+0000 7f7d0259c640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 0x7f7cec0a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d04199270 tx=0x7f7cf8005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:03.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.372+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cf4014030 con 0x7f7d04102590 2024-09-19T09:21:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:03 smithi086 ceph-mon[34813]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:21:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:03 smithi086 ceph-mon[34813]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:21:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:03 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1437263696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:03.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.545+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d04062630 con 0x7f7cec0a3250 2024-09-19T09:21:03.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.552+0000 7f7cebfff640 1 -- 172.21.15.52:0/1025243159 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258832 (secure 0 0 0) 0x7f7d04062630 con 0x7f7cec0a3250 2024-09-19T09:21:03.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:03.557 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 msgr2=0x7f7cec0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 0x7f7cec0a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7d04199270 tx=0x7f7cf8005d90 comp rx=0 tx=0).stop 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 msgr2=0x7f7d04197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400c920 tx=0x7f7cf400cde0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 shutdown_connections 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cec0a3250 0x7f7cec0a5710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d041077f0 0x7f7d0419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d04104ec0 0x7f7d041982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 --2- 172.21.15.52:0/1025243159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d04102590 0x7f7d04197d60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 >> 172.21.15.52:0/1025243159 conn(0x7f7d040fc170 msgr2=0x7f7d04102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 shutdown_connections 2024-09-19T09:21:03.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.555+0000 7f7d09206640 1 -- 172.21.15.52:0/1025243159 wait complete. 2024-09-19T09:21:03.566 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:03 smithi052 ceph-mon[30947]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:21:03.566 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:03 smithi052 ceph-mon[30947]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:21:03.566 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1437263696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:03.567 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T09:21:03.302956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":484,"num_write":354,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":489,"ondisk_log_size":489,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407808,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534016,"statfs":{"total":1151940427776,"available":1151522832384,"internally_reserved":0,"allocated":13062144,"data_stored":7311054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":47,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338958+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:20:33.338958+0000","last_peered":"2024-09-19T09:20:33.338958+0000","last_clean":"2024-09-19T09:20:33.338958+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:20:33.338958+0000","last_undegraded":"2024-09-19T09:20:33.338958+0000","last_fullsized":"2024-09-19T09:20:33.338958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338656+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:20:33.338656+0000","last_peered":"2024-09-19T09:20:33.338656+0000","last_clean":"2024-09-19T09:20:33.338656+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:20:33.338656+0000","last_undegraded":"2024-09-19T09:20:33.338656+0000","last_fullsized":"2024-09-19T09:20:33.338656+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226656+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:20:33.226656+0000","last_peered":"2024-09-19T09:20:33.226656+0000","last_clean":"2024-09-19T09:20:33.226656+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:20:33.226656+0000","last_undegraded":"2024-09-19T09:20:33.226656+0000","last_fullsized":"2024-09-19T09:20:33.226656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089669+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:20:33.089669+0000","last_peered":"2024-09-19T09:20:33.089669+0000","last_clean":"2024-09-19T09:20:33.089669+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:20:33.089669+0000","last_undegraded":"2024-09-19T09:20:33.089669+0000","last_fullsized":"2024-09-19T09:20:33.089669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227042+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:20:33.227042+0000","last_peered":"2024-09-19T09:20:33.227042+0000","last_clean":"2024-09-19T09:20:33.227042+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:20:33.227042+0000","last_undegraded":"2024-09-19T09:20:33.227042+0000","last_fullsized":"2024-09-19T09:20:33.227042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113217+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:20:33.113217+0000","last_peered":"2024-09-19T09:20:33.113217+0000","last_clean":"2024-09-19T09:20:33.113217+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:20:33.113217+0000","last_undegraded":"2024-09-19T09:20:33.113217+0000","last_fullsized":"2024-09-19T09:20:33.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339168+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:20:33.339168+0000","last_peered":"2024-09-19T09:20:33.339168+0000","last_clean":"2024-09-19T09:20:33.339168+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:20:33.339168+0000","last_undegraded":"2024-09-19T09:20:33.339168+0000","last_fullsized":"2024-09-19T09:20:33.339168+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091338+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:20:33.091338+0000","last_peered":"2024-09-19T09:20:33.091338+0000","last_clean":"2024-09-19T09:20:33.091338+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:20:33.091338+0000","last_undegraded":"2024-09-19T09:20:33.091338+0000","last_fullsized":"2024-09-19T09:20:33.091338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338567+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:20:33.338567+0000","last_peered":"2024-09-19T09:20:33.338567+0000","last_clean":"2024-09-19T09:20:33.338567+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:20:33.338567+0000","last_undegraded":"2024-09-19T09:20:33.338567+0000","last_fullsized":"2024-09-19T09:20:33.338567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113237+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:20:33.113237+0000","last_peered":"2024-09-19T09:20:33.113237+0000","last_clean":"2024-09-19T09:20:33.113237+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:20:33.113237+0000","last_undegraded":"2024-09-19T09:20:33.113237+0000","last_fullsized":"2024-09-19T09:20:33.113237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089723+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:20:33.089723+0000","last_peered":"2024-09-19T09:20:33.089723+0000","last_clean":"2024-09-19T09:20:33.089723+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:20:33.089723+0000","last_undegraded":"2024-09-19T09:20:33.089723+0000","last_fullsized":"2024-09-19T09:20:33.089723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338375+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:20:33.338375+0000","last_peered":"2024-09-19T09:20:33.338375+0000","last_clean":"2024-09-19T09:20:33.338375+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:20:33.338375+0000","last_undegraded":"2024-09-19T09:20:33.338375+0000","last_fullsized":"2024-09-19T09:20:33.338375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090107+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:20:33.090107+0000","last_peered":"2024-09-19T09:20:33.090107+0000","last_clean":"2024-09-19T09:20:33.090107+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:20:33.090107+0000","last_undegraded":"2024-09-19T09:20:33.090107+0000","last_fullsized":"2024-09-19T09:20:33.090107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338712+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:20:33.338712+0000","last_peered":"2024-09-19T09:20:33.338712+0000","last_clean":"2024-09-19T09:20:33.338712+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:20:33.338712+0000","last_undegraded":"2024-09-19T09:20:33.338712+0000","last_fullsized":"2024-09-19T09:20:33.338712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113206+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:20:33.113206+0000","last_peered":"2024-09-19T09:20:33.113206+0000","last_clean":"2024-09-19T09:20:33.113206+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:20:33.113206+0000","last_undegraded":"2024-09-19T09:20:33.113206+0000","last_fullsized":"2024-09-19T09:20:33.113206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338402+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:20:33.338402+0000","last_peered":"2024-09-19T09:20:33.338402+0000","last_clean":"2024-09-19T09:20:33.338402+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:20:33.338402+0000","last_undegraded":"2024-09-19T09:20:33.338402+0000","last_fullsized":"2024-09-19T09:20:33.338402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338486+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:20:33.338486+0000","last_peered":"2024-09-19T09:20:33.338486+0000","last_clean":"2024-09-19T09:20:33.338486+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:20:33.338486+0000","last_undegraded":"2024-09-19T09:20:33.338486+0000","last_fullsized":"2024-09-19T09:20:33.338486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:59.921931+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:20:59.921931+0000","last_peered":"2024-09-19T09:20:59.921931+0000","last_clean":"2024-09-19T09:20:59.921931+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:20:59.921931+0000","last_undegraded":"2024-09-19T09:20:59.921931+0000","last_fullsized":"2024-09-19T09:20:59.921931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139673+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:20:33.139673+0000","last_peered":"2024-09-19T09:20:33.139673+0000","last_clean":"2024-09-19T09:20:33.139673+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:20:33.139673+0000","last_undegraded":"2024-09-19T09:20:33.139673+0000","last_fullsized":"2024-09-19T09:20:33.139673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089727+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:20:33.089727+0000","last_peered":"2024-09-19T09:20:33.089727+0000","last_clean":"2024-09-19T09:20:33.089727+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:20:33.089727+0000","last_undegraded":"2024-09-19T09:20:33.089727+0000","last_fullsized":"2024-09-19T09:20:33.089727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.290071+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:20:33.290071+0000","last_peered":"2024-09-19T09:20:33.290071+0000","last_clean":"2024-09-19T09:20:33.290071+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:20:33.290071+0000","last_undegraded":"2024-09-19T09:20:33.290071+0000","last_fullsized":"2024-09-19T09:20:33.290071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.924246+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:01.924246+0000","last_peered":"2024-09-19T09:21:01.924246+0000","last_clean":"2024-09-19T09:21:01.924246+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:01.924246+0000","last_undegraded":"2024-09-19T09:21:01.924246+0000","last_fullsized":"2024-09-19T09:21:01.924246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":261,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:02.926149+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:02.926149+0000","last_peered":"2024-09-19T09:21:02.926149+0000","last_clean":"2024-09-19T09:21:02.926149+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:02.926149+0000","last_undegraded":"2024-09-19T09:21:02.926149+0000","last_fullsized":"2024-09-19T09:21:02.926149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338997+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:20:33.338997+0000","last_peered":"2024-09-19T09:20:33.338997+0000","last_clean":"2024-09-19T09:20:33.338997+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:20:33.338997+0000","last_undegraded":"2024-09-19T09:20:33.338997+0000","last_fullsized":"2024-09-19T09:20:33.338997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.112997+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:20:33.112997+0000","last_peered":"2024-09-19T09:20:33.112997+0000","last_clean":"2024-09-19T09:20:33.112997+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:20:33.112997+0000","last_undegraded":"2024-09-19T09:20:33.112997+0000","last_fullsized":"2024-09-19T09:20:33.112997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226934+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:20:33.226934+0000","last_peered":"2024-09-19T09:20:33.226934+0000","last_clean":"2024-09-19T09:20:33.226934+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:20:33.226934+0000","last_undegraded":"2024-09-19T09:20:33.226934+0000","last_fullsized":"2024-09-19T09:20:33.226934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:00.942175+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:00.942175+0000","last_peered":"2024-09-19T09:21:00.942175+0000","last_clean":"2024-09-19T09:21:00.942175+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:00.942175+0000","last_undegraded":"2024-09-19T09:21:00.942175+0000","last_fullsized":"2024-09-19T09:21:00.942175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226486+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:20:33.226486+0000","last_peered":"2024-09-19T09:20:33.226486+0000","last_clean":"2024-09-19T09:20:33.226486+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:20:33.226486+0000","last_undegraded":"2024-09-19T09:20:33.226486+0000","last_fullsized":"2024-09-19T09:20:33.226486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139479+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:20:33.139479+0000","last_peered":"2024-09-19T09:20:33.139479+0000","last_clean":"2024-09-19T09:20:33.139479+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:20:33.139479+0000","last_undegraded":"2024-09-19T09:20:33.139479+0000","last_fullsized":"2024-09-19T09:20:33.139479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339070+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:20:33.339070+0000","last_peered":"2024-09-19T09:20:33.339070+0000","last_clean":"2024-09-19T09:20:33.339070+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:20:33.339070+0000","last_undegraded":"2024-09-19T09:20:33.339070+0000","last_fullsized":"2024-09-19T09:20:33.339070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226980+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:20:33.226980+0000","last_peered":"2024-09-19T09:20:33.226980+0000","last_clean":"2024-09-19T09:20:33.226980+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:20:33.226980+0000","last_undegraded":"2024-09-19T09:20:33.226980+0000","last_fullsized":"2024-09-19T09:20:33.226980+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226889+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:20:33.226889+0000","last_peered":"2024-09-19T09:20:33.226889+0000","last_clean":"2024-09-19T09:20:33.226889+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:20:33.226889+0000","last_undegraded":"2024-09-19T09:20:33.226889+0000","last_fullsized":"2024-09-19T09:20:33.226889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227104+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:20:33.227104+0000","last_peered":"2024-09-19T09:20:33.227104+0000","last_clean":"2024-09-19T09:20:33.227104+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:20:33.227104+0000","last_undegraded":"2024-09-19T09:20:33.227104+0000","last_fullsized":"2024-09-19T09:20:33.227104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089851+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:20:33.089851+0000","last_peered":"2024-09-19T09:20:33.089851+0000","last_clean":"2024-09-19T09:20:33.089851+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:20:33.089851+0000","last_undegraded":"2024-09-19T09:20:33.089851+0000","last_fullsized":"2024-09-19T09:20:33.089851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113037+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:20:33.113037+0000","last_peered":"2024-09-19T09:20:33.113037+0000","last_clean":"2024-09-19T09:20:33.113037+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:20:33.113037+0000","last_undegraded":"2024-09-19T09:20:33.113037+0000","last_fullsized":"2024-09-19T09:20:33.113037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:58.936601+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:20:58.936601+0000","last_peered":"2024-09-19T09:20:58.936601+0000","last_clean":"2024-09-19T09:20:58.936601+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:20:58.936601+0000","last_undegraded":"2024-09-19T09:20:58.936601+0000","last_fullsized":"2024-09-19T09:20:58.936601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139393+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:20:33.139393+0000","last_peered":"2024-09-19T09:20:33.139393+0000","last_clean":"2024-09-19T09:20:33.139393+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:20:33.139393+0000","last_undegraded":"2024-09-19T09:20:33.139393+0000","last_fullsized":"2024-09-19T09:20:33.139393+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113307+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:20:33.113307+0000","last_peered":"2024-09-19T09:20:33.113307+0000","last_clean":"2024-09-19T09:20:33.113307+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:20:33.113307+0000","last_undegraded":"2024-09-19T09:20:33.113307+0000","last_fullsized":"2024-09-19T09:20:33.113307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091377+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091377+0000","last_peered":"2024-09-19T09:20:33.091377+0000","last_clean":"2024-09-19T09:20:33.091377+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091377+0000","last_undegraded":"2024-09-19T09:20:33.091377+0000","last_fullsized":"2024-09-19T09:20:33.091377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090189+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:20:33.090189+0000","last_peered":"2024-09-19T09:20:33.090189+0000","last_clean":"2024-09-19T09:20:33.090189+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:20:33.090189+0000","last_undegraded":"2024-09-19T09:20:33.090189+0000","last_fullsized":"2024-09-19T09:20:33.090189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338902+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:20:33.338902+0000","last_peered":"2024-09-19T09:20:33.338902+0000","last_clean":"2024-09-19T09:20:33.338902+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:20:33.338902+0000","last_undegraded":"2024-09-19T09:20:33.338902+0000","last_fullsized":"2024-09-19T09:20:33.338902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338482+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:20:33.338482+0000","last_peered":"2024-09-19T09:20:33.338482+0000","last_clean":"2024-09-19T09:20:33.338482+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:20:33.338482+0000","last_undegraded":"2024-09-19T09:20:33.338482+0000","last_fullsized":"2024-09-19T09:20:33.338482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089874+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:20:33.089874+0000","last_peered":"2024-09-19T09:20:33.089874+0000","last_clean":"2024-09-19T09:20:33.089874+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:20:33.089874+0000","last_undegraded":"2024-09-19T09:20:33.089874+0000","last_fullsized":"2024-09-19T09:20:33.089874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226714+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:20:33.226714+0000","last_peered":"2024-09-19T09:20:33.226714+0000","last_clean":"2024-09-19T09:20:33.226714+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:20:33.226714+0000","last_undegraded":"2024-09-19T09:20:33.226714+0000","last_fullsized":"2024-09-19T09:20:33.226714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.097166+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:20:33.097166+0000","last_peered":"2024-09-19T09:20:33.097166+0000","last_clean":"2024-09-19T09:20:33.097166+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:20:33.097166+0000","last_undegraded":"2024-09-19T09:20:33.097166+0000","last_fullsized":"2024-09-19T09:20:33.097166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090022+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:20:33.090022+0000","last_peered":"2024-09-19T09:20:33.090022+0000","last_clean":"2024-09-19T09:20:33.090022+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:20:33.090022+0000","last_undegraded":"2024-09-19T09:20:33.090022+0000","last_fullsized":"2024-09-19T09:20:33.090022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091533+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091533+0000","last_peered":"2024-09-19T09:20:33.091533+0000","last_clean":"2024-09-19T09:20:33.091533+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091533+0000","last_undegraded":"2024-09-19T09:20:33.091533+0000","last_fullsized":"2024-09-19T09:20:33.091533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":599,"num_read_kb":375,"num_write":171,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678050,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561078,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1036825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920832,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280584,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:03.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:21:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:03 smithi169 ceph-mon[35454]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-19T09:21:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:03 smithi169 ceph-mon[35454]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:21:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:03 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1437263696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 -- 172.21.15.52:0/3022499475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c104ee0 msgr2=0x7f881c1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 --2- 172.21.15.52:0/3022499475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c104ee0 0x7f881c1072d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8810009900 tx=0x7f881002a410 comp rx=0 tx=0).stop 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 -- 172.21.15.52:0/3022499475 shutdown_connections 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 --2- 172.21.15.52:0/3022499475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 --2- 172.21.15.52:0/3022499475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c104ee0 0x7f881c1072d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 --2- 172.21.15.52:0/3022499475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c1025b0 0x7f881c1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 -- 172.21.15.52:0/3022499475 >> 172.21.15.52:0/3022499475 conn(0x7f881c0fc1b0 msgr2=0x7f881c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 -- 172.21.15.52:0/3022499475 shutdown_connections 2024-09-19T09:21:03.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.710+0000 7f882192c640 1 -- 172.21.15.52:0/3022499475 wait complete. 2024-09-19T09:21:03.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 Processor -- start 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 -- start start 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 0x7f881c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10d810 con 0x7f881c1025b0 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10d690 con 0x7f881c107810 2024-09-19T09:21:03.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f882192c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f881c10d990 con 0x7f881c104ee0 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f881affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f881affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54992/0 (socket says 172.21.15.52:54992) 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f881affd640 1 -- 172.21.15.52:0/1106044743 learned_addr learned my addr 172.21.15.52:0/1106044743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f881b7fe640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.711+0000 7f881a7fc640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 0x7f881c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 -- 172.21.15.52:0/1106044743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 msgr2=0x7f881c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 0x7f881c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 -- 172.21.15.52:0/1106044743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 msgr2=0x7f881c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 -- 172.21.15.52:0/1106044743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c19fb40 con 0x7f881c1025b0 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881a7fc640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 0x7f881c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881b7fe640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:03.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f881affd640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f880c00d950 tx=0x7f880c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c017070 con 0x7f881c1025b0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f880c009c30 con 0x7f881c1025b0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c19fe30 con 0x7f881c1025b0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c00f6b0 con 0x7f881c1025b0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.712+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c1a02f0 con 0x7f881c1025b0 2024-09-19T09:21:03.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.713+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c0fdca0 con 0x7f881c1025b0 2024-09-19T09:21:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.714+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f880c0109d0 con 0x7f881c1025b0 2024-09-19T09:21:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.715+0000 7f882092a640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 0x7f88040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.715+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f880c0cf690 con 0x7f881c1025b0 2024-09-19T09:21:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.715+0000 7f881a7fc640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 0x7f88040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:03.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.716+0000 7f881a7fc640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 0x7f88040a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f881002a930 tx=0x7f8810000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:03.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.719+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f880c009de0 con 0x7f881c1025b0 2024-09-19T09:21:03.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.892+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f881c062630 con 0x7f88040a32d0 2024-09-19T09:21:03.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.898+0000 7f882092a640 1 -- 172.21.15.52:0/1106044743 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258832 (secure 0 0 0) 0x7f881c062630 con 0x7f88040a32d0 2024-09-19T09:21:03.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:03.903 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 msgr2=0x7f88040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 0x7f88040a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f881002a930 tx=0x7f8810000bc0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 msgr2=0x7f881c197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f880c00d950 tx=0x7f880c00de10 comp rx=0 tx=0).stop 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 shutdown_connections 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f881c107810 0x7f881c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88040a32d0 0x7f88040a5790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f881c104ee0 0x7f881c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 --2- 172.21.15.52:0/1106044743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f881c1025b0 0x7f881c197f20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 >> 172.21.15.52:0/1106044743 conn(0x7f881c0fc1b0 msgr2=0x7f881c102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 shutdown_connections 2024-09-19T09:21:03.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:03.902+0000 7f882192c640 1 -- 172.21.15.52:0/1106044743 wait complete. 2024-09-19T09:21:03.913 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T09:21:03.302956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":484,"num_write":354,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":489,"ondisk_log_size":489,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407808,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534016,"statfs":{"total":1151940427776,"available":1151522832384,"internally_reserved":0,"allocated":13062144,"data_stored":7311054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":47,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338958+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:20:33.338958+0000","last_peered":"2024-09-19T09:20:33.338958+0000","last_clean":"2024-09-19T09:20:33.338958+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:20:33.338958+0000","last_undegraded":"2024-09-19T09:20:33.338958+0000","last_fullsized":"2024-09-19T09:20:33.338958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338656+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:20:33.338656+0000","last_peered":"2024-09-19T09:20:33.338656+0000","last_clean":"2024-09-19T09:20:33.338656+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:20:33.338656+0000","last_undegraded":"2024-09-19T09:20:33.338656+0000","last_fullsized":"2024-09-19T09:20:33.338656+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226656+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:20:33.226656+0000","last_peered":"2024-09-19T09:20:33.226656+0000","last_clean":"2024-09-19T09:20:33.226656+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:20:33.226656+0000","last_undegraded":"2024-09-19T09:20:33.226656+0000","last_fullsized":"2024-09-19T09:20:33.226656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089669+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:20:33.089669+0000","last_peered":"2024-09-19T09:20:33.089669+0000","last_clean":"2024-09-19T09:20:33.089669+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:20:33.089669+0000","last_undegraded":"2024-09-19T09:20:33.089669+0000","last_fullsized":"2024-09-19T09:20:33.089669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227042+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:20:33.227042+0000","last_peered":"2024-09-19T09:20:33.227042+0000","last_clean":"2024-09-19T09:20:33.227042+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:20:33.227042+0000","last_undegraded":"2024-09-19T09:20:33.227042+0000","last_fullsized":"2024-09-19T09:20:33.227042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113217+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:20:33.113217+0000","last_peered":"2024-09-19T09:20:33.113217+0000","last_clean":"2024-09-19T09:20:33.113217+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:20:33.113217+0000","last_undegraded":"2024-09-19T09:20:33.113217+0000","last_fullsized":"2024-09-19T09:20:33.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339168+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:20:33.339168+0000","last_peered":"2024-09-19T09:20:33.339168+0000","last_clean":"2024-09-19T09:20:33.339168+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:20:33.339168+0000","last_undegraded":"2024-09-19T09:20:33.339168+0000","last_fullsized":"2024-09-19T09:20:33.339168+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091338+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:20:33.091338+0000","last_peered":"2024-09-19T09:20:33.091338+0000","last_clean":"2024-09-19T09:20:33.091338+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:20:33.091338+0000","last_undegraded":"2024-09-19T09:20:33.091338+0000","last_fullsized":"2024-09-19T09:20:33.091338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338567+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:20:33.338567+0000","last_peered":"2024-09-19T09:20:33.338567+0000","last_clean":"2024-09-19T09:20:33.338567+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:20:33.338567+0000","last_undegraded":"2024-09-19T09:20:33.338567+0000","last_fullsized":"2024-09-19T09:20:33.338567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113237+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:20:33.113237+0000","last_peered":"2024-09-19T09:20:33.113237+0000","last_clean":"2024-09-19T09:20:33.113237+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:20:33.113237+0000","last_undegraded":"2024-09-19T09:20:33.113237+0000","last_fullsized":"2024-09-19T09:20:33.113237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089723+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:20:33.089723+0000","last_peered":"2024-09-19T09:20:33.089723+0000","last_clean":"2024-09-19T09:20:33.089723+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:20:33.089723+0000","last_undegraded":"2024-09-19T09:20:33.089723+0000","last_fullsized":"2024-09-19T09:20:33.089723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338375+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:20:33.338375+0000","last_peered":"2024-09-19T09:20:33.338375+0000","last_clean":"2024-09-19T09:20:33.338375+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:20:33.338375+0000","last_undegraded":"2024-09-19T09:20:33.338375+0000","last_fullsized":"2024-09-19T09:20:33.338375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090107+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:20:33.090107+0000","last_peered":"2024-09-19T09:20:33.090107+0000","last_clean":"2024-09-19T09:20:33.090107+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:20:33.090107+0000","last_undegraded":"2024-09-19T09:20:33.090107+0000","last_fullsized":"2024-09-19T09:20:33.090107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338712+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:20:33.338712+0000","last_peered":"2024-09-19T09:20:33.338712+0000","last_clean":"2024-09-19T09:20:33.338712+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:20:33.338712+0000","last_undegraded":"2024-09-19T09:20:33.338712+0000","last_fullsized":"2024-09-19T09:20:33.338712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113206+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:20:33.113206+0000","last_peered":"2024-09-19T09:20:33.113206+0000","last_clean":"2024-09-19T09:20:33.113206+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:20:33.113206+0000","last_undegraded":"2024-09-19T09:20:33.113206+0000","last_fullsized":"2024-09-19T09:20:33.113206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338402+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:20:33.338402+0000","last_peered":"2024-09-19T09:20:33.338402+0000","last_clean":"2024-09-19T09:20:33.338402+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:20:33.338402+0000","last_undegraded":"2024-09-19T09:20:33.338402+0000","last_fullsized":"2024-09-19T09:20:33.338402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338486+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:20:33.338486+0000","last_peered":"2024-09-19T09:20:33.338486+0000","last_clean":"2024-09-19T09:20:33.338486+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:20:33.338486+0000","last_undegraded":"2024-09-19T09:20:33.338486+0000","last_fullsized":"2024-09-19T09:20:33.338486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:59.921931+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:20:59.921931+0000","last_peered":"2024-09-19T09:20:59.921931+0000","last_clean":"2024-09-19T09:20:59.921931+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:20:59.921931+0000","last_undegraded":"2024-09-19T09:20:59.921931+0000","last_fullsized":"2024-09-19T09:20:59.921931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139673+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:20:33.139673+0000","last_peered":"2024-09-19T09:20:33.139673+0000","last_clean":"2024-09-19T09:20:33.139673+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:20:33.139673+0000","last_undegraded":"2024-09-19T09:20:33.139673+0000","last_fullsized":"2024-09-19T09:20:33.139673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089727+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:20:33.089727+0000","last_peered":"2024-09-19T09:20:33.089727+0000","last_clean":"2024-09-19T09:20:33.089727+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:20:33.089727+0000","last_undegraded":"2024-09-19T09:20:33.089727+0000","last_fullsized":"2024-09-19T09:20:33.089727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.290071+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:20:33.290071+0000","last_peered":"2024-09-19T09:20:33.290071+0000","last_clean":"2024-09-19T09:20:33.290071+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:20:33.290071+0000","last_undegraded":"2024-09-19T09:20:33.290071+0000","last_fullsized":"2024-09-19T09:20:33.290071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.924246+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:01.924246+0000","last_peered":"2024-09-19T09:21:01.924246+0000","last_clean":"2024-09-19T09:21:01.924246+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:01.924246+0000","last_undegraded":"2024-09-19T09:21:01.924246+0000","last_fullsized":"2024-09-19T09:21:01.924246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":261,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:02.926149+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:02.926149+0000","last_peered":"2024-09-19T09:21:02.926149+0000","last_clean":"2024-09-19T09:21:02.926149+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:02.926149+0000","last_undegraded":"2024-09-19T09:21:02.926149+0000","last_fullsized":"2024-09-19T09:21:02.926149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338997+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:20:33.338997+0000","last_peered":"2024-09-19T09:20:33.338997+0000","last_clean":"2024-09-19T09:20:33.338997+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:20:33.338997+0000","last_undegraded":"2024-09-19T09:20:33.338997+0000","last_fullsized":"2024-09-19T09:20:33.338997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.112997+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:20:33.112997+0000","last_peered":"2024-09-19T09:20:33.112997+0000","last_clean":"2024-09-19T09:20:33.112997+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:20:33.112997+0000","last_undegraded":"2024-09-19T09:20:33.112997+0000","last_fullsized":"2024-09-19T09:20:33.112997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226934+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:20:33.226934+0000","last_peered":"2024-09-19T09:20:33.226934+0000","last_clean":"2024-09-19T09:20:33.226934+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:20:33.226934+0000","last_undegraded":"2024-09-19T09:20:33.226934+0000","last_fullsized":"2024-09-19T09:20:33.226934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:00.942175+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:00.942175+0000","last_peered":"2024-09-19T09:21:00.942175+0000","last_clean":"2024-09-19T09:21:00.942175+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:00.942175+0000","last_undegraded":"2024-09-19T09:21:00.942175+0000","last_fullsized":"2024-09-19T09:21:00.942175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226486+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:20:33.226486+0000","last_peered":"2024-09-19T09:20:33.226486+0000","last_clean":"2024-09-19T09:20:33.226486+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:20:33.226486+0000","last_undegraded":"2024-09-19T09:20:33.226486+0000","last_fullsized":"2024-09-19T09:20:33.226486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139479+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:20:33.139479+0000","last_peered":"2024-09-19T09:20:33.139479+0000","last_clean":"2024-09-19T09:20:33.139479+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:20:33.139479+0000","last_undegraded":"2024-09-19T09:20:33.139479+0000","last_fullsized":"2024-09-19T09:20:33.139479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339070+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:20:33.339070+0000","last_peered":"2024-09-19T09:20:33.339070+0000","last_clean":"2024-09-19T09:20:33.339070+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:20:33.339070+0000","last_undegraded":"2024-09-19T09:20:33.339070+0000","last_fullsized":"2024-09-19T09:20:33.339070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226980+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:20:33.226980+0000","last_peered":"2024-09-19T09:20:33.226980+0000","last_clean":"2024-09-19T09:20:33.226980+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:20:33.226980+0000","last_undegraded":"2024-09-19T09:20:33.226980+0000","last_fullsized":"2024-09-19T09:20:33.226980+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226889+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:20:33.226889+0000","last_peered":"2024-09-19T09:20:33.226889+0000","last_clean":"2024-09-19T09:20:33.226889+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:20:33.226889+0000","last_undegraded":"2024-09-19T09:20:33.226889+0000","last_fullsized":"2024-09-19T09:20:33.226889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227104+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:20:33.227104+0000","last_peered":"2024-09-19T09:20:33.227104+0000","last_clean":"2024-09-19T09:20:33.227104+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:20:33.227104+0000","last_undegraded":"2024-09-19T09:20:33.227104+0000","last_fullsized":"2024-09-19T09:20:33.227104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089851+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:20:33.089851+0000","last_peered":"2024-09-19T09:20:33.089851+0000","last_clean":"2024-09-19T09:20:33.089851+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:20:33.089851+0000","last_undegraded":"2024-09-19T09:20:33.089851+0000","last_fullsized":"2024-09-19T09:20:33.089851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113037+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:20:33.113037+0000","last_peered":"2024-09-19T09:20:33.113037+0000","last_clean":"2024-09-19T09:20:33.113037+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:20:33.113037+0000","last_undegraded":"2024-09-19T09:20:33.113037+0000","last_fullsized":"2024-09-19T09:20:33.113037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:58.936601+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:20:58.936601+0000","last_peered":"2024-09-19T09:20:58.936601+0000","last_clean":"2024-09-19T09:20:58.936601+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:20:58.936601+0000","last_undegraded":"2024-09-19T09:20:58.936601+0000","last_fullsized":"2024-09-19T09:20:58.936601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139393+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:20:33.139393+0000","last_peered":"2024-09-19T09:20:33.139393+0000","last_clean":"2024-09-19T09:20:33.139393+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:20:33.139393+0000","last_undegraded":"2024-09-19T09:20:33.139393+0000","last_fullsized":"2024-09-19T09:20:33.139393+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113307+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:20:33.113307+0000","last_peered":"2024-09-19T09:20:33.113307+0000","last_clean":"2024-09-19T09:20:33.113307+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:20:33.113307+0000","last_undegraded":"2024-09-19T09:20:33.113307+0000","last_fullsized":"2024-09-19T09:20:33.113307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091377+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091377+0000","last_peered":"2024-09-19T09:20:33.091377+0000","last_clean":"2024-09-19T09:20:33.091377+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091377+0000","last_undegraded":"2024-09-19T09:20:33.091377+0000","last_fullsized":"2024-09-19T09:20:33.091377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090189+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:20:33.090189+0000","last_peered":"2024-09-19T09:20:33.090189+0000","last_clean":"2024-09-19T09:20:33.090189+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:20:33.090189+0000","last_undegraded":"2024-09-19T09:20:33.090189+0000","last_fullsized":"2024-09-19T09:20:33.090189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338902+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:20:33.338902+0000","last_peered":"2024-09-19T09:20:33.338902+0000","last_clean":"2024-09-19T09:20:33.338902+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:20:33.338902+0000","last_undegraded":"2024-09-19T09:20:33.338902+0000","last_fullsized":"2024-09-19T09:20:33.338902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338482+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:20:33.338482+0000","last_peered":"2024-09-19T09:20:33.338482+0000","last_clean":"2024-09-19T09:20:33.338482+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:20:33.338482+0000","last_undegraded":"2024-09-19T09:20:33.338482+0000","last_fullsized":"2024-09-19T09:20:33.338482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089874+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:20:33.089874+0000","last_peered":"2024-09-19T09:20:33.089874+0000","last_clean":"2024-09-19T09:20:33.089874+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:20:33.089874+0000","last_undegraded":"2024-09-19T09:20:33.089874+0000","last_fullsized":"2024-09-19T09:20:33.089874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226714+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:20:33.226714+0000","last_peered":"2024-09-19T09:20:33.226714+0000","last_clean":"2024-09-19T09:20:33.226714+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:20:33.226714+0000","last_undegraded":"2024-09-19T09:20:33.226714+0000","last_fullsized":"2024-09-19T09:20:33.226714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.097166+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:20:33.097166+0000","last_peered":"2024-09-19T09:20:33.097166+0000","last_clean":"2024-09-19T09:20:33.097166+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:20:33.097166+0000","last_undegraded":"2024-09-19T09:20:33.097166+0000","last_fullsized":"2024-09-19T09:20:33.097166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090022+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:20:33.090022+0000","last_peered":"2024-09-19T09:20:33.090022+0000","last_clean":"2024-09-19T09:20:33.090022+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:20:33.090022+0000","last_undegraded":"2024-09-19T09:20:33.090022+0000","last_fullsized":"2024-09-19T09:20:33.090022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091533+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091533+0000","last_peered":"2024-09-19T09:20:33.091533+0000","last_clean":"2024-09-19T09:20:33.091533+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091533+0000","last_undegraded":"2024-09-19T09:20:33.091533+0000","last_fullsized":"2024-09-19T09:20:33.091533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":599,"num_read_kb":375,"num_write":171,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678050,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561078,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1036825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920832,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280584,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:03.917 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:21:03.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:21:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 -- 172.21.15.52:0/4165459200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760102d20 msgr2=0x7f87601031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 --2- 172.21.15.52:0/4165459200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760102d20 0x7f87601031a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8750009900 tx=0x7f875002a410 comp rx=0 tx=0).stop 2024-09-19T09:21:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 -- 172.21.15.52:0/4165459200 shutdown_connections 2024-09-19T09:21:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 --2- 172.21.15.52:0/4165459200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87601036e0 0x7f8760109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 --2- 172.21.15.52:0/4165459200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760102d20 0x7f87601031a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 --2- 172.21.15.52:0/4165459200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8760101b30 0x7f8760101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 -- 172.21.15.52:0/4165459200 >> 172.21.15.52:0/4165459200 conn(0x7f87600fd270 msgr2=0x7f87600ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 -- 172.21.15.52:0/4165459200 shutdown_connections 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.056+0000 7f876552a640 1 -- 172.21.15.52:0/4165459200 wait complete. 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 Processor -- start 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 -- start start 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760102d20 0x7f8760198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 0x7f876019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f876010d7b0 con 0x7f8760101b30 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f876010d630 con 0x7f87601036e0 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f876552a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f876010d930 con 0x7f8760102d20 2024-09-19T09:21:04.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f875effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f875effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54998/0 (socket says 172.21.15.52:54998) 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.057+0000 7f875effd640 1 -- 172.21.15.52:0/1228759053 learned_addr learned my addr 172.21.15.52:0/1228759053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875f7fe640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 0x7f876019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875e7fc640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760102d20 0x7f8760198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 -- 172.21.15.52:0/1228759053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760102d20 msgr2=0x7f8760198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760102d20 0x7f8760198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 -- 172.21.15.52:0/1228759053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 msgr2=0x7f876019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 0x7f876019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 -- 172.21.15.52:0/1228759053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876019fa60 con 0x7f8760101b30 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875f7fe640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 0x7f876019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f875effd640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f874800d950 tx=0x7f874800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748017020 con 0x7f8760101b30 2024-09-19T09:21:04.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8748009c30 con 0x7f8760101b30 2024-09-19T09:21:04.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876019fd50 con 0x7f8760101b30 2024-09-19T09:21:04.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800f720 con 0x7f8760101b30 2024-09-19T09:21:04.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.058+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87601a0200 con 0x7f8760101b30 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.059+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8760108f10 con 0x7f8760101b30 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.060+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f874801a020 con 0x7f8760101b30 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.061+0000 7f8757fff640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 0x7f874c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.061+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f87480cf920 con 0x7f8760101b30 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.061+0000 7f875e7fc640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 0x7f874c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:04.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.061+0000 7f875e7fc640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 0x7f874c0a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f87500315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:04.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.065+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8748021020 con 0x7f8760101b30 2024-09-19T09:21:04.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.239+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8760062630 con 0x7f874c0a32d0 2024-09-19T09:21:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.245+0000 7f8757fff640 1 -- 172.21.15.52:0/1228759053 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258832 (secure 0 0 0) 0x7f8760062630 con 0x7f874c0a32d0 2024-09-19T09:21:04.248 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:04.250 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 msgr2=0x7f874c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 0x7f874c0a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f87500315d0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 msgr2=0x7f8760197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f874800d950 tx=0x7f874800de10 comp rx=0 tx=0).stop 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 shutdown_connections 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87601036e0 0x7f876019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f874c0a32d0 0x7f874c0a5790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8760102d20 0x7f8760198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 --2- 172.21.15.52:0/1228759053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8760101b30 0x7f8760197e40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 >> 172.21.15.52:0/1228759053 conn(0x7f87600fd270 msgr2=0x7f87601060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 shutdown_connections 2024-09-19T09:21:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:04.249+0000 7f876552a640 1 -- 172.21.15.52:0/1228759053 wait complete. 2024-09-19T09:21:04.260 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T09:21:03.302956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":484,"num_write":354,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":489,"ondisk_log_size":489,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407808,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534016,"statfs":{"total":1151940427776,"available":1151522832384,"internally_reserved":0,"allocated":13062144,"data_stored":7311054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":47,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002678"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338958+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:20:33.338958+0000","last_peered":"2024-09-19T09:20:33.338958+0000","last_clean":"2024-09-19T09:20:33.338958+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:20:33.338958+0000","last_undegraded":"2024-09-19T09:20:33.338958+0000","last_fullsized":"2024-09-19T09:20:33.338958+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338656+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:20:33.338656+0000","last_peered":"2024-09-19T09:20:33.338656+0000","last_clean":"2024-09-19T09:20:33.338656+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:20:33.338656+0000","last_undegraded":"2024-09-19T09:20:33.338656+0000","last_fullsized":"2024-09-19T09:20:33.338656+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226656+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:20:33.226656+0000","last_peered":"2024-09-19T09:20:33.226656+0000","last_clean":"2024-09-19T09:20:33.226656+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:20:33.226656+0000","last_undegraded":"2024-09-19T09:20:33.226656+0000","last_fullsized":"2024-09-19T09:20:33.226656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089669+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:20:33.089669+0000","last_peered":"2024-09-19T09:20:33.089669+0000","last_clean":"2024-09-19T09:20:33.089669+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:20:33.089669+0000","last_undegraded":"2024-09-19T09:20:33.089669+0000","last_fullsized":"2024-09-19T09:20:33.089669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227042+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:20:33.227042+0000","last_peered":"2024-09-19T09:20:33.227042+0000","last_clean":"2024-09-19T09:20:33.227042+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:20:33.227042+0000","last_undegraded":"2024-09-19T09:20:33.227042+0000","last_fullsized":"2024-09-19T09:20:33.227042+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113217+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:20:33.113217+0000","last_peered":"2024-09-19T09:20:33.113217+0000","last_clean":"2024-09-19T09:20:33.113217+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:20:33.113217+0000","last_undegraded":"2024-09-19T09:20:33.113217+0000","last_fullsized":"2024-09-19T09:20:33.113217+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339168+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:20:33.339168+0000","last_peered":"2024-09-19T09:20:33.339168+0000","last_clean":"2024-09-19T09:20:33.339168+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:20:33.339168+0000","last_undegraded":"2024-09-19T09:20:33.339168+0000","last_fullsized":"2024-09-19T09:20:33.339168+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091338+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:20:33.091338+0000","last_peered":"2024-09-19T09:20:33.091338+0000","last_clean":"2024-09-19T09:20:33.091338+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:20:33.091338+0000","last_undegraded":"2024-09-19T09:20:33.091338+0000","last_fullsized":"2024-09-19T09:20:33.091338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338567+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:20:33.338567+0000","last_peered":"2024-09-19T09:20:33.338567+0000","last_clean":"2024-09-19T09:20:33.338567+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:20:33.338567+0000","last_undegraded":"2024-09-19T09:20:33.338567+0000","last_fullsized":"2024-09-19T09:20:33.338567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113237+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:20:33.113237+0000","last_peered":"2024-09-19T09:20:33.113237+0000","last_clean":"2024-09-19T09:20:33.113237+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:20:33.113237+0000","last_undegraded":"2024-09-19T09:20:33.113237+0000","last_fullsized":"2024-09-19T09:20:33.113237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089723+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:20:33.089723+0000","last_peered":"2024-09-19T09:20:33.089723+0000","last_clean":"2024-09-19T09:20:33.089723+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:20:33.089723+0000","last_undegraded":"2024-09-19T09:20:33.089723+0000","last_fullsized":"2024-09-19T09:20:33.089723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338375+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:20:33.338375+0000","last_peered":"2024-09-19T09:20:33.338375+0000","last_clean":"2024-09-19T09:20:33.338375+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:20:33.338375+0000","last_undegraded":"2024-09-19T09:20:33.338375+0000","last_fullsized":"2024-09-19T09:20:33.338375+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090107+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:20:33.090107+0000","last_peered":"2024-09-19T09:20:33.090107+0000","last_clean":"2024-09-19T09:20:33.090107+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:20:33.090107+0000","last_undegraded":"2024-09-19T09:20:33.090107+0000","last_fullsized":"2024-09-19T09:20:33.090107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338712+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:20:33.338712+0000","last_peered":"2024-09-19T09:20:33.338712+0000","last_clean":"2024-09-19T09:20:33.338712+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:20:33.338712+0000","last_undegraded":"2024-09-19T09:20:33.338712+0000","last_fullsized":"2024-09-19T09:20:33.338712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113206+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:20:33.113206+0000","last_peered":"2024-09-19T09:20:33.113206+0000","last_clean":"2024-09-19T09:20:33.113206+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:20:33.113206+0000","last_undegraded":"2024-09-19T09:20:33.113206+0000","last_fullsized":"2024-09-19T09:20:33.113206+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338402+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:20:33.338402+0000","last_peered":"2024-09-19T09:20:33.338402+0000","last_clean":"2024-09-19T09:20:33.338402+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:20:33.338402+0000","last_undegraded":"2024-09-19T09:20:33.338402+0000","last_fullsized":"2024-09-19T09:20:33.338402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338486+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:20:33.338486+0000","last_peered":"2024-09-19T09:20:33.338486+0000","last_clean":"2024-09-19T09:20:33.338486+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:20:33.338486+0000","last_undegraded":"2024-09-19T09:20:33.338486+0000","last_fullsized":"2024-09-19T09:20:33.338486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:59.921931+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:20:59.921931+0000","last_peered":"2024-09-19T09:20:59.921931+0000","last_clean":"2024-09-19T09:20:59.921931+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:20:59.921931+0000","last_undegraded":"2024-09-19T09:20:59.921931+0000","last_fullsized":"2024-09-19T09:20:59.921931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139673+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:20:33.139673+0000","last_peered":"2024-09-19T09:20:33.139673+0000","last_clean":"2024-09-19T09:20:33.139673+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:20:33.139673+0000","last_undegraded":"2024-09-19T09:20:33.139673+0000","last_fullsized":"2024-09-19T09:20:33.139673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089727+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:20:33.089727+0000","last_peered":"2024-09-19T09:20:33.089727+0000","last_clean":"2024-09-19T09:20:33.089727+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:20:33.089727+0000","last_undegraded":"2024-09-19T09:20:33.089727+0000","last_fullsized":"2024-09-19T09:20:33.089727+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.290071+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:20:33.290071+0000","last_peered":"2024-09-19T09:20:33.290071+0000","last_clean":"2024-09-19T09:20:33.290071+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:20:33.290071+0000","last_undegraded":"2024-09-19T09:20:33.290071+0000","last_fullsized":"2024-09-19T09:20:33.290071+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.924246+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:01.924246+0000","last_peered":"2024-09-19T09:21:01.924246+0000","last_clean":"2024-09-19T09:21:01.924246+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:01.924246+0000","last_undegraded":"2024-09-19T09:21:01.924246+0000","last_fullsized":"2024-09-19T09:21:01.924246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":261,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:02.926149+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:02.926149+0000","last_peered":"2024-09-19T09:21:02.926149+0000","last_clean":"2024-09-19T09:21:02.926149+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:02.926149+0000","last_undegraded":"2024-09-19T09:21:02.926149+0000","last_fullsized":"2024-09-19T09:21:02.926149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338997+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:20:33.338997+0000","last_peered":"2024-09-19T09:20:33.338997+0000","last_clean":"2024-09-19T09:20:33.338997+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:20:33.338997+0000","last_undegraded":"2024-09-19T09:20:33.338997+0000","last_fullsized":"2024-09-19T09:20:33.338997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.112997+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:20:33.112997+0000","last_peered":"2024-09-19T09:20:33.112997+0000","last_clean":"2024-09-19T09:20:33.112997+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:20:33.112997+0000","last_undegraded":"2024-09-19T09:20:33.112997+0000","last_fullsized":"2024-09-19T09:20:33.112997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226934+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:20:33.226934+0000","last_peered":"2024-09-19T09:20:33.226934+0000","last_clean":"2024-09-19T09:20:33.226934+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:20:33.226934+0000","last_undegraded":"2024-09-19T09:20:33.226934+0000","last_fullsized":"2024-09-19T09:20:33.226934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:00.942175+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:00.942175+0000","last_peered":"2024-09-19T09:21:00.942175+0000","last_clean":"2024-09-19T09:21:00.942175+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:00.942175+0000","last_undegraded":"2024-09-19T09:21:00.942175+0000","last_fullsized":"2024-09-19T09:21:00.942175+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226486+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:20:33.226486+0000","last_peered":"2024-09-19T09:20:33.226486+0000","last_clean":"2024-09-19T09:20:33.226486+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:20:33.226486+0000","last_undegraded":"2024-09-19T09:20:33.226486+0000","last_fullsized":"2024-09-19T09:20:33.226486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139479+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:20:33.139479+0000","last_peered":"2024-09-19T09:20:33.139479+0000","last_clean":"2024-09-19T09:20:33.139479+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:20:33.139479+0000","last_undegraded":"2024-09-19T09:20:33.139479+0000","last_fullsized":"2024-09-19T09:20:33.139479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339070+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:20:33.339070+0000","last_peered":"2024-09-19T09:20:33.339070+0000","last_clean":"2024-09-19T09:20:33.339070+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:20:33.339070+0000","last_undegraded":"2024-09-19T09:20:33.339070+0000","last_fullsized":"2024-09-19T09:20:33.339070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226980+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:20:33.226980+0000","last_peered":"2024-09-19T09:20:33.226980+0000","last_clean":"2024-09-19T09:20:33.226980+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:20:33.226980+0000","last_undegraded":"2024-09-19T09:20:33.226980+0000","last_fullsized":"2024-09-19T09:20:33.226980+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226889+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:20:33.226889+0000","last_peered":"2024-09-19T09:20:33.226889+0000","last_clean":"2024-09-19T09:20:33.226889+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:20:33.226889+0000","last_undegraded":"2024-09-19T09:20:33.226889+0000","last_fullsized":"2024-09-19T09:20:33.226889+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.227104+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:20:33.227104+0000","last_peered":"2024-09-19T09:20:33.227104+0000","last_clean":"2024-09-19T09:20:33.227104+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:20:33.227104+0000","last_undegraded":"2024-09-19T09:20:33.227104+0000","last_fullsized":"2024-09-19T09:20:33.227104+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089851+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:20:33.089851+0000","last_peered":"2024-09-19T09:20:33.089851+0000","last_clean":"2024-09-19T09:20:33.089851+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:20:33.089851+0000","last_undegraded":"2024-09-19T09:20:33.089851+0000","last_fullsized":"2024-09-19T09:20:33.089851+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113037+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:20:33.113037+0000","last_peered":"2024-09-19T09:20:33.113037+0000","last_clean":"2024-09-19T09:20:33.113037+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:20:33.113037+0000","last_undegraded":"2024-09-19T09:20:33.113037+0000","last_fullsized":"2024-09-19T09:20:33.113037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:58.936601+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:20:58.936601+0000","last_peered":"2024-09-19T09:20:58.936601+0000","last_clean":"2024-09-19T09:20:58.936601+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:20:58.936601+0000","last_undegraded":"2024-09-19T09:20:58.936601+0000","last_fullsized":"2024-09-19T09:20:58.936601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139393+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:20:33.139393+0000","last_peered":"2024-09-19T09:20:33.139393+0000","last_clean":"2024-09-19T09:20:33.139393+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:20:33.139393+0000","last_undegraded":"2024-09-19T09:20:33.139393+0000","last_fullsized":"2024-09-19T09:20:33.139393+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113307+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:20:33.113307+0000","last_peered":"2024-09-19T09:20:33.113307+0000","last_clean":"2024-09-19T09:20:33.113307+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:20:33.113307+0000","last_undegraded":"2024-09-19T09:20:33.113307+0000","last_fullsized":"2024-09-19T09:20:33.113307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091377+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091377+0000","last_peered":"2024-09-19T09:20:33.091377+0000","last_clean":"2024-09-19T09:20:33.091377+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091377+0000","last_undegraded":"2024-09-19T09:20:33.091377+0000","last_fullsized":"2024-09-19T09:20:33.091377+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090189+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:20:33.090189+0000","last_peered":"2024-09-19T09:20:33.090189+0000","last_clean":"2024-09-19T09:20:33.090189+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:20:33.090189+0000","last_undegraded":"2024-09-19T09:20:33.090189+0000","last_fullsized":"2024-09-19T09:20:33.090189+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338902+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:20:33.338902+0000","last_peered":"2024-09-19T09:20:33.338902+0000","last_clean":"2024-09-19T09:20:33.338902+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:20:33.338902+0000","last_undegraded":"2024-09-19T09:20:33.338902+0000","last_fullsized":"2024-09-19T09:20:33.338902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338482+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:20:33.338482+0000","last_peered":"2024-09-19T09:20:33.338482+0000","last_clean":"2024-09-19T09:20:33.338482+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:20:33.338482+0000","last_undegraded":"2024-09-19T09:20:33.338482+0000","last_fullsized":"2024-09-19T09:20:33.338482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089874+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:20:33.089874+0000","last_peered":"2024-09-19T09:20:33.089874+0000","last_clean":"2024-09-19T09:20:33.089874+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:20:33.089874+0000","last_undegraded":"2024-09-19T09:20:33.089874+0000","last_fullsized":"2024-09-19T09:20:33.089874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226714+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:20:33.226714+0000","last_peered":"2024-09-19T09:20:33.226714+0000","last_clean":"2024-09-19T09:20:33.226714+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:20:33.226714+0000","last_undegraded":"2024-09-19T09:20:33.226714+0000","last_fullsized":"2024-09-19T09:20:33.226714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.097166+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:20:33.097166+0000","last_peered":"2024-09-19T09:20:33.097166+0000","last_clean":"2024-09-19T09:20:33.097166+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:20:33.097166+0000","last_undegraded":"2024-09-19T09:20:33.097166+0000","last_fullsized":"2024-09-19T09:20:33.097166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090022+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:20:33.090022+0000","last_peered":"2024-09-19T09:20:33.090022+0000","last_clean":"2024-09-19T09:20:33.090022+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:20:33.090022+0000","last_undegraded":"2024-09-19T09:20:33.090022+0000","last_fullsized":"2024-09-19T09:20:33.090022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091533+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091533+0000","last_peered":"2024-09-19T09:20:33.091533+0000","last_clean":"2024-09-19T09:20:33.091533+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091533+0000","last_undegraded":"2024-09-19T09:20:33.091533+0000","last_fullsized":"2024-09-19T09:20:33.091533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":599,"num_read_kb":375,"num_write":171,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678050,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299441,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561078,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1515520,"data_stored":1036825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920832,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051653,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280584,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:04.264 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:04.556 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 -- 172.21.15.52:0/537912067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 msgr2=0x7f4d501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 --2- 172.21.15.52:0/537912067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d501029b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4d40009900 tx=0x7f4d4002a480 comp rx=0 tx=0).stop 2024-09-19T09:21:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 -- 172.21.15.52:0/537912067 shutdown_connections 2024-09-19T09:21:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 --2- 172.21.15.52:0/537912067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 --2- 172.21.15.52:0/537912067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d501029b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 --2- 172.21.15.52:0/537912067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 0x7f4d50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 -- 172.21.15.52:0/537912067 >> 172.21.15.52:0/537912067 conn(0x7f4d500fc7d0 msgr2=0x7f4d500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 -- 172.21.15.52:0/537912067 shutdown_connections 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.028+0000 7f4d57d19640 1 -- 172.21.15.52:0/537912067 wait complete. 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 Processor -- start 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 -- start start 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 0x7f4d500fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d500fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50110f50 con 0x7f4d50102570 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50110dd0 con 0x7f4d50100e20 2024-09-19T09:21:05.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d57d19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d501110d0 con 0x7f4d50102ef0 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55018/0 (socket says 172.21.15.52:55018) 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 -- 172.21.15.52:0/829943926 learned_addr learned my addr 172.21.15.52:0/829943926 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d55ab5640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 0x7f4d500fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 -- 172.21.15.52:0/829943926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 msgr2=0x7f4d500fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d562b6640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d500fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d500fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 -- 172.21.15.52:0/829943926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 msgr2=0x7f4d500fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 0x7f4d500fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d552b4640 1 -- 172.21.15.52:0/829943926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d501a69b0 con 0x7f4d50102570 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.029+0000 7f4d562b6640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d500fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d552b4640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4d40006010 tx=0x7f4d40003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:05.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4003f070 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d40031c30 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d501a6c40 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d40035030 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.030+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d501a7120 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.031+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50101200 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.032+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d40042070 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.033+0000 7f4d46ffd640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 0x7f4d3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.033+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4d400f0640 con 0x7f4d50102570 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.033+0000 7f4d55ab5640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 0x7f4d3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.033+0000 7f4d55ab5640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 0x7f4d3c0a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c005d00 tx=0x7f4d4c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:05.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.036+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d40031de0 con 0x7f4d50102570 2024-09-19T09:21:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.247+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d5010a0d0 con 0x7f4d50102570 2024-09-19T09:21:05.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.248+0000 7f4d46ffd640 1 -- 172.21.15.52:0/829943926 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f4d400bd280 con 0x7f4d50102570 2024-09-19T09:21:05.249 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:05.249 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:05.249 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 msgr2=0x7f4d3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 0x7f4d3c0a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c005d00 tx=0x7f4d4c00b410 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 msgr2=0x7f4d500fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4d40006010 tx=0x7f4d40003c10 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 shutdown_connections 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d3c0a3240 0x7f4d3c0a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d50102ef0 0x7f4d500fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d50102570 0x7f4d500fd1c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 --2- 172.21.15.52:0/829943926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d50100e20 0x7f4d500fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:05.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 >> 172.21.15.52:0/829943926 conn(0x7f4d500fc7d0 msgr2=0x7f4d5006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 shutdown_connections 2024-09-19T09:21:05.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:05.250+0000 7f4d57d19640 1 -- 172.21.15.52:0/829943926 wait complete. 2024-09-19T09:21:05.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:05 smithi086 ceph-mon[34813]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T09:21:05.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:05 smithi086 ceph-mon[34813]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:05 smithi086 ceph-mon[34813]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:05 smithi086 ceph-mon[34813]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.623 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:05 smithi052 ceph-mon[30947]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T09:21:05.623 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:05 smithi052 ceph-mon[30947]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.623 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:05 smithi052 ceph-mon[30947]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.623 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:05 smithi052 ceph-mon[30947]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:05 smithi169 ceph-mon[35454]: pgmap v327: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T09:21:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:05 smithi169 ceph-mon[35454]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:05 smithi169 ceph-mon[35454]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:05 smithi169 ceph-mon[35454]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:05.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:21:06.224 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:06.478 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/829943926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:06.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/829943926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:06.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/829943926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:06.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 -- 172.21.15.52:0/2671908039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64100a80 msgr2=0x7f9e64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:06.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2671908039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64100a80 0x7f9e64100ee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009930 tx=0x7f9e4c02a420 comp rx=0 tx=0).stop 2024-09-19T09:21:06.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 -- 172.21.15.52:0/2671908039 shutdown_connections 2024-09-19T09:21:06.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2671908039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64101420 0x7f9e6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2671908039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64100a80 0x7f9e64100ee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2671908039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 -- 172.21.15.52:0/2671908039 >> 172.21.15.52:0/2671908039 conn(0x7f9e640fc7a0 msgr2=0x7f9e640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 -- 172.21.15.52:0/2671908039 shutdown_connections 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.700+0000 7f9e6897d640 1 -- 172.21.15.52:0/2671908039 wait complete. 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.701+0000 7f9e6897d640 1 Processor -- start 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.701+0000 7f9e6897d640 1 -- start start 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e6419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:06.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e6419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64110e40 con 0x7f9e64101420 2024-09-19T09:21:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64110cc0 con 0x7f9e64100a80 2024-09-19T09:21:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6897d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64110fc0 con 0x7f9e64106a80 2024-09-19T09:21:06.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55048/0 (socket says 172.21.15.52:55048) 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 -- 172.21.15.52:0/2374300655 learned_addr learned my addr 172.21.15.52:0/2374300655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6259c640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e6419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e62d9d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e6419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 -- 172.21.15.52:0/2374300655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 msgr2=0x7f9e6419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e6419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 -- 172.21.15.52:0/2374300655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 msgr2=0x7f9e6419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e6419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 -- 172.21.15.52:0/2374300655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6419f5a0 con 0x7f9e64101420 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e6259c640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e6419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.702+0000 7f9e5bfff640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009a50 tx=0x7f9e4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.703+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c03f030 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.703+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e4c003ce0 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.703+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6419f830 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.703+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c035070 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.703+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e641a7170 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.704+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e641021c0 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.705+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e4c042030 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.705+0000 7f9e5b7fe640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.706+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9e4c0effe0 con 0x7f9e64101420 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.706+0000 7f9e6259c640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.706+0000 7f9e6259c640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 0x7f9e500a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005e10 tx=0x7f9e54005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.710+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e4c0bcc80 con 0x7f9e64101420 2024-09-19T09:21:06.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.885+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e641a7340 con 0x7f9e64101420 2024-09-19T09:21:06.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.886+0000 7f9e5b7fe640 1 -- 172.21.15.52:0/2374300655 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7f9e4c0a1980 con 0x7f9e64101420 2024-09-19T09:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:06.888 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 msgr2=0x7f9e500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 0x7f9e500a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005e10 tx=0x7f9e54005da0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 msgr2=0x7f9e6419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009a50 tx=0x7f9e4c004270 comp rx=0 tx=0).stop 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 shutdown_connections 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e6419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6419ab30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 --2- 172.21.15.52:0/2374300655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e6419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 >> 172.21.15.52:0/2374300655 conn(0x7f9e640fc7a0 msgr2=0x7f9e6406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 shutdown_connections 2024-09-19T09:21:06.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:06.889+0000 7f9e6897d640 1 -- 172.21.15.52:0/2374300655 wait complete. 2024-09-19T09:21:07.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:07 smithi086 ceph-mon[34813]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:21:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:07 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2374300655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:07.548 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:07 smithi052 ceph-mon[30947]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:21:07.548 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:07 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2374300655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:07.604 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:21:07.604 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:21:07.622 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:21:07.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:21:07.623 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:21:07.623 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:21:07.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:21:07.626 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:21:07.654 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:21:07.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:21:07.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:07 smithi169 ceph-mon[35454]: pgmap v328: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-19T09:21:07.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:07 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2374300655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:07.901 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:07.932 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.608+0000 7f20dbe9b640 1 -- 172.21.15.52:0/1761397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4106f10 msgr2=0x7f20d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.608+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/1761397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4106f10 0x7f20d410ea90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009ca0 tx=0x7f20cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 -- 172.21.15.52:0/1761397423 shutdown_connections 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/1761397423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4106f10 0x7f20d410ea90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/1761397423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 0x7f20d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/1761397423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d4101de0 0x7f20d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 -- 172.21.15.52:0/1761397423 >> 172.21.15.52:0/1761397423 conn(0x7f20d40fd8c0 msgr2=0x7f20d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 -- 172.21.15.52:0/1761397423 shutdown_connections 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 -- 172.21.15.52:0/1761397423 wait complete. 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 Processor -- start 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 -- start start 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.609+0000 7f20dbe9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 0x7f20d41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d4106f10 0x7f20d419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4111fc0 con 0x7f20d4101de0 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4111e40 con 0x7f20d4106f10 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4112140 con 0x7f20d4102790 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54158/0 (socket says 172.21.15.52:54158) 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 -- 172.21.15.52:0/3834942577 learned_addr learned my addr 172.21.15.52:0/3834942577 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9436640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 0x7f20d41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 -- 172.21.15.52:0/3834942577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 msgr2=0x7f20d41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 0x7f20d41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 -- 172.21.15.52:0/3834942577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d4106f10 msgr2=0x7f20d419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d4106f10 0x7f20d419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 -- 172.21.15.52:0/3834942577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d419d350 con 0x7f20d4101de0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20d9c37640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20d000d950 tx=0x7f20d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20caffd640 1 -- 172.21.15.52:0/3834942577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0017070 con 0x7f20d4101de0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d419d640 con 0x7f20d4101de0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20caffd640 1 -- 172.21.15.52:0/3834942577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d0009c30 con 0x7f20d4101de0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20caffd640 1 -- 172.21.15.52:0/3834942577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d000f6b0 con 0x7f20d4101de0 2024-09-19T09:21:08.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.610+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41a4f20 con 0x7f20d4101de0 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.612+0000 7f20caffd640 1 -- 172.21.15.52:0/3834942577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f20d00109d0 con 0x7f20d4101de0 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 Processor -- start 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 -- start start 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc3a40 0x564fd6bc3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564fd6b29280 con 0x564fd6bc4360 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564fd6ad0b10 con 0x564fd6bd3150 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20de274740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564fd6b25240 con 0x564fd6bc3a40 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20caffd640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 0x7f20c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54162/0 (socket says 172.21.15.52:54162) 2024-09-19T09:21:08.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.613+0000 7f20d9c37640 1 -- 172.21.15.52:0/2967557735 learned_addr learned my addr 172.21.15.52:0/2967557735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20da438640 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc3a40 0x564fd6bc3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20da438640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 0x7f20c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20caffd640 1 -- 172.21.15.52:0/3834942577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f20d00cf6d0 con 0x7f20d4101de0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9436640 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 -- 172.21.15.52:0/2967557735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc3a40 msgr2=0x564fd6bc3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc3a40 0x564fd6bc3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 -- 172.21.15.52:0/2967557735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 msgr2=0x564fd6bd5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 -- 172.21.15.52:0/2967557735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd6add1f0 con 0x564fd6bc4360 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20da438640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 0x7f20c00a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02aeb0 tx=0x7f20cc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cd0c0 tx=0x7f20d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2ba640b0b2b5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20bffff640 1 -- 172.21.15.52:0/2967557735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0020070 con 0x564fd6bc4360 2024-09-19T09:21:08.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20bffff640 1 -- 172.21.15.52:0/2967557735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d0009de0 con 0x564fd6bc4360 2024-09-19T09:21:08.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.614+0000 7f20bffff640 1 -- 172.21.15.52:0/2967557735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d00cfb80 con 0x564fd6bc4360 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 -- 172.21.15.52:0/2967557735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 msgr2=0x564fd6bd2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cd0c0 tx=0x7f20d0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 -- 172.21.15.52:0/2967557735 shutdown_connections 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6bd2c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 --2- 172.21.15.52:0/2967557735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc3a40 0x564fd6bc3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 -- 172.21.15.52:0/2967557735 >> 172.21.15.52:0/2967557735 conn(0x564fd6bc00f0 msgr2=0x564fd6bc04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 -- 172.21.15.52:0/2967557735 shutdown_connections 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.615+0000 7f20de274740 1 -- 172.21.15.52:0/2967557735 wait complete. 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 -- start start 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 Processor -- start 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc4360 0x564fd6bd05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564fd6bd5cc0 con 0x564fd6bc3a40 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564fd6ae3f10 con 0x564fd6bd3150 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564fd6bd5e40 con 0x564fd6bc4360 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.616+0000 7f20de274740 10 client.0 _ll_register_callbacks cb 0x564fd6aaca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54170/0 (socket says 172.21.15.52:54170) 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 -- 172.21.15.52:0/328475236 learned_addr learned my addr 172.21.15.52:0/328475236 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20da438640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9436640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc4360 0x564fd6bd05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 -- 172.21.15.52:0/328475236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc4360 msgr2=0x564fd6bd05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc4360 0x564fd6bd05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 -- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 msgr2=0x564fd6bd0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 -- 172.21.15.52:0/328475236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd689a6a0 con 0x564fd6bc3a40 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20d9c37640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cd4c0 tx=0x7f20d0010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73376094246f6535 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0020050 con 0x564fd6bc3a40 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f20d00d1de0 con 0x564fd6bc3a40 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d0009de0 con 0x564fd6bc3a40 2024-09-19T09:21:08.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.617+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f20d00a48e0 con 0x564fd6bc3a40 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 10 client.15219 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fd6be1960 con 0x564fd6bc3a40 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d0009de0 con 0x564fd6bc3a40 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f20d009b1a0 con 0x564fd6bc3a40 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 10 client.15219 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 10 client.15219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 20 client.15219 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6be2cb0 0x564fd6be50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 4 client.15219 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fd6b367f0 con 0x564fd6be2cb0 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.618+0000 7f20d9436640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6be2cb0 0x564fd6be50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.619+0000 7f20d9436640 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6be2cb0 0x564fd6be50a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b0f363e5b5f4a4 server_cookie=f61272b2922f3c in_seq=0 out_seq=0 2024-09-19T09:21:08.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.619+0000 7f20bd7fa640 10 client.15219 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.619+0000 7f20bd7fa640 1 -- 172.21.15.52:0/328475236 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fd6b367f0 con 0x564fd6be2cb0 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.619+0000 7f20bd7fa640 10 client.15219 handle_command_reply: tid=0 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 client.15219 shutdown 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 msgr2=0x564fd6bd00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cd4c0 tx=0x7f20d0010d70 comp rx=0 tx=0).stop 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 shutdown_connections 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6be2cb0 0x564fd6be50a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bd3150 0x564fd6bd0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20bd7fa640 0 client.15219 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:08.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bc4360 0x564fd6bd05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 --2- 172.21.15.52:0/328475236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6bd00b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 >> 172.21.15.52:0/328475236 conn(0x564fd6bc00f0 msgr2=0x564fd6bc5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 shutdown_connections 2024-09-19T09:21:08.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 1 -- 172.21.15.52:0/328475236 wait complete. 2024-09-19T09:21:08.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.620+0000 7f20de274740 20 client.15219 trim_cache size 0 max 16384 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.637+0000 7f20de274740 1 Processor -- start 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.637+0000 7f20de274740 1 -- start start 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 0x564fd6bcef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41adf30 con 0x564fd6bc4360 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41ab800 con 0x564fd6bc3a40 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20de274740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a9650 con 0x564fd6bd3150 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54180/0 (socket says 172.21.15.52:54180) 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 -- 172.21.15.52:0/3764201617 learned_addr learned my addr 172.21.15.52:0/3764201617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 -- 172.21.15.52:0/3764201617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 msgr2=0x564fd6be8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 -- 172.21.15.52:0/3764201617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 msgr2=0x564fd6bcef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9c37640 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 0x564fd6bcef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 0x564fd6bcef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 -- 172.21.15.52:0/3764201617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd6bc4190 con 0x564fd6bc4360 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9c37640 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 0x564fd6bcef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20d9436640 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009b90 tx=0x7f20c4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7a0a1eec7728ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20bf7fe640 1 -- 172.21.15.52:0/3764201617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4004050 con 0x564fd6bc4360 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20bf7fe640 1 -- 172.21.15.52:0/3764201617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c40041f0 con 0x564fd6bc4360 2024-09-19T09:21:08.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.638+0000 7f20bf7fe640 1 -- 172.21.15.52:0/3764201617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40116a0 con 0x564fd6bc4360 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- 172.21.15.52:0/3764201617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 msgr2=0x564fd6be80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009b90 tx=0x7f20c4013830 comp rx=0 tx=0).stop 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- 172.21.15.52:0/3764201617 shutdown_connections 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc4360 0x564fd6be80c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 --2- 172.21.15.52:0/3764201617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc3a40 0x564fd6bcef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- 172.21.15.52:0/3764201617 >> 172.21.15.52:0/3764201617 conn(0x564fd6bc00f0 msgr2=0x564fd6bce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- 172.21.15.52:0/3764201617 shutdown_connections 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- 172.21.15.52:0/3764201617 wait complete. 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 -- start start 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.639+0000 7f20de274740 1 Processor -- start 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc4360 0x564fd6be6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41a9cc0 con 0x564fd6bc3a40 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41ab130 con 0x564fd6bc4360 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f20d41aa390 con 0x564fd6bd3150 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20de274740 10 client.0 _ll_register_callbacks cb 0x7f20c4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54196/0 (socket says 172.21.15.52:54196) 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 -- 172.21.15.52:0/2810393646 learned_addr learned my addr 172.21.15.52:0/2810393646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9436640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc4360 0x564fd6be6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20da438640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 -- 172.21.15.52:0/2810393646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 msgr2=0x564fd6be6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 -- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc4360 msgr2=0x564fd6be6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc4360 0x564fd6be6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20d9c37640 1 -- 172.21.15.52:0/2810393646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd6c4c8e0 con 0x564fd6bc3a40 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.640+0000 7f20da438640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20d9c37640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20d0010480 tx=0x7f20d0009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872efec59ff70bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0020070 con 0x564fd6bc3a40 2024-09-19T09:21:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f20d00107a0 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c40041f0 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f20d0009de0 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fd6c4db10 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c40041f0 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f20d0073020 con 0x564fd6bc3a40 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 10 client.15225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 20 client.15225 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6c4dff0 0x564fd6c503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 4 client.15225 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:21:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.641+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564fd6b30d00 con 0x564fd6c4dff0 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.642+0000 7f20d9436640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6c4dff0 0x564fd6c503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.642+0000 7f20d9436640 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6c4dff0 0x564fd6c503e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2632ad1ef93d9271 server_cookie=35e9d66a3e5134e3 in_seq=0 out_seq=0 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.642+0000 7f20bd7fa640 10 client.15225 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20bd7fa640 1 -- 172.21.15.52:0/2810393646 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564fd6b30d00 con 0x564fd6c4dff0 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20bd7fa640 10 client.15225 handle_command_reply: tid=0 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 client.15225 shutdown 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 msgr2=0x564fd6be60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f20d0010480 tx=0x7f20d0009740 comp rx=0 tx=0).stop 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 shutdown_connections 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564fd6c4dff0 0x564fd6c503e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fd6bd3150 0x564fd6be6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fd6bc4360 0x564fd6be6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 --2- 172.21.15.52:0/2810393646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fd6bc3a40 0x564fd6be60d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 >> 172.21.15.52:0/2810393646 conn(0x564fd6bc00f0 msgr2=0x564fd6bbf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20bd7fa640 0 client.15225 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 shutdown_connections 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 1 -- 172.21.15.52:0/2810393646 wait complete. 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.643+0000 7f20de274740 20 client.15225 trim_cache size 0 max 16384 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:08.650 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "872d31e2-9f5e-4e37-bfeb-e688ba46ad48", 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 msgr2=0x7f20c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 0x7f20c00a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20cc02aeb0 tx=0x7f20cc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 msgr2=0x7f20d41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20d000d950 tx=0x7f20d000de10 comp rx=0 tx=0).stop 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 shutdown_connections 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20d4106f10 0x7f20d419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f20c00a3240 0x7f20c00a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f20d4102790 0x7f20d41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 --2- 172.21.15.52:0/3834942577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20d4101de0 0x7f20d41983a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 >> 172.21.15.52:0/3834942577 conn(0x7f20d40fd8c0 msgr2=0x7f20d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 shutdown_connections 2024-09-19T09:21:08.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.644+0000 7f20dbe9b640 1 -- 172.21.15.52:0/3834942577 wait complete. 2024-09-19T09:21:09.411 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:09 smithi052 ceph-mon[30947]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:09.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:21:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:09 smithi086 ceph-mon[34813]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:09.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.814+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3885118125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 msgr2=0x7f8ab81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.814+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3885118125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81067f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009900 tx=0x7f8aa802a410 comp rx=0 tx=0).stop 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3885118125 shutdown_connections 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3885118125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8106f20 0x7f8ab810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3885118125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81067f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3885118125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8101df0 0x7f8ab81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3885118125 >> 172.21.15.52:0/3885118125 conn(0x7f8ab80fd8b0 msgr2=0x7f8ab80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3885118125 shutdown_connections 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3885118125 wait complete. 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 Processor -- start 2024-09-19T09:21:09.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- start start 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 0x7f8ab8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 0x7f8ab819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.815+0000 7f8abfc5f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8111f80 con 0x7f8ab81027a0 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abfc5f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8111e00 con 0x7f8ab8106f20 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abfc5f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab8112100 con 0x7f8ab8101df0 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54222/0 (socket says 172.21.15.52:54222) 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 -- 172.21.15.52:0/3353394070 learned_addr learned my addr 172.21.15.52:0/3353394070 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd9fb640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 0x7f8ab8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abe1fc640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 0x7f8ab819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:09.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 -- 172.21.15.52:0/3353394070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 msgr2=0x7f8ab8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 0x7f8ab8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 -- 172.21.15.52:0/3353394070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 msgr2=0x7f8ab819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 0x7f8ab819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 -- 172.21.15.52:0/3353394070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab819d410 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abe1fc640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 0x7f8ab819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd9fb640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 0x7f8ab8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abd1fa640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8006010 tx=0x7f8aa80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa803f030 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aa8003ce0 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab819d6a0 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8035070 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.816+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab81a4fe0 con 0x7f8ab81027a0 2024-09-19T09:21:09.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.818+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab81032d0 con 0x7f8ab81027a0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.819+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8aa8042030 con 0x7f8ab81027a0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.819+0000 7f8aaeffd640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 0x7f8aa40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.819+0000 7f8abd9fb640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 0x7f8aa40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.819+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8aa80effa0 con 0x7f8ab81027a0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.820+0000 7f8abd9fb640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 0x7f8aa40a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009c20 tx=0x7f8ab4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.824+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8aa80bcd00 con 0x7f8ab81027a0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:08.998+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ab8062630 con 0x7f8aa40a32c0 2024-09-19T09:21:09.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.006+0000 7f8aaeffd640 1 -- 172.21.15.52:0/3353394070 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258944 (secure 0 0 0) 0x7f8ab8062630 con 0x7f8aa40a32c0 2024-09-19T09:21:09.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:09.678 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 msgr2=0x7f8aa40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 0x7f8aa40a5780 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009c20 tx=0x7f8ab4005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 msgr2=0x7f8ab81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8006010 tx=0x7f8aa80042f0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 shutdown_connections 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ab8106f20 0x7f8ab819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ab81027a0 0x7f8ab81989a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8aa40a32c0 0x7f8aa40a5780 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 --2- 172.21.15.52:0/3353394070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ab8101df0 0x7f8ab8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 >> 172.21.15.52:0/3353394070 conn(0x7f8ab80fd8b0 msgr2=0x7f8ab80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:09.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 shutdown_connections 2024-09-19T09:21:09.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:09.673+0000 7f8abfc5f640 1 -- 172.21.15.52:0/3353394070 wait complete. 2024-09-19T09:21:09.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:09 smithi169 ceph-mon[35454]: pgmap v329: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:10.354 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:10 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:21:10.354 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:10 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.354 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:10 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:21:10.354 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:10 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.354 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:10 smithi052 ceph-mon[30947]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:10.383 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-09-19T09:21:07.303972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":741,"num_read_kb":490,"num_write":357,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407764,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534060,"statfs":{"total":1151940427776,"available":1151522877440,"internally_reserved":0,"allocated":13062144,"data_stored":7311195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":43,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002878"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304849+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:21:01.304849+0000","last_peered":"2024-09-19T09:21:01.304849+0000","last_clean":"2024-09-19T09:21:01.304849+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:21:01.304849+0000","last_undegraded":"2024-09-19T09:21:01.304849+0000","last_fullsized":"2024-09-19T09:21:01.304849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292098+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:21:01.292098+0000","last_peered":"2024-09-19T09:21:01.292098+0000","last_clean":"2024-09-19T09:21:01.292098+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:21:01.292098+0000","last_undegraded":"2024-09-19T09:21:01.292098+0000","last_fullsized":"2024-09-19T09:21:01.292098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303763+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:21:01.303763+0000","last_peered":"2024-09-19T09:21:01.303763+0000","last_clean":"2024-09-19T09:21:01.303763+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:21:01.303763+0000","last_undegraded":"2024-09-19T09:21:01.303763+0000","last_fullsized":"2024-09-19T09:21:01.303763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297317+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:21:01.297317+0000","last_peered":"2024-09-19T09:21:01.297317+0000","last_clean":"2024-09-19T09:21:01.297317+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:21:01.297317+0000","last_undegraded":"2024-09-19T09:21:01.297317+0000","last_fullsized":"2024-09-19T09:21:01.297317+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305750+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:21:01.305750+0000","last_peered":"2024-09-19T09:21:01.305750+0000","last_clean":"2024-09-19T09:21:01.305750+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:21:01.305750+0000","last_undegraded":"2024-09-19T09:21:01.305750+0000","last_fullsized":"2024-09-19T09:21:01.305750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299054+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:21:01.299054+0000","last_peered":"2024-09-19T09:21:01.299054+0000","last_clean":"2024-09-19T09:21:01.299054+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:21:01.299054+0000","last_undegraded":"2024-09-19T09:21:01.299054+0000","last_fullsized":"2024-09-19T09:21:01.299054+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304928+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:21:01.304928+0000","last_peered":"2024-09-19T09:21:01.304928+0000","last_clean":"2024-09-19T09:21:01.304928+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:21:01.304928+0000","last_undegraded":"2024-09-19T09:21:01.304928+0000","last_fullsized":"2024-09-19T09:21:01.304928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289377+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:21:01.289377+0000","last_peered":"2024-09-19T09:21:01.289377+0000","last_clean":"2024-09-19T09:21:01.289377+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:21:01.289377+0000","last_undegraded":"2024-09-19T09:21:01.289377+0000","last_fullsized":"2024-09-19T09:21:01.289377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303987+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:21:01.303987+0000","last_peered":"2024-09-19T09:21:01.303987+0000","last_clean":"2024-09-19T09:21:01.303987+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:21:01.303987+0000","last_undegraded":"2024-09-19T09:21:01.303987+0000","last_fullsized":"2024-09-19T09:21:01.303987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295670+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:21:01.295670+0000","last_peered":"2024-09-19T09:21:01.295670+0000","last_clean":"2024-09-19T09:21:01.295670+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:21:01.295670+0000","last_undegraded":"2024-09-19T09:21:01.295670+0000","last_fullsized":"2024-09-19T09:21:01.295670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298974+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:21:01.298974+0000","last_peered":"2024-09-19T09:21:01.298974+0000","last_clean":"2024-09-19T09:21:01.298974+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:21:01.298974+0000","last_undegraded":"2024-09-19T09:21:01.298974+0000","last_fullsized":"2024-09-19T09:21:01.298974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289674+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:21:01.289674+0000","last_peered":"2024-09-19T09:21:01.289674+0000","last_clean":"2024-09-19T09:21:01.289674+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:21:01.289674+0000","last_undegraded":"2024-09-19T09:21:01.289674+0000","last_fullsized":"2024-09-19T09:21:01.289674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295019+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:21:01.295019+0000","last_peered":"2024-09-19T09:21:01.295019+0000","last_clean":"2024-09-19T09:21:01.295019+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:21:01.295019+0000","last_undegraded":"2024-09-19T09:21:01.295019+0000","last_fullsized":"2024-09-19T09:21:01.295019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294163+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:21:01.294163+0000","last_peered":"2024-09-19T09:21:01.294163+0000","last_clean":"2024-09-19T09:21:01.294163+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:21:01.294163+0000","last_undegraded":"2024-09-19T09:21:01.294163+0000","last_fullsized":"2024-09-19T09:21:01.294163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296002+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:21:01.296002+0000","last_peered":"2024-09-19T09:21:01.296002+0000","last_clean":"2024-09-19T09:21:01.296002+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:21:01.296002+0000","last_undegraded":"2024-09-19T09:21:01.296002+0000","last_fullsized":"2024-09-19T09:21:01.296002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298541+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:21:01.298541+0000","last_peered":"2024-09-19T09:21:01.298541+0000","last_clean":"2024-09-19T09:21:01.298541+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:21:01.298541+0000","last_undegraded":"2024-09-19T09:21:01.298541+0000","last_fullsized":"2024-09-19T09:21:01.298541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.288921+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:21:01.288921+0000","last_peered":"2024-09-19T09:21:01.288921+0000","last_clean":"2024-09-19T09:21:01.288921+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:21:01.288921+0000","last_undegraded":"2024-09-19T09:21:01.288921+0000","last_fullsized":"2024-09-19T09:21:01.288921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:04.929566+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:21:04.929566+0000","last_peered":"2024-09-19T09:21:04.929566+0000","last_clean":"2024-09-19T09:21:04.929566+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:21:04.929566+0000","last_undegraded":"2024-09-19T09:21:04.929566+0000","last_fullsized":"2024-09-19T09:21:04.929566+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293250+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:21:01.293250+0000","last_peered":"2024-09-19T09:21:01.293250+0000","last_clean":"2024-09-19T09:21:01.293250+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:21:01.293250+0000","last_undegraded":"2024-09-19T09:21:01.293250+0000","last_fullsized":"2024-09-19T09:21:01.293250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298659+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:21:01.298659+0000","last_peered":"2024-09-19T09:21:01.298659+0000","last_clean":"2024-09-19T09:21:01.298659+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:21:01.298659+0000","last_undegraded":"2024-09-19T09:21:01.298659+0000","last_fullsized":"2024-09-19T09:21:01.298659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292872+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:21:01.292872+0000","last_peered":"2024-09-19T09:21:01.292872+0000","last_clean":"2024-09-19T09:21:01.292872+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:21:01.292872+0000","last_undegraded":"2024-09-19T09:21:01.292872+0000","last_fullsized":"2024-09-19T09:21:01.292872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.924246+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:01.924246+0000","last_peered":"2024-09-19T09:21:01.924246+0000","last_clean":"2024-09-19T09:21:01.924246+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:01.924246+0000","last_undegraded":"2024-09-19T09:21:01.924246+0000","last_fullsized":"2024-09-19T09:21:01.924246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":261,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:02.926149+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:02.926149+0000","last_peered":"2024-09-19T09:21:02.926149+0000","last_clean":"2024-09-19T09:21:02.926149+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:02.926149+0000","last_undegraded":"2024-09-19T09:21:02.926149+0000","last_fullsized":"2024-09-19T09:21:02.926149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":202,"num_read_kb":166,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291779+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:21:01.291779+0000","last_peered":"2024-09-19T09:21:01.291779+0000","last_clean":"2024-09-19T09:21:01.291779+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:21:01.291779+0000","last_undegraded":"2024-09-19T09:21:01.291779+0000","last_fullsized":"2024-09-19T09:21:01.291779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294536+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:21:01.294536+0000","last_peered":"2024-09-19T09:21:01.294536+0000","last_clean":"2024-09-19T09:21:01.294536+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:21:01.294536+0000","last_undegraded":"2024-09-19T09:21:01.294536+0000","last_fullsized":"2024-09-19T09:21:01.294536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296324+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:21:01.296324+0000","last_peered":"2024-09-19T09:21:01.296324+0000","last_clean":"2024-09-19T09:21:01.296324+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:21:01.296324+0000","last_undegraded":"2024-09-19T09:21:01.296324+0000","last_fullsized":"2024-09-19T09:21:01.296324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:04.950320+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:04.950320+0000","last_peered":"2024-09-19T09:21:04.950320+0000","last_clean":"2024-09-19T09:21:04.950320+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:04.950320+0000","last_undegraded":"2024-09-19T09:21:04.950320+0000","last_fullsized":"2024-09-19T09:21:04.950320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291256+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:21:01.291256+0000","last_peered":"2024-09-19T09:21:01.291256+0000","last_clean":"2024-09-19T09:21:01.291256+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:21:01.291256+0000","last_undegraded":"2024-09-19T09:21:01.291256+0000","last_fullsized":"2024-09-19T09:21:01.291256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.280355+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:21:01.280355+0000","last_peered":"2024-09-19T09:21:01.280355+0000","last_clean":"2024-09-19T09:21:01.280355+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:21:01.280355+0000","last_undegraded":"2024-09-19T09:21:01.280355+0000","last_fullsized":"2024-09-19T09:21:01.280355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303702+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:21:01.303702+0000","last_peered":"2024-09-19T09:21:01.303702+0000","last_clean":"2024-09-19T09:21:01.303702+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:21:01.303702+0000","last_undegraded":"2024-09-19T09:21:01.303702+0000","last_fullsized":"2024-09-19T09:21:01.303702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304415+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:21:01.304415+0000","last_peered":"2024-09-19T09:21:01.304415+0000","last_clean":"2024-09-19T09:21:01.304415+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:21:01.304415+0000","last_undegraded":"2024-09-19T09:21:01.304415+0000","last_fullsized":"2024-09-19T09:21:01.304415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292107+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:21:01.292107+0000","last_peered":"2024-09-19T09:21:01.292107+0000","last_clean":"2024-09-19T09:21:01.292107+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:21:01.292107+0000","last_undegraded":"2024-09-19T09:21:01.292107+0000","last_fullsized":"2024-09-19T09:21:01.292107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305898+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:21:01.305898+0000","last_peered":"2024-09-19T09:21:01.305898+0000","last_clean":"2024-09-19T09:21:01.305898+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:21:01.305898+0000","last_undegraded":"2024-09-19T09:21:01.305898+0000","last_fullsized":"2024-09-19T09:21:01.305898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294398+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:21:01.294398+0000","last_peered":"2024-09-19T09:21:01.294398+0000","last_clean":"2024-09-19T09:21:01.294398+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:21:01.294398+0000","last_undegraded":"2024-09-19T09:21:01.294398+0000","last_fullsized":"2024-09-19T09:21:01.294398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292803+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:21:01.292803+0000","last_peered":"2024-09-19T09:21:01.292803+0000","last_clean":"2024-09-19T09:21:01.292803+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:21:01.292803+0000","last_undegraded":"2024-09-19T09:21:01.292803+0000","last_fullsized":"2024-09-19T09:21:01.292803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:03.948166+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:21:03.948166+0000","last_peered":"2024-09-19T09:21:03.948166+0000","last_clean":"2024-09-19T09:21:03.948166+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:21:03.948166+0000","last_undegraded":"2024-09-19T09:21:03.948166+0000","last_fullsized":"2024-09-19T09:21:03.948166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.284498+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:21:01.284498+0000","last_peered":"2024-09-19T09:21:01.284498+0000","last_clean":"2024-09-19T09:21:01.284498+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:21:01.284498+0000","last_undegraded":"2024-09-19T09:21:01.284498+0000","last_fullsized":"2024-09-19T09:21:01.284498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294244+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:21:01.294244+0000","last_peered":"2024-09-19T09:21:01.294244+0000","last_clean":"2024-09-19T09:21:01.294244+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:21:01.294244+0000","last_undegraded":"2024-09-19T09:21:01.294244+0000","last_fullsized":"2024-09-19T09:21:01.294244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091442+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091442+0000","last_peered":"2024-09-19T09:20:33.091442+0000","last_clean":"2024-09-19T09:20:33.091442+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091442+0000","last_undegraded":"2024-09-19T09:20:33.091442+0000","last_fullsized":"2024-09-19T09:20:33.091442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300466+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:21:01.300466+0000","last_peered":"2024-09-19T09:21:01.300466+0000","last_clean":"2024-09-19T09:21:01.300466+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:21:01.300466+0000","last_undegraded":"2024-09-19T09:21:01.300466+0000","last_fullsized":"2024-09-19T09:21:01.300466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.257752+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:21:01.257752+0000","last_peered":"2024-09-19T09:21:01.257752+0000","last_clean":"2024-09-19T09:21:01.257752+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:21:01.257752+0000","last_undegraded":"2024-09-19T09:21:01.257752+0000","last_fullsized":"2024-09-19T09:21:01.257752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302793+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:21:01.302793+0000","last_peered":"2024-09-19T09:21:01.302793+0000","last_clean":"2024-09-19T09:21:01.302793+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:21:01.302793+0000","last_undegraded":"2024-09-19T09:21:01.302793+0000","last_fullsized":"2024-09-19T09:21:01.302793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291573+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:21:01.291573+0000","last_peered":"2024-09-19T09:21:01.291573+0000","last_clean":"2024-09-19T09:21:01.291573+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:21:01.291573+0000","last_undegraded":"2024-09-19T09:21:01.291573+0000","last_fullsized":"2024-09-19T09:21:01.291573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304998+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:21:01.304998+0000","last_peered":"2024-09-19T09:21:01.304998+0000","last_clean":"2024-09-19T09:21:01.304998+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:21:01.304998+0000","last_undegraded":"2024-09-19T09:21:01.304998+0000","last_fullsized":"2024-09-19T09:21:01.304998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289848+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:21:01.289848+0000","last_peered":"2024-09-19T09:21:01.289848+0000","last_clean":"2024-09-19T09:21:01.289848+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:21:01.289848+0000","last_undegraded":"2024-09-19T09:21:01.289848+0000","last_fullsized":"2024-09-19T09:21:01.289848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295261+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:21:01.295261+0000","last_peered":"2024-09-19T09:21:01.295261+0000","last_clean":"2024-09-19T09:21:01.295261+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:21:01.295261+0000","last_undegraded":"2024-09-19T09:21:01.295261+0000","last_fullsized":"2024-09-19T09:21:01.295261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091533+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091533+0000","last_peered":"2024-09-19T09:20:33.091533+0000","last_clean":"2024-09-19T09:20:33.091533+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091533+0000","last_undegraded":"2024-09-19T09:20:33.091533+0000","last_fullsized":"2024-09-19T09:20:33.091533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":615,"num_read_kb":381,"num_write":174,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678051,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561079,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1036966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920833,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051654,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280585,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476815,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:10.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:21:10.487 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:10.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:10 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:21:10.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:10 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:10 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:21:10.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:10 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:10 smithi086 ceph-mon[34813]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:10.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:10 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:21:10.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:10 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:10 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:21:10.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:10 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:21:10.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:10 smithi169 ceph-mon[35454]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 -- 172.21.15.52:0/153107184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034106f10 msgr2=0x7f103410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 --2- 172.21.15.52:0/153107184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034106f10 0x7f103410ea90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f102c009ca0 tx=0x7f102c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 -- 172.21.15.52:0/153107184 shutdown_connections 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 --2- 172.21.15.52:0/153107184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034106f10 0x7f103410ea90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 --2- 172.21.15.52:0/153107184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034102790 0x7f10341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 --2- 172.21.15.52:0/153107184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034101de0 0x7f10341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 -- 172.21.15.52:0/153107184 >> 172.21.15.52:0/153107184 conn(0x7f10340fd8c0 msgr2=0x7f10340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 -- 172.21.15.52:0/153107184 shutdown_connections 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.980+0000 7f103b189640 1 -- 172.21.15.52:0/153107184 wait complete. 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 Processor -- start 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 -- start start 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034101de0 0x7f10341983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034106f10 0x7f103419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1034111f70 con 0x7f1034102790 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1034111df0 con 0x7f1034106f10 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f103b189640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10341120f0 con 0x7f1034101de0 2024-09-19T09:21:10.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54242/0 (socket says 172.21.15.52:54242) 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.981+0000 7f1033fff640 1 -- 172.21.15.52:0/3830682389 learned_addr learned my addr 172.21.15.52:0/3830682389 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1038f25640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034101de0 0x7f10341983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1039726640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034106f10 0x7f103419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 -- 172.21.15.52:0/3830682389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034101de0 msgr2=0x7f10341983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034101de0 0x7f10341983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 -- 172.21.15.52:0/3830682389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034106f10 msgr2=0x7f103419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034106f10 0x7f103419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 -- 172.21.15.52:0/3830682389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103419d3a0 con 0x7f1034102790 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1033fff640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f102000d770 tx=0x7f102000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1031ffb640 1 -- 172.21.15.52:0/3830682389 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020017070 con 0x7f1034102790 2024-09-19T09:21:10.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1031ffb640 1 -- 172.21.15.52:0/3830682389 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1020005500 con 0x7f1034102790 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103419d690 con 0x7f1034102790 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.982+0000 7f1031ffb640 1 -- 172.21.15.52:0/3830682389 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020004e00 con 0x7f1034102790 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.983+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10341a4f70 con 0x7f1034102790 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f1031ffb640 1 -- 172.21.15.52:0/3830682389 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1020004fa0 con 0x7f1034102790 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 Processor -- start 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 -- start start 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f1031ffb640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 0x7f10240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f855862880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f85586fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f8557c82e0 con 0x55f855862dc0 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f85576fce0 con 0x55f8558624a0 2024-09-19T09:21:10.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f103d562740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8557c42a0 con 0x55f85586d680 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.985+0000 7f1039726640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 0x7f10240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1031ffb640 1 -- 172.21.15.52:0/3830682389 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f10200cf280 con 0x7f1034102790 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f855862880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54248/0 (socket says 172.21.15.52:54248) 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1033fff640 1 -- 172.21.15.52:0/3749630639 learned_addr learned my addr 172.21.15.52:0/3749630639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1039726640 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f85586fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 -- 172.21.15.52:0/3749630639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 msgr2=0x55f85586fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f85586fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 -- 172.21.15.52:0/3749630639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 msgr2=0x55f85586d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1039726640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 0x7f10240a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f102c004af0 tx=0x7f102c009930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:10.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 -- 172.21.15.52:0/3749630639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f855754440 con 0x55f8558624a0 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1033fff640 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f1038f25640 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f855862880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f102800bbf0 tx=0x7f10280107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304fab503bb229fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.986+0000 7f101effd640 1 -- 172.21.15.52:0/3749630639 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028004030 con 0x55f8558624a0 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f101effd640 1 -- 172.21.15.52:0/3749630639 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10280041d0 con 0x55f8558624a0 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f101effd640 1 -- 172.21.15.52:0/3749630639 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10280116a0 con 0x55f8558624a0 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 -- 172.21.15.52:0/3749630639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 msgr2=0x55f855862880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f855862880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f102800bbf0 tx=0x7f10280107a0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 -- 172.21.15.52:0/3749630639 shutdown_connections 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f85586fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85586d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 --2- 172.21.15.52:0/3749630639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f855862880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 -- 172.21.15.52:0/3749630639 >> 172.21.15.52:0/3749630639 conn(0x55f85585ea30 msgr2=0x55f85585ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 -- 172.21.15.52:0/3749630639 shutdown_connections 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.987+0000 7f103d562740 1 -- 172.21.15.52:0/3749630639 wait complete. 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 -- start start 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 Processor -- start 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f855862dc0 0x55f85586a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f85586d680 0x55f85586a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f855870250 con 0x55f8558624a0 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f855783050 con 0x55f85586d680 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8558703d0 con 0x55f855862dc0 2024-09-19T09:21:10.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f103d562740 10 client.0 _ll_register_callbacks cb 0x55f8557c3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f1038f25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f1038f25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54256/0 (socket says 172.21.15.52:54256) 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f1038f25640 1 -- 172.21.15.52:0/2252969657 learned_addr learned my addr 172.21.15.52:0/2252969657 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f1033fff640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f855862dc0 0x55f85586a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.988+0000 7f1039726640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f85586d680 0x55f85586a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 -- 172.21.15.52:0/2252969657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f855862dc0 msgr2=0x55f85586a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f855862dc0 0x55f85586a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 -- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f85586d680 msgr2=0x55f85586a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f85586d680 0x55f85586a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 -- 172.21.15.52:0/2252969657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8555393c0 con 0x55f8558624a0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1038f25640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1028003e80 tx=0x7f102800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809ad50ce7c94a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:10.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.989+0000 7f1013fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:10.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102802a060 con 0x55f8558624a0 2024-09-19T09:21:10.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f10280035f0 con 0x55f8558624a0 2024-09-19T09:21:10.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10280041d0 con 0x55f8558624a0 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10280037f0 con 0x55f8558624a0 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 10 client.15243 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f85587bbc0 con 0x55f8558624a0 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10280041d0 con 0x55f8558624a0 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10280047e0 con 0x55f8558624a0 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 10 client.15243 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 10 client.15243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 20 client.15243 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f85587f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 4 client.15243 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:11.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.990+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8557d5850 con 0x55f85587d080 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.991+0000 7f1033fff640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f85587f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.991+0000 7f1033fff640 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f85587f470 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9668f8dab1b26622 server_cookie=be5265c9adea9ace in_seq=0 out_seq=0 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.991+0000 7f1013fff640 10 client.15243 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f1013fff640 1 -- 172.21.15.52:0/2252969657 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8557d5850 con 0x55f85587d080 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f1013fff640 10 client.15243 handle_command_reply: tid=0 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 client.15243 shutdown 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 msgr2=0x55f85586cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1028003e80 tx=0x7f102800b940 comp rx=0 tx=0).stop 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 shutdown_connections 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f85587f470 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f1013fff640 0 client.15243 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f85586d680 0x55f85586a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f855862dc0 0x55f85586a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 --2- 172.21.15.52:0/2252969657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f85586cf70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 >> 172.21.15.52:0/2252969657 conn(0x55f85585ea30 msgr2=0x55f85585db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 shutdown_connections 2024-09-19T09:21:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 1 -- 172.21.15.52:0/2252969657 wait complete. 2024-09-19T09:21:11.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:10.992+0000 7f103d562740 20 client.15243 trim_cache size 0 max 16384 2024-09-19T09:21:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.009+0000 7f103d562740 1 Processor -- start 2024-09-19T09:21:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.009+0000 7f103d562740 1 -- start start 2024-09-19T09:21:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f855862dc0 0x55f855882490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f8558829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10341adf40 con 0x55f8558624a0 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10341ab810 con 0x55f855862dc0 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f103d562740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10341a9660 con 0x55f85586d680 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54270/0 (socket says 172.21.15.52:54270) 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 -- 172.21.15.52:0/4283465349 learned_addr learned my addr 172.21.15.52:0/4283465349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1033fff640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f855862dc0 0x55f855882490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1039726640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f8558829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 -- 172.21.15.52:0/4283465349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 msgr2=0x55f8558829d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f8558829d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 -- 172.21.15.52:0/4283465349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f855862dc0 msgr2=0x55f855882490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:11.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f855862dc0 0x55f855882490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 -- 172.21.15.52:0/4283465349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f855868770 con 0x55f8558624a0 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1039726640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f8558829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.010+0000 7f1038f25640 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f10280107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ceed62d34a3a165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f101e7fc640 1 -- 172.21.15.52:0/4283465349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028003eb0 con 0x55f8558624a0 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f101e7fc640 1 -- 172.21.15.52:0/4283465349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1028005a70 con 0x55f8558624a0 2024-09-19T09:21:11.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f101e7fc640 1 -- 172.21.15.52:0/4283465349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028004fa0 con 0x55f8558624a0 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 -- 172.21.15.52:0/4283465349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 msgr2=0x55f8558657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1028000c00 tx=0x7f10280107a0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 -- 172.21.15.52:0/4283465349 shutdown_connections 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f8558829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f855862dc0 0x55f855882490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 --2- 172.21.15.52:0/4283465349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8558624a0 0x55f8558657f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 -- 172.21.15.52:0/4283465349 >> 172.21.15.52:0/4283465349 conn(0x55f85585ea30 msgr2=0x55f8558650e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 -- 172.21.15.52:0/4283465349 shutdown_connections 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.011+0000 7f103d562740 1 -- 172.21.15.52:0/4283465349 wait complete. 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 -- start start 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 Processor -- start 2024-09-19T09:21:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f8558829a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f855880230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10341a9cd0 con 0x55f855862dc0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10341ab140 con 0x55f8558624a0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10341aa3a0 con 0x55f85586d680 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f103d562740 10 client.0 _ll_register_callbacks cb 0x7f10200056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f1033fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54284/0 (socket says 172.21.15.52:54284) 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f1033fff640 1 -- 172.21.15.52:0/3979648394 learned_addr learned my addr 172.21.15.52:0/3979648394 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f1038f25640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f8558829a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.012+0000 7f1039726640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f855880230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 -- 172.21.15.52:0/3979648394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 msgr2=0x55f855880230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f855880230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 -- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 msgr2=0x55f8558829a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f8558829a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 -- 172.21.15.52:0/3979648394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8558807f0 con 0x55f855862dc0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1039726640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f855880230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1033fff640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1020005760 tx=0x7f102000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b88ad5fe6451f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1013fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020099bd0 con 0x55f855862dc0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1020009cc0 con 0x55f855862dc0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1028005a70 con 0x55f855862dc0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1020097f40 con 0x55f855862dc0 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f103d562740 10 client.15249 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f8558e7780 con 0x55f855862dc0 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.013+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1028005a70 con 0x55f855862dc0 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10200071c0 con 0x55f855862dc0 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 10 client.15249 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 10 client.15249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 20 client.15249 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f8558e9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 4 client.15249 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f85586aaf0 con 0x55f85587d080 2024-09-19T09:21:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1038f25640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f8558e9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1038f25640 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f8558e9f70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e526c48316258c server_cookie=c64f9ac20f375dfc in_seq=0 out_seq=0 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1013fff640 10 client.15249 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1013fff640 1 -- 172.21.15.52:0/3979648394 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f85586aaf0 con 0x55f85587d080 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f1013fff640 10 client.15249 handle_command_reply: tid=0 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 1 client.15249 shutdown 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.014+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 msgr2=0x55f85587fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1020005760 tx=0x7f102000b480 comp rx=0 tx=0).stop 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 shutdown_connections 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f85587d080 0x55f8558e9f70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f85586d680 0x55f855880230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f855862dc0 0x55f85587fcf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f1013fff640 0 client.15249 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 --2- 172.21.15.52:0/3979648394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8558624a0 0x55f8558829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 >> 172.21.15.52:0/3979648394 conn(0x55f85585ea30 msgr2=0x55f85585db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 shutdown_connections 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 1 -- 172.21.15.52:0/3979648394 wait complete. 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103d562740 20 client.15249 trim_cache size 0 max 16384 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout: "872d31e2-9f5e-4e37-bfeb-e688ba46ad48": { 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:21:11.023 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "872d31e2-9f5e-4e37-bfeb-e688ba46ad48", 2024-09-19T09:21:11.024 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:21:11.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:11.024 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:11.024 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 msgr2=0x7f10240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 0x7f10240a5780 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f102c004af0 tx=0x7f102c009930 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 msgr2=0x7f1034198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f102000d770 tx=0x7f102000dc30 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 shutdown_connections 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1034106f10 0x7f103419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1034102790 0x7f1034198930 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10240a32c0 0x7f10240a5780 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.015+0000 7f103b189640 1 --2- 172.21.15.52:0/3830682389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1034101de0 0x7f10341983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.016+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 >> 172.21.15.52:0/3830682389 conn(0x7f10340fd8c0 msgr2=0x7f10340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.016+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 shutdown_connections 2024-09-19T09:21:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:11.016+0000 7f103b189640 1 -- 172.21.15.52:0/3830682389 wait complete. 2024-09-19T09:21:11.281 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:11.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:11 smithi086 ceph-mon[34813]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:11.632 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:11 smithi052 ceph-mon[30947]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:11.684 INFO:tasks.cephfs.filesystem:scrub status for tag:872d31e2-9f5e-4e37-bfeb-e688ba46ad48 - {'path': '/', 'tag': '872d31e2-9f5e-4e37-bfeb-e688ba46ad48', 'options': 'recursive,force'} 2024-09-19T09:21:11.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:11 smithi169 ceph-mon[35454]: pgmap v330: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 -- 172.21.15.52:0/500080470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048106f10 msgr2=0x7f804810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 --2- 172.21.15.52:0/500080470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048106f10 0x7f804810ea90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8040009ca0 tx=0x7f804002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 -- 172.21.15.52:0/500080470 shutdown_connections 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 --2- 172.21.15.52:0/500080470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048106f10 0x7f804810ea90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 --2- 172.21.15.52:0/500080470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f80481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 --2- 172.21.15.52:0/500080470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048101de0 0x7f80481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 -- 172.21.15.52:0/500080470 >> 172.21.15.52:0/500080470 conn(0x7f80480fd8c0 msgr2=0x7f80480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 -- 172.21.15.52:0/500080470 shutdown_connections 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.172+0000 7f80501e1640 1 -- 172.21.15.52:0/500080470 wait complete. 2024-09-19T09:21:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 Processor -- start 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 -- start start 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f8048198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048106f10 0x7f804819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8048111f70 con 0x7f8048101de0 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8048111df0 con 0x7f8048106f10 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f80501e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80481120f0 con 0x7f8048102790 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f804df7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f804df7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54302/0 (socket says 172.21.15.52:54302) 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f804df7d640 1 -- 172.21.15.52:0/266635261 learned_addr learned my addr 172.21.15.52:0/266635261 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.173+0000 7f804d77c640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f8048198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 -- 172.21.15.52:0/266635261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 msgr2=0x7f8048198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f8048198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804e77e640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048106f10 0x7f804819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 -- 172.21.15.52:0/266635261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048106f10 msgr2=0x7f804819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048106f10 0x7f804819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 -- 172.21.15.52:0/266635261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f804819d3a0 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804d77c640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f8048198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f804df7d640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f804400e9f0 tx=0x7f804400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804400cd80 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8044010910 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804819d690 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8044018990 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.174+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80481a4f70 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.175+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80481021c0 con 0x7f8048101de0 2024-09-19T09:21:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.176+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8044010ac0 con 0x7f8048101de0 2024-09-19T09:21:12.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.177+0000 7f803effd640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 0x7f80340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:12.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.177+0000 7f804d77c640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 0x7f80340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:12.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.177+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f80440cfe00 con 0x7f8048101de0 2024-09-19T09:21:12.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.177+0000 7f804d77c640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 0x7f80340a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f80480fdce0 tx=0x7f8038005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:12.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.181+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f804409caa0 con 0x7f8048101de0 2024-09-19T09:21:12.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.354+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8048062630 con 0x7f80340a3240 2024-09-19T09:21:12.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.360+0000 7f803effd640 1 -- 172.21.15.52:0/266635261 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258836 (secure 0 0 0) 0x7f8048062630 con 0x7f80340a3240 2024-09-19T09:21:12.364 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 msgr2=0x7f80340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 0x7f80340a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f80480fdce0 tx=0x7f8038005cb0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 msgr2=0x7f80481983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f804400e9f0 tx=0x7f804400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 shutdown_connections 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8048106f10 0x7f804819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80340a3240 0x7f80340a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8048102790 0x7f8048198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 --2- 172.21.15.52:0/266635261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8048101de0 0x7f80481983f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 >> 172.21.15.52:0/266635261 conn(0x7f80480fd8c0 msgr2=0x7f80480feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 shutdown_connections 2024-09-19T09:21:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:12.363+0000 7f80501e1640 1 -- 172.21.15.52:0/266635261 wait complete. 2024-09-19T09:21:13.025 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-19T09:21:11.305365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":767,"num_read_kb":506,"num_write":357,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407764,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534060,"statfs":{"total":1151940427776,"available":1151522877440,"internally_reserved":0,"allocated":13062144,"data_stored":7311195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44,"num_write":12,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003356"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304849+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:21:01.304849+0000","last_peered":"2024-09-19T09:21:01.304849+0000","last_clean":"2024-09-19T09:21:01.304849+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:21:01.304849+0000","last_undegraded":"2024-09-19T09:21:01.304849+0000","last_fullsized":"2024-09-19T09:21:01.304849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292098+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:21:01.292098+0000","last_peered":"2024-09-19T09:21:01.292098+0000","last_clean":"2024-09-19T09:21:01.292098+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:21:01.292098+0000","last_undegraded":"2024-09-19T09:21:01.292098+0000","last_fullsized":"2024-09-19T09:21:01.292098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303763+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:21:01.303763+0000","last_peered":"2024-09-19T09:21:01.303763+0000","last_clean":"2024-09-19T09:21:01.303763+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:21:01.303763+0000","last_undegraded":"2024-09-19T09:21:01.303763+0000","last_fullsized":"2024-09-19T09:21:01.303763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297317+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:21:01.297317+0000","last_peered":"2024-09-19T09:21:01.297317+0000","last_clean":"2024-09-19T09:21:01.297317+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:21:01.297317+0000","last_undegraded":"2024-09-19T09:21:01.297317+0000","last_fullsized":"2024-09-19T09:21:01.297317+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305750+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:21:01.305750+0000","last_peered":"2024-09-19T09:21:01.305750+0000","last_clean":"2024-09-19T09:21:01.305750+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:21:01.305750+0000","last_undegraded":"2024-09-19T09:21:01.305750+0000","last_fullsized":"2024-09-19T09:21:01.305750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299054+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:21:01.299054+0000","last_peered":"2024-09-19T09:21:01.299054+0000","last_clean":"2024-09-19T09:21:01.299054+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:21:01.299054+0000","last_undegraded":"2024-09-19T09:21:01.299054+0000","last_fullsized":"2024-09-19T09:21:01.299054+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304928+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:21:01.304928+0000","last_peered":"2024-09-19T09:21:01.304928+0000","last_clean":"2024-09-19T09:21:01.304928+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:21:01.304928+0000","last_undegraded":"2024-09-19T09:21:01.304928+0000","last_fullsized":"2024-09-19T09:21:01.304928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289377+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:21:01.289377+0000","last_peered":"2024-09-19T09:21:01.289377+0000","last_clean":"2024-09-19T09:21:01.289377+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:21:01.289377+0000","last_undegraded":"2024-09-19T09:21:01.289377+0000","last_fullsized":"2024-09-19T09:21:01.289377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303987+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:21:01.303987+0000","last_peered":"2024-09-19T09:21:01.303987+0000","last_clean":"2024-09-19T09:21:01.303987+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:21:01.303987+0000","last_undegraded":"2024-09-19T09:21:01.303987+0000","last_fullsized":"2024-09-19T09:21:01.303987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295670+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:21:01.295670+0000","last_peered":"2024-09-19T09:21:01.295670+0000","last_clean":"2024-09-19T09:21:01.295670+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:21:01.295670+0000","last_undegraded":"2024-09-19T09:21:01.295670+0000","last_fullsized":"2024-09-19T09:21:01.295670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298974+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:21:01.298974+0000","last_peered":"2024-09-19T09:21:01.298974+0000","last_clean":"2024-09-19T09:21:01.298974+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:21:01.298974+0000","last_undegraded":"2024-09-19T09:21:01.298974+0000","last_fullsized":"2024-09-19T09:21:01.298974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289674+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:21:01.289674+0000","last_peered":"2024-09-19T09:21:01.289674+0000","last_clean":"2024-09-19T09:21:01.289674+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:21:01.289674+0000","last_undegraded":"2024-09-19T09:21:01.289674+0000","last_fullsized":"2024-09-19T09:21:01.289674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295019+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:21:01.295019+0000","last_peered":"2024-09-19T09:21:01.295019+0000","last_clean":"2024-09-19T09:21:01.295019+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:21:01.295019+0000","last_undegraded":"2024-09-19T09:21:01.295019+0000","last_fullsized":"2024-09-19T09:21:01.295019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294163+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:21:01.294163+0000","last_peered":"2024-09-19T09:21:01.294163+0000","last_clean":"2024-09-19T09:21:01.294163+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:21:01.294163+0000","last_undegraded":"2024-09-19T09:21:01.294163+0000","last_fullsized":"2024-09-19T09:21:01.294163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296002+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:21:01.296002+0000","last_peered":"2024-09-19T09:21:01.296002+0000","last_clean":"2024-09-19T09:21:01.296002+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:21:01.296002+0000","last_undegraded":"2024-09-19T09:21:01.296002+0000","last_fullsized":"2024-09-19T09:21:01.296002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298541+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:21:01.298541+0000","last_peered":"2024-09-19T09:21:01.298541+0000","last_clean":"2024-09-19T09:21:01.298541+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:21:01.298541+0000","last_undegraded":"2024-09-19T09:21:01.298541+0000","last_fullsized":"2024-09-19T09:21:01.298541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.288921+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:21:01.288921+0000","last_peered":"2024-09-19T09:21:01.288921+0000","last_clean":"2024-09-19T09:21:01.288921+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:21:01.288921+0000","last_undegraded":"2024-09-19T09:21:01.288921+0000","last_fullsized":"2024-09-19T09:21:01.288921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:09.935794+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:21:09.935794+0000","last_peered":"2024-09-19T09:21:09.935794+0000","last_clean":"2024-09-19T09:21:09.935794+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:21:09.935794+0000","last_undegraded":"2024-09-19T09:21:09.935794+0000","last_fullsized":"2024-09-19T09:21:09.935794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293250+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:21:01.293250+0000","last_peered":"2024-09-19T09:21:01.293250+0000","last_clean":"2024-09-19T09:21:01.293250+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:21:01.293250+0000","last_undegraded":"2024-09-19T09:21:01.293250+0000","last_fullsized":"2024-09-19T09:21:01.293250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298659+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:21:01.298659+0000","last_peered":"2024-09-19T09:21:01.298659+0000","last_clean":"2024-09-19T09:21:01.298659+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:21:01.298659+0000","last_undegraded":"2024-09-19T09:21:01.298659+0000","last_fullsized":"2024-09-19T09:21:01.298659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292872+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:21:01.292872+0000","last_peered":"2024-09-19T09:21:01.292872+0000","last_clean":"2024-09-19T09:21:01.292872+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:21:01.292872+0000","last_undegraded":"2024-09-19T09:21:01.292872+0000","last_fullsized":"2024-09-19T09:21:01.292872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:06.931433+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:06.931433+0000","last_peered":"2024-09-19T09:21:06.931433+0000","last_clean":"2024-09-19T09:21:06.931433+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:06.931433+0000","last_undegraded":"2024-09-19T09:21:06.931433+0000","last_fullsized":"2024-09-19T09:21:06.931433+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":271,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:07.932551+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:07.932551+0000","last_peered":"2024-09-19T09:21:07.932551+0000","last_clean":"2024-09-19T09:21:07.932551+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:07.932551+0000","last_undegraded":"2024-09-19T09:21:07.932551+0000","last_fullsized":"2024-09-19T09:21:07.932551+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":171,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291779+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:21:01.291779+0000","last_peered":"2024-09-19T09:21:01.291779+0000","last_clean":"2024-09-19T09:21:01.291779+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:21:01.291779+0000","last_undegraded":"2024-09-19T09:21:01.291779+0000","last_fullsized":"2024-09-19T09:21:01.291779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294536+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:21:01.294536+0000","last_peered":"2024-09-19T09:21:01.294536+0000","last_clean":"2024-09-19T09:21:01.294536+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:21:01.294536+0000","last_undegraded":"2024-09-19T09:21:01.294536+0000","last_fullsized":"2024-09-19T09:21:01.294536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296324+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:21:01.296324+0000","last_peered":"2024-09-19T09:21:01.296324+0000","last_clean":"2024-09-19T09:21:01.296324+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:21:01.296324+0000","last_undegraded":"2024-09-19T09:21:01.296324+0000","last_fullsized":"2024-09-19T09:21:01.296324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":136,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:04.950320+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:04.950320+0000","last_peered":"2024-09-19T09:21:04.950320+0000","last_clean":"2024-09-19T09:21:04.950320+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:04.950320+0000","last_undegraded":"2024-09-19T09:21:04.950320+0000","last_fullsized":"2024-09-19T09:21:04.950320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291256+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:21:01.291256+0000","last_peered":"2024-09-19T09:21:01.291256+0000","last_clean":"2024-09-19T09:21:01.291256+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:21:01.291256+0000","last_undegraded":"2024-09-19T09:21:01.291256+0000","last_fullsized":"2024-09-19T09:21:01.291256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.280355+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:21:01.280355+0000","last_peered":"2024-09-19T09:21:01.280355+0000","last_clean":"2024-09-19T09:21:01.280355+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:21:01.280355+0000","last_undegraded":"2024-09-19T09:21:01.280355+0000","last_fullsized":"2024-09-19T09:21:01.280355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303702+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:21:01.303702+0000","last_peered":"2024-09-19T09:21:01.303702+0000","last_clean":"2024-09-19T09:21:01.303702+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:21:01.303702+0000","last_undegraded":"2024-09-19T09:21:01.303702+0000","last_fullsized":"2024-09-19T09:21:01.303702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304415+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:21:01.304415+0000","last_peered":"2024-09-19T09:21:01.304415+0000","last_clean":"2024-09-19T09:21:01.304415+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:21:01.304415+0000","last_undegraded":"2024-09-19T09:21:01.304415+0000","last_fullsized":"2024-09-19T09:21:01.304415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292107+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:21:01.292107+0000","last_peered":"2024-09-19T09:21:01.292107+0000","last_clean":"2024-09-19T09:21:01.292107+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:21:01.292107+0000","last_undegraded":"2024-09-19T09:21:01.292107+0000","last_fullsized":"2024-09-19T09:21:01.292107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305898+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:21:01.305898+0000","last_peered":"2024-09-19T09:21:01.305898+0000","last_clean":"2024-09-19T09:21:01.305898+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:21:01.305898+0000","last_undegraded":"2024-09-19T09:21:01.305898+0000","last_fullsized":"2024-09-19T09:21:01.305898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294398+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:21:01.294398+0000","last_peered":"2024-09-19T09:21:01.294398+0000","last_clean":"2024-09-19T09:21:01.294398+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:21:01.294398+0000","last_undegraded":"2024-09-19T09:21:01.294398+0000","last_fullsized":"2024-09-19T09:21:01.294398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292803+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:21:01.292803+0000","last_peered":"2024-09-19T09:21:01.292803+0000","last_clean":"2024-09-19T09:21:01.292803+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:21:01.292803+0000","last_undegraded":"2024-09-19T09:21:01.292803+0000","last_fullsized":"2024-09-19T09:21:01.292803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:08.956967+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:21:08.956967+0000","last_peered":"2024-09-19T09:21:08.956967+0000","last_clean":"2024-09-19T09:21:08.956967+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:21:08.956967+0000","last_undegraded":"2024-09-19T09:21:08.956967+0000","last_fullsized":"2024-09-19T09:21:08.956967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.284498+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:21:01.284498+0000","last_peered":"2024-09-19T09:21:01.284498+0000","last_clean":"2024-09-19T09:21:01.284498+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:21:01.284498+0000","last_undegraded":"2024-09-19T09:21:01.284498+0000","last_fullsized":"2024-09-19T09:21:01.284498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294244+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:21:01.294244+0000","last_peered":"2024-09-19T09:21:01.294244+0000","last_clean":"2024-09-19T09:21:01.294244+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:21:01.294244+0000","last_undegraded":"2024-09-19T09:21:01.294244+0000","last_fullsized":"2024-09-19T09:21:01.294244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091442+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091442+0000","last_peered":"2024-09-19T09:20:33.091442+0000","last_clean":"2024-09-19T09:20:33.091442+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091442+0000","last_undegraded":"2024-09-19T09:20:33.091442+0000","last_fullsized":"2024-09-19T09:20:33.091442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300466+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:21:01.300466+0000","last_peered":"2024-09-19T09:21:01.300466+0000","last_clean":"2024-09-19T09:21:01.300466+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:21:01.300466+0000","last_undegraded":"2024-09-19T09:21:01.300466+0000","last_fullsized":"2024-09-19T09:21:01.300466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.257752+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:21:01.257752+0000","last_peered":"2024-09-19T09:21:01.257752+0000","last_clean":"2024-09-19T09:21:01.257752+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:21:01.257752+0000","last_undegraded":"2024-09-19T09:21:01.257752+0000","last_fullsized":"2024-09-19T09:21:01.257752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302793+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:21:01.302793+0000","last_peered":"2024-09-19T09:21:01.302793+0000","last_clean":"2024-09-19T09:21:01.302793+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:21:01.302793+0000","last_undegraded":"2024-09-19T09:21:01.302793+0000","last_fullsized":"2024-09-19T09:21:01.302793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291573+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:21:01.291573+0000","last_peered":"2024-09-19T09:21:01.291573+0000","last_clean":"2024-09-19T09:21:01.291573+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:21:01.291573+0000","last_undegraded":"2024-09-19T09:21:01.291573+0000","last_fullsized":"2024-09-19T09:21:01.291573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304998+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:21:01.304998+0000","last_peered":"2024-09-19T09:21:01.304998+0000","last_clean":"2024-09-19T09:21:01.304998+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:21:01.304998+0000","last_undegraded":"2024-09-19T09:21:01.304998+0000","last_fullsized":"2024-09-19T09:21:01.304998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289848+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:21:01.289848+0000","last_peered":"2024-09-19T09:21:01.289848+0000","last_clean":"2024-09-19T09:21:01.289848+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:21:01.289848+0000","last_undegraded":"2024-09-19T09:21:01.289848+0000","last_fullsized":"2024-09-19T09:21:01.289848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295261+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:21:01.295261+0000","last_peered":"2024-09-19T09:21:01.295261+0000","last_clean":"2024-09-19T09:21:01.295261+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:21:01.295261+0000","last_undegraded":"2024-09-19T09:21:01.295261+0000","last_fullsized":"2024-09-19T09:21:01.295261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091596+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091596+0000","last_peered":"2024-09-19T09:20:33.091596+0000","last_clean":"2024-09-19T09:20:33.091596+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091596+0000","last_undegraded":"2024-09-19T09:20:33.091596+0000","last_fullsized":"2024-09-19T09:20:33.091596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":397,"num_write":174,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678052,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939688,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299443,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1036966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920834,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051654,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280586,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476816,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:13.029 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:21:13.030 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:21:13.290 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:13.395 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:13 smithi052 ceph-mon[30947]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:13.495 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:13 smithi169 ceph-mon[35454]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:13 smithi086 ceph-mon[34813]: pgmap v331: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:21:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 -- 172.21.15.52:0/1251478400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc10c180 msgr2=0x7fabcc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 --2- 172.21.15.52:0/1251478400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc10c180 0x7fabcc10e610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009ca0 tx=0x7fabc402a950 comp rx=0 tx=0).stop 2024-09-19T09:21:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 -- 172.21.15.52:0/1251478400 shutdown_connections 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 --2- 172.21.15.52:0/1251478400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc10c180 0x7fabcc10e610 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 --2- 172.21.15.52:0/1251478400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc103700 0x7fabcc10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 --2- 172.21.15.52:0/1251478400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc102de0 0x7fabcc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 -- 172.21.15.52:0/1251478400 >> 172.21.15.52:0/1251478400 conn(0x7fabcc0fc7a0 msgr2=0x7fabcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 -- 172.21.15.52:0/1251478400 shutdown_connections 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.729+0000 7fabd4759640 1 -- 172.21.15.52:0/1251478400 wait complete. 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 Processor -- start 2024-09-19T09:21:13.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 -- start start 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc103700 0x7fabcc100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 0x7fabcc1014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc111f70 con 0x7fabcc102de0 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc111df0 con 0x7fabcc10c180 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd4759640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabcc1120f0 con 0x7fabcc103700 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.730+0000 7fabd24f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54328/0 (socket says 172.21.15.52:54328) 2024-09-19T09:21:13.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 -- 172.21.15.52:0/3548498239 learned_addr learned my addr 172.21.15.52:0/3548498239 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd1cf4640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc103700 0x7fabcc100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd2cf6640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 0x7fabcc1014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 -- 172.21.15.52:0/3548498239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc103700 msgr2=0x7fabcc100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc103700 0x7fabcc100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 -- 172.21.15.52:0/3548498239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 msgr2=0x7fabcc1014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 0x7fabcc1014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 -- 172.21.15.52:0/3548498239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabcc1a68d0 con 0x7fabcc102de0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd2cf6640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 0x7fabcc1014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd24f5640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc800d770 tx=0x7fabc800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8017070 con 0x7fabcc102de0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabcc1a6bc0 con 0x7fabcc102de0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc8005500 con 0x7fabcc102de0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8004e00 con 0x7fabcc102de0 2024-09-19T09:21:13.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.731+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabcc1a7100 con 0x7fabcc102de0 2024-09-19T09:21:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.732+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabcc1031c0 con 0x7fabcc102de0 2024-09-19T09:21:13.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.734+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fabc8004fa0 con 0x7fabcc102de0 2024-09-19T09:21:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.735+0000 7fabc37fe640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.735+0000 7fabd1cf4640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.735+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fabc80cf770 con 0x7fabcc102de0 2024-09-19T09:21:13.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.736+0000 7fabd1cf4640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fabcc1024d0 tx=0x7fabbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:13.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.739+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabc809c410 con 0x7fabcc102de0 2024-09-19T09:21:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.911+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 --> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabcc062630 con 0x7fabb80a3240 2024-09-19T09:21:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.917+0000 7fabc37fe640 1 -- 172.21.15.52:0/3548498239 <== mgr.14150 v2:172.21.15.52:6800/2340346787 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258835 (secure 0 0 0) 0x7fabcc062630 con 0x7fabb80a3240 2024-09-19T09:21:13.922 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:13.923 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-19T09:21:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 msgr2=0x7fabb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fabcc1024d0 tx=0x7fabbc00b390 comp rx=0 tx=0).stop 2024-09-19T09:21:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 msgr2=0x7fabcc100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fabc800d770 tx=0x7fabc800dc30 comp rx=0 tx=0).stop 2024-09-19T09:21:13.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 shutdown_connections 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabcc10c180 0x7fabcc1014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabcc103700 0x7fabcc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 --2- 172.21.15.52:0/3548498239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabcc102de0 0x7fabcc100a40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 >> 172.21.15.52:0/3548498239 conn(0x7fabcc0fc7a0 msgr2=0x7fabcc0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 shutdown_connections 2024-09-19T09:21:13.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:13.921+0000 7fabd4759640 1 -- 172.21.15.52:0/3548498239 wait complete. 2024-09-19T09:21:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:14 smithi086 ceph-mon[34813]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:14.561 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:14 smithi052 ceph-mon[30947]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:14.592 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-19T09:21:13.305961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661677,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":788,"num_read_kb":517,"num_write":357,"num_write_kb":3063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180770,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":786,"ondisk_log_size":786,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":407764,"kb_used_data":12756,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124534060,"statfs":{"total":1151940427776,"available":1151522877440,"internally_reserved":0,"allocated":13062144,"data_stored":7311195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":50,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003565"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304849+0000","last_change":"2024-09-19T09:19:17.810183+0000","last_active":"2024-09-19T09:21:01.304849+0000","last_peered":"2024-09-19T09:21:01.304849+0000","last_clean":"2024-09-19T09:21:01.304849+0000","last_became_active":"2024-09-19T09:19:17.809780+0000","last_became_peered":"2024-09-19T09:19:17.809780+0000","last_unstale":"2024-09-19T09:21:01.304849+0000","last_undegraded":"2024-09-19T09:21:01.304849+0000","last_fullsized":"2024-09-19T09:21:01.304849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:30.996738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303195+0000","last_change":"2024-09-19T09:19:17.806166+0000","last_active":"2024-09-19T09:21:01.303195+0000","last_peered":"2024-09-19T09:21:01.303195+0000","last_clean":"2024-09-19T09:21:01.303195+0000","last_became_active":"2024-09-19T09:19:17.805855+0000","last_became_peered":"2024-09-19T09:19:17.805855+0000","last_unstale":"2024-09-19T09:21:01.303195+0000","last_undegraded":"2024-09-19T09:21:01.303195+0000","last_fullsized":"2024-09-19T09:21:01.303195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:33.107548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302927+0000","last_change":"2024-09-19T09:19:17.802334+0000","last_active":"2024-09-19T09:21:01.302927+0000","last_peered":"2024-09-19T09:21:01.302927+0000","last_clean":"2024-09-19T09:21:01.302927+0000","last_became_active":"2024-09-19T09:19:17.801879+0000","last_became_peered":"2024-09-19T09:19:17.801879+0000","last_unstale":"2024-09-19T09:21:01.302927+0000","last_undegraded":"2024-09-19T09:21:01.302927+0000","last_fullsized":"2024-09-19T09:21:01.302927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:04.517833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299230+0000","last_change":"2024-09-19T09:19:17.794448+0000","last_active":"2024-09-19T09:21:01.299230+0000","last_peered":"2024-09-19T09:21:01.299230+0000","last_clean":"2024-09-19T09:21:01.299230+0000","last_became_active":"2024-09-19T09:19:17.794081+0000","last_became_peered":"2024-09-19T09:19:17.794081+0000","last_unstale":"2024-09-19T09:21:01.299230+0000","last_undegraded":"2024-09-19T09:21:01.299230+0000","last_fullsized":"2024-09-19T09:21:01.299230+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:10.763015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292098+0000","last_change":"2024-09-19T09:19:17.799456+0000","last_active":"2024-09-19T09:21:01.292098+0000","last_peered":"2024-09-19T09:21:01.292098+0000","last_clean":"2024-09-19T09:21:01.292098+0000","last_became_active":"2024-09-19T09:19:17.799141+0000","last_became_peered":"2024-09-19T09:19:17.799141+0000","last_unstale":"2024-09-19T09:21:01.292098+0000","last_undegraded":"2024-09-19T09:21:01.292098+0000","last_fullsized":"2024-09-19T09:21:01.292098+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:58.130854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302941+0000","last_change":"2024-09-19T09:19:17.811777+0000","last_active":"2024-09-19T09:21:01.302941+0000","last_peered":"2024-09-19T09:21:01.302941+0000","last_clean":"2024-09-19T09:21:01.302941+0000","last_became_active":"2024-09-19T09:19:17.811411+0000","last_became_peered":"2024-09-19T09:19:17.811411+0000","last_unstale":"2024-09-19T09:21:01.302941+0000","last_undegraded":"2024-09-19T09:21:01.302941+0000","last_fullsized":"2024-09-19T09:21:01.302941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:21.784171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303763+0000","last_change":"2024-09-19T09:19:32.851709+0000","last_active":"2024-09-19T09:21:01.303763+0000","last_peered":"2024-09-19T09:21:01.303763+0000","last_clean":"2024-09-19T09:21:01.303763+0000","last_became_active":"2024-09-19T09:19:32.851359+0000","last_became_peered":"2024-09-19T09:19:32.851359+0000","last_unstale":"2024-09-19T09:21:01.303763+0000","last_undegraded":"2024-09-19T09:21:01.303763+0000","last_fullsized":"2024-09-19T09:21:01.303763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.628327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297317+0000","last_change":"2024-09-19T09:19:17.803795+0000","last_active":"2024-09-19T09:21:01.297317+0000","last_peered":"2024-09-19T09:21:01.297317+0000","last_clean":"2024-09-19T09:21:01.297317+0000","last_became_active":"2024-09-19T09:19:17.803451+0000","last_became_peered":"2024-09-19T09:19:17.803451+0000","last_unstale":"2024-09-19T09:21:01.297317+0000","last_undegraded":"2024-09-19T09:21:01.297317+0000","last_fullsized":"2024-09-19T09:21:01.297317+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:59.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297323+0000","last_change":"2024-09-19T09:19:17.808020+0000","last_active":"2024-09-19T09:21:01.297323+0000","last_peered":"2024-09-19T09:21:01.297323+0000","last_clean":"2024-09-19T09:21:01.297323+0000","last_became_active":"2024-09-19T09:19:17.807100+0000","last_became_peered":"2024-09-19T09:19:17.807100+0000","last_unstale":"2024-09-19T09:21:01.297323+0000","last_undegraded":"2024-09-19T09:21:01.297323+0000","last_fullsized":"2024-09-19T09:21:01.297323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:17.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303159+0000","last_change":"2024-09-19T09:19:17.812766+0000","last_active":"2024-09-19T09:21:01.303159+0000","last_peered":"2024-09-19T09:21:01.303159+0000","last_clean":"2024-09-19T09:21:01.303159+0000","last_became_active":"2024-09-19T09:19:17.812459+0000","last_became_peered":"2024-09-19T09:19:17.812459+0000","last_unstale":"2024-09-19T09:21:01.303159+0000","last_undegraded":"2024-09-19T09:21:01.303159+0000","last_fullsized":"2024-09-19T09:21:01.303159+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:35.343489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305750+0000","last_change":"2024-09-19T09:19:17.806100+0000","last_active":"2024-09-19T09:21:01.305750+0000","last_peered":"2024-09-19T09:21:01.305750+0000","last_clean":"2024-09-19T09:21:01.305750+0000","last_became_active":"2024-09-19T09:19:17.805596+0000","last_became_peered":"2024-09-19T09:19:17.805596+0000","last_unstale":"2024-09-19T09:21:01.305750+0000","last_undegraded":"2024-09-19T09:21:01.305750+0000","last_fullsized":"2024-09-19T09:21:01.305750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:19.874009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296039+0000","last_change":"2024-09-19T09:19:17.809612+0000","last_active":"2024-09-19T09:21:01.296039+0000","last_peered":"2024-09-19T09:21:01.296039+0000","last_clean":"2024-09-19T09:21:01.296039+0000","last_became_active":"2024-09-19T09:19:17.809279+0000","last_became_peered":"2024-09-19T09:19:17.809279+0000","last_unstale":"2024-09-19T09:21:01.296039+0000","last_undegraded":"2024-09-19T09:21:01.296039+0000","last_fullsized":"2024-09-19T09:21:01.296039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:48.222107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.299054+0000","last_change":"2024-09-19T09:19:17.804136+0000","last_active":"2024-09-19T09:21:01.299054+0000","last_peered":"2024-09-19T09:21:01.299054+0000","last_clean":"2024-09-19T09:21:01.299054+0000","last_became_active":"2024-09-19T09:19:17.803787+0000","last_became_peered":"2024-09-19T09:19:17.803787+0000","last_unstale":"2024-09-19T09:21:01.299054+0000","last_undegraded":"2024-09-19T09:21:01.299054+0000","last_fullsized":"2024-09-19T09:21:01.299054+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:26.397249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303356+0000","last_change":"2024-09-19T09:19:17.805235+0000","last_active":"2024-09-19T09:21:01.303356+0000","last_peered":"2024-09-19T09:21:01.303356+0000","last_clean":"2024-09-19T09:21:01.303356+0000","last_became_active":"2024-09-19T09:19:17.804894+0000","last_became_peered":"2024-09-19T09:19:17.804894+0000","last_unstale":"2024-09-19T09:21:01.303356+0000","last_undegraded":"2024-09-19T09:21:01.303356+0000","last_fullsized":"2024-09-19T09:21:01.303356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:59.195668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300961+0000","last_change":"2024-09-19T09:20:33.114502+0000","last_active":"2024-09-19T09:21:01.300961+0000","last_peered":"2024-09-19T09:21:01.300961+0000","last_clean":"2024-09-19T09:21:01.300961+0000","last_became_active":"2024-09-19T09:20:33.113955+0000","last_became_peered":"2024-09-19T09:20:33.113955+0000","last_unstale":"2024-09-19T09:21:01.300961+0000","last_undegraded":"2024-09-19T09:21:01.300961+0000","last_fullsized":"2024-09-19T09:21:01.300961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.745248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305682+0000","last_change":"2024-09-19T09:19:17.802978+0000","last_active":"2024-09-19T09:21:01.305682+0000","last_peered":"2024-09-19T09:21:01.305682+0000","last_clean":"2024-09-19T09:21:01.305682+0000","last_became_active":"2024-09-19T09:19:17.802524+0000","last_became_peered":"2024-09-19T09:19:17.802524+0000","last_unstale":"2024-09-19T09:21:01.305682+0000","last_undegraded":"2024-09-19T09:21:01.305682+0000","last_fullsized":"2024-09-19T09:21:01.305682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:40.664319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304928+0000","last_change":"2024-09-19T09:19:17.810450+0000","last_active":"2024-09-19T09:21:01.304928+0000","last_peered":"2024-09-19T09:21:01.304928+0000","last_clean":"2024-09-19T09:21:01.304928+0000","last_became_active":"2024-09-19T09:19:17.809984+0000","last_became_peered":"2024-09-19T09:19:17.809984+0000","last_unstale":"2024-09-19T09:21:01.304928+0000","last_undegraded":"2024-09-19T09:21:01.304928+0000","last_fullsized":"2024-09-19T09:21:01.304928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:35.366881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289377+0000","last_change":"2024-09-19T09:19:17.804836+0000","last_active":"2024-09-19T09:21:01.289377+0000","last_peered":"2024-09-19T09:21:01.289377+0000","last_clean":"2024-09-19T09:21:01.289377+0000","last_became_active":"2024-09-19T09:19:17.804530+0000","last_became_peered":"2024-09-19T09:19:17.804530+0000","last_unstale":"2024-09-19T09:21:01.289377+0000","last_undegraded":"2024-09-19T09:21:01.289377+0000","last_fullsized":"2024-09-19T09:21:01.289377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:07.246214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.290279+0000","last_change":"2024-09-19T09:19:17.795263+0000","last_active":"2024-09-19T09:21:01.290279+0000","last_peered":"2024-09-19T09:21:01.290279+0000","last_clean":"2024-09-19T09:21:01.290279+0000","last_became_active":"2024-09-19T09:19:17.794955+0000","last_became_peered":"2024-09-19T09:19:17.794955+0000","last_unstale":"2024-09-19T09:21:01.290279+0000","last_undegraded":"2024-09-19T09:21:01.290279+0000","last_fullsized":"2024-09-19T09:21:01.290279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:57.738770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303987+0000","last_change":"2024-09-19T09:19:17.811848+0000","last_active":"2024-09-19T09:21:01.303987+0000","last_peered":"2024-09-19T09:21:01.303987+0000","last_clean":"2024-09-19T09:21:01.303987+0000","last_became_active":"2024-09-19T09:19:17.811399+0000","last_became_peered":"2024-09-19T09:19:17.811399+0000","last_unstale":"2024-09-19T09:21:01.303987+0000","last_undegraded":"2024-09-19T09:21:01.303987+0000","last_fullsized":"2024-09-19T09:21:01.303987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:15.133254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295670+0000","last_change":"2024-09-19T09:19:17.799410+0000","last_active":"2024-09-19T09:21:01.295670+0000","last_peered":"2024-09-19T09:21:01.295670+0000","last_clean":"2024-09-19T09:21:01.295670+0000","last_became_active":"2024-09-19T09:19:17.799018+0000","last_became_peered":"2024-09-19T09:19:17.799018+0000","last_unstale":"2024-09-19T09:21:01.295670+0000","last_undegraded":"2024-09-19T09:21:01.295670+0000","last_fullsized":"2024-09-19T09:21:01.295670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:35.566763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305740+0000","last_change":"2024-09-19T09:19:17.800348+0000","last_active":"2024-09-19T09:21:01.305740+0000","last_peered":"2024-09-19T09:21:01.305740+0000","last_clean":"2024-09-19T09:21:01.305740+0000","last_became_active":"2024-09-19T09:19:17.799925+0000","last_became_peered":"2024-09-19T09:19:17.799925+0000","last_unstale":"2024-09-19T09:21:01.305740+0000","last_undegraded":"2024-09-19T09:21:01.305740+0000","last_fullsized":"2024-09-19T09:21:01.305740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.067198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298974+0000","last_change":"2024-09-19T09:19:17.798361+0000","last_active":"2024-09-19T09:21:01.298974+0000","last_peered":"2024-09-19T09:21:01.298974+0000","last_clean":"2024-09-19T09:21:01.298974+0000","last_became_active":"2024-09-19T09:19:17.798105+0000","last_became_peered":"2024-09-19T09:19:17.798105+0000","last_unstale":"2024-09-19T09:21:01.298974+0000","last_undegraded":"2024-09-19T09:21:01.298974+0000","last_fullsized":"2024-09-19T09:21:01.298974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:05.601818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289674+0000","last_change":"2024-09-19T09:19:32.850364+0000","last_active":"2024-09-19T09:21:01.289674+0000","last_peered":"2024-09-19T09:21:01.289674+0000","last_clean":"2024-09-19T09:21:01.289674+0000","last_became_active":"2024-09-19T09:19:32.849975+0000","last_became_peered":"2024-09-19T09:19:32.849975+0000","last_unstale":"2024-09-19T09:21:01.289674+0000","last_undegraded":"2024-09-19T09:21:01.289674+0000","last_fullsized":"2024-09-19T09:21:01.289674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:41.220680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295019+0000","last_change":"2024-09-19T09:19:17.791976+0000","last_active":"2024-09-19T09:21:01.295019+0000","last_peered":"2024-09-19T09:21:01.295019+0000","last_clean":"2024-09-19T09:21:01.295019+0000","last_became_active":"2024-09-19T09:19:17.791668+0000","last_became_peered":"2024-09-19T09:19:17.791668+0000","last_unstale":"2024-09-19T09:21:01.295019+0000","last_undegraded":"2024-09-19T09:21:01.295019+0000","last_fullsized":"2024-09-19T09:21:01.295019+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:11.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.281882+0000","last_change":"2024-09-19T09:19:17.794239+0000","last_active":"2024-09-19T09:21:01.281882+0000","last_peered":"2024-09-19T09:21:01.281882+0000","last_clean":"2024-09-19T09:21:01.281882+0000","last_became_active":"2024-09-19T09:19:17.793700+0000","last_became_peered":"2024-09-19T09:19:17.793700+0000","last_unstale":"2024-09-19T09:21:01.281882+0000","last_undegraded":"2024-09-19T09:21:01.281882+0000","last_fullsized":"2024-09-19T09:21:01.281882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:33:07.250724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294163+0000","last_change":"2024-09-19T09:19:17.804781+0000","last_active":"2024-09-19T09:21:01.294163+0000","last_peered":"2024-09-19T09:21:01.294163+0000","last_clean":"2024-09-19T09:21:01.294163+0000","last_became_active":"2024-09-19T09:19:17.804435+0000","last_became_peered":"2024-09-19T09:19:17.804435+0000","last_unstale":"2024-09-19T09:21:01.294163+0000","last_undegraded":"2024-09-19T09:21:01.294163+0000","last_fullsized":"2024-09-19T09:21:01.294163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:10.797582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296002+0000","last_change":"2024-09-19T09:19:17.795999+0000","last_active":"2024-09-19T09:21:01.296002+0000","last_peered":"2024-09-19T09:21:01.296002+0000","last_clean":"2024-09-19T09:21:01.296002+0000","last_became_active":"2024-09-19T09:19:17.795676+0000","last_became_peered":"2024-09-19T09:19:17.795676+0000","last_unstale":"2024-09-19T09:21:01.296002+0000","last_undegraded":"2024-09-19T09:21:01.296002+0000","last_fullsized":"2024-09-19T09:21:01.296002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:51.508384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301032+0000","last_change":"2024-09-19T09:19:17.796935+0000","last_active":"2024-09-19T09:21:01.301032+0000","last_peered":"2024-09-19T09:21:01.301032+0000","last_clean":"2024-09-19T09:21:01.301032+0000","last_became_active":"2024-09-19T09:19:17.796171+0000","last_became_peered":"2024-09-19T09:19:17.796171+0000","last_unstale":"2024-09-19T09:21:01.301032+0000","last_undegraded":"2024-09-19T09:21:01.301032+0000","last_fullsized":"2024-09-19T09:21:01.301032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:52.689304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289962+0000","last_change":"2024-09-19T09:19:17.798733+0000","last_active":"2024-09-19T09:21:01.289962+0000","last_peered":"2024-09-19T09:21:01.289962+0000","last_clean":"2024-09-19T09:21:01.289962+0000","last_became_active":"2024-09-19T09:19:17.798200+0000","last_became_peered":"2024-09-19T09:19:17.798200+0000","last_unstale":"2024-09-19T09:21:01.289962+0000","last_undegraded":"2024-09-19T09:21:01.289962+0000","last_fullsized":"2024-09-19T09:21:01.289962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:17.795352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.297712+0000","last_change":"2024-09-19T09:19:17.801046+0000","last_active":"2024-09-19T09:21:01.297712+0000","last_peered":"2024-09-19T09:21:01.297712+0000","last_clean":"2024-09-19T09:21:01.297712+0000","last_became_active":"2024-09-19T09:19:17.800713+0000","last_became_peered":"2024-09-19T09:19:17.800713+0000","last_unstale":"2024-09-19T09:21:01.297712+0000","last_undegraded":"2024-09-19T09:21:01.297712+0000","last_fullsized":"2024-09-19T09:21:01.297712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:13.269867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298541+0000","last_change":"2024-09-19T09:19:17.803270+0000","last_active":"2024-09-19T09:21:01.298541+0000","last_peered":"2024-09-19T09:21:01.298541+0000","last_clean":"2024-09-19T09:21:01.298541+0000","last_became_active":"2024-09-19T09:19:17.802883+0000","last_became_peered":"2024-09-19T09:19:17.802883+0000","last_unstale":"2024-09-19T09:21:01.298541+0000","last_undegraded":"2024-09-19T09:21:01.298541+0000","last_fullsized":"2024-09-19T09:21:01.298541+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:28.465636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.288921+0000","last_change":"2024-09-19T09:19:17.803071+0000","last_active":"2024-09-19T09:21:01.288921+0000","last_peered":"2024-09-19T09:21:01.288921+0000","last_clean":"2024-09-19T09:21:01.288921+0000","last_became_active":"2024-09-19T09:19:17.802729+0000","last_became_peered":"2024-09-19T09:19:17.802729+0000","last_unstale":"2024-09-19T09:21:01.288921+0000","last_undegraded":"2024-09-19T09:21:01.288921+0000","last_fullsized":"2024-09-19T09:21:01.288921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:08.803014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'5","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:09.935794+0000","last_change":"2024-09-19T09:19:15.724943+0000","last_active":"2024-09-19T09:21:09.935794+0000","last_peered":"2024-09-19T09:21:09.935794+0000","last_clean":"2024-09-19T09:21:09.935794+0000","last_became_active":"2024-09-19T09:19:15.724593+0000","last_became_peered":"2024-09-19T09:19:15.724593+0000","last_unstale":"2024-09-19T09:21:09.935794+0000","last_undegraded":"2024-09-19T09:21:09.935794+0000","last_fullsized":"2024-09-19T09:21:09.935794+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:53.468700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293250+0000","last_change":"2024-09-19T09:19:32.850691+0000","last_active":"2024-09-19T09:21:01.293250+0000","last_peered":"2024-09-19T09:21:01.293250+0000","last_clean":"2024-09-19T09:21:01.293250+0000","last_became_active":"2024-09-19T09:19:32.850281+0000","last_became_peered":"2024-09-19T09:19:32.850281+0000","last_unstale":"2024-09-19T09:21:01.293250+0000","last_undegraded":"2024-09-19T09:21:01.293250+0000","last_fullsized":"2024-09-19T09:21:01.293250+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.372967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.288796+0000","last_change":"2024-09-19T09:19:32.888269+0000","last_active":"2024-09-19T09:20:33.288796+0000","last_peered":"2024-09-19T09:20:33.288796+0000","last_clean":"2024-09-19T09:20:33.288796+0000","last_became_active":"2024-09-19T09:19:32.885222+0000","last_became_peered":"2024-09-19T09:19:32.885222+0000","last_unstale":"2024-09-19T09:20:33.288796+0000","last_undegraded":"2024-09-19T09:20:33.288796+0000","last_fullsized":"2024-09-19T09:20:33.288796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:01.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113140+0000","last_change":"2024-09-19T09:19:15.715249+0000","last_active":"2024-09-19T09:20:33.113140+0000","last_peered":"2024-09-19T09:20:33.113140+0000","last_clean":"2024-09-19T09:20:33.113140+0000","last_became_active":"2024-09-19T09:19:15.714897+0000","last_became_peered":"2024-09-19T09:19:15.714897+0000","last_unstale":"2024-09-19T09:20:33.113140+0000","last_undegraded":"2024-09-19T09:20:33.113140+0000","last_fullsized":"2024-09-19T09:20:33.113140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:46.777436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.298659+0000","last_change":"2024-09-19T09:19:17.795738+0000","last_active":"2024-09-19T09:21:01.298659+0000","last_peered":"2024-09-19T09:21:01.298659+0000","last_clean":"2024-09-19T09:21:01.298659+0000","last_became_active":"2024-09-19T09:19:17.795441+0000","last_became_peered":"2024-09-19T09:19:17.795441+0000","last_unstale":"2024-09-19T09:21:01.298659+0000","last_undegraded":"2024-09-19T09:21:01.298659+0000","last_fullsized":"2024-09-19T09:21:01.298659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:32.282110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139601+0000","last_change":"2024-09-19T09:19:15.722305+0000","last_active":"2024-09-19T09:20:33.139601+0000","last_peered":"2024-09-19T09:20:33.139601+0000","last_clean":"2024-09-19T09:20:33.139601+0000","last_became_active":"2024-09-19T09:19:15.721989+0000","last_became_peered":"2024-09-19T09:19:15.721989+0000","last_unstale":"2024-09-19T09:20:33.139601+0000","last_undegraded":"2024-09-19T09:20:33.139601+0000","last_fullsized":"2024-09-19T09:20:33.139601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:41.477281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292872+0000","last_change":"2024-09-19T09:20:33.290071+0000","last_active":"2024-09-19T09:21:01.292872+0000","last_peered":"2024-09-19T09:21:01.292872+0000","last_clean":"2024-09-19T09:21:01.292872+0000","last_became_active":"2024-09-19T09:20:33.289817+0000","last_became_peered":"2024-09-19T09:20:33.289817+0000","last_unstale":"2024-09-19T09:21:01.292872+0000","last_undegraded":"2024-09-19T09:21:01.292872+0000","last_fullsized":"2024-09-19T09:21:01.292872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:15.930183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:11.937740+0000","last_change":"2024-09-19T09:19:15.723777+0000","last_active":"2024-09-19T09:21:11.937740+0000","last_peered":"2024-09-19T09:21:11.937740+0000","last_clean":"2024-09-19T09:21:11.937740+0000","last_became_active":"2024-09-19T09:19:15.723369+0000","last_became_peered":"2024-09-19T09:19:15.723369+0000","last_unstale":"2024-09-19T09:21:11.937740+0000","last_undegraded":"2024-09-19T09:21:11.937740+0000","last_fullsized":"2024-09-19T09:21:11.937740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:36.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304201+0000","last_change":"2024-09-19T09:19:17.809430+0000","last_active":"2024-09-19T09:21:01.304201+0000","last_peered":"2024-09-19T09:21:01.304201+0000","last_clean":"2024-09-19T09:21:01.304201+0000","last_became_active":"2024-09-19T09:19:17.809047+0000","last_became_peered":"2024-09-19T09:19:17.809047+0000","last_unstale":"2024-09-19T09:21:01.304201+0000","last_undegraded":"2024-09-19T09:21:01.304201+0000","last_fullsized":"2024-09-19T09:21:01.304201+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:37.737249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226975+0000","last_change":"2024-09-19T09:19:15.725439+0000","last_active":"2024-09-19T09:20:33.226975+0000","last_peered":"2024-09-19T09:20:33.226975+0000","last_clean":"2024-09-19T09:20:33.226975+0000","last_became_active":"2024-09-19T09:19:15.725031+0000","last_became_peered":"2024-09-19T09:19:15.725031+0000","last_unstale":"2024-09-19T09:20:33.226975+0000","last_undegraded":"2024-09-19T09:20:33.226975+0000","last_fullsized":"2024-09-19T09:20:33.226975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:57.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303569+0000","last_change":"2024-09-19T09:19:17.801244+0000","last_active":"2024-09-19T09:21:01.303569+0000","last_peered":"2024-09-19T09:21:01.303569+0000","last_clean":"2024-09-19T09:21:01.303569+0000","last_became_active":"2024-09-19T09:19:17.800815+0000","last_became_peered":"2024-09-19T09:19:17.800815+0000","last_unstale":"2024-09-19T09:21:01.303569+0000","last_undegraded":"2024-09-19T09:21:01.303569+0000","last_fullsized":"2024-09-19T09:21:01.303569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:57.144594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139741+0000","last_change":"2024-09-19T09:19:15.723754+0000","last_active":"2024-09-19T09:20:33.139741+0000","last_peered":"2024-09-19T09:20:33.139741+0000","last_clean":"2024-09-19T09:20:33.139741+0000","last_became_active":"2024-09-19T09:19:15.723412+0000","last_became_peered":"2024-09-19T09:19:15.723412+0000","last_unstale":"2024-09-19T09:20:33.139741+0000","last_undegraded":"2024-09-19T09:20:33.139741+0000","last_fullsized":"2024-09-19T09:20:33.139741+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:37.287940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301067+0000","last_change":"2024-09-19T09:19:17.801117+0000","last_active":"2024-09-19T09:21:01.301067+0000","last_peered":"2024-09-19T09:21:01.301067+0000","last_clean":"2024-09-19T09:21:01.301067+0000","last_became_active":"2024-09-19T09:19:17.800781+0000","last_became_peered":"2024-09-19T09:19:17.800781+0000","last_unstale":"2024-09-19T09:21:01.301067+0000","last_undegraded":"2024-09-19T09:21:01.301067+0000","last_fullsized":"2024-09-19T09:21:01.301067+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:57.655130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":282,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:12.938995+0000","last_change":"2024-09-19T09:19:15.724929+0000","last_active":"2024-09-19T09:21:12.938995+0000","last_peered":"2024-09-19T09:21:12.938995+0000","last_clean":"2024-09-19T09:21:12.938995+0000","last_became_active":"2024-09-19T09:19:15.724581+0000","last_became_peered":"2024-09-19T09:19:15.724581+0000","last_unstale":"2024-09-19T09:21:12.938995+0000","last_undegraded":"2024-09-19T09:21:12.938995+0000","last_fullsized":"2024-09-19T09:21:12.938995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:29.807476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66623,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291779+0000","last_change":"2024-09-19T09:19:17.801051+0000","last_active":"2024-09-19T09:21:01.291779+0000","last_peered":"2024-09-19T09:21:01.291779+0000","last_clean":"2024-09-19T09:21:01.291779+0000","last_became_active":"2024-09-19T09:19:17.800673+0000","last_became_peered":"2024-09-19T09:19:17.800673+0000","last_unstale":"2024-09-19T09:21:01.291779+0000","last_undegraded":"2024-09-19T09:21:01.291779+0000","last_fullsized":"2024-09-19T09:21:01.291779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:28.310916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338770+0000","last_change":"2024-09-19T09:19:32.861207+0000","last_active":"2024-09-19T09:20:33.338770+0000","last_peered":"2024-09-19T09:20:33.338770+0000","last_clean":"2024-09-19T09:20:33.338770+0000","last_became_active":"2024-09-19T09:19:32.847952+0000","last_became_peered":"2024-09-19T09:19:32.847952+0000","last_unstale":"2024-09-19T09:20:33.338770+0000","last_undegraded":"2024-09-19T09:20:33.338770+0000","last_fullsized":"2024-09-19T09:20:33.338770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:24:12.672642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294536+0000","last_change":"2024-09-19T09:19:32.850543+0000","last_active":"2024-09-19T09:21:01.294536+0000","last_peered":"2024-09-19T09:21:01.294536+0000","last_clean":"2024-09-19T09:21:01.294536+0000","last_became_active":"2024-09-19T09:19:32.850206+0000","last_became_peered":"2024-09-19T09:19:32.850206+0000","last_unstale":"2024-09-19T09:21:01.294536+0000","last_undegraded":"2024-09-19T09:21:01.294536+0000","last_fullsized":"2024-09-19T09:21:01.294536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.008634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139465+0000","last_change":"2024-09-19T09:19:15.722125+0000","last_active":"2024-09-19T09:20:33.139465+0000","last_peered":"2024-09-19T09:20:33.139465+0000","last_clean":"2024-09-19T09:20:33.139465+0000","last_became_active":"2024-09-19T09:19:15.721733+0000","last_became_peered":"2024-09-19T09:19:15.721733+0000","last_unstale":"2024-09-19T09:20:33.139465+0000","last_undegraded":"2024-09-19T09:20:33.139465+0000","last_fullsized":"2024-09-19T09:20:33.139465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:11.146723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.296324+0000","last_change":"2024-09-19T09:19:32.852142+0000","last_active":"2024-09-19T09:21:01.296324+0000","last_peered":"2024-09-19T09:21:01.296324+0000","last_clean":"2024-09-19T09:21:01.296324+0000","last_became_active":"2024-09-19T09:19:32.851644+0000","last_became_peered":"2024-09-19T09:19:32.851644+0000","last_unstale":"2024-09-19T09:21:01.296324+0000","last_undegraded":"2024-09-19T09:21:01.296324+0000","last_fullsized":"2024-09-19T09:21:01.296324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:29.184863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":141,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:09.959648+0000","last_change":"2024-09-19T09:19:15.715151+0000","last_active":"2024-09-19T09:21:09.959648+0000","last_peered":"2024-09-19T09:21:09.959648+0000","last_clean":"2024-09-19T09:21:09.959648+0000","last_became_active":"2024-09-19T09:19:15.714821+0000","last_became_peered":"2024-09-19T09:19:15.714821+0000","last_unstale":"2024-09-19T09:21:09.959648+0000","last_undegraded":"2024-09-19T09:21:09.959648+0000","last_fullsized":"2024-09-19T09:21:09.959648+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:42.053060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291256+0000","last_change":"2024-09-19T09:19:17.805676+0000","last_active":"2024-09-19T09:21:01.291256+0000","last_peered":"2024-09-19T09:21:01.291256+0000","last_clean":"2024-09-19T09:21:01.291256+0000","last_became_active":"2024-09-19T09:19:17.805287+0000","last_became_peered":"2024-09-19T09:19:17.805287+0000","last_unstale":"2024-09-19T09:21:01.291256+0000","last_undegraded":"2024-09-19T09:21:01.291256+0000","last_fullsized":"2024-09-19T09:21:01.291256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:42.847038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338506+0000","last_change":"2024-09-19T09:19:15.726597+0000","last_active":"2024-09-19T09:20:33.338506+0000","last_peered":"2024-09-19T09:20:33.338506+0000","last_clean":"2024-09-19T09:20:33.338506+0000","last_became_active":"2024-09-19T09:19:15.726257+0000","last_became_peered":"2024-09-19T09:19:15.726257+0000","last_unstale":"2024-09-19T09:20:33.338506+0000","last_undegraded":"2024-09-19T09:20:33.338506+0000","last_fullsized":"2024-09-19T09:20:33.338506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:00.377089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.280355+0000","last_change":"2024-09-19T09:19:17.795644+0000","last_active":"2024-09-19T09:21:01.280355+0000","last_peered":"2024-09-19T09:21:01.280355+0000","last_clean":"2024-09-19T09:21:01.280355+0000","last_became_active":"2024-09-19T09:19:17.795260+0000","last_became_peered":"2024-09-19T09:19:17.795260+0000","last_unstale":"2024-09-19T09:21:01.280355+0000","last_undegraded":"2024-09-19T09:21:01.280355+0000","last_fullsized":"2024-09-19T09:21:01.280355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:12.476729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339074+0000","last_change":"2024-09-19T09:19:15.727915+0000","last_active":"2024-09-19T09:20:33.339074+0000","last_peered":"2024-09-19T09:20:33.339074+0000","last_clean":"2024-09-19T09:20:33.339074+0000","last_became_active":"2024-09-19T09:19:15.727323+0000","last_became_peered":"2024-09-19T09:19:15.727323+0000","last_unstale":"2024-09-19T09:20:33.339074+0000","last_undegraded":"2024-09-19T09:20:33.339074+0000","last_fullsized":"2024-09-19T09:20:33.339074+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:58.376283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303702+0000","last_change":"2024-09-19T09:19:17.811997+0000","last_active":"2024-09-19T09:21:01.303702+0000","last_peered":"2024-09-19T09:21:01.303702+0000","last_clean":"2024-09-19T09:21:01.303702+0000","last_became_active":"2024-09-19T09:19:17.811551+0000","last_became_peered":"2024-09-19T09:19:17.811551+0000","last_unstale":"2024-09-19T09:21:01.303702+0000","last_undegraded":"2024-09-19T09:21:01.303702+0000","last_fullsized":"2024-09-19T09:21:01.303702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:37.398659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.113361+0000","last_change":"2024-09-19T09:19:15.723891+0000","last_active":"2024-09-19T09:20:33.113361+0000","last_peered":"2024-09-19T09:20:33.113361+0000","last_clean":"2024-09-19T09:20:33.113361+0000","last_became_active":"2024-09-19T09:19:15.723576+0000","last_became_peered":"2024-09-19T09:19:15.723576+0000","last_unstale":"2024-09-19T09:20:33.113361+0000","last_undegraded":"2024-09-19T09:20:33.113361+0000","last_fullsized":"2024-09-19T09:20:33.113361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:40.603276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304415+0000","last_change":"2024-09-19T09:19:17.798001+0000","last_active":"2024-09-19T09:21:01.304415+0000","last_peered":"2024-09-19T09:21:01.304415+0000","last_clean":"2024-09-19T09:21:01.304415+0000","last_became_active":"2024-09-19T09:19:17.797631+0000","last_became_peered":"2024-09-19T09:19:17.797631+0000","last_unstale":"2024-09-19T09:21:01.304415+0000","last_undegraded":"2024-09-19T09:21:01.304415+0000","last_fullsized":"2024-09-19T09:21:01.304415+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.680476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.139766+0000","last_change":"2024-09-19T09:19:15.723533+0000","last_active":"2024-09-19T09:20:33.139766+0000","last_peered":"2024-09-19T09:20:33.139766+0000","last_clean":"2024-09-19T09:20:33.139766+0000","last_became_active":"2024-09-19T09:19:15.722985+0000","last_became_peered":"2024-09-19T09:19:15.722985+0000","last_unstale":"2024-09-19T09:20:33.139766+0000","last_undegraded":"2024-09-19T09:20:33.139766+0000","last_fullsized":"2024-09-19T09:20:33.139766+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:54.219493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292107+0000","last_change":"2024-09-19T09:19:17.804765+0000","last_active":"2024-09-19T09:21:01.292107+0000","last_peered":"2024-09-19T09:21:01.292107+0000","last_clean":"2024-09-19T09:21:01.292107+0000","last_became_active":"2024-09-19T09:19:17.804406+0000","last_became_peered":"2024-09-19T09:19:17.804406+0000","last_unstale":"2024-09-19T09:21:01.292107+0000","last_undegraded":"2024-09-19T09:21:01.292107+0000","last_fullsized":"2024-09-19T09:21:01.292107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:02.410221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090843+0000","last_change":"2024-09-19T09:19:15.725229+0000","last_active":"2024-09-19T09:20:33.090843+0000","last_peered":"2024-09-19T09:20:33.090843+0000","last_clean":"2024-09-19T09:20:33.090843+0000","last_became_active":"2024-09-19T09:19:15.724392+0000","last_became_peered":"2024-09-19T09:19:15.724392+0000","last_unstale":"2024-09-19T09:20:33.090843+0000","last_undegraded":"2024-09-19T09:20:33.090843+0000","last_fullsized":"2024-09-19T09:20:33.090843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.557465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.305898+0000","last_change":"2024-09-19T09:19:17.806339+0000","last_active":"2024-09-19T09:21:01.305898+0000","last_peered":"2024-09-19T09:21:01.305898+0000","last_clean":"2024-09-19T09:21:01.305898+0000","last_became_active":"2024-09-19T09:19:17.806027+0000","last_became_peered":"2024-09-19T09:19:17.806027+0000","last_unstale":"2024-09-19T09:21:01.305898+0000","last_undegraded":"2024-09-19T09:21:01.305898+0000","last_fullsized":"2024-09-19T09:21:01.305898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:47.166342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'137","reported_seq":339,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226709+0000","last_change":"2024-09-19T09:18:06.090116+0000","last_active":"2024-09-19T09:20:33.226709+0000","last_peered":"2024-09-19T09:20:33.226709+0000","last_clean":"2024-09-19T09:20:33.226709+0000","last_became_active":"2024-09-19T09:18:06.089666+0000","last_became_peered":"2024-09-19T09:18:06.089666+0000","last_unstale":"2024-09-19T09:20:33.226709+0000","last_undegraded":"2024-09-19T09:20:33.226709+0000","last_fullsized":"2024-09-19T09:20:33.226709+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:47.922918+0000","last_clean_scrub_stamp":"2024-09-19T09:14:47.922918+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:51.513350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095545+0000","last_change":"2024-09-19T09:19:15.716062+0000","last_active":"2024-09-19T09:20:33.095545+0000","last_peered":"2024-09-19T09:20:33.095545+0000","last_clean":"2024-09-19T09:20:33.095545+0000","last_became_active":"2024-09-19T09:19:15.715638+0000","last_became_peered":"2024-09-19T09:19:15.715638+0000","last_unstale":"2024-09-19T09:20:33.095545+0000","last_undegraded":"2024-09-19T09:20:33.095545+0000","last_fullsized":"2024-09-19T09:20:33.095545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:30.539372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294398+0000","last_change":"2024-09-19T09:19:17.795249+0000","last_active":"2024-09-19T09:21:01.294398+0000","last_peered":"2024-09-19T09:21:01.294398+0000","last_clean":"2024-09-19T09:21:01.294398+0000","last_became_active":"2024-09-19T09:19:17.794864+0000","last_became_peered":"2024-09-19T09:19:17.794864+0000","last_unstale":"2024-09-19T09:21:01.294398+0000","last_undegraded":"2024-09-19T09:21:01.294398+0000","last_fullsized":"2024-09-19T09:21:01.294398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:20.972636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226609+0000","last_change":"2024-09-19T09:19:15.727486+0000","last_active":"2024-09-19T09:20:33.226609+0000","last_peered":"2024-09-19T09:20:33.226609+0000","last_clean":"2024-09-19T09:20:33.226609+0000","last_became_active":"2024-09-19T09:19:15.727098+0000","last_became_peered":"2024-09-19T09:19:15.727098+0000","last_unstale":"2024-09-19T09:20:33.226609+0000","last_undegraded":"2024-09-19T09:20:33.226609+0000","last_fullsized":"2024-09-19T09:20:33.226609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:29.722989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.292803+0000","last_change":"2024-09-19T09:19:17.798133+0000","last_active":"2024-09-19T09:21:01.292803+0000","last_peered":"2024-09-19T09:21:01.292803+0000","last_clean":"2024-09-19T09:21:01.292803+0000","last_became_active":"2024-09-19T09:19:17.797769+0000","last_became_peered":"2024-09-19T09:19:17.797769+0000","last_unstale":"2024-09-19T09:21:01.292803+0000","last_undegraded":"2024-09-19T09:21:01.292803+0000","last_fullsized":"2024-09-19T09:21:01.292803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:47.881760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:08.956967+0000","last_change":"2024-09-19T09:19:15.713221+0000","last_active":"2024-09-19T09:21:08.956967+0000","last_peered":"2024-09-19T09:21:08.956967+0000","last_clean":"2024-09-19T09:21:08.956967+0000","last_became_active":"2024-09-19T09:19:15.712904+0000","last_became_peered":"2024-09-19T09:19:15.712904+0000","last_unstale":"2024-09-19T09:21:08.956967+0000","last_undegraded":"2024-09-19T09:21:08.956967+0000","last_fullsized":"2024-09-19T09:21:08.956967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:22.665315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.284498+0000","last_change":"2024-09-19T09:19:17.798137+0000","last_active":"2024-09-19T09:21:01.284498+0000","last_peered":"2024-09-19T09:21:01.284498+0000","last_clean":"2024-09-19T09:21:01.284498+0000","last_became_active":"2024-09-19T09:19:17.797558+0000","last_became_peered":"2024-09-19T09:19:17.797558+0000","last_unstale":"2024-09-19T09:21:01.284498+0000","last_undegraded":"2024-09-19T09:21:01.284498+0000","last_fullsized":"2024-09-19T09:21:01.284498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:18.459957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.226910+0000","last_change":"2024-09-19T09:19:15.714275+0000","last_active":"2024-09-19T09:20:33.226910+0000","last_peered":"2024-09-19T09:20:33.226910+0000","last_clean":"2024-09-19T09:20:33.226910+0000","last_became_active":"2024-09-19T09:19:15.713976+0000","last_became_peered":"2024-09-19T09:19:15.713976+0000","last_unstale":"2024-09-19T09:20:33.226910+0000","last_undegraded":"2024-09-19T09:20:33.226910+0000","last_fullsized":"2024-09-19T09:20:33.226910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:59.275065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302733+0000","last_change":"2024-09-19T09:19:17.811775+0000","last_active":"2024-09-19T09:21:01.302733+0000","last_peered":"2024-09-19T09:21:01.302733+0000","last_clean":"2024-09-19T09:21:01.302733+0000","last_became_active":"2024-09-19T09:19:17.811416+0000","last_became_peered":"2024-09-19T09:19:17.811416+0000","last_unstale":"2024-09-19T09:21:01.302733+0000","last_undegraded":"2024-09-19T09:21:01.302733+0000","last_fullsized":"2024-09-19T09:21:01.302733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:25.829402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091335+0000","last_change":"2024-09-19T09:19:15.724124+0000","last_active":"2024-09-19T09:20:33.091335+0000","last_peered":"2024-09-19T09:20:33.091335+0000","last_clean":"2024-09-19T09:20:33.091335+0000","last_became_active":"2024-09-19T09:19:15.723611+0000","last_became_peered":"2024-09-19T09:19:15.723611+0000","last_unstale":"2024-09-19T09:20:33.091335+0000","last_undegraded":"2024-09-19T09:20:33.091335+0000","last_fullsized":"2024-09-19T09:20:33.091335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:15.976145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.293326+0000","last_change":"2024-09-19T09:19:17.804293+0000","last_active":"2024-09-19T09:21:01.293326+0000","last_peered":"2024-09-19T09:21:01.293326+0000","last_clean":"2024-09-19T09:21:01.293326+0000","last_became_active":"2024-09-19T09:19:17.803725+0000","last_became_peered":"2024-09-19T09:19:17.803725+0000","last_unstale":"2024-09-19T09:21:01.293326+0000","last_undegraded":"2024-09-19T09:21:01.293326+0000","last_fullsized":"2024-09-19T09:21:01.293326+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:02.921649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.339113+0000","last_change":"2024-09-19T09:19:15.721995+0000","last_active":"2024-09-19T09:20:33.339113+0000","last_peered":"2024-09-19T09:20:33.339113+0000","last_clean":"2024-09-19T09:20:33.339113+0000","last_became_active":"2024-09-19T09:19:15.721048+0000","last_became_peered":"2024-09-19T09:19:15.721048+0000","last_unstale":"2024-09-19T09:20:33.339113+0000","last_undegraded":"2024-09-19T09:20:33.339113+0000","last_fullsized":"2024-09-19T09:20:33.339113+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:21.536500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.294244+0000","last_change":"2024-09-19T09:19:17.798984+0000","last_active":"2024-09-19T09:21:01.294244+0000","last_peered":"2024-09-19T09:21:01.294244+0000","last_clean":"2024-09-19T09:21:01.294244+0000","last_became_active":"2024-09-19T09:19:17.798617+0000","last_became_peered":"2024-09-19T09:19:17.798617+0000","last_unstale":"2024-09-19T09:21:01.294244+0000","last_undegraded":"2024-09-19T09:21:01.294244+0000","last_fullsized":"2024-09-19T09:21:01.294244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:33.476079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'11","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091442+0000","last_change":"2024-09-19T09:19:32.864777+0000","last_active":"2024-09-19T09:20:33.091442+0000","last_peered":"2024-09-19T09:20:33.091442+0000","last_clean":"2024-09-19T09:20:33.091442+0000","last_became_active":"2024-09-19T09:19:32.850076+0000","last_became_peered":"2024-09-19T09:19:32.850076+0000","last_unstale":"2024-09-19T09:20:33.091442+0000","last_undegraded":"2024-09-19T09:20:33.091442+0000","last_fullsized":"2024-09-19T09:20:33.091442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:31.413486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.300466+0000","last_change":"2024-09-19T09:19:17.798858+0000","last_active":"2024-09-19T09:21:01.300466+0000","last_peered":"2024-09-19T09:21:01.300466+0000","last_clean":"2024-09-19T09:21:01.300466+0000","last_became_active":"2024-09-19T09:19:17.798473+0000","last_became_peered":"2024-09-19T09:19:17.798473+0000","last_unstale":"2024-09-19T09:21:01.300466+0000","last_undegraded":"2024-09-19T09:21:01.300466+0000","last_fullsized":"2024-09-19T09:21:01.300466+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:07.410593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.095723+0000","last_change":"2024-09-19T09:19:15.716663+0000","last_active":"2024-09-19T09:20:33.095723+0000","last_peered":"2024-09-19T09:20:33.095723+0000","last_clean":"2024-09-19T09:20:33.095723+0000","last_became_active":"2024-09-19T09:19:15.716306+0000","last_became_peered":"2024-09-19T09:19:15.716306+0000","last_unstale":"2024-09-19T09:20:33.095723+0000","last_undegraded":"2024-09-19T09:20:33.095723+0000","last_fullsized":"2024-09-19T09:20:33.095723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:02.504447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.301294+0000","last_change":"2024-09-19T09:19:32.850919+0000","last_active":"2024-09-19T09:21:01.301294+0000","last_peered":"2024-09-19T09:21:01.301294+0000","last_clean":"2024-09-19T09:21:01.301294+0000","last_became_active":"2024-09-19T09:19:32.850511+0000","last_became_peered":"2024-09-19T09:19:32.850511+0000","last_unstale":"2024-09-19T09:21:01.301294+0000","last_undegraded":"2024-09-19T09:21:01.301294+0000","last_fullsized":"2024-09-19T09:21:01.301294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:37.435257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.287829+0000","last_change":"2024-09-19T09:19:15.724823+0000","last_active":"2024-09-19T09:20:33.287829+0000","last_peered":"2024-09-19T09:20:33.287829+0000","last_clean":"2024-09-19T09:20:33.287829+0000","last_became_active":"2024-09-19T09:19:15.724512+0000","last_became_peered":"2024-09-19T09:19:15.724512+0000","last_unstale":"2024-09-19T09:20:33.287829+0000","last_undegraded":"2024-09-19T09:20:33.287829+0000","last_fullsized":"2024-09-19T09:20:33.287829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:47.629952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.257752+0000","last_change":"2024-09-19T09:19:17.807031+0000","last_active":"2024-09-19T09:21:01.257752+0000","last_peered":"2024-09-19T09:21:01.257752+0000","last_clean":"2024-09-19T09:21:01.257752+0000","last_became_active":"2024-09-19T09:19:17.806689+0000","last_became_peered":"2024-09-19T09:19:17.806689+0000","last_unstale":"2024-09-19T09:21:01.257752+0000","last_undegraded":"2024-09-19T09:21:01.257752+0000","last_fullsized":"2024-09-19T09:21:01.257752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:25.435385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.089910+0000","last_change":"2024-09-19T09:19:15.714521+0000","last_active":"2024-09-19T09:20:33.089910+0000","last_peered":"2024-09-19T09:20:33.089910+0000","last_clean":"2024-09-19T09:20:33.089910+0000","last_became_active":"2024-09-19T09:19:15.714188+0000","last_became_peered":"2024-09-19T09:19:15.714188+0000","last_unstale":"2024-09-19T09:20:33.089910+0000","last_undegraded":"2024-09-19T09:20:33.089910+0000","last_fullsized":"2024-09-19T09:20:33.089910+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:07.003581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.302793+0000","last_change":"2024-09-19T09:19:17.799387+0000","last_active":"2024-09-19T09:21:01.302793+0000","last_peered":"2024-09-19T09:21:01.302793+0000","last_clean":"2024-09-19T09:21:01.302793+0000","last_became_active":"2024-09-19T09:19:17.799046+0000","last_became_peered":"2024-09-19T09:19:17.799046+0000","last_unstale":"2024-09-19T09:21:01.302793+0000","last_undegraded":"2024-09-19T09:21:01.302793+0000","last_fullsized":"2024-09-19T09:21:01.302793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:40.544141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090531+0000","last_change":"2024-09-19T09:19:15.728107+0000","last_active":"2024-09-19T09:20:33.090531+0000","last_peered":"2024-09-19T09:20:33.090531+0000","last_clean":"2024-09-19T09:20:33.090531+0000","last_became_active":"2024-09-19T09:19:15.727767+0000","last_became_peered":"2024-09-19T09:19:15.727767+0000","last_unstale":"2024-09-19T09:20:33.090531+0000","last_undegraded":"2024-09-19T09:20:33.090531+0000","last_fullsized":"2024-09-19T09:20:33.090531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:10.086995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.291573+0000","last_change":"2024-09-19T09:19:17.803901+0000","last_active":"2024-09-19T09:21:01.291573+0000","last_peered":"2024-09-19T09:21:01.291573+0000","last_clean":"2024-09-19T09:21:01.291573+0000","last_became_active":"2024-09-19T09:19:17.803545+0000","last_became_peered":"2024-09-19T09:19:17.803545+0000","last_unstale":"2024-09-19T09:21:01.291573+0000","last_undegraded":"2024-09-19T09:21:01.291573+0000","last_fullsized":"2024-09-19T09:21:01.291573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:34.864921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338763+0000","last_change":"2024-09-19T09:19:15.726086+0000","last_active":"2024-09-19T09:20:33.338763+0000","last_peered":"2024-09-19T09:20:33.338763+0000","last_clean":"2024-09-19T09:20:33.338763+0000","last_became_active":"2024-09-19T09:19:15.725772+0000","last_became_peered":"2024-09-19T09:19:15.725772+0000","last_unstale":"2024-09-19T09:20:33.338763+0000","last_undegraded":"2024-09-19T09:20:33.338763+0000","last_fullsized":"2024-09-19T09:20:33.338763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:30.958172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.304998+0000","last_change":"2024-09-19T09:19:17.801093+0000","last_active":"2024-09-19T09:21:01.304998+0000","last_peered":"2024-09-19T09:21:01.304998+0000","last_clean":"2024-09-19T09:21:01.304998+0000","last_became_active":"2024-09-19T09:19:17.800755+0000","last_became_peered":"2024-09-19T09:19:17.800755+0000","last_unstale":"2024-09-19T09:21:01.304998+0000","last_undegraded":"2024-09-19T09:21:01.304998+0000","last_fullsized":"2024-09-19T09:21:01.304998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:46.746467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.289848+0000","last_change":"2024-09-19T09:20:33.096811+0000","last_active":"2024-09-19T09:21:01.289848+0000","last_peered":"2024-09-19T09:21:01.289848+0000","last_clean":"2024-09-19T09:21:01.289848+0000","last_became_active":"2024-09-19T09:20:33.096491+0000","last_became_peered":"2024-09-19T09:20:33.096491+0000","last_unstale":"2024-09-19T09:21:01.289848+0000","last_undegraded":"2024-09-19T09:21:01.289848+0000","last_fullsized":"2024-09-19T09:21:01.289848+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:43.541732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338999+0000","last_change":"2024-09-19T09:19:15.726809+0000","last_active":"2024-09-19T09:20:33.338999+0000","last_peered":"2024-09-19T09:20:33.338999+0000","last_clean":"2024-09-19T09:20:33.338999+0000","last_became_active":"2024-09-19T09:19:15.726437+0000","last_became_peered":"2024-09-19T09:19:15.726437+0000","last_unstale":"2024-09-19T09:20:33.338999+0000","last_undegraded":"2024-09-19T09:20:33.338999+0000","last_fullsized":"2024-09-19T09:20:33.338999+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:10.173757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303870+0000","last_change":"2024-09-19T09:19:17.808342+0000","last_active":"2024-09-19T09:21:01.303870+0000","last_peered":"2024-09-19T09:21:01.303870+0000","last_clean":"2024-09-19T09:21:01.303870+0000","last_became_active":"2024-09-19T09:19:17.807729+0000","last_became_peered":"2024-09-19T09:19:17.807729+0000","last_unstale":"2024-09-19T09:21:01.303870+0000","last_undegraded":"2024-09-19T09:21:01.303870+0000","last_fullsized":"2024-09-19T09:21:01.303870+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:38.921736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.338941+0000","last_change":"2024-09-19T09:19:32.889702+0000","last_active":"2024-09-19T09:20:33.338941+0000","last_peered":"2024-09-19T09:20:33.338941+0000","last_clean":"2024-09-19T09:20:33.338941+0000","last_became_active":"2024-09-19T09:19:32.885657+0000","last_became_peered":"2024-09-19T09:19:32.885657+0000","last_unstale":"2024-09-19T09:20:33.338941+0000","last_undegraded":"2024-09-19T09:20:33.338941+0000","last_fullsized":"2024-09-19T09:20:33.338941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:38.596031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.303694+0000","last_change":"2024-09-19T09:19:17.797302+0000","last_active":"2024-09-19T09:21:01.303694+0000","last_peered":"2024-09-19T09:21:01.303694+0000","last_clean":"2024-09-19T09:21:01.303694+0000","last_became_active":"2024-09-19T09:19:17.794878+0000","last_became_peered":"2024-09-19T09:19:17.794878+0000","last_unstale":"2024-09-19T09:21:01.303694+0000","last_undegraded":"2024-09-19T09:21:01.303694+0000","last_fullsized":"2024-09-19T09:21:01.303694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:11.317652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.090184+0000","last_change":"2024-09-19T09:19:15.724092+0000","last_active":"2024-09-19T09:20:33.090184+0000","last_peered":"2024-09-19T09:20:33.090184+0000","last_clean":"2024-09-19T09:20:33.090184+0000","last_became_active":"2024-09-19T09:19:15.723453+0000","last_became_peered":"2024-09-19T09:19:15.723453+0000","last_unstale":"2024-09-19T09:20:33.090184+0000","last_undegraded":"2024-09-19T09:20:33.090184+0000","last_fullsized":"2024-09-19T09:20:33.090184+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:15.206202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:21:01.295261+0000","last_change":"2024-09-19T09:19:17.793525+0000","last_active":"2024-09-19T09:21:01.295261+0000","last_peered":"2024-09-19T09:21:01.295261+0000","last_clean":"2024-09-19T09:21:01.295261+0000","last_became_active":"2024-09-19T09:19:17.792884+0000","last_became_peered":"2024-09-19T09:19:17.792884+0000","last_unstale":"2024-09-19T09:21:01.295261+0000","last_undegraded":"2024-09-19T09:21:01.295261+0000","last_fullsized":"2024-09-19T09:21:01.295261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:16.771484+0000","last_clean_scrub_stamp":"2024-09-19T09:19:16.771484+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:05.918793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:20:33.091596+0000","last_change":"2024-09-19T09:19:15.719941+0000","last_active":"2024-09-19T09:20:33.091596+0000","last_peered":"2024-09-19T09:20:33.091596+0000","last_clean":"2024-09-19T09:20:33.091596+0000","last_became_active":"2024-09-19T09:19:15.719661+0000","last_became_peered":"2024-09-19T09:19:15.719661+0000","last_unstale":"2024-09-19T09:20:33.091596+0000","last_undegraded":"2024-09-19T09:20:33.091596+0000","last_fullsized":"2024-09-19T09:20:33.091596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:14.701210+0000","last_clean_scrub_stamp":"2024-09-19T09:19:14.701210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:22.467288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":662,"num_read_kb":408,"num_write":174,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":34,"num_keys_recovered":23,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678052,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":444463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32756,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712396,"statfs":{"total":95995035648,"available":95961493504,"internally_reserved":0,"allocated":1609728,"data_stored":1103375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":444665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299443,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":444585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":44,"seq":188978561080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1036966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":444054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":33,"seq":141733920834,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1527808,"data_stored":1035808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051655,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":445333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280586,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":444365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476817,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":511786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607638,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":510470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":445325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:21:14.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:14.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:14 smithi169 ceph-mon[35454]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:14.855 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:15.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 -- 172.21.15.52:0/3549908592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 msgr2=0x7f8b2c06df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 --2- 172.21.15.52:0/3549908592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c06df80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009900 tx=0x7f8b1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 -- 172.21.15.52:0/3549908592 shutdown_connections 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 --2- 172.21.15.52:0/3549908592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c11b210 0x7f8b2c11d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 --2- 172.21.15.52:0/3549908592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c06e4c0 0x7f8b2c11acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 --2- 172.21.15.52:0/3549908592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c06df80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 -- 172.21.15.52:0/3549908592 >> 172.21.15.52:0/3549908592 conn(0x7f8b2c06cdc0 msgr2=0x7f8b2c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 -- 172.21.15.52:0/3549908592 shutdown_connections 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.314+0000 7f8b32462640 1 -- 172.21.15.52:0/3549908592 wait complete. 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 Processor -- start 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 -- start start 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c06e4c0 0x7f8b2c1a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c11b210 0x7f8b2c1abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c120d90 con 0x7f8b2c06dba0 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c120c10 con 0x7f8b2c06e4c0 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b32462640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c120f10 con 0x7f8b2c11b210 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54342/0 (socket says 172.21.15.52:54342) 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 -- 172.21.15.52:0/283123171 learned_addr learned my addr 172.21.15.52:0/283123171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b23fff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c06e4c0 0x7f8b2c1a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b309ff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c11b210 0x7f8b2c1abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 -- 172.21.15.52:0/283123171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c11b210 msgr2=0x7f8b2c1abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c11b210 0x7f8b2c1abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 -- 172.21.15.52:0/283123171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c06e4c0 msgr2=0x7f8b2c1a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c06e4c0 0x7f8b2c1a77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.315+0000 7f8b2bfff640 1 -- 172.21.15.52:0/283123171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c1ac220 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b2bfff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c03f030 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b1c003ce0 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c035070 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c1ac4b0 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.316+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1ac940 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.317+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c06f2e0 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.318+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8b1c042030 con 0x7f8b2c06dba0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.319+0000 7f8b29ffb640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 0x7f8b180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.319+0000 7f8b23fff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 0x7f8b180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.319+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8b1c0eff50 con 0x7f8b2c06dba0 2024-09-19T09:21:15.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.319+0000 7f8b23fff640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 0x7f8b180a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c11d590 tx=0x7f8b14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.323+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b1c0bcc50 con 0x7f8b2c06dba0 2024-09-19T09:21:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:15 smithi086 ceph-mon[34813]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:15 smithi086 ceph-mon[34813]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:15.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.536+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b2c06df80 con 0x7f8b2c06dba0 2024-09-19T09:21:15.538 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:15 smithi052 ceph-mon[30947]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:15.538 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:15 smithi052 ceph-mon[30947]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:15.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.536+0000 7f8b29ffb640 1 -- 172.21.15.52:0/283123171 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f8b1c0bc550 con 0x7f8b2c06dba0 2024-09-19T09:21:15.538 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:15.539 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:15.539 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:15.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.538+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 msgr2=0x7f8b180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.538+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 0x7f8b180a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c11d590 tx=0x7f8b14005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:15.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.538+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 msgr2=0x7f8b2c1a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.538+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c006010 tx=0x7f8b1c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 shutdown_connections 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8b180a3240 0x7f8b180a5700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8b2c11b210 0x7f8b2c1abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b2c06e4c0 0x7f8b2c1a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 --2- 172.21.15.52:0/283123171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8b2c06dba0 0x7f8b2c1a7270 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 >> 172.21.15.52:0/283123171 conn(0x7f8b2c06cdc0 msgr2=0x7f8b2c11b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 shutdown_connections 2024-09-19T09:21:15.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:15.539+0000 7f8b32462640 1 -- 172.21.15.52:0/283123171 wait complete. 2024-09-19T09:21:15.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:15 smithi169 ceph-mon[35454]: pgmap v332: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:15.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:15 smithi169 ceph-mon[35454]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:21:16.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:16.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:16 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/283123171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:16.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:16 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/283123171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:16.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:16 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/283123171' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:16.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.918+0000 7f6105329640 1 -- 172.21.15.52:0/2964198276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100106b80 msgr2=0x7f6100106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.918+0000 7f6105329640 1 --2- 172.21.15.52:0/2964198276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100106b80 0x7f6100106f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009900 tx=0x7f60f802a410 comp rx=0 tx=0).stop 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 -- 172.21.15.52:0/2964198276 shutdown_connections 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 --2- 172.21.15.52:0/2964198276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100100aa0 0x7f610010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 --2- 172.21.15.52:0/2964198276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 0x7f6100100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 --2- 172.21.15.52:0/2964198276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100106b80 0x7f6100106f60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 -- 172.21.15.52:0/2964198276 >> 172.21.15.52:0/2964198276 conn(0x7f6100077230 msgr2=0x7f61000fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 -- 172.21.15.52:0/2964198276 shutdown_connections 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 -- 172.21.15.52:0/2964198276 wait complete. 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 Processor -- start 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.919+0000 7f6105329640 1 -- start start 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 0x7f6100198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:16.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 0x7f610019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6100112070 con 0x7f6100100aa0 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6100111ef0 con 0x7f6100106b80 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f6105329640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61001121f0 con 0x7f6100100100 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54366/0 (socket says 172.21.15.52:54366) 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 -- 172.21.15.52:0/113520712 learned_addr learned my addr 172.21.15.52:0/113520712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60feffd640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 0x7f6100198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60ff7fe640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 0x7f610019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 -- 172.21.15.52:0/113520712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 msgr2=0x7f6100198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 0x7f6100198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 -- 172.21.15.52:0/113520712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 msgr2=0x7f610019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:16.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 0x7f610019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 -- 172.21.15.52:0/113520712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610019d500 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60ff7fe640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 0x7f610019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60fe7fc640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f60e800b4a0 tx=0x7f60e800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.920+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8014070 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.921+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60e8010af0 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.921+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610019d7f0 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.921+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8017d10 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.921+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61001a50d0 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.922+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6100100560 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.923+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f60e8017070 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.924+0000 7f60f7fff640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 0x7f60ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.924+0000 7f60feffd640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 0x7f60ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.924+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f60e80cf200 con 0x7f6100100aa0 2024-09-19T09:21:16.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.924+0000 7f60feffd640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 0x7f60ec0a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f8005ab0 tx=0x7f60f8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:16.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:16.927+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60e809be40 con 0x7f6100100aa0 2024-09-19T09:21:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.140+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61001998b0 con 0x7f6100100aa0 2024-09-19T09:21:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.141+0000 7f60f7fff640 1 -- 172.21.15.52:0/113520712 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f60e809b740 con 0x7f6100100aa0 2024-09-19T09:21:17.143 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:17.143 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.143+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 msgr2=0x7f60ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.143+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 0x7f60ec0a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60f8005ab0 tx=0x7f60f8005a20 comp rx=0 tx=0).stop 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.143+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 msgr2=0x7f6100198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.143+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f60e800b4a0 tx=0x7f60e800b960 comp rx=0 tx=0).stop 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 shutdown_connections 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6100106b80 0x7f610019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6100100aa0 0x7f6100198a90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f60ec0a3240 0x7f60ec0a5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 --2- 172.21.15.52:0/113520712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6100100100 0x7f6100198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 >> 172.21.15.52:0/113520712 conn(0x7f6100077230 msgr2=0x7f6100104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 shutdown_connections 2024-09-19T09:21:17.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:17.144+0000 7f6105329640 1 -- 172.21.15.52:0/113520712 wait complete. 2024-09-19T09:21:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:17 smithi052 ceph-mon[30947]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:21:17.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/113520712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:17 smithi086 ceph-mon[34813]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:21:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/113520712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:17 smithi169 ceph-mon[35454]: pgmap v333: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:21:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/113520712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:17.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:21:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 -- 172.21.15.52:0/2188011427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064102d40 msgr2=0x7f0064103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 --2- 172.21.15.52:0/2188011427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064102d40 0x7f0064103120 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0054009900 tx=0x7f005402a480 comp rx=0 tx=0).stop 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 -- 172.21.15.52:0/2188011427 shutdown_connections 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 --2- 172.21.15.52:0/2188011427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f006410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 --2- 172.21.15.52:0/2188011427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064103660 0x7f006410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 --2- 172.21.15.52:0/2188011427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064102d40 0x7f0064103120 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 -- 172.21.15.52:0/2188011427 >> 172.21.15.52:0/2188011427 conn(0x7f00640fc7a0 msgr2=0x7f00640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 -- 172.21.15.52:0/2188011427 shutdown_connections 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.601+0000 7f006946f640 1 -- 172.21.15.52:0/2188011427 wait complete. 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 Processor -- start 2024-09-19T09:21:18.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 -- start start 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064102d40 0x7f00641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f0064101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0064111f70 con 0x7f0064103660 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0064111df0 con 0x7f006410c170 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.602+0000 7f006946f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00641120f0 con 0x7f0064102d40 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48676/0 (socket says 172.21.15.52:48676) 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 -- 172.21.15.52:0/413271944 learned_addr learned my addr 172.21.15.52:0/413271944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f0062ffd640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064102d40 0x7f00641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f00637fe640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f0064101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 -- 172.21.15.52:0/413271944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064102d40 msgr2=0x7f00641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:18.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064102d40 0x7f00641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 -- 172.21.15.52:0/413271944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 msgr2=0x7f0064101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f0064101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 -- 172.21.15.52:0/413271944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00641a6930 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f00637fe640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f0064101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f005a7fc640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d750 tx=0x7f004c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c017070 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004c005020 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00641a6c20 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004d00 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.603+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00641a7160 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.604+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064103120 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.605+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f004c009a30 con 0x7f0064103660 2024-09-19T09:21:18.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.606+0000 7f0060ff9640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 0x7f00500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:18.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.606+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f004c0cf3f0 con 0x7f0064103660 2024-09-19T09:21:18.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.606+0000 7f0062ffd640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 0x7f00500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:18.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.607+0000 7f0062ffd640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 0x7f00500a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0054005ab0 tx=0x7f0054005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:18.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.611+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f004c09c090 con 0x7f0064103660 2024-09-19T09:21:18.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.788+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00641071e0 con 0x7f0064103660 2024-09-19T09:21:18.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.791+0000 7f0060ff9640 1 -- 172.21.15.52:0/413271944 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7f004c09b990 con 0x7f0064103660 2024-09-19T09:21:18.793 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:18.793 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:21:18.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 msgr2=0x7f00500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 0x7f00500a5780 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0054005ab0 tx=0x7f0054005a20 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 msgr2=0x7f0064100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f004c00d750 tx=0x7f004c00dc10 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 shutdown_connections 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f006410c170 0x7f0064101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0064103660 0x7f0064100ee0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00500a32c0 0x7f00500a5780 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 --2- 172.21.15.52:0/413271944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0064102d40 0x7f00641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 >> 172.21.15.52:0/413271944 conn(0x7f00640fc7a0 msgr2=0x7f00640fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 shutdown_connections 2024-09-19T09:21:18.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:18.793+0000 7f006946f640 1 -- 172.21.15.52:0/413271944 wait complete. 2024-09-19T09:21:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:19 smithi052 ceph-mon[30947]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:21:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:19 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/413271944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:19 smithi086 ceph-mon[34813]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:21:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:19 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/413271944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:19.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:21:19.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:19 smithi169 ceph-mon[35454]: pgmap v334: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T09:21:19.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:19 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/413271944' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:21:19.775 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 -- 172.21.15.52:0/2190876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8103710 msgr2=0x7f39c8109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 --2- 172.21.15.52:0/2190876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8103710 0x7f39c8109fa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009ca0 tx=0x7f39c002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 -- 172.21.15.52:0/2190876812 shutdown_connections 2024-09-19T09:21:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 --2- 172.21.15.52:0/2190876812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8103710 0x7f39c8109fa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 --2- 172.21.15.52:0/2190876812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 --2- 172.21.15.52:0/2190876812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8101b60 0x7f39c8101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 -- 172.21.15.52:0/2190876812 >> 172.21.15.52:0/2190876812 conn(0x7f39c80fd2e0 msgr2=0x7f39c80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 -- 172.21.15.52:0/2190876812 shutdown_connections 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 -- 172.21.15.52:0/2190876812 wait complete. 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.762+0000 7f39cf453640 1 Processor -- start 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 -- start start 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 0x7f39c819f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810d7c0 con 0x7f39c8101b60 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810d640 con 0x7f39c8102d50 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cf453640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810d940 con 0x7f39c8103710 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48688/0 (socket says 172.21.15.52:48688) 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 -- 172.21.15.52:0/330865543 learned_addr learned my addr 172.21.15.52:0/330865543 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 0x7f39c819f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 -- 172.21.15.52:0/330865543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 msgr2=0x7f39c819f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 0x7f39c819f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 -- 172.21.15.52:0/330865543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 msgr2=0x7f39c81981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 -- 172.21.15.52:0/330865543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c819f890 con 0x7f39c8101b60 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 0x7f39c819f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.763+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c970 tx=0x7f39c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.764+0000 7f39be7fc640 1 -- 172.21.15.52:0/330865543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4007c10 con 0x7f39c8101b60 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.764+0000 7f39be7fc640 1 -- 172.21.15.52:0/330865543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c4007db0 con 0x7f39c8101b60 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.764+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c819fb80 con 0x7f39c8101b60 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.764+0000 7f39be7fc640 1 -- 172.21.15.52:0/330865543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c400f940 con 0x7f39c8101b60 2024-09-19T09:21:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.764+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c81a00d0 con 0x7f39c8101b60 2024-09-19T09:21:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39be7fc640 1 -- 172.21.15.52:0/330865543 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f39c400fae0 con 0x7f39c8101b60 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 Processor -- start 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 -- start start 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b2dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b33370 0x555ac3b35830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ac3a912f0 con 0x555ac3b2e2e0 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.766+0000 7f39d21ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ac3a39270 con 0x555ac3b33370 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39d21ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ac3a8d2b0 con 0x555ac3b2d9a0 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48694/0 (socket says 172.21.15.52:48694) 2024-09-19T09:21:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 -- 172.21.15.52:0/2807378457 learned_addr learned my addr 172.21.15.52:0/2807378457 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b2dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b33370 0x555ac3b35830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 -- 172.21.15.52:0/2807378457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 msgr2=0x555ac3b2dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b2dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 -- 172.21.15.52:0/2807378457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b33370 msgr2=0x555ac3b35830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b33370 0x555ac3b35830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 -- 172.21.15.52:0/2807378457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac3a38340 con 0x555ac3b2e2e0 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39be7fc640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 0x7f39b40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f39c40d81b0 tx=0x7f39c40d81e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7ed9abb011c5e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 0x7f39b40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39be7fc640 1 -- 172.21.15.52:0/330865543 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f39c40cfed0 con 0x7f39c8101b60 2024-09-19T09:21:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.767+0000 7f39b37fe640 1 -- 172.21.15.52:0/2807378457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4098710 con 0x555ac3b2e2e0 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39b37fe640 1 -- 172.21.15.52:0/2807378457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c409cb70 con 0x555ac3b2e2e0 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39b37fe640 1 -- 172.21.15.52:0/2807378457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c409bdd0 con 0x555ac3b2e2e0 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 -- 172.21.15.52:0/2807378457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 msgr2=0x555ac3b32da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 0x7f39b40a57b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009430 tx=0x7f39c0005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f39c40d81b0 tx=0x7f39c40d81e0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 -- 172.21.15.52:0/2807378457 shutdown_connections 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b33370 0x555ac3b35830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b32da0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2807378457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b2dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 -- 172.21.15.52:0/2807378457 >> 172.21.15.52:0/2807378457 conn(0x555ac3b29010 msgr2=0x555ac3b29410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 -- 172.21.15.52:0/2807378457 shutdown_connections 2024-09-19T09:21:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.768+0000 7f39d21ec740 1 -- 172.21.15.52:0/2807378457 wait complete. 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 -- start start 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 Processor -- start 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2d9a0 0x555ac3b37bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ac3b36340 con 0x555ac3b2e2e0 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ac3a1a290 con 0x555ac3b2d9a0 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ac3b364c0 con 0x555ac3b33370 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39cc9ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39d21ec740 10 client.0 _ll_register_callbacks cb 0x555ac3a4b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39cc9ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48704/0 (socket says 172.21.15.52:48704) 2024-09-19T09:21:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39cc9ee640 1 -- 172.21.15.52:0/2653523093 learned_addr learned my addr 172.21.15.52:0/2653523093 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2d9a0 0x555ac3b37bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.769+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 -- 172.21.15.52:0/2653523093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 msgr2=0x555ac3b3f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 -- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2d9a0 msgr2=0x555ac3b37bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2d9a0 0x555ac3b37bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 -- 172.21.15.52:0/2653523093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ac37a4210 con 0x555ac3b2e2e0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39b800f790 tx=0x7f39b800fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39816166d43e9b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b800fea0 con 0x555ac3b2e2e0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f39b800dd30 con 0x555ac3b2e2e0 2024-09-19T09:21:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c409cb70 con 0x555ac3b2e2e0 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f39b8020020 con 0x555ac3b2e2e0 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39d21ec740 10 client.15291 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ac3870620 con 0x555ac3b2e2e0 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c409cb70 con 0x555ac3b2e2e0 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.770+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f39b8025700 con 0x555ac3b2e2e0 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 10 client.15291 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 10 client.15291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 20 client.15291 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3b43840 0x555ac3b45cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 4 client.15291 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ac3a9ea20 con 0x555ac3b43840 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3b43840 0x555ac3b45cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3b43840 0x555ac3b45cb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c258c8539c2fb8e server_cookie=ef912c5889abe2f4 in_seq=0 out_seq=0 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.771+0000 7f39b0ff9640 10 client.15291 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39b0ff9640 1 -- 172.21.15.52:0/2653523093 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ac3a9ea20 con 0x555ac3b43840 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39b0ff9640 10 client.15291 handle_command_reply: tid=0 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 client.15291 shutdown 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 msgr2=0x555ac3b38100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39b800f790 tx=0x7f39b800fc50 comp rx=0 tx=0).stop 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 shutdown_connections 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3b43840 0x555ac3b45cb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39b0ff9640 0 client.15291 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2e2e0 0x555ac3b38100 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2653523093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2d9a0 0x555ac3b37bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 >> 172.21.15.52:0/2653523093 conn(0x555ac3b29010 msgr2=0x555ac3b2a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 shutdown_connections 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 1 -- 172.21.15.52:0/2653523093 wait complete. 2024-09-19T09:21:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.772+0000 7f39d21ec740 20 client.15291 trim_cache size 0 max 16384 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 Processor -- start 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 -- start start 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b29e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81ab960 con 0x555ac3b33370 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81a9230 con 0x555ac3b2e2e0 2024-09-19T09:21:20.793 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39d21ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81a7080 con 0x555ac3b2d9a0 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48710/0 (socket says 172.21.15.52:48710) 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 -- 172.21.15.52:0/2420247303 learned_addr learned my addr 172.21.15.52:0/2420247303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b29e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 -- 172.21.15.52:0/2420247303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 msgr2=0x555ac3b29e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b29e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 -- 172.21.15.52:0/2420247303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 msgr2=0x555ac3b3f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 -- 172.21.15.52:0/2420247303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ac3b29ca0 con 0x555ac3b33370 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.787+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009ca0 tx=0x7f39c0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4cc54b81287318 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39b2ffd640 1 -- 172.21.15.52:0/2420247303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0031770 con 0x555ac3b33370 2024-09-19T09:21:20.794 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39b2ffd640 1 -- 172.21.15.52:0/2420247303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c0036050 con 0x555ac3b33370 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39b2ffd640 1 -- 172.21.15.52:0/2420247303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c002fbd0 con 0x555ac3b33370 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 -- 172.21.15.52:0/2420247303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 msgr2=0x555ac3b2a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009ca0 tx=0x7f39c0040000 comp rx=0 tx=0).stop 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 -- 172.21.15.52:0/2420247303 shutdown_connections 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b33370 0x555ac3b2a3d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 --2- 172.21.15.52:0/2420247303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b2d9a0 0x555ac3b29e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 -- 172.21.15.52:0/2420247303 >> 172.21.15.52:0/2420247303 conn(0x555ac3b29010 msgr2=0x555ac3b2f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 -- 172.21.15.52:0/2420247303 shutdown_connections 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.788+0000 7f39d21ec740 1 -- 172.21.15.52:0/2420247303 wait complete. 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 -- start start 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 Processor -- start 2024-09-19T09:21:20.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81a76f0 con 0x555ac3b2d9a0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81a8b60 con 0x555ac3b2e2e0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81a7dc0 con 0x555ac3b33370 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39d21ec740 10 client.0 _ll_register_callbacks cb 0x7f39b80093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48722/0 (socket says 172.21.15.52:48722) 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 -- 172.21.15.52:0/4097740771 learned_addr learned my addr 172.21.15.52:0/4097740771 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd9f0640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 -- 172.21.15.52:0/4097740771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 msgr2=0x555ac3b3df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 -- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 msgr2=0x555ac3b3cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.789+0000 7f39cd1ef640 1 -- 172.21.15.52:0/4097740771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ac3b3e520 con 0x555ac3b2d9a0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39cd1ef640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39c4098e40 tx=0x7f39c40980d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec95489ec777c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40b4070 con 0x555ac3b2d9a0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f39c409a770 con 0x555ac3b2d9a0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c0036050 con 0x555ac3b2d9a0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f39c409bfb0 con 0x555ac3b2d9a0 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 10 client.15297 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:20.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ac3bae790 con 0x555ac3b2d9a0 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c0036050 con 0x555ac3b2d9a0 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f39c4098ae0 con 0x555ac3b2d9a0 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 10 client.15297 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 10 client.15297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 20 client.15297 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3baec40 0x555ac3bb1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 4 client.15297 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.790+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ac3a98d70 con 0x555ac3baec40 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.791+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3baec40 0x555ac3bb1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.791+0000 7f39cc9ee640 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3baec40 0x555ac3bb1030 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8e8fecf2dc1a7f0 server_cookie=8146a044826fb18 in_seq=0 out_seq=0 2024-09-19T09:21:20.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.791+0000 7f39b0ff9640 10 client.15297 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39b0ff9640 1 -- 172.21.15.52:0/4097740771 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ac3a98d70 con 0x555ac3baec40 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39b0ff9640 10 client.15297 handle_command_reply: tid=0 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 client.15297 shutdown 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 msgr2=0x555ac3b3c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39c4098e40 tx=0x7f39c40980d0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 shutdown_connections 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555ac3baec40 0x555ac3bb1030 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ac3b33370 0x555ac3b3df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ac3b2e2e0 0x555ac3b3cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39b0ff9640 0 client.15297 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 --2- 172.21.15.52:0/4097740771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ac3b2d9a0 0x555ac3b3c9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 >> 172.21.15.52:0/4097740771 conn(0x555ac3b29010 msgr2=0x555ac3b279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 shutdown_connections 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 1 -- 172.21.15.52:0/4097740771 wait complete. 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.802+0000 7f39d21ec740 20 client.15297 trim_cache size 0 max 16384 2024-09-19T09:21:20.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:21:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:21:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:21:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:21:20.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 msgr2=0x7f39b40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 0x7f39b40a57b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009430 tx=0x7f39c0005c50 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 msgr2=0x7f39c8197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c970 tx=0x7f39c400ce30 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 shutdown_connections 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39b40a32f0 0x7f39b40a57b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f39c8103710 0x7f39c819f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39c8102d50 0x7f39c81981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 --2- 172.21.15.52:0/330865543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39c8101b60 0x7f39c8197c80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 >> 172.21.15.52:0/330865543 conn(0x7f39c80fd2e0 msgr2=0x7f39c8105f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 shutdown_connections 2024-09-19T09:21:20.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:20.803+0000 7f39cf453640 1 -- 172.21.15.52:0/330865543 wait complete. 2024-09-19T09:21:20.928 INFO:teuthology.orchestra.run.smithi052.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:21:20.928 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:21:20.928 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:21:20.929 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:21:20.929 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:21:20.943 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:21:20.943 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:21:20.944 INFO:tasks.workunit:timeout=3h 2024-09-19T09:21:20.944 INFO:tasks.workunit:cleanup=True 2024-09-19T09:21:20.944 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:21:20.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:21:20.961 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:21:20.961 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T09:21:20.961 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:21:20.962 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:21:20.962 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-19 09:19:36.296650407 +0000 2024-09-19T09:21:20.962 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-19 09:19:36.296650407 +0000 2024-09-19T09:21:20.962 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-19 09:20:58.791119134 +0000 2024-09-19T09:21:20.962 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-19 09:19:36.296650407 +0000 2024-09-19T09:21:20.962 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:21:20.962 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:21:21.042 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:21:21.103 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:21:21.205 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:21 smithi086 ceph-mon[34813]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-19T09:21:21.508 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:21 smithi052 ceph-mon[30947]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-19T09:21:21.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:21 smithi169 ceph-mon[35454]: pgmap v335: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-19T09:21:21.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 -- 172.21.15.52:0/1002673254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f822410e4d0 msgr2=0x7f82241108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 --2- 172.21.15.52:0/1002673254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f822410e4d0 0x7f82241108e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f821c009ca0 tx=0x7f821c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 -- 172.21.15.52:0/1002673254 shutdown_connections 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 --2- 172.21.15.52:0/1002673254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f822410e4d0 0x7f82241108e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 --2- 172.21.15.52:0/1002673254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8224101360 0x7f822410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 --2- 172.21.15.52:0/1002673254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f8224100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 -- 172.21.15.52:0/1002673254 >> 172.21.15.52:0/1002673254 conn(0x7f82240fc7d0 msgr2=0x7f82240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 -- 172.21.15.52:0/1002673254 shutdown_connections 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.674+0000 7f822bb7d640 1 -- 172.21.15.52:0/1002673254 wait complete. 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 Processor -- start 2024-09-19T09:21:21.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 -- start start 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 0x7f822419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8224114250 con 0x7f8224101360 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82241140d0 con 0x7f822410e4d0 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.675+0000 7f822bb7d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f82241143d0 con 0x7f82241009b0 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229118640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f822a11a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 0x7f822419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:21.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f822a11a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 0x7f822419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:45438/0 (socket says 172.21.15.52:45438) 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229118640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48740/0 (socket says 172.21.15.52:48740) 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f822a11a640 1 -- 172.21.15.52:0/3937097415 learned_addr learned my addr 172.21.15.52:0/3937097415 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:53434/0 (socket says 172.21.15.52:53434) 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 -- 172.21.15.52:0/3937097415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 msgr2=0x7f822419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 0x7f822419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 -- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 msgr2=0x7f822419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 -- 172.21.15.52:0/3937097415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822419f6e0 con 0x7f82241009b0 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229118640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f8229919640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f822000d6d0 tx=0x7f822000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:21.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220017070 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822419f9d0 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8220009820 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.676+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220004cd0 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.677+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a72b0 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.677+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8224100d90 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.679+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f82200099d0 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.679+0000 7f821affd640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 0x7f82100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.680+0000 7f8229118640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 0x7f82100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.680+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f82200cf590 con 0x7f82241009b0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.680+0000 7f8229118640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 0x7f82100a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f822410ed60 tx=0x7f8214005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:21.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.683+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f822009bb80 con 0x7f82241009b0 2024-09-19T09:21:21.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.907+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8224109660 con 0x7f82241009b0 2024-09-19T09:21:21.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.908+0000 7f821affd640 1 -- 172.21.15.52:0/3937097415 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f822009fe80 con 0x7f82241009b0 2024-09-19T09:21:21.910 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:21.910 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:21.910 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:21.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 msgr2=0x7f82100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:21.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 0x7f82100a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f822410ed60 tx=0x7f8214005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 msgr2=0x7f822419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f822000d6d0 tx=0x7f822000db90 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 shutdown_connections 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f822410e4d0 0x7f822419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8224101360 0x7f822419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f82100a3240 0x7f82100a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 --2- 172.21.15.52:0/3937097415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82241009b0 0x7f822419a730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 >> 172.21.15.52:0/3937097415 conn(0x7f82240fc7d0 msgr2=0x7f82240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 shutdown_connections 2024-09-19T09:21:21.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:21.911+0000 7f822bb7d640 1 -- 172.21.15.52:0/3937097415 wait complete. 2024-09-19T09:21:22.265 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:22 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.265 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3937097415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:22 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3937097415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.636 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:22 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.636 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3937097415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:22.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:19:18.374880+0000', 'modified': '2024-09-19T09:20:59.524065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24482, 'mds_2': 24466}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6835/144132383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6834', 'nonce': 144132383}, {'type': 'v1', 'addr': '172.21.15.169:6835', 'nonce': 144132383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.169:6837/1790018144', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6836', 'nonce': 1790018144}, {'type': 'v1', 'addr': '172.21.15.169:6837', 'nonce': 1790018144}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.86:6835/4246812720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6834', 'nonce': 4246812720}, {'type': 'v1', 'addr': '172.21.15.86:6835', 'nonce': 4246812720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.169:6839/3841296575', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6838', 'nonce': 3841296575}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 3841296575}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.86:6837/546883569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6836', 'nonce': 546883569}, {'type': 'v1', 'addr': '172.21.15.86:6837', 'nonce': 546883569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.86:6839/1882596213', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.86:6838', 'nonce': 1882596213}, {'type': 'v1', 'addr': '172.21.15.86:6839', 'nonce': 1882596213}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24466, 24482, 24509]} 2024-09-19T09:21:22.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T09:21:22.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:21:23.378 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:23 smithi086 ceph-mon[34813]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:21:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:23 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.599 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:23 smithi052 ceph-mon[30947]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:21:23.599 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.599 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.599 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.599 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:23 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:23 smithi169 ceph-mon[35454]: pgmap v336: 97 pgs: 97 active+clean; 646 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:21:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:23 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:23.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 -- 172.21.15.52:0/461584449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 msgr2=0x7fd14c110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 --2- 172.21.15.52:0/461584449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c110810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd144009900 tx=0x7fd14402a480 comp rx=0 tx=0).stop 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 -- 172.21.15.52:0/461584449 shutdown_connections 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 --2- 172.21.15.52:0/461584449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c110810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 --2- 172.21.15.52:0/461584449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074f40 0x7fd14c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 --2- 172.21.15.52:0/461584449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074620 0x7fd14c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 -- 172.21.15.52:0/461584449 >> 172.21.15.52:0/461584449 conn(0x7fd14c0fd8c0 msgr2=0x7fd14c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 -- 172.21.15.52:0/461584449 shutdown_connections 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 -- 172.21.15.52:0/461584449 wait complete. 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.824+0000 7fd151bd9640 1 Processor -- start 2024-09-19T09:21:23.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 -- start start 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074620 0x7fd14c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c114170 con 0x7fd14c10e3c0 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c113ff0 con 0x7fd14c074f40 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd151bd9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd14c1142f0 con 0x7fd14c074620 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:45468/0 (socket says 172.21.15.52:45468) 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 -- 172.21.15.52:0/1612349335 learned_addr learned my addr 172.21.15.52:0/1612349335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074620 0x7fd14c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 -- 172.21.15.52:0/1612349335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074620 msgr2=0x7fd14c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074620 0x7fd14c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 -- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 msgr2=0x7fd14c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.825+0000 7fd14affd640 1 -- 172.21.15.52:0/1612349335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14c19f5f0 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd14affd640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d770 tx=0x7fd14000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd148ff9640 1 -- 172.21.15.52:0/1612349335 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140017070 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14c19f8e0 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd148ff9640 1 -- 172.21.15.52:0/1612349335 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd140005500 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd148ff9640 1 -- 172.21.15.52:0/1612349335 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140004e00 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.826+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14c1a71c0 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.828+0000 7fd148ff9640 1 -- 172.21.15.52:0/1612349335 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd140004fa0 con 0x7fd14c074f40 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 Processor -- start 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd148ff9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 -- start start 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd148ff9640 1 -- 172.21.15.52:0/1612349335 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd1400cf2a0 con 0x7fd14c074f40 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f53fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f54cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c84f4a6090 con 0x55c84f54abb0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c84f44da70 con 0x55c84f5402f0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd153fb2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c84f4a2050 con 0x55c84f53f9d0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f53fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:45484/0 (socket says 172.21.15.52:45484) 2024-09-19T09:21:23.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f53fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:53456/0 (socket says 172.21.15.52:53456) 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 -- 172.21.15.52:0/1919480944 learned_addr learned my addr 172.21.15.52:0/1919480944 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f54cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 -- 172.21.15.52:0/1919480944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 msgr2=0x55c84f53fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f53fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 -- 172.21.15.52:0/1919480944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 msgr2=0x55c84f54cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.829+0000 7fd14affd640 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f54cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd14affd640 1 -- 172.21.15.52:0/1919480944 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84f45a130 con 0x55c84f5402f0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 0x7fd1340a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1440096c0 tx=0x7fd1440315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd14affd640 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd14009b880 tx=0x7fd14009b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4412fa316384b196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd131ffb640 1 -- 172.21.15.52:0/1919480944 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140020070 con 0x55c84f5402f0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd131ffb640 1 -- 172.21.15.52:0/1919480944 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1400a44b0 con 0x55c84f5402f0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd131ffb640 1 -- 172.21.15.52:0/1919480944 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140097f60 con 0x55c84f5402f0 2024-09-19T09:21:23.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd153fb2740 1 -- 172.21.15.52:0/1919480944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 msgr2=0x55c84f54a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.830+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd14009b880 tx=0x7fd14009b540 comp rx=0 tx=0).stop 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- 172.21.15.52:0/1919480944 shutdown_connections 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f54cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f5402f0 0x55c84f54a670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1919480944 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f53fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- 172.21.15.52:0/1919480944 >> 172.21.15.52:0/1919480944 conn(0x55c84f53bf60 msgr2=0x55c84f53c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- 172.21.15.52:0/1919480944 shutdown_connections 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- 172.21.15.52:0/1919480944 wait complete. 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- start start 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 Processor -- start 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 0x55c84f54a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 0x55c84f5477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.831+0000 7fd153fb2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c84f54d780 con 0x55c84f54abb0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd153fb2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c84f460f20 con 0x55c84f53f9d0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd153fb2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c84f54d900 con 0x55c84f5402f0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd153fb2740 10 client.0 _ll_register_callbacks cb 0x55c84f42a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48766/0 (socket says 172.21.15.52:48766) 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 0x55c84f5477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 -- 172.21.15.52:0/1775298947 learned_addr learned my addr 172.21.15.52:0/1775298947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 0x55c84f54a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 -- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 msgr2=0x55c84f5477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 0x55c84f5477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 -- 172.21.15.52:0/1775298947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 msgr2=0x55c84f54a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 0x55c84f54a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 -- 172.21.15.52:0/1775298947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84f2172b0 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14affd640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 0x55c84f5477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 0x55c84f54a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd14402a9a0 tx=0x7fd14402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcc90a20b26bfc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd12affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd144035040 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd144052470 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1400a44b0 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.832+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd144057030 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 10 client.15315 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c84f5590f0 con 0x55c84f54abb0 2024-09-19T09:21:23.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1400a44b0 con 0x55c84f54abb0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd14403d6b0 con 0x55c84f54abb0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 10 client.15315 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 20 client.15315 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f55b6e0 0x55c84f55cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 4 client.15315 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c84f4b3600 con 0x55c84f55b6e0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.833+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f55b6e0 0x55c84f55cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f55b6e0 0x55c84f55cb50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b842d91d786fa539 server_cookie=2c430c331aa25db in_seq=0 out_seq=0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd12affd640 10 client.15315 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd12affd640 1 -- 172.21.15.52:0/1775298947 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c84f4b3600 con 0x55c84f55b6e0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd12affd640 10 client.15315 handle_command_reply: tid=0 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd153fb2740 1 client.15315 shutdown 2024-09-19T09:21:23.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 msgr2=0x55c84f547d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.834+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd14402a9a0 tx=0x7fd14402a480 comp rx=0 tx=0).stop 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 shutdown_connections 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f55b6e0 0x55c84f55cb50 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f54abb0 0x55c84f547d20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f5402f0 0x55c84f5477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1775298947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f53f9d0 0x55c84f54a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd12affd640 0 client.15315 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 >> 172.21.15.52:0/1775298947 conn(0x55c84f53bf60 msgr2=0x55c84f541c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 shutdown_connections 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 1 -- 172.21.15.52:0/1775298947 wait complete. 2024-09-19T09:21:23.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.835+0000 7fd153fb2740 20 client.15315 trim_cache size 0 max 16384 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 Processor -- start 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 -- start start 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f5460b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55ae90 con 0x55c84f5402f0 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55b560 con 0x55c84f54abb0 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd153fb2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55bc30 con 0x55c84f53f9d0 2024-09-19T09:21:23.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48772/0 (socket says 172.21.15.52:48772) 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 -- 172.21.15.52:0/2080850929 learned_addr learned my addr 172.21.15.52:0/2080850929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14bfff640 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f5460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 -- 172.21.15.52:0/2080850929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 msgr2=0x55c84f55cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 -- 172.21.15.52:0/2080850929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 msgr2=0x55c84f5460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f5460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.853+0000 7fd14affd640 1 -- 172.21.15.52:0/2080850929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c84f543430 con 0x55c84f5402f0 2024-09-19T09:21:23.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.854+0000 7fd14affd640 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd140005c20 tx=0x7fd14009b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d501e7958c14aee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.854+0000 7fd1317fa640 1 -- 172.21.15.52:0/2080850929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140020070 con 0x55c84f5402f0 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.854+0000 7fd1317fa640 1 -- 172.21.15.52:0/2080850929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1400a44b0 con 0x55c84f5402f0 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.854+0000 7fd1317fa640 1 -- 172.21.15.52:0/2080850929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140097f60 con 0x55c84f5402f0 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- 172.21.15.52:0/2080850929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 msgr2=0x55c84f536ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd140005c20 tx=0x7fd14009b7f0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- 172.21.15.52:0/2080850929 shutdown_connections 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f5460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f536ce0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 --2- 172.21.15.52:0/2080850929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- 172.21.15.52:0/2080850929 >> 172.21.15.52:0/2080850929 conn(0x55c84f53bf60 msgr2=0x55c84f5477a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- 172.21.15.52:0/2080850929 shutdown_connections 2024-09-19T09:21:23.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- 172.21.15.52:0/2080850929 wait complete. 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 -- start start 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.855+0000 7fd153fb2740 1 Processor -- start 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f560790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55c9d0 con 0x55c84f5402f0 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55c300 con 0x55c84f54abb0 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c84f55d0a0 con 0x55c84f53f9d0 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48778/0 (socket says 172.21.15.52:48778) 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 -- 172.21.15.52:0/1817697407 learned_addr learned my addr 172.21.15.52:0/1817697407 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd153fb2740 10 client.0 _ll_register_callbacks cb 0x7fd1440318e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14bfff640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f560790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 -- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 msgr2=0x55c84f55fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 -- 172.21.15.52:0/1817697407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 msgr2=0x55c84f560790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f560790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 -- 172.21.15.52:0/1817697407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c84f5c3fb0 con 0x55c84f5402f0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd14affd640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d740 tx=0x7fd140009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7251f079f9bfaec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd12affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.856+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140020040 con 0x55c84f5402f0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd140099bf0 con 0x55c84f5402f0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1400a44b0 con 0x55c84f5402f0 2024-09-19T09:21:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd1400ccd70 con 0x55c84f5402f0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 10 client.15321 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c84f5c5250 con 0x55c84f5402f0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1400a44b0 con 0x55c84f5402f0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd140082080 con 0x55c84f5402f0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 10 client.15321 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 20 client.15321 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f5c96c0 0x55c84f5c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 4 client.15321 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.857+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "status"}) -- 0x55c84f4adb10 con 0x55c84f5c96c0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f5c96c0 0x55c84f5c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd14b7fe640 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f5c96c0 0x55c84f5c83d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=985377143e125138 server_cookie=16e84c837e4dc1a9 in_seq=0 out_seq=0 2024-09-19T09:21:23.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd12affd640 10 client.15321 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd12affd640 1 -- 172.21.15.52:0/1817697407 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55c84f4adb10 con 0x55c84f5c96c0 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd12affd640 10 client.15321 handle_command_reply: tid=0 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 client.15321 shutdown 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 msgr2=0x55c84f560250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d740 tx=0x7fd140009c30 comp rx=0 tx=0).stop 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 shutdown_connections 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55c84f5c96c0 0x55c84f5c83d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c84f54abb0 0x55c84f560790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c84f5402f0 0x55c84f560250 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd12affd640 0 client.15321 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 --2- 172.21.15.52:0/1817697407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c84f53f9d0 0x55c84f55fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.858+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 >> 172.21.15.52:0/1817697407 conn(0x55c84f53bf60 msgr2=0x55c84f546070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 shutdown_connections 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd153fb2740 1 -- 172.21.15.52:0/1817697407 wait complete. 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd153fb2740 20 client.15321 trim_cache size 0 max 16384 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 2, 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24466, 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:21:23.866 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 117.034730779, 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 24, 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 144.100843602 2024-09-19T09:21:23.867 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 msgr2=0x7fd1340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 0x7fd1340a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd1440096c0 tx=0x7fd1440315b0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 msgr2=0x7fd14c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd14000d770 tx=0x7fd14000dc30 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 shutdown_connections 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd14c10e3c0 0x7fd14c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd14c074f40 0x7fd14c19ab80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1340a3240 0x7fd1340a5700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 --2- 172.21.15.52:0/1612349335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd14c074620 0x7fd14c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.859+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 >> 172.21.15.52:0/1612349335 conn(0x7fd14c0fd8c0 msgr2=0x7fd14c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.860+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 shutdown_connections 2024-09-19T09:21:23.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:23.860+0000 7fd151bd9640 1 -- 172.21.15.52:0/1612349335 wait complete. 2024-09-19T09:21:24.397 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:24 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:21:24.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:21:24.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:24 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:21:24.697 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:24.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:24 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:21:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- 172.21.15.52:0/426435534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 msgr2=0x7f8ea8100480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 --2- 172.21.15.52:0/426435534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8100480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009900 tx=0x7f8ea402a410 comp rx=0 tx=0).stop 2024-09-19T09:21:25.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- 172.21.15.52:0/426435534 shutdown_connections 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 --2- 172.21.15.52:0/426435534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea8104e80 0x7f8ea8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 --2- 172.21.15.52:0/426435534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea806a370 0x7f8ea81009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 --2- 172.21.15.52:0/426435534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8100480 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- 172.21.15.52:0/426435534 >> 172.21.15.52:0/426435534 conn(0x7f8ea8077210 msgr2=0x7f8ea80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- 172.21.15.52:0/426435534 shutdown_connections 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- 172.21.15.52:0/426435534 wait complete. 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 Processor -- start 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 -- start start 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.157+0000 7f8eafe33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea806a370 0x7f8ea81997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea8104e80 0x7f8ea81a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8110eb0 con 0x7f8ea8069f00 2024-09-19T09:21:25.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8110d30 con 0x7f8ea806a370 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8111030 con 0x7f8ea8104e80 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48796/0 (socket says 172.21.15.52:48796) 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 -- 172.21.15.52:0/516710036 learned_addr learned my addr 172.21.15.52:0/516710036 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea806a370 0x7f8ea81997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea8104e80 0x7f8ea81a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 -- 172.21.15.52:0/516710036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea8104e80 msgr2=0x7f8ea81a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea8104e80 0x7f8ea81a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 -- 172.21.15.52:0/516710036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea806a370 msgr2=0x7f8ea81997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea806a370 0x7f8ea81997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 -- 172.21.15.52:0/516710036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea81a4840 con 0x7f8ea8069f00 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4006010 tx=0x7f8ea4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8e9effd640 1 -- 172.21.15.52:0/516710036 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea403f030 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8e9effd640 1 -- 172.21.15.52:0/516710036 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea4004440 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea81a4a10 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8e9effd640 1 -- 172.21.15.52:0/516710036 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4035070 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.158+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea81a4e60 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8e9effd640 1 -- 172.21.15.52:0/516710036 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8ea4042030 con 0x7f8ea8069f00 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 Processor -- start 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 -- start start 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 0x55838833edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 0x55838834bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5583882a5090 con 0x55838833f2f0 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55838824ca70 con 0x55838833e9d0 2024-09-19T09:21:25.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eb220c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583882a1050 con 0x558388349bb0 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.161+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48800/0 (socket says 172.21.15.52:48800) 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 -- 172.21.15.52:0/1657573897 learned_addr learned my addr 172.21.15.52:0/1657573897 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eae3d0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 0x55838833edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 0x55838834bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8e9effd640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 -- 172.21.15.52:0/1657573897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 msgr2=0x55838834bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 0x55838834bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 -- 172.21.15.52:0/1657573897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 msgr2=0x55838833edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 0x55838833edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 -- 172.21.15.52:0/1657573897 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558388259130 con 0x55838833f2f0 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 0x55838833edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:25.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 0x55838834bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8e9effd640 1 -- 172.21.15.52:0/516710036 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8ea40efd80 con 0x7f8ea8069f00 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40b8cf0 tx=0x7f8ea403ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7bf513c0402cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8e93fff640 1 -- 172.21.15.52:0/1657573897 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4049030 con 0x55838833f2f0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8e93fff640 1 -- 172.21.15.52:0/1657573897 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea404a260 con 0x55838833f2f0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.162+0000 7f8e93fff640 1 -- 172.21.15.52:0/1657573897 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40c06d0 con 0x55838833f2f0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 -- 172.21.15.52:0/1657573897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 msgr2=0x558388349670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 0x7f8e940a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009fd0 tx=0x7f8ea0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40b8cf0 tx=0x7f8ea403ae50 comp rx=0 tx=0).stop 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 -- 172.21.15.52:0/1657573897 shutdown_connections 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558388349bb0 0x55838834bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833f2f0 0x558388349670 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1657573897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833e9d0 0x55838833edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 -- 172.21.15.52:0/1657573897 >> 172.21.15.52:0/1657573897 conn(0x55838833af60 msgr2=0x55838833b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 -- 172.21.15.52:0/1657573897 shutdown_connections 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.163+0000 7f8eb220c740 1 -- 172.21.15.52:0/1657573897 wait complete. 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 -- start start 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 Processor -- start 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388346740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388346c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55838834c540 con 0x55838833e9d0 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55838825ff20 con 0x558388349bb0 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55838834c6c0 con 0x55838833f2f0 2024-09-19T09:21:25.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eb220c740 10 client.0 _ll_register_callbacks cb 0x558388229030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48806/0 (socket says 172.21.15.52:48806) 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eadbcf640 1 -- 172.21.15.52:0/4232969207 learned_addr learned my addr 172.21.15.52:0/4232969207 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388346c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.164+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388346740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 -- 172.21.15.52:0/4232969207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 msgr2=0x558388346740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388346740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 -- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 msgr2=0x558388346c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388346c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 -- 172.21.15.52:0/4232969207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583880162b0 con 0x55838833e9d0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388346c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ea404a450 tx=0x7f8ea40bbc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a1a5cc76923f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40d4020 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8ea40d5250 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea404a260 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ea4049040 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eb220c740 10 client.15333 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55838834c540 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea404a260 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea40b8990 con 0x55838833e9d0 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.165+0000 7f8eb220c740 10 client.15333 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8eb220c740 10 client.15333 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8eb220c740 20 client.15333 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55838835a200 0x55838835b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8eb220c740 4 client.15333 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583882b2600 con 0x55838835a200 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55838835a200 0x55838835b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8e917fa640 10 client.15333 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.166+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55838835a200 0x55838835b670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=873dbc6d2f4694c6 server_cookie=f2c6fd2581132881 in_seq=0 out_seq=0 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8e917fa640 1 -- 172.21.15.52:0/4232969207 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583882b2600 con 0x55838835a200 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8e917fa640 10 client.15333 handle_command_reply: tid=0 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 client.15333 shutdown 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 msgr2=0x5583883493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ea404a450 tx=0x7f8ea40bbc80 comp rx=0 tx=0).stop 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 shutdown_connections 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55838835a200 0x55838835b670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388346c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388346740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8e917fa640 0 client.15333 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 --2- 172.21.15.52:0/4232969207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x5583883493f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.167+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 >> 172.21.15.52:0/4232969207 conn(0x55838833af60 msgr2=0x558388340c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.168+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 shutdown_connections 2024-09-19T09:21:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.168+0000 7f8eb220c740 1 -- 172.21.15.52:0/4232969207 wait complete. 2024-09-19T09:21:25.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.168+0000 7f8eb220c740 20 client.15333 trim_cache size 0 max 16384 2024-09-19T09:21:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 Processor -- start 2024-09-19T09:21:25.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 -- start start 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388341610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388341b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5583883599b0 con 0x55838833e9d0 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55838835a080 con 0x558388349bb0 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eb220c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55838835a750 con 0x55838833f2f0 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48822/0 (socket says 172.21.15.52:48822) 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 -- 172.21.15.52:0/970762953 learned_addr learned my addr 172.21.15.52:0/970762953 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 -- 172.21.15.52:0/970762953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 msgr2=0x558388341610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388341610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 -- 172.21.15.52:0/970762953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 msgr2=0x558388341b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388341b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.186+0000 7f8eadbcf640 1 -- 172.21.15.52:0/970762953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838833ad90 con 0x55838833e9d0 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ab0 tx=0x7f8ea40f0080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3110d4d7cd304c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8e937fe640 1 -- 172.21.15.52:0/970762953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40d4030 con 0x55838833e9d0 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8e937fe640 1 -- 172.21.15.52:0/970762953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea404a260 con 0x55838833e9d0 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8e937fe640 1 -- 172.21.15.52:0/970762953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b8990 con 0x55838833e9d0 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 -- 172.21.15.52:0/970762953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 msgr2=0x55838835b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ab0 tx=0x7f8ea40f0080 comp rx=0 tx=0).stop 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 -- 172.21.15.52:0/970762953 shutdown_connections 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558388349bb0 0x558388341b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833f2f0 0x558388341610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 --2- 172.21.15.52:0/970762953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55838833e9d0 0x55838835b670 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.187+0000 7f8eb220c740 1 -- 172.21.15.52:0/970762953 >> 172.21.15.52:0/970762953 conn(0x55838833af60 msgr2=0x558388345010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- 172.21.15.52:0/970762953 shutdown_connections 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- 172.21.15.52:0/970762953 wait complete. 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- start start 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 Processor -- start 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 0x55838835cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 0x55838835d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55838835b4f0 con 0x558388349bb0 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55838835ae20 con 0x55838833f2f0 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55838835bbc0 con 0x55838833e9d0 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eb220c740 10 client.0 _ll_register_callbacks cb 0x7f8ea00099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eae3d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eae3d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48832/0 (socket says 172.21.15.52:48832) 2024-09-19T09:21:25.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.188+0000 7f8eae3d0640 1 -- 172.21.15.52:0/1699625637 learned_addr learned my addr 172.21.15.52:0/1699625637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 0x55838835cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 0x55838835d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 -- 172.21.15.52:0/1699625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 msgr2=0x55838835cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 0x55838835cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 -- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 msgr2=0x55838835d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 0x55838835d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 -- 172.21.15.52:0/1699625637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838833bbf0 con 0x558388349bb0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 0x55838835cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8ead3ce640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 0x55838835d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eae3d0640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0010930 tx=0x7f8ea0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c56992ae17188e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8e917fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0011bd0 con 0x558388349bb0 2024-09-19T09:21:25.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8ea0011d70 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea404a260 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ea002b030 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eb220c740 10 client.15339 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.189+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583883c3f80 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea404a260 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea0025030 con 0x558388349bb0 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 10 client.15339 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 10 client.15339 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 20 client.15339 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5583883c8b20 0x5583883c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 4 client.15339 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "status"}) -- 0x5583882acb10 con 0x5583883c8b20 2024-09-19T09:21:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.190+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5583883c8b20 0x5583883c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8e917fa640 10 client.15339 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eadbcf640 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5583883c8b20 0x5583883c7830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11a4c748eb9c49da server_cookie=4df41ba6f2b7c9d5 in_seq=0 out_seq=0 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8e917fa640 1 -- 172.21.15.52:0/1699625637 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5583882acb10 con 0x5583883c8b20 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8e917fa640 10 client.15339 handle_command_reply: tid=0 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 client.15339 shutdown 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 msgr2=0x5583883c2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0010930 tx=0x7f8ea0009500 comp rx=0 tx=0).stop 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 shutdown_connections 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558388349bb0 0x5583883c2900 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5583883c8b20 0x5583883c7830 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55838833f2f0 0x55838835d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 --2- 172.21.15.52:0/1699625637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55838833e9d0 0x55838835cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8e917fa640 0 client.15339 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 >> 172.21.15.52:0/1699625637 conn(0x55838833af60 msgr2=0x5583883397e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 shutdown_connections 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 1 -- 172.21.15.52:0/1699625637 wait complete. 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.191+0000 7f8eb220c740 20 client.15339 trim_cache size 0 max 16384 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 1, 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24482, 2024-09-19T09:21:25.205 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 119.37352656100001, 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 24, 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 147.80899867100001 2024-09-19T09:21:25.206 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 msgr2=0x7f8e940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 0x7f8e940a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009fd0 tx=0x7f8ea0004a40 comp rx=0 tx=0).stop 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 msgr2=0x7f8ea8199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4006010 tx=0x7f8ea4004040 comp rx=0 tx=0).stop 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 shutdown_connections 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8e940a3240 0x7f8e940a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ea8104e80 0x7f8ea81a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ea806a370 0x7f8ea81997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 --2- 172.21.15.52:0/516710036 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ea8069f00 0x7f8ea8199280 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 >> 172.21.15.52:0/516710036 conn(0x7f8ea8077210 msgr2=0x7f8ea8102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 shutdown_connections 2024-09-19T09:21:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:25.192+0000 7f8eafe33640 1 -- 172.21.15.52:0/516710036 wait complete. 2024-09-19T09:21:25.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:25 smithi052 ceph-mon[30947]: pgmap v337: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T09:21:25.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:25 smithi169 ceph-mon[35454]: pgmap v337: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T09:21:25.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:25 smithi086 ceph-mon[34813]: pgmap v337: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-09-19T09:21:25.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:21:26.124 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- 172.21.15.52:0/71484798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c102790 msgr2=0x7f6e8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/71484798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c102790 0x7f6e8c1067e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009900 tx=0x7f6e8002a410 comp rx=0 tx=0).stop 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- 172.21.15.52:0/71484798 shutdown_connections 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/71484798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 0x7f6e8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/71484798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c102790 0x7f6e8c1067e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/71484798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c101de0 0x7f6e8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- 172.21.15.52:0/71484798 >> 172.21.15.52:0/71484798 conn(0x7f6e8c0fd8c0 msgr2=0x7f6e8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- 172.21.15.52:0/71484798 shutdown_connections 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- 172.21.15.52:0/71484798 wait complete. 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 Processor -- start 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.635+0000 7f6e90ee7640 1 -- start start 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c102790 0x7f6e8c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 0x7f6e8c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111fc0 con 0x7f6e8c101de0 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111e40 con 0x7f6e8c102790 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e90ee7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c112140 con 0x7f6e8c106f10 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48854/0 (socket says 172.21.15.52:48854) 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3334015241 learned_addr learned my addr 172.21.15.52:0/3334015241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c102790 0x7f6e8c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 0x7f6e8c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3334015241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 msgr2=0x7f6e8c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 0x7f6e8c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3334015241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c102790 msgr2=0x7f6e8c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c102790 0x7f6e8c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3334015241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c1a68e0 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.636+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c890 tx=0x7f6e7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.637+0000 7f6e7b7fe640 1 -- 172.21.15.52:0/3334015241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c004220 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.637+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c1a6bd0 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.637+0000 7f6e7b7fe640 1 -- 172.21.15.52:0/3334015241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c0043c0 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.637+0000 7f6e7b7fe640 1 -- 172.21.15.52:0/3334015241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c004a00 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.637+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c1a70e0 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e7b7fe640 1 -- 172.21.15.52:0/3334015241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e7c0079b0 con 0x7f6e8c101de0 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 Processor -- start 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 -- start start 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8573db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 0x5555d857e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d84da090 con 0x5555d85739d0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5555d8481a70 con 0x5555d85742f0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.640+0000 7f6e932c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5555d84d6050 con 0x5555d857ebb0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:53544/0 (socket says 172.21.15.52:53544) 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 -- 172.21.15.52:0/4050398257 learned_addr learned my addr 172.21.15.52:0/4050398257 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8573db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 0x5555d857e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 -- 172.21.15.52:0/4050398257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 msgr2=0x5555d857e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 0x5555d857e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 -- 172.21.15.52:0/4050398257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 msgr2=0x5555d8573db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8573db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e7b7fe640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 0x7f6e740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 -- 172.21.15.52:0/4050398257 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d848e130 con 0x5555d857ebb0 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 0x5555d857e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e7b7fe640 1 -- 172.21.15.52:0/3334015241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e7c0cf5e0 con 0x7f6e8c101de0 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 0x7f6e740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.641+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e80031550 tx=0x7f6e800041a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625acff0e6b086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e78ff9640 1 -- 172.21.15.52:0/4050398257 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80035040 con 0x5555d857ebb0 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 0x7f6e740a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005fd0 tx=0x7f6e84009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e78ff9640 1 -- 172.21.15.52:0/4050398257 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e80005520 con 0x5555d857ebb0 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e78ff9640 1 -- 172.21.15.52:0/4050398257 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80003850 con 0x5555d857ebb0 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 -- 172.21.15.52:0/4050398257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 msgr2=0x5555d8580fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e80031550 tx=0x7f6e800041a0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 -- 172.21.15.52:0/4050398257 shutdown_connections 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d8580fa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85742f0 0x5555d857e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 --2- 172.21.15.52:0/4050398257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8573db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.642+0000 7f6e932c0740 1 -- 172.21.15.52:0/4050398257 >> 172.21.15.52:0/4050398257 conn(0x5555d856ff60 msgr2=0x5555d8570340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- 172.21.15.52:0/4050398257 shutdown_connections 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- 172.21.15.52:0/4050398257 wait complete. 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- start start 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 Processor -- start 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85739d0 0x5555d857e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d857bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d8581780 con 0x5555d85742f0 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5555d8494f20 con 0x5555d85739d0 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5555d8581900 con 0x5555d857ebb0 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e932c0740 10 client.0 _ll_register_callbacks cb 0x5555d845e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48870/0 (socket says 172.21.15.52:48870) 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e89d9b640 1 -- 172.21.15.52:0/1523529573 learned_addr learned my addr 172.21.15.52:0/1523529573 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.643+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d857bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85739d0 0x5555d857e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 -- 172.21.15.52:0/1523529573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 msgr2=0x5555d857bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d857bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 -- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85739d0 msgr2=0x5555d857e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85739d0 0x5555d857e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 -- 172.21.15.52:0/1523529573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d824b2b0 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e80006010 tx=0x7f6e80005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af219b9c525ad192 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80035070 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e800048d0 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e80005520 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e80049070 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e932c0740 10 client.15351 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.644+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555d858d0a0 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e80005520 con 0x5555d85742f0 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6e800315b0 con 0x5555d85742f0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 10 client.15351 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 10 client.15351 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 20 client.15351 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d858f1d0 0x5555d8590640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 4 client.15351 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555d84e7600 con 0x5555d858f1d0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.645+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d858f1d0 0x5555d8590640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.646+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d858f1d0 0x5555d8590640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a8dbe43f57e4a9 server_cookie=8fdb4b67ccfc632b in_seq=0 out_seq=0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.646+0000 7f6e71ffb640 10 client.15351 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.646+0000 7f6e71ffb640 1 -- 172.21.15.52:0/1523529573 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555d84e7600 con 0x5555d858f1d0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.646+0000 7f6e71ffb640 10 client.15351 handle_command_reply: tid=0 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.646+0000 7f6e932c0740 1 client.15351 shutdown 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 msgr2=0x5555d857b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e80006010 tx=0x7f6e80005230 comp rx=0 tx=0).stop 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 shutdown_connections 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d858f1d0 0x5555d8590640 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d857ebb0 0x5555d857bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d857b7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 --2- 172.21.15.52:0/1523529573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d85739d0 0x5555d857e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 >> 172.21.15.52:0/1523529573 conn(0x5555d856ff60 msgr2=0x5555d8575c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e71ffb640 0 client.15351 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 shutdown_connections 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 1 -- 172.21.15.52:0/1523529573 wait complete. 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.647+0000 7f6e932c0740 20 client.15351 trim_cache size 0 max 16384 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.664+0000 7f6e932c0740 1 Processor -- start 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 -- start start 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 0x5555d858eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d8574b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d858e980 con 0x5555d85742f0 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5555d858f050 con 0x5555d857ebb0 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e932c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5555d858f720 con 0x5555d85739d0 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48876/0 (socket says 172.21.15.52:48876) 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 -- 172.21.15.52:0/2415320114 learned_addr learned my addr 172.21.15.52:0/2415320114 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 0x5555d858eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 -- 172.21.15.52:0/2415320114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 msgr2=0x5555d858eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 0x5555d858eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d8574b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 -- 172.21.15.52:0/2415320114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 msgr2=0x5555d8574b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d8574b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 -- 172.21.15.52:0/2415320114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555d85737e0 con 0x5555d85742f0 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 0x5555d858eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d8574b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009850 tx=0x7f6e800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58df8e381691345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.665+0000 7f6e73fff640 1 -- 172.21.15.52:0/2415320114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8005a030 con 0x5555d85742f0 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e73fff640 1 -- 172.21.15.52:0/2415320114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e80005850 con 0x5555d85742f0 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e73fff640 1 -- 172.21.15.52:0/2415320114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80035070 con 0x5555d85742f0 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- 172.21.15.52:0/2415320114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 msgr2=0x5555d858ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009850 tx=0x7f6e800045e0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- 172.21.15.52:0/2415320114 shutdown_connections 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d8574b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85742f0 0x5555d858ff70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 --2- 172.21.15.52:0/2415320114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85739d0 0x5555d858eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- 172.21.15.52:0/2415320114 >> 172.21.15.52:0/2415320114 conn(0x5555d856ff60 msgr2=0x5555d8576d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- 172.21.15.52:0/2415320114 shutdown_connections 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- 172.21.15.52:0/2415320114 wait complete. 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.666+0000 7f6e932c0740 1 -- start start 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 Processor -- start 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 0x5555d8591d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d85922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5555d85904c0 con 0x5555d85739d0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5555d858fdf0 con 0x5555d857ebb0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5555d8590b90 con 0x5555d85742f0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e932c0740 10 client.0 _ll_register_callbacks cb 0x7f6e84009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48888/0 (socket says 172.21.15.52:48888) 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3074989869 learned_addr learned my addr 172.21.15.52:0/3074989869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d85922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 0x5555d8591d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3074989869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 msgr2=0x5555d8591d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 0x5555d8591d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 msgr2=0x5555d85922c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d85922c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8a59c640 1 -- 172.21.15.52:0/3074989869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555d85f7980 con 0x5555d85739d0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 0x5555d8591d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.667+0000 7f6e8ad9d640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d85922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e8a59c640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c098600 tx=0x7f6e7c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd46c7c86ebc5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c01d040 con 0x5555d85739d0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e7c0d2d10 con 0x5555d85739d0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e80005850 con 0x5555d85739d0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c09bc30 con 0x5555d85739d0 2024-09-19T09:21:26.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 10 client.15357 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555d85f8bf0 con 0x5555d85739d0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e80005850 con 0x5555d85739d0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6e7c0ba2a0 con 0x5555d85739d0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 10 client.15357 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 10 client.15357 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 20 client.15357 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d85fd7b0 0x5555d85fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 4 client.15357 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.668+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "status"}) -- 0x5555d84e1b10 con 0x5555d85fd7b0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d85fd7b0 0x5555d85fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e89d9b640 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d85fd7b0 0x5555d85fc4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b328116dca8318c2 server_cookie=5a7e0556252a31ed in_seq=0 out_seq=0 2024-09-19T09:21:26.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e71ffb640 10 client.15357 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e71ffb640 1 -- 172.21.15.52:0/3074989869 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5555d84e1b10 con 0x5555d85fd7b0 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e71ffb640 10 client.15357 handle_command_reply: tid=0 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e932c0740 1 client.15357 shutdown 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 msgr2=0x5555d8591840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.669+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c098600 tx=0x7f6e7c0054a0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 shutdown_connections 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5555d85fd7b0 0x5555d85fc4c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5555d857ebb0 0x5555d85922c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5555d85742f0 0x5555d8591d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 --2- 172.21.15.52:0/3074989869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5555d85739d0 0x5555d8591840 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 >> 172.21.15.52:0/3074989869 conn(0x5555d856ff60 msgr2=0x5555d85764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e71ffb640 0 client.15357 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 shutdown_connections 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 1 -- 172.21.15.52:0/3074989869 wait complete. 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e932c0740 20 client.15357 trim_cache size 0 max 16384 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "044f38fa-7667-11ef-bceb-c7b262605968", 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 24509, 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-09-19T09:21:26.678 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 127.885628552, 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 24, 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 81, 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 138.39251918900001 2024-09-19T09:21:26.679 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 msgr2=0x7f6e740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 0x7f6e740a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005fd0 tx=0x7f6e84009600 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 msgr2=0x7f6e8c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00c890 tx=0x7f6e7c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 shutdown_connections 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e740a3240 0x7f6e740a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e8c106f10 0x7f6e8c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e8c102790 0x7f6e8c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 --2- 172.21.15.52:0/3334015241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e8c101de0 0x7f6e8c0744f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 >> 172.21.15.52:0/3334015241 conn(0x7f6e8c0fd8c0 msgr2=0x7f6e8c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.670+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 shutdown_connections 2024-09-19T09:21:26.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:26.671+0000 7f6e90ee7640 1 -- 172.21.15.52:0/3334015241 wait complete. 2024-09-19T09:21:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:21:27.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:26 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:21:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:27.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:26 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: pgmap v338: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:27.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:26 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:21:27.350 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:21:29.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:28 smithi169 ceph-mon[35454]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:29.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:28 smithi086 ceph-mon[34813]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:28 smithi052 ceph-mon[30947]: pgmap v339: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:30 smithi169 ceph-mon[35454]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:31.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:30 smithi086 ceph-mon[34813]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:31.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:30 smithi052 ceph-mon[30947]: pgmap v340: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:33.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:32 smithi086 ceph-mon[34813]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:33.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:32 smithi052 ceph-mon[30947]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:32 smithi169 ceph-mon[35454]: pgmap v341: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.902+0000 7f4327c7b640 1 -- 172.21.15.52:0/1238173896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 msgr2=0x7f43201007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.902+0000 7f4327c7b640 1 --2- 172.21.15.52:0/1238173896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f43201007d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f431c009900 tx=0x7f431c02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 -- 172.21.15.52:0/1238173896 shutdown_connections 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 --2- 172.21.15.52:0/1238173896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 0x7f4320101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 --2- 172.21.15.52:0/1238173896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f4320101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 --2- 172.21.15.52:0/1238173896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f43201007d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 -- 172.21.15.52:0/1238173896 >> 172.21.15.52:0/1238173896 conn(0x7f43200fc1e0 msgr2=0x7f43200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 -- 172.21.15.52:0/1238173896 shutdown_connections 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 -- 172.21.15.52:0/1238173896 wait complete. 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 Processor -- start 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.903+0000 7f4327c7b640 1 -- start start 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f432019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 0x7f43201a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f432010f9d0 con 0x7f43201003d0 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f432010f850 con 0x7f4320100d10 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4327c7b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f432010fb50 con 0x7f43201016b0 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39616/0 (socket says 172.21.15.52:39616) 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 -- 172.21.15.52:0/2810843543 learned_addr learned my addr 172.21.15.52:0/2810843543 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4326218640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 0x7f43201a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325216640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f432019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 -- 172.21.15.52:0/2810843543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 msgr2=0x7f43201a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 0x7f43201a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 -- 172.21.15.52:0/2810843543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 msgr2=0x7f432019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f432019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 -- 172.21.15.52:0/2810843543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201a1c10 con 0x7f43201003d0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325216640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f432019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4325a17640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f431c009230 tx=0x7f431c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.904+0000 7f4316ffd640 1 -- 172.21.15.52:0/2810843543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c03f030 con 0x7f43201003d0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.905+0000 7f4316ffd640 1 -- 172.21.15.52:0/2810843543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f431c003ad0 con 0x7f43201003d0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.905+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201a1ea0 con 0x7f43201003d0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.905+0000 7f4316ffd640 1 -- 172.21.15.52:0/2810843543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c035070 con 0x7f43201003d0 2024-09-19T09:21:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.905+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43201a22b0 con 0x7f43201003d0 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.907+0000 7f4316ffd640 1 -- 172.21.15.52:0/2810843543 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f431c042030 con 0x7f43201003d0 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.907+0000 7f432aa1c740 1 Processor -- start 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 -- start start 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c952da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c955830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c8b12f0 con 0x55ba3c94d9a0 2024-09-19T09:21:33.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c859270 con 0x55ba3c94e2e0 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f432aa1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c8ad2b0 con 0x55ba3c953370 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4326218640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4326218640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39620/0 (socket says 172.21.15.52:39620) 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4326218640 1 -- 172.21.15.52:0/565397292 learned_addr learned my addr 172.21.15.52:0/565397292 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4316ffd640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 0x7f430c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4325a17640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c952da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4325216640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c955830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.908+0000 7f4326218640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 0x7f430c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 -- 172.21.15.52:0/565397292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 msgr2=0x55ba3c952da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c952da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 -- 172.21.15.52:0/565397292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 msgr2=0x55ba3c94dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4316ffd640 1 -- 172.21.15.52:0/2810843543 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f431c0eff70 con 0x7f43201003d0 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 -- 172.21.15.52:0/565397292 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3c858340 con 0x55ba3c953370 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4326218640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4325216640 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c955830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4310009c00 tx=0x7f43100117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e564ef96f91736 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f4326218640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 0x7f430c0a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4318009fd0 tx=0x7f4318004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f430bfff640 1 -- 172.21.15.52:0/565397292 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310012450 con 0x55ba3c953370 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f430bfff640 1 -- 172.21.15.52:0/565397292 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4310012ad0 con 0x55ba3c953370 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.909+0000 7f430bfff640 1 -- 172.21.15.52:0/565397292 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431000fa80 con 0x55ba3c953370 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- 172.21.15.52:0/565397292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 msgr2=0x55ba3c955830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c955830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4310009c00 tx=0x7f43100117b0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.920 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- 172.21.15.52:0/565397292 shutdown_connections 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c955830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c952da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 --2- 172.21.15.52:0/565397292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- 172.21.15.52:0/565397292 >> 172.21.15.52:0/565397292 conn(0x55ba3c949010 msgr2=0x55ba3c949410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- 172.21.15.52:0/565397292 shutdown_connections 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- 172.21.15.52:0/565397292 wait complete. 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 -- start start 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.910+0000 7f432aa1c740 1 Processor -- start 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94d9a0 0x55ba3c957b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c95f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.921 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c956340 con 0x55ba3c94e2e0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c83a290 con 0x55ba3c94d9a0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba3c9564c0 con 0x55ba3c953370 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f432aa1c740 10 client.0 _ll_register_callbacks cb 0x55ba3c86b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39634/0 (socket says 172.21.15.52:39634) 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 -- 172.21.15.52:0/503056562 learned_addr learned my addr 172.21.15.52:0/503056562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325a17640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94d9a0 0x55ba3c957b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4326218640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c95f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 -- 172.21.15.52:0/503056562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 msgr2=0x55ba3c95f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c95f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 -- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94d9a0 msgr2=0x55ba3c957b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94d9a0 0x55ba3c957b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.922 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.911+0000 7f4325216640 1 -- 172.21.15.52:0/503056562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3c5c4210 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f4325216640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f431001c040 tx=0x7f4310009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3edb130049df51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310029070 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f43100126e0 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4310012ad0 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43100128e0 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f432aa1c740 10 client.15369 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba3c690620 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4310012ad0 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f431002c030 con 0x55ba3c94e2e0 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f432aa1c740 10 client.15369 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.912+0000 7f432aa1c740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:33.923 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f432aa1c740 20 client.15369 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9634a0 0x55ba3c965890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f432aa1c740 4 client.15369 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba3c8bea20 con 0x55ba3c9634a0 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f4325a17640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9634a0 0x55ba3c965890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f43097fa640 10 client.15369 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.913+0000 7f4325a17640 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9634a0 0x55ba3c965890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e060f80e7ca175 server_cookie=270ddc64e1c9cde8 in_seq=0 out_seq=0 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f43097fa640 1 -- 172.21.15.52:0/503056562 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba3c8bea20 con 0x55ba3c9634a0 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f43097fa640 10 client.15369 handle_command_reply: tid=0 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 client.15369 shutdown 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 msgr2=0x55ba3c958040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f431001c040 tx=0x7f4310009860 comp rx=0 tx=0).stop 2024-09-19T09:21:33.924 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 shutdown_connections 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9634a0 0x55ba3c965890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c95f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94e2e0 0x55ba3c958040 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 --2- 172.21.15.52:0/503056562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94d9a0 0x55ba3c957b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f43097fa640 0 client.15369 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 >> 172.21.15.52:0/503056562 conn(0x55ba3c949010 msgr2=0x55ba3c94a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 shutdown_connections 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 1 -- 172.21.15.52:0/503056562 wait complete. 2024-09-19T09:21:33.925 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.914+0000 7f432aa1c740 20 client.15369 trim_cache size 0 max 16384 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 Processor -- start 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 -- start start 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c9480b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43201adcf0 con 0x55ba3c94d9a0 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43201ab5c0 con 0x55ba3c94e2e0 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f432aa1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a9410 con 0x55ba3c953370 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39648/0 (socket says 172.21.15.52:39648) 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f4325a17640 1 -- 172.21.15.52:0/4021870815 learned_addr learned my addr 172.21.15.52:0/4021870815 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.929+0000 7f4325216640 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 -- 172.21.15.52:0/4021870815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 msgr2=0x55ba3c9480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c9480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 -- 172.21.15.52:0/4021870815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 msgr2=0x55ba3c95f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 -- 172.21.15.52:0/4021870815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3c956ac0 con 0x55ba3c94d9a0 2024-09-19T09:21:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325216640 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f4325a17640 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f431c0b8e80 tx=0x7f431c0b8880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f45da82690b1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f430b7fe640 1 -- 172.21.15.52:0/4021870815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c049040 con 0x55ba3c94d9a0 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f430b7fe640 1 -- 172.21.15.52:0/4021870815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f431c0ede50 con 0x55ba3c94d9a0 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.930+0000 7f430b7fe640 1 -- 172.21.15.52:0/4021870815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0b8b20 con 0x55ba3c94d9a0 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- 172.21.15.52:0/4021870815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 msgr2=0x55ba3c94dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f431c0b8e80 tx=0x7f431c0b8880 comp rx=0 tx=0).stop 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- 172.21.15.52:0/4021870815 shutdown_connections 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c953370 0x55ba3c9480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- 172.21.15.52:0/4021870815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c94dd80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- 172.21.15.52:0/4021870815 >> 172.21.15.52:0/4021870815 conn(0x55ba3c949010 msgr2=0x55ba3c9479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- 172.21.15.52:0/4021870815 shutdown_connections 2024-09-19T09:21:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- 172.21.15.52:0/4021870815 wait complete. 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- start start 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 Processor -- start 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 0x55ba3c95df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43201a9a80 con 0x55ba3c94d9a0 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43201aaef0 con 0x55ba3c953370 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43201aa150 con 0x55ba3c94e2e0 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.931+0000 7f432aa1c740 10 client.0 _ll_register_callbacks cb 0x7f4318009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39650/0 (socket says 172.21.15.52:39650) 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 -- 172.21.15.52:0/1515347397 learned_addr learned my addr 172.21.15.52:0/1515347397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4326218640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 0x55ba3c95df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325216640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 -- 172.21.15.52:0/1515347397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c94e2e0 msgr2=0x55ba3c95cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 -- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 msgr2=0x55ba3c95df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 0x55ba3c95df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 -- 172.21.15.52:0/1515347397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba3c95e520 con 0x55ba3c94d9a0 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4326218640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 0x55ba3c95df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f4325a17640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f431c0c4bf0 tx=0x7f431c0c52a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4869b53b07d439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f43097fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0d4070 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f431c0b8b20 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f431c0ede50 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f431c049050 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f432aa1c740 10 client.15375 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.932+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba3c9ce210 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f431c0ede50 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f431c0d52b0 con 0x55ba3c94d9a0 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 10 client.15375 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 20 client.15375 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9ceac0 0x55ba3c9d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 4 client.15375 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba3c8b8d70 con 0x55ba3c9ceac0 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f4325216640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9ceac0 0x55ba3c9d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f4325216640 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9ceac0 0x55ba3c9d0eb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a615e9dd3904686f server_cookie=24e4f3e2d2fc101d in_seq=0 out_seq=0 2024-09-19T09:21:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.933+0000 7f43097fa640 10 client.15375 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f43097fa640 1 -- 172.21.15.52:0/1515347397 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba3c8b8d70 con 0x55ba3c9ceac0 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f43097fa640 10 client.15375 handle_command_reply: tid=0 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 client.15375 shutdown 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 msgr2=0x55ba3c95c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f431c0c4bf0 tx=0x7f431c0c52a0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 shutdown_connections 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba3c9ceac0 0x55ba3c9d0eb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba3c953370 0x55ba3c95df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba3c94e2e0 0x55ba3c95cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f43097fa640 0 client.15375 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 --2- 172.21.15.52:0/1515347397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba3c94d9a0 0x55ba3c95c9c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 >> 172.21.15.52:0/1515347397 conn(0x55ba3c949010 msgr2=0x55ba3c9481c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 shutdown_connections 2024-09-19T09:21:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.941+0000 7f432aa1c740 1 -- 172.21.15.52:0/1515347397 wait complete. 2024-09-19T09:21:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f432aa1c740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T09:21:33.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:21:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:21:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:21:33.947 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 msgr2=0x7f430c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 0x7f430c0a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4318009fd0 tx=0x7f4318004ab0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 msgr2=0x7f4320199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f431c009230 tx=0x7f431c031b60 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 shutdown_connections 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f430c0a32f0 0x7f430c0a57b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43201016b0 0x7f43201a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4320100d10 0x7f432019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 --2- 172.21.15.52:0/2810843543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43201003d0 0x7f4320199ff0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:33.948 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 >> 172.21.15.52:0/2810843543 conn(0x7f43200fc1e0 msgr2=0x7f43200fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 shutdown_connections 2024-09-19T09:21:33.949 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:33.942+0000 7f4327c7b640 1 -- 172.21.15.52:0/2810843543 wait complete. 2024-09-19T09:21:35.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:34 smithi086 ceph-mon[34813]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:21:35.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:34 smithi052 ceph-mon[30947]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:21:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:34 smithi169 ceph-mon[35454]: pgmap v342: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:21:37.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:36 smithi086 ceph-mon[34813]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:21:37.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:36 smithi052 ceph-mon[30947]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:21:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:36 smithi169 ceph-mon[35454]: pgmap v343: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:21:39.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:38 smithi086 ceph-mon[34813]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:21:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:38 smithi052 ceph-mon[30947]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:21:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:38 smithi169 ceph-mon[35454]: pgmap v344: 97 pgs: 97 active+clean; 656 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:21:41.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:40 smithi086 ceph-mon[34813]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:41.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:40 smithi052 ceph-mon[30947]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:41.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:40 smithi169 ceph-mon[35454]: pgmap v345: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:41.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:21:41.966 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:42.351 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:21:42.351 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:42.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 -- 172.21.15.52:0/293477055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01036e0 msgr2=0x7f3da0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 --2- 172.21.15.52:0/293477055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01036e0 0x7f3da0107b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009930 tx=0x7f3d9002a420 comp rx=0 tx=0).stop 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 -- 172.21.15.52:0/293477055 shutdown_connections 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 --2- 172.21.15.52:0/293477055 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01082a0 0x7f3da010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 --2- 172.21.15.52:0/293477055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01036e0 0x7f3da0107b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 --2- 172.21.15.52:0/293477055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 0x7f3da0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 -- 172.21.15.52:0/293477055 >> 172.21.15.52:0/293477055 conn(0x7f3da00fc7d0 msgr2=0x7f3da00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 -- 172.21.15.52:0/293477055 shutdown_connections 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.632+0000 7f3da77df640 1 -- 172.21.15.52:0/293477055 wait complete. 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 Processor -- start 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 -- start start 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 0x7f3da0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 0x7f3da019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01120c0 con 0x7f3da01082a0 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0111f40 con 0x7f3da0102d30 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.633+0000 7f3da77df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0112240 con 0x7f3da01036e0 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:46606/0 (socket says 172.21.15.52:46606) 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da4d7a640 1 -- 172.21.15.52:0/2456874335 learned_addr learned my addr 172.21.15.52:0/2456874335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 0x7f3da019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da557b640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 0x7f3da0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 -- 172.21.15.52:0/2456874335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 msgr2=0x7f3da0198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 -- 172.21.15.52:0/2456874335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 msgr2=0x7f3da0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 0x7f3da0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 -- 172.21.15.52:0/2456874335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da019d6e0 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 0x7f3da019d000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800be20 tx=0x7f3d9800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.634+0000 7f3d967fc640 1 -- 172.21.15.52:0/2456874335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98019070 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.635+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da019d9d0 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.635+0000 7f3d967fc640 1 -- 172.21.15.52:0/2456874335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d98014920 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.635+0000 7f3d967fc640 1 -- 172.21.15.52:0/2456874335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98012880 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.635+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01a52b0 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.637+0000 7f3d967fc640 1 -- 172.21.15.52:0/2456874335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3d9801c070 con 0x7f3da01082a0 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 Processor -- start 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 -- start start 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3d967fc640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 0x7f3d8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b85140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b87a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558f26ae02e0 con 0x558f26b7a4a0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558f26a87ce0 con 0x558f26b85680 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.638+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558f26adc2a0 con 0x558f26b7adc0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3d967fc640 1 -- 172.21.15.52:0/2456874335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3d980cf210 con 0x7f3da01082a0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 0x7f3d8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58340/0 (socket says 172.21.15.52:58340) 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 -- 172.21.15.52:0/2628855062 learned_addr learned my addr 172.21.15.52:0/2628855062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b85140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b87a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 -- 172.21.15.52:0/2628855062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 msgr2=0x558f26b85140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b85140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 -- 172.21.15.52:0/2628855062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 msgr2=0x558f26b87a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b87a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 -- 172.21.15.52:0/2628855062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f26a6c440 con 0x558f26b7a4a0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da557b640 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00ac20 tx=0x7f3d9c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5adc920f2528da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 0x7f3d8c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3d90000c00 tx=0x7f3d90031630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.639+0000 7f3d8b7fe640 1 -- 172.21.15.52:0/2628855062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c01d070 con 0x558f26b7a4a0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3d8b7fe640 1 -- 172.21.15.52:0/2628855062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9c018b20 con 0x558f26b7a4a0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3d8b7fe640 1 -- 172.21.15.52:0/2628855062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c010aa0 con 0x558f26b7a4a0 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 -- 172.21.15.52:0/2628855062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 msgr2=0x558f26b7a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00ac20 tx=0x7f3d9c00f790 comp rx=0 tx=0).stop 2024-09-19T09:21:42.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 -- 172.21.15.52:0/2628855062 shutdown_connections 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b87a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b85140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/2628855062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b7a880 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 -- 172.21.15.52:0/2628855062 >> 172.21.15.52:0/2628855062 conn(0x558f26b76a30 msgr2=0x558f26b76e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 -- 172.21.15.52:0/2628855062 shutdown_connections 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.640+0000 7f3da9bb8740 1 -- 172.21.15.52:0/2628855062 wait complete. 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 -- start start 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 Processor -- start 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b84f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b82710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558f26b88250 con 0x558f26b7a4a0 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558f26a9b050 con 0x558f26b85680 2024-09-19T09:21:42.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558f26b883d0 con 0x558f26b7adc0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.641+0000 7f3da9bb8740 10 client.0 _ll_register_callbacks cb 0x558f26adb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b821d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:46618/0 (socket says 172.21.15.52:46618) 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da4d7a640 1 -- 172.21.15.52:0/1749974787 learned_addr learned my addr 172.21.15.52:0/1749974787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b82710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b84f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 -- 172.21.15.52:0/1749974787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 msgr2=0x558f26b821d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b821d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 -- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 msgr2=0x558f26b82710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b82710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 -- 172.21.15.52:0/1749974787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f268513c0 con 0x558f26b7a4a0 2024-09-19T09:21:42.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b82710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3da557b640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b84f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c010680 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d15bf48e947659 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.642+0000 7f3d88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c01d050 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3d9c0107e0 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9c018b20 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d9c010430 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 10 client.15387 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558f26b93b70 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9c018b20 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d9c022b50 con 0x558f26b7a4a0 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 10 client.15387 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:42.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 20 client.15387 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26b94fd0 0x558f26b973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 4 client.15387 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.643+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f26aed850 con 0x558f26b94fd0 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.644+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26b94fd0 0x558f26b973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.644+0000 7f3d88ff9640 10 client.15387 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.644+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26b94fd0 0x558f26b973c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f35f599824b383 server_cookie=56cef01f7cb2e73f in_seq=0 out_seq=0 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1749974787 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f26aed850 con 0x558f26b94fd0 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3d88ff9640 10 client.15387 handle_command_reply: tid=0 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 client.15387 shutdown 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 msgr2=0x558f26b84f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b84f20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c010680 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 shutdown_connections 2024-09-19T09:21:42.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26b94fd0 0x558f26b973c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26b82710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7adc0 0x558f26b821d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3d88ff9640 0 client.15387 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1749974787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b84f20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 >> 172.21.15.52:0/1749974787 conn(0x558f26b76a30 msgr2=0x558f26b7c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 shutdown_connections 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.645+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1749974787 wait complete. 2024-09-19T09:21:42.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.646+0000 7f3da9bb8740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T09:21:42.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.664+0000 7f3da9bb8740 1 Processor -- start 2024-09-19T09:21:42.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.664+0000 7f3da9bb8740 1 -- start start 2024-09-19T09:21:42.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b7adc0 0x558f26b9c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 0x558f26b9cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01b0180 con 0x558f26b7a4a0 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ada50 con 0x558f26b7adc0 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da9bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ab8a0 con 0x558f26b85680 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58346/0 (socket says 172.21.15.52:58346) 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 -- 172.21.15.52:0/4169233121 learned_addr learned my addr 172.21.15.52:0/4169233121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 0x558f26b9cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b7adc0 0x558f26b9c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 -- 172.21.15.52:0/4169233121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 msgr2=0x558f26b9cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 0x558f26b9cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 -- 172.21.15.52:0/4169233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b7adc0 msgr2=0x558f26b9c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b7adc0 0x558f26b9c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 -- 172.21.15.52:0/4169233121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f26b85290 con 0x558f26b7a4a0 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 0x558f26b9cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.665+0000 7f3da557b640 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c023040 tx=0x7f3d9c00a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbecc7d31cb61da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.666+0000 7f3d8affd640 1 -- 172.21.15.52:0/4169233121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c01d040 con 0x558f26b7a4a0 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.666+0000 7f3d8affd640 1 -- 172.21.15.52:0/4169233121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9c01e040 con 0x558f26b7a4a0 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.666+0000 7f3d8affd640 1 -- 172.21.15.52:0/4169233121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c005040 con 0x558f26b7a4a0 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- 172.21.15.52:0/4169233121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 msgr2=0x558f26b914b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c023040 tx=0x7f3d9c00a6b0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- 172.21.15.52:0/4169233121 shutdown_connections 2024-09-19T09:21:42.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b85680 0x558f26b9cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b7adc0 0x558f26b9c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/4169233121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7a4a0 0x558f26b914b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- 172.21.15.52:0/4169233121 >> 172.21.15.52:0/4169233121 conn(0x558f26b76a30 msgr2=0x558f26b812c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- 172.21.15.52:0/4169233121 shutdown_connections 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- 172.21.15.52:0/4169233121 wait complete. 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 -- start start 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.667+0000 7f3da9bb8740 1 Processor -- start 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7a4a0 0x558f26b8a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26bfd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da4d7a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58354/0 (socket says 172.21.15.52:58354) 2024-09-19T09:21:42.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da4d7a640 1 -- 172.21.15.52:0/1309371887 learned_addr learned my addr 172.21.15.52:0/1309371887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01abf10 con 0x558f26b7adc0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ad380 con 0x558f26b85680 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01ac5e0 con 0x558f26b7a4a0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.668+0000 7f3da9bb8740 10 client.0 _ll_register_callbacks cb 0x7f3d9c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da5d7c640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26bfd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da557b640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7a4a0 0x558f26b8a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 -- 172.21.15.52:0/1309371887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7a4a0 msgr2=0x558f26b8a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7a4a0 0x558f26b8a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 -- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 msgr2=0x558f26bfd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26bfd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f26bfdf00 con 0x558f26b7adc0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da4d7a640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006010 tx=0x7f3d9002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8dc662b7827f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:42.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3d88ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90058020 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3d90054340 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.669+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9c01e040 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d90063050 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 10 client.15393 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558f26bff170 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d9c01e040 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d9004c4e0 con 0x558f26b7adc0 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 10 client.15393 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 10 client.15393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 20 client.15393 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.670+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26bff8e0 0x558f26c01cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:42.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.671+0000 7f3da9bb8740 4 client.15393 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.671+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f26ae7d60 con 0x558f26bff8e0 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.671+0000 7f3da557b640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26bff8e0 0x558f26c01cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.671+0000 7f3da557b640 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26bff8e0 0x558f26c01cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2778bbdfb10a58e4 server_cookie=c58a2974cd29f44a in_seq=0 out_seq=0 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.671+0000 7f3d88ff9640 10 client.15393 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3d88ff9640 1 -- 172.21.15.52:0/1309371887 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558f26ae7d60 con 0x558f26bff8e0 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3d88ff9640 10 client.15393 handle_command_reply: tid=0 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 client.15393 shutdown 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 msgr2=0x558f26b8af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006010 tx=0x7f3d9002a420 comp rx=0 tx=0).stop 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 shutdown_connections 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558f26bff8e0 0x558f26c01cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558f26b85680 0x558f26bfd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558f26b7adc0 0x558f26b8af00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3d88ff9640 0 client.15393 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 --2- 172.21.15.52:0/1309371887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558f26b7a4a0 0x558f26b8a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 >> 172.21.15.52:0/1309371887 conn(0x558f26b76a30 msgr2=0x558f26b75350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 shutdown_connections 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.672+0000 7f3da9bb8740 1 -- 172.21.15.52:0/1309371887 wait complete. 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.673+0000 7f3da9bb8740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:21:42.680 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.673+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 msgr2=0x7f3d8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.673+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 0x7f3d8c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3d90000c00 tx=0x7f3d90031630 comp rx=0 tx=0).stop 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.673+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 msgr2=0x7f3da019d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.673+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 0x7f3da019d000 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800be20 tx=0x7f3d9800bf10 comp rx=0 tx=0).stop 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 shutdown_connections 2024-09-19T09:21:42.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da01082a0 0x7f3da019d000 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d8c0a3240 0x7f3d8c0a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da01036e0 0x7f3da0198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 --2- 172.21.15.52:0/2456874335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da0102d30 0x7f3da0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 >> 172.21.15.52:0/2456874335 conn(0x7f3da00fc7d0 msgr2=0x7f3da0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 shutdown_connections 2024-09-19T09:21:42.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:42.674+0000 7f3da77df640 1 -- 172.21.15.52:0/2456874335 wait complete. 2024-09-19T09:21:43.237 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:42 smithi052 ceph-mon[30947]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:43.244 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:42 smithi169 ceph-mon[35454]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:43.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:42 smithi086 ceph-mon[34813]: pgmap v346: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:43.437 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:21:43.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:43.503 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:44.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 -- 172.21.15.52:0/2449205608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 msgr2=0x7fdfc81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:44.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 --2- 172.21.15.52:0/2449205608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc81029b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009900 tx=0x7fdfb802a480 comp rx=0 tx=0).stop 2024-09-19T09:21:44.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 -- 172.21.15.52:0/2449205608 shutdown_connections 2024-09-19T09:21:44.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 --2- 172.21.15.52:0/2449205608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8102ef0 0x7fdfc810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 --2- 172.21.15.52:0/2449205608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc81029b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 --2- 172.21.15.52:0/2449205608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8100e20 0x7fdfc8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 -- 172.21.15.52:0/2449205608 >> 172.21.15.52:0/2449205608 conn(0x7fdfc80fc7d0 msgr2=0x7fdfc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 -- 172.21.15.52:0/2449205608 shutdown_connections 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.044+0000 7fdfcf716640 1 -- 172.21.15.52:0/2449205608 wait complete. 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 Processor -- start 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 -- start start 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8100e20 0x7fdfc80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8102ef0 0x7fdfc80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8110f80 con 0x7fdfc8102570 2024-09-19T09:21:44.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8110e00 con 0x7fdfc8102ef0 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcf716640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8111100 con 0x7fdfc8100e20 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58380/0 (socket says 172.21.15.52:58380) 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 -- 172.21.15.52:0/570124686 learned_addr learned my addr 172.21.15.52:0/570124686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcdcb3640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8102ef0 0x7fdfc80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcd4b2640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8100e20 0x7fdfc80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 -- 172.21.15.52:0/570124686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8100e20 msgr2=0x7fdfc80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8100e20 0x7fdfc80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.045+0000 7fdfcccb1640 1 -- 172.21.15.52:0/570124686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8102ef0 msgr2=0x7fdfc80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfcccb1640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8102ef0 0x7fdfc80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfcccb1640 1 -- 172.21.15.52:0/570124686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc81a69c0 con 0x7fdfc8102570 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfcccb1640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8006010 tx=0x7fdfb8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:44.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb803f070 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb8031c30 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81a6c50 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8035030 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.046+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc81a7180 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.047+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8101200 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.049+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdfb8042070 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.049+0000 7fdfbe7fc640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 0x7fdfb40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.049+0000 7fdfcd4b2640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 0x7fdfb40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.049+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdfb80f04d0 con 0x7fdfc8102570 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.050+0000 7fdfcd4b2640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 0x7fdfb40a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4005fd0 tx=0x7fdfc4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.056+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfb80bd170 con 0x7fdfc8102570 2024-09-19T09:21:44.129 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:44.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.310+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc80fe1b0 con 0x7fdfc8102570 2024-09-19T09:21:44.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.311+0000 7fdfbe7fc640 1 -- 172.21.15.52:0/570124686 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fdfc80fe1b0 con 0x7fdfc8102570 2024-09-19T09:21:44.312 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:44.312 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:44.312 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 msgr2=0x7fdfb40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 0x7fdfb40a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4005fd0 tx=0x7fdfc4009500 comp rx=0 tx=0).stop 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 msgr2=0x7fdfc80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8006010 tx=0x7fdfb8003c10 comp rx=0 tx=0).stop 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 shutdown_connections 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdfc8102ef0 0x7fdfc80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdfc8102570 0x7fdfc80fd1c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdfb40a32c0 0x7fdfb40a5780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 --2- 172.21.15.52:0/570124686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfc8100e20 0x7fdfc80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:44.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.313+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 >> 172.21.15.52:0/570124686 conn(0x7fdfc80fc7d0 msgr2=0x7fdfc806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:44.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.314+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 shutdown_connections 2024-09-19T09:21:44.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:44.314+0000 7fdfcf716640 1 -- 172.21.15.52:0/570124686 wait complete. 2024-09-19T09:21:45.052 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:21:45.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:21:45.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:44 smithi086 ceph-mon[34813]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:45.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:44 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/570124686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:45.283 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:44 smithi052 ceph-mon[30947]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:45.283 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:44 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/570124686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 -- 172.21.15.52:0/2907224247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc102ac0 msgr2=0x7f50fc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 --2- 172.21.15.52:0/2907224247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc102ac0 0x7f50fc1000b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009900 tx=0x7f50ec02a480 comp rx=0 tx=0).stop 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 -- 172.21.15.52:0/2907224247 shutdown_connections 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 --2- 172.21.15.52:0/2907224247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc100c10 0x7f50fc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 --2- 172.21.15.52:0/2907224247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 0x7f50fc1005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 --2- 172.21.15.52:0/2907224247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc102ac0 0x7f50fc1000b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.282+0000 7f51009f8640 1 -- 172.21.15.52:0/2907224247 >> 172.21.15.52:0/2907224247 conn(0x7f50fc077210 msgr2=0x7f50fc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.283+0000 7f51009f8640 1 -- 172.21.15.52:0/2907224247 shutdown_connections 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.283+0000 7f51009f8640 1 -- 172.21.15.52:0/2907224247 wait complete. 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.283+0000 7f51009f8640 1 Processor -- start 2024-09-19T09:21:45.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 -- start start 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 0x7f50fc1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 0x7f50fc19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc1141a0 con 0x7f50fc100c10 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc114020 con 0x7f50fc102ea0 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f51009f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc114320 con 0x7f50fc102ac0 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58384/0 (socket says 172.21.15.52:58384) 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 -- 172.21.15.52:0/3394810646 learned_addr learned my addr 172.21.15.52:0/3394810646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fad9d640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 0x7f50fc19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50f9d9b640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 0x7f50fc1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 -- 172.21.15.52:0/3394810646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 msgr2=0x7f50fc1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 0x7f50fc1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 -- 172.21.15.52:0/3394810646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 msgr2=0x7f50fc19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 0x7f50fc19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.284+0000 7f50fa59c640 1 -- 172.21.15.52:0/3394810646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc19ef90 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f50f9d9b640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 0x7f50fc1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f50fa59c640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f50ec004770 tx=0x7f50ec003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec03f070 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc19f220 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50ec031ca0 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec035030 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.285+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc1ab570 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.286+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc1000b0 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.288+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f50ec042070 con 0x7f50fc100c10 2024-09-19T09:21:45.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.288+0000 7f50eb7fe640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 0x7f50e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.289+0000 7f50f9d9b640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 0x7f50e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.289+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50ec0f0010 con 0x7f50fc100c10 2024-09-19T09:21:45.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.289+0000 7f50f9d9b640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 0x7f50e40a5780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ff9e0 tx=0x7f50f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.297+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50ec0bccb0 con 0x7f50fc100c10 2024-09-19T09:21:45.396 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:44 smithi169 ceph-mon[35454]: pgmap v347: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:21:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:44 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/570124686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:45.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.555+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50fc19fd90 con 0x7f50fc100c10 2024-09-19T09:21:45.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.556+0000 7f50eb7fe640 1 -- 172.21.15.52:0/3394810646 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f50ec0bc5b0 con 0x7f50fc100c10 2024-09-19T09:21:45.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:45.557 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:45.558 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 msgr2=0x7f50e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 0x7f50e40a5780 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ff9e0 tx=0x7f50f0005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:45.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 msgr2=0x7f50fc1a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f50ec004770 tx=0x7f50ec003c10 comp rx=0 tx=0).stop 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 shutdown_connections 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50fc102ea0 0x7f50fc19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50e40a32c0 0x7f50e40a5780 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50fc102ac0 0x7f50fc1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 --2- 172.21.15.52:0/3394810646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50fc100c10 0x7f50fc1a46a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 >> 172.21.15.52:0/3394810646 conn(0x7f50fc077210 msgr2=0x7f50fc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 shutdown_connections 2024-09-19T09:21:45.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:45.559+0000 7f51009f8640 1 -- 172.21.15.52:0/3394810646 wait complete. 2024-09-19T09:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 -- 172.21.15.52:0/4107703547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102d90 msgr2=0x7efcac103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 --2- 172.21.15.52:0/4107703547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102d90 0x7efcac103170 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009930 tx=0x7efc9c02a420 comp rx=0 tx=0).stop 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 -- 172.21.15.52:0/4107703547 shutdown_connections 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 --2- 172.21.15.52:0/4107703547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac108290 0x7efcac10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 --2- 172.21.15.52:0/4107703547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac103740 0x7efcac107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 --2- 172.21.15.52:0/4107703547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102d90 0x7efcac103170 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 -- 172.21.15.52:0/4107703547 >> 172.21.15.52:0/4107703547 conn(0x7efcac0fc7d0 msgr2=0x7efcac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 -- 172.21.15.52:0/4107703547 shutdown_connections 2024-09-19T09:21:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.092+0000 7efcb1f41640 1 -- 172.21.15.52:0/4107703547 wait complete. 2024-09-19T09:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.093+0000 7efcb1f41640 1 Processor -- start 2024-09-19T09:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.093+0000 7efcb1f41640 1 -- start start 2024-09-19T09:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 0x7efcac198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac108290 0x7efcac19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcac112090 con 0x7efcac103740 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcac111f10 con 0x7efcac108290 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcb1f41640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcac112210 con 0x7efcac102d90 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58394/0 (socket says 172.21.15.52:58394) 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 -- 172.21.15.52:0/685225121 learned_addr learned my addr 172.21.15.52:0/685225121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcab7fe640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 0x7efcac198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcabfff640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac108290 0x7efcac19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 -- 172.21.15.52:0/685225121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 msgr2=0x7efcac198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 0x7efcac198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 -- 172.21.15.52:0/685225121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac108290 msgr2=0x7efcac19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac108290 0x7efcac19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcaaffd640 1 -- 172.21.15.52:0/685225121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac19d4d0 con 0x7efcac103740 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.094+0000 7efcab7fe640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 0x7efcac198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efcaaffd640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efca000c970 tx=0x7efca000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efca8ff9640 1 -- 172.21.15.52:0/685225121 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0014070 con 0x7efcac103740 2024-09-19T09:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efca8ff9640 1 -- 172.21.15.52:0/685225121 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca0004440 con 0x7efcac103740 2024-09-19T09:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efca8ff9640 1 -- 172.21.15.52:0/685225121 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca000f450 con 0x7efcac103740 2024-09-19T09:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac19d7c0 con 0x7efcac103740 2024-09-19T09:21:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.095+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac100920 con 0x7efcac103740 2024-09-19T09:21:46.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.097+0000 7efca8ff9640 1 -- 172.21.15.52:0/685225121 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efca0017070 con 0x7efcac103740 2024-09-19T09:21:46.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 Processor -- start 2024-09-19T09:21:46.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 -- start start 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 0x55e6b4ae5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e6b4a402a0 con 0x55e6b4adb080 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6b49e7b10 con 0x55e6b4ada760 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcb431a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e6b4a3c260 con 0x55e6b4ae5940 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcabfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcabfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:52472/0 (socket says 172.21.15.52:52472) 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcaaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.098+0000 7efcabfff640 1 -- 172.21.15.52:0/3657739116 learned_addr learned my addr 172.21.15.52:0/3657739116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:46.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efca8ff9640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 0x7efc940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcab7fe640 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 0x55e6b4ae5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 -- 172.21.15.52:0/3657739116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 msgr2=0x55e6b4ae7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 -- 172.21.15.52:0/3657739116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 msgr2=0x55e6b4ae5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 0x55e6b4ae5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 -- 172.21.15.52:0/3657739116 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b47b1b90 con 0x55e6b4ada760 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcab7fe640 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 0x55e6b4ae5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 0x7efc940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efca8ff9640 1 -- 172.21.15.52:0/685225121 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efca00cf7d0 con 0x7efcac103740 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efcabfff640 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca4010440 tx=0x7efca4010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46e745f2d7e0d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efc91ffb640 1 -- 172.21.15.52:0/3657739116 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4022070 con 0x55e6b4ada760 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efc91ffb640 1 -- 172.21.15.52:0/3657739116 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca401c390 con 0x55e6b4ada760 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.099+0000 7efc91ffb640 1 -- 172.21.15.52:0/3657739116 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40255e0 con 0x55e6b4ada760 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 -- 172.21.15.52:0/3657739116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 msgr2=0x55e6b4adab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcabfff640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 0x7efc940a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efca401f000 tx=0x7efca401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efca4010440 tx=0x7efca4010900 comp rx=0 tx=0).stop 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 -- 172.21.15.52:0/3657739116 shutdown_connections 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4adb080 0x55e6b4ae5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 --2- 172.21.15.52:0/3657739116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ada760 0x55e6b4adab40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 -- 172.21.15.52:0/3657739116 >> 172.21.15.52:0/3657739116 conn(0x55e6b4ad6cf0 msgr2=0x55e6b4ad70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 -- 172.21.15.52:0/3657739116 shutdown_connections 2024-09-19T09:21:46.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.100+0000 7efcb431a740 1 -- 172.21.15.52:0/3657739116 wait complete. 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 -- start start 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 Processor -- start 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e6b4ae8510 con 0x55e6b4ada760 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6b49c86e0 con 0x55e6b4adb080 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e6b4ae8690 con 0x55e6b4ae5940 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcb431a740 10 client.0 _ll_register_callbacks cb 0x55e6b49eca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58412/0 (socket says 172.21.15.52:58412) 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.101+0000 7efcab7fe640 1 -- 172.21.15.52:0/2637399258 learned_addr learned my addr 172.21.15.52:0/2637399258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcabfff640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 -- 172.21.15.52:0/2637399258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 msgr2=0x55e6b4ae32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 -- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 msgr2=0x55e6b4ae2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 -- 172.21.15.52:0/2637399258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b4af1a00 con 0x55e6b4ada760 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcab7fe640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009930 tx=0x7efc9c0319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72399043f9783d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efc8affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c035030 con 0x55e6b4ada760 2024-09-19T09:21:46.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efc9c004460 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.102+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efca401c390 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc9c048030 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 10 client.15414 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6b4af4300 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca401c390 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc9c0035f0 con 0x55e6b4ada760 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 10 client.15414 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 10 client.15414 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 20 client.15414 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4af5810 0x55e6b4af7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 4 client.15414 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:46.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b4a4d9d0 con 0x55e6b4af5810 2024-09-19T09:21:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.103+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4af5810 0x55e6b4af7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.104+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4af5810 0x55e6b4af7c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad407e2195325916 server_cookie=91185f5ce9da8842 in_seq=0 out_seq=0 2024-09-19T09:21:46.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.104+0000 7efc8affd640 10 client.15414 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.104+0000 7efc8affd640 1 -- 172.21.15.52:0/2637399258 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6b4a4d9d0 con 0x55e6b4af5810 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.104+0000 7efc8affd640 10 client.15414 handle_command_reply: tid=0 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.104+0000 7efcb431a740 1 client.15414 shutdown 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 msgr2=0x55e6b4ae2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009930 tx=0x7efc9c0319a0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 shutdown_connections 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4af5810 0x55e6b4af7c80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 --2- 172.21.15.52:0/2637399258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 >> 172.21.15.52:0/2637399258 conn(0x55e6b4ad6cf0 msgr2=0x55e6b4ad5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efc8affd640 0 client.15414 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 shutdown_connections 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 1 -- 172.21.15.52:0/2637399258 wait complete. 2024-09-19T09:21:46.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.105+0000 7efcb431a740 20 client.15414 trim_cache size 0 max 16384 2024-09-19T09:21:46.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 Processor -- start 2024-09-19T09:21:46.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 -- start start 2024-09-19T09:21:46.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4adb080 0x55e6b4adc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ae5940 0x55e6b4afd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1b2280 con 0x55e6b4ada760 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1afb50 con 0x55e6b4ae5940 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcb431a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1ad9a0 con 0x55e6b4adb080 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58428/0 (socket says 172.21.15.52:58428) 2024-09-19T09:21:46.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 -- 172.21.15.52:0/3534879168 learned_addr learned my addr 172.21.15.52:0/3534879168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:46.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcabfff640 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ae5940 0x55e6b4afd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcaaffd640 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4adb080 0x55e6b4adc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 -- 172.21.15.52:0/3534879168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4adb080 msgr2=0x55e6b4adc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4adb080 0x55e6b4adc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 -- 172.21.15.52:0/3534879168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ae5940 msgr2=0x55e6b4afd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ae5940 0x55e6b4afd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.123+0000 7efcab7fe640 1 -- 172.21.15.52:0/3534879168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b4ad2260 con 0x55e6b4ada760 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.124+0000 7efcab7fe640 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02a940 tx=0x7efc9c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cb3148b0f5038c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.124+0000 7efc917fa640 1 -- 172.21.15.52:0/3534879168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c035070 con 0x55e6b4ada760 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.124+0000 7efc917fa640 1 -- 172.21.15.52:0/3534879168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc9c003c30 con 0x55e6b4ada760 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.124+0000 7efc917fa640 1 -- 172.21.15.52:0/3534879168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c004920 con 0x55e6b4ada760 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- 172.21.15.52:0/3534879168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 msgr2=0x55e6b4ae2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc9c02a940 tx=0x7efc9c02a420 comp rx=0 tx=0).stop 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- 172.21.15.52:0/3534879168 shutdown_connections 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4ae5940 0x55e6b4afd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4adb080 0x55e6b4adc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 --2- 172.21.15.52:0/3534879168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4ae2100 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- 172.21.15.52:0/3534879168 >> 172.21.15.52:0/3534879168 conn(0x55e6b4ad6cf0 msgr2=0x55e6b4adc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- 172.21.15.52:0/3534879168 shutdown_connections 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- 172.21.15.52:0/3534879168 wait complete. 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.125+0000 7efcb431a740 1 -- start start 2024-09-19T09:21:46.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 Processor -- start 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4aee030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1ae010 con 0x55e6b4ada760 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1af480 con 0x55e6b4adb080 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1ae6e0 con 0x55e6b4ae5940 2024-09-19T09:21:46.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcb431a740 10 client.0 _ll_register_callbacks cb 0x7efc9c0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4aee030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcaaffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcaaffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:52506/0 (socket says 172.21.15.52:52506) 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.126+0000 7efcaaffd640 1 -- 172.21.15.52:0/2937572381 learned_addr learned my addr 172.21.15.52:0/2937572381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcabfff640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 -- 172.21.15.52:0/2937572381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 msgr2=0x55e6b4ae98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 -- 172.21.15.52:0/2937572381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 msgr2=0x55e6b4aee030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4aee030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 -- 172.21.15.52:0/2937572381 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b4aea080 con 0x55e6b4adb080 2024-09-19T09:21:46.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcaaffd640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efca0098740 tx=0x7efca00045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a9edf093e0f14ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efc8affd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca009bd70 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc9c003c30 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.127+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efca00035f0 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efca00a0120 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 10 client.25118 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6b4b605c0 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc9c003c30 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efca00b2070 con 0x55e6b4adb080 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 10 client.25118 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 10 client.25118 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 20 client.25118 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4b60da0 0x55e6b4b631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 4 client.25118 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55e6b4a47d20 con 0x55e6b4b60da0 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.128+0000 7efcab7fe640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4b60da0 0x55e6b4b631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.129+0000 7efcab7fe640 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4b60da0 0x55e6b4b631c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=846bec1381028b83 server_cookie=b543884df44b2b8 in_seq=0 out_seq=0 2024-09-19T09:21:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.129+0000 7efc8affd640 10 client.25118 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efc8affd640 1 -- 172.21.15.52:0/2937572381 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e6b4a47d20 con 0x55e6b4b60da0 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efc8affd640 10 client.25118 handle_command_reply: tid=0 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 client.25118 shutdown 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 msgr2=0x55e6b4ae9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efca0098740 tx=0x7efca00045f0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 shutdown_connections 2024-09-19T09:21:46.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e6b4b60da0 0x55e6b4b631c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6b4ae5940 0x55e6b4ae98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6b4adb080 0x55e6b4ae9360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 --2- 172.21.15.52:0/2937572381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6b4ada760 0x55e6b4aee030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efc8affd640 0 client.25118 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 >> 172.21.15.52:0/2937572381 conn(0x55e6b4ad6cf0 msgr2=0x55e6b4adca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 shutdown_connections 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 1 -- 172.21.15.52:0/2937572381 wait complete. 2024-09-19T09:21:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.139+0000 7efcb431a740 20 client.25118 trim_cache size 0 max 16384 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 2, 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "13654521": { 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 2, 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:21:46.142 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 131.2, 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:21:46.143 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:46.144 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 msgr2=0x7efc940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 0x7efc940a5700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efca401f000 tx=0x7efca401d000 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 msgr2=0x7efcac198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efca000c970 tx=0x7efca000ce30 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 shutdown_connections 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac108290 0x7efcac19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac103740 0x7efcac198a60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc940a3240 0x7efc940a5700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 --2- 172.21.15.52:0/685225121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102d90 0x7efcac198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 >> 172.21.15.52:0/685225121 conn(0x7efcac0fc7d0 msgr2=0x7efcac106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 shutdown_connections 2024-09-19T09:21:46.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:46.140+0000 7efcb1f41640 1 -- 172.21.15.52:0/685225121 wait complete. 2024-09-19T09:21:46.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:45 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3394810646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:46.288 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:45 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3394810646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:46.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:45 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3394810646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:46.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:21:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 -- 172.21.15.52:0/3100277664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8104f50 msgr2=0x7f86a8107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/3100277664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8104f50 0x7f86a8107340 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f869c009900 tx=0x7f869c02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 -- 172.21.15.52:0/3100277664 shutdown_connections 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/3100277664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8107880 0x7f86a8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/3100277664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8104f50 0x7f86a8107340 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/3100277664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8102620 0x7f86a8104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 -- 172.21.15.52:0/3100277664 >> 172.21.15.52:0/3100277664 conn(0x7f86a80fc1e0 msgr2=0x7f86a80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 -- 172.21.15.52:0/3100277664 shutdown_connections 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.036+0000 7f86ae2eb640 1 -- 172.21.15.52:0/3100277664 wait complete. 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 Processor -- start 2024-09-19T09:21:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 -- start start 2024-09-19T09:21:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8104f50 0x7f86a81005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8107880 0x7f86a8100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86a810d840 con 0x7f86a8102620 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86a810d6c0 con 0x7f86a8107880 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.037+0000 7f86ae2eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86a810d9c0 con 0x7f86a8104f50 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58466/0 (socket says 172.21.15.52:58466) 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 -- 172.21.15.52:0/238585029 learned_addr learned my addr 172.21.15.52:0/238585029 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a77fe640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8104f50 0x7f86a81005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86ac888640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8107880 0x7f86a8100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 -- 172.21.15.52:0/238585029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8104f50 msgr2=0x7f86a81005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8104f50 0x7f86a81005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 -- 172.21.15.52:0/238585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8107880 msgr2=0x7f86a8100b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8107880 0x7f86a8100b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 -- 172.21.15.52:0/238585029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a81013a0 con 0x7f86a8102620 2024-09-19T09:21:47.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a7fff640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f869800d950 tx=0x7f869800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a57fa640 1 -- 172.21.15.52:0/238585029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698017070 con 0x7f86a8102620 2024-09-19T09:21:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a57fa640 1 -- 172.21.15.52:0/238585029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8698009c30 con 0x7f86a8102620 2024-09-19T09:21:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86a57fa640 1 -- 172.21.15.52:0/238585029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869800f6b0 con 0x7f86a8102620 2024-09-19T09:21:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a81a1f90 con 0x7f86a8102620 2024-09-19T09:21:47.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.038+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a81a2390 con 0x7f86a8102620 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86a57fa640 1 -- 172.21.15.52:0/238585029 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f86980109d0 con 0x7f86a8102620 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 Processor -- start 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 -- start start 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d47da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 0x55c766d4a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c766ca62f0 con 0x55c766d429a0 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c766c4e270 con 0x55c766d432e0 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.041+0000 7f86b108a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c766ca22b0 con 0x55c766d48370 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58480/0 (socket says 172.21.15.52:58480) 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 -- 172.21.15.52:0/3430419278 learned_addr learned my addr 172.21.15.52:0/3430419278 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86a7fff640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d47da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 0x55c766d4a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 -- 172.21.15.52:0/3430419278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 msgr2=0x55c766d4a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 0x55c766d4a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 -- 172.21.15.52:0/3430419278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 msgr2=0x55c766d47da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d47da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 -- 172.21.15.52:0/3430419278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c766c4d340 con 0x55c766d429a0 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 0x55c766d4a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86ac888640 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009f90 tx=0x7f86a00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05bf1c9675070c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86a57fa640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 0x7f86900a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f868e7fc640 1 -- 172.21.15.52:0/3430419278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004d20 con 0x55c766d429a0 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f868e7fc640 1 -- 172.21.15.52:0/3430419278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a0004050 con 0x55c766d429a0 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f868e7fc640 1 -- 172.21.15.52:0/3430419278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0005260 con 0x55c766d429a0 2024-09-19T09:21:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.042+0000 7f86a7fff640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 0x7f86900a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86a57fa640 1 -- 172.21.15.52:0/238585029 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86980cf510 con 0x7f86a8102620 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 -- 172.21.15.52:0/3430419278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 msgr2=0x55c766d42da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009f90 tx=0x7f86a00118d0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86a7fff640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 0x7f86900a57b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86980a4190 tx=0x7f86980d2f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 -- 172.21.15.52:0/3430419278 shutdown_connections 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d48370 0x55c766d4a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d47da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 --2- 172.21.15.52:0/3430419278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d429a0 0x55c766d42da0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 -- 172.21.15.52:0/3430419278 >> 172.21.15.52:0/3430419278 conn(0x55c766d3e010 msgr2=0x55c766d3e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 -- 172.21.15.52:0/3430419278 shutdown_connections 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.043+0000 7f86b108a740 1 -- 172.21.15.52:0/3430419278 wait complete. 2024-09-19T09:21:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 -- start start 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 Processor -- start 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d4cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 0x55c766d54140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c766d4b340 con 0x55c766d432e0 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c766c2f290 con 0x55c766d48370 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c766d4b4c0 con 0x55c766d429a0 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86b108a740 10 client.0 _ll_register_callbacks cb 0x55c766c60140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86a77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58488/0 (socket says 172.21.15.52:58488) 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.044+0000 7f86a77fe640 1 -- 172.21.15.52:0/1085734912 learned_addr learned my addr 172.21.15.52:0/1085734912 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86ac888640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d4cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86ac888640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 0x55c766d54140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 -- 172.21.15.52:0/1085734912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 msgr2=0x55c766d4cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d4cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 -- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 msgr2=0x55c766d54140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 0x55c766d54140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 -- 172.21.15.52:0/1085734912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7669b9210 con 0x55c766d432e0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86ac888640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 0x55c766d54140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86a77fe640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f869c009900 tx=0x7f869c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1895b927ba492e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86877fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869c035040 con 0x55c766d432e0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f869c005510 con 0x55c766d432e0 2024-09-19T09:21:47.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a0004050 con 0x55c766d432e0 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f869c04a030 con 0x55c766d432e0 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86b108a740 10 client.15432 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c766a85620 con 0x55c766d432e0 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.045+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a0004050 con 0x55c766d432e0 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f869c031b40 con 0x55c766d432e0 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 10 client.15432 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 10 client.15432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 20 client.15432 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766d58880 0x55c766d5ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 4 client.15432 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c766cb3a20 con 0x55c766d58880 2024-09-19T09:21:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.046+0000 7f86ac888640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766d58880 0x55c766d5ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86ac888640 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766d58880 0x55c766d5ac70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=671bc41b83627475 server_cookie=705b873f50ac525a in_seq=0 out_seq=0 2024-09-19T09:21:47.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86877fe640 10 client.15432 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86877fe640 1 -- 172.21.15.52:0/1085734912 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c766cb3a20 con 0x55c766d58880 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86877fe640 10 client.15432 handle_command_reply: tid=0 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 client.15432 shutdown 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 msgr2=0x55c766d4d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f869c009900 tx=0x7f869c004430 comp rx=0 tx=0).stop 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 shutdown_connections 2024-09-19T09:21:47.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766d58880 0x55c766d5ac70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d48370 0x55c766d54140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d432e0 0x55c766d4d100 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 --2- 172.21.15.52:0/1085734912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d4cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 >> 172.21.15.52:0/1085734912 conn(0x55c766d3e010 msgr2=0x55c766d3f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.047+0000 7f86877fe640 0 client.15432 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.048+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 shutdown_connections 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.048+0000 7f86b108a740 1 -- 172.21.15.52:0/1085734912 wait complete. 2024-09-19T09:21:47.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.048+0000 7f86b108a740 20 client.15432 trim_cache size 0 max 16384 2024-09-19T09:21:47.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 Processor -- start 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 -- start start 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d429a0 0x55c766d3ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 0x55c766d54100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81add40 con 0x55c766d48370 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81ab610 con 0x55c766d429a0 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86b108a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81a9460 con 0x55c766d432e0 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58500/0 (socket says 172.21.15.52:58500) 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.063+0000 7f86ac888640 1 -- 172.21.15.52:0/3149336566 learned_addr learned my addr 172.21.15.52:0/3149336566 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d429a0 0x55c766d3ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.065 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 0x55c766d54100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 -- 172.21.15.52:0/3149336566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 msgr2=0x55c766d54100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 0x55c766d54100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 -- 172.21.15.52:0/3149336566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d429a0 msgr2=0x55c766d3ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d429a0 0x55c766d3ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 -- 172.21.15.52:0/3149336566 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c766d437c0 con 0x55c766d48370 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 0x55c766d54100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f86ac888640 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86a00049d0 tx=0x7f86a00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78d53e820cd66a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f868dffb640 1 -- 172.21.15.52:0/3149336566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0009c10 con 0x55c766d48370 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f868dffb640 1 -- 172.21.15.52:0/3149336566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a0004530 con 0x55c766d48370 2024-09-19T09:21:47.066 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.064+0000 7f868dffb640 1 -- 172.21.15.52:0/3149336566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a000fbf0 con 0x55c766d48370 2024-09-19T09:21:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- 172.21.15.52:0/3149336566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 msgr2=0x55c766d3f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86a00049d0 tx=0x7f86a00118d0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- 172.21.15.52:0/3149336566 shutdown_connections 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d3f460 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d432e0 0x55c766d54100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 --2- 172.21.15.52:0/3149336566 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d429a0 0x55c766d3ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- 172.21.15.52:0/3149336566 >> 172.21.15.52:0/3149336566 conn(0x55c766d3e010 msgr2=0x55c766d4cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- 172.21.15.52:0/3149336566 shutdown_connections 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- 172.21.15.52:0/3149336566 wait complete. 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.065+0000 7f86b108a740 1 -- start start 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 Processor -- start 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d51920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81a9ad0 con 0x55c766d48370 2024-09-19T09:21:47.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81aaf40 con 0x55c766d432e0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81aa1a0 con 0x55c766d429a0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86b108a740 10 client.0 _ll_register_callbacks cb 0x7f869c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86ac888640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58510/0 (socket says 172.21.15.52:58510) 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86ac888640 1 -- 172.21.15.52:0/3405405833 learned_addr learned my addr 172.21.15.52:0/3405405833 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.066+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d51920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 -- 172.21.15.52:0/3405405833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 msgr2=0x55c766d513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 -- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 msgr2=0x55c766d51920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d51920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 -- 172.21.15.52:0/3405405833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c766d52f40 con 0x55c766d48370 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86ac888640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009270 tx=0x7f86a0003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225a7f79bd64ac28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:47.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a00046e0 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86a000f4e0 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a0004530 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f86a0009bf0 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86b108a740 10 client.15438 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c766d54250 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a0004530 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.067+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86a0019430 con 0x55c766d48370 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 10 client.15438 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 10 client.15438 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 20 client.15438 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:47.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766dc38f0 0x55c766dc5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 4 client.15438 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c766cadd70 con 0x55c766dc38f0 2024-09-19T09:21:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766dc38f0 0x55c766dc5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86a77fe640 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766dc38f0 0x55c766dc5d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f36533f3273d42 server_cookie=189def87ef3e090 in_seq=0 out_seq=0 2024-09-19T09:21:47.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.068+0000 7f86877fe640 10 client.15438 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86877fe640 1 -- 172.21.15.52:0/3405405833 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c766cadd70 con 0x55c766dc38f0 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86877fe640 10 client.15438 handle_command_reply: tid=0 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 client.15438 shutdown 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 msgr2=0x55c766d52930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009270 tx=0x7f86a0003a30 comp rx=0 tx=0).stop 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 shutdown_connections 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c766dc38f0 0x55c766dc5d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c766d48370 0x55c766d52930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86877fe640 0 client.15438 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c766d432e0 0x55c766d51920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.076 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 --2- 172.21.15.52:0/3405405833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c766d429a0 0x55c766d513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 >> 172.21.15.52:0/3405405833 conn(0x55c766d3e010 msgr2=0x55c766d3c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 shutdown_connections 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 1 -- 172.21.15.52:0/3405405833 wait complete. 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.075+0000 7f86b108a740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:21:47.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 msgr2=0x7f86900a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 0x7f86900a57b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86980a4190 tx=0x7f86980d2f50 comp rx=0 tx=0).stop 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 msgr2=0x7f86a8101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f869800d950 tx=0x7f869800de10 comp rx=0 tx=0).stop 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 shutdown_connections 2024-09-19T09:21:47.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86a8107880 0x7f86a8100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86900a32f0 0x7f86900a57b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86a8104f50 0x7f86a81005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 --2- 172.21.15.52:0/238585029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8102620 0x7f86a8101f90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 >> 172.21.15.52:0/238585029 conn(0x7f86a80fc1e0 msgr2=0x7f86a8102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 shutdown_connections 2024-09-19T09:21:47.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:21:47.076+0000 7f86ae2eb640 1 -- 172.21.15.52:0/238585029 wait complete. 2024-09-19T09:21:47.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:46 smithi086 ceph-mon[34813]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:47.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:46 smithi052 ceph-mon[30947]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:46 smithi169 ceph-mon[35454]: pgmap v348: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:21:48.301 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '13654521', quiesce took 6.0 seconds. Will release after: 5.199999999999999 2024-09-19T09:21:48.311 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:49.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:48 smithi086 ceph-mon[34813]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:21:49.310 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:48 smithi052 ceph-mon[30947]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:21:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:48 smithi169 ceph-mon[35454]: pgmap v349: 97 pgs: 97 active+clean; 657 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:21:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:50 smithi086 ceph-mon[34813]: pgmap v350: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T09:21:51.289 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:50 smithi052 ceph-mon[30947]: pgmap v350: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T09:21:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:50 smithi169 ceph-mon[35454]: pgmap v350: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 -- 172.21.15.52:0/1864480095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1082a0 msgr2=0x7f7e4c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 --2- 172.21.15.52:0/1864480095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c10ec40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009cd0 tx=0x7f7e4402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 -- 172.21.15.52:0/1864480095 shutdown_connections 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 --2- 172.21.15.52:0/1864480095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c10ec40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 --2- 172.21.15.52:0/1864480095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 --2- 172.21.15.52:0/1864480095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.388+0000 7f7e537af640 1 -- 172.21.15.52:0/1864480095 >> 172.21.15.52:0/1864480095 conn(0x7f7e4c0fc7d0 msgr2=0x7f7e4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.389+0000 7f7e537af640 1 -- 172.21.15.52:0/1864480095 shutdown_connections 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.389+0000 7f7e537af640 1 -- 172.21.15.52:0/1864480095 wait complete. 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.389+0000 7f7e537af640 1 Processor -- start 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.389+0000 7f7e537af640 1 -- start start 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1120a0 con 0x7f7e4c1036e0 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c111f20 con 0x7f7e4c1082a0 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e537af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c112220 con 0x7f7e4c102d30 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60794/0 (socket says 172.21.15.52:60794) 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 -- 172.21.15.52:0/3429622909 learned_addr learned my addr 172.21.15.52:0/3429622909 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e5154b640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 -- 172.21.15.52:0/3429622909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 msgr2=0x7f7e4c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 -- 172.21.15.52:0/3429622909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1082a0 msgr2=0x7f7e4c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e50d4a640 1 -- 172.21.15.52:0/3429622909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c1a6a30 con 0x7f7e4c1036e0 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.390+0000 7f7e5154b640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e9f0 tx=0x7f7e3c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e427fc640 1 -- 172.21.15.52:0/3429622909 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00ccc0 con 0x7f7e4c1036e0 2024-09-19T09:21:52.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c1a6d20 con 0x7f7e4c1036e0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e427fc640 1 -- 172.21.15.52:0/3429622909 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c010910 con 0x7f7e4c1036e0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e427fc640 1 -- 172.21.15.52:0/3429622909 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c018920 con 0x7f7e4c1036e0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.391+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c1a7250 con 0x7f7e4c1036e0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.394+0000 7f7e427fc640 1 -- 172.21.15.52:0/3429622909 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7e3c010ac0 con 0x7f7e4c1036e0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.394+0000 7f7e55b88740 1 Processor -- start 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 -- start start 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4a73512f0 con 0x55d4a73f6370 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4a72f8cf0 con 0x55d4a73ecb40 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e55b88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4a734d2b0 con 0x55d4a73eb5d0 2024-09-19T09:21:52.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e51d4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e51d4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50230/0 (socket says 172.21.15.52:50230) 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e51d4c640 1 -- 172.21.15.52:0/3596041143 learned_addr learned my addr 172.21.15.52:0/3596041143 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.395+0000 7f7e427fc640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 0x7f7e380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.396+0000 7f7e427fc640 1 -- 172.21.15.52:0/3429622909 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7e3c0cfc90 con 0x7f7e4c1036e0 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.396+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 0x7f7e380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.396+0000 7f7e51d4c640 1 -- 172.21.15.52:0/3596041143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 msgr2=0x55d4a73eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.396+0000 7f7e5154b640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.396+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 -- 172.21.15.52:0/3596041143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 msgr2=0x55d4a73f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 -- 172.21.15.52:0/3596041143 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a72dd3a0 con 0x55d4a73ecb40 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e5154b640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44031940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=983aa2c582408548 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 0x7f7e380a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e44047000 tx=0x7f7e4404a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e377fe640 1 -- 172.21.15.52:0/3596041143 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44004410 con 0x55d4a73ecb40 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e377fe640 1 -- 172.21.15.52:0/3596041143 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44036070 con 0x55d4a73ecb40 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.397+0000 7f7e377fe640 1 -- 172.21.15.52:0/3596041143 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4404a450 con 0x55d4a73ecb40 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- 172.21.15.52:0/3596041143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 msgr2=0x55d4a73eb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44031940 comp rx=0 tx=0).stop 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- 172.21.15.52:0/3596041143 shutdown_connections 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 --2- 172.21.15.52:0/3596041143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73eb090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- 172.21.15.52:0/3596041143 >> 172.21.15.52:0/3596041143 conn(0x55d4a73b4310 msgr2=0x55d4a73e7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- 172.21.15.52:0/3596041143 shutdown_connections 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- 172.21.15.52:0/3596041143 wait complete. 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.398+0000 7f7e55b88740 1 -- start start 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 Processor -- start 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4a73f8fb0 con 0x55d4a73f6370 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4a730c060 con 0x55d4a73ecb40 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4a73f9130 con 0x55d4a73eb5d0 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e50d4a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e5154b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e50d4a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50246/0 (socket says 172.21.15.52:50246) 2024-09-19T09:21:52.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e50d4a640 1 -- 172.21.15.52:0/941173317 learned_addr learned my addr 172.21.15.52:0/941173317 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.399+0000 7f7e55b88740 10 client.0 _ll_register_callbacks cb 0x55d4a705f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 -- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 msgr2=0x55d4a73f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 -- 172.21.15.52:0/941173317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 msgr2=0x55d4a73f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 -- 172.21.15.52:0/941173317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a70c23c0 con 0x55d4a73ecb40 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009750 tx=0x7f7e3c09ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153a82a593c4cbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0bc2b0 con 0x55d4a73ecb40 2024-09-19T09:21:52.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7e3c0cdbd0 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e44036070 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e3c0b5220 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e55b88740 10 client.25145 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.400+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4a7404970 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e3c0b5070 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e3c09b680 con 0x55d4a73ecb40 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 10 client.25145 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 10 client.25145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 20 client.25145 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7406340 0x55d4a7408750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 4 client.25145 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7e44036070 con 0x55d4a7406340 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.401+0000 7f7e5154b640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7406340 0x55d4a7408750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.402+0000 7f7e5154b640 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7406340 0x55d4a7408750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2e3e3a0d35fbfd server_cookie=c1fca44d5b1e3cba in_seq=0 out_seq=0 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.402+0000 7f7e34ff9640 10 client.25145 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.402+0000 7f7e34ff9640 1 -- 172.21.15.52:0/941173317 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f7e44036070 con 0x55d4a7406340 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.402+0000 7f7e34ff9640 10 client.25145 handle_command_reply: tid=0 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.402+0000 7f7e55b88740 1 client.25145 shutdown 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 msgr2=0x55d4a73f2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009750 tx=0x7f7e3c09ca70 comp rx=0 tx=0).stop 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 shutdown_connections 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7406340 0x55d4a7408750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73ecb40 0x55d4a73f2f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 --2- 172.21.15.52:0/941173317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73eb5d0 0x55d4a73f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 >> 172.21.15.52:0/941173317 conn(0x55d4a73b4310 msgr2=0x55d4a73ed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e34ff9640 0 client.25145 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 shutdown_connections 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 1 -- 172.21.15.52:0/941173317 wait complete. 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.403+0000 7f7e55b88740 20 client.25145 trim_cache size 0 max 16384 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 Processor -- start 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 -- start start 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 0x55d4a74022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1b2310 con 0x55d4a73f6370 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1afbe0 con 0x55d4a73eb5d0 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e55b88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ada30 con 0x55d4a73ecb40 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e51d4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e51d4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60812/0 (socket says 172.21.15.52:60812) 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.416+0000 7f7e51d4c640 1 -- 172.21.15.52:0/1979856447 learned_addr learned my addr 172.21.15.52:0/1979856447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e5154b640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 0x55d4a74022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 -- 172.21.15.52:0/1979856447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 msgr2=0x55d4a73ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 -- 172.21.15.52:0/1979856447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 msgr2=0x55d4a74022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 0x55d4a74022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 -- 172.21.15.52:0/1979856447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a73f6010 con 0x55d4a73f6370 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:52.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e5154b640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 0x55d4a74022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7951931bd1207b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.417+0000 7f7e36ffd640 1 -- 172.21.15.52:0/1979856447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44057030 con 0x55d4a73f6370 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e36ffd640 1 -- 172.21.15.52:0/1979856447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e44036040 con 0x55d4a73f6370 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e36ffd640 1 -- 172.21.15.52:0/1979856447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44030e10 con 0x55d4a73f6370 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 -- 172.21.15.52:0/1979856447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 msgr2=0x55d4a73ee660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009430 tx=0x7f7e44003f90 comp rx=0 tx=0).stop 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 -- 172.21.15.52:0/1979856447 shutdown_connections 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73f6370 0x55d4a73ee660 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 --2- 172.21.15.52:0/1979856447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73eb5d0 0x55d4a74022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.418+0000 7f7e55b88740 1 -- 172.21.15.52:0/1979856447 >> 172.21.15.52:0/1979856447 conn(0x55d4a73b4310 msgr2=0x55d4a73f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.419+0000 7f7e55b88740 1 -- 172.21.15.52:0/1979856447 shutdown_connections 2024-09-19T09:21:52.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.419+0000 7f7e55b88740 1 -- 172.21.15.52:0/1979856447 wait complete. 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.419+0000 7f7e55b88740 1 -- start start 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.419+0000 7f7e55b88740 1 Processor -- start 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e5154b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e5154b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60828/0 (socket says 172.21.15.52:60828) 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e5154b640 1 -- 172.21.15.52:0/2676004016 learned_addr learned my addr 172.21.15.52:0/2676004016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73f6370 0x55d4a73eff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ae0a0 con 0x55d4a73eb5d0 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1af510 con 0x55d4a73f6370 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c1ae770 con 0x55d4a73ecb40 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.420+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e51d4c640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73f6370 0x55d4a73eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 -- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 msgr2=0x55d4a73ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 -- 172.21.15.52:0/2676004016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73f6370 msgr2=0x55d4a73eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73f6370 0x55d4a73eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a73f04a0 con 0x55d4a73eb5d0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e55b88740 10 client.0 _ll_register_callbacks cb 0x7f7e3c0984d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e44036040 con 0x55d4a73eb5d0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e5154b640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005eb0 tx=0x7f7e48014cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c110939d4da493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e34ff9640 10 client.15453 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.421+0000 7f7e34ff9640 1 -- 172.21.15.52:0/2676004016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48014110 con 0x55d4a73eb5d0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e34ff9640 1 -- 172.21.15.52:0/2676004016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7e48004030 con 0x55d4a73eb5d0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e34ff9640 1 -- 172.21.15.52:0/2676004016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e48004270 con 0x55d4a73eb5d0 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 10 client.15453 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:52.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55d4a7470c30 con 0x55d4a73eb5d0 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e34ff9640 1 -- 172.21.15.52:0/2676004016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7e48011970 con 0x55d4a73eb5d0 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 10 client.15453 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 10 client.15453 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 20 client.15453 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7471220 0x55d4a74736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 4 client.15453 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4a735e860 con 0x55d4a7471220 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.422+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7471220 0x55d4a74736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e34ff9640 10 client.15453 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e50d4a640 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7471220 0x55d4a74736a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=624a5021707db99a server_cookie=f6c039e031326ba3 in_seq=0 out_seq=0 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e34ff9640 1 -- 172.21.15.52:0/2676004016 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4a735e860 con 0x55d4a7471220 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e34ff9640 10 client.15453 handle_command_reply: tid=0 2024-09-19T09:21:52.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 client.15453 shutdown 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 msgr2=0x55d4a73fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7e48005eb0 tx=0x7f7e48014cc0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 shutdown_connections 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4a7471220 0x55d4a74736a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4a73f6370 0x55d4a73eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e34ff9640 0 client.15453 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4a73ecb40 0x55d4a73ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 --2- 172.21.15.52:0/2676004016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4a73eb5d0 0x55d4a73fe930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.423+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 >> 172.21.15.52:0/2676004016 conn(0x55d4a73b4310 msgr2=0x55d4a73e63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 shutdown_connections 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e55b88740 1 -- 172.21.15.52:0/2676004016 wait complete. 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e55b88740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 msgr2=0x7f7e380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 0x7f7e380a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7e44047000 tx=0x7f7e4404a000 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 msgr2=0x7f7e4c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00e9f0 tx=0x7f7e3c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 shutdown_connections 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e4c1082a0 0x7f7e4c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7e4c1036e0 0x7f7e4c100ed0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7e380a3240 0x7f7e380a5700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 --2- 172.21.15.52:0/3429622909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e4c102d30 0x7f7e4c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.424+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 >> 172.21.15.52:0/3429622909 conn(0x7f7e4c0fc7d0 msgr2=0x7f7e4c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.425+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 shutdown_connections 2024-09-19T09:21:52.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:51.425+0000 7f7e537af640 1 -- 172.21.15.52:0/3429622909 wait complete. 2024-09-19T09:21:52.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:21:53.121 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:53.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:52 smithi052 ceph-mon[30947]: pgmap v351: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:21:53.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:52 smithi086 ceph-mon[34813]: pgmap v351: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:21:53.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:52 smithi169 ceph-mon[35454]: pgmap v351: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:21:53.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:53.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 -- 172.21.15.52:0/1321329446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c01027a0 msgr2=0x7f03c01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1321329446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c01027a0 0x7f03c01067f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009900 tx=0x7f03ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:21:53.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 -- 172.21.15.52:0/1321329446 shutdown_connections 2024-09-19T09:21:53.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1321329446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c0106f20 0x7f03c010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1321329446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c01027a0 0x7f03c01067f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.707+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1321329446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.708+0000 7f03c71a3640 1 -- 172.21.15.52:0/1321329446 >> 172.21.15.52:0/1321329446 conn(0x7f03c00fd8f0 msgr2=0x7f03c00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.708+0000 7f03c71a3640 1 -- 172.21.15.52:0/1321329446 shutdown_connections 2024-09-19T09:21:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.708+0000 7f03c71a3640 1 -- 172.21.15.52:0/1321329446 wait complete. 2024-09-19T09:21:53.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.709+0000 7f03c71a3640 1 Processor -- start 2024-09-19T09:21:53.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.709+0000 7f03c71a3640 1 -- start start 2024-09-19T09:21:53.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c01027a0 0x7f03c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0111f80 con 0x7f03c0106f20 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0111e00 con 0x7f03c0101df0 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c71a3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0112100 con 0x7f03c01027a0 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c5740640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50282/0 (socket says 172.21.15.52:50282) 2024-09-19T09:21:53.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1991579282 learned_addr learned my addr 172.21.15.52:0/1991579282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c5740640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60834/0 (socket says 172.21.15.52:60834) 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03bffff640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c01027a0 0x7f03c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1991579282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c01027a0 msgr2=0x7f03c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c01027a0 0x7f03c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 msgr2=0x7f03c0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.710+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1991579282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01a69c0 con 0x7f03c0101df0 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03c5740640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:53.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03b400e9f0 tx=0x7f03b400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03bdffb640 1 -- 172.21.15.52:0/1991579282 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b400cd80 con 0x7f03c0101df0 2024-09-19T09:21:53.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01a6cb0 con 0x7f03c0101df0 2024-09-19T09:21:53.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03bdffb640 1 -- 172.21.15.52:0/1991579282 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b4005500 con 0x7f03c0101df0 2024-09-19T09:21:53.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03bdffb640 1 -- 172.21.15.52:0/1991579282 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4010690 con 0x7f03c0101df0 2024-09-19T09:21:53.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.711+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01a71a0 con 0x7f03c0101df0 2024-09-19T09:21:53.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.714+0000 7f03bdffb640 1 -- 172.21.15.52:0/1991579282 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f03b40046c0 con 0x7f03c0101df0 2024-09-19T09:21:53.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 Processor -- start 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 -- start start 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d0e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d0f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561679c6c2f0 con 0x561679d0ede0 2024-09-19T09:21:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561679c13cf0 con 0x561679d19b80 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c957c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561679c682b0 con 0x561679d10350 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d0f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03bffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03bffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50286/0 (socket says 172.21.15.52:50286) 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d0f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60838/0 (socket says 172.21.15.52:60838) 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.715+0000 7f03bffff640 1 -- 172.21.15.52:0/3019116873 learned_addr learned my addr 172.21.15.52:0/3019116873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03c5740640 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d0e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bdffb640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 0x7f03b00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 -- 172.21.15.52:0/3019116873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 msgr2=0x561679d0e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d0e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 -- 172.21.15.52:0/3019116873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 msgr2=0x561679d0f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bdffb640 1 -- 172.21.15.52:0/1991579282 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f03b40cfe20 con 0x7f03c0101df0 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d0f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 -- 172.21.15.52:0/3019116873 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561679bf83a0 con 0x561679d19b80 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03c5740640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 0x7f03b00a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.716+0000 7f03bffff640 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02a930 tx=0x7f03ac005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8197d22b267111e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03aaffd640 1 -- 172.21.15.52:0/3019116873 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac03f070 con 0x561679d19b80 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03aaffd640 1 -- 172.21.15.52:0/3019116873 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03ac004030 con 0x561679d19b80 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03aaffd640 1 -- 172.21.15.52:0/3019116873 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac035070 con 0x561679d19b80 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03c957c740 1 -- 172.21.15.52:0/3019116873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 msgr2=0x561679d1bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03c5740640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 0x7f03b00a5800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005fd0 tx=0x7f03b8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.717+0000 7f03c957c740 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02a930 tx=0x7f03ac005dd0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 -- 172.21.15.52:0/3019116873 shutdown_connections 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d19b80 0x561679d1bf70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d0f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 --2- 172.21.15.52:0/3019116873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d0e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 -- 172.21.15.52:0/3019116873 >> 172.21.15.52:0/3019116873 conn(0x561679ccf310 msgr2=0x561679d0b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 -- 172.21.15.52:0/3019116873 shutdown_connections 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 -- 172.21.15.52:0/3019116873 wait complete. 2024-09-19T09:21:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 -- start start 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.718+0000 7f03c957c740 1 Processor -- start 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 0x561679d19540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561679d1c870 con 0x561679d19b80 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561679c27060 con 0x561679d0ede0 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561679d1c9f0 con 0x561679d10350 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c5740640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03bffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c5740640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60850/0 (socket says 172.21.15.52:60850) 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c5740640 1 -- 172.21.15.52:0/2697170045 learned_addr learned my addr 172.21.15.52:0/2697170045 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.719+0000 7f03c957c740 10 client.0 _ll_register_callbacks cb 0x56167997a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 0x561679d19540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 -- 172.21.15.52:0/2697170045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 msgr2=0x561679d167f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d167f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 -- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 msgr2=0x561679d19540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 0x561679d19540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 -- 172.21.15.52:0/2697170045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616799dd3c0 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 0x561679d19540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f03c5740640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009950 tx=0x7f03b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446cb8ad6a0b6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.720+0000 7f039ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b8003b70 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f03b8003d10 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03ac004030 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f03b8013270 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f03c957c740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.721+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561679d28360 con 0x561679d19b80 2024-09-19T09:21:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.722+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03ac004030 con 0x561679d19b80 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.722+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f03b801c7d0 con 0x561679d19b80 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.722+0000 7f03c957c740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c957c740 10 client.15465 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c957c740 20 client.15465 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d2bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c957c740 4 client.15465 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561679c79860 con 0x561679d29820 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.723+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d2bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.724+0000 7f039ffff640 10 client.15465 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.724+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d2bc10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d487a619d938bc02 server_cookie=f736ef3c9250ecb4 in_seq=0 out_seq=0 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.724+0000 7f039ffff640 1 -- 172.21.15.52:0/2697170045 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561679c79860 con 0x561679d29820 2024-09-19T09:21:53.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.724+0000 7f039ffff640 10 client.15465 handle_command_reply: tid=0 2024-09-19T09:21:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.724+0000 7f03c957c740 1 client.15465 shutdown 2024-09-19T09:21:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 msgr2=0x561679d16de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009950 tx=0x7f03b8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 shutdown_connections 2024-09-19T09:21:53.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d16de0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d10350 0x561679d167f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.725+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d2bc10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f039ffff640 0 client.15465 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f03c957c740 1 --2- 172.21.15.52:0/2697170045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d0ede0 0x561679d19540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 >> 172.21.15.52:0/2697170045 conn(0x561679ccf310 msgr2=0x561679d11140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 shutdown_connections 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f03c957c740 1 -- 172.21.15.52:0/2697170045 wait complete. 2024-09-19T09:21:53.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.726+0000 7f03c957c740 20 client.15465 trim_cache size 0 max 16384 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.752+0000 7f03c957c740 1 Processor -- start 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.752+0000 7f03c957c740 1 -- start start 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.752+0000 7f03c957c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c957c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d11930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c957c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d19b80 0x561679d11e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c957c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01add60 con 0x561679d0ede0 2024-09-19T09:21:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c957c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01ab630 con 0x561679d10350 2024-09-19T09:21:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c957c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01a9480 con 0x561679d19b80 2024-09-19T09:21:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60860/0 (socket says 172.21.15.52:60860) 2024-09-19T09:21:53.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1144474436 learned_addr learned my addr 172.21.15.52:0/1144474436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03bffff640 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d11930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c5740640 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d19b80 0x561679d11e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1144474436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d19b80 msgr2=0x561679d11e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d19b80 0x561679d11e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1144474436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 msgr2=0x561679d11930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d11930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.753+0000 7f03c4f3f640 1 -- 172.21.15.52:0/1144474436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561679d198b0 con 0x561679d0ede0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.754+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f03b40049d0 tx=0x7f03b40bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777058a303d6cae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.754+0000 7f03aa7fc640 1 -- 172.21.15.52:0/1144474436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b409bea0 con 0x561679d0ede0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.754+0000 7f03aa7fc640 1 -- 172.21.15.52:0/1144474436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b40af070 con 0x561679d0ede0 2024-09-19T09:21:53.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.754+0000 7f03aa7fc640 1 -- 172.21.15.52:0/1144474436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b409bcc0 con 0x561679d0ede0 2024-09-19T09:21:53.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 -- 172.21.15.52:0/1144474436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 msgr2=0x561679d18760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f03b40049d0 tx=0x7f03b40bc040 comp rx=0 tx=0).stop 2024-09-19T09:21:53.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 -- 172.21.15.52:0/1144474436 shutdown_connections 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d19b80 0x561679d11e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d11930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 --2- 172.21.15.52:0/1144474436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d0ede0 0x561679d18760 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 -- 172.21.15.52:0/1144474436 >> 172.21.15.52:0/1144474436 conn(0x561679ccf310 msgr2=0x561679d18050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.755+0000 7f03c957c740 1 -- 172.21.15.52:0/1144474436 shutdown_connections 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.756+0000 7f03c957c740 1 -- 172.21.15.52:0/1144474436 wait complete. 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.756+0000 7f03c957c740 1 -- start start 2024-09-19T09:21:53.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.756+0000 7f03c957c740 1 Processor -- start 2024-09-19T09:21:53.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 0x561679d1ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d93410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01a9af0 con 0x561679d19b80 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01aaf60 con 0x561679d10350 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01aa1c0 con 0x561679d0ede0 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c957c740 10 client.0 _ll_register_callbacks cb 0x7f03b8010f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03bffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03bffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50324/0 (socket says 172.21.15.52:50324) 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03bffff640 1 -- 172.21.15.52:0/337822885 learned_addr learned my addr 172.21.15.52:0/337822885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c4f3f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 0x561679d1ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.757+0000 7f03c5740640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d93410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 -- 172.21.15.52:0/337822885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 msgr2=0x561679d1ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 0x561679d1ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 -- 172.21.15.52:0/337822885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 msgr2=0x561679d93410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d93410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 -- 172.21.15.52:0/337822885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561679d93950 con 0x561679d10350 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 0x561679d1ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03bffff640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02a930 tx=0x7f03ac009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837e42f19ec340bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f039ffff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac035070 con 0x561679d10350 2024-09-19T09:21:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f03ac004230 con 0x561679d10350 2024-09-19T09:21:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03b40af070 con 0x561679d10350 2024-09-19T09:21:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f03ac051020 con 0x561679d10350 2024-09-19T09:21:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03c957c740 10 client.25169 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.758+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561679d94b10 con 0x561679d10350 2024-09-19T09:21:53.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03b40af070 con 0x561679d10350 2024-09-19T09:21:53.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f03ac004b00 con 0x561679d10350 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 10 client.25169 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 10 client.25169 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 20 client.25169 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d96ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 4 client.25169 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561679c73d70 con 0x561679d29820 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.759+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d96ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f039ffff640 10 client.25169 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c4f3f640 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d96ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=834a291666787492 server_cookie=f94b18bc7d616dd6 in_seq=0 out_seq=0 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f039ffff640 1 -- 172.21.15.52:0/337822885 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561679c73d70 con 0x561679d29820 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f039ffff640 10 client.25169 handle_command_reply: tid=0 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 client.25169 shutdown 2024-09-19T09:21:53.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 msgr2=0x561679d1e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ac02a930 tx=0x7f03ac009680 comp rx=0 tx=0).stop 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 shutdown_connections 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679d19b80 0x561679d93410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x561679d29820 0x561679d96ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679d10350 0x561679d1e330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 --2- 172.21.15.52:0/337822885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679d0ede0 0x561679d1ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f039ffff640 0 client.25169 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 >> 172.21.15.52:0/337822885 conn(0x561679ccf310 msgr2=0x561679d18870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.760+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 shutdown_connections 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c957c740 1 -- 172.21.15.52:0/337822885 wait complete. 2024-09-19T09:21:53.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c957c740 20 client.25169 trim_cache size 0 max 16384 2024-09-19T09:21:53.766 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:21:53.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 msgr2=0x7f03b00a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 0x7f03b00a5800 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f03b8005fd0 tx=0x7f03b8004a40 comp rx=0 tx=0).stop 2024-09-19T09:21:53.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 msgr2=0x7f03c00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.761+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03b400e9f0 tx=0x7f03b400edf0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 shutdown_connections 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03c0106f20 0x7f03c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03b00a3340 0x7f03b00a5800 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03c01027a0 0x7f03c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 --2- 172.21.15.52:0/1991579282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03c0101df0 0x7f03c00744f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 >> 172.21.15.52:0/1991579282 conn(0x7f03c00fd8f0 msgr2=0x7f03c00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 shutdown_connections 2024-09-19T09:21:53.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:53.762+0000 7f03c71a3640 1 -- 172.21.15.52:0/1991579282 wait complete. 2024-09-19T09:21:54.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:21:54.495 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 -- 172.21.15.52:0/736401468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 msgr2=0x7fbf1810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/736401468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1810da40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009ca0 tx=0x7fbf1002a950 comp rx=0 tx=0).stop 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 -- 172.21.15.52:0/736401468 shutdown_connections 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/736401468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1810da40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/736401468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 0x7fbf181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/736401468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 0x7fbf18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 -- 172.21.15.52:0/736401468 >> 172.21.15.52:0/736401468 conn(0x7fbf180fc7d0 msgr2=0x7fbf180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 -- 172.21.15.52:0/736401468 shutdown_connections 2024-09-19T09:21:54.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.989+0000 7fbf1cb68640 1 -- 172.21.15.52:0/736401468 wait complete. 2024-09-19T09:21:54.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.990+0000 7fbf1cb68640 1 Processor -- start 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.990+0000 7fbf1cb68640 1 -- start start 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.990+0000 7fbf1cb68640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 0x7fbf18197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.990+0000 7fbf1cb68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 0x7fbf18197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.990+0000 7fbf1cb68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf1cb68640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18110f80 con 0x7fbf18102ef0 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf1cb68640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18110e00 con 0x7fbf18100e20 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf1cb68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18111100 con 0x7fbf18102570 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60886/0 (socket says 172.21.15.52:60886) 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf15d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 0x7fbf18197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:54.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 -- 172.21.15.52:0/4111488321 learned_addr learned my addr 172.21.15.52:0/4111488321 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf1659c640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 0x7fbf18197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 -- 172.21.15.52:0/4111488321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 msgr2=0x7fbf18197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 0x7fbf18197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 -- 172.21.15.52:0/4111488321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 msgr2=0x7fbf18197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 0x7fbf18197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:54.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.991+0000 7fbf16d9d640 1 -- 172.21.15.52:0/4111488321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1819c2f0 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf16d9d640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf10004af0 tx=0x7fbf1002ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10034040 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1819c580 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf10030920 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10004040 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.992+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf18069f70 con 0x7fbf18102ef0 2024-09-19T09:21:54.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.993+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf181021b0 con 0x7fbf18102ef0 2024-09-19T09:21:54.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.995+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbf10037020 con 0x7fbf18102ef0 2024-09-19T09:21:54.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.996+0000 7fbf077fe640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 0x7fbf000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:54.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.996+0000 7fbf1659c640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 0x7fbf000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:54.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.996+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbf100f4f10 con 0x7fbf18102ef0 2024-09-19T09:21:54.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:54.997+0000 7fbf1659c640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 0x7fbf000a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009bd0 tx=0x7fbf08010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.003+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf100c1bb0 con 0x7fbf18102ef0 2024-09-19T09:21:55.072 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:55.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:54 smithi086 ceph-mon[34813]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:21:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.265+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf18101200 con 0x7fbf18102ef0 2024-09-19T09:21:55.266 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:54 smithi052 ceph-mon[30947]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:21:55.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.267+0000 7fbf077fe640 1 -- 172.21.15.52:0/4111488321 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fbf18101200 con 0x7fbf18102ef0 2024-09-19T09:21:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:21:55.267 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:21:55.268 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:21:55.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 msgr2=0x7fbf000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 0x7fbf000a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009bd0 tx=0x7fbf08010040 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 msgr2=0x7fbf1819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf10004af0 tx=0x7fbf1002ff40 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 shutdown_connections 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18102ef0 0x7fbf1819bc10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf000a3240 0x7fbf000a5700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf18102570 0x7fbf18197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 --2- 172.21.15.52:0/4111488321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf18100e20 0x7fbf18197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 >> 172.21.15.52:0/4111488321 conn(0x7fbf180fc7d0 msgr2=0x7fbf18106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 shutdown_connections 2024-09-19T09:21:55.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.270+0000 7fbf1cb68640 1 -- 172.21.15.52:0/4111488321 wait complete. 2024-09-19T09:21:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:54 smithi169 ceph-mon[35454]: pgmap v352: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:21:55.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 -- 172.21.15.52:0/315753864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c102790 msgr2=0x7f087c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 --2- 172.21.15.52:0/315753864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c102790 0x7f087c1067e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0868009900 tx=0x7f086802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 -- 172.21.15.52:0/315753864 shutdown_connections 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 --2- 172.21.15.52:0/315753864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c106f10 0x7f087c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 --2- 172.21.15.52:0/315753864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c102790 0x7f087c1067e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 --2- 172.21.15.52:0/315753864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c101de0 0x7f087c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 -- 172.21.15.52:0/315753864 >> 172.21.15.52:0/315753864 conn(0x7f087c0fd8e0 msgr2=0x7f087c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 -- 172.21.15.52:0/315753864 shutdown_connections 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.672+0000 7f0883067640 1 -- 172.21.15.52:0/315753864 wait complete. 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.673+0000 7f0883067640 1 Processor -- start 2024-09-19T09:21:55.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.673+0000 7f0883067640 1 -- start start 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.673+0000 7f0883067640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.673+0000 7f0883067640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 0x7f087c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.673+0000 7f0883067640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 0x7f087c19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0883067640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111fc0 con 0x7f087c101de0 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0883067640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111e40 con 0x7f087c106f10 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0883067640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c112140 con 0x7f087c102790 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60910/0 (socket says 172.21.15.52:60910) 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 -- 172.21.15.52:0/781727196 learned_addr learned my addr 172.21.15.52:0/781727196 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f087bfff640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 0x7f087c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0881604640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 0x7f087c19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 -- 172.21.15.52:0/781727196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 msgr2=0x7f087c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 0x7f087c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 -- 172.21.15.52:0/781727196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 msgr2=0x7f087c19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 0x7f087c19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 -- 172.21.15.52:0/781727196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087c19f560 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f087bfff640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 0x7f087c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0881604640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 0x7f087c19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.674+0000 7f0880e03640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f087000c920 tx=0x7f087000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.675+0000 7f0879ffb640 1 -- 172.21.15.52:0/781727196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870007c70 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.675+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087c19f850 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.675+0000 7f0879ffb640 1 -- 172.21.15.52:0/781727196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0870007e10 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.675+0000 7f0879ffb640 1 -- 172.21.15.52:0/781727196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870018890 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.675+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087c1a7130 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.677+0000 7f0879ffb640 1 -- 172.21.15.52:0/781727196 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0870018b10 con 0x7f087c101de0 2024-09-19T09:21:55.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 Processor -- start 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 -- start start 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x561363308090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56136326e2f0 con 0x56136331bb80 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561363215cf0 con 0x5613633085d0 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0885440740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56136326a2b0 con 0x561363309b40 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0880e03640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f087bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f087bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60924/0 (socket says 172.21.15.52:60924) 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0880e03640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50368/0 (socket says 172.21.15.52:50368) 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0880e03640 1 -- 172.21.15.52:0/646575408 learned_addr learned my addr 172.21.15.52:0/646575408 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:55.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.678+0000 7f0881604640 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x561363308090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 -- 172.21.15.52:0/646575408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 msgr2=0x561363308090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x561363308090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 -- 172.21.15.52:0/646575408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 msgr2=0x56136331df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 -- 172.21.15.52:0/646575408 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613631fa3a0 con 0x5613633085d0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f087bfff640 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0879ffb640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 0x7f086c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0881604640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 0x7f086c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0880e03640 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08700d3b90 tx=0x7f08700d3c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d7594bfaf259fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.679+0000 7f0879ffb640 1 -- 172.21.15.52:0/781727196 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f08700cfb90 con 0x7f087c101de0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.680+0000 7f0881604640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 0x7f086c0a5780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0874005fd0 tx=0x7f0874009780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.680+0000 7f0866ffd640 1 -- 172.21.15.52:0/646575408 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700d6070 con 0x5613633085d0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.680+0000 7f0866ffd640 1 -- 172.21.15.52:0/646575408 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087009c7d0 con 0x5613633085d0 2024-09-19T09:21:55.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.680+0000 7f0866ffd640 1 -- 172.21.15.52:0/646575408 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087009bea0 con 0x5613633085d0 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- 172.21.15.52:0/646575408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 msgr2=0x561363308a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08700d3b90 tx=0x7f08700d3c80 comp rx=0 tx=0).stop 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- 172.21.15.52:0/646575408 shutdown_connections 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x56136331df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x561363308a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 --2- 172.21.15.52:0/646575408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x561363308090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- 172.21.15.52:0/646575408 >> 172.21.15.52:0/646575408 conn(0x5613632d1310 msgr2=0x561363304c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- 172.21.15.52:0/646575408 shutdown_connections 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- 172.21.15.52:0/646575408 wait complete. 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 -- start start 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.681+0000 7f0885440740 1 Processor -- start 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x56136331b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x5613633188b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56136331e880 con 0x56136331bb80 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561363229060 con 0x5613633085d0 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56136331ea00 con 0x561363309b40 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0885440740 10 client.0 _ll_register_callbacks cb 0x561362f7c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f087bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x5613633188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60930/0 (socket says 172.21.15.52:60930) 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 -- 172.21.15.52:0/4094715636 learned_addr learned my addr 172.21.15.52:0/4094715636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0880e03640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x56136331b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 -- 172.21.15.52:0/4094715636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 msgr2=0x5613633188b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x5613633188b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 -- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 msgr2=0x56136331b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x56136331b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.682+0000 7f0881604640 1 -- 172.21.15.52:0/4094715636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561362fdf3c0 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f0881604640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0874011c80 tx=0x7f0874004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f816952944fb607 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874010ea0 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087009c7d0 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f08740203f0 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f087402d030 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f0885440740 10 client.15489 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56136332a460 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087009c7d0 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.683+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f087400f040 con 0x56136331bb80 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 10 client.15489 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:55.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 20 client.15489 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56136332b870 0x56136332dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 4 client.15489 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56136327b860 con 0x56136332b870 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.684+0000 7f0880e03640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56136332b870 0x56136332dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f0880e03640 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56136332b870 0x56136332dcc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca88d4c4908c5ba server_cookie=b4d5e976bc502815 in_seq=0 out_seq=0 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f085bfff640 10 client.15489 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f085bfff640 1 -- 172.21.15.52:0/4094715636 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56136327b860 con 0x56136332b870 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f085bfff640 10 client.15489 handle_command_reply: tid=0 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f0885440740 1 client.15489 shutdown 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 msgr2=0x561363318ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.685+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0874011c80 tx=0x7f0874004a40 comp rx=0 tx=0).stop 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 shutdown_connections 2024-09-19T09:21:55.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56136332b870 0x56136332dcc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56136331bb80 0x561363318ff0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561363309b40 0x5613633188b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 --2- 172.21.15.52:0/4094715636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613633085d0 0x56136331b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f085bfff640 0 client.15489 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 >> 172.21.15.52:0/4094715636 conn(0x5613632d1310 msgr2=0x56136330a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 shutdown_connections 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 1 -- 172.21.15.52:0/4094715636 wait complete. 2024-09-19T09:21:55.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.686+0000 7f0885440740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 Processor -- start 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 -- start start 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 0x561363333590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56136331bb80 0x561363333ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ade30 con 0x561363309b40 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ab700 con 0x56136331bb80 2024-09-19T09:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.699+0000 7f0885440740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1a95b0 con 0x5613633085d0 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f087bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 0x561363333590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f087bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 0x561363333590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60940/0 (socket says 172.21.15.52:60940) 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f087bfff640 1 -- 172.21.15.52:0/365081743 learned_addr learned my addr 172.21.15.52:0/365081743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:55860/0 (socket says 172.21.15.52:55860) 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0881604640 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56136331bb80 0x561363333ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 -- 172.21.15.52:0/365081743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56136331bb80 msgr2=0x561363333ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56136331bb80 0x561363333ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 -- 172.21.15.52:0/365081743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 msgr2=0x561363333590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 0x561363333590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 -- 172.21.15.52:0/365081743 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561363328060 con 0x5613633085d0 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f0880e03640 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561363305ac0 tx=0x7f08700d34a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b293796315ddb95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f08667fc640 1 -- 172.21.15.52:0/365081743 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700d6040 con 0x5613633085d0 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f08667fc640 1 -- 172.21.15.52:0/365081743 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087009c7d0 con 0x5613633085d0 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.700+0000 7f08667fc640 1 -- 172.21.15.52:0/365081743 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087009ba30 con 0x5613633085d0 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 -- 172.21.15.52:0/365081743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 msgr2=0x561363327b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561363305ac0 tx=0x7f08700d34a0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 -- 172.21.15.52:0/365081743 shutdown_connections 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56136331bb80 0x561363333ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561363309b40 0x561363333590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 --2- 172.21.15.52:0/365081743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613633085d0 0x561363327b20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 -- 172.21.15.52:0/365081743 >> 172.21.15.52:0/365081743 conn(0x5613632d1310 msgr2=0x56136331a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 -- 172.21.15.52:0/365081743 shutdown_connections 2024-09-19T09:21:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.701+0000 7f0885440740 1 -- 172.21.15.52:0/365081743 wait complete. 2024-09-19T09:21:55.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.702+0000 7f0885440740 1 -- start start 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.702+0000 7f0885440740 1 Processor -- start 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.702+0000 7f0885440740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.702+0000 7f0885440740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 0x5613633241d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0885440740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56136331bb80 0x561363320c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60948/0 (socket says 172.21.15.52:60948) 2024-09-19T09:21:55.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 -- 172.21.15.52:0/2677034684 learned_addr learned my addr 172.21.15.52:0/2677034684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1a9c00 con 0x5613633085d0 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1ab030 con 0x561363309b40 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f087bfff640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 0x5613633241d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1aa290 con 0x56136331bb80 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0881604640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56136331bb80 0x561363320c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0885440740 10 client.0 _ll_register_callbacks cb 0x7f0874009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 -- 172.21.15.52:0/2677034684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56136331bb80 msgr2=0x561363320c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56136331bb80 0x561363320c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 -- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 msgr2=0x5613633241d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 0x5613633241d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f0880e03640 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613633211a0 con 0x5613633085d0 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.703+0000 7f087bfff640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 0x5613633241d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:55.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f0880e03640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f08700d3b60 tx=0x7f0870098480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361956219a66c4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f085bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700d6070 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f087009a3d0 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087009c7d0 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f087009bc10 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f0885440740 10 client.15495 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.704+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561363396cd0 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087009c7d0 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0870098740 con 0x5613633085d0 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 10 client.15495 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 20 client.15495 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561363396f00 0x5613633992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 4 client.15495 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561363275d70 con 0x561363396f00 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.705+0000 7f087bfff640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561363396f00 0x5613633992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f085bfff640 10 client.15495 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f087bfff640 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561363396f00 0x5613633992f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e797695b6cb206a4 server_cookie=d1c27a5fa6d9a5c1 in_seq=0 out_seq=0 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f085bfff640 1 -- 172.21.15.52:0/2677034684 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561363275d70 con 0x561363396f00 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f085bfff640 10 client.15495 handle_command_reply: tid=0 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 client.15495 shutdown 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 msgr2=0x561363323c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f08700d3b60 tx=0x7f0870098480 comp rx=0 tx=0).stop 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 shutdown_connections 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561363396f00 0x5613633992f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56136331bb80 0x561363320c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561363309b40 0x5613633241d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 --2- 172.21.15.52:0/2677034684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613633085d0 0x561363323c90 secure :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f08700d3b60 tx=0x7f0870098480 comp rx=0 tx=0).stop 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 >> 172.21.15.52:0/2677034684 conn(0x5613632d1310 msgr2=0x5613633034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f085bfff640 0 client.15495 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.706+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 shutdown_connections 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0885440740 1 -- 172.21.15.52:0/2677034684 wait complete. 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0885440740 20 client.15495 trim_cache size 0 max 16384 2024-09-19T09:21:55.712 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 msgr2=0x7f086c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 0x7f086c0a5780 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0874005fd0 tx=0x7f0874009780 comp rx=0 tx=0).stop 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 msgr2=0x7f087c19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f087000c920 tx=0x7f087000cde0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 shutdown_connections 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f087c106f10 0x7f087c19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f086c0a32c0 0x7f086c0a5780 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f087c102790 0x7f087c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 --2- 172.21.15.52:0/781727196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f087c101de0 0x7f087c19a5b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.707+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 >> 172.21.15.52:0/781727196 conn(0x7f087c0fd8e0 msgr2=0x7f087c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.708+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 shutdown_connections 2024-09-19T09:21:55.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:55.708+0000 7f0883067640 1 -- 172.21.15.52:0/781727196 wait complete. 2024-09-19T09:21:56.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:55 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4111488321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:56.376 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:55 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4111488321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:55 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4111488321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:56.889 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 13654521 --release --await' 2024-09-19T09:21:56.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 13654521 --release --await 2024-09-19T09:21:57.173 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:57.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:56 smithi052 ceph-mon[30947]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-19T09:21:57.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:56 smithi086 ceph-mon[34813]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-19T09:21:57.403 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:21:57.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:21:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:56 smithi169 ceph-mon[35454]: pgmap v353: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 -- 172.21.15.52:0/1162044486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0106b80 msgr2=0x7f4db0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 --2- 172.21.15.52:0/1162044486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0106b80 0x7f4db0106f60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009900 tx=0x7f4da402a410 comp rx=0 tx=0).stop 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 -- 172.21.15.52:0/1162044486 shutdown_connections 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 --2- 172.21.15.52:0/1162044486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db0100aa0 0x7f4db010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 --2- 172.21.15.52:0/1162044486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db0100100 0x7f4db0100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 --2- 172.21.15.52:0/1162044486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0106b80 0x7f4db0106f60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 -- 172.21.15.52:0/1162044486 >> 172.21.15.52:0/1162044486 conn(0x7f4db0077230 msgr2=0x7f4db00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 -- 172.21.15.52:0/1162044486 shutdown_connections 2024-09-19T09:21:57.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.690+0000 7f4db704f640 1 -- 172.21.15.52:0/1162044486 wait complete. 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.691+0000 7f4db704f640 1 Processor -- start 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.691+0000 7f4db704f640 1 -- start start 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.691+0000 7f4db704f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db0100100 0x7f4db019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db704f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db704f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db010e3c0 0x7f4db010e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db704f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0112050 con 0x7f4db0100aa0 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db704f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4db0111ed0 con 0x7f4db010e3c0 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db704f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01121d0 con 0x7f4db0100100 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60974/0 (socket says 172.21.15.52:60974) 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 -- 172.21.15.52:0/772365537 learned_addr learned my addr 172.21.15.52:0/772365537 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4db55ec640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db010e3c0 0x7f4db010e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 -- 172.21.15.52:0/772365537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db0100100 msgr2=0x7f4db019f320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:21:57.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db0100100 0x7f4db019f320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 -- 172.21.15.52:0/772365537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db010e3c0 msgr2=0x7f4db010e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db010e3c0 0x7f4db010e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.692+0000 7f4daffff640 1 -- 172.21.15.52:0/772365537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db019ae20 con 0x7f4db0100aa0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4daffff640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4da000d950 tx=0x7f4da000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4dadffb640 1 -- 172.21.15.52:0/772365537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da0017070 con 0x7f4db0100aa0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4dadffb640 1 -- 172.21.15.52:0/772365537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da0009c30 con 0x7f4db0100aa0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4dadffb640 1 -- 172.21.15.52:0/772365537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da000f6b0 con 0x7f4db0100aa0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db019b110 con 0x7f4db0100aa0 2024-09-19T09:21:57.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.693+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db019b600 con 0x7f4db0100aa0 2024-09-19T09:21:57.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.699+0000 7f4db9428740 1 Processor -- start 2024-09-19T09:21:57.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.699+0000 7f4db9428740 1 -- start start 2024-09-19T09:21:57.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.699+0000 7f4dadffb640 1 -- 172.21.15.52:0/772365537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4da00109d0 con 0x7f4db0100aa0 2024-09-19T09:21:57.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.700+0000 7f4db9428740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.700+0000 7f4dadffb640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 0x7f4d980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4dadffb640 1 -- 172.21.15.52:0/772365537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4da0099bc0 con 0x7f4db0100aa0 2024-09-19T09:21:57.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db9428740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e2cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db9428740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e2d240 0x5612d7e2f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db9428740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5612d7d87620 con 0x5612d7e22060 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db9428740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612d7d2ee50 con 0x5612d7e2d240 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db9428740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612d7d835e0 con 0x5612d7e22980 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db55ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db55ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60986/0 (socket says 172.21.15.52:60986) 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db55ec640 1 -- 172.21.15.52:0/2369118052 learned_addr learned my addr 172.21.15.52:0/2369118052 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.701+0000 7f4db4deb640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 0x7f4d980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4daffff640 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e2cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e2d240 0x5612d7e2f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 -- 172.21.15.52:0/2369118052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 msgr2=0x5612d7e2cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e2cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 -- 172.21.15.52:0/2369118052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e2d240 msgr2=0x5612d7e2f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e2d240 0x5612d7e2f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 -- 172.21.15.52:0/2369118052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d7d1fd40 con 0x5612d7e22060 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.702+0000 7f4db55ec640 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5612d7e1f970 tx=0x7f4da8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b19bd7d01a043a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.703+0000 7f4d96ffd640 1 -- 172.21.15.52:0/2369118052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004b20 con 0x5612d7e22060 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.703+0000 7f4d96ffd640 1 -- 172.21.15.52:0/2369118052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da800fd70 con 0x5612d7e22060 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.703+0000 7f4d96ffd640 1 -- 172.21.15.52:0/2369118052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8005680 con 0x5612d7e22060 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.704+0000 7f4db9428740 1 -- 172.21.15.52:0/2369118052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 msgr2=0x5612d7e22440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.704+0000 7f4db9428740 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x5612d7e1f970 tx=0x7f4da8005bd0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.704+0000 7f4db4deb640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 0x7f4d980a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4da40057c0 tx=0x7f4da4009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 -- 172.21.15.52:0/2369118052 shutdown_connections 2024-09-19T09:21:57.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e2d240 0x5612d7e2f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e2cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 --2- 172.21.15.52:0/2369118052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22060 0x5612d7e22440 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 -- 172.21.15.52:0/2369118052 >> 172.21.15.52:0/2369118052 conn(0x5612d7e1e5f0 msgr2=0x5612d7e1e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 -- 172.21.15.52:0/2369118052 shutdown_connections 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.706+0000 7f4db9428740 1 -- 172.21.15.52:0/2369118052 wait complete. 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.707+0000 7f4db9428740 1 -- start start 2024-09-19T09:21:57.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.707+0000 7f4db9428740 1 Processor -- start 2024-09-19T09:21:57.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db9428740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db9428740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db4deb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db4deb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50422/0 (socket says 172.21.15.52:50422) 2024-09-19T09:21:57.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32768/0 (socket says 172.21.15.52:32768) 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db4deb640 1 -- 172.21.15.52:0/1429042252 learned_addr learned my addr 172.21.15.52:0/1429042252 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.708+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5612d7e2feb0 con 0x5612d7e22980 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612d7d0ff10 con 0x5612d7e22060 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612d7e30030 con 0x5612d7e2d240 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db55ec640 1 -- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 msgr2=0x5612d7e2a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.709+0000 7f4db55ec640 1 -- 172.21.15.52:0/1429042252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 msgr2=0x5612d7e2a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.710+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.710+0000 7f4db55ec640 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d7a96580 con 0x5612d7e2d240 2024-09-19T09:21:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.710+0000 7f4db9428740 10 client.0 _ll_register_callbacks cb 0x5612d7d33db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.710+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da800fd70 con 0x5612d7e2d240 2024-09-19T09:21:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.710+0000 7f4daffff640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.711+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e2abe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4da801b000 tx=0x7f4da80133a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e9673d734ec0e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.711+0000 7f4d8ffff640 10 client.25096 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:21:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.711+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1429042252 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da800fb90 con 0x5612d7e2d240 2024-09-19T09:21:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.711+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1429042252 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4da8005510 con 0x5612d7e2d240 2024-09-19T09:21:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.711+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1429042252 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4da8005770 con 0x5612d7e2d240 2024-09-19T09:21:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.712+0000 7f4db9428740 10 client.25096 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:57.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.712+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5612d7b60960 con 0x5612d7e2d240 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.713+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1429042252 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4da801d020 con 0x5612d7e2d240 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.713+0000 7f4db9428740 10 client.25096 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.713+0000 7f4db9428740 10 client.25096 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.713+0000 7f4db9428740 20 client.25096 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.713+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7e3f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.714+0000 7f4db9428740 4 client.25096 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.714+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612d7d94b90 con 0x5612d7e3cc40 2024-09-19T09:21:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.714+0000 7f4db4deb640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7e3f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.715+0000 7f4d8ffff640 10 client.25096 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.714+0000 7f4db4deb640 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7e3f030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d336f383ac8217a7 server_cookie=24cfbd35f1dffcab in_seq=0 out_seq=0 2024-09-19T09:21:57.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.715+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1429042252 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612d7d94b90 con 0x5612d7e3cc40 2024-09-19T09:21:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.715+0000 7f4d8ffff640 10 client.25096 handle_command_reply: tid=0 2024-09-19T09:21:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.715+0000 7f4db9428740 1 client.25096 shutdown 2024-09-19T09:21:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.716+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 msgr2=0x5612d7e2abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.716+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e2abe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4da801b000 tx=0x7f4da80133a0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.716+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 shutdown_connections 2024-09-19T09:21:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.716+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7e3f030 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4d8ffff640 0 client.25096 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:57.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e2abe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e2a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4db9428740 1 --2- 172.21.15.52:0/1429042252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 >> 172.21.15.52:0/1429042252 conn(0x5612d7e1e5f0 msgr2=0x5612d7e242d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.717+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 shutdown_connections 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.718+0000 7f4db9428740 1 -- 172.21.15.52:0/1429042252 wait complete. 2024-09-19T09:21:57.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.718+0000 7f4db9428740 20 client.25096 trim_cache size 0 max 16384 2024-09-19T09:21:57.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.738+0000 7f4db9428740 1 Processor -- start 2024-09-19T09:21:57.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.738+0000 7f4db9428740 1 -- start start 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e24ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bf5a0 con 0x5612d7e2d240 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bce70 con 0x5612d7e22060 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db9428740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bacc0 con 0x5612d7e22980 2024-09-19T09:21:57.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32778/0 (socket says 172.21.15.52:32778) 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 -- 172.21.15.52:0/1496200498 learned_addr learned my addr 172.21.15.52:0/1496200498 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db4deb640 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 -- 172.21.15.52:0/1496200498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 msgr2=0x5612d7e24ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e24ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 -- 172.21.15.52:0/1496200498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 msgr2=0x5612d7e2c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.739+0000 7f4db55ec640 1 -- 172.21.15.52:0/1496200498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d7e30030 con 0x5612d7e2d240 2024-09-19T09:21:57.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.740+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4da8013880 tx=0x7f4da8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e307b1510ff96f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.740+0000 7f4d967fc640 1 -- 172.21.15.52:0/1496200498 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da800fb70 con 0x5612d7e2d240 2024-09-19T09:21:57.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.740+0000 7f4d967fc640 1 -- 172.21.15.52:0/1496200498 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4da800fd70 con 0x5612d7e2d240 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.740+0000 7f4d967fc640 1 -- 172.21.15.52:0/1496200498 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8029680 con 0x5612d7e2d240 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 -- 172.21.15.52:0/1496200498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 msgr2=0x5612d7e44690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4da8013880 tx=0x7f4da8021000 comp rx=0 tx=0).stop 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 -- 172.21.15.52:0/1496200498 shutdown_connections 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e2d240 0x5612d7e44690 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e22980 0x5612d7e24ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 --2- 172.21.15.52:0/1496200498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e2c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.741+0000 7f4db9428740 1 -- 172.21.15.52:0/1496200498 >> 172.21.15.52:0/1496200498 conn(0x5612d7e1e5f0 msgr2=0x5612d7e2a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.742+0000 7f4db9428740 1 -- 172.21.15.52:0/1496200498 shutdown_connections 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.742+0000 7f4db9428740 1 -- 172.21.15.52:0/1496200498 wait complete. 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.742+0000 7f4db9428740 1 -- start start 2024-09-19T09:21:57.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.742+0000 7f4db9428740 1 Processor -- start 2024-09-19T09:21:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.743+0000 7f4db9428740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e27170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.743+0000 7f4db9428740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.743+0000 7f4db4deb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e27170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.743+0000 7f4db4deb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e27170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50440/0 (socket says 172.21.15.52:50440) 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4daffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32790/0 (socket says 172.21.15.52:32790) 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db4deb640 1 -- 172.21.15.52:0/1152747712 learned_addr learned my addr 172.21.15.52:0/1152747712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e27bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bb330 con 0x5612d7e22980 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bc7a0 con 0x5612d7e22060 2024-09-19T09:21:57.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4db01bba00 con 0x5612d7e2d240 2024-09-19T09:21:57.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.744+0000 7f4db55ec640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e27bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4daffff640 1 -- 172.21.15.52:0/1152747712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 msgr2=0x5612d7e27bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4daffff640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e27bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4daffff640 1 -- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 msgr2=0x5612d7e27170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4db9428740 10 client.0 _ll_register_callbacks cb 0x7f4da800fac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4daffff640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e27170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4daffff640 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d7ea6660 con 0x5612d7e22980 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.745+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da800fd70 con 0x5612d7e22980 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4daffff640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x5612d7e1f450 tx=0x7f4da0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21edca6efd53f730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4d8ffff640 10 client.15513 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1152747712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da00b9060 con 0x5612d7e22980 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1152747712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4da009b180 con 0x5612d7e22980 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1152747712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4da009fed0 con 0x5612d7e22980 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4db9428740 10 client.15513 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.746+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5612d7ea7830 con 0x5612d7e22980 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1152747712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4da0023060 con 0x5612d7e22980 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 10 client.15513 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 10 client.15513 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 20 client.15513 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7ea9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 4 client.15513 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "13654521", "release": true, "await": true}] 2024-09-19T09:21:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "13654521", "release": true, "await": true}) -- 0x5612d7d8f0a0 con 0x5612d7e3cc40 2024-09-19T09:21:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.747+0000 7f4db4deb640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7ea9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.749+0000 7f4d8ffff640 10 client.15513 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.749+0000 7f4db4deb640 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7ea9e50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33238027f2d83b51 server_cookie=4559f83c1609c314 in_seq=0 out_seq=0 2024-09-19T09:21:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.750+0000 7f4d8ffff640 1 -- 172.21.15.52:0/1152747712 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5612d7d8f0a0 con 0x5612d7e3cc40 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.750+0000 7f4d8ffff640 10 client.15513 handle_command_reply: tid=0 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.750+0000 7f4db9428740 1 client.15513 shutdown 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 msgr2=0x5612d7e276b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x5612d7e1f450 tx=0x7f4da0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 shutdown_connections 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612d7e3cc40 0x5612d7ea9e50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4d8ffff640 0 client.15513 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612d7e2d240 0x5612d7e27bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612d7e22980 0x5612d7e276b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 --2- 172.21.15.52:0/1152747712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612d7e22060 0x5612d7e27170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 >> 172.21.15.52:0/1152747712 conn(0x5612d7e1e5f0 msgr2=0x5612d7e38150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 shutdown_connections 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 1 -- 172.21.15.52:0/1152747712 wait complete. 2024-09-19T09:21:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.751+0000 7f4db9428740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 4, 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "13654521": { 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 4, 2024-09-19T09:21:57.755 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 131.2, 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:21:57.756 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.754+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 msgr2=0x7f4d980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.754+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 0x7f4d980a5780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4da40057c0 tx=0x7f4da4009520 comp rx=0 tx=0).stop 2024-09-19T09:21:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.754+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 msgr2=0x7f4db010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.754+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4da000d950 tx=0x7f4da000de10 comp rx=0 tx=0).stop 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 shutdown_connections 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4db010e3c0 0x7f4db010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4db0100aa0 0x7f4db010de80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4d980a32c0 0x7f4d980a5780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 --2- 172.21.15.52:0/772365537 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4db0100100 0x7f4db019f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.755+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 >> 172.21.15.52:0/772365537 conn(0x7f4db0077230 msgr2=0x7f4db0104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.756+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 shutdown_connections 2024-09-19T09:21:57.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:57.756+0000 7f4db704f640 1 -- 172.21.15.52:0/772365537 wait complete. 2024-09-19T09:21:58.488 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:58.507 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '13654521', total seconds elapsed: 16.2 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 -- 172.21.15.52:0/125419588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100aa0 msgr2=0x7faa0810ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/125419588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100aa0 0x7faa0810ea20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7faa00009ca0 tx=0x7faa0002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 -- 172.21.15.52:0/125419588 shutdown_connections 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/125419588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100aa0 0x7faa0810ea20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/125419588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100100 0x7faa08100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/125419588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.010+0000 7faa0d6a0640 1 -- 172.21.15.52:0/125419588 >> 172.21.15.52:0/125419588 conn(0x7faa08077230 msgr2=0x7faa080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.014 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:58 smithi052 ceph-mon[30947]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:21:59.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.013+0000 7faa0d6a0640 1 -- 172.21.15.52:0/125419588 shutdown_connections 2024-09-19T09:21:59.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.013+0000 7faa0d6a0640 1 -- 172.21.15.52:0/125419588 wait complete. 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.014+0000 7faa0d6a0640 1 Processor -- start 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.014+0000 7faa0d6a0640 1 -- start start 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 0x7faa08101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa081120a0 con 0x7faa08100100 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa08111f20 con 0x7faa08106b80 2024-09-19T09:21:59.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa0d6a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa08112220 con 0x7faa08100aa0 2024-09-19T09:21:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45442/0 (socket says 172.21.15.52:45442) 2024-09-19T09:21:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa06ffd640 1 -- 172.21.15.52:0/1479826010 learned_addr learned my addr 172.21.15.52:0/1479826010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa077fe640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.015+0000 7faa067fc640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 0x7faa08101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 -- 172.21.15.52:0/1479826010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 msgr2=0x7faa08101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 0x7faa08101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 -- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 msgr2=0x7faa081012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 -- 172.21.15.52:0/1479826010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa081a69e0 con 0x7faa08106b80 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa06ffd640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:59.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa067fc640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 0x7faa08101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7faa077fe640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08101d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa0002ade0 tx=0x7faa00003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7fa9effff640 1 -- 172.21.15.52:0/1479826010 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00031650 con 0x7faa08106b80 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7fa9effff640 1 -- 172.21.15.52:0/1479826010 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa000317f0 con 0x7faa08106b80 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.016+0000 7fa9effff640 1 -- 172.21.15.52:0/1479826010 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0002f9b0 con 0x7faa08106b80 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.017+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa081a6c70 con 0x7faa08106b80 2024-09-19T09:21:59.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.017+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa081a7130 con 0x7faa08106b80 2024-09-19T09:21:59.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.020+0000 7faa0fa79740 1 Processor -- start 2024-09-19T09:21:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.020+0000 7fa9effff640 1 -- 172.21.15.52:0/1479826010 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faa0002fb50 con 0x7faa08106b80 2024-09-19T09:21:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 -- start start 2024-09-19T09:21:59.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992b8b60 0x5622992b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c3d40 0x5622992c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56229921e280 con 0x5622992b9480 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622991c5b10 con 0x5622992b8b60 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.021+0000 7faa0fa79740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56229921a240 con 0x5622992c3d40 2024-09-19T09:21:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45446/0 (socket says 172.21.15.52:45446) 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 -- 172.21.15.52:0/236423478 learned_addr learned my addr 172.21.15.52:0/236423478 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 -- 172.21.15.52:0/236423478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c3d40 msgr2=0x5622992c6130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c3d40 0x5622992c6130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 -- 172.21.15.52:0/236423478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992b8b60 msgr2=0x5622992b8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992b8b60 0x5622992b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 -- 172.21.15.52:0/236423478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622991d21f0 con 0x5622992b9480 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.022+0000 7faa06ffd640 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80115c0 tx=0x7fa9f8011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81771cf1607930a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7fa9ed7fa640 1 -- 172.21.15.52:0/236423478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800f660 con 0x5622992b9480 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7fa9ed7fa640 1 -- 172.21.15.52:0/236423478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f800fce0 con 0x5622992b9480 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7fa9ed7fa640 1 -- 172.21.15.52:0/236423478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80183b0 con 0x5622992b9480 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7fa9effff640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 0x7fa9f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7fa9effff640 1 -- 172.21.15.52:0/1479826010 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faa000f0db0 con 0x7faa08106b80 2024-09-19T09:21:59.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.023+0000 7faa067fc640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 0x7fa9f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa067fc640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 0x7fa9f00a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5622992b6470 tx=0x7fa9fc009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 -- 172.21.15.52:0/236423478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 msgr2=0x5622992c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80115c0 tx=0x7fa9f8011a80 comp rx=0 tx=0).stop 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 -- 172.21.15.52:0/236423478 shutdown_connections 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c3d40 0x5622992c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b9480 0x5622992c3800 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 --2- 172.21.15.52:0/236423478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992b8b60 0x5622992b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.024+0000 7faa0fa79740 1 -- 172.21.15.52:0/236423478 >> 172.21.15.52:0/236423478 conn(0x5622992b50f0 msgr2=0x5622992b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.025+0000 7faa0fa79740 1 -- 172.21.15.52:0/236423478 shutdown_connections 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.025+0000 7faa0fa79740 1 -- 172.21.15.52:0/236423478 wait complete. 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.025+0000 7faa0fa79740 1 -- start start 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.025+0000 7faa0fa79740 1 Processor -- start 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa067fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa067fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45462/0 (socket says 172.21.15.52:45462) 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa067fc640 1 -- 172.21.15.52:0/3652160010 learned_addr learned my addr 172.21.15.52:0/3652160010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5622992c6910 con 0x5622992c3d40 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622991d8f10 con 0x5622992c1810 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622992c6a90 con 0x5622992b8b60 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.026+0000 7faa077fe640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 -- 172.21.15.52:0/3652160010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 msgr2=0x5622992c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 -- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 msgr2=0x5622992cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562298f8f6a0 con 0x5622992c3d40 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa077fe640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa0fa79740 10 client.0 _ll_register_callbacks cb 0x5622991a1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f800fce0 con 0x5622992c3d40 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7faa067fc640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009fd0 tx=0x7fa9fc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7484a6898fc589c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7fa9eaff5640 10 client.15525 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.027+0000 7fa9eaff5640 1 -- 172.21.15.52:0/3652160010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc00fc10 con 0x5622992c3d40 2024-09-19T09:21:59.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7fa9eaff5640 1 -- 172.21.15.52:0/3652160010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9fc00fdb0 con 0x5622992c3d40 2024-09-19T09:21:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7fa9eaff5640 1 -- 172.21.15.52:0/3652160010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9fc01f420 con 0x5622992c3d40 2024-09-19T09:21:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 10 client.15525 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5622992d29a0 con 0x5622992c3d40 2024-09-19T09:21:59.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7fa9eaff5640 1 -- 172.21.15.52:0/3652160010 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9fc01f5c0 con 0x5622992c3d40 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 20 client.15525 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622992d3da0 0x5622992d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 4 client.15525 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.028+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56229922b7f0 con 0x5622992d3da0 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.029+0000 7faa06ffd640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622992d3da0 0x5622992d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.029+0000 7faa06ffd640 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622992d3da0 0x5622992d6230 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=650c71b393c96848 server_cookie=64c61300fcfcb0e7 in_seq=0 out_seq=0 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.029+0000 7fa9eaff5640 10 client.15525 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7fa9eaff5640 1 -- 172.21.15.52:0/3652160010 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56229922b7f0 con 0x5622992d3da0 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7fa9eaff5640 10 client.15525 handle_command_reply: tid=0 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 client.15525 shutdown 2024-09-19T09:21:59.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 msgr2=0x5622992c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009fd0 tx=0x7fa9fc005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 shutdown_connections 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622992d3da0 0x5622992d6230 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 --2- 172.21.15.52:0/3652160010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7fa9eaff5640 0 client.15525 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 >> 172.21.15.52:0/3652160010 conn(0x5622992b50f0 msgr2=0x5622992bae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 shutdown_connections 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.030+0000 7faa0fa79740 1 -- 172.21.15.52:0/3652160010 wait complete. 2024-09-19T09:21:59.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.031+0000 7faa0fa79740 20 client.15525 trim_cache size 0 max 16384 2024-09-19T09:21:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.066+0000 7faa0fa79740 1 Processor -- start 2024-09-19T09:21:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.066+0000 7faa0fa79740 1 -- start start 2024-09-19T09:21:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.066+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.066+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.066+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:39230/0 (socket says 172.21.15.52:39230) 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa067fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa067fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:37686/0 (socket says 172.21.15.52:37686) 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45464/0 (socket says 172.21.15.52:45464) 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa06ffd640 1 -- 172.21.15.52:0/827918639 learned_addr learned my addr 172.21.15.52:0/827918639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa081aded0 con 0x5622992c3d40 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa081ab7a0 con 0x5622992c1810 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa081a95f0 con 0x5622992b8b60 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 -- 172.21.15.52:0/827918639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 msgr2=0x5622992cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 -- 172.21.15.52:0/827918639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 msgr2=0x5622992c0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992c0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.067+0000 7faa077fe640 1 -- 172.21.15.52:0/827918639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622992b92b0 con 0x5622992c3d40 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.068+0000 7faa077fe640 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faa00009430 tx=0x7faa000dbf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acf78fa6ae39240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.068+0000 7fa9ecff9640 1 -- 172.21.15.52:0/827918639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000319a0 con 0x5622992c3d40 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.068+0000 7fa9ecff9640 1 -- 172.21.15.52:0/827918639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa00036030 con 0x5622992c3d40 2024-09-19T09:21:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.068+0000 7fa9ecff9640 1 -- 172.21.15.52:0/827918639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000bb6e0 con 0x5622992c3d40 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.069+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 msgr2=0x5622992c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.069+0000 7faa0fa79740 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faa00009430 tx=0x7faa000dbf90 comp rx=0 tx=0).stop 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.069+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 shutdown_connections 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992c3d40 0x5622992c12a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c1810 0x5622992c0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 --2- 172.21.15.52:0/827918639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992b8b60 0x5622992cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 >> 172.21.15.52:0/827918639 conn(0x5622992b50f0 msgr2=0x5622992c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 shutdown_connections 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 -- 172.21.15.52:0/827918639 wait complete. 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 -- start start 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 Processor -- start 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.070+0000 7faa0fa79740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa06ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45474/0 (socket says 172.21.15.52:45474) 2024-09-19T09:21:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa06ffd640 1 -- 172.21.15.52:0/2994438095 learned_addr learned my addr 172.21.15.52:0/2994438095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c1810 0x5622992cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c3d40 0x5622992c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa081a9c60 con 0x5622992b8b60 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa081ab0d0 con 0x5622992c3d40 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa081aa330 con 0x5622992c1810 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa067fc640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c1810 0x5622992cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.071+0000 7faa077fe640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c3d40 0x5622992c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 -- 172.21.15.52:0/2994438095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c1810 msgr2=0x5622992cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c1810 0x5622992cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 -- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c3d40 msgr2=0x5622992c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c3d40 0x5622992c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa0fa79740 10 client.0 _ll_register_callbacks cb 0x7fa9fc011f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622992c89a0 con 0x5622992b8b60 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa00036030 con 0x5622992b8b60 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7faa06ffd640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5622992b5f50 tx=0x7fa9f8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538883f580fe21bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7fa9eaff5640 10 client.15531 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7fa9eaff5640 1 -- 172.21.15.52:0/2994438095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8032020 con 0x5622992b8b60 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.072+0000 7fa9eaff5640 1 -- 172.21.15.52:0/2994438095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9f8019b60 con 0x5622992b8b60 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7fa9eaff5640 1 -- 172.21.15.52:0/2994438095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9f8019da0 con 0x5622992b8b60 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 10 client.15531 fetch_fsmap learned FSMap version 24 2024-09-19T09:21:59.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56229933f4d0 con 0x5622992b8b60 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7fa9eaff5640 1 -- 172.21.15.52:0/2994438095 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9f80259d0 con 0x5622992b8b60 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 10 client.15531 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 20 client.15531 populate_metadata read hostname 'smithi052' 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56229933f8a0 0x562299341c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 4 client.15531 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562299225d00 con 0x56229933f8a0 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.073+0000 7faa067fc640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56229933f8a0 0x562299341c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.074+0000 7fa9eaff5640 10 client.15531 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.074+0000 7faa067fc640 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56229933f8a0 0x562299341c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a40ee0d1095aa4e3 server_cookie=f4522177a6e19fca in_seq=0 out_seq=0 2024-09-19T09:21:59.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7fa9eaff5640 1 -- 172.21.15.52:0/2994438095 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562299225d00 con 0x56229933f8a0 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7fa9eaff5640 10 client.15531 handle_command_reply: tid=0 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 client.15531 shutdown 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 msgr2=0x5622992cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x5622992b5f50 tx=0x7fa9f8019640 comp rx=0 tx=0).stop 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 shutdown_connections 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56229933f8a0 0x562299341c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7fa9eaff5640 0 client.15531 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622992c3d40 0x5622992c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.075+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622992c1810 0x5622992cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.076+0000 7faa0fa79740 1 --2- 172.21.15.52:0/2994438095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622992b8b60 0x5622992cbcf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.076+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 >> 172.21.15.52:0/2994438095 conn(0x5622992b50f0 msgr2=0x5622992c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.076+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 shutdown_connections 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.076+0000 7faa0fa79740 1 -- 172.21.15.52:0/2994438095 wait complete. 2024-09-19T09:21:59.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.076+0000 7faa0fa79740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T09:21:59.083 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:21:59.083 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:21:59.083 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "d08d974e-b881-4ea2-a770-cd531dbfc69c", 2024-09-19T09:21:59.083 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:21:59.083 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 msgr2=0x7fa9f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 0x7fa9f00a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5622992b6470 tx=0x7fa9fc009620 comp rx=0 tx=0).stop 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 msgr2=0x7faa08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08101d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faa0002ade0 tx=0x7faa00003f10 comp rx=0 tx=0).stop 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 shutdown_connections 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa08106b80 0x7faa08101d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9f00a3240 0x7fa9f00a5700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa08100aa0 0x7faa08101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 --2- 172.21.15.52:0/1479826010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa08100100 0x7faa081012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.077+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 >> 172.21.15.52:0/1479826010 conn(0x7faa08077230 msgr2=0x7faa080fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.078+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 shutdown_connections 2024-09-19T09:21:59.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:21:59.078+0000 7faa0d6a0640 1 -- 172.21.15.52:0/1479826010 wait complete. 2024-09-19T09:21:59.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:58 smithi086 ceph-mon[34813]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:21:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:58 smithi169 ceph-mon[35454]: pgmap v354: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:21:59.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:22:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 -- 172.21.15.52:0/513688751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 msgr2=0x7fe4fc100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 --2- 172.21.15.52:0/513688751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc100810 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009900 tx=0x7fe4ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 -- 172.21.15.52:0/513688751 shutdown_connections 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 --2- 172.21.15.52:0/513688751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc1016f0 0x7fe4fc101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 --2- 172.21.15.52:0/513688751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4fc100d50 0x7fe4fc1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 --2- 172.21.15.52:0/513688751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc100810 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 -- 172.21.15.52:0/513688751 >> 172.21.15.52:0/513688751 conn(0x7fe4fc0fc1e0 msgr2=0x7fe4fc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 -- 172.21.15.52:0/513688751 shutdown_connections 2024-09-19T09:22:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.185+0000 7fe5008ac640 1 -- 172.21.15.52:0/513688751 wait complete. 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 Processor -- start 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 -- start start 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc100d50 0x7fe4fc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4fc1016f0 0x7fe4fc1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10f950 con 0x7fe4fc100410 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10f7d0 con 0x7fe4fc100d50 2024-09-19T09:22:00.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe5008ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10fad0 con 0x7fe4fc1016f0 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe4fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe4fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45488/0 (socket says 172.21.15.52:45488) 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe4fa59c640 1 -- 172.21.15.52:0/3638789076 learned_addr learned my addr 172.21.15.52:0/3638789076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.186+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc100d50 0x7fe4fc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 -- 172.21.15.52:0/3638789076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4fc1016f0 msgr2=0x7fe4fc1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4fc1016f0 0x7fe4fc1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 -- 172.21.15.52:0/3638789076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc100d50 msgr2=0x7fe4fc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc100d50 0x7fe4fc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 -- 172.21.15.52:0/3638789076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc1a1b90 con 0x7fe4fc100410 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009230 tx=0x7fe4ec031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4eb7fe640 1 -- 172.21.15.52:0/3638789076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec03f030 con 0x7fe4fc100410 2024-09-19T09:22:00.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4eb7fe640 1 -- 172.21.15.52:0/3638789076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec003ad0 con 0x7fe4fc100410 2024-09-19T09:22:00.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc1a1e20 con 0x7fe4fc100410 2024-09-19T09:22:00.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe4eb7fe640 1 -- 172.21.15.52:0/3638789076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec035070 con 0x7fe4fc100410 2024-09-19T09:22:00.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.187+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc1a22e0 con 0x7fe4fc100410 2024-09-19T09:22:00.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.190+0000 7fe50364d740 1 Processor -- start 2024-09-19T09:22:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 -- start start 2024-09-19T09:22:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ec6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 0x562731ecbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562731e2a2f0 con 0x562731ecc370 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562731dd2270 con 0x562731ec72e0 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe50364d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562731e262b0 con 0x562731ec69a0 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe4eb7fe640 1 -- 172.21.15.52:0/3638789076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe4ec042030 con 0x7fe4fc100410 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45498/0 (socket says 172.21.15.52:45498) 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/3612490141 learned_addr learned my addr 172.21.15.52:0/3612490141 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.191+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ec6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 0x562731ecbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/3612490141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 msgr2=0x562731ec6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ec6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/3612490141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 msgr2=0x562731ecbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 0x562731ecbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/3612490141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562731dd1340 con 0x562731ecc370 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 0x562731ecbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.192+0000 7fe4eb7fe640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 0x7fe4e40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 0x7fe4e40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4eb7fe640 1 -- 172.21.15.52:0/3638789076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe4ec0efef0 con 0x7fe4fc100410 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b740 tx=0x7fe4f000bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d6be81558faae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4e8ff9640 1 -- 172.21.15.52:0/3612490141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0003dd0 con 0x562731ecc370 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 0x7fe4e40a5830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009270 tx=0x7fe4f4009200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4e8ff9640 1 -- 172.21.15.52:0/3612490141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0015070 con 0x562731ecc370 2024-09-19T09:22:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.193+0000 7fe4e8ff9640 1 -- 172.21.15.52:0/3612490141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0011440 con 0x562731ecc370 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 -- 172.21.15.52:0/3612490141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 msgr2=0x562731ece830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000b740 tx=0x7fe4f000bc00 comp rx=0 tx=0).stop 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 -- 172.21.15.52:0/3612490141 shutdown_connections 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ece830 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ec72e0 0x562731ecbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 --2- 172.21.15.52:0/3612490141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ec6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 -- 172.21.15.52:0/3612490141 >> 172.21.15.52:0/3612490141 conn(0x562731ec2010 msgr2=0x562731ec2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 -- 172.21.15.52:0/3612490141 shutdown_connections 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.194+0000 7fe50364d740 1 -- 172.21.15.52:0/3612490141 wait complete. 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 -- start start 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 Processor -- start 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ed0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ed81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562731ecf3e0 con 0x562731ec72e0 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562731db3290 con 0x562731ecc370 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562731ecf560 con 0x562731ec69a0 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe50364d740 10 client.0 _ll_register_callbacks cb 0x562731de4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:00.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45512/0 (socket says 172.21.15.52:45512) 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/4067902533 learned_addr learned my addr 172.21.15.52:0/4067902533 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.195+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ed0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ed81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/4067902533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 msgr2=0x562731ed0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ed0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 msgr2=0x562731ed81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ed81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/4067902533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562731b3d210 con 0x562731ec72e0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ed0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0006010 tx=0x7fe4f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892b857bebe56217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0028060 con 0x562731ec72e0 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe4f0003dd0 con 0x562731ec72e0 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4f0015070 con 0x562731ec72e0 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe4f0004e80 con 0x562731ec72e0 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe50364d740 10 client.15543 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.196+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562731c09620 con 0x562731ec72e0 2024-09-19T09:22:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.197+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0015070 con 0x562731ec72e0 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.197+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe4f0022070 con 0x562731ec72e0 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 20 client.15543 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731edc570 0x562731ede960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 4 client.15543 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562731e37a20 con 0x562731edc570 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731edc570 0x562731ede960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731edc570 0x562731ede960 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fc5227cefa44e26 server_cookie=11158f6bf8a00c65 in_seq=0 out_seq=0 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.198+0000 7fe4e1ffb640 10 client.15543 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/4067902533 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562731e37a20 con 0x562731edc570 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe4e1ffb640 10 client.15543 handle_command_reply: tid=0 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 client.15543 shutdown 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 msgr2=0x562731ed1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0006010 tx=0x7fe4f00048f0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 shutdown_connections 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731edc570 0x562731ede960 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ed81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec72e0 0x562731ed1170 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe4e1ffb640 0 client.15543 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 --2- 172.21.15.52:0/4067902533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec69a0 0x562731ed0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.199+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 >> 172.21.15.52:0/4067902533 conn(0x562731ec2010 msgr2=0x562731ec3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.200+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 shutdown_connections 2024-09-19T09:22:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.200+0000 7fe50364d740 1 -- 172.21.15.52:0/4067902533 wait complete. 2024-09-19T09:22:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.200+0000 7fe50364d740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T09:22:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.227+0000 7fe50364d740 1 Processor -- start 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.230+0000 7fe50364d740 1 -- start start 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ee3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1adcc0 con 0x562731ec69a0 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1ab590 con 0x562731ecc370 2024-09-19T09:22:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe50364d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1a93e0 con 0x562731ec72e0 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45518/0 (socket says 172.21.15.52:45518) 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2181352975 learned_addr learned my addr 172.21.15.52:0/2181352975 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ee3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2181352975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 msgr2=0x562731ed8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2181352975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 msgr2=0x562731ee3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ee3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.231+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2181352975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562731ec7b30 con 0x562731ec69a0 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.232+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.232+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec031440 tx=0x7fe4ec0f39d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5af51147b59afb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.232+0000 7fe4e3fff640 1 -- 172.21.15.52:0/2181352975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec049040 con 0x562731ec69a0 2024-09-19T09:22:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.232+0000 7fe4e3fff640 1 -- 172.21.15.52:0/2181352975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec0bcb90 con 0x562731ec69a0 2024-09-19T09:22:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.232+0000 7fe4e3fff640 1 -- 172.21.15.52:0/2181352975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0ba820 con 0x562731ec69a0 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 -- 172.21.15.52:0/2181352975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 msgr2=0x562731ec3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec031440 tx=0x7fe4ec0f39d0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 -- 172.21.15.52:0/2181352975 shutdown_connections 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731ecc370 0x562731ee3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 --2- 172.21.15.52:0/2181352975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ec69a0 0x562731ec3b10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 -- 172.21.15.52:0/2181352975 >> 172.21.15.52:0/2181352975 conn(0x562731ec2010 msgr2=0x562731ec23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 -- 172.21.15.52:0/2181352975 shutdown_connections 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.233+0000 7fe50364d740 1 -- 172.21.15.52:0/2181352975 wait complete. 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 -- start start 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 Processor -- start 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe4f9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45522/0 (socket says 172.21.15.52:45522) 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 0x562731ed6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe4f9d9b640 1 -- 172.21.15.52:0/2543287898 learned_addr learned my addr 172.21.15.52:0/2543287898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.234+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1a9a50 con 0x562731ecc370 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1aaec0 con 0x562731edc570 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc1aa120 con 0x562731ec72e0 2024-09-19T09:22:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 0x562731ed6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 msgr2=0x562731ed6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 0x562731ed6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2543287898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 msgr2=0x562731ed66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562731ed7430 con 0x562731ec72e0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fad9d640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 0x562731ed6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe50364d740 10 client.0 _ll_register_callbacks cb 0x7fe4ec0f38a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4fa59c640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed80e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x562731ec4050 tx=0x7fe4ec0ba530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5bad14c011e21c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4e1ffb640 10 client.25129 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4ec0bcb90 con 0x562731ec72e0 2024-09-19T09:22:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/2543287898 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec049040 con 0x562731ec72e0 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.235+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/2543287898 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe4ec0b8b00 con 0x562731ec72e0 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/2543287898 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe4ec0c0840 con 0x562731ec72e0 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 10 client.25129 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562731f50810 con 0x562731ec72e0 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/2543287898 <== mon.1 v2:172.21.15.169:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe4ec003c80 con 0x562731ec72e0 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 10 client.25129 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 10 client.25129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 20 client.25129 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.236+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731f51090 0x562731f534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.237+0000 7fe50364d740 4 client.25129 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.237+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562731e31d70 con 0x562731f51090 2024-09-19T09:22:00.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.237+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731f51090 0x562731f534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.237+0000 7fe4f9d9b640 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731f51090 0x562731f534d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f7d40c5125ae014 server_cookie=fb1ba8673d2f7821 in_seq=0 out_seq=0 2024-09-19T09:22:00.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.237+0000 7fe4e1ffb640 10 client.25129 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.241+0000 7fe4e1ffb640 1 -- 172.21.15.52:0/2543287898 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562731e31d70 con 0x562731f51090 2024-09-19T09:22:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.241+0000 7fe4e1ffb640 10 client.25129 handle_command_reply: tid=0 2024-09-19T09:22:00.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.241+0000 7fe50364d740 1 client.25129 shutdown 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 msgr2=0x562731ed80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed80e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x562731ec4050 tx=0x7fe4ec0ba530 comp rx=0 tx=0).stop 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 shutdown_connections 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562731f51090 0x562731f534d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562731edc570 0x562731ed6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe4e1ffb640 0 client.25129 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562731ecc370 0x562731ed66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 --2- 172.21.15.52:0/2543287898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562731ec72e0 0x562731ed80e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 >> 172.21.15.52:0/2543287898 conn(0x562731ec2010 msgr2=0x562731ec23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 shutdown_connections 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 1 -- 172.21.15.52:0/2543287898 wait complete. 2024-09-19T09:22:00.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.242+0000 7fe50364d740 20 client.25129 trim_cache size 0 max 16384 2024-09-19T09:22:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:22:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:22:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:22:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 msgr2=0x7fe4e40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 0x7fe4e40a5830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009270 tx=0x7fe4f4009200 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 msgr2=0x7fe4fc199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009230 tx=0x7fe4ec031b60 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 shutdown_connections 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4e40a3370 0x7fe4e40a5830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe4fc1016f0 0x7fe4fc1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4fc100d50 0x7fe4fc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 --2- 172.21.15.52:0/3638789076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4fc100410 0x7fe4fc199f70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.243+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 >> 172.21.15.52:0/3638789076 conn(0x7fe4fc0fc1e0 msgr2=0x7fe4fc0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.244+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 shutdown_connections 2024-09-19T09:22:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:00.244+0000 7fe5008ac640 1 -- 172.21.15.52:0/3638789076 wait complete. 2024-09-19T09:22:00.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:59 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:22:00.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:59 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:59 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:22:00.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:21:59 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.357 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:59 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:22:00.357 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:59 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.358 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:59 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:22:00.358 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:21:59 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:59 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:22:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:59 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:59 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:22:00.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:21:59 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:00.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.567+0000 7f86b49bb640 1 -- 172.21.15.52:0/3678995244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01036e0 msgr2=0x7f86b0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.567+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3678995244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01036e0 0x7f86b0107b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009930 tx=0x7f86a402a420 comp rx=0 tx=0).stop 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 -- 172.21.15.52:0/3678995244 shutdown_connections 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3678995244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b01082a0 0x7f86b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3678995244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01036e0 0x7f86b0107b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3678995244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b0102d30 0x7f86b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 -- 172.21.15.52:0/3678995244 >> 172.21.15.52:0/3678995244 conn(0x7f86b00fc7d0 msgr2=0x7f86b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 -- 172.21.15.52:0/3678995244 shutdown_connections 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.568+0000 7f86b49bb640 1 -- 172.21.15.52:0/3678995244 wait complete. 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.569+0000 7f86b49bb640 1 Processor -- start 2024-09-19T09:22:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.569+0000 7f86b49bb640 1 -- start start 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b0102d30 0x7f86b01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b01036e0 0x7f86b0198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01120a0 con 0x7f86b01082a0 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0111f20 con 0x7f86b0102d30 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86b49bb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86b0112220 con 0x7f86b01036e0 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45532/0 (socket says 172.21.15.52:45532) 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 -- 172.21.15.52:0/3450855324 learned_addr learned my addr 172.21.15.52:0/3450855324 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86add9b640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b01036e0 0x7f86b0198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86ae59c640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b0102d30 0x7f86b01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 -- 172.21.15.52:0/3450855324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b01036e0 msgr2=0x7f86b0198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b01036e0 0x7f86b0198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 -- 172.21.15.52:0/3450855324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b0102d30 msgr2=0x7f86b01985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b0102d30 0x7f86b01985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.570+0000 7f86aed9d640 1 -- 172.21.15.52:0/3450855324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b019d590 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.571+0000 7f86aed9d640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f86a800eb10 tx=0x7f86a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.571+0000 7f869f7fe640 1 -- 172.21.15.52:0/3450855324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8004b20 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.571+0000 7f869f7fe640 1 -- 172.21.15.52:0/3450855324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8004cc0 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.571+0000 7f869f7fe640 1 -- 172.21.15.52:0/3450855324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8010760 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.571+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b019d880 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.572+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b019dce0 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.574+0000 7f869f7fe640 1 -- 172.21.15.52:0/3450855324 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f86a8005000 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.575+0000 7f869f7fe640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 0x7f86980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.575+0000 7f869f7fe640 1 -- 172.21.15.52:0/3450855324 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86a80cff00 con 0x7f86b01082a0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.575+0000 7f86ae59c640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 0x7f86980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.575+0000 7f86b6d94740 1 Processor -- start 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86ae59c640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 0x7f86980a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009b60 tx=0x7f86a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 -- start start 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f562b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 0x55b7f5638a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b7f55912e0 con 0x55b7f562bdb0 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b7f5538ce0 con 0x55b7f5636670 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86b6d94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b7f558d2a0 con 0x55b7f562b490 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45546/0 (socket says 172.21.15.52:45546) 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.576+0000 7f86add9b640 1 -- 172.21.15.52:0/4275778657 learned_addr learned my addr 172.21.15.52:0/4275778657 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86ae59c640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f562b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86aed9d640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 0x55b7f5638a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 -- 172.21.15.52:0/4275778657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 msgr2=0x55b7f562b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f562b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 -- 172.21.15.52:0/4275778657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 msgr2=0x55b7f5638a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 0x55b7f5638a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 -- 172.21.15.52:0/4275778657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f551d440 con 0x55b7f562bdb0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86add9b640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f86a4000c00 tx=0x7f86a4005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c964d379cf5facb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.577+0000 7f86aed9d640 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 0x55b7f5638a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.578+0000 7f869cff9640 1 -- 172.21.15.52:0/4275778657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035040 con 0x55b7f562bdb0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.578+0000 7f869cff9640 1 -- 172.21.15.52:0/4275778657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a4004030 con 0x55b7f562bdb0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.578+0000 7f869cff9640 1 -- 172.21.15.52:0/4275778657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40055b0 con 0x55b7f562bdb0 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 -- 172.21.15.52:0/4275778657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 msgr2=0x55b7f5636130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f86a4000c00 tx=0x7f86a4005d50 comp rx=0 tx=0).stop 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 -- 172.21.15.52:0/4275778657 shutdown_connections 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f5636670 0x55b7f5638a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5636130 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 --2- 172.21.15.52:0/4275778657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f562b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 -- 172.21.15.52:0/4275778657 >> 172.21.15.52:0/4275778657 conn(0x55b7f5627a20 msgr2=0x55b7f5627e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 -- 172.21.15.52:0/4275778657 shutdown_connections 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.579+0000 7f86b6d94740 1 -- 172.21.15.52:0/4275778657 wait complete. 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 -- start start 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 Processor -- start 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56360d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45560/0 (socket says 172.21.15.52:45560) 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86add9b640 1 -- 172.21.15.52:0/32997074 learned_addr learned my addr 172.21.15.52:0/32997074 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f5633b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86ae59c640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b7f5639240 con 0x55b7f562bdb0 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b7f554c050 con 0x55b7f562b490 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.580+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b7f56393c0 con 0x55b7f5636670 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86aed9d640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f5633b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 -- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 msgr2=0x55b7f5633b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f5633b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 -- 172.21.15.52:0/32997074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 msgr2=0x55b7f5633380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86b6d94740 10 client.0 _ll_register_callbacks cb 0x55b7f558c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f53023c0 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86aed9d640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f5633b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86add9b640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a4004030 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f86ae59c640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56360d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86a0011870 tx=0x7f86a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c94985b1ceadd8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f8695ffb640 10 client.25247 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f8695ffb640 1 -- 172.21.15.52:0/32997074 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004460 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.581+0000 7f8695ffb640 1 -- 172.21.15.52:0/32997074 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86a00209b0 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f8695ffb640 1 -- 172.21.15.52:0/32997074 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f86a0020bd0 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 10 client.25247 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55b7f5644c70 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f8695ffb640 1 -- 172.21.15.52:0/32997074 <== mon.2 v2:172.21.15.86:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86a0027020 con 0x55b7f562b490 2024-09-19T09:22:00.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 10 client.25247 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 10 client.25247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 20 client.25247 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f5646090 0x55b7f5648500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 4 client.25247 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7f559e850 con 0x55b7f5646090 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.582+0000 7f86add9b640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f5646090 0x55b7f5648500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.583+0000 7f86add9b640 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f5646090 0x55b7f5648500 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d69639f8e721c7c server_cookie=b3431354a44a98fe in_seq=0 out_seq=0 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.583+0000 7f8695ffb640 10 client.25247 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.583+0000 7f8695ffb640 1 -- 172.21.15.52:0/32997074 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7f559e850 con 0x55b7f5646090 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f8695ffb640 10 client.25247 handle_command_reply: tid=0 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 client.25247 shutdown 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 msgr2=0x55b7f56360d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56360d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86a0011870 tx=0x7f86a0004730 comp rx=0 tx=0).stop 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 shutdown_connections 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f5646090 0x55b7f5648500 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f5633b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f5633380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 --2- 172.21.15.52:0/32997074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56360d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 >> 172.21.15.52:0/32997074 conn(0x55b7f5627a20 msgr2=0x55b7f562d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f8695ffb640 0 client.25247 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 shutdown_connections 2024-09-19T09:22:00.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 1 -- 172.21.15.52:0/32997074 wait complete. 2024-09-19T09:22:00.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.584+0000 7f86b6d94740 20 client.25247 trim_cache size 0 max 16384 2024-09-19T09:22:00.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 Processor -- start 2024-09-19T09:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 -- start start 2024-09-19T09:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f564dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562bdb0 0x55b7f564e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01adf20 con 0x55b7f5636670 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01ab7f0 con 0x55b7f562bdb0 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86b6d94740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01a9640 con 0x55b7f562b490 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45562/0 (socket says 172.21.15.52:45562) 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86aed9d640 1 -- 172.21.15.52:0/1950761625 learned_addr learned my addr 172.21.15.52:0/1950761625 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.619+0000 7f86ae59c640 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f564dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 -- 172.21.15.52:0/1950761625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 msgr2=0x55b7f564dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f564dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 -- 172.21.15.52:0/1950761625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562bdb0 msgr2=0x55b7f564e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562bdb0 0x55b7f564e2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 -- 172.21.15.52:0/1950761625 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f5638dd0 con 0x55b7f5636670 2024-09-19T09:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.620+0000 7f86aed9d640 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f86a80cd980 tx=0x7f86a809c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100fb154ac495c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.621+0000 7f8697fff640 1 -- 172.21.15.52:0/1950761625 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a80b4020 con 0x55b7f5636670 2024-09-19T09:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.621+0000 7f8697fff640 1 -- 172.21.15.52:0/1950761625 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a80cee50 con 0x55b7f5636670 2024-09-19T09:22:00.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.621+0000 7f8697fff640 1 -- 172.21.15.52:0/1950761625 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8098b10 con 0x55b7f5636670 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 -- 172.21.15.52:0/1950761625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 msgr2=0x55b7f562e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f86a80cd980 tx=0x7f86a809c270 comp rx=0 tx=0).stop 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 -- 172.21.15.52:0/1950761625 shutdown_connections 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f5636670 0x55b7f562e080 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562bdb0 0x55b7f564e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 --2- 172.21.15.52:0/1950761625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f562b490 0x55b7f564dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 -- 172.21.15.52:0/1950761625 >> 172.21.15.52:0/1950761625 conn(0x55b7f5627a20 msgr2=0x55b7f56324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.622+0000 7f86b6d94740 1 -- 172.21.15.52:0/1950761625 shutdown_connections 2024-09-19T09:22:00.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.623+0000 7f86b6d94740 1 -- 172.21.15.52:0/1950761625 wait complete. 2024-09-19T09:22:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.623+0000 7f86b6d94740 1 -- start start 2024-09-19T09:22:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.623+0000 7f86b6d94740 1 Processor -- start 2024-09-19T09:22:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86ae59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86ae59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:37772/0 (socket says 172.21.15.52:37772) 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86add9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45576/0 (socket says 172.21.15.52:45576) 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86ae59c640 1 -- 172.21.15.52:0/3495627423 learned_addr learned my addr 172.21.15.52:0/3495627423 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:00.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f563eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01a9cb0 con 0x55b7f562bdb0 2024-09-19T09:22:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01ab120 con 0x55b7f562b490 2024-09-19T09:22:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.624+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86b01aa380 con 0x55b7f5636670 2024-09-19T09:22:00.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86aed9d640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f563eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 -- 172.21.15.52:0/3495627423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 msgr2=0x55b7f563eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f563eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 -- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 msgr2=0x55b7f56ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86b6d94740 10 client.0 _ll_register_callbacks cb 0x7f86a0011c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f563f090 con 0x55b7f562bdb0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86a80cee50 con 0x55b7f562bdb0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f86add9b640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55b7f5632c10 tx=0x7f86a402a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6705a4712ac90d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.625+0000 7f8695ffb640 10 client.15567 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.626+0000 7f8695ffb640 1 -- 172.21.15.52:0/3495627423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4035040 con 0x55b7f562bdb0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.626+0000 7f8695ffb640 1 -- 172.21.15.52:0/3495627423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86a4005280 con 0x55b7f562bdb0 2024-09-19T09:22:00.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.626+0000 7f8695ffb640 1 -- 172.21.15.52:0/3495627423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f86a40054c0 con 0x55b7f562bdb0 2024-09-19T09:22:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.626+0000 7f86b6d94740 10 client.15567 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.626+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55b7f56abb80 con 0x55b7f562bdb0 2024-09-19T09:22:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f8695ffb640 1 -- 172.21.15.52:0/3495627423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86a40315b0 con 0x55b7f562bdb0 2024-09-19T09:22:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 10 client.15567 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:00.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 20 client.15567 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f56c1d60 0x55b7f56c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 4 client.15567 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b7f5598d60 con 0x55b7f56c1d60 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.627+0000 7f86ae59c640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f56c1d60 0x55b7f56c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f8695ffb640 10 client.15567 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f86ae59c640 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f56c1d60 0x55b7f56c4150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c1d200107d6a56 server_cookie=1091e67ef31ff05c in_seq=0 out_seq=0 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f8695ffb640 1 -- 172.21.15.52:0/3495627423 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b7f5598d60 con 0x55b7f56c1d60 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f8695ffb640 10 client.15567 handle_command_reply: tid=0 2024-09-19T09:22:00.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f86b6d94740 1 client.15567 shutdown 2024-09-19T09:22:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 msgr2=0x55b7f563e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.628+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55b7f5632c10 tx=0x7f86a402a9c0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 shutdown_connections 2024-09-19T09:22:00.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b7f56c1d60 0x55b7f56c4150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f8695ffb640 0 client.15567 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b7f5636670 0x55b7f563eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b7f562bdb0 0x55b7f563e610 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 --2- 172.21.15.52:0/3495627423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b7f562b490 0x55b7f56ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 >> 172.21.15.52:0/3495627423 conn(0x55b7f5627a20 msgr2=0x55b7f562cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 shutdown_connections 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 1 -- 172.21.15.52:0/3495627423 wait complete. 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.629+0000 7f86b6d94740 20 client.15567 trim_cache size 0 max 16384 2024-09-19T09:22:00.631 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "d08d974e-b881-4ea2-a770-cd531dbfc69c": { 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "d08d974e-b881-4ea2-a770-cd531dbfc69c", 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:00.632 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:00.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.630+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 msgr2=0x7f86980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.630+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 0x7f86980a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009b60 tx=0x7f86a0005f90 comp rx=0 tx=0).stop 2024-09-19T09:22:00.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.630+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 msgr2=0x7f86b019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.630+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f86a800eb10 tx=0x7f86a800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 shutdown_connections 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86b01082a0 0x7f86b019ceb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86980a3240 0x7f86980a5700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86b01036e0 0x7f86b0198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 --2- 172.21.15.52:0/3450855324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86b0102d30 0x7f86b01985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 >> 172.21.15.52:0/3450855324 conn(0x7f86b00fc7d0 msgr2=0x7f86b0105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 shutdown_connections 2024-09-19T09:22:00.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:00.631+0000 7f86b49bb640 1 -- 172.21.15.52:0/3450855324 wait complete. 2024-09-19T09:22:01.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:00 smithi086 ceph-mon[34813]: pgmap v355: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:22:01.293 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:00 smithi052 ceph-mon[30947]: pgmap v355: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:22:01.335 INFO:tasks.cephfs.filesystem:scrub status for tag:d08d974e-b881-4ea2-a770-cd531dbfc69c - {'path': '/', 'tag': 'd08d974e-b881-4ea2-a770-cd531dbfc69c', 'options': 'recursive,force'} 2024-09-19T09:22:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:00 smithi169 ceph-mon[35454]: pgmap v355: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:22:03.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:02 smithi086 ceph-mon[34813]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:03.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:02 smithi052 ceph-mon[30947]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:02 smithi169 ceph-mon[35454]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:04.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:03 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:22:04.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:03 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:22:04.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:03 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:22:05.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:04 smithi086 ceph-mon[34813]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T09:22:05.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:04 smithi052 ceph-mon[30947]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T09:22:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:04 smithi169 ceph-mon[35454]: pgmap v357: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T09:22:07.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:06 smithi086 ceph-mon[34813]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:22:07.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:06 smithi052 ceph-mon[30947]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:22:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:06 smithi169 ceph-mon[35454]: pgmap v358: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-19T09:22:09.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:09 smithi086 ceph-mon[34813]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:09.295 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:09 smithi052 ceph-mon[30947]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:09 smithi169 ceph-mon[35454]: pgmap v359: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:11.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:11 smithi086 ceph-mon[34813]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:11.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:11 smithi052 ceph-mon[30947]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:11 smithi169 ceph-mon[35454]: pgmap v360: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:13.257 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:13 smithi086 ceph-mon[34813]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 -- 172.21.15.52:0/3066626281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8107880 msgr2=0x7f2be8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 --2- 172.21.15.52:0/3066626281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8107880 0x7f2be8109c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009ca0 tx=0x7f2be002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 -- 172.21.15.52:0/3066626281 shutdown_connections 2024-09-19T09:22:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 --2- 172.21.15.52:0/3066626281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8107880 0x7f2be8109c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 --2- 172.21.15.52:0/3066626281 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be8104f50 0x7f2be8107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 --2- 172.21.15.52:0/3066626281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.338+0000 7f2beff1f640 1 -- 172.21.15.52:0/3066626281 >> 172.21.15.52:0/3066626281 conn(0x7f2be80fc1e0 msgr2=0x7f2be80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.339+0000 7f2beff1f640 1 -- 172.21.15.52:0/3066626281 shutdown_connections 2024-09-19T09:22:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.339+0000 7f2beff1f640 1 -- 172.21.15.52:0/3066626281 wait complete. 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.339+0000 7f2beff1f640 1 Processor -- start 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.339+0000 7f2beff1f640 1 -- start start 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be8107880 0x7f2be819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2be810d7e0 con 0x7f2be8104f50 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2be810d660 con 0x7f2be8102620 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2beff1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2be810d960 con 0x7f2be8107880 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40120/0 (socket says 172.21.15.52:40120) 2024-09-19T09:22:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bed4ba640 1 -- 172.21.15.52:0/1755619961 learned_addr learned my addr 172.21.15.52:0/1755619961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 -- 172.21.15.52:0/1755619961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be8107880 msgr2=0x7f2be819f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be8107880 0x7f2be819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 -- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 msgr2=0x7f2be8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 -- 172.21.15.52:0/1755619961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be8100490 con 0x7f2be8102620 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.340+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8197de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e9f0 tx=0x7f2be400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.341+0000 7f2bdeffd640 1 -- 172.21.15.52:0/1755619961 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be400ccc0 con 0x7f2be8102620 2024-09-19T09:22:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.341+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be8100780 con 0x7f2be8102620 2024-09-19T09:22:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.341+0000 7f2bdeffd640 1 -- 172.21.15.52:0/1755619961 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be4010910 con 0x7f2be8102620 2024-09-19T09:22:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.342+0000 7f2bdeffd640 1 -- 172.21.15.52:0/1755619961 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4018960 con 0x7f2be8102620 2024-09-19T09:22:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.342+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be8100d20 con 0x7f2be8102620 2024-09-19T09:22:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.344+0000 7f2bf2cb4740 1 Processor -- start 2024-09-19T09:22:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.344+0000 7f2bf2cb4740 1 -- start start 2024-09-19T09:22:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.344+0000 7f2bdeffd640 1 -- 172.21.15.52:0/1755619961 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2be4010ac0 con 0x7f2be8102620 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x56490871cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x56490871f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56490867b2f0 con 0x5649087179a0 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564908623270 con 0x5649087182e0 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649086772b0 con 0x56490871d370 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40136/0 (socket says 172.21.15.52:40136) 2024-09-19T09:22:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 -- 172.21.15.52:0/1888346657 learned_addr learned my addr 172.21.15.52:0/1888346657 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x56490871f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x56490871cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 -- 172.21.15.52:0/1888346657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 msgr2=0x56490871f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x56490871f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 -- 172.21.15.52:0/1888346657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 msgr2=0x56490871cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x56490871cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bee4bc640 1 -- 172.21.15.52:0/1888346657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564908622340 con 0x5649087179a0 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.345+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x56490871cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009bf0 tx=0x7f2be00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2328b8710027cb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bdeffd640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 0x7f2bd40a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bd3fff640 1 -- 172.21.15.52:0/1888346657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0031bb0 con 0x5649087179a0 2024-09-19T09:22:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bdeffd640 1 -- 172.21.15.52:0/1755619961 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2be40cfe50 con 0x7f2be8102620 2024-09-19T09:22:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bd3fff640 1 -- 172.21.15.52:0/1888346657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be0036040 con 0x5649087179a0 2024-09-19T09:22:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bd3fff640 1 -- 172.21.15.52:0/1888346657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be002fbb0 con 0x5649087179a0 2024-09-19T09:22:13.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.346+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 0x7f2bd40a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bedcbb640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 0x7f2bd40a56a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2be40cdc40 tx=0x7f2be400ce60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/1888346657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 msgr2=0x564908717da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009bf0 tx=0x7f2be00093d0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/1888346657 shutdown_connections 2024-09-19T09:22:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x56490871f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x56490871cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/1888346657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x564908717da0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/1888346657 >> 172.21.15.52:0/1888346657 conn(0x564908713010 msgr2=0x564908713410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/1888346657 shutdown_connections 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.347+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/1888346657 wait complete. 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.348+0000 7f2bf2cb4740 1 -- start start 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.348+0000 7f2bf2cb4740 1 Processor -- start 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.348+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908721ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.348+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.348+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908729120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40150/0 (socket says 172.21.15.52:40150) 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 -- 172.21.15.52:0/2281827855 learned_addr learned my addr 172.21.15.52:0/2281827855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649087202e0 con 0x5649087182e0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564908604290 con 0x5649087179a0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564908720460 con 0x56490871d370 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908721ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bf2cb4740 10 client.0 _ll_register_callbacks cb 0x564908635140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 -- 172.21.15.52:0/2281827855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 msgr2=0x564908729120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908729120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908729120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 -- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 msgr2=0x564908721ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908721ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490838e210 con 0x5649087182e0 2024-09-19T09:22:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908729120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80044c0 tx=0x7f2bd80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5d2bdaec6173a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd801ce00 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2bd80114a0 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.349+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2be0036040 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2bd802c050 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 10 client.15579 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56490845a620 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bd8020030 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2bd8010940 con 0x5649087182e0 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 10 client.15579 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 20 client.15579 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56490872d870 0x56490872fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 4 client.15579 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2be0036040 con 0x56490872d870 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.350+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56490872d870 0x56490872fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.351+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56490872d870 0x56490872fcc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd7feea2fe1bd7cf server_cookie=7433bfe7922aaedb in_seq=0 out_seq=0 2024-09-19T09:22:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.351+0000 7f2bd17fa640 10 client.15579 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2281827855 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2be0036040 con 0x56490872d870 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bd17fa640 10 client.15579 handle_command_reply: tid=0 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 client.15579 shutdown 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 msgr2=0x5649087220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80044c0 tx=0x7f2bd80039c0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 shutdown_connections 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56490872d870 0x56490872fcc0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908729120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bd17fa640 0 client.15579 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x5649087220e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2281827855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908721ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 >> 172.21.15.52:0/2281827855 conn(0x564908713010 msgr2=0x564908714820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 shutdown_connections 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2281827855 wait complete. 2024-09-19T09:22:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.352+0000 7f2bf2cb4740 20 client.15579 trim_cache size 0 max 16384 2024-09-19T09:22:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 Processor -- start 2024-09-19T09:22:13.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 -- start start 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x5649087290e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908714400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a9760 con 0x5649087179a0 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a7030 con 0x5649087182e0 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bf2cb4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a4e80 con 0x56490871d370 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bee4bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bee4bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40154/0 (socket says 172.21.15.52:40154) 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.381+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2704150108 learned_addr learned my addr 172.21.15.52:0/2704150108 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x5649087290e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2704150108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 msgr2=0x564908714400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908714400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2704150108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 msgr2=0x5649087290e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x5649087290e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2704150108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649087190b0 con 0x5649087179a0 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2be0000f80 tx=0x7f2be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59d5c056596e61b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bd37fe640 1 -- 172.21.15.52:0/2704150108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0031650 con 0x5649087179a0 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bd37fe640 1 -- 172.21.15.52:0/2704150108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be0036040 con 0x5649087179a0 2024-09-19T09:22:13.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.382+0000 7f2bd37fe640 1 -- 172.21.15.52:0/2704150108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0030820 con 0x5649087179a0 2024-09-19T09:22:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2704150108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 msgr2=0x5649087120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2be0000f80 tx=0x7f2be0004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2704150108 shutdown_connections 2024-09-19T09:22:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908714400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.387 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087182e0 0x5649087290e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2704150108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087179a0 0x5649087120b0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2704150108 >> 172.21.15.52:0/2704150108 conn(0x564908713010 msgr2=0x5649087119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2704150108 shutdown_connections 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.383+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2704150108 wait complete. 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bf2cb4740 1 -- start start 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bf2cb4740 1 Processor -- start 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908726960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.388 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bf2cb4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bed4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40162/0 (socket says 172.21.15.52:40162) 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bed4ba640 1 -- 172.21.15.52:0/2282819534 learned_addr learned my addr 172.21.15.52:0/2282819534 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908727eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.384+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908726960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a54f0 con 0x5649087182e0 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a6960 con 0x5649087179a0 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2be81a5bc0 con 0x56490871d370 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2282819534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 msgr2=0x564908727eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908727eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2282819534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 msgr2=0x564908726ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649087284c0 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bf2cb4740 10 client.0 _ll_register_callbacks cb 0x7f2bd800bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2be0036040 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bee4bc640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908726960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2be00319e0 tx=0x7f2be0009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a2c8322f81d668 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bd17fa640 10 client.25268 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2282819534 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0055620 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.385+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2282819534 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2be00557c0 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2282819534 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2be0055a00 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 10 client.25268 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5649087985a0 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2282819534 <== mon.2 v2:172.21.15.86:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2be005d030 con 0x5649087179a0 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 10 client.25268 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:13.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 10 client.25268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 20 client.25268 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649087988a0 0x56490879ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 4 client.25268 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564908688a20 con 0x5649087988a0 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.386+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649087988a0 0x56490879ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.387+0000 7f2bd17fa640 10 client.25268 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.387+0000 7f2bed4ba640 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649087988a0 0x56490879ac90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489ff7cd5a0cd959 server_cookie=e22a5b290ce80efa in_seq=0 out_seq=0 2024-09-19T09:22:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.390+0000 7f2bd17fa640 1 -- 172.21.15.52:0/2282819534 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564908688a20 con 0x5649087988a0 2024-09-19T09:22:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.390+0000 7f2bd17fa640 10 client.25268 handle_command_reply: tid=0 2024-09-19T09:22:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.390+0000 7f2bf2cb4740 1 client.25268 shutdown 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 msgr2=0x564908726960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908726960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2be00319e0 tx=0x7f2be0009880 comp rx=0 tx=0).stop 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 shutdown_connections 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649087988a0 0x56490879ac90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bd17fa640 0 client.25268 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56490871d370 0x564908727eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649087182e0 0x564908726ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 --2- 172.21.15.52:0/2282819534 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649087179a0 0x564908726960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 >> 172.21.15.52:0/2282819534 conn(0x564908713010 msgr2=0x5649087121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 shutdown_connections 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 1 -- 172.21.15.52:0/2282819534 wait complete. 2024-09-19T09:22:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.391+0000 7f2bf2cb4740 20 client.25268 trim_cache size 0 max 16384 2024-09-19T09:22:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:22:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:22:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:22:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 msgr2=0x7f2bd40a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 0x7f2bd40a56a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2be40cdc40 tx=0x7f2be400ce60 comp rx=0 tx=0).stop 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 msgr2=0x7f2be8197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8197de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2be400e9f0 tx=0x7f2be400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 shutdown_connections 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bd40a31e0 0x7f2bd40a56a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2be8107880 0x7f2be819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2be8104f50 0x7f2be8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 --2- 172.21.15.52:0/1755619961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2be8102620 0x7f2be8197de0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 >> 172.21.15.52:0/1755619961 conn(0x7f2be80fc1e0 msgr2=0x7f2be8102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 shutdown_connections 2024-09-19T09:22:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:13.392+0000 7f2beff1f640 1 -- 172.21.15.52:0/1755619961 wait complete. 2024-09-19T09:22:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:13 smithi052 ceph-mon[30947]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:13 smithi169 ceph-mon[35454]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:15 smithi052 ceph-mon[30947]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:15 smithi169 ceph-mon[35454]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:15 smithi086 ceph-mon[34813]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T09:22:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:17 smithi052 ceph-mon[30947]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:22:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:17 smithi169 ceph-mon[35454]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:22:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:17 smithi086 ceph-mon[34813]: pgmap v363: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T09:22:19.308 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:22:19.308 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:22:19.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:19.332 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:19 smithi052 ceph-mon[30947]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:22:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:19 smithi169 ceph-mon[35454]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:22:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:19 smithi086 ceph-mon[34813]: pgmap v364: 97 pgs: 97 active+clean; 664 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T09:22:19.579 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:20.090 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 92% (11876/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 -- 172.21.15.52:0/327045505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae801008d0 msgr2=0x7fae80100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 --2- 172.21.15.52:0/327045505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae801008d0 0x7fae80100cb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fae70009900 tx=0x7fae7002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 -- 172.21.15.52:0/327045505 shutdown_connections 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 --2- 172.21.15.52:0/327045505 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8010e480 0x7fae80110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 --2- 172.21.15.52:0/327045505 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae80101280 0x7fae8010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 --2- 172.21.15.52:0/327045505 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae801008d0 0x7fae80100cb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 -- 172.21.15.52:0/327045505 >> 172.21.15.52:0/327045505 conn(0x7fae800fc7a0 msgr2=0x7fae800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 -- 172.21.15.52:0/327045505 shutdown_connections 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 -- 172.21.15.52:0/327045505 wait complete. 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.208+0000 7fae859c4640 1 Processor -- start 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 -- start start 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 0x7fae8019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae80101280 0x7fae8019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fae80114190 con 0x7fae8010e480 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fae80114010 con 0x7fae801008d0 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae859c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae80114310 con 0x7fae80101280 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53610/0 (socket says 172.21.15.52:53610) 2024-09-19T09:22:20.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 -- 172.21.15.52:0/3531172692 learned_addr learned my addr 172.21.15.52:0/3531172692 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7effd640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 0x7fae8019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae77fff640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae80101280 0x7fae8019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 -- 172.21.15.52:0/3531172692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae80101280 msgr2=0x7fae8019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae80101280 0x7fae8019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 -- 172.21.15.52:0/3531172692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 msgr2=0x7fae8019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 0x7fae8019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7f7fe640 1 -- 172.21.15.52:0/3531172692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8019f5e0 con 0x7fae8010e480 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.209+0000 7fae7effd640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 0x7fae8019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae7f7fe640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fae7800cce0 tx=0x7fae7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7800f450 con 0x7fae8010e480 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae7800fad0 con 0x7fae8010e480 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8019f8d0 con 0x7fae8010e480 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae78018bd0 con 0x7fae8010e480 2024-09-19T09:22:20.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.210+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae801a71b0 con 0x7fae8010e480 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.211+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae80100cb0 con 0x7fae8010e480 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.212+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fae7800fc80 con 0x7fae8010e480 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.213+0000 7fae849c2640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 0x7fae6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.214+0000 7fae7effd640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 0x7fae6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.214+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fae780d0110 con 0x7fae8010e480 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.214+0000 7fae7effd640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 0x7fae6c0a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae70005ab0 tx=0x7fae70005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:20.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.218+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae78014030 con 0x7fae8010e480 2024-09-19T09:22:20.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.436+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae80109670 con 0x7fae8010e480 2024-09-19T09:22:20.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.436+0000 7fae849c2640 1 -- 172.21.15.52:0/3531172692 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fae7809cd50 con 0x7fae8010e480 2024-09-19T09:22:20.437 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:22:20.437 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:22:20.438 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:22:20.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 msgr2=0x7fae6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:20.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 0x7fae6c0a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae70005ab0 tx=0x7fae70005a20 comp rx=0 tx=0).stop 2024-09-19T09:22:20.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 msgr2=0x7fae8019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fae7800cce0 tx=0x7fae7800a620 comp rx=0 tx=0).stop 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 shutdown_connections 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fae8010e480 0x7fae8019ef00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fae6c0a3240 0x7fae6c0a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae80101280 0x7fae8019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 --2- 172.21.15.52:0/3531172692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae801008d0 0x7fae8019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 >> 172.21.15.52:0/3531172692 conn(0x7fae800fc7a0 msgr2=0x7fae800feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 shutdown_connections 2024-09-19T09:22:20.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:20.439+0000 7fae859c4640 1 -- 172.21.15.52:0/3531172692 wait complete. 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.516 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-19T09:22:20.517 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:22:20.521 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:22:20.630 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:22:20.632 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:22:20.632 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:22:21.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:21 smithi052 ceph-mon[30947]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:21.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:21 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3531172692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:21 smithi169 ceph-mon[35454]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:21 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3531172692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:21.506 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:22:21.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:22:21.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:21 smithi086 ceph-mon[34813]: pgmap v365: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:21 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3531172692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:21.775 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:21.976 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:22:22.086 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:22:22.136 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:22:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:22:22.138 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:22:22.178 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:22:22.182 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:22:22.182 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:22:22.198 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-19T09:22:22.200 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-19T09:22:22.200 DEBUG:teuthology.orchestra.run.smithi052:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T09:22:22.261 INFO:tasks.workunit.client.0.smithi052.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T09:22:22.262 INFO:tasks.workunit.client.0.smithi052.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-19T09:22:22.262 INFO:tasks.workunit.client.0.smithi052.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-19T09:22:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- 172.21.15.52:0/3316059225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 msgr2=0x7feb241067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 --2- 172.21.15.52:0/3316059225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb241067f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb14009900 tx=0x7feb1402a410 comp rx=0 tx=0).stop 2024-09-19T09:22:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- 172.21.15.52:0/3316059225 shutdown_connections 2024-09-19T09:22:22.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 --2- 172.21.15.52:0/3316059225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24106f20 0x7feb2410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 --2- 172.21.15.52:0/3316059225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb241067f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 --2- 172.21.15.52:0/3316059225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24101df0 0x7feb241021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- 172.21.15.52:0/3316059225 >> 172.21.15.52:0/3316059225 conn(0x7feb240fd8b0 msgr2=0x7feb240ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- 172.21.15.52:0/3316059225 shutdown_connections 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- 172.21.15.52:0/3316059225 wait complete. 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 Processor -- start 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.342+0000 7feb2c45b640 1 -- start start 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 0x7feb2419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24106f20 0x7feb2419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb24111fd0 con 0x7feb241027a0 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb24111e50 con 0x7feb24101df0 2024-09-19T09:22:22.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2c45b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb24112150 con 0x7feb24106f20 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53634/0 (socket says 172.21.15.52:53634) 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 -- 172.21.15.52:0/714799379 learned_addr learned my addr 172.21.15.52:0/714799379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24106f20 0x7feb2419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 0x7feb2419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 -- 172.21.15.52:0/714799379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24106f20 msgr2=0x7feb2419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24106f20 0x7feb2419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 -- 172.21.15.52:0/714799379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 msgr2=0x7feb2419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 0x7feb2419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 -- 172.21.15.52:0/714799379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2419f670 con 0x7feb241027a0 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 0x7feb2419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:22.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb299f6640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7feb14006010 tx=0x7feb14003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb1b7fe640 1 -- 172.21.15.52:0/714799379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1403f070 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.343+0000 7feb1b7fe640 1 -- 172.21.15.52:0/714799379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb14031c90 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.344+0000 7feb1b7fe640 1 -- 172.21.15.52:0/714799379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14035030 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.344+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2419f900 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.344+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb241a7240 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb1b7fe640 1 -- 172.21.15.52:0/714799379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feb14042070 con 0x7feb241027a0 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 Processor -- start 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 -- start start 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520eb9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a520e1e160 con 0x55a520ec4a30 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a520dc5720 con 0x55a520eba170 2024-09-19T09:22:22.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.346+0000 7feb2e834740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a520e1a120 con 0x55a520eb9850 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb1b7fe640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 0x7feb100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53642/0 (socket says 172.21.15.52:53642) 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 -- 172.21.15.52:0/1460232727 learned_addr learned my addr 172.21.15.52:0/1460232727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520eb9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 0x7feb100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb1b7fe640 1 -- 172.21.15.52:0/714799379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb140f0340 con 0x7feb241027a0 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 -- 172.21.15.52:0/1460232727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 msgr2=0x55a520eb9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520eb9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 -- 172.21.15.52:0/1460232727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 msgr2=0x55a520ec44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 -- 172.21.15.52:0/1460232727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a520b8fba0 con 0x55a520ec4a30 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb299f6640 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feb140bc5e0 tx=0x7feb14009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17f42af2dec3af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 0x7feb100a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00bfd0 tx=0x7feb1c005c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.347+0000 7feb18dea640 1 -- 172.21.15.52:0/1460232727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140a70c0 con 0x55a520ec4a30 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb18dea640 1 -- 172.21.15.52:0/1460232727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140bcfe0 con 0x55a520ec4a30 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb18dea640 1 -- 172.21.15.52:0/1460232727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140b8f50 con 0x55a520ec4a30 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 -- 172.21.15.52:0/1460232727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 msgr2=0x55a520ec6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7feb140bc5e0 tx=0x7feb14009260 comp rx=0 tx=0).stop 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 -- 172.21.15.52:0/1460232727 shutdown_connections 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec6e20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 --2- 172.21.15.52:0/1460232727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520eb9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 -- 172.21.15.52:0/1460232727 >> 172.21.15.52:0/1460232727 conn(0x55a520eb5de0 msgr2=0x55a520eb61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:22.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 -- 172.21.15.52:0/1460232727 shutdown_connections 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.348+0000 7feb2e834740 1 -- 172.21.15.52:0/1460232727 wait complete. 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 -- start start 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 Processor -- start 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a520ec73c0 con 0x55a520ec4a30 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a520da6900 con 0x55a520eba170 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a520ec7540 con 0x55a520eb9850 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.349+0000 7feb2e834740 10 client.0 _ll_register_callbacks cb 0x55a520da4780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb2a9f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:53604/0 (socket says 172.21.15.52:53604) 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 -- 172.21.15.52:0/3550555728 learned_addr learned my addr 172.21.15.52:0/3550555728 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 -- 172.21.15.52:0/3550555728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 msgr2=0x55a520ec1950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec1950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 -- 172.21.15.52:0/3550555728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 msgr2=0x55a520ec23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 -- 172.21.15.52:0/3550555728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a520de6c50 con 0x55a520eba170 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb299f6640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb140a7260 tx=0x7feb14034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b850733d723c9287 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14049030 con 0x55a520eba170 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb140bcfe0 con 0x55a520eba170 2024-09-19T09:22:22.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb140b8f50 con 0x55a520eba170 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.350+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feb140da070 con 0x55a520eba170 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 10 client.25280 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a520ec73c0 con 0x55a520eba170 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140bcfe0 con 0x55a520eba170 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feb1403b5f0 con 0x55a520eba170 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 10 client.25280 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 10 client.25280 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 20 client.25280 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520ed4230 0x55a520ed6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 4 client.25280 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a520e2b890 con 0x55a520ed4230 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.351+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520ed4230 0x55a520ed6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.352+0000 7feb0dffb640 10 client.25280 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:22.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.352+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520ed4230 0x55a520ed6680 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1f13a8c60d8834 server_cookie=344c56c42e781999 in_seq=0 out_seq=0 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.352+0000 7feb0dffb640 1 -- 172.21.15.52:0/3550555728 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a520e2b890 con 0x55a520ed4230 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.352+0000 7feb0dffb640 10 client.25280 handle_command_reply: tid=0 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 client.25280 shutdown 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 msgr2=0x55a520ec1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb140a7260 tx=0x7feb14034000 comp rx=0 tx=0).stop 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 shutdown_connections 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520ed4230 0x55a520ed6680 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520ec4a30 0x55a520ec23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec1e90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb0dffb640 0 client.25280 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 --2- 172.21.15.52:0/3550555728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 >> 172.21.15.52:0/3550555728 conn(0x55a520eb5de0 msgr2=0x55a520ebbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 shutdown_connections 2024-09-19T09:22:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 1 -- 172.21.15.52:0/3550555728 wait complete. 2024-09-19T09:22:22.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.353+0000 7feb2e834740 20 client.25280 trim_cache size 0 max 16384 2024-09-19T09:22:22.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 Processor -- start 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 -- start start 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 0x55a520edc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb241b22b0 con 0x55a520eba170 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb241afb80 con 0x55a520ec4a30 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2e834740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb241ad9d0 con 0x55a520eb9850 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb299f6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53660/0 (socket says 172.21.15.52:53660) 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb299f6640 1 -- 172.21.15.52:0/677853468 learned_addr learned my addr 172.21.15.52:0/677853468 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.370+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 0x55a520edc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 -- 172.21.15.52:0/677853468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 msgr2=0x55a520ec0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 -- 172.21.15.52:0/677853468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 msgr2=0x55a520edc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 0x55a520edc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 -- 172.21.15.52:0/677853468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a520ebfea0 con 0x55a520eba170 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 0x55a520edc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb299f6640 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb140c5020 tx=0x7feb140badf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e44a2acff48c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb0ffff640 1 -- 172.21.15.52:0/677853468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14049070 con 0x55a520eba170 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb0ffff640 1 -- 172.21.15.52:0/677853468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140d5070 con 0x55a520eba170 2024-09-19T09:22:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.371+0000 7feb0ffff640 1 -- 172.21.15.52:0/677853468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb140b8f50 con 0x55a520eba170 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- 172.21.15.52:0/677853468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 msgr2=0x55a520edbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7feb140c5020 tx=0x7feb140badf0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- 172.21.15.52:0/677853468 shutdown_connections 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520ec4a30 0x55a520edc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eba170 0x55a520edbf50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- 172.21.15.52:0/677853468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520eb9850 0x55a520ec0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- 172.21.15.52:0/677853468 >> 172.21.15.52:0/677853468 conn(0x55a520eb5de0 msgr2=0x55a520ec00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- 172.21.15.52:0/677853468 shutdown_connections 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- 172.21.15.52:0/677853468 wait complete. 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- start start 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 Processor -- start 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520ec4a30 0x55a520ec91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb241ae040 con 0x55a520eb9850 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb241af4b0 con 0x55a520eba170 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb241ae710 con 0x55a520ec4a30 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2e834740 10 client.0 _ll_register_callbacks cb 0x7feb2000b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.372+0000 7feb2a1f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53672/0 (socket says 172.21.15.52:53672) 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 -- 172.21.15.52:0/1669673051 learned_addr learned my addr 172.21.15.52:0/1669673051 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a9f8640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520ec4a30 0x55a520ec91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb299f6640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 -- 172.21.15.52:0/1669673051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520ec4a30 msgr2=0x55a520ec91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520ec4a30 0x55a520ec91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 -- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 msgr2=0x55a520ec8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 -- 172.21.15.52:0/1669673051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a520f3e1f0 con 0x55a520eb9850 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2a1f7640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55a520ed6ef0 tx=0x7feb20019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a69ba25fcd20033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20005230 con 0x55a520eb9850 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb200053d0 con 0x55a520eb9850 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb140d5070 con 0x55a520eb9850 2024-09-19T09:22:22.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feb20026020 con 0x55a520eb9850 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2e834740 10 client.15609 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.373+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a520f3f4a0 con 0x55a520eb9850 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140d5070 con 0x55a520eb9850 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feb2000f9c0 con 0x55a520eb9850 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 10 client.15609 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 10 client.15609 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 20 client.15609 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520f3fb90 0x55a520f41fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 4 client.15609 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55a520eb1410 con 0x55a520f3fb90 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.374+0000 7feb299f6640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520f3fb90 0x55a520f41fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.375+0000 7feb0dffb640 10 client.15609 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:22.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:22.375+0000 7feb299f6640 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520f3fb90 0x55a520f41fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e42ffef6855b92f4 server_cookie=ed5935cd425539da in_seq=0 out_seq=0 2024-09-19T09:22:23.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb0dffb640 1 -- 172.21.15.52:0/1669673051 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a520eb1410 con 0x55a520f3fb90 2024-09-19T09:22:23.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb0dffb640 10 client.15609 handle_command_reply: tid=0 2024-09-19T09:22:23.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb2e834740 1 client.15609 shutdown 2024-09-19T09:22:23.277 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:23 smithi052 ceph-mon[30947]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:23.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 msgr2=0x55a520ec8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:23.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55a520ed6ef0 tx=0x7feb20019670 comp rx=0 tx=0).stop 2024-09-19T09:22:23.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.276+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 shutdown_connections 2024-09-19T09:22:23.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a520f3fb90 0x55a520f41fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a520ec4a30 0x55a520ec91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a520eba170 0x55a520ec8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 --2- 172.21.15.52:0/1669673051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a520eb9850 0x55a520ec8740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb0dffb640 0 client.15609 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 >> 172.21.15.52:0/1669673051 conn(0x55a520eb5de0 msgr2=0x55a520ec2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 shutdown_connections 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 1 -- 172.21.15.52:0/1669673051 wait complete. 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.277+0000 7feb2e834740 20 client.15609 trim_cache size 0 max 16384 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:23.279 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 6, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "5c586c34": { 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 6, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 140.3, 2024-09-19T09:22:23.280 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:23.281 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 msgr2=0x7feb100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 0x7feb100a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb1c00bfd0 tx=0x7feb1c005c20 comp rx=0 tx=0).stop 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 msgr2=0x7feb2419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7feb14006010 tx=0x7feb14003ba0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 shutdown_connections 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb100a3240 0x7feb100a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb24106f20 0x7feb2419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb241027a0 0x7feb2419ac00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 --2- 172.21.15.52:0/714799379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb24101df0 0x7feb2419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:23.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 >> 172.21.15.52:0/714799379 conn(0x7feb240fd8b0 msgr2=0x7feb240feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:23.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 shutdown_connections 2024-09-19T09:22:23.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:23.278+0000 7feb2c45b640 1 -- 172.21.15.52:0/714799379 wait complete. 2024-09-19T09:22:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:23 smithi169 ceph-mon[35454]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:23 smithi086 ceph-mon[34813]: pgmap v366: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:22:23.982 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5c586c34', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T09:22:25.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:25 smithi052 ceph-mon[30947]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:22:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:25 smithi169 ceph-mon[35454]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:22:25.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:25 smithi086 ceph-mon[34813]: pgmap v367: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:22:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 -- 172.21.15.52:0/239225670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c101c50 msgr2=0x7fca2c1020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 --2- 172.21.15.52:0/239225670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c101c50 0x7fca2c1020d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fca20009900 tx=0x7fca2002a410 comp rx=0 tx=0).stop 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 -- 172.21.15.52:0/239225670 shutdown_connections 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 --2- 172.21.15.52:0/239225670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 0x7fca2c108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 --2- 172.21.15.52:0/239225670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c101c50 0x7fca2c1020d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 --2- 172.21.15.52:0/239225670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca2c100a60 0x7fca2c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 -- 172.21.15.52:0/239225670 >> 172.21.15.52:0/239225670 conn(0x7fca2c0fc1e0 msgr2=0x7fca2c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 -- 172.21.15.52:0/239225670 shutdown_connections 2024-09-19T09:22:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.496+0000 7fca30cba640 1 -- 172.21.15.52:0/239225670 wait complete. 2024-09-19T09:22:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 Processor -- start 2024-09-19T09:22:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 -- start start 2024-09-19T09:22:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca2c101c50 0x7fca2c103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.499 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 0x7fca2c103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c10c6c0 con 0x7fca2c100a60 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c10c540 con 0x7fca2c102610 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca30cba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c10c840 con 0x7fca2c101c50 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53684/0 (socket says 172.21.15.52:53684) 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 -- 172.21.15.52:0/1363230149 learned_addr learned my addr 172.21.15.52:0/1363230149 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 0x7fca2c103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 -- 172.21.15.52:0/1363230149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca2c101c50 msgr2=0x7fca2c103030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca2c101c50 0x7fca2c103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 -- 172.21.15.52:0/1363230149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 msgr2=0x7fca2c103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 0x7fca2c103570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.500 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 -- 172.21.15.52:0/1363230149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c103e00 con 0x7fca2c100a60 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.497+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00d770 tx=0x7fca1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.498+0000 7fca1b7fe640 1 -- 172.21.15.52:0/1363230149 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c017070 con 0x7fca2c100a60 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.498+0000 7fca1b7fe640 1 -- 172.21.15.52:0/1363230149 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c009c30 con 0x7fca2c100a60 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.498+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c1a1f00 con 0x7fca2c100a60 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.498+0000 7fca1b7fe640 1 -- 172.21.15.52:0/1363230149 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c003dd0 con 0x7fca2c100a60 2024-09-19T09:22:26.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.498+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c1a2360 con 0x7fca2c100a60 2024-09-19T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.500+0000 7fca1b7fe640 1 -- 172.21.15.52:0/1363230149 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca1c003fb0 con 0x7fca2c100a60 2024-09-19T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.500+0000 7fca33a58740 1 Processor -- start 2024-09-19T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 -- start start 2024-09-19T09:22:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9fb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c9572f0 con 0x55cc5c9f42e0 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c8ff270 con 0x55cc5c9f39a0 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca33a58740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c9532b0 con 0x55cc5c9f9370 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca1b7fe640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 0x7fca140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53686/0 (socket says 172.21.15.52:53686) 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca2a59c640 1 -- 172.21.15.52:0/3658096373 learned_addr learned my addr 172.21.15.52:0/3658096373 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 0x7fca140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca29d9b640 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9fb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.501+0000 7fca1b7fe640 1 -- 172.21.15.52:0/1363230149 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca1c0cf250 con 0x7fca2c100a60 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 -- 172.21.15.52:0/3658096373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 msgr2=0x55cc5c9fb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9fb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 -- 172.21.15.52:0/3658096373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f39a0 msgr2=0x55cc5c9f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 -- 172.21.15.52:0/3658096373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5c8fe340 con 0x55cc5c9f42e0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2a59c640 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0ccc40 tx=0x7fca1c0ba340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bafbe42af53525 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 0x7fca140a57b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca24005c40 tx=0x7fca24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca18ff9640 1 -- 172.21.15.52:0/3658096373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c020030 con 0x55cc5c9f42e0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca18ff9640 1 -- 172.21.15.52:0/3658096373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c09bef0 con 0x55cc5c9f42e0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.502+0000 7fca18ff9640 1 -- 172.21.15.52:0/3658096373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0042a0 con 0x55cc5c9f42e0 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- 172.21.15.52:0/3658096373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 msgr2=0x55cc5c9f8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.508 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0ccc40 tx=0x7fca1c0ba340 comp rx=0 tx=0).stop 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- 172.21.15.52:0/3658096373 shutdown_connections 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9f8da0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 --2- 172.21.15.52:0/3658096373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- 172.21.15.52:0/3658096373 >> 172.21.15.52:0/3658096373 conn(0x55cc5c9ef010 msgr2=0x55cc5c9ef410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- 172.21.15.52:0/3658096373 shutdown_connections 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- 172.21.15.52:0/3658096373 wait complete. 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 -- start start 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.503+0000 7fca33a58740 1 Processor -- start 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9fdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca05030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c9fc280 con 0x55cc5c9f39a0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c8e0290 con 0x55cc5c9f9370 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc5c9fc400 con 0x55cc5c9f42e0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 10 client.0 _ll_register_callbacks cb 0x55cc5c911140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53690/0 (socket says 172.21.15.52:53690) 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 -- 172.21.15.52:0/540973019 learned_addr learned my addr 172.21.15.52:0/540973019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca05030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca29d9b640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 -- 172.21.15.52:0/540973019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 msgr2=0x55cc5c9fdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9fdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 -- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 msgr2=0x55cc5ca05030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.510 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca05030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 -- 172.21.15.52:0/540973019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5c66a210 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca05030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca2a59c640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0981c0 tx=0x7fca1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c23fcdfecd90dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c020050 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca1c0042a0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.504+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c09bef0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0b9030 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 10 client.15621 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cc5c736620 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c09bef0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca1c09ac40 con 0x55cc5c9f39a0 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 10 client.15621 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 20 client.15621 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca09330 0x55cc5ca0b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 4 client.15621 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc5c964a20 con 0x55cc5ca09330 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.505+0000 7fca29d9b640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca09330 0x55cc5ca0b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.506+0000 7fca29d9b640 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca09330 0x55cc5ca0b720 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d22aab981627ca01 server_cookie=fd990bd31f4e7be7 in_seq=0 out_seq=0 2024-09-19T09:22:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.506+0000 7fca11ffb640 10 client.15621 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca11ffb640 1 -- 172.21.15.52:0/540973019 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc5c964a20 con 0x55cc5ca09330 2024-09-19T09:22:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca11ffb640 10 client.15621 handle_command_reply: tid=0 2024-09-19T09:22:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 client.15621 shutdown 2024-09-19T09:22:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 msgr2=0x55cc5c9fdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0981c0 tx=0x7fca1c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 shutdown_connections 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca09330 0x55cc5ca0b720 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca05030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5c9fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca11ffb640 0 client.15621 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 --2- 172.21.15.52:0/540973019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9fdab0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 >> 172.21.15.52:0/540973019 conn(0x55cc5c9ef010 msgr2=0x55cc5c9f0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 shutdown_connections 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 1 -- 172.21.15.52:0/540973019 wait complete. 2024-09-19T09:22:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.507+0000 7fca33a58740 20 client.15621 trim_cache size 0 max 16384 2024-09-19T09:22:26.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 Processor -- start 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 -- start start 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca04ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9f0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1add20 con 0x55cc5c9f39a0 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1ab5f0 con 0x55cc5c9f42e0 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca33a58740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1a9440 con 0x55cc5c9f9370 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53704/0 (socket says 172.21.15.52:53704) 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 -- 172.21.15.52:0/1678508563 learned_addr learned my addr 172.21.15.52:0/1678508563 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:26.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca29d9b640 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca04ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 -- 172.21.15.52:0/1678508563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 msgr2=0x55cc5c9f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 -- 172.21.15.52:0/1678508563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f42e0 msgr2=0x55cc5ca04ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca04ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.522+0000 7fca2a59c640 1 -- 172.21.15.52:0/1678508563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5c9eee30 con 0x55cc5c9f39a0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca2a59c640 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fca1c097c00 tx=0x7fca1c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9b7f1382fd8955 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca13fff640 1 -- 172.21.15.52:0/1678508563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c020070 con 0x55cc5c9f39a0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca13fff640 1 -- 172.21.15.52:0/1678508563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c09bef0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca13fff640 1 -- 172.21.15.52:0/1678508563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0b4070 con 0x55cc5c9f39a0 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 -- 172.21.15.52:0/1678508563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 msgr2=0x55cc5c9f0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fca1c097c00 tx=0x7fca1c0035f0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 -- 172.21.15.52:0/1678508563 shutdown_connections 2024-09-19T09:22:26.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f9370 0x55cc5c9f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca04ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 --2- 172.21.15.52:0/1678508563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5c9f0400 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 -- 172.21.15.52:0/1678508563 >> 172.21.15.52:0/1678508563 conn(0x55cc5c9ef010 msgr2=0x55cc5c9ee1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 -- 172.21.15.52:0/1678508563 shutdown_connections 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.523+0000 7fca33a58740 1 -- 172.21.15.52:0/1678508563 wait complete. 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 -- start start 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 Processor -- start 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca03180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca04190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1a9ab0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1aaf20 con 0x55cc5c9f9370 2024-09-19T09:22:26.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1aa180 con 0x55cc5c9f42e0 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca33a58740 10 client.0 _ll_register_callbacks cb 0x7fca240093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53720/0 (socket says 172.21.15.52:53720) 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 -- 172.21.15.52:0/4049244865 learned_addr learned my addr 172.21.15.52:0/4049244865 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca04190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 -- 172.21.15.52:0/4049244865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 msgr2=0x55cc5ca03180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca03180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 -- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 msgr2=0x55cc5ca04190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca04190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2a59c640 1 -- 172.21.15.52:0/4049244865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5ca047a0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.524+0000 7fca2ad9d640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca04190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca2a59c640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0981c0 tx=0x7fca1c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12c04f11d4479c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c020070 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca1c09ac40 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c09bef0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0b4040 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 10 client.15627 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cc5ca74410 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c09bef0 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca1c0ac070 con 0x55cc5c9f39a0 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 10 client.15627 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 20 client.15627 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca74ba0 0x55cc5ca76fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 4 client.15627 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.525+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc5c95ed70 con 0x55cc5ca74ba0 2024-09-19T09:22:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.526+0000 7fca29d9b640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca74ba0 0x55cc5ca76fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.526+0000 7fca29d9b640 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca74ba0 0x55cc5ca76fc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567c86d0b8fd4aba server_cookie=226e87168314369f in_seq=0 out_seq=0 2024-09-19T09:22:26.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.526+0000 7fca11ffb640 10 client.15627 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca11ffb640 1 -- 172.21.15.52:0/4049244865 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc5c95ed70 con 0x55cc5ca74ba0 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca11ffb640 10 client.15627 handle_command_reply: tid=0 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 client.15627 shutdown 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 msgr2=0x55cc5ca02c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0981c0 tx=0x7fca1c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 shutdown_connections 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc5ca74ba0 0x55cc5ca76fc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc5c9f9370 0x55cc5ca04190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc5c9f42e0 0x55cc5ca03180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca11ffb640 0 client.15627 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 --2- 172.21.15.52:0/4049244865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc5c9f39a0 0x55cc5ca02c40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 >> 172.21.15.52:0/4049244865 conn(0x55cc5c9ef010 msgr2=0x55cc5c9ef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 shutdown_connections 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 1 -- 172.21.15.52:0/4049244865 wait complete. 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.535+0000 7fca33a58740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:22:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:22:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:22:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 msgr2=0x7fca140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 0x7fca140a57b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca24005c40 tx=0x7fca24009500 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 msgr2=0x7fca2c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00d770 tx=0x7fca1c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 shutdown_connections 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca2c102610 0x7fca2c103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca140a32f0 0x7fca140a57b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca2c101c50 0x7fca2c103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 --2- 172.21.15.52:0/1363230149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca2c100a60 0x7fca2c1049f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 >> 172.21.15.52:0/1363230149 conn(0x7fca2c0fc1e0 msgr2=0x7fca2c0fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 shutdown_connections 2024-09-19T09:22:26.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:26.536+0000 7fca30cba640 1 -- 172.21.15.52:0/1363230149 wait complete. 2024-09-19T09:22:27.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:27 smithi052 ceph-mon[30947]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:22:27.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:27 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:27 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:27 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:27 smithi169 ceph-mon[35454]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:22:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:27 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:27 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:27.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:27 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:27.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:27 smithi086 ceph-mon[34813]: pgmap v368: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-19T09:22:27.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:27 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:27 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:27 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:28.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:28.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:28.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:28.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:22:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:29 smithi052 ceph-mon[30947]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T09:22:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:29 smithi169 ceph-mon[35454]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T09:22:29.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:29 smithi086 ceph-mon[34813]: pgmap v369: 97 pgs: 97 active+clean; 665 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T09:22:31.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:22:31.367 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:31 smithi052 ceph-mon[30947]: pgmap v370: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:31.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:31 smithi169 ceph-mon[35454]: pgmap v370: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:31.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:31 smithi086 ceph-mon[34813]: pgmap v370: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:31.611 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 -- 172.21.15.52:0/254982535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0101de0 msgr2=0x7fabd01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/254982535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0101de0 0x7fabd01021c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009900 tx=0x7fabc002a410 comp rx=0 tx=0).stop 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 -- 172.21.15.52:0/254982535 shutdown_connections 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/254982535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0106f10 0x7fabd010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/254982535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0102790 0x7fabd01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/254982535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0101de0 0x7fabd01021c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 -- 172.21.15.52:0/254982535 >> 172.21.15.52:0/254982535 conn(0x7fabd00fd8c0 msgr2=0x7fabd00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 -- 172.21.15.52:0/254982535 shutdown_connections 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.086+0000 7fabd4c8b640 1 -- 172.21.15.52:0/254982535 wait complete. 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 Processor -- start 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 -- start start 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0101de0 0x7fabd00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 0x7fabd0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fabd0111f70 con 0x7fabd0102790 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabd0111df0 con 0x7fabd0101de0 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabd4c8b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01120f0 con 0x7fabd0106f10 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58586/0 (socket says 172.21.15.52:58586) 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1529724417 learned_addr learned my addr 172.21.15.52:0/1529724417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabced9d640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 0x7fabd0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabce59c640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0101de0 0x7fabd00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1529724417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 msgr2=0x7fabd0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 0x7fabd0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1529724417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0101de0 msgr2=0x7fabd00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0101de0 0x7fabd00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1529724417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd01a68f0 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.087+0000 7fabced9d640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 0x7fabd0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fabc400d770 tx=0x7fabc400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabbf7fe640 1 -- 172.21.15.52:0/1529724417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4017070 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd01a6be0 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabbf7fe640 1 -- 172.21.15.52:0/1529724417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc4005500 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabbf7fe640 1 -- 172.21.15.52:0/1529724417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4004e00 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.088+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01a7120 con 0x7fabd0102790 2024-09-19T09:22:32.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.090+0000 7fabbf7fe640 1 -- 172.21.15.52:0/1529724417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fabc4004fa0 con 0x7fabd0102790 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.090+0000 7fabd7064740 1 Processor -- start 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.090+0000 7fabd7064740 1 -- start start 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563b1a4562e0 con 0x563b1a4fb680 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563b1a3fdce0 con 0x563b1a4f04a0 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabd7064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b1a4522a0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabbf7fe640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58592/0 (socket says 172.21.15.52:58592) 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 -- 172.21.15.52:0/3696487756 learned_addr learned my addr 172.21.15.52:0/3696487756 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:32.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabced9d640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabce59c640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabced9d640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabbf7fe640 1 -- 172.21.15.52:0/1529724417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fabc40cf4d0 con 0x7fabd0102790 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 -- 172.21.15.52:0/3696487756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 msgr2=0x563b1a4fb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 -- 172.21.15.52:0/3696487756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 msgr2=0x563b1a4f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabcdd9b640 1 -- 172.21.15.52:0/3696487756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1a3e2440 con 0x563b1a4fb680 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.091+0000 7fabce59c640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fabc4097e70 tx=0x7fabc4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d488fe10099f0b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabced9d640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabc8013b30 tx=0x7fabc8005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabbcff9640 1 -- 172.21.15.52:0/3696487756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4020030 con 0x563b1a4fb680 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabbcff9640 1 -- 172.21.15.52:0/3696487756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc40046c0 con 0x563b1a4fb680 2024-09-19T09:22:32.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabbcff9640 1 -- 172.21.15.52:0/3696487756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40cd000 con 0x563b1a4fb680 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabd7064740 1 -- 172.21.15.52:0/3696487756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 msgr2=0x563b1a4fda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.092+0000 7fabd7064740 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fabc4097e70 tx=0x7fabc4009c30 comp rx=0 tx=0).stop 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- 172.21.15.52:0/3696487756 shutdown_connections 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fda70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- 172.21.15.52:0/3696487756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- 172.21.15.52:0/3696487756 >> 172.21.15.52:0/3696487756 conn(0x563b1a4eca30 msgr2=0x563b1a4ece10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- 172.21.15.52:0/3696487756 shutdown_connections 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- 172.21.15.52:0/3696487756 wait complete. 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- start start 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 Processor -- start 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4faee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563b1a4fe250 con 0x563b1a4f0dc0 2024-09-19T09:22:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563b1a411050 con 0x563b1a4f04a0 2024-09-19T09:22:32.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563b1a4fe3d0 con 0x563b1a4fb680 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabd7064740 10 client.0 _ll_register_callbacks cb 0x563b1a451160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.093+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58604/0 (socket says 172.21.15.52:58604) 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1230804735 learned_addr learned my addr 172.21.15.52:0/1230804735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabce59c640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4faee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabced9d640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1230804735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 msgr2=0x563b1a4f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 msgr2=0x563b1a4faee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4faee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1230804735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1a1c73c0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabced9d640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fabc40048e0 tx=0x7fabc4097d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226bbbad142e6d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4020050 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563b1a463850 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fabc4009cc0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fabc409c110 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabd7064740 10 client.15639 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.094+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b1a509b70 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563b1a463850 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fabc40d2be0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 10 client.15639 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 20 client.15639 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a50d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 4 client.15639 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b1a45dd60 con 0x563b1a50aec0 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.095+0000 7fabce59c640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a50d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabb5ffb640 10 client.15639 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabce59c640 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a50d2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c873f51947fb308 server_cookie=ae451abc3caaae4a in_seq=0 out_seq=0 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabb5ffb640 1 -- 172.21.15.52:0/1230804735 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b1a45dd60 con 0x563b1a50aec0 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabb5ffb640 10 client.15639 handle_command_reply: tid=0 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabd7064740 1 client.15639 shutdown 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 msgr2=0x563b1a4f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fabc40048e0 tx=0x7fabc4097d20 comp rx=0 tx=0).stop 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 shutdown_connections 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a50d2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.096+0000 7fabb5ffb640 0 client.15639 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a4f8190 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 --2- 172.21.15.52:0/1230804735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a4faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 >> 172.21.15.52:0/1230804735 conn(0x563b1a4eca30 msgr2=0x563b1a4f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 shutdown_connections 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 1 -- 172.21.15.52:0/1230804735 wait complete. 2024-09-19T09:22:32.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.097+0000 7fabd7064740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 Processor -- start 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 -- start start 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a512880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01b21c0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01afa90 con 0x563b1a4f04a0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabd7064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01ad8e0 con 0x563b1a4fb680 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabcdd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58614/0 (socket says 172.21.15.52:58614) 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.114+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1702512727 learned_addr learned my addr 172.21.15.52:0/1702512727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabce59c640 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a512880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabced9d640 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1702512727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 msgr2=0x563b1a4f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1702512727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 msgr2=0x563b1a512880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a512880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 -- 172.21.15.52:0/1702512727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1a4ec860 con 0x563b1a4f0dc0 2024-09-19T09:22:32.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabc40a4150 tx=0x7fabc4099f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e814e27fc607719 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabb7fff640 1 -- 172.21.15.52:0/1702512727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4020070 con 0x563b1a4f0dc0 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabb7fff640 1 -- 172.21.15.52:0/1702512727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc40860f0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.115+0000 7fabb7fff640 1 -- 172.21.15.52:0/1702512727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40cd0f0 con 0x563b1a4f0dc0 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 -- 172.21.15.52:0/1702512727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 msgr2=0x563b1a512dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabc40a4150 tx=0x7fabc4099f20 comp rx=0 tx=0).stop 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 -- 172.21.15.52:0/1702512727 shutdown_connections 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4fb680 0x563b1a4f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4f0dc0 0x563b1a512dc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 --2- 172.21.15.52:0/1702512727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a512880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 -- 172.21.15.52:0/1702512727 >> 172.21.15.52:0/1702512727 conn(0x563b1a4eca30 msgr2=0x563b1a4f7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 -- 172.21.15.52:0/1702512727 shutdown_connections 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.116+0000 7fabd7064740 1 -- 172.21.15.52:0/1702512727 wait complete. 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 -- start start 2024-09-19T09:22:32.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 Processor -- start 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a503b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01adf50 con 0x563b1a4fb680 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01af3c0 con 0x563b1a4f04a0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01ae620 con 0x563b1a4f0dc0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabced9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabd7064740 10 client.0 _ll_register_callbacks cb 0x7fabc800ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabced9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58618/0 (socket says 172.21.15.52:58618) 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabced9d640 1 -- 172.21.15.52:0/246464554 learned_addr learned my addr 172.21.15.52:0/246464554 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabcdd9b640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.117+0000 7fabce59c640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a503b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 -- 172.21.15.52:0/246464554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 msgr2=0x563b1a4fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 -- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 msgr2=0x563b1a503b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a503b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 -- 172.21.15.52:0/246464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1a4fccf0 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabced9d640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabc8010c90 tx=0x7fabc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9381aceb7efae16c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8004d20 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fabc8003970 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc40860f0 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fabc80137d0 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabd7064740 10 client.15645 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.118+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563b1a502380 con 0x563b1a4fb680 2024-09-19T09:22:32.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc40860f0 con 0x563b1a4fb680 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fabc8028070 con 0x563b1a4fb680 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 10 client.15645 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 20 client.15645 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a577cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 4 client.15645 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b1a3da210 con 0x563b1a50aec0 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabce59c640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a577cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabce59c640 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a577cf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec94afcef8f583a5 server_cookie=c97a92eaf6a01816 in_seq=0 out_seq=0 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.119+0000 7fabb5ffb640 10 client.15645 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabb5ffb640 1 -- 172.21.15.52:0/246464554 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563b1a3da210 con 0x563b1a50aec0 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabb5ffb640 10 client.15645 handle_command_reply: tid=0 2024-09-19T09:22:32.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 client.15645 shutdown 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 msgr2=0x563b1a4fc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fabc8010c90 tx=0x7fabc8004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 shutdown_connections 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563b1a50aec0 0x563b1a577cf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563b1a4fb680 0x563b1a4fc7b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563b1a4f0dc0 0x563b1a4fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 --2- 172.21.15.52:0/246464554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563b1a4f04a0 0x563b1a503b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 >> 172.21.15.52:0/246464554 conn(0x563b1a4eca30 msgr2=0x563b1a4eb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabb5ffb640 0 client.15645 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 shutdown_connections 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 1 -- 172.21.15.52:0/246464554 wait complete. 2024-09-19T09:22:32.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.120+0000 7fabd7064740 20 client.15645 trim_cache size 0 max 16384 2024-09-19T09:22:32.133 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:32.133 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:22:32.133 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:22:32.133 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 msgr2=0x7fabb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fabc8013b30 tx=0x7fabc8005c60 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 msgr2=0x7fabd0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fabc400d770 tx=0x7fabc400dc30 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 shutdown_connections 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fabb80a3240 0x7fabb80a5700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fabd0106f10 0x7fabd0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabd0102790 0x7fabd0074a30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 --2- 172.21.15.52:0/1529724417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabd0101de0 0x7fabd00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 >> 172.21.15.52:0/1529724417 conn(0x7fabd00fd8c0 msgr2=0x7fabd00fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 shutdown_connections 2024-09-19T09:22:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:32.121+0000 7fabd4c8b640 1 -- 172.21.15.52:0/1529724417 wait complete. 2024-09-19T09:22:32.834 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:22:32.835 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:33.136 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:33.350 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:33 smithi052 ceph-mon[30947]: pgmap v371: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-19T09:22:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:33 smithi169 ceph-mon[35454]: pgmap v371: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-19T09:22:33.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:33 smithi086 ceph-mon[34813]: pgmap v371: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.8 KiB/s wr, 9 op/s 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- 172.21.15.52:0/1934962786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0780074f40 msgr2=0x7f078010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 --2- 172.21.15.52:0/1934962786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0780074f40 0x7f078010de80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0774009900 tx=0x7f077402a480 comp rx=0 tx=0).stop 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- 172.21.15.52:0/1934962786 shutdown_connections 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 --2- 172.21.15.52:0/1934962786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f078010e3c0 0x7f0780110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 --2- 172.21.15.52:0/1934962786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0780074f40 0x7f078010de80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 --2- 172.21.15.52:0/1934962786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074620 0x7f0780074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- 172.21.15.52:0/1934962786 >> 172.21.15.52:0/1934962786 conn(0x7f07800fd8c0 msgr2=0x7f07800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- 172.21.15.52:0/1934962786 shutdown_connections 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- 172.21.15.52:0/1934962786 wait complete. 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 Processor -- start 2024-09-19T09:22:33.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.583+0000 7f0785b24640 1 -- start start 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780074620 0x7f078019a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074f40 0x7f078019aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0780114160 con 0x7f078010e3c0 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0780113fe0 con 0x7f0780074f40 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f0785b24640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f07801142e0 con 0x7f0780074620 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58642/0 (socket says 172.21.15.52:58642) 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 -- 172.21.15.52:0/2288846 learned_addr learned my addr 172.21.15.52:0/2288846 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077f7fe640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780074620 0x7f078019a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077effd640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074f40 0x7f078019aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 -- 172.21.15.52:0/2288846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780074620 msgr2=0x7f078019a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780074620 0x7f078019a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 -- 172.21.15.52:0/2288846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074f40 msgr2=0x7f078019aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074f40 0x7f078019aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 -- 172.21.15.52:0/2288846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078019e6b0 con 0x7f078010e3c0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077ffff640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f077800eb10 tx=0x7f077800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.584+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778004b20 con 0x7f078010e3c0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.585+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078019e9a0 con 0x7f078010e3c0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.585+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0778004cc0 con 0x7f078010e3c0 2024-09-19T09:22:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.585+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778010760 con 0x7f078010e3c0 2024-09-19T09:22:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.585+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801a7310 con 0x7f078010e3c0 2024-09-19T09:22:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.586+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0780074a00 con 0x7f078010e3c0 2024-09-19T09:22:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.587+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0778005000 con 0x7f078010e3c0 2024-09-19T09:22:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.588+0000 7f077cff9640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 0x7f07680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.588+0000 7f077f7fe640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 0x7f07680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.588+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f07780d0470 con 0x7f078010e3c0 2024-09-19T09:22:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.588+0000 7f077f7fe640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 0x7f07680a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f077000bbe0 tx=0x7f077000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.591+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f077809d0b0 con 0x7f078010e3c0 2024-09-19T09:22:33.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.800+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0780109540 con 0x7f078010e3c0 2024-09-19T09:22:33.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.801+0000 7f077cff9640 1 -- 172.21.15.52:0/2288846 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f077809c9b0 con 0x7f078010e3c0 2024-09-19T09:22:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:22:33.803 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:22:33.803 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:22:33.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 msgr2=0x7f07680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:33.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 0x7f07680a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f077000bbe0 tx=0x7f077000b390 comp rx=0 tx=0).stop 2024-09-19T09:22:33.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 msgr2=0x7f078019df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f077800eb10 tx=0x7f077800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 shutdown_connections 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f078010e3c0 0x7f078019df80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0780074f40 0x7f078019aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07680a3240 0x7f07680a5700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 --2- 172.21.15.52:0/2288846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0780074620 0x7f078019a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 >> 172.21.15.52:0/2288846 conn(0x7f07800fd8c0 msgr2=0x7f07800fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 shutdown_connections 2024-09-19T09:22:33.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:33.803+0000 7f0785b24640 1 -- 172.21.15.52:0/2288846 wait complete. 2024-09-19T09:22:34.122 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:34 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2288846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:34 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2288846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:34.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:22:34.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:34 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2288846' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:35.153 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:35 smithi052 ceph-mon[30947]: pgmap v372: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 -- 172.21.15.52:0/887642820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c101420 msgr2=0x7f346c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 --2- 172.21.15.52:0/887642820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c101420 0x7f346c10d950 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3464009cd0 tx=0x7f346402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 -- 172.21.15.52:0/887642820 shutdown_connections 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 --2- 172.21.15.52:0/887642820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c101420 0x7f346c10d950 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 --2- 172.21.15.52:0/887642820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c100a80 0x7f346c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 --2- 172.21.15.52:0/887642820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c106a80 0x7f346c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 -- 172.21.15.52:0/887642820 >> 172.21.15.52:0/887642820 conn(0x7f346c0fc7a0 msgr2=0x7f346c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 -- 172.21.15.52:0/887642820 shutdown_connections 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.151+0000 7f3474466640 1 -- 172.21.15.52:0/887642820 wait complete. 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 Processor -- start 2024-09-19T09:22:35.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 -- start start 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100a80 0x7f346c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 0x7f346c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f346c110ed0 con 0x7f346c106a80 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f346c110d50 con 0x7f346c101420 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3474466640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f346c111050 con 0x7f346c100a80 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.152+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58662/0 (socket says 172.21.15.52:58662) 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 -- 172.21.15.52:0/1622208237 learned_addr learned my addr 172.21.15.52:0/1622208237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472202640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100a80 0x7f346c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3471a01640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 0x7f346c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 -- 172.21.15.52:0/1622208237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100a80 msgr2=0x7f346c199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100a80 0x7f346c199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 -- 172.21.15.52:0/1622208237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 msgr2=0x7f346c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 0x7f346c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 -- 172.21.15.52:0/1622208237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c1a47c0 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3471a01640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 0x7f346c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3472a03640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3464033040 tx=0x7f3464031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f34637fe640 1 -- 172.21.15.52:0/1622208237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464004040 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c1a4990 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f34637fe640 1 -- 172.21.15.52:0/1622208237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34640046c0 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f34637fe640 1 -- 172.21.15.52:0/1622208237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464046480 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.153+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c1a4ec0 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.156+0000 7f34637fe640 1 -- 172.21.15.52:0/1622208237 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f34640305a0 con 0x7f346c106a80 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.156+0000 7f347683f740 1 Processor -- start 2024-09-19T09:22:35.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.156+0000 7f347683f740 1 -- start start 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.156+0000 7f347683f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17611090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.156+0000 7f347683f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f347683f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c1761e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f347683f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c175772f0 con 0x564c176115d0 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f347683f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564c1751ecf0 con 0x564c17612b40 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f347683f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c175732b0 con 0x564c1761c370 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58676/0 (socket says 172.21.15.52:58676) 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 -- 172.21.15.52:0/4204458789 learned_addr learned my addr 172.21.15.52:0/4204458789 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3471a01640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c1761e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3471a01640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17611090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 -- 172.21.15.52:0/4204458789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 msgr2=0x564c1761e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c1761e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 -- 172.21.15.52:0/4204458789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 msgr2=0x564c17611090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17611090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 -- 172.21.15.52:0/4204458789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c175033a0 con 0x564c176115d0 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3471a01640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c1761e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f34637fe640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 0x7f34580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3472202640 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f346800bc50 tx=0x7f34680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c21917b2f5a19b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3471a01640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 0x7f34580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f34637fe640 1 -- 172.21.15.52:0/1622208237 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f346402e030 con 0x7f346c106a80 2024-09-19T09:22:35.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3460dea640 1 -- 172.21.15.52:0/4204458789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346801c480 con 0x564c176115d0 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3460dea640 1 -- 172.21.15.52:0/4204458789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346801cb00 con 0x564c176115d0 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.157+0000 7f3460dea640 1 -- 172.21.15.52:0/4204458789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468011b90 con 0x564c176115d0 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 -- 172.21.15.52:0/4204458789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 msgr2=0x564c17611a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f346800bc50 tx=0x7f34680107a0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f3471a01640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 0x7f34580a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564c17612070 tx=0x7f345c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 -- 172.21.15.52:0/4204458789 shutdown_connections 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c1761e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c17611a10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 --2- 172.21.15.52:0/4204458789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17611090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 -- 172.21.15.52:0/4204458789 >> 172.21.15.52:0/4204458789 conn(0x564c175da310 msgr2=0x564c1760dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 -- 172.21.15.52:0/4204458789 shutdown_connections 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.158+0000 7f347683f740 1 -- 172.21.15.52:0/4204458789 wait complete. 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 -- start start 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 Processor -- start 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17618ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c176195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c1761f070 con 0x564c176115d0 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564c17532060 con 0x564c17612b40 2024-09-19T09:22:35.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c1761f1f0 con 0x564c1761c370 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f347683f740 10 client.0 _ll_register_callbacks cb 0x564c172858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f3472202640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f3472202640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58688/0 (socket says 172.21.15.52:58688) 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.159+0000 7f3472202640 1 -- 172.21.15.52:0/3546071587 learned_addr learned my addr 172.21.15.52:0/3546071587 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3471a01640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17618ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472a03640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c176195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 -- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 msgr2=0x564c176195e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c176195e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 -- 172.21.15.52:0/3546071587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 msgr2=0x564c17618ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17618ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 -- 172.21.15.52:0/3546071587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c172e83c0 con 0x564c176115d0 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472a03640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c176195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:35.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3472202640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f346800bc20 tx=0x7f3468005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a87e63f361d76e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346801c710 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f346801cb00 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f346801c8b0 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3468004020 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f347683f740 10 client.15663 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c1762aab0 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.160+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346801cb00 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f34680037b0 con 0x564c176115d0 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 10 client.15663 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 10 client.15663 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 20 client.15663 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c1762e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 4 client.15663 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c17584860 con 0x564c1762bf10 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.161+0000 7f3471a01640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c1762e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.162+0000 7f3455ffb640 10 client.15663 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.162+0000 7f3471a01640 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c1762e300 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3be58e07c83ebab server_cookie=e368279f8865ce01 in_seq=0 out_seq=0 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.162+0000 7f3455ffb640 1 -- 172.21.15.52:0/3546071587 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c17584860 con 0x564c1762bf10 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.162+0000 7f3455ffb640 10 client.15663 handle_command_reply: tid=0 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.162+0000 7f347683f740 1 client.15663 shutdown 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 msgr2=0x564c1761bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f346800bc20 tx=0x7f3468005850 comp rx=0 tx=0).stop 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 shutdown_connections 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c1762e300 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c1761c370 0x564c176195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f3455ffb640 0 client.15663 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c17612b40 0x564c17618ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 --2- 172.21.15.52:0/3546071587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c176115d0 0x564c1761bd40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 >> 172.21.15.52:0/3546071587 conn(0x564c175da310 msgr2=0x564c17613930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 shutdown_connections 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 1 -- 172.21.15.52:0/3546071587 wait complete. 2024-09-19T09:22:35.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.163+0000 7f347683f740 20 client.15663 trim_cache size 0 max 16384 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 Processor -- start 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 -- start start 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17614120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17614660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1affa0 con 0x564c1761c370 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1ad870 con 0x564c176115d0 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f347683f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1ab6c0 con 0x564c17612b40 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58694/0 (socket says 172.21.15.52:58694) 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f3472a03640 1 -- 172.21.15.52:0/3720623972 learned_addr learned my addr 172.21.15.52:0/3720623972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.176+0000 7f3472202640 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17614120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3471a01640 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17614660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 -- 172.21.15.52:0/3720623972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 msgr2=0x564c17614660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17614660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 -- 172.21.15.52:0/3720623972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 msgr2=0x564c17614120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17614120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 -- 172.21.15.52:0/3720623972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1761c0b0 con 0x564c1761c370 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3472a03640 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f34640c5d60 tx=0x7f3464003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aede822868ef19c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3457fff640 1 -- 172.21.15.52:0/3720623972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34640d5070 con 0x564c1761c370 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3457fff640 1 -- 172.21.15.52:0/3720623972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3464036050 con 0x564c1761c370 2024-09-19T09:22:35.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.177+0000 7f3457fff640 1 -- 172.21.15.52:0/3720623972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34640c6290 con 0x564c1761c370 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- 172.21.15.52:0/3720623972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 msgr2=0x564c17633990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f34640c5d60 tx=0x7f3464003f00 comp rx=0 tx=0).stop 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- 172.21.15.52:0/3720623972 shutdown_connections 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17633990 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17614660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 --2- 172.21.15.52:0/3720623972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17614120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- 172.21.15.52:0/3720623972 >> 172.21.15.52:0/3720623972 conn(0x564c175da310 msgr2=0x564c1760cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- 172.21.15.52:0/3720623972 shutdown_connections 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- 172.21.15.52:0/3720623972 wait complete. 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 -- start start 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.178+0000 7f347683f740 1 Processor -- start 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17615fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17616510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1abd30 con 0x564c1761c370 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1ad1a0 con 0x564c176115d0 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f346c1ac400 con 0x564c17612b40 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f347683f740 10 client.0 _ll_register_callbacks cb 0x7f346800baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58706/0 (socket says 172.21.15.52:58706) 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 -- 172.21.15.52:0/3904051704 learned_addr learned my addr 172.21.15.52:0/3904051704 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3471a01640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17616510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472202640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17615fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 -- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 msgr2=0x564c17616510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17616510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 -- 172.21.15.52:0/3904051704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 msgr2=0x564c17615fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17615fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 -- 172.21.15.52:0/3904051704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c17619950 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472202640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17615fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3472a03640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3464005b90 tx=0x7f3464003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edd9fd5f4dc6fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3455ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.179+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34640d5040 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f34640d1d40 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3464036050 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f34640bcf80 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 10 client.15669 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c17696a50 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3464036050 con 0x564c1761c370 2024-09-19T09:22:35.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f346404e070 con 0x564c1761c370 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 10 client.15669 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 10 client.15669 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 20 client.15669 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c176990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 4 client.15669 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564c1757ed70 con 0x564c1762bf10 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.180+0000 7f3472202640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c176990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f3455ffb640 10 client.15669 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f3472202640 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c176990b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fa8f333fb4b4157 server_cookie=12f7bdbec1b5eb52 in_seq=0 out_seq=0 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f3455ffb640 1 -- 172.21.15.52:0/3904051704 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564c1757ed70 con 0x564c1762bf10 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f3455ffb640 10 client.15669 handle_command_reply: tid=0 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 client.15669 shutdown 2024-09-19T09:22:35.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 msgr2=0x564c17616a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3464005b90 tx=0x7f3464003f70 comp rx=0 tx=0).stop 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 shutdown_connections 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x564c1762bf10 0x564c176990b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c1761c370 0x564c17616a50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c17612b40 0x564c17616510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 --2- 172.21.15.52:0/3904051704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c176115d0 0x564c17615fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 >> 172.21.15.52:0/3904051704 conn(0x564c175da310 msgr2=0x564c1761a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f3455ffb640 0 client.15669 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 shutdown_connections 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 1 -- 172.21.15.52:0/3904051704 wait complete. 2024-09-19T09:22:35.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.181+0000 7f347683f740 20 client.15669 trim_cache size 0 max 16384 2024-09-19T09:22:35.191 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:35.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 msgr2=0x7f34580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 0x7f34580a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x564c17612070 tx=0x7f345c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 msgr2=0x7f346c1a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3464033040 tx=0x7f3464031e60 comp rx=0 tx=0).stop 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 shutdown_connections 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f346c106a80 0x7f346c1a4280 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f346c101420 0x7f346c199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34580a3240 0x7f34580a5700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 --2- 172.21.15.52:0/1622208237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f346c100a80 0x7f346c199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 >> 172.21.15.52:0/1622208237 conn(0x7f346c0fc7a0 msgr2=0x7f346c0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 shutdown_connections 2024-09-19T09:22:35.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:35.182+0000 7f3474466640 1 -- 172.21.15.52:0/1622208237 wait complete. 2024-09-19T09:22:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:35 smithi169 ceph-mon[35454]: pgmap v372: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-19T09:22:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:35 smithi086 ceph-mon[34813]: pgmap v372: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.8 KiB/s wr, 10 op/s 2024-09-19T09:22:35.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:22:36.146 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 -- 172.21.15.52:0/382857636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 msgr2=0x7fb72c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 --2- 172.21.15.52:0/382857636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c10da40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb724009ca0 tx=0x7fb72402a950 comp rx=0 tx=0).stop 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 -- 172.21.15.52:0/382857636 shutdown_connections 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 --2- 172.21.15.52:0/382857636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c10da40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 --2- 172.21.15.52:0/382857636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 0x7fb72c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 --2- 172.21.15.52:0/382857636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 -- 172.21.15.52:0/382857636 >> 172.21.15.52:0/382857636 conn(0x7fb72c0fc7d0 msgr2=0x7fb72c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 -- 172.21.15.52:0/382857636 shutdown_connections 2024-09-19T09:22:36.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.669+0000 7fb730d6a640 1 -- 172.21.15.52:0/382857636 wait complete. 2024-09-19T09:22:36.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 Processor -- start 2024-09-19T09:22:36.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 -- start start 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 0x7fb72c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1120f0 con 0x7fb72c102ef0 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c111f70 con 0x7fb72c100e20 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb730d6a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c112270 con 0x7fb72c102570 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58712/0 (socket says 172.21.15.52:58712) 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3396759859 learned_addr learned my addr 172.21.15.52:0/3396759859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.670+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 0x7fb72c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3396759859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 msgr2=0x7fb72c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 0x7fb72c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3396759859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 msgr2=0x7fb72c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3396759859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c19d4a0 con 0x7fb72c102ef0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098d0 tx=0x7fb724003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb723fff640 1 -- 172.21.15.52:0/3396759859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724034040 con 0x7fb72c102ef0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c19d730 con 0x7fb72c102ef0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb723fff640 1 -- 172.21.15.52:0/3396759859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb72402fe10 con 0x7fb72c102ef0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb723fff640 1 -- 172.21.15.52:0/3396759859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb724039450 con 0x7fb72c102ef0 2024-09-19T09:22:36.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.671+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c1a5070 con 0x7fb72c102ef0 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.673+0000 7fb723fff640 1 -- 172.21.15.52:0/3396759859 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb724037020 con 0x7fb72c102ef0 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb733143740 1 Processor -- start 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb733143740 1 -- start start 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb723fff640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 0x7fb7180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb733143740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb733143740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf14ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.674+0000 7fb733143740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb733143740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddf14652f0 con 0x55ddf1500b40 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb733143740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ddf140ccf0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb733143740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ddf14612b0 con 0x55ddf150a370 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb723fff640 1 -- 172.21.15.52:0/3396759859 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb7240f0a20 con 0x7fb72c102ef0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 0x7fb7180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58720/0 (socket says 172.21.15.52:58720) 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 -- 172.21.15.52:0/1602161165 learned_addr learned my addr 172.21.15.52:0/1602161165 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb721d9b640 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf14ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 -- 172.21.15.52:0/1602161165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 msgr2=0x55ddf150c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 -- 172.21.15.52:0/1602161165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 msgr2=0x55ddf14ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf14ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 -- 172.21.15.52:0/1602161165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf13f13a0 con 0x55ddf1500b40 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 0x7fb7180a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb714006e10 tx=0x7fb714014660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00f3c0 tx=0x7fb71c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6f1174781082b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.675+0000 7fb720d99640 1 -- 172.21.15.52:0/1602161165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c01d070 con 0x55ddf1500b40 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb720d99640 1 -- 172.21.15.52:0/1602161165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c010de0 con 0x55ddf1500b40 2024-09-19T09:22:36.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb720d99640 1 -- 172.21.15.52:0/1602161165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c018e60 con 0x55ddf1500b40 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 -- 172.21.15.52:0/1602161165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 msgr2=0x55ddf14ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00f3c0 tx=0x7fb71c00f880 comp rx=0 tx=0).stop 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 -- 172.21.15.52:0/1602161165 shutdown_connections 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf14ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 --2- 172.21.15.52:0/1602161165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf1500b40 0x55ddf14ff090 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 -- 172.21.15.52:0/1602161165 >> 172.21.15.52:0/1602161165 conn(0x55ddf14c8310 msgr2=0x55ddf14fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 -- 172.21.15.52:0/1602161165 shutdown_connections 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.676+0000 7fb733143740 1 -- 172.21.15.52:0/1602161165 wait complete. 2024-09-19T09:22:36.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 -- start start 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 Processor -- start 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf1506fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf1507570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ddf150d070 con 0x55ddf14ff5d0 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ddf1420060 con 0x55ddf1500b40 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ddf150d1f0 con 0x55ddf150a370 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb733143740 10 client.0 _ll_register_callbacks cb 0x55ddf11738c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58730/0 (socket says 172.21.15.52:58730) 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb72a59c640 1 -- 172.21.15.52:0/3767895059 learned_addr learned my addr 172.21.15.52:0/3767895059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:36.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf1506fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.677+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf1507570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 -- 172.21.15.52:0/3767895059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 msgr2=0x55ddf1507570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf1507570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 -- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 msgr2=0x55ddf1506fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf1506fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 -- 172.21.15.52:0/3767895059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf11d63c0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb71c010fd0 tx=0x7fb71c019ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48057f67a2239b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c01d050 con 0x55ddf14ff5d0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb71c010910 con 0x55ddf14ff5d0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb71c010de0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb71c010b30 con 0x55ddf14ff5d0 2024-09-19T09:22:36.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb733143740 10 client.15681 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddf1518ac0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb71c010de0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.678+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb71c0048f0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 10 client.15681 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 10 client.15681 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 20 client.15681 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf1519ec0 0x55ddf151c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 4 client.15681 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddf1472860 con 0x55ddf1519ec0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf1519ec0 0x55ddf151c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb721d9b640 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf1519ec0 0x55ddf151c2b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b8d8dbd2e72f4eca server_cookie=b4566100549e11d1 in_seq=0 out_seq=0 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.679+0000 7fb711ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:36.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb711ffb640 1 -- 172.21.15.52:0/3767895059 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddf1472860 con 0x55ddf1519ec0 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb711ffb640 10 client.15681 handle_command_reply: tid=0 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 client.15681 shutdown 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 msgr2=0x55ddf1509cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb71c010fd0 tx=0x7fb71c019ea0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 shutdown_connections 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf1507570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf1519ec0 0x55ddf151c2b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf1506fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 --2- 172.21.15.52:0/3767895059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf1509cd0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 >> 172.21.15.52:0/3767895059 conn(0x55ddf14c8310 msgr2=0x55ddf1501960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.680+0000 7fb711ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.681+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 shutdown_connections 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.681+0000 7fb733143740 1 -- 172.21.15.52:0/3767895059 wait complete. 2024-09-19T09:22:36.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.681+0000 7fb733143740 20 client.15681 trim_cache size 0 max 16384 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.693+0000 7fb733143740 1 Processor -- start 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 -- start start 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf1516310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf1500b40 0x55ddf14fb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1b0140 con 0x55ddf150a370 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ada10 con 0x55ddf14ff5d0 2024-09-19T09:22:36.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb733143740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ab860 con 0x55ddf1500b40 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58734/0 (socket says 172.21.15.52:58734) 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3739005661 learned_addr learned my addr 172.21.15.52:0/3739005661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72a59c640 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf1516310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3739005661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf1500b40 msgr2=0x55ddf14fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf1500b40 0x55ddf14fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3739005661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 msgr2=0x55ddf1516310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf1516310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 -- 172.21.15.52:0/3739005661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddf1505520 con 0x55ddf150a370 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb724009dc0 tx=0x7fb72402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a106899ee6f33a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.694+0000 7fb713fff640 1 -- 172.21.15.52:0/3739005661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72402c040 con 0x55ddf150a370 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb713fff640 1 -- 172.21.15.52:0/3739005661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7240bd6c0 con 0x55ddf150a370 2024-09-19T09:22:36.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb713fff640 1 -- 172.21.15.52:0/3739005661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240b9630 con 0x55ddf150a370 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- 172.21.15.52:0/3739005661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 msgr2=0x55ddf15218b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb724009dc0 tx=0x7fb72402a950 comp rx=0 tx=0).stop 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- 172.21.15.52:0/3739005661 shutdown_connections 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf150a370 0x55ddf15218b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf1500b40 0x55ddf14fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 --2- 172.21.15.52:0/3739005661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf14ff5d0 0x55ddf1516310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- 172.21.15.52:0/3739005661 >> 172.21.15.52:0/3739005661 conn(0x55ddf14c8310 msgr2=0x55ddf15060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- 172.21.15.52:0/3739005661 shutdown_connections 2024-09-19T09:22:36.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- 172.21.15.52:0/3739005661 wait complete. 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.695+0000 7fb733143740 1 -- start start 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 Processor -- start 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf150e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1abed0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ad340 con 0x55ddf1500b40 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c1ac5a0 con 0x55ddf150a370 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb733143740 10 client.0 _ll_register_callbacks cb 0x7fb71c01b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58746/0 (socket says 172.21.15.52:58746) 2024-09-19T09:22:36.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 -- 172.21.15.52:0/1889186311 learned_addr learned my addr 172.21.15.52:0/1889186311 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb721d9b640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf150e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 -- 172.21.15.52:0/1889186311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 msgr2=0x55ddf150ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 -- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 msgr2=0x55ddf150e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf150e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72a59c640 1 -- 172.21.15.52:0/1889186311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddf1583ad0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.696+0000 7fb72ad9d640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb72a59c640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00a460 tx=0x7fb71c01afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7d527a337208f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c01d070 con 0x55ddf14ff5d0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb71c029040 con 0x55ddf14ff5d0 2024-09-19T09:22:36.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7240bd6c0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb71c00ae50 con 0x55ddf14ff5d0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 10 client.15687 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ddf1584d90 con 0x55ddf14ff5d0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7240bd6c0 con 0x55ddf14ff5d0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb71c018970 con 0x55ddf14ff5d0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 10 client.15687 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 10 client.15687 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 20 client.15687 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf15854a0 0x55ddf1587890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 4 client.15687 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.697+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddf146cd70 con 0x55ddf15854a0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb721d9b640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf15854a0 0x55ddf1587890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb711ffb640 10 client.15687 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb721d9b640 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf15854a0 0x55ddf1587890 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=702bf41a6a9fda77 server_cookie=78e25295c1b0659a in_seq=0 out_seq=0 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb711ffb640 1 -- 172.21.15.52:0/1889186311 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddf146cd70 con 0x55ddf15854a0 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb711ffb640 10 client.15687 handle_command_reply: tid=0 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 client.15687 shutdown 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 msgr2=0x55ddf150e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00a460 tx=0x7fb71c01afc0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 shutdown_connections 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ddf150a370 0x55ddf150ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ddf15854a0 0x55ddf1587890 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb711ffb640 0 client.15687 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ddf1500b40 0x55ddf150e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 --2- 172.21.15.52:0/1889186311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ddf14ff5d0 0x55ddf150e400 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 >> 172.21.15.52:0/1889186311 conn(0x55ddf14c8310 msgr2=0x55ddf1501110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 shutdown_connections 2024-09-19T09:22:36.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.698+0000 7fb733143740 1 -- 172.21.15.52:0/1889186311 wait complete. 2024-09-19T09:22:36.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb733143740 20 client.15687 trim_cache size 0 max 16384 2024-09-19T09:22:36.706 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 msgr2=0x7fb7180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 0x7fb7180a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb714006e10 tx=0x7fb714014660 comp rx=0 tx=0).stop 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 msgr2=0x7fb72c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb7240098d0 tx=0x7fb724003f10 comp rx=0 tx=0).stop 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 shutdown_connections 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb72c102ef0 0x7fb72c19cdc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb7180a3240 0x7fb7180a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb72c102570 0x7fb72c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 --2- 172.21.15.52:0/3396759859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb72c100e20 0x7fb72c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 >> 172.21.15.52:0/3396759859 conn(0x7fb72c0fc7d0 msgr2=0x7fb72c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 shutdown_connections 2024-09-19T09:22:36.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:36.699+0000 7fb730d6a640 1 -- 172.21.15.52:0/3396759859 wait complete. 2024-09-19T09:22:37.333 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:37 smithi052 ceph-mon[30947]: pgmap v373: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:22:37.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:22:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:37 smithi169 ceph-mon[35454]: pgmap v373: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:22:37.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:37 smithi086 ceph-mon[34813]: pgmap v373: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:22:37.618 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 -- 172.21.15.52:0/1277251256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300101de0 msgr2=0x7f43001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 --2- 172.21.15.52:0/1277251256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300101de0 0x7f43001021c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009900 tx=0x7f42f002a410 comp rx=0 tx=0).stop 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 -- 172.21.15.52:0/1277251256 shutdown_connections 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 --2- 172.21.15.52:0/1277251256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300106f10 0x7f430010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 --2- 172.21.15.52:0/1277251256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f43001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 --2- 172.21.15.52:0/1277251256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300101de0 0x7f43001021c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 -- 172.21.15.52:0/1277251256 >> 172.21.15.52:0/1277251256 conn(0x7f43000fd8c0 msgr2=0x7f43000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 -- 172.21.15.52:0/1277251256 shutdown_connections 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 -- 172.21.15.52:0/1277251256 wait complete. 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.074+0000 7f430520d640 1 Processor -- start 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 -- start start 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300101de0 0x7f43000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4300111f70 con 0x7f4300106f10 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4300111df0 con 0x7f4300101de0 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f430520d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43001120f0 con 0x7f4300102790 2024-09-19T09:22:38.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33030/0 (socket says 172.21.15.52:33030) 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 -- 172.21.15.52:0/601088664 learned_addr learned my addr 172.21.15.52:0/601088664 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42fed9d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300101de0 0x7f43000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42fe59c640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 -- 172.21.15.52:0/601088664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 msgr2=0x7f4300074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 -- 172.21.15.52:0/601088664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300101de0 msgr2=0x7f43000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300101de0 0x7f43000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.075+0000 7f42ff59e640 1 -- 172.21.15.52:0/601088664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001a6970 con 0x7f4300106f10 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f42ff59e640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42f800eaa0 tx=0x7f42f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f42e7fff640 1 -- 172.21.15.52:0/601088664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800cdb0 con 0x7f4300106f10 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43001a6c60 con 0x7f4300106f10 2024-09-19T09:22:38.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f42e7fff640 1 -- 172.21.15.52:0/601088664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f8005020 con 0x7f4300106f10 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f42e7fff640 1 -- 172.21.15.52:0/601088664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f80116b0 con 0x7f4300106f10 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.076+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001a71a0 con 0x7f4300106f10 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.078+0000 7f42e7fff640 1 -- 172.21.15.52:0/601088664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42f8005560 con 0x7f4300106f10 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.078+0000 7f43075e6740 1 Processor -- start 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 -- start start 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 0x5560a1df1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5560a1d572f0 con 0x5560a1dfc370 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5560a1cfecf0 con 0x5560a1df15d0 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f43075e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5560a1d532b0 con 0x5560a1df2b40 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42e7fff640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 0x7f42e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33040/0 (socket says 172.21.15.52:33040) 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 -- 172.21.15.52:0/1457035029 learned_addr learned my addr 172.21.15.52:0/1457035029 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fed9d640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 0x5560a1df1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42ff59e640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 0x7f42e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42e7fff640 1 -- 172.21.15.52:0/601088664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42f80cfb50 con 0x7f4300106f10 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 -- 172.21.15.52:0/1457035029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 msgr2=0x5560a1df1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 -- 172.21.15.52:0/1457035029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 msgr2=0x5560a1df1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 0x5560a1df1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.079+0000 7f42fe59c640 1 -- 172.21.15.52:0/1457035029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a1ce33a0 con 0x5560a1dfc370 2024-09-19T09:22:38.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42fed9d640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 0x5560a1df1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42fe59c640 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42f40127b0 tx=0x7f42f400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac106cf5a483dd26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42ff59e640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 0x7f42e80a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42f80cd570 tx=0x7f42f8066b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42e57fa640 1 -- 172.21.15.52:0/1457035029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4012df0 con 0x5560a1dfc370 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42e57fa640 1 -- 172.21.15.52:0/1457035029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f4005020 con 0x5560a1dfc370 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.080+0000 7f42e57fa640 1 -- 172.21.15.52:0/1457035029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4004a00 con 0x5560a1dfc370 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- 172.21.15.52:0/1457035029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 msgr2=0x5560a1dfe760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f42f40127b0 tx=0x7f42f400b7c0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- 172.21.15.52:0/1457035029 shutdown_connections 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfe760 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df15d0 0x5560a1df1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- 172.21.15.52:0/1457035029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- 172.21.15.52:0/1457035029 >> 172.21.15.52:0/1457035029 conn(0x5560a1dba310 msgr2=0x5560a1dedc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- 172.21.15.52:0/1457035029 shutdown_connections 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- 172.21.15.52:0/1457035029 wait complete. 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- start start 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 Processor -- start 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1dfc370 0x5560a1df95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5560a1dff070 con 0x5560a1df15d0 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5560a1d12060 con 0x5560a1dfc370 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5560a1dff1f0 con 0x5560a1df2b40 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f43075e6740 10 client.0 _ll_register_callbacks cb 0x5560a1a658c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.081+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33044/0 (socket says 172.21.15.52:33044) 2024-09-19T09:22:38.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 -- 172.21.15.52:0/435756106 learned_addr learned my addr 172.21.15.52:0/435756106 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fed9d640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 -- 172.21.15.52:0/435756106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 msgr2=0x5560a1df9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 -- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1dfc370 msgr2=0x5560a1df95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1dfc370 0x5560a1df95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 -- 172.21.15.52:0/435756106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a1ac83c0 con 0x5560a1df15d0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fed9d640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42fe59c640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42f400b5f0 tx=0x7f42f4005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f5116518c431e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4010c00 con 0x5560a1df15d0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42f4010da0 con 0x5560a1df15d0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f4005020 con 0x5560a1df15d0 2024-09-19T09:22:38.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42f402f070 con 0x5560a1df15d0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f43075e6740 10 client.15699 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5560a1e0aaf0 con 0x5560a1df15d0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.082+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f4005020 con 0x5560a1df15d0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42f4028020 con 0x5560a1df15d0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 10 client.15699 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 20 client.15699 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e0be40 0x5560a1e0e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 4 client.15699 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560a1d64860 con 0x5560a1e0be40 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f42fed9d640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e0be40 0x5560a1e0e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f42fed9d640 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e0be40 0x5560a1e0e230 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bcd37680cada0d3 server_cookie=856cd8f1447c5d11 in_seq=0 out_seq=0 2024-09-19T09:22:38.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.083+0000 7f42e2ff5640 10 client.15699 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f42e2ff5640 1 -- 172.21.15.52:0/435756106 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560a1d64860 con 0x5560a1e0be40 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f42e2ff5640 10 client.15699 handle_command_reply: tid=0 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 client.15699 shutdown 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 msgr2=0x5560a1dfbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f42f400b5f0 tx=0x7f42f4005470 comp rx=0 tx=0).stop 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 shutdown_connections 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e0be40 0x5560a1e0e230 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1dfc370 0x5560a1df95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f42e2ff5640 0 client.15699 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df2b40 0x5560a1df9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 --2- 172.21.15.52:0/435756106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1df15d0 0x5560a1dfbd50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 >> 172.21.15.52:0/435756106 conn(0x5560a1dba310 msgr2=0x5560a1df3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 shutdown_connections 2024-09-19T09:22:38.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 1 -- 172.21.15.52:0/435756106 wait complete. 2024-09-19T09:22:38.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.084+0000 7f43075e6740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T09:22:38.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.097+0000 7f43075e6740 1 Processor -- start 2024-09-19T09:22:38.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 -- start start 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e08310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1df88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43001b22c0 con 0x5560a1dfc370 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43001afb90 con 0x5560a1df2b40 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f43075e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ad9e0 con 0x5560a1df15d0 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33056/0 (socket says 172.21.15.52:33056) 2024-09-19T09:22:38.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 -- 172.21.15.52:0/2398691418 learned_addr learned my addr 172.21.15.52:0/2398691418 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e08310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fed9d640 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1df88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 -- 172.21.15.52:0/2398691418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 msgr2=0x5560a1e08310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e08310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 -- 172.21.15.52:0/2398691418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 msgr2=0x5560a1df88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1df88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 -- 172.21.15.52:0/2398691418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560a1df4120 con 0x5560a1dfc370 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.098+0000 7f42fe59c640 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f42f40127b0 tx=0x7f42f400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c01bb541b7f715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f42e4ff9640 1 -- 172.21.15.52:0/2398691418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f40054e0 con 0x5560a1dfc370 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f42e4ff9640 1 -- 172.21.15.52:0/2398691418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f400b3d0 con 0x5560a1dfc370 2024-09-19T09:22:38.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f42e4ff9640 1 -- 172.21.15.52:0/2398691418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4003850 con 0x5560a1dfc370 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 -- 172.21.15.52:0/2398691418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 msgr2=0x5560a1dfd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f42f40127b0 tx=0x7f42f400b900 comp rx=0 tx=0).stop 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 -- 172.21.15.52:0/2398691418 shutdown_connections 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1dfd760 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1df88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 --2- 172.21.15.52:0/2398691418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e08310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 -- 172.21.15.52:0/2398691418 >> 172.21.15.52:0/2398691418 conn(0x5560a1dba310 msgr2=0x5560a1df4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 -- 172.21.15.52:0/2398691418 shutdown_connections 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.099+0000 7f43075e6740 1 -- 172.21.15.52:0/2398691418 wait complete. 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 -- start start 2024-09-19T09:22:38.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 Processor -- start 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ae050 con 0x5560a1dfc370 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43001af4c0 con 0x5560a1df2b40 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43001ae720 con 0x5560a1df15d0 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f43075e6740 10 client.0 _ll_register_callbacks cb 0x7f42f400be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33058/0 (socket says 172.21.15.52:33058) 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:49186/0 (socket says 172.21.15.52:49186) 2024-09-19T09:22:38.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 -- 172.21.15.52:0/3960961573 learned_addr learned my addr 172.21.15.52:0/3960961573 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 -- 172.21.15.52:0/3960961573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 msgr2=0x5560a1e128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e128d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 -- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 msgr2=0x5560a1e12e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.100+0000 7f42fe59c640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42fe59c640 1 -- 172.21.15.52:0/3960961573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560a1e03530 con 0x5560a1dfc370 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42fed9d640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42fe59c640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f42f4012780 tx=0x7f42f402a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8502850cbe219c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f402a580 con 0x5560a1dfc370 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f400b3d0 con 0x5560a1dfc370 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42f4012090 con 0x5560a1dfc370 2024-09-19T09:22:38.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42f4039050 con 0x5560a1dfc370 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f43075e6740 10 client.15705 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5560a1e04830 con 0x5560a1dfc370 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f400b3d0 con 0x5560a1dfc370 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.101+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42f4028070 con 0x5560a1dfc370 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 10 client.15705 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 20 client.15705 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e04f10 0x5560a1e788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 4 client.15705 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560a1d5ed70 con 0x5560a1e04f10 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f42fed9d640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e04f10 0x5560a1e788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f42e2ff5640 10 client.15705 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f42fed9d640 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e04f10 0x5560a1e788c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32195d757628db27 server_cookie=103f19defc7ae9c7 in_seq=0 out_seq=0 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f42e2ff5640 1 -- 172.21.15.52:0/3960961573 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560a1d5ed70 con 0x5560a1e04f10 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f42e2ff5640 10 client.15705 handle_command_reply: tid=0 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.102+0000 7f43075e6740 1 client.15705 shutdown 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 msgr2=0x5560a1e13350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f42f4012780 tx=0x7f42f402a4e0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 shutdown_connections 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5560a1e04f10 0x5560a1e788c0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5560a1dfc370 0x5560a1e13350 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5560a1df2b40 0x5560a1e12e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 --2- 172.21.15.52:0/3960961573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5560a1df15d0 0x5560a1e128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 >> 172.21.15.52:0/3960961573 conn(0x5560a1dba310 msgr2=0x5560a1df3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f42e2ff5640 0 client.15705 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:38.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 shutdown_connections 2024-09-19T09:22:38.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 1 -- 172.21.15.52:0/3960961573 wait complete. 2024-09-19T09:22:38.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f43075e6740 20 client.15705 trim_cache size 0 max 16384 2024-09-19T09:22:38.118 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 msgr2=0x7f42e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 0x7f42e80a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42f80cd570 tx=0x7f42f8066b80 comp rx=0 tx=0).stop 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 msgr2=0x7f4300074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f42f800eaa0 tx=0x7f42f800ef60 comp rx=0 tx=0).stop 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 shutdown_connections 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4300106f10 0x7f4300074f70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42e80a3240 0x7f42e80a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4300102790 0x7f4300074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 --2- 172.21.15.52:0/601088664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4300101de0 0x7f43000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:38.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.103+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 >> 172.21.15.52:0/601088664 conn(0x7f43000fd8c0 msgr2=0x7f43000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:38.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.104+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 shutdown_connections 2024-09-19T09:22:38.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:38.104+0000 7f430520d640 1 -- 172.21.15.52:0/601088664 wait complete. 2024-09-19T09:22:39.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:39 smithi052 ceph-mon[30947]: pgmap v374: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:39 smithi169 ceph-mon[35454]: pgmap v374: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:39.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:39 smithi086 ceph-mon[34813]: pgmap v374: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:22:39.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 -- 172.21.15.52:0/2810210692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c102610 msgr2=0x7fe49c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 --2- 172.21.15.52:0/2810210692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c102610 0x7fe49c108ea0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe494009ca0 tx=0x7fe49402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 -- 172.21.15.52:0/2810210692 shutdown_connections 2024-09-19T09:22:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 --2- 172.21.15.52:0/2810210692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c102610 0x7fe49c108ea0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 --2- 172.21.15.52:0/2810210692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 0x7fe49c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 --2- 172.21.15.52:0/2810210692 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c100a60 0x7fe49c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 -- 172.21.15.52:0/2810210692 >> 172.21.15.52:0/2810210692 conn(0x7fe49c0fc1e0 msgr2=0x7fe49c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 -- 172.21.15.52:0/2810210692 shutdown_connections 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.635+0000 7fe4a271f640 1 -- 172.21.15.52:0/2810210692 wait complete. 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 Processor -- start 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 -- start start 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 0x7fe49c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c102610 0x7fe49c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c10d890 con 0x7fe49c100a60 2024-09-19T09:22:39.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c10d710 con 0x7fe49c101c50 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.636+0000 7fe4a271f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c10da10 con 0x7fe49c102610 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33076/0 (socket says 172.21.15.52:33076) 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 -- 172.21.15.52:0/209962320 learned_addr learned my addr 172.21.15.52:0/209962320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c102610 0x7fe49c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 0x7fe49c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 -- 172.21.15.52:0/209962320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c102610 msgr2=0x7fe49c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c102610 0x7fe49c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 -- 172.21.15.52:0/209962320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 msgr2=0x7fe49c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 0x7fe49c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 -- 172.21.15.52:0/209962320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49c19f9c0 con 0x7fe49c100a60 2024-09-19T09:22:39.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.637+0000 7fe49bfff640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00d950 tx=0x7fe48c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.638+0000 7fe4997fa640 1 -- 172.21.15.52:0/209962320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c017070 con 0x7fe49c100a60 2024-09-19T09:22:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.638+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe49c19fcb0 con 0x7fe49c100a60 2024-09-19T09:22:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.638+0000 7fe4997fa640 1 -- 172.21.15.52:0/209962320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe48c009c30 con 0x7fe49c100a60 2024-09-19T09:22:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.638+0000 7fe4997fa640 1 -- 172.21.15.52:0/209962320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00f600 con 0x7fe49c100a60 2024-09-19T09:22:39.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.638+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe49c1a01b0 con 0x7fe49c100a60 2024-09-19T09:22:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.640+0000 7fe4997fa640 1 -- 172.21.15.52:0/209962320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe48c01a070 con 0x7fe49c100a60 2024-09-19T09:22:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.640+0000 7fe4a54b4740 1 Processor -- start 2024-09-19T09:22:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 -- start start 2024-09-19T09:22:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4997fa640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 0x7fe4840a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.647 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b86830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bc75ae22f0 con 0x55bc75b7f2e0 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc75a8a270 con 0x55bc75b7e9a0 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc75ade2b0 con 0x55bc75b84370 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 0x7fe4840a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33084/0 (socket says 172.21.15.52:33084) 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 -- 172.21.15.52:0/3481103050 learned_addr learned my addr 172.21.15.52:0/3481103050 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49bfff640 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.648 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b86830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe4997fa640 1 -- 172.21.15.52:0/209962320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe48c0cf400 con 0x7fe49c100a60 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 -- 172.21.15.52:0/3481103050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 msgr2=0x55bc75b86830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b86830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 -- 172.21.15.52:0/3481103050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 msgr2=0x55bc75b7eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.641+0000 7fe49b7fe640 1 -- 172.21.15.52:0/3481103050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc75a89340 con 0x55bc75b7f2e0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.642+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bcd0 tx=0x7fe4900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c7e45b6da63c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.642+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 0x7fe4840a57b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe494005e30 tx=0x7fe4940099f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.642+0000 7fe4827fc640 1 -- 172.21.15.52:0/3481103050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49001c680 con 0x55bc75b7f2e0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.642+0000 7fe4827fc640 1 -- 172.21.15.52:0/3481103050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe49001cd00 con 0x55bc75b7f2e0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.642+0000 7fe4827fc640 1 -- 172.21.15.52:0/3481103050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490011ba0 con 0x55bc75b7f2e0 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- 172.21.15.52:0/3481103050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 msgr2=0x55bc75b83da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bcd0 tx=0x7fe4900107a0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- 172.21.15.52:0/3481103050 shutdown_connections 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b86830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b83da0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/3481103050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- 172.21.15.52:0/3481103050 >> 172.21.15.52:0/3481103050 conn(0x55bc75b7a010 msgr2=0x55bc75b7a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- 172.21.15.52:0/3481103050 shutdown_connections 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- 172.21.15.52:0/3481103050 wait complete. 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 -- start start 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.643+0000 7fe4a54b4740 1 Processor -- start 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b88c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b84370 0x55bc75b901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.650 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bc75b87340 con 0x55bc75b7f2e0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc75a6b290 con 0x55bc75b84370 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc75b874c0 con 0x55bc75b7e9a0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a54b4740 10 client.0 _ll_register_callbacks cb 0x55bc75a9c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33098/0 (socket says 172.21.15.52:33098) 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 -- 172.21.15.52:0/64514511 learned_addr learned my addr 172.21.15.52:0/64514511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49bfff640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b88c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b84370 0x55bc75b901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 -- 172.21.15.52:0/64514511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 msgr2=0x55bc75b88c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b88c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 -- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b84370 msgr2=0x55bc75b901b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.651 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b84370 0x55bc75b901b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.644+0000 7fe49b7fe640 1 -- 172.21.15.52:0/64514511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc757f5210 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bca0 tx=0x7fe49000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1829aa7a510b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490011b10 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe490011cb0 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe49001cd00 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe490004020 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe4a54b4740 10 client.15717 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc758c1620 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe49001cd00 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe49001c780 con 0x55bc75b7f2e0 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe4a54b4740 10 client.15717 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:39.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.645+0000 7fe4a54b4740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe4a54b4740 20 client.15717 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75b94680 0x55bc75b96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe4a54b4740 4 client.15717 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc75aefa20 con 0x55bc75b94680 2024-09-19T09:22:39.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe49bfff640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75b94680 0x55bc75b96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe47b7fe640 10 client.15717 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.646+0000 7fe49bfff640 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75b94680 0x55bc75b96a70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61d7f0b14897d2c5 server_cookie=c5ea3bfc126aa658 in_seq=0 out_seq=0 2024-09-19T09:22:39.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe47b7fe640 1 -- 172.21.15.52:0/64514511 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc75aefa20 con 0x55bc75b94680 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe47b7fe640 10 client.15717 handle_command_reply: tid=0 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 client.15717 shutdown 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 msgr2=0x55bc75b89170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bca0 tx=0x7fe49000bf50 comp rx=0 tx=0).stop 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 shutdown_connections 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75b94680 0x55bc75b96a70 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b84370 0x55bc75b901b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b89170 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe47b7fe640 0 client.15717 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/64514511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b88c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.647+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 >> 172.21.15.52:0/64514511 conn(0x55bc75b7a010 msgr2=0x55bc75b7b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.648+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 shutdown_connections 2024-09-19T09:22:39.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.648+0000 7fe4a54b4740 1 -- 172.21.15.52:0/64514511 wait complete. 2024-09-19T09:22:39.656 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.648+0000 7fe4a54b4740 20 client.15717 trim_cache size 0 max 16384 2024-09-19T09:22:39.669 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 Processor -- start 2024-09-19T09:22:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 -- start start 2024-09-19T09:22:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7f2e0 0x55bc75b90170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1abb60 con 0x55bc75b84370 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1a9430 con 0x55bc75b7f2e0 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1a7280 con 0x55bc75b7e9a0 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33104/0 (socket says 172.21.15.52:33104) 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 -- 172.21.15.52:0/150242500 learned_addr learned my addr 172.21.15.52:0/150242500 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7f2e0 0x55bc75b90170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe49bfff640 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 -- 172.21.15.52:0/150242500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 msgr2=0x55bc75b7b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 -- 172.21.15.52:0/150242500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7f2e0 msgr2=0x55bc75b90170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7f2e0 0x55bc75b90170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.663+0000 7fe4a0cbc640 1 -- 172.21.15.52:0/150242500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc75b79e30 con 0x55bc75b84370 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.664+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe494035000 tx=0x7fe494049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e149cdaf6399bacf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.664+0000 7fe481ffb640 1 -- 172.21.15.52:0/150242500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494004230 con 0x55bc75b84370 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.664+0000 7fe481ffb640 1 -- 172.21.15.52:0/150242500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe494036070 con 0x55bc75b84370 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.664+0000 7fe481ffb640 1 -- 172.21.15.52:0/150242500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4940305c0 con 0x55bc75b84370 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- 172.21.15.52:0/150242500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 msgr2=0x55bc75b7b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe494035000 tx=0x7fe494049000 comp rx=0 tx=0).stop 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- 172.21.15.52:0/150242500 shutdown_connections 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b84370 0x55bc75b7b940 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7f2e0 0x55bc75b90170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/150242500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b7e9a0 0x55bc75b7b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- 172.21.15.52:0/150242500 >> 172.21.15.52:0/150242500 conn(0x55bc75b7a010 msgr2=0x55bc75b791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- 172.21.15.52:0/150242500 shutdown_connections 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- 172.21.15.52:0/150242500 wait complete. 2024-09-19T09:22:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 -- start start 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.665+0000 7fe4a54b4740 1 Processor -- start 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b8d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b8eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1a78f0 con 0x55bc75b7f2e0 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1a8d60 con 0x55bc75b7e9a0 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe49c1a7fc0 con 0x55bc75b84370 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a54b4740 10 client.0 _ll_register_callbacks cb 0x7fe48c00bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33114/0 (socket says 172.21.15.52:33114) 2024-09-19T09:22:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 -- 172.21.15.52:0/4003515020 learned_addr learned my addr 172.21.15.52:0/4003515020 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49bfff640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b8d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b8eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 -- 172.21.15.52:0/4003515020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 msgr2=0x55bc75b8eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b8eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 -- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 msgr2=0x55bc75b8d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b8d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 -- 172.21.15.52:0/4003515020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc75b8f180 con 0x55bc75b7f2e0 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe4a0cbc640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b8eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe49b7fe640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bf20 tx=0x7fe49000bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e56ac5982d36c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe47b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.666+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490034040 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe49000b810 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe494036070 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe490011650 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 10 client.15723 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc75b90490 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe494036070 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe4900035f0 con 0x55bc75b7f2e0 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 10 client.15723 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 20 client.15723 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75bff9d0 0x55bc75c01df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 4 client.15723 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.667+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bc75ae9d70 con 0x55bc75bff9d0 2024-09-19T09:22:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.668+0000 7fe49bfff640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75bff9d0 0x55bc75c01df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.668+0000 7fe49bfff640 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75bff9d0 0x55bc75c01df0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f4e613dc86b89bf server_cookie=263fc1ab2e8926f6 in_seq=0 out_seq=0 2024-09-19T09:22:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.668+0000 7fe47b7fe640 10 client.15723 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe47b7fe640 1 -- 172.21.15.52:0/4003515020 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bc75ae9d70 con 0x55bc75bff9d0 2024-09-19T09:22:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe47b7fe640 10 client.15723 handle_command_reply: tid=0 2024-09-19T09:22:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 client.15723 shutdown 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 msgr2=0x55bc75b8db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe49000bf20 tx=0x7fe49000bba0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 shutdown_connections 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc75bff9d0 0x55bc75c01df0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc75b84370 0x55bc75b8eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc75b7f2e0 0x55bc75b8db60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe47b7fe640 0 client.15723 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 --2- 172.21.15.52:0/4003515020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc75b7e9a0 0x55bc75b8d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 >> 172.21.15.52:0/4003515020 conn(0x55bc75b7a010 msgr2=0x55bc75b791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 shutdown_connections 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 1 -- 172.21.15.52:0/4003515020 wait complete. 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.675+0000 7fe4a54b4740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:22:39.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:22:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 msgr2=0x7fe4840a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 0x7fe4840a57b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe494005e30 tx=0x7fe4940099f0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 msgr2=0x7fe49c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00d950 tx=0x7fe48c00de10 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 shutdown_connections 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe4840a32f0 0x7fe4840a57b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe49c102610 0x7fe49c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe49c101c50 0x7fe49c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 --2- 172.21.15.52:0/209962320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe49c100a60 0x7fe49c197db0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 >> 172.21.15.52:0/209962320 conn(0x7fe49c0fc1e0 msgr2=0x7fe49c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 shutdown_connections 2024-09-19T09:22:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:39.676+0000 7fe4a271f640 1 -- 172.21.15.52:0/209962320 wait complete. 2024-09-19T09:22:39.805 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:22:39.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:22:39.900 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 -- 172.21.15.52:0/2808421691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674106f10 msgr2=0x7f367410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 --2- 172.21.15.52:0/2808421691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674106f10 0x7f367410ea90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f366c009900 tx=0x7f366c02a410 comp rx=0 tx=0).stop 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 -- 172.21.15.52:0/2808421691 shutdown_connections 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 --2- 172.21.15.52:0/2808421691 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674106f10 0x7f367410ea90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 --2- 172.21.15.52:0/2808421691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674102790 0x7f36741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 --2- 172.21.15.52:0/2808421691 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674101de0 0x7f36741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 -- 172.21.15.52:0/2808421691 >> 172.21.15.52:0/2808421691 conn(0x7f36740fd8c0 msgr2=0x7f36740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 -- 172.21.15.52:0/2808421691 shutdown_connections 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.376+0000 7f3678c8c640 1 -- 172.21.15.52:0/2808421691 wait complete. 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 Processor -- start 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 -- start start 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674102790 0x7f3674198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674106f10 0x7f367419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3674111f70 con 0x7f3674101de0 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3674111df0 con 0x7f3674106f10 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3678c8c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36741120f0 con 0x7f3674102790 2024-09-19T09:22:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f367259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f367259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33136/0 (socket says 172.21.15.52:33136) 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f367259c640 1 -- 172.21.15.52:0/759125200 learned_addr learned my addr 172.21.15.52:0/759125200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.377+0000 7f3671d9b640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674102790 0x7f3674198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f3672d9d640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674106f10 0x7f367419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 -- 172.21.15.52:0/759125200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674102790 msgr2=0x7f3674198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674102790 0x7f3674198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 -- 172.21.15.52:0/759125200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674106f10 msgr2=0x7f367419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674106f10 0x7f367419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 -- 172.21.15.52:0/759125200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367419d3a0 con 0x7f3674101de0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f367259c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f366400cce0 tx=0x7f366400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664004b20 con 0x7f3674101de0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3664004cc0 con 0x7f3674101de0 2024-09-19T09:22:40.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367419d690 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366400f7d0 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.378+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36741a4f70 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.379+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36741021c0 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.380+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f366400f970 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.381+0000 7f36637fe640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 0x7f365c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.381+0000 7f3671d9b640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 0x7f365c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.381+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36640cf990 con 0x7f3674101de0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.382+0000 7f3671d9b640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 0x7f365c0a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36740fdce0 tx=0x7f366800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:40.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.386+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3664014030 con 0x7f3674101de0 2024-09-19T09:22:40.479 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:40.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.609+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3674199750 con 0x7f3674101de0 2024-09-19T09:22:40.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.610+0000 7f36637fe640 1 -- 172.21.15.52:0/759125200 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f366409bfe0 con 0x7f3674101de0 2024-09-19T09:22:40.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:22:40.612 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:22:40.612 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 msgr2=0x7f365c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 0x7f365c0a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f36740fdce0 tx=0x7f366800b390 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 msgr2=0x7f36741983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f366400cce0 tx=0x7f366400a620 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 shutdown_connections 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3674106f10 0x7f367419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f365c0a3240 0x7f365c0a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3674102790 0x7f3674198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 --2- 172.21.15.52:0/759125200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3674101de0 0x7f36741983f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:40.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 >> 172.21.15.52:0/759125200 conn(0x7f36740fd8c0 msgr2=0x7f36740feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:40.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 shutdown_connections 2024-09-19T09:22:40.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:40.612+0000 7f3678c8c640 1 -- 172.21.15.52:0/759125200 wait complete. 2024-09-19T09:22:41.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.185+0000 7fce1c556640 1 -- 172.21.15.52:0/986581805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 msgr2=0x7fce141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.185+0000 7fce1c556640 1 --2- 172.21.15.52:0/986581805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce141067e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fce08009900 tx=0x7fce0802a410 comp rx=0 tx=0).stop 2024-09-19T09:22:41.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- 172.21.15.52:0/986581805 shutdown_connections 2024-09-19T09:22:41.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- 172.21.15.52:0/986581805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14106f10 0x7fce1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- 172.21.15.52:0/986581805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce141067e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- 172.21.15.52:0/986581805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14101de0 0x7fce141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- 172.21.15.52:0/986581805 >> 172.21.15.52:0/986581805 conn(0x7fce140fd8c0 msgr2=0x7fce140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- 172.21.15.52:0/986581805 shutdown_connections 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- 172.21.15.52:0/986581805 wait complete. 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 Processor -- start 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- start start 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 0x7fce14198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 0x7fce1419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce14111f70 con 0x7fce14102790 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce14111df0 con 0x7fce14101de0 2024-09-19T09:22:41.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.186+0000 7fce1c556640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce141120f0 con 0x7fce14106f10 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33144/0 (socket says 172.21.15.52:33144) 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 -- 172.21.15.52:0/2732071903 learned_addr learned my addr 172.21.15.52:0/2732071903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 0x7fce14198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 0x7fce1419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 -- 172.21.15.52:0/2732071903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 msgr2=0x7fce1419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 0x7fce1419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 -- 172.21.15.52:0/2732071903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 msgr2=0x7fce14198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 0x7fce14198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 -- 172.21.15.52:0/2732071903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1419d4c0 con 0x7fce14102790 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 0x7fce14198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 0x7fce1419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:41.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce19af1640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce08006010 tx=0x7fce080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce077fe640 1 -- 172.21.15.52:0/2732071903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0803f030 con 0x7fce14102790 2024-09-19T09:22:41.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1419d750 con 0x7fce14102790 2024-09-19T09:22:41.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce077fe640 1 -- 172.21.15.52:0/2732071903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce08003ce0 con 0x7fce14102790 2024-09-19T09:22:41.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.187+0000 7fce077fe640 1 -- 172.21.15.52:0/2732071903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08035070 con 0x7fce14102790 2024-09-19T09:22:41.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.188+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce141a5090 con 0x7fce14102790 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.190+0000 7fce077fe640 1 -- 172.21.15.52:0/2732071903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce08042030 con 0x7fce14102790 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.190+0000 7fce1e92f740 1 Processor -- start 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 -- start start 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f242f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f250130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f1a8280 con 0x55cc3f243480 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f14fb10 con 0x55cc3f24dd40 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1e92f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f1a4240 con 0x55cc3f242b60 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33150/0 (socket says 172.21.15.52:33150) 2024-09-19T09:22:41.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 -- 172.21.15.52:0/1056621578 learned_addr learned my addr 172.21.15.52:0/1056621578 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce19af1640 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f250130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f242f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce077fe640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 0x7fce000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 -- 172.21.15.52:0/1056621578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 msgr2=0x55cc3f242f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 0x7fce000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f242f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 -- 172.21.15.52:0/1056621578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 msgr2=0x55cc3f250130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.191+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f250130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce1a2f2640 1 -- 172.21.15.52:0/1056621578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc3f15c1f0 con 0x55cc3f243480 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce077fe640 1 -- 172.21.15.52:0/2732071903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce080effe0 con 0x7fce14102790 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fce10009d40 tx=0x7fce100117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4014e68f38071aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce04ff9640 1 -- 172.21.15.52:0/1056621578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10012650 con 0x55cc3f243480 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 0x7fce000a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce0c005fd0 tx=0x7fce0c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce04ff9640 1 -- 172.21.15.52:0/1056621578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce10009e30 con 0x55cc3f243480 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.192+0000 7fce04ff9640 1 -- 172.21.15.52:0/1056621578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000fd00 con 0x55cc3f243480 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- 172.21.15.52:0/1056621578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 msgr2=0x55cc3f24d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fce10009d40 tx=0x7fce100117b0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- 172.21.15.52:0/1056621578 shutdown_connections 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f250130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f24d800 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 --2- 172.21.15.52:0/1056621578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f242f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- 172.21.15.52:0/1056621578 >> 172.21.15.52:0/1056621578 conn(0x55cc3f23f0f0 msgr2=0x55cc3f23f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- 172.21.15.52:0/1056621578 shutdown_connections 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- 172.21.15.52:0/1056621578 wait complete. 2024-09-19T09:22:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 -- start start 2024-09-19T09:22:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.193+0000 7fce1e92f740 1 Processor -- start 2024-09-19T09:22:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f242b60 0x55cc3f24abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f243480 0x55cc3f24b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f250910 con 0x55cc3f24dd40 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f162f10 con 0x55cc3f242b60 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cc3f250a90 con 0x55cc3f243480 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1e92f740 10 client.0 _ll_register_callbacks cb 0x55cc3f12ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33164/0 (socket says 172.21.15.52:33164) 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 -- 172.21.15.52:0/2420877894 learned_addr learned my addr 172.21.15.52:0/2420877894 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f242b60 0x55cc3f24abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce19af1640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f243480 0x55cc3f24b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 -- 172.21.15.52:0/2420877894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f243480 msgr2=0x55cc3f24b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f243480 0x55cc3f24b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 -- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f242b60 msgr2=0x55cc3f24abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f242b60 0x55cc3f24abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.194+0000 7fce1aaf3640 1 -- 172.21.15.52:0/2420877894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc3ef196a0 con 0x55cc3f24dd40 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fce0c011bb0 tx=0x7fce0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e3e9ea6095f9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c019070 con 0x55cc3f24dd40 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce0c013020 con 0x55cc3f24dd40 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce10009e30 con 0x55cc3f24dd40 2024-09-19T09:22:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce0c013220 con 0x55cc3f24dd40 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 10 client.15741 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cc3f25c540 con 0x55cc3f24dd40 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce10009e30 con 0x55cc3f24dd40 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce0c030070 con 0x55cc3f24dd40 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 10 client.15741 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 20 client.15741 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f25d950 0x55cc3f25fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 4 client.15741 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.195+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc3f1b57f0 con 0x55cc3f25d950 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.196+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f25d950 0x55cc3f25fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.196+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f25d950 0x55cc3f25fdf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e199c38ee590610 server_cookie=91056ed6334bec28 in_seq=0 out_seq=0 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.196+0000 7fcdfdffb640 10 client.15741 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fcdfdffb640 1 -- 172.21.15.52:0/2420877894 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc3f1b57f0 con 0x55cc3f25d950 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fcdfdffb640 10 client.15741 handle_command_reply: tid=0 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 client.15741 shutdown 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 msgr2=0x55cc3f24b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fce0c011bb0 tx=0x7fce0c004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 shutdown_connections 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f25d950 0x55cc3f25fdf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f24dd40 0x55cc3f24b660 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f243480 0x55cc3f24b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fcdfdffb640 0 client.15741 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 --2- 172.21.15.52:0/2420877894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f242b60 0x55cc3f24abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 >> 172.21.15.52:0/2420877894 conn(0x55cc3f23f0f0 msgr2=0x55cc3f244dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 shutdown_connections 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 1 -- 172.21.15.52:0/2420877894 wait complete. 2024-09-19T09:22:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.197+0000 7fce1e92f740 20 client.15741 trim_cache size 0 max 16384 2024-09-19T09:22:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 Processor -- start 2024-09-19T09:22:41.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 -- start start 2024-09-19T09:22:41.217 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:41 smithi052 ceph-mon[30947]: pgmap v375: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-19T09:22:41.217 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:41 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/759125200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:41.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f244cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f265c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce141b00e0 con 0x55cc3f243480 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce141ad9b0 con 0x55cc3f24dd40 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1e92f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce141ab800 con 0x55cc3f242b60 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33168/0 (socket says 172.21.15.52:33168) 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 -- 172.21.15.52:0/3772320602 learned_addr learned my addr 172.21.15.52:0/3772320602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 -- 172.21.15.52:0/3772320602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 msgr2=0x55cc3f244cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f265c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f244cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f244cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 -- 172.21.15.52:0/3772320602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 msgr2=0x55cc3f265c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.215+0000 7fce19af1640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f265c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fce19af1640 1 -- 172.21.15.52:0/3772320602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc3f23fd80 con 0x55cc3f243480 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fce1aaf3640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f265c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fce19af1640 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fce08000c00 tx=0x7fce08005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cecd4088cf8521d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fcdfffff640 1 -- 172.21.15.52:0/3772320602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08049070 con 0x55cc3f243480 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fcdfffff640 1 -- 172.21.15.52:0/3772320602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce080dc040 con 0x55cc3f243480 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fcdfffff640 1 -- 172.21.15.52:0/3772320602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080b8040 con 0x55cc3f243480 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fce1e92f740 1 -- 172.21.15.52:0/3772320602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 msgr2=0x55cc3f265710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.216+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fce08000c00 tx=0x7fce08005e50 comp rx=0 tx=0).stop 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- 172.21.15.52:0/3772320602 shutdown_connections 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f265c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f265710 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3772320602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f244cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- 172.21.15.52:0/3772320602 >> 172.21.15.52:0/3772320602 conn(0x55cc3f23f0f0 msgr2=0x55cc3f2445b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- 172.21.15.52:0/3772320602 shutdown_connections 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- 172.21.15.52:0/3772320602 wait complete. 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- start start 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 Processor -- start 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f2c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f256220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce141abe70 con 0x55cc3f243480 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce141ad2e0 con 0x55cc3f24dd40 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce141ac540 con 0x55cc3f242b60 2024-09-19T09:22:41.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce1e92f740 10 client.0 _ll_register_callbacks cb 0x7fce0c009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.217+0000 7fce19af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33170/0 (socket says 172.21.15.52:33170) 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 -- 172.21.15.52:0/3404863587 learned_addr learned my addr 172.21.15.52:0/3404863587 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f2c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 -- 172.21.15.52:0/3404863587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 msgr2=0x55cc3f2c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f2c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 -- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 msgr2=0x55cc3f256220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f256220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 -- 172.21.15.52:0/3404863587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc3f2c1650 con 0x55cc3f243480 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f2c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce19af1640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce0803d040 tx=0x7fce080b82a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb3b95c5a0725e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:41.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fcdfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08049050 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce080b8350 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce080dc040 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce080b8040 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce1e92f740 10 client.15747 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.218+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cc3f2d13a0 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce080dc040 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce080f2070 con 0x55cc3f243480 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 10 client.15747 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 20 client.15747 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f2d1b10 0x55cc3f2d3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:41.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 4 client.15747 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:22:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cc3f1afd00 con 0x55cc3f2d1b10 2024-09-19T09:22:41.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f2d1b10 0x55cc3f2d3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fcdfdffb640 10 client.15747 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.219+0000 7fce1a2f2640 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f2d1b10 0x55cc3f2d3f30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f7c12cff7b4d0d server_cookie=4f23c518ae33da5b in_seq=0 out_seq=0 2024-09-19T09:22:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fcdfdffb640 1 -- 172.21.15.52:0/3404863587 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cc3f1afd00 con 0x55cc3f2d1b10 2024-09-19T09:22:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fcdfdffb640 10 client.15747 handle_command_reply: tid=0 2024-09-19T09:22:41.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 client.15747 shutdown 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 msgr2=0x55cc3f255ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fce0803d040 tx=0x7fce080b82a0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 shutdown_connections 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cc3f2d1b10 0x55cc3f2d3f30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cc3f24dd40 0x55cc3f256220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cc3f243480 0x55cc3f255ce0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 --2- 172.21.15.52:0/3404863587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cc3f242b60 0x55cc3f2c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 >> 172.21.15.52:0/3404863587 conn(0x55cc3f23f0f0 msgr2=0x55cc3f23e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fcdfdffb640 0 client.15747 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 shutdown_connections 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 1 -- 172.21.15.52:0/3404863587 wait complete. 2024-09-19T09:22:41.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.221+0000 7fce1e92f740 20 client.15747 trim_cache size 0 max 16384 2024-09-19T09:22:41.229 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:41.229 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:22:41.229 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "9d7f08fc-2e7c-430f-b432-1dc2b341ad5b", 2024-09-19T09:22:41.229 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:22:41.229 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 msgr2=0x7fce000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 0x7fce000a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fce0c005fd0 tx=0x7fce0c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 msgr2=0x7fce14198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fce08006010 tx=0x7fce080042f0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 shutdown_connections 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce000a3240 0x7fce000a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce14106f10 0x7fce1419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce14102790 0x7fce14198a50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 --2- 172.21.15.52:0/2732071903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce14101de0 0x7fce14198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:41.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 >> 172.21.15.52:0/2732071903 conn(0x7fce140fd8c0 msgr2=0x7fce140fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:41.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 shutdown_connections 2024-09-19T09:22:41.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:41.222+0000 7fce1c556640 1 -- 172.21.15.52:0/2732071903 wait complete. 2024-09-19T09:22:41.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:41 smithi169 ceph-mon[35454]: pgmap v375: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-19T09:22:41.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:41 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/759125200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:41 smithi086 ceph-mon[34813]: pgmap v375: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.6 KiB/s wr, 9 op/s 2024-09-19T09:22:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:41 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/759125200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:41.717 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 5c586c34 --release --await' 2024-09-19T09:22:41.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 5c586c34 --release --await 2024-09-19T09:22:42.377 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:42 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:22:42.377 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:42 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.377 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:42 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:22:42.377 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:42 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:22:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:42 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:22:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:42 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:42 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:22:42.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:42 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.462 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:42.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:42 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:22:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:42 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:42 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:22:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:42 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:42.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 -- 172.21.15.52:0/2444456572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 msgr2=0x7f52cc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 --2- 172.21.15.52:0/2444456572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc107b90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009930 tx=0x7f52b402a420 comp rx=0 tx=0).stop 2024-09-19T09:22:42.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 -- 172.21.15.52:0/2444456572 shutdown_connections 2024-09-19T09:22:42.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 --2- 172.21.15.52:0/2444456572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc1082a0 0x7f52cc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 --2- 172.21.15.52:0/2444456572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc107b90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 --2- 172.21.15.52:0/2444456572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc102d30 0x7f52cc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 -- 172.21.15.52:0/2444456572 >> 172.21.15.52:0/2444456572 conn(0x7f52cc0fc7d0 msgr2=0x7f52cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 -- 172.21.15.52:0/2444456572 shutdown_connections 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.910+0000 7f52d197e640 1 -- 172.21.15.52:0/2444456572 wait complete. 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 Processor -- start 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 -- start start 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102d30 0x7f52cc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc1082a0 0x7f52cc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1120c0 con 0x7f52cc1036e0 2024-09-19T09:22:42.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc111f40 con 0x7f52cc1082a0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.911+0000 7f52d197e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc112240 con 0x7f52cc102d30 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33196/0 (socket says 172.21.15.52:33196) 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 -- 172.21.15.52:0/2457138994 learned_addr learned my addr 172.21.15.52:0/2457138994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52caffd640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102d30 0x7f52cc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc1082a0 0x7f52cc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 -- 172.21.15.52:0/2457138994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102d30 msgr2=0x7f52cc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102d30 0x7f52cc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 -- 172.21.15.52:0/2457138994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc1082a0 msgr2=0x7f52cc19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc1082a0 0x7f52cc19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 -- 172.21.15.52:0/2457138994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52cc19d5f0 con 0x7f52cc1036e0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005940 tx=0x7f52b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52d097c640 1 -- 172.21.15.52:0/2457138994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b403f030 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52d097c640 1 -- 172.21.15.52:0/2457138994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52b4003ce0 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52cc19d880 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52d097c640 1 -- 172.21.15.52:0/2457138994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4035070 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.912+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52cc1a51c0 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d097c640 1 -- 172.21.15.52:0/2457138994 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52b4042030 con 0x7f52cc1036e0 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 Processor -- start 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 -- start start 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d4f60 0x55c44d0d5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c44d03a620 con 0x55c44d0d5880 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c44cfe1e50 con 0x55c44d0d4f60 2024-09-19T09:22:42.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.915+0000 7f52d3d57740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c44d0365e0 con 0x55c44d0e4650 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33206/0 (socket says 172.21.15.52:33206) 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 -- 172.21.15.52:0/343917325 learned_addr learned my addr 172.21.15.52:0/343917325 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52d097c640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 0x7f52b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 -- 172.21.15.52:0/343917325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 msgr2=0x55c44d0e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 -- 172.21.15.52:0/343917325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d4f60 msgr2=0x55c44d0d5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d4f60 0x55c44d0d5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 -- 172.21.15.52:0/343917325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44cfd2d40 con 0x55c44d0d5880 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 0x7f52b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52d097c640 1 -- 172.21.15.52:0/2457138994 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f52b40eff60 con 0x7f52cc1036e0 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52caffd640 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ac20 tx=0x7f52bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98ebe002e7ff92c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52c1ffb640 1 -- 172.21.15.52:0/343917325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc01d070 con 0x55c44d0d5880 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52c1ffb640 1 -- 172.21.15.52:0/343917325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52bc018b20 con 0x55c44d0d5880 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.916+0000 7f52c1ffb640 1 -- 172.21.15.52:0/343917325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc010c00 con 0x55c44d0d5880 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 0x7f52b80a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f52c40070b0 tx=0x7f52c400c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- 172.21.15.52:0/343917325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 msgr2=0x55c44d0e4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00ac20 tx=0x7f52bc00f790 comp rx=0 tx=0).stop 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- 172.21.15.52:0/343917325 shutdown_connections 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d5880 0x55c44d0e4110 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 --2- 172.21.15.52:0/343917325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d4f60 0x55c44d0d5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- 172.21.15.52:0/343917325 >> 172.21.15.52:0/343917325 conn(0x55c44d0d15f0 msgr2=0x55c44d0d19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- 172.21.15.52:0/343917325 shutdown_connections 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- 172.21.15.52:0/343917325 wait complete. 2024-09-19T09:22:42.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.917+0000 7f52d3d57740 1 -- start start 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 Processor -- start 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 0x55c44d0e1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c44d0e7280 con 0x55c44d0e4650 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c44cfc2f10 con 0x55c44d0d5880 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c44d0e7400 con 0x55c44d0d4f60 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52d3d57740 10 client.0 _ll_register_callbacks cb 0x55c44cfe6db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33212/0 (socket says 172.21.15.52:33212) 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 -- 172.21.15.52:0/878455041 learned_addr learned my addr 172.21.15.52:0/878455041 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52caffd640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 0x55c44d0e1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 -- 172.21.15.52:0/878455041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 msgr2=0x55c44d0e1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 0x55c44d0e1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 -- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 msgr2=0x55c44d0e1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52cb7fe640 1 -- 172.21.15.52:0/878455041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44cd49580 con 0x55c44d0e4650 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.918+0000 7f52caffd640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 0x55c44d0e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f52c4013e00 tx=0x7f52c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb24581a31b68cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4019050 con 0x55c44d0e4650 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f52c401e640 con 0x55c44d0e4650 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52bc018b20 con 0x55c44d0e4650 2024-09-19T09:22:42.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f52c401e840 con 0x55c44d0e4650 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 10 client.15759 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c44ce13960 con 0x55c44d0e4650 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52bc018b20 con 0x55c44d0e4650 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f52c4027a80 con 0x55c44d0e4650 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 10 client.15759 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 20 client.15759 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d0f4390 0x55c44d0f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.919+0000 7f52d3d57740 4 client.15759 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.920+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c44d047b90 con 0x55c44d0f4390 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.920+0000 7f52caffd640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d0f4390 0x55c44d0f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.920+0000 7f52caffd640 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d0f4390 0x55c44d0f67e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=780a1d63dff86e48 server_cookie=6f7dc54996515e5a in_seq=0 out_seq=0 2024-09-19T09:22:42.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.920+0000 7f52aaffd640 10 client.15759 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52aaffd640 1 -- 172.21.15.52:0/878455041 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c44d047b90 con 0x55c44d0f4390 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52aaffd640 10 client.15759 handle_command_reply: tid=0 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 client.15759 shutdown 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 msgr2=0x55c44d0e20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f52c4013e00 tx=0x7f52c4004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 shutdown_connections 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d0f4390 0x55c44d0f67e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0e4650 0x55c44d0e20a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 --2- 172.21.15.52:0/878455041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0d4f60 0x55c44d0e1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52aaffd640 0 client.15759 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 >> 172.21.15.52:0/878455041 conn(0x55c44d0d15f0 msgr2=0x55c44d0d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 shutdown_connections 2024-09-19T09:22:42.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 1 -- 172.21.15.52:0/878455041 wait complete. 2024-09-19T09:22:42.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.921+0000 7f52d3d57740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 Processor -- start 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 -- start start 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0fc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1adf70 con 0x55c44d0d4f60 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1ab840 con 0x55c44d0d5880 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52d3d57740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1a9690 con 0x55c44d0e4650 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33218/0 (socket says 172.21.15.52:33218) 2024-09-19T09:22:42.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.939+0000 7f52caffd640 1 -- 172.21.15.52:0/4135242890 learned_addr learned my addr 172.21.15.52:0/4135242890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 -- 172.21.15.52:0/4135242890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 msgr2=0x55c44d0fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0fc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 -- 172.21.15.52:0/4135242890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 msgr2=0x55c44d0fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 -- 172.21.15.52:0/4135242890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44d0dc3e0 con 0x55c44d0d4f60 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52caffd640 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55c44d0d7c50 tx=0x7f52bc010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259fe527b27c1dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52c17fa640 1 -- 172.21.15.52:0/4135242890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc01d040 con 0x55c44d0d4f60 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52c17fa640 1 -- 172.21.15.52:0/4135242890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52bc010510 con 0x55c44d0d4f60 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.940+0000 7f52c17fa640 1 -- 172.21.15.52:0/4135242890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc010b50 con 0x55c44d0d4f60 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- 172.21.15.52:0/4135242890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 msgr2=0x55c44d0e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55c44d0d7c50 tx=0x7f52bc010760 comp rx=0 tx=0).stop 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- 172.21.15.52:0/4135242890 shutdown_connections 2024-09-19T09:22:42.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 --2- 172.21.15.52:0/4135242890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e3590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- 172.21.15.52:0/4135242890 >> 172.21.15.52:0/4135242890 conn(0x55c44d0d15f0 msgr2=0x55c44d0e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- 172.21.15.52:0/4135242890 shutdown_connections 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- 172.21.15.52:0/4135242890 wait complete. 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.941+0000 7f52d3d57740 1 -- start start 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 Processor -- start 2024-09-19T09:22:42.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1a9d00 con 0x55c44d0d4f60 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1ab170 con 0x55c44d0d5880 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52cc1aa3d0 con 0x55c44d0e4650 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33226/0 (socket says 172.21.15.52:33226) 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52caffd640 1 -- 172.21.15.52:0/2546714778 learned_addr learned my addr 172.21.15.52:0/2546714778 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52d3d57740 10 client.0 _ll_register_callbacks cb 0x7f52c4013a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.942+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 -- 172.21.15.52:0/2546714778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 msgr2=0x55c44d0ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 -- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 msgr2=0x55c44d0e9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 -- 172.21.15.52:0/2546714778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44d0ecb80 con 0x55c44d0d4f60 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52cb7fe640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.943+0000 7f52caffd640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00f7d0 tx=0x7f52bc00a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33f828db02cda0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:42.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc01d040 con 0x55c44d0d4f60 2024-09-19T09:22:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f52bc0108d0 con 0x55c44d0d4f60 2024-09-19T09:22:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52bc010510 con 0x55c44d0d4f60 2024-09-19T09:22:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f52bc010ad0 con 0x55c44d0d4f60 2024-09-19T09:22:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52d3d57740 10 client.15765 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:42.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.944+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c44d15fcc0 con 0x55c44d0d4f60 2024-09-19T09:22:42.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52bc010510 con 0x55c44d0d4f60 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f52bc018790 con 0x55c44d0d4f60 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 10 client.15765 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 10 client.15765 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 20 client.15765 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d1600e0 0x55c44d1624d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 4 client.15765 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5c586c34", "release": true, "await": true}] 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.945+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5c586c34", "release": true, "await": true}) -- 0x55c44d0e2430 con 0x55c44d1600e0 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.946+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d1600e0 0x55c44d1624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.946+0000 7f52aaffd640 10 client.15765 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.946+0000 7f52ca7fc640 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d1600e0 0x55c44d1624d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4032a23e77e045e server_cookie=dfbd9dbcb48ac5a0 in_seq=0 out_seq=0 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.948+0000 7f52aaffd640 1 -- 172.21.15.52:0/2546714778 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c44d0e2430 con 0x55c44d1600e0 2024-09-19T09:22:42.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.948+0000 7f52aaffd640 10 client.15765 handle_command_reply: tid=0 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.948+0000 7f52d3d57740 1 client.15765 shutdown 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 msgr2=0x55c44d0e8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00f7d0 tx=0x7f52bc00a700 comp rx=0 tx=0).stop 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 shutdown_connections 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c44d1600e0 0x55c44d1624d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c44d0e4650 0x55c44d0ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c44d0d5880 0x55c44d0e9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 --2- 172.21.15.52:0/2546714778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c44d0d4f60 0x55c44d0e8ee0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52aaffd640 0 client.15765 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 >> 172.21.15.52:0/2546714778 conn(0x55c44d0d15f0 msgr2=0x55c44d0d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 shutdown_connections 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 1 -- 172.21.15.52:0/2546714778 wait complete. 2024-09-19T09:22:42.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.949+0000 7f52d3d57740 20 client.15765 trim_cache size 0 max 16384 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 8, 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "5c586c34": { 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 8, 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:42.955 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 140.3, 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:42.956 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:42.957 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 msgr2=0x7f52b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 0x7f52b80a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f52c40070b0 tx=0x7f52c400c040 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 msgr2=0x7f52cc198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f52b4005940 tx=0x7f52b40042f0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 shutdown_connections 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52cc1082a0 0x7f52cc19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f52cc1036e0 0x7f52cc198b80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52b80a3240 0x7f52b80a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 --2- 172.21.15.52:0/2457138994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52cc102d30 0x7f52cc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 >> 172.21.15.52:0/2457138994 conn(0x7f52cc0fc7d0 msgr2=0x7f52cc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 shutdown_connections 2024-09-19T09:22:42.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:42.950+0000 7f52d197e640 1 -- 172.21.15.52:0/2457138994 wait complete. 2024-09-19T09:22:42.965 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:43.319 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:43 smithi052 ceph-mon[30947]: pgmap v376: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:22:43.343 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:43 smithi169 ceph-mon[35454]: pgmap v376: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:22:43.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:43 smithi086 ceph-mon[34813]: pgmap v376: 97 pgs: 97 active+clean; 695 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:22:43.668 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5c586c34', total seconds elapsed: 24.4 2024-09-19T09:22:43.668 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:22:43.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:44.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3159297755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc103660 msgr2=0x7fc7dc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3159297755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc103660 0x7fc7dc10bb50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d002a480 comp rx=0 tx=0).stop 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3159297755 shutdown_connections 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3159297755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3159297755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc103660 0x7fc7dc10bb50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3159297755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc102d40 0x7fc7dc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3159297755 >> 172.21.15.52:0/3159297755 conn(0x7fc7dc0fc7a0 msgr2=0x7fc7dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3159297755 shutdown_connections 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.131+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3159297755 wait complete. 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 Processor -- start 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 -- start start 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc103660 0x7fc7dc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc111f70 con 0x7fc7dc102d40 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc111df0 con 0x7fc7dc10c170 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e23fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1120f0 con 0x7fc7dc103660 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33232/0 (socket says 172.21.15.52:33232) 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3217672766 learned_addr learned my addr 172.21.15.52:0/3217672766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7e099b640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3217672766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc103660 msgr2=0x7fc7dc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.132+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc103660 0x7fc7dc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc103660 0x7fc7dc100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3217672766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 msgr2=0x7fc7dc101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3217672766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc1a6890 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7e099b640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c920 tx=0x7fc7cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7d97fa640 1 -- 172.21.15.52:0/3217672766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc007c70 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc1a6b80 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7d97fa640 1 -- 172.21.15.52:0/3217672766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7cc007e10 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7d97fa640 1 -- 172.21.15.52:0/3217672766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc018890 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.133+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc1a70c0 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.135+0000 7fc7d97fa640 1 -- 172.21.15.52:0/3217672766 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc7cc018a70 con 0x7fc7dc102d40 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.135+0000 7fc7e47d7740 1 Processor -- start 2024-09-19T09:22:44.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 -- start start 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707b4a0 0x560ac707b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7086140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ac6fe12e0 con 0x560ac7086680 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560ac6f88ce0 con 0x560ac707b4a0 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ac6fdd2a0 con 0x560ac707bdc0 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7d97fa640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 0x7fc7c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33234/0 (socket says 172.21.15.52:33234) 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 -- 172.21.15.52:0/987146118 learned_addr learned my addr 172.21.15.52:0/987146118 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e099b640 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707b4a0 0x560ac707b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7d97fa640 1 -- 172.21.15.52:0/3217672766 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc7cc0cfb90 con 0x7fc7dc102d40 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7086140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7e099b640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 0x7fc7c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 -- 172.21.15.52:0/987146118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 msgr2=0x560ac7086140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7086140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 -- 172.21.15.52:0/987146118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707b4a0 msgr2=0x560ac707b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707b4a0 0x560ac707b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.136+0000 7fc7db7fe640 1 -- 172.21.15.52:0/987146118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac6f6d440 con 0x560ac7086680 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006010 tx=0x7fc7d0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e587fae6f20dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7e099b640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 0x7fc7c40a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009fd0 tx=0x7fc7d4005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7c27fc640 1 -- 172.21.15.52:0/987146118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d003f070 con 0x560ac7086680 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7c27fc640 1 -- 172.21.15.52:0/987146118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7d0004030 con 0x560ac7086680 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7c27fc640 1 -- 172.21.15.52:0/987146118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0035070 con 0x560ac7086680 2024-09-19T09:22:44.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7e47d7740 1 -- 172.21.15.52:0/987146118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 msgr2=0x560ac7088a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.137+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006010 tx=0x7fc7d0005dd0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- 172.21.15.52:0/987146118 shutdown_connections 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7088a70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7086140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/987146118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707b4a0 0x560ac707b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- 172.21.15.52:0/987146118 >> 172.21.15.52:0/987146118 conn(0x560ac7077a30 msgr2=0x560ac7077e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- 172.21.15.52:0/987146118 shutdown_connections 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- 172.21.15.52:0/987146118 wait complete. 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- start start 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 Processor -- start 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac7085f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac70836f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ac7089250 con 0x560ac707bdc0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560ac6f9c050 con 0x560ac7086680 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.138+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ac70893d0 con 0x560ac707b4a0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7e47d7740 10 client.0 _ll_register_callbacks cb 0x560ac6fdc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33236/0 (socket says 172.21.15.52:33236) 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 -- 172.21.15.52:0/24340350 learned_addr learned my addr 172.21.15.52:0/24340350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7e099b640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac70836f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac7085f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 -- 172.21.15.52:0/24340350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 msgr2=0x560ac7085f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac7085f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 -- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 msgr2=0x560ac70836f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac70836f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 -- 172.21.15.52:0/24340350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac6d523c0 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d0005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5419e5c610121a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0035030 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc7d00315b0 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d0004030 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7d003f070 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7e47d7740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.139+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560ac7094b60 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7d0004030 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc7d003b460 con 0x560ac707bdc0 2024-09-19T09:22:44.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 20 client.15777 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7095eb0 0x560ac70982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 4 client.15777 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ac6fee850 con 0x560ac7095eb0 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.140+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7095eb0 0x560ac70982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.141+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7095eb0 0x560ac70982a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0ed296aa0c2ceab server_cookie=a0cf522812fae9b4 in_seq=0 out_seq=0 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.141+0000 7fc7bb7fe640 10 client.15777 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.141+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/24340350 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ac6fee850 con 0x560ac7095eb0 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.141+0000 7fc7bb7fe640 10 client.15777 handle_command_reply: tid=0 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.141+0000 7fc7e47d7740 1 client.15777 shutdown 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 msgr2=0x560ac70831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009900 tx=0x7fc7d0005670 comp rx=0 tx=0).stop 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 shutdown_connections 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7095eb0 0x560ac70982a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac70836f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707bdc0 0x560ac70831b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/24340350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac7085f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7bb7fe640 0 client.15777 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 >> 172.21.15.52:0/24340350 conn(0x560ac7077a30 msgr2=0x560ac707d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 shutdown_connections 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 1 -- 172.21.15.52:0/24340350 wait complete. 2024-09-19T09:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.142+0000 7fc7e47d7740 20 client.15777 trim_cache size 0 max 16384 2024-09-19T09:22:44.158 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:44 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 Processor -- start 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 -- start start 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7082190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac709aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1b2230 con 0x560ac707b4a0 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1afb00 con 0x560ac7086680 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1ad950 con 0x560ac707bdc0 2024-09-19T09:22:44.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33242/0 (socket says 172.21.15.52:33242) 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3157784395 learned_addr learned my addr 172.21.15.52:0/3157784395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.166+0000 7fc7e099b640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac709aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3157784395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 msgr2=0x560ac7082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7082190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3157784395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 msgr2=0x560ac709aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac709aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 -- 172.21.15.52:0/3157784395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac7077860 con 0x560ac707b4a0 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7082190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cd660 tx=0x7fc7cc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a1754013b06ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7c1ffb640 1 -- 172.21.15.52:0/3157784395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0a4da0 con 0x560ac707b4a0 2024-09-19T09:22:44.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7c1ffb640 1 -- 172.21.15.52:0/3157784395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7cc09a1d0 con 0x560ac707b4a0 2024-09-19T09:22:44.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.167+0000 7fc7c1ffb640 1 -- 172.21.15.52:0/3157784395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0987a0 con 0x560ac707b4a0 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- 172.21.15.52:0/3157784395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 msgr2=0x560ac707e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cd660 tx=0x7fc7cc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- 172.21.15.52:0/3157784395 shutdown_connections 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac7086680 0x560ac709aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707bdc0 0x560ac7082190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/3157784395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac707b4a0 0x560ac707e900 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- 172.21.15.52:0/3157784395 >> 172.21.15.52:0/3157784395 conn(0x560ac7077a30 msgr2=0x560ac7081a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- 172.21.15.52:0/3157784395 shutdown_connections 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- 172.21.15.52:0/3157784395 wait complete. 2024-09-19T09:22:44.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.168+0000 7fc7e47d7740 1 -- start start 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 Processor -- start 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac709b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 0x560ac70988e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1adfc0 con 0x560ac7086680 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1af430 con 0x560ac707bdc0 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc1ae690 con 0x560ac707b4a0 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e47d7740 10 client.0 _ll_register_callbacks cb 0x7fc7d4009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e099b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e099b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33250/0 (socket says 172.21.15.52:33250) 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e099b640 1 -- 172.21.15.52:0/4117125203 learned_addr learned my addr 172.21.15.52:0/4117125203 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 0x560ac70988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac709b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 -- 172.21.15.52:0/4117125203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 msgr2=0x560ac709b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac709b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 -- 172.21.15.52:0/4117125203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 msgr2=0x560ac7098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7db7fe640 1 -- 172.21.15.52:0/4117125203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac7099650 con 0x560ac707bdc0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.169+0000 7fc7e099b640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7db7fe640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 0x560ac70988e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031550 tx=0x7fc7d0005930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1701ff792c4f5ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d005f060 con 0x560ac707bdc0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc7d00315b0 con 0x560ac707bdc0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7cc09a1d0 con 0x560ac707bdc0 2024-09-19T09:22:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc7d0035030 con 0x560ac707bdc0 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7e47d7740 10 client.25430 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.170+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560ac7100670 con 0x560ac707bdc0 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7cc09a1d0 con 0x560ac707bdc0 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc7d005a7c0 con 0x560ac707bdc0 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 10 client.25430 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 20 client.25430 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7100d90 0x560ac71031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 4 client.25430 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560ac7083a80 con 0x560ac7100d90 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.171+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7100d90 0x560ac71031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7bb7fe640 10 client.25430 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:44.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7dbfff640 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7100d90 0x560ac71031b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=338673be3218a8b8 server_cookie=91e8767821d407e5 in_seq=0 out_seq=0 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7bb7fe640 1 -- 172.21.15.52:0/4117125203 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560ac7083a80 con 0x560ac7100d90 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7bb7fe640 10 client.25430 handle_command_reply: tid=0 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 client.25430 shutdown 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 msgr2=0x560ac70988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 0x560ac70988e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031550 tx=0x7fc7d0005930 comp rx=0 tx=0).stop 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 shutdown_connections 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ac7100d90 0x560ac71031b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ac7086680 0x560ac7098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ac707bdc0 0x560ac70988e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 --2- 172.21.15.52:0/4117125203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ac707b4a0 0x560ac709b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7bb7fe640 0 client.25430 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:44.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 >> 172.21.15.52:0/4117125203 conn(0x560ac7077a30 msgr2=0x560ac7076350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 shutdown_connections 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 1 -- 172.21.15.52:0/4117125203 wait complete. 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.172+0000 7fc7e47d7740 20 client.25430 trim_cache size 0 max 16384 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:22:44.180 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 msgr2=0x7fc7c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 0x7fc7c40a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009fd0 tx=0x7fc7d4005bd0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 msgr2=0x7fc7dc1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00c920 tx=0x7fc7cc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 shutdown_connections 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7dc10c170 0x7fc7dc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc7c40a3240 0x7fc7c40a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7dc103660 0x7fc7dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 --2- 172.21.15.52:0/3217672766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc7dc102d40 0x7fc7dc1009a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 >> 172.21.15.52:0/3217672766 conn(0x7fc7dc0fc7a0 msgr2=0x7fc7dc0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 shutdown_connections 2024-09-19T09:22:44.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:44.173+0000 7fc7e23fe640 1 -- 172.21.15.52:0/3217672766 wait complete. 2024-09-19T09:22:44.383 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:44.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:44 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:22:44.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:44 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:22:44.781 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:22:44.782 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 -- 172.21.15.52:0/3297782620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074590 msgr2=0x7fa618074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/3297782620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074590 0x7fa618074970 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009900 tx=0x7fa60c02a480 comp rx=0 tx=0).stop 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 -- 172.21.15.52:0/3297782620 shutdown_connections 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/3297782620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6181129f0 0x7fa618114de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/3297782620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa618074eb0 0x7fa6181124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/3297782620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074590 0x7fa618074970 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 -- 172.21.15.52:0/3297782620 >> 172.21.15.52:0/3297782620 conn(0x7fa6180fd700 msgr2=0x7fa6180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:45.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 -- 172.21.15.52:0/3297782620 shutdown_connections 2024-09-19T09:22:45.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 -- 172.21.15.52:0/3297782620 wait complete. 2024-09-19T09:22:45.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.304+0000 7fa61dfa2640 1 Processor -- start 2024-09-19T09:22:45.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 -- start start 2024-09-19T09:22:45.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074eb0 0x7fa6181a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6181129f0 0x7fa61819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6181184d0 con 0x7fa618074eb0 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa618118350 con 0x7fa618074590 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61dfa2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa618118650 con 0x7fa6181129f0 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61cfa0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61cfa0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:49436/0 (socket says 172.21.15.52:49436) 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61cfa0640 1 -- 172.21.15.52:0/23693827 learned_addr learned my addr 172.21.15.52:0/23693827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa617fff640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074eb0 0x7fa6181a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.305+0000 7fa61d7a1640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6181129f0 0x7fa61819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 -- 172.21.15.52:0/23693827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6181129f0 msgr2=0x7fa61819e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6181129f0 0x7fa61819e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 -- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074eb0 msgr2=0x7fa6181a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074eb0 0x7fa6181a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 -- 172.21.15.52:0/23693827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa61819efe0 con 0x7fa618074590 2024-09-19T09:22:45.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61cfa0640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c03f030 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa60c003ce0 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61819f270 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.306+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60c035070 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.307+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6181ab520 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.308+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa618075cd0 con 0x7fa618074590 2024-09-19T09:22:45.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.309+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa60c042030 con 0x7fa618074590 2024-09-19T09:22:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.310+0000 7fa615ffb640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 0x7fa6080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.310+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa60c0f0280 con 0x7fa618074590 2024-09-19T09:22:45.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.310+0000 7fa617fff640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 0x7fa6080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.310+0000 7fa617fff640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 0x7fa6080a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6180ffd90 tx=0x7fa60400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.313+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa60c0bc990 con 0x7fa618074590 2024-09-19T09:22:45.346 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:45.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:45 smithi052 ceph-mon[30947]: pgmap v377: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:22:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:45 smithi169 ceph-mon[35454]: pgmap v377: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:22:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:45 smithi086 ceph-mon[34813]: pgmap v377: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:22:45.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.535+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6181ab6f0 con 0x7fa618074590 2024-09-19T09:22:45.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.536+0000 7fa615ffb640 1 -- 172.21.15.52:0/23693827 <== mon.2 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fa60c0c0c90 con 0x7fa618074590 2024-09-19T09:22:45.538 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:22:45.539 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:22:45.539 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:22:45.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 msgr2=0x7fa6080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 0x7fa6080a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6180ffd90 tx=0x7fa60400b390 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 msgr2=0x7fa6181a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60c006010 tx=0x7fa60c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 shutdown_connections 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6080a3240 0x7fa6080a5700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6181129f0 0x7fa61819e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa618074eb0 0x7fa6181a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 --2- 172.21.15.52:0/23693827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa618074590 0x7fa6181a46c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 >> 172.21.15.52:0/23693827 conn(0x7fa6180fd700 msgr2=0x7fa6180fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 shutdown_connections 2024-09-19T09:22:45.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.539+0000 7fa61dfa2640 1 -- 172.21.15.52:0/23693827 wait complete. 2024-09-19T09:22:45.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.950+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/1566695378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 msgr2=0x7f2c041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.950+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/1566695378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041067e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009900 tx=0x7f2bf002a410 comp rx=0 tx=0).stop 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/1566695378 shutdown_connections 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/1566695378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04106f10 0x7f2c0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/1566695378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041067e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/1566695378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04101de0 0x7f2c041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/1566695378 >> 172.21.15.52:0/1566695378 conn(0x7f2c040fd8c0 msgr2=0x7f2c040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/1566695378 shutdown_connections 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/1566695378 wait complete. 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 Processor -- start 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.951+0000 7f2c0b1d4640 1 -- start start 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04101de0 0x7f2c041984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04106f10 0x7f2c0419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04111f70 con 0x7f2c04102790 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04111df0 con 0x7f2c04101de0 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2c041120f0 con 0x7f2c04106f10 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33282/0 (socket says 172.21.15.52:33282) 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 -- 172.21.15.52:0/637125892 learned_addr learned my addr 172.21.15.52:0/637125892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c09771640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04106f10 0x7f2c0419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c08f70640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04101de0 0x7f2c041984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 -- 172.21.15.52:0/637125892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04106f10 msgr2=0x7f2c0419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04106f10 0x7f2c0419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 -- 172.21.15.52:0/637125892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04101de0 msgr2=0x7f2c041984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04101de0 0x7f2c041984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 -- 172.21.15.52:0/637125892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0419d460 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c03fff640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006010 tx=0x7f2bf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf003f030 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.952+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0419d6f0 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.953+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf0003ce0 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.953+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0035070 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.953+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c041a5030 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.954+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c041021c0 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.955+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2bf0042030 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.955+0000 7f2c01ffb640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 0x7f2bf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.956+0000 7f2c08f70640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 0x7f2bf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.956+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2bf00efea0 con 0x7f2c04102790 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.956+0000 7f2c08f70640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 0x7f2bf40a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8005fd0 tx=0x7f2bf800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:45.960+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bf00bc550 con 0x7f2c04102790 2024-09-19T09:22:46.156 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:46 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/23693827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.176+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c0410a150 con 0x7f2c04102790 2024-09-19T09:22:46.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.177+0000 7f2c01ffb640 1 -- 172.21.15.52:0/637125892 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f2bf00c0850 con 0x7f2c04102790 2024-09-19T09:22:46.178 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:22:46.179 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:22:46.179 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:22:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 msgr2=0x7f2bf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 0x7f2bf40a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8005fd0 tx=0x7f2bf800b390 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 msgr2=0x7f2c041989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0006010 tx=0x7f2bf00042f0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 shutdown_connections 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2bf40a3240 0x7f2bf40a5700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2c04106f10 0x7f2c0419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c04102790 0x7f2c041989f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 --2- 172.21.15.52:0/637125892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c04101de0 0x7f2c041984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 >> 172.21.15.52:0/637125892 conn(0x7f2c040fd8c0 msgr2=0x7f2c040fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 shutdown_connections 2024-09-19T09:22:46.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:46.179+0000 7f2c0b1d4640 1 -- 172.21.15.52:0/637125892 wait complete. 2024-09-19T09:22:46.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:46 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/23693827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:46.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:46 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/23693827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:46.528 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:22:46.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:22:47.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:47 smithi052 ceph-mon[30947]: pgmap v378: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:22:47.086 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/637125892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:47.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:22:47.221 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:47 smithi169 ceph-mon[35454]: pgmap v378: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:22:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/637125892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:47.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:47 smithi086 ceph-mon[34813]: pgmap v378: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:22:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/637125892' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 -- 172.21.15.52:0/2182607048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a01036c0 msgr2=0x7f64a010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 --2- 172.21.15.52:0/2182607048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a01036c0 0x7f64a010bbb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6488009900 tx=0x7f648802a480 comp rx=0 tx=0).stop 2024-09-19T09:22:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 -- 172.21.15.52:0/2182607048 shutdown_connections 2024-09-19T09:22:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 --2- 172.21.15.52:0/2182607048 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a010c180 0x7f64a010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 --2- 172.21.15.52:0/2182607048 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a01036c0 0x7f64a010bbb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 --2- 172.21.15.52:0/2182607048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 0x7f64a0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 -- 172.21.15.52:0/2182607048 >> 172.21.15.52:0/2182607048 conn(0x7f64a00fc7a0 msgr2=0x7f64a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 -- 172.21.15.52:0/2182607048 shutdown_connections 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.733+0000 7f64a4d04640 1 -- 172.21.15.52:0/2182607048 wait complete. 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 Processor -- start 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 -- start start 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 0x7f64a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a01036c0 0x7f64a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0111f60 con 0x7f64a010c180 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f64a0111de0 con 0x7f64a0102da0 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.734+0000 7f64a4d04640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01120e0 con 0x7f64a01036c0 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33308/0 (socket says 172.21.15.52:33308) 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a01036c0 0x7f64a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 -- 172.21.15.52:0/468107865 learned_addr learned my addr 172.21.15.52:0/468107865 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649e59c640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 0x7f64a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 -- 172.21.15.52:0/468107865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a01036c0 msgr2=0x7f64a0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a01036c0 0x7f64a0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 -- 172.21.15.52:0/468107865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 msgr2=0x7f64a0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 0x7f64a0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 -- 172.21.15.52:0/468107865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a019d3e0 con 0x7f64a010c180 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f649ed9d640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f649800cad0 tx=0x7f649800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f6497fff640 1 -- 172.21.15.52:0/468107865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800ae20 con 0x7f64a010c180 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a019d6d0 con 0x7f64a010c180 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f6497fff640 1 -- 172.21.15.52:0/468107865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6498005020 con 0x7f64a010c180 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.735+0000 7f6497fff640 1 -- 172.21.15.52:0/468107865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800f6b0 con 0x7f64a010c180 2024-09-19T09:22:47.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.736+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a01a4fb0 con 0x7f64a010c180 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f6497fff640 1 -- 172.21.15.52:0/468107865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f64980051d0 con 0x7f64a010c180 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 Processor -- start 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 -- start start 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048ee2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e048e47160 con 0x55e048eeda30 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e048dee720 con 0x55e048ee3170 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.738+0000 7f64a70dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e048e43120 con 0x55e048ee2850 2024-09-19T09:22:47.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33314/0 (socket says 172.21.15.52:33314) 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6497fff640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 -- 172.21.15.52:0/3581220420 learned_addr learned my addr 172.21.15.52:0/3581220420 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048ee2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f649e59c640 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f649ed9d640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 -- 172.21.15.52:0/3581220420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 msgr2=0x55e048ee2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048ee2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 -- 172.21.15.52:0/3581220420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 msgr2=0x55e048eed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 -- 172.21.15.52:0/3581220420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e048bb8ba0 con 0x55e048eeda30 2024-09-19T09:22:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6497fff640 1 -- 172.21.15.52:0/468107865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f64980cfc70 con 0x7f64a010c180 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6495d9b640 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6488009900 tx=0x7f64880314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eea325ac7788743 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f649ed9d640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 0x7f648c0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64980a4950 tx=0x7f649806d890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.739+0000 7f6494d99640 1 -- 172.21.15.52:0/3581220420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6488035070 con 0x55e048eeda30 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f6494d99640 1 -- 172.21.15.52:0/3581220420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6488031a10 con 0x55e048eeda30 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f6494d99640 1 -- 172.21.15.52:0/3581220420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648803d6b0 con 0x55e048eeda30 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 -- 172.21.15.52:0/3581220420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 msgr2=0x55e048eefe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6488009900 tx=0x7f64880314d0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 -- 172.21.15.52:0/3581220420 shutdown_connections 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eefe20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 --2- 172.21.15.52:0/3581220420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048ee2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 -- 172.21.15.52:0/3581220420 >> 172.21.15.52:0/3581220420 conn(0x55e048edede0 msgr2=0x55e048edf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 -- 172.21.15.52:0/3581220420 shutdown_connections 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.740+0000 7f64a70dd740 1 -- 172.21.15.52:0/3581220420 wait complete. 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 -- start start 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 Processor -- start 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eeaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e048ef0600 con 0x55e048eeda30 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e048dcf900 con 0x55e048ee3170 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e048ef0780 con 0x55e048ee2850 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f64a70dd740 10 client.0 _ll_register_callbacks cb 0x55e048dcd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:47.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33322/0 (socket says 172.21.15.52:33322) 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 -- 172.21.15.52:0/559826738 learned_addr learned my addr 172.21.15.52:0/559826738 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f649e59c640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eeaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 -- 172.21.15.52:0/559826738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 msgr2=0x55e048eea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 -- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 msgr2=0x55e048eeaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eeaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.741+0000 7f6495d9b640 1 -- 172.21.15.52:0/559826738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e048e0fc50 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6495d9b640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6488001eb0 tx=0x7f6488041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5987e6366cad53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648804e070 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6488003e80 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e048e54890 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6488035070 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 10 client.15807 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e048efc310 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e048e54890 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f648803dbc0 con 0x55e048eeda30 2024-09-19T09:22:47.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 10 client.15807 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 10 client.15807 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 20 client.15807 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048efd660 0x55e048effa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 4 client.15807 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.742+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e048e4ebe0 con 0x55e048efd660 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.743+0000 7f649e59c640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048efd660 0x55e048effa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.743+0000 7f649e59c640 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048efd660 0x55e048effa50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d33c59e6f3e53e server_cookie=8e2fa0e9791e5d63 in_seq=0 out_seq=0 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.743+0000 7f6485ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f6485ffb640 1 -- 172.21.15.52:0/559826738 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e048e4ebe0 con 0x55e048efd660 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f6485ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 client.15807 shutdown 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 msgr2=0x55e048eeb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6488001eb0 tx=0x7f6488041040 comp rx=0 tx=0).stop 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 shutdown_connections 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048efd660 0x55e048effa50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048eeb400 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048eeaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 --2- 172.21.15.52:0/559826738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f6485ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 >> 172.21.15.52:0/559826738 conn(0x55e048edede0 msgr2=0x55e048ee4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 shutdown_connections 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 1 -- 172.21.15.52:0/559826738 wait complete. 2024-09-19T09:22:47.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.744+0000 7f64a70dd740 20 client.15807 trim_cache size 0 max 16384 2024-09-19T09:22:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.761+0000 7f64a70dd740 1 Processor -- start 2024-09-19T09:22:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.761+0000 7f64a70dd740 1 -- start start 2024-09-19T09:22:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048ed9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01adf30 con 0x55e048eeda30 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01ab800 con 0x55e048ee3170 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f64a70dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01a9650 con 0x55e048ee2850 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33338/0 (socket says 172.21.15.52:33338) 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 -- 172.21.15.52:0/1015906845 learned_addr learned my addr 172.21.15.52:0/1015906845 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f649e59c640 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048ed9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 -- 172.21.15.52:0/1015906845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 msgr2=0x55e048eec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eec850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 -- 172.21.15.52:0/1015906845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 msgr2=0x55e048ed9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048ed9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 -- 172.21.15.52:0/1015906845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e048ee2680 con 0x55e048eeda30 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6495d9b640 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f64880319e0 tx=0x7f6488005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db60d495f6e2c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6487fff640 1 -- 172.21.15.52:0/1015906845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648804e040 con 0x55e048eeda30 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6487fff640 1 -- 172.21.15.52:0/1015906845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f648803ce10 con 0x55e048eeda30 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.762+0000 7f6487fff640 1 -- 172.21.15.52:0/1015906845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648803dad0 con 0x55e048eeda30 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- 172.21.15.52:0/1015906845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 msgr2=0x55e048f02a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f64880319e0 tx=0x7f6488005fd0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- 172.21.15.52:0/1015906845 shutdown_connections 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f02a70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee3170 0x55e048ed9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 --2- 172.21.15.52:0/1015906845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee2850 0x55e048eec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- 172.21.15.52:0/1015906845 >> 172.21.15.52:0/1015906845 conn(0x55e048edede0 msgr2=0x55e048ee9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- 172.21.15.52:0/1015906845 shutdown_connections 2024-09-19T09:22:47.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- 172.21.15.52:0/1015906845 wait complete. 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.763+0000 7f64a70dd740 1 -- start start 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 Processor -- start 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee2850 0x55e048f03300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee3170 0x55e048f00650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01a9cc0 con 0x55e048eeda30 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01ab130 con 0x55e048ee2850 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64a01aa390 con 0x55e048ee3170 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f64a70dd740 10 client.0 _ll_register_callbacks cb 0x7f64900106e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33344/0 (socket says 172.21.15.52:33344) 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 -- 172.21.15.52:0/816712639 learned_addr learned my addr 172.21.15.52:0/816712639 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee2850 0x55e048f03300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f649e59c640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee3170 0x55e048f00650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 -- 172.21.15.52:0/816712639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee3170 msgr2=0x55e048f00650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee3170 0x55e048f00650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 -- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee2850 msgr2=0x55e048f03300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee2850 0x55e048f03300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 -- 172.21.15.52:0/816712639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e048f01490 con 0x55e048eeda30 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6495d9b640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6488033000 tx=0x7f648803c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88f7e9647446582 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.764+0000 7f6485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648804e040 con 0x55e048eeda30 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6488003a30 con 0x55e048eeda30 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f648803ce10 con 0x55e048eeda30 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6488074030 con 0x55e048eeda30 2024-09-19T09:22:47.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 10 client.15813 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e048f680b0 con 0x55e048eeda30 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f648803ce10 con 0x55e048eeda30 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f648803d970 con 0x55e048eeda30 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 10 client.15813 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 10 client.15813 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 20 client.15813 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048f685a0 0x55e048f6a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 4 client.15813 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55e048dcaf40 con 0x55e048f685a0 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.765+0000 7f649e59c640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048f685a0 0x55e048f6a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.766+0000 7f649e59c640 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048f685a0 0x55e048f6a990 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=336e033c29755b65 server_cookie=5b5965ada6e0d299 in_seq=0 out_seq=0 2024-09-19T09:22:47.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.766+0000 7f6485ffb640 10 client.15813 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.780+0000 7f6485ffb640 1 -- 172.21.15.52:0/816712639 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e048dcaf40 con 0x55e048f685a0 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.780+0000 7f6485ffb640 10 client.15813 handle_command_reply: tid=0 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.780+0000 7f64a70dd740 1 client.15813 shutdown 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 msgr2=0x55e048f00c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6488033000 tx=0x7f648803c7f0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 shutdown_connections 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e048f685a0 0x55e048f6a990 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e048eeda30 0x55e048f00c60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e048ee3170 0x55e048f00650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 --2- 172.21.15.52:0/816712639 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e048ee2850 0x55e048f03300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 >> 172.21.15.52:0/816712639 conn(0x55e048edede0 msgr2=0x55e048eea940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f6485ffb640 0 client.15813 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 shutdown_connections 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 1 -- 172.21.15.52:0/816712639 wait complete. 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a70dd740 20 client.15813 trim_cache size 0 max 16384 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 10, 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "3fb6f79e": { 2024-09-19T09:22:47.784 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 10, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 140.3, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:22:47.785 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:22:47.786 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 msgr2=0x7f648c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 0x7f648c0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f64980a4950 tx=0x7f649806d890 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 msgr2=0x7f64a019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.781+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f649800cad0 tx=0x7f649800cf90 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 shutdown_connections 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64a010c180 0x7f64a019cd00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64a01036c0 0x7f64a0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 --2- 172.21.15.52:0/468107865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f64a0102da0 0x7f64a0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 >> 172.21.15.52:0/468107865 conn(0x7f64a00fc7a0 msgr2=0x7f64a00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 shutdown_connections 2024-09-19T09:22:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:47.782+0000 7f64a4d04640 1 -- 172.21.15.52:0/468107865 wait complete. 2024-09-19T09:22:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:48.415 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3fb6f79e', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T09:22:49.150 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:49 smithi052 ceph-mon[30947]: pgmap v379: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 -- 172.21.15.52:0/4210734387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 msgr2=0x7ff5f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 --2- 172.21.15.52:0/4210734387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f01021c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009900 tx=0x7ff5ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 -- 172.21.15.52:0/4210734387 shutdown_connections 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 --2- 172.21.15.52:0/4210734387 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0106f10 0x7ff5f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 --2- 172.21.15.52:0/4210734387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0102790 0x7ff5f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 --2- 172.21.15.52:0/4210734387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f01021c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 -- 172.21.15.52:0/4210734387 >> 172.21.15.52:0/4210734387 conn(0x7ff5f00fd8c0 msgr2=0x7ff5f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 -- 172.21.15.52:0/4210734387 shutdown_connections 2024-09-19T09:22:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.148+0000 7ff5f74be640 1 -- 172.21.15.52:0/4210734387 wait complete. 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 Processor -- start 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 -- start start 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0102790 0x7ff5f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0106f10 0x7ff5f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0111f90 con 0x7ff5f0101de0 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0111e10 con 0x7ff5f0106f10 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f74be640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f0112110 con 0x7ff5f0102790 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f525a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f525a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37974/0 (socket says 172.21.15.52:37974) 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f525a640 1 -- 172.21.15.52:0/3983973422 learned_addr learned my addr 172.21.15.52:0/3983973422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:49.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.149+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0106f10 0x7ff5f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0102790 0x7ff5f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 -- 172.21.15.52:0/3983973422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0102790 msgr2=0x7ff5f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0102790 0x7ff5f0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 -- 172.21.15.52:0/3983973422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0106f10 msgr2=0x7ff5f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0106f10 0x7ff5f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 -- 172.21.15.52:0/3983973422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f01aae30 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f525a640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec006010 tx=0x7ff5ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5e67fc640 1 -- 172.21.15.52:0/3983973422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec03f030 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f01ab000 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5e67fc640 1 -- 172.21.15.52:0/3983973422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec003ce0 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5e67fc640 1 -- 172.21.15.52:0/3983973422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec035070 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.150+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f01ab590 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.152+0000 7ff5e67fc640 1 -- 172.21.15.52:0/3983973422 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff5ec042030 con 0x7ff5f0101de0 2024-09-19T09:22:49.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 Processor -- start 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 -- start start 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff6b40 0x5635e0ff5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0ff5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5635e0f5b2f0 con 0x5635e1000370 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5635e0f02cf0 con 0x5635e0ff55d0 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f9897740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5635e0f572b0 con 0x5635e0ff6b40 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f525a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0ff5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37990/0 (socket says 172.21.15.52:37990) 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 -- 172.21.15.52:0/3526139723 learned_addr learned my addr 172.21.15.52:0/3526139723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5e67fc640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 0x7ff5dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff6b40 0x5635e0ff5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 0x7ff5dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 -- 172.21.15.52:0/3526139723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff6b40 msgr2=0x5635e0ff5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5e67fc640 1 -- 172.21.15.52:0/3983973422 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5ec0efbb0 con 0x7ff5f0101de0 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff6b40 0x5635e0ff5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 -- 172.21.15.52:0/3526139723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 msgr2=0x5635e0ff5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.153+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0ff5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5f4a59640 1 -- 172.21.15.52:0/3526139723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e0ee73a0 con 0x5635e1000370 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009af0 tx=0x7ff5e000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64d899effd980dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 0x7ff5dc0a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009900 tx=0x7ff5e8009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5db7fe640 1 -- 172.21.15.52:0/3526139723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0016070 con 0x5635e1000370 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5db7fe640 1 -- 172.21.15.52:0/3526139723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5e000ed20 con 0x5635e1000370 2024-09-19T09:22:49.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.154+0000 7ff5db7fe640 1 -- 172.21.15.52:0/3526139723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00107b0 con 0x5635e1000370 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- 172.21.15.52:0/3526139723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 msgr2=0x5635e1002760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009af0 tx=0x7ff5e000e2f0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- 172.21.15.52:0/3526139723 shutdown_connections 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e1000370 0x5635e1002760 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0ff5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 --2- 172.21.15.52:0/3526139723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff6b40 0x5635e0ff5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- 172.21.15.52:0/3526139723 >> 172.21.15.52:0/3526139723 conn(0x5635e0fbe310 msgr2=0x5635e0ff1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- 172.21.15.52:0/3526139723 shutdown_connections 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- 172.21.15.52:0/3526139723 wait complete. 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 -- start start 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.155+0000 7ff5f9897740 1 Processor -- start 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0fffc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e1000370 0x5635e0ffd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5635e1003070 con 0x5635e0ff6b40 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5635e0f16060 con 0x5635e0ff55d0 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5635e10031f0 con 0x5635e1000370 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f9897740 10 client.0 _ll_register_callbacks cb 0x5635e0c698c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37998/0 (socket says 172.21.15.52:37998) 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 -- 172.21.15.52:0/2079812751 learned_addr learned my addr 172.21.15.52:0/2079812751 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 -- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e1000370 msgr2=0x5635e0ffd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e1000370 0x5635e0ffd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0fffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 -- 172.21.15.52:0/2079812751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 msgr2=0x5635e0fffc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0fffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 -- 172.21.15.52:0/2079812751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e0ccc3c0 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00056b0 tx=0x7ff5e00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90cc4ca26679f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.156+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0028060 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5e00048d0 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5e000ed20 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5e0016070 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 10 client.15825 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5635e100ea60 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5e000ed20 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5e000f040 con 0x5635e0ff6b40 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 10 client.15825 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:49.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 10 client.15825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 20 client.15825 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e100fdb0 0x5635e10121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 4 client.15825 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.157+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635e0f68860 con 0x5635e100fdb0 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.158+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e100fdb0 0x5635e10121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.158+0000 7ff5d8ff9640 10 client.15825 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.158+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e100fdb0 0x5635e10121a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4de4615661fb75f server_cookie=49b6076ef46d454b in_seq=0 out_seq=0 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2079812751 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635e0f68860 con 0x5635e100fdb0 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5d8ff9640 10 client.15825 handle_command_reply: tid=0 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 client.15825 shutdown 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 msgr2=0x5635e0ffcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00056b0 tx=0x7ff5e00056e0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 shutdown_connections 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e100fdb0 0x5635e10121a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e1000370 0x5635e0ffd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e0ffcf60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2079812751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff55d0 0x5635e0fffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5d8ff9640 0 client.15825 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 >> 172.21.15.52:0/2079812751 conn(0x5635e0fbe310 msgr2=0x5635e0ff7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 shutdown_connections 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 1 -- 172.21.15.52:0/2079812751 wait complete. 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.159+0000 7ff5f9897740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.172+0000 7ff5f9897740 1 Processor -- start 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.172+0000 7ff5f9897740 1 -- start start 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.172+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e0ff8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 0x5635e1017860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f9897740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b6730 con 0x5635e0fbe310 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f9897740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b4000 con 0x5635e0ff6b40 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f9897740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b1e50 con 0x5635e0ff55d0 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38000/0 (socket says 172.21.15.52:38000) 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 -- 172.21.15.52:0/2820682772 learned_addr learned my addr 172.21.15.52:0/2820682772 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e0ff8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 0x5635e1017860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 -- 172.21.15.52:0/2820682772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 msgr2=0x5635e0ff8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e0ff8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 -- 172.21.15.52:0/2820682772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 msgr2=0x5635e1017860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 0x5635e1017860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 -- 172.21.15.52:0/2820682772 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e0ff2960 con 0x5635e0fbe310 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 0x5635e1017860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0781145d3929c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5daffd640 1 -- 172.21.15.52:0/2820682772 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec049040 con 0x5635e0fbe310 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5daffd640 1 -- 172.21.15.52:0/2820682772 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec03b580 con 0x5635e0fbe310 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.173+0000 7ff5daffd640 1 -- 172.21.15.52:0/2820682772 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0ba450 con 0x5635e0fbe310 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- 172.21.15.52:0/2820682772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 msgr2=0x5635e100c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000c00 tx=0x7ff5ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- 172.21.15.52:0/2820682772 shutdown_connections 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0ff6b40 0x5635e1017860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e0ff8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2820682772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0fbe310 0x5635e100c310 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- 172.21.15.52:0/2820682772 >> 172.21.15.52:0/2820682772 conn(0x5635e0ffd600 msgr2=0x5635e0ffc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- 172.21.15.52:0/2820682772 shutdown_connections 2024-09-19T09:22:49.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- 172.21.15.52:0/2820682772 wait complete. 2024-09-19T09:22:49.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.174+0000 7ff5f9897740 1 -- start start 2024-09-19T09:22:49.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 Processor -- start 2024-09-19T09:22:49.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0fbe310 0x5635e10042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e1004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b24c0 con 0x5635e0ff6b40 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b3930 con 0x5635e0fbe310 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f01b2b90 con 0x5635e0ff55d0 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38006/0 (socket says 172.21.15.52:38006) 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 -- 172.21.15.52:0/2653922157 learned_addr learned my addr 172.21.15.52:0/2653922157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f9897740 10 client.0 _ll_register_callbacks cb 0x7ff5ec0bbf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0fbe310 0x5635e10042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f4a59640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e1004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 -- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 msgr2=0x5635e1004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e1004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 -- 172.21.15.52:0/2653922157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0fbe310 msgr2=0x5635e10042e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0fbe310 0x5635e10042e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.175+0000 7ff5f5a5b640 1 -- 172.21.15.52:0/2653922157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e1079930 con 0x5635e0ff6b40 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5f5a5b640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8017ad0 tx=0x7ff5e8009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42e0a6484a32426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e802b060 con 0x5635e0ff6b40 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5e8017e20 con 0x5635e0ff6b40 2024-09-19T09:22:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635e0f62d70 con 0x5635e0ff6b40 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5e8014040 con 0x5635e0ff6b40 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5f9897740 10 client.15831 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5635e107abe0 con 0x5635e0ff6b40 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5635e0f62d70 con 0x5635e0ff6b40 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.176+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5e80307e0 con 0x5635e0ff6b40 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 10 client.15831 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 10 client.15831 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 20 client.15831 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e1000370 0x5635e107d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 4 client.15831 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635e0edf170 con 0x5635e1000370 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e1000370 0x5635e107d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f525a640 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e1000370 0x5635e107d3a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1f9c375813b0856 server_cookie=a5a7e3ad4c0c0e1e in_seq=0 out_seq=0 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5d8ff9640 10 client.15831 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5d8ff9640 1 -- 172.21.15.52:0/2653922157 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635e0edf170 con 0x5635e1000370 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5d8ff9640 10 client.15831 handle_command_reply: tid=0 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.177+0000 7ff5f9897740 1 client.15831 shutdown 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 msgr2=0x5635e1004d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8017ad0 tx=0x7ff5e8009be0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 shutdown_connections 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5635e1000370 0x5635e107d3a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5635e0ff6b40 0x5635e1004d60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5635e0ff55d0 0x5635e1004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 --2- 172.21.15.52:0/2653922157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5635e0fbe310 0x5635e10042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 >> 172.21.15.52:0/2653922157 conn(0x5635e0ffd600 msgr2=0x5635e0ffc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5d8ff9640 0 client.15831 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:22:49.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 shutdown_connections 2024-09-19T09:22:49.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 1 -- 172.21.15.52:0/2653922157 wait complete. 2024-09-19T09:22:49.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f9897740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T09:22:49.195 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 msgr2=0x7ff5dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 0x7ff5dc0a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009900 tx=0x7ff5e8009650 comp rx=0 tx=0).stop 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 msgr2=0x7ff5f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec006010 tx=0x7ff5ec0042f0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 shutdown_connections 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f0106f10 0x7ff5f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5dc0a3240 0x7ff5dc0a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5f0102790 0x7ff5f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 --2- 172.21.15.52:0/3983973422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5f0101de0 0x7ff5f00744f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.178+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 >> 172.21.15.52:0/3983973422 conn(0x7ff5f00fd8c0 msgr2=0x7ff5f00fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.179+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 shutdown_connections 2024-09-19T09:22:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:49.179+0000 7ff5f74be640 1 -- 172.21.15.52:0/3983973422 wait complete. 2024-09-19T09:22:49.445 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:49 smithi169 ceph-mon[35454]: pgmap v379: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T09:22:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:49 smithi086 ceph-mon[34813]: pgmap v379: 97 pgs: 97 active+clean; 703 KiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T09:22:49.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:22:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 -- 172.21.15.52:0/1623346992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc358109120 msgr2=0x7fc358110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/1623346992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc358109120 0x7fc358110ca0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc350009ca0 tx=0x7fc35002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 -- 172.21.15.52:0/1623346992 shutdown_connections 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/1623346992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc358109120 0x7fc358110ca0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/1623346992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3581049a0 0x7fc3581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/1623346992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358103ff0 0x7fc3581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 -- 172.21.15.52:0/1623346992 >> 172.21.15.52:0/1623346992 conn(0x7fc3580ffa90 msgr2=0x7fc358101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 -- 172.21.15.52:0/1623346992 shutdown_connections 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.506+0000 7fc35f1b9640 1 -- 172.21.15.52:0/1623346992 wait complete. 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 Processor -- start 2024-09-19T09:22:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 -- start start 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc358103ff0 0x7fc35819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109120 0x7fc35819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc358114240 con 0x7fc3581049a0 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581140c0 con 0x7fc358103ff0 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35f1b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581143c0 con 0x7fc358109120 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38014/0 (socket says 172.21.15.52:38014) 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 -- 172.21.15.52:0/2938712846 learned_addr learned my addr 172.21.15.52:0/2938712846 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35cf55640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc358103ff0 0x7fc35819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 -- 172.21.15.52:0/2938712846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109120 msgr2=0x7fc35819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc35d756640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109120 0x7fc35819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109120 0x7fc35819f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 -- 172.21.15.52:0/2938712846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc358103ff0 msgr2=0x7fc35819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc358103ff0 0x7fc35819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.507+0000 7fc357fff640 1 -- 172.21.15.52:0/2938712846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35819f6f0 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc357fff640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc34400b4a0 tx=0x7fc34400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc355ffb640 1 -- 172.21.15.52:0/2938712846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344014070 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc355ffb640 1 -- 172.21.15.52:0/2938712846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc344010af0 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35819f9e0 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc355ffb640 1 -- 172.21.15.52:0/2938712846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344017d10 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.508+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3581a72c0 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.510+0000 7fc355ffb640 1 -- 172.21.15.52:0/2938712846 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc344017070 con 0x7fc3581049a0 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.510+0000 7fc361592740 1 Processor -- start 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 -- start start 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572408a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572415760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d57236e2f0 con 0x55d572409b40 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d572315cf0 con 0x55d572413370 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc361592740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d57236a2b0 con 0x55d5724085d0 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc355ffb640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 0x7fc3480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38026/0 (socket says 172.21.15.52:38026) 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 -- 172.21.15.52:0/858455485 learned_addr learned my addr 172.21.15.52:0/858455485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc357fff640 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572415760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35cf55640 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572408a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 0x7fc3480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc355ffb640 1 -- 172.21.15.52:0/2938712846 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc3440ced60 con 0x7fc3581049a0 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 -- 172.21.15.52:0/858455485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 msgr2=0x55d572408a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572408a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 -- 172.21.15.52:0/858455485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 msgr2=0x55d572415760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572415760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.511+0000 7fc35d756640 1 -- 172.21.15.52:0/858455485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5722fa3a0 con 0x55d572409b40 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc35d756640 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc35002aed0 tx=0x7fc350031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7968b4d3accf4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc342ffd640 1 -- 172.21.15.52:0/858455485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35004e070 con 0x55d572409b40 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc342ffd640 1 -- 172.21.15.52:0/858455485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350036040 con 0x55d572409b40 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc342ffd640 1 -- 172.21.15.52:0/858455485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350030e50 con 0x55d572409b40 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc361592740 1 -- 172.21.15.52:0/858455485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 msgr2=0x55d572408090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc35d756640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 0x7fc3480a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc35004b000 tx=0x7fc350047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.512+0000 7fc361592740 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc35002aed0 tx=0x7fc350031bb0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- 172.21.15.52:0/858455485 shutdown_connections 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572415760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572408a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- 172.21.15.52:0/858455485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572408090 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- 172.21.15.52:0/858455485 >> 172.21.15.52:0/858455485 conn(0x55d5723d1310 msgr2=0x55d572404c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- 172.21.15.52:0/858455485 shutdown_connections 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- 172.21.15.52:0/858455485 wait complete. 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- start start 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 Processor -- start 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 0x55d572410030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572410640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d572416070 con 0x55d5724085d0 2024-09-19T09:22:50.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d572329060 con 0x55d572413370 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.513+0000 7fc361592740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d5724161f0 con 0x55d572409b40 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc361592740 10 client.0 _ll_register_callbacks cb 0x55d57207c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38040/0 (socket says 172.21.15.52:38040) 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 -- 172.21.15.52:0/3913376360 learned_addr learned my addr 172.21.15.52:0/3913376360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc357fff640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 0x55d572410030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35d756640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572410640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 -- 172.21.15.52:0/3913376360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 msgr2=0x55d572410030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 0x55d572410030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 -- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 msgr2=0x55d572410640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572410640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc35cf55640 1 -- 172.21.15.52:0/3913376360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5720df3c0 con 0x55d5724085d0 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.514+0000 7fc357fff640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 0x55d572410030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:50.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc35cf55640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc34c011570 tx=0x7fc34c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc690630b4a7293 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc337fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c013670 con 0x55d5724085d0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc34c013810 con 0x55d5724085d0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc350036040 con 0x55d5724085d0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc34c022020 con 0x55d5724085d0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc361592740 10 client.15843 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d572421bf0 con 0x55d5724085d0 2024-09-19T09:22:50.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.515+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350036040 con 0x55d5724085d0 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc34c014c80 con 0x55d5724085d0 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 10 client.15843 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 10 client.15843 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 20 client.15843 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d572423000 0x55d572425410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 4 client.15843 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d57237b860 con 0x55d572423000 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc357fff640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d572423000 0x55d572425410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc337fff640 10 client.15843 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:50.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.516+0000 7fc357fff640 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d572423000 0x55d572425410 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32e0969da1fed983 server_cookie=bd90a4bed0202bd9 in_seq=0 out_seq=0 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc337fff640 1 -- 172.21.15.52:0/3913376360 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d57237b860 con 0x55d572423000 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc337fff640 10 client.15843 handle_command_reply: tid=0 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 client.15843 shutdown 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 msgr2=0x55d572412d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc34c011570 tx=0x7fc34c011a30 comp rx=0 tx=0).stop 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 shutdown_connections 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d572423000 0x55d572425410 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572413370 0x55d572410640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572409b40 0x55d572410030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc337fff640 0 client.15843 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.517+0000 7fc361592740 1 --2- 172.21.15.52:0/3913376360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5724085d0 0x55d572412d80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.518+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 >> 172.21.15.52:0/3913376360 conn(0x55d5723d1310 msgr2=0x55d57240a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.518+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 shutdown_connections 2024-09-19T09:22:50.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.518+0000 7fc361592740 1 -- 172.21.15.52:0/3913376360 wait complete. 2024-09-19T09:22:50.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.518+0000 7fc361592740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 Processor -- start 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 -- start start 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572403bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572409b40 0x55d57240b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581b22e0 con 0x55d572413370 2024-09-19T09:22:50.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581afbb0 con 0x55d572409b40 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc361592740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581ada00 con 0x55d5724085d0 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38052/0 (socket says 172.21.15.52:38052) 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 -- 172.21.15.52:0/121478427 learned_addr learned my addr 172.21.15.52:0/121478427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc357fff640 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572409b40 0x55d57240b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35cf55640 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572403bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 -- 172.21.15.52:0/121478427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 msgr2=0x55d572403bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572403bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 -- 172.21.15.52:0/121478427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572409b40 msgr2=0x55d57240b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572409b40 0x55d57240b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.531+0000 7fc35d756640 1 -- 172.21.15.52:0/121478427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5724082d0 con 0x55d572413370 2024-09-19T09:22:50.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc35d756640 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc350031c20 tx=0x7fc350030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ab23bb79006f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc3427fc640 1 -- 172.21.15.52:0/121478427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35004e070 con 0x55d572413370 2024-09-19T09:22:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc3427fc640 1 -- 172.21.15.52:0/121478427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350057030 con 0x55d572413370 2024-09-19T09:22:50.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc3427fc640 1 -- 172.21.15.52:0/121478427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350030e00 con 0x55d572413370 2024-09-19T09:22:50.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 -- 172.21.15.52:0/121478427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 msgr2=0x55d57240b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc350031c20 tx=0x7fc350030b30 comp rx=0 tx=0).stop 2024-09-19T09:22:50.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 -- 172.21.15.52:0/121478427 shutdown_connections 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572413370 0x55d57240b660 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d572409b40 0x55d57240b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 --2- 172.21.15.52:0/121478427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5724085d0 0x55d572403bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.532+0000 7fc361592740 1 -- 172.21.15.52:0/121478427 >> 172.21.15.52:0/121478427 conn(0x55d5723d1310 msgr2=0x55d5724034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- 172.21.15.52:0/121478427 shutdown_connections 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- 172.21.15.52:0/121478427 wait complete. 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- start start 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 Processor -- start 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5724085d0 0x55d5724171c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572413370 0x55d572417c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581ae070 con 0x55d572409b40 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581af4e0 con 0x55d5724085d0 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3581ae740 con 0x55d572413370 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc361592740 10 client.0 _ll_register_callbacks cb 0x7fc34c0095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.533+0000 7fc357fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38066/0 (socket says 172.21.15.52:38066) 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 -- 172.21.15.52:0/370726386 learned_addr learned my addr 172.21.15.52:0/370726386 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc35d756640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572413370 0x55d572417c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc35cf55640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5724085d0 0x55d5724171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 -- 172.21.15.52:0/370726386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572413370 msgr2=0x55d572417c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572413370 0x55d572417c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 -- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5724085d0 msgr2=0x55d5724171c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5724085d0 0x55d5724171c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 -- 172.21.15.52:0/370726386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d572405960 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc357fff640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc34409b290 tx=0x7fc3440907e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea697efebe7eb3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc337fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34401e040 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc344099600 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc350057030 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc344095030 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc361592740 10 client.15849 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.534+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d57248de30 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350057030 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc344097970 con 0x55d572409b40 2024-09-19T09:22:50.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 10 client.15849 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 10 client.15849 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 20 client.15849 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d57248e5b0 0x55d5724909d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 4 client.15849 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d572375d70 con 0x55d57248e5b0 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.535+0000 7fc35cf55640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d57248e5b0 0x55d5724909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc35cf55640 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d57248e5b0 0x55d5724909d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5075f2f89d6ebe76 server_cookie=a38c88adb092ff9a in_seq=0 out_seq=0 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc337fff640 10 client.15849 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc337fff640 1 -- 172.21.15.52:0/370726386 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d572375d70 con 0x55d57248e5b0 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc337fff640 10 client.15849 handle_command_reply: tid=0 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 client.15849 shutdown 2024-09-19T09:22:50.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 msgr2=0x55d572417700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc34409b290 tx=0x7fc3440907e0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 shutdown_connections 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d572413370 0x55d572417c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d572409b40 0x55d572417700 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d57248e5b0 0x55d5724909d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc337fff640 0 client.15849 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 --2- 172.21.15.52:0/370726386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5724085d0 0x55d5724171c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 >> 172.21.15.52:0/370726386 conn(0x55d5723d1310 msgr2=0x55d572403d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 shutdown_connections 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 1 -- 172.21.15.52:0/370726386 wait complete. 2024-09-19T09:22:50.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.536+0000 7fc361592740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T09:22:50.544 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 msgr2=0x7fc3480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 0x7fc3480a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc35004b000 tx=0x7fc350047000 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 msgr2=0x7fc35819ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc34400b4a0 tx=0x7fc34400b960 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 shutdown_connections 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3480a3240 0x7fc3480a5700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc358109120 0x7fc35819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3581049a0 0x7fc35819ac80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 --2- 172.21.15.52:0/2938712846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc358103ff0 0x7fc35819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 >> 172.21.15.52:0/2938712846 conn(0x7fc3580ffa90 msgr2=0x7fc358100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 shutdown_connections 2024-09-19T09:22:50.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:50.537+0000 7fc35f1b9640 1 -- 172.21.15.52:0/2938712846 wait complete. 2024-09-19T09:22:51.172 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:51 smithi052 ceph-mon[30947]: pgmap v380: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:51.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:22:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:51 smithi169 ceph-mon[35454]: pgmap v380: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:51.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:51 smithi086 ceph-mon[34813]: pgmap v380: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/2756732889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1810c170 msgr2=0x7fbe1810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/2756732889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1810c170 0x7fbe1810e610 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbe10009ca0 tx=0x7fbe1002a950 comp rx=0 tx=0).stop 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/2756732889 shutdown_connections 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/2756732889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1810c170 0x7fbe1810e610 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/2756732889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe18103660 0x7fbe1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/2756732889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 0x7fbe18103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/2756732889 >> 172.21.15.52:0/2756732889 conn(0x7fbe180fc7a0 msgr2=0x7fbe180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/2756732889 shutdown_connections 2024-09-19T09:22:51.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.933+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/2756732889 wait complete. 2024-09-19T09:22:51.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 Processor -- start 2024-09-19T09:22:51.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 -- start start 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 0x7fbe18198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1810c170 0x7fbe1819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18111fb0 con 0x7fbe18103660 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18111e30 con 0x7fbe1810c170 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe1d4d4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe18112130 con 0x7fbe18102d40 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.934+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38080/0 (socket says 172.21.15.52:38080) 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 -- 172.21.15.52:0/3289244453 learned_addr learned my addr 172.21.15.52:0/3289244453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1810c170 0x7fbe1819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 0x7fbe18198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 -- 172.21.15.52:0/3289244453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 msgr2=0x7fbe18198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 0x7fbe18198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 -- 172.21.15.52:0/3289244453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1810c170 msgr2=0x7fbe1819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1810c170 0x7fbe1819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 -- 172.21.15.52:0/3289244453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1819d420 con 0x7fbe18103660 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00d950 tx=0x7fbe0c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbdfffff640 1 -- 172.21.15.52:0/3289244453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c017030 con 0x7fbe18103660 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbdfffff640 1 -- 172.21.15.52:0/3289244453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0c00be10 con 0x7fbe18103660 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbdfffff640 1 -- 172.21.15.52:0/3289244453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0055f0 con 0x7fbe18103660 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1819d710 con 0x7fbe18103660 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.935+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181a4ff0 con 0x7fbe18103660 2024-09-19T09:22:51.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbdfffff640 1 -- 172.21.15.52:0/3289244453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe0c009a30 con 0x7fbe18103660 2024-09-19T09:22:51.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 Processor -- start 2024-09-19T09:22:51.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 -- start start 2024-09-19T09:22:51.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b41b40 0x55f524b40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524b51b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f524aa62f0 con 0x55f524b405d0 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f524a4dcf0 con 0x55f524b4f780 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f524aa22b0 con 0x55f524b41b40 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe16ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe16ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38086/0 (socket says 172.21.15.52:38086) 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbe16ffd640 1 -- 172.21.15.52:0/1135869758 learned_addr learned my addr 172.21.15.52:0/1135869758 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.938+0000 7fbdfffff640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 0x7fbe000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe177fe640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b41b40 0x55f524b40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe167fc640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524b51b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 -- 172.21.15.52:0/1135869758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b41b40 msgr2=0x55f524b40090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b41b40 0x55f524b40090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 -- 172.21.15.52:0/1135869758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 msgr2=0x55f524b51b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524b51b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 -- 172.21.15.52:0/1135869758 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f524a323a0 con 0x55f524b405d0 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 0x7fbe000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe167fc640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524b51b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:51.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbdfffff640 1 -- 172.21.15.52:0/3289244453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe0c0cf1a0 con 0x7fbe18103660 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009a70 tx=0x7fbe08009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c2e3a35ad4ec4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbdfd7fa640 1 -- 172.21.15.52:0/1135869758 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08017070 con 0x55f524b405d0 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbdfd7fa640 1 -- 172.21.15.52:0/1135869758 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08013470 con 0x55f524b405d0 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.939+0000 7fbdfd7fa640 1 -- 172.21.15.52:0/1135869758 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08012630 con 0x55f524b405d0 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/1135869758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 msgr2=0x55f524b40a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009a70 tx=0x7fbe08009f30 comp rx=0 tx=0).stop 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 0x7fbe000a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe10005e30 tx=0x7fbe100095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/1135869758 shutdown_connections 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524b51b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b405d0 0x55f524b40a10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/1135869758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b41b40 0x55f524b40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/1135869758 >> 172.21.15.52:0/1135869758 conn(0x55f524b09310 msgr2=0x55f524b3cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/1135869758 shutdown_connections 2024-09-19T09:22:51.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/1135869758 wait complete. 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 -- start start 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.940+0000 7fbe1f8ad740 1 Processor -- start 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 0x55f524b4f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b4f780 0x55f524b4ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f524b52480 con 0x55f524b41b40 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f524a61060 con 0x55f524b405d0 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f524b52600 con 0x55f524b4f780 2024-09-19T09:22:51.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe1f8ad740 10 client.0 _ll_register_callbacks cb 0x55f5247b48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38098/0 (socket says 172.21.15.52:38098) 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 -- 172.21.15.52:0/4196126747 learned_addr learned my addr 172.21.15.52:0/4196126747 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 0x55f524b4f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe177fe640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b4f780 0x55f524b4ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 -- 172.21.15.52:0/4196126747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b4f780 msgr2=0x55f524b4ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b4f780 0x55f524b4ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 -- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 msgr2=0x55f524b4f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 0x55f524b4f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe167fc640 1 -- 172.21.15.52:0/4196126747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5248173c0 con 0x55f524b41b40 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.941+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 0x55f524b4f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe167fc640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009610 tx=0x7fbe0c09c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7ccb1d98057cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a43b0 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe0c099a40 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe08013470 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe0c09b740 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 10 client.15861 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f524b5dfa0 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe08013470 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe0c0a3f20 con 0x55f524b41b40 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 10 client.15861 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 20 client.15861 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524b5f460 0x55f524b61850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 4 client.15861 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:51.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.942+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f524ab3860 con 0x55f524b5f460 2024-09-19T09:22:51.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.943+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524b5f460 0x55f524b61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.943+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524b5f460 0x55f524b61850 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1b85035505ee0e server_cookie=74ef939b65cafda4 in_seq=0 out_seq=0 2024-09-19T09:22:51.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.943+0000 7fbdfaff5640 10 client.15861 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbdfaff5640 1 -- 172.21.15.52:0/4196126747 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f524ab3860 con 0x55f524b5f460 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbdfaff5640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 client.15861 shutdown 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 msgr2=0x55f524b4c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009610 tx=0x7fbe0c09c0d0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 shutdown_connections 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524b5f460 0x55f524b61850 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b4f780 0x55f524b4ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b4c450 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/4196126747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b405d0 0x55f524b4f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 >> 172.21.15.52:0/4196126747 conn(0x55f524b09310 msgr2=0x55f524b42960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbdfaff5640 0 client.15861 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 shutdown_connections 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/4196126747 wait complete. 2024-09-19T09:22:51.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.944+0000 7fbe1f8ad740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:22:51.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 Processor -- start 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 -- start start 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b3ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b41b40 0x55f524b5b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ade40 con 0x55f524b4f780 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ab710 con 0x55f524b41b40 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181a9560 con 0x55f524b405d0 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38108/0 (socket says 172.21.15.52:38108) 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe177fe640 1 -- 172.21.15.52:0/3325263592 learned_addr learned my addr 172.21.15.52:0/3325263592 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.957+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b41b40 0x55f524b5b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b3ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 -- 172.21.15.52:0/3325263592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 msgr2=0x55f524b3ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b3ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 -- 172.21.15.52:0/3325263592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b41b40 msgr2=0x55f524b5b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b41b40 0x55f524b5b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 -- 172.21.15.52:0/3325263592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f524b4f510 con 0x55f524b4f780 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbe10035000 tx=0x7fbe10043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785aaf8f320ef1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbdfcff9640 1 -- 172.21.15.52:0/3325263592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10055070 con 0x55f524b4f780 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbdfcff9640 1 -- 172.21.15.52:0/3325263592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe10004030 con 0x55f524b4f780 2024-09-19T09:22:51.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.958+0000 7fbdfcff9640 1 -- 172.21.15.52:0/3325263592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10034040 con 0x55f524b4f780 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3325263592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 msgr2=0x55f524b670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbe10035000 tx=0x7fbe10043000 comp rx=0 tx=0).stop 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3325263592 shutdown_connections 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b4f780 0x55f524b670f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b41b40 0x55f524b5b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3325263592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b3ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3325263592 >> 172.21.15.52:0/3325263592 conn(0x55f524b09310 msgr2=0x55f524b3c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3325263592 shutdown_connections 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3325263592 wait complete. 2024-09-19T09:22:51.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- start start 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 Processor -- start 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b53e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524bc3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181a9bd0 con 0x55f524b41b40 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181ab040 con 0x55f524b4f780 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe181aa2a0 con 0x55f524b405d0 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.959+0000 7fbe1f8ad740 10 client.0 _ll_register_callbacks cb 0x7fbe0c09b510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38118/0 (socket says 172.21.15.52:38118) 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 -- 172.21.15.52:0/3756613872 learned_addr learned my addr 172.21.15.52:0/3756613872 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b53e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe177fe640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524bc3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 -- 172.21.15.52:0/3756613872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 msgr2=0x55f524b53e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b53e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 -- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 msgr2=0x55f524bc3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524bc3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 -- 172.21.15.52:0/3756613872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f524bc3680 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe167fc640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c09b6d0 tx=0x7fbe0c09b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0df7702da87466 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbdfaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c080060 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe0c099a40 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.960+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe10004030 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe0c014070 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 10 client.15867 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f524bcaa00 con 0x55f524b41b40 2024-09-19T09:22:51.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe10004030 con 0x55f524b41b40 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe0c09a600 con 0x55f524b41b40 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 10 client.15867 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 20 client.15867 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524bcb120 0x55f524bcd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 4 client.15867 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f524aadd70 con 0x55f524bcb120 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.961+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524bcb120 0x55f524bcd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe16ffd640 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524bcb120 0x55f524bcd540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a892248b8305582 server_cookie=f48fc40ac2e4192d in_seq=0 out_seq=0 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbdfaff5640 10 client.15867 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbdfaff5640 1 -- 172.21.15.52:0/3756613872 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f524aadd70 con 0x55f524bcb120 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbdfaff5640 10 client.15867 handle_command_reply: tid=0 2024-09-19T09:22:51.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 client.15867 shutdown 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 msgr2=0x55f524b54370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c09b6d0 tx=0x7fbe0c09b0a0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 shutdown_connections 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f524bcb120 0x55f524bcd540 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f524b4f780 0x55f524bc3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f524b41b40 0x55f524b54370 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbdfaff5640 0 client.15867 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 --2- 172.21.15.52:0/3756613872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f524b405d0 0x55f524b53e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 >> 172.21.15.52:0/3756613872 conn(0x55f524b09310 msgr2=0x55f524b4dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 shutdown_connections 2024-09-19T09:22:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 1 -- 172.21.15.52:0/3756613872 wait complete. 2024-09-19T09:22:51.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.962+0000 7fbe1f8ad740 20 client.15867 trim_cache size 0 max 16384 2024-09-19T09:22:51.970 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 msgr2=0x7fbe000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 0x7fbe000a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe10005e30 tx=0x7fbe100095c0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 msgr2=0x7fbe181989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00d950 tx=0x7fbe0c00dd50 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 shutdown_connections 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1810c170 0x7fbe1819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe18103660 0x7fbe181989b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe000a32c0 0x7fbe000a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 --2- 172.21.15.52:0/3289244453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe18102d40 0x7fbe18198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 >> 172.21.15.52:0/3289244453 conn(0x7fbe180fc7a0 msgr2=0x7fbe180fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 shutdown_connections 2024-09-19T09:22:51.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:51.963+0000 7fbe1d4d4640 1 -- 172.21.15.52:0/3289244453 wait complete. 2024-09-19T09:22:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 -- 172.21.15.52:0/36534576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694101b60 msgr2=0x7fa694101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 --2- 172.21.15.52:0/36534576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694101b60 0x7fa694101f60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa684009900 tx=0x7fa68402a410 comp rx=0 tx=0).stop 2024-09-19T09:22:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 -- 172.21.15.52:0/36534576 shutdown_connections 2024-09-19T09:22:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 --2- 172.21.15.52:0/36534576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 0x7fa694109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 --2- 172.21.15.52:0/36534576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694102d50 0x7fa6941031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 --2- 172.21.15.52:0/36534576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694101b60 0x7fa694101f60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 -- 172.21.15.52:0/36534576 >> 172.21.15.52:0/36534576 conn(0x7fa6940fd2e0 msgr2=0x7fa6940ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 -- 172.21.15.52:0/36534576 shutdown_connections 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.769+0000 7fa698877640 1 -- 172.21.15.52:0/36534576 wait complete. 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 Processor -- start 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 -- start start 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694101b60 0x7fa694197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 0x7fa69419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d840 con 0x7fa694102d50 2024-09-19T09:22:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d6c0 con 0x7fa694103710 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa698877640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa69410d9c0 con 0x7fa694101b60 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38126/0 (socket says 172.21.15.52:38126) 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.770+0000 7fa691d9b640 1 -- 172.21.15.52:0/626447434 learned_addr learned my addr 172.21.15.52:0/626447434 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa69259c640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694101b60 0x7fa694197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa692d9d640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 0x7fa69419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 -- 172.21.15.52:0/626447434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694101b60 msgr2=0x7fa694197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694101b60 0x7fa694197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 -- 172.21.15.52:0/626447434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 msgr2=0x7fa69419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 0x7fa69419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 -- 172.21.15.52:0/626447434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69419fa90 con 0x7fa694102d50 2024-09-19T09:22:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa691d9b640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b4a0 tx=0x7fa68800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa6837fe640 1 -- 172.21.15.52:0/626447434 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688014070 con 0x7fa694102d50 2024-09-19T09:22:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa6837fe640 1 -- 172.21.15.52:0/626447434 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa688010af0 con 0x7fa694102d50 2024-09-19T09:22:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69419fd80 con 0x7fa694102d50 2024-09-19T09:22:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa6837fe640 1 -- 172.21.15.52:0/626447434 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688017d10 con 0x7fa694102d50 2024-09-19T09:22:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.771+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6941a0220 con 0x7fa694102d50 2024-09-19T09:22:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa6837fe640 1 -- 172.21.15.52:0/626447434 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa688017070 con 0x7fa694102d50 2024-09-19T09:22:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa69b609740 1 Processor -- start 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa69b609740 1 -- start start 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa69b609740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde59da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa69b609740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde5eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.774+0000 7fa69b609740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa69b609740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cabddbd2f0 con 0x55cabde5f370 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa69b609740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cabdd65270 con 0x55cabde5a2e0 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa69b609740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cabddb92b0 con 0x55cabde599a0 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38130/0 (socket says 172.21.15.52:38130) 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 -- 172.21.15.52:0/3048335307 learned_addr learned my addr 172.21.15.52:0/3048335307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa692d9d640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde59da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa6837fe640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 0x7fa67c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa69259c640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde5eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa692d9d640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 0x7fa67c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa6837fe640 1 -- 172.21.15.52:0/626447434 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa6880cedc0 con 0x7fa694102d50 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 -- 172.21.15.52:0/3048335307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 msgr2=0x55cabde59da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde59da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 -- 172.21.15.52:0/3048335307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 msgr2=0x55cabde5eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde5eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 -- 172.21.15.52:0/3048335307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cabdd64340 con 0x55cabde5f370 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa692d9d640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde59da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:52.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa69259c640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde5eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.775+0000 7fa691d9b640 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa68809f1f0 tx=0x7fa6880047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0190f801a2fac69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa692d9d640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 0x7fa67c0a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c005fd0 tx=0x7fa68c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa680ff9640 1 -- 172.21.15.52:0/3048335307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68801e070 con 0x55cabde5f370 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa680ff9640 1 -- 172.21.15.52:0/3048335307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa68809f6b0 con 0x55cabde5f370 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa680ff9640 1 -- 172.21.15.52:0/3048335307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688097970 con 0x55cabde5f370 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 -- 172.21.15.52:0/3048335307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 msgr2=0x55cabde61830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa68809f1f0 tx=0x7fa6880047d0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 -- 172.21.15.52:0/3048335307 shutdown_connections 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde61830 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde5eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 --2- 172.21.15.52:0/3048335307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde59da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 -- 172.21.15.52:0/3048335307 >> 172.21.15.52:0/3048335307 conn(0x55cabde55010 msgr2=0x55cabde55410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 -- 172.21.15.52:0/3048335307 shutdown_connections 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.776+0000 7fa69b609740 1 -- 172.21.15.52:0/3048335307 wait complete. 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 -- start start 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 Processor -- start 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde64130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5f370 0x55cabde6b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cabde62340 con 0x55cabde599a0 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cabdd46290 con 0x55cabde5a2e0 2024-09-19T09:22:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cabde624c0 con 0x55cabde5f370 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69b609740 10 client.0 _ll_register_callbacks cb 0x55cabdd77140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38132/0 (socket says 172.21.15.52:38132) 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 -- 172.21.15.52:0/2853179090 learned_addr learned my addr 172.21.15.52:0/2853179090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa691d9b640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde64130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 -- 172.21.15.52:0/2853179090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5f370 msgr2=0x55cabde6b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5f370 0x55cabde6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 -- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 msgr2=0x55cabde64130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde64130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.777+0000 7fa69259c640 1 -- 172.21.15.52:0/2853179090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cabdad0210 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69259c640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa684031610 tx=0x7fa6840316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3b55e6fc1fdd9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684035040 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa684004040 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cabddcaa20 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa68404a030 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 10 client.15879 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cabdb9c620 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55cabddcaa20 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa684004940 con 0x55cabde599a0 2024-09-19T09:22:52.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 10 client.15879 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.778+0000 7fa69b609740 20 client.15879 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabde6f810 0x55cabde71c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa69b609740 4 client.15879 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cabddc4d70 con 0x55cabde6f810 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa691d9b640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabde6f810 0x55cabde71c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa691d9b640 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabde6f810 0x55cabde71c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af09553e5f68a29 server_cookie=b62e8acefa7ed4e6 in_seq=0 out_seq=0 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.779+0000 7fa679ffb640 10 client.15879 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa679ffb640 1 -- 172.21.15.52:0/2853179090 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cabddc4d70 con 0x55cabde6f810 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa679ffb640 10 client.15879 handle_command_reply: tid=0 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 client.15879 shutdown 2024-09-19T09:22:52.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 msgr2=0x55cabde63bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa684031610 tx=0x7fa6840316b0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 shutdown_connections 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabde6f810 0x55cabde71c40 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5f370 0x55cabde6b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa679ffb640 0 client.15879 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5a2e0 0x55cabde64130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 --2- 172.21.15.52:0/2853179090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde599a0 0x55cabde63bf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 >> 172.21.15.52:0/2853179090 conn(0x55cabde55010 msgr2=0x55cabde56820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 shutdown_connections 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 1 -- 172.21.15.52:0/2853179090 wait complete. 2024-09-19T09:22:52.791 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.780+0000 7fa69b609740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T09:22:52.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.794+0000 7fa69b609740 1 Processor -- start 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.794+0000 7fa69b609740 1 -- start start 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde55f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5f370 0x55cabde56460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941abb40 con 0x55cabde5a2e0 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941a9410 con 0x55cabde5f370 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69b609740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941a7260 con 0x55cabde599a0 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38146/0 (socket says 172.21.15.52:38146) 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 -- 172.21.15.52:0/623509970 learned_addr learned my addr 172.21.15.52:0/623509970 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:52.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa69259c640 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde55f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 -- 172.21.15.52:0/623509970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 msgr2=0x55cabde55f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde55f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 -- 172.21.15.52:0/623509970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5f370 msgr2=0x55cabde56460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5f370 0x55cabde56460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 -- 172.21.15.52:0/623509970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cabde5bd10 con 0x55cabde5a2e0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa691d9b640 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b470 tx=0x7fa6880ce040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270d6690a55c42a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.795+0000 7fa67bfff640 1 -- 172.21.15.52:0/623509970 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880b4070 con 0x55cabde5a2e0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa67bfff640 1 -- 172.21.15.52:0/623509970 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6880b4210 con 0x55cabde5a2e0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa67bfff640 1 -- 172.21.15.52:0/623509970 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68801e040 con 0x55cabde5a2e0 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- 172.21.15.52:0/623509970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 msgr2=0x55cabde6b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b470 tx=0x7fa6880ce040 comp rx=0 tx=0).stop 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- 172.21.15.52:0/623509970 shutdown_connections 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde5f370 0x55cabde56460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5a2e0 0x55cabde6b0c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 --2- 172.21.15.52:0/623509970 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde599a0 0x55cabde55f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- 172.21.15.52:0/623509970 >> 172.21.15.52:0/623509970 conn(0x55cabde55010 msgr2=0x55cabde639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- 172.21.15.52:0/623509970 shutdown_connections 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- 172.21.15.52:0/623509970 wait complete. 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 -- start start 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.796+0000 7fa69b609740 1 Processor -- start 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 0x55cabde687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 0x55cabde68ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941a78d0 con 0x55cabde5f370 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941a8d40 con 0x55cabde599a0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6941a7fa0 con 0x55cabde5a2e0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 10 client.0 _ll_register_callbacks cb 0x7fa684009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38158/0 (socket says 172.21.15.52:38158) 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 -- 172.21.15.52:0/2910709858 learned_addr learned my addr 172.21.15.52:0/2910709858 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69259c640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 0x55cabde687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa691d9b640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 0x55cabde68ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 -- 172.21.15.52:0/2910709858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 msgr2=0x55cabde68ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 0x55cabde68ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 -- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 msgr2=0x55cabde687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 0x55cabde687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 -- 172.21.15.52:0/2910709858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cabde6a300 con 0x55cabde5f370 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69259c640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 0x55cabde687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa691d9b640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 0x55cabde68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa692d9d640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa68c013880 tx=0x7fa68c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba02ca83b272e226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c019040 con 0x55cabde5f370 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa68c013230 con 0x55cabde5f370 2024-09-19T09:22:52.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.797+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6880b4210 con 0x55cabde5f370 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa68c003ef0 con 0x55cabde5f370 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 10 client.15885 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cabdeda650 con 0x55cabde5f370 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6880b4210 con 0x55cabde5f370 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa68c01f040 con 0x55cabde5f370 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 10 client.15885 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 20 client.15885 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabdedb030 0x55cabdedd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 4 client.15885 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cabdd41900 con 0x55cabdedb030 2024-09-19T09:22:52.806 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.798+0000 7fa69259c640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabdedb030 0x55cabdedd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.799+0000 7fa679ffb640 10 client.15885 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:52.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.799+0000 7fa69259c640 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabdedb030 0x55cabdedd450 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eceb3dfa5cbadf11 server_cookie=9936c58350e9cb37 in_seq=0 out_seq=0 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa679ffb640 1 -- 172.21.15.52:0/2910709858 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cabdd41900 con 0x55cabdedb030 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa679ffb640 10 client.15885 handle_command_reply: tid=0 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 client.15885 shutdown 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 msgr2=0x55cabde69cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa68c013880 tx=0x7fa68c011e50 comp rx=0 tx=0).stop 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 shutdown_connections 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cabdedb030 0x55cabdedd450 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cabde5f370 0x55cabde69cf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cabde5a2e0 0x55cabde68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa679ffb640 0 client.15885 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 --2- 172.21.15.52:0/2910709858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cabde599a0 0x55cabde687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 >> 172.21.15.52:0/2910709858 conn(0x55cabde55010 msgr2=0x55cabde539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 shutdown_connections 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 1 -- 172.21.15.52:0/2910709858 wait complete. 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa69b609740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:22:52.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:22:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:22:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 msgr2=0x7fa67c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 0x7fa67c0a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa68c005fd0 tx=0x7fa68c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 msgr2=0x7fa6941983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.808+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa68800b4a0 tx=0x7fa68800b960 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 shutdown_connections 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa694103710 0x7fa69419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa694102d50 0x7fa6941983b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa67c0a32f0 0x7fa67c0a57b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 --2- 172.21.15.52:0/626447434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa694101b60 0x7fa694197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 >> 172.21.15.52:0/626447434 conn(0x7fa6940fd2e0 msgr2=0x7fa6941060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 shutdown_connections 2024-09-19T09:22:52.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:22:52.809+0000 7fa698877640 1 -- 172.21.15.52:0/626447434 wait complete. 2024-09-19T09:22:53.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:53 smithi052 ceph-mon[30947]: pgmap v381: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:53.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:53 smithi169 ceph-mon[35454]: pgmap v381: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:53.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:53 smithi086 ceph-mon[34813]: pgmap v381: 97 pgs: 97 active+clean; 744 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-09-19T09:22:53.613 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:22:53.613 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:22:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:54.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 -- 172.21.15.52:0/307151430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8102790 msgr2=0x7f35f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 --2- 172.21.15.52:0/307151430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8102790 0x7f35f81067e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009900 tx=0x7f35e802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 -- 172.21.15.52:0/307151430 shutdown_connections 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 --2- 172.21.15.52:0/307151430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8106f10 0x7f35f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 --2- 172.21.15.52:0/307151430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8102790 0x7f35f81067e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 --2- 172.21.15.52:0/307151430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 0x7f35f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 -- 172.21.15.52:0/307151430 >> 172.21.15.52:0/307151430 conn(0x7f35f80fd8c0 msgr2=0x7f35f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 -- 172.21.15.52:0/307151430 shutdown_connections 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.329+0000 7f35ff83b640 1 -- 172.21.15.52:0/307151430 wait complete. 2024-09-19T09:22:54.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 Processor -- start 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 -- start start 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 0x7f35f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8102790 0x7f35f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8112010 con 0x7f35f8106f10 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8111e90 con 0x7f35f8102790 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35ff83b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8112190 con 0x7f35f8101de0 2024-09-19T09:22:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38166/0 (socket says 172.21.15.52:38166) 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 -- 172.21.15.52:0/3541932159 learned_addr learned my addr 172.21.15.52:0/3541932159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8102790 0x7f35f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 0x7f35f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 -- 172.21.15.52:0/3541932159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 msgr2=0x7f35f80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 0x7f35f80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 -- 172.21.15.52:0/3541932159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8102790 msgr2=0x7f35f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8102790 0x7f35f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.330+0000 7f35fddd8640 1 -- 172.21.15.52:0/3541932159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f81a6a70 con 0x7f35f8106f10 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35fddd8640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b970 tx=0x7f35f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35ee7fc640 1 -- 172.21.15.52:0/3541932159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0019070 con 0x7f35f8106f10 2024-09-19T09:22:54.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35ee7fc640 1 -- 172.21.15.52:0/3541932159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f000cb40 con 0x7f35f8106f10 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f81a6d60 con 0x7f35f8106f10 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35ee7fc640 1 -- 172.21.15.52:0/3541932159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0007650 con 0x7f35f8106f10 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.331+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f81a7220 con 0x7f35f8106f10 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.333+0000 7f35ee7fc640 1 -- 172.21.15.52:0/3541932159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f35f001c070 con 0x7f35f8106f10 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 Processor -- start 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 -- start start 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 0x55687ef03f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef11130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55687ee69280 con 0x55687ef04480 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55687ee10b10 con 0x55687ef0ed40 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f3601c14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55687ee65240 con 0x55687ef03b60 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35ee7fc640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 0x7f35e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38170/0 (socket says 172.21.15.52:38170) 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 -- 172.21.15.52:0/197898476 learned_addr learned my addr 172.21.15.52:0/197898476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:54.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef11130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 0x55687ef03f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fddd8640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 0x7f35e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35ee7fc640 1 -- 172.21.15.52:0/3541932159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35f00cef30 con 0x7f35f8106f10 2024-09-19T09:22:54.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 -- 172.21.15.52:0/197898476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 msgr2=0x55687ef03f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 0x55687ef03f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 -- 172.21.15.52:0/197898476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 msgr2=0x55687ef11130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef11130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fd5d7640 1 -- 172.21.15.52:0/197898476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687ee1d1f0 con 0x55687ef04480 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.334+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 0x55687ef03f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.335+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35f400b820 tx=0x7f35f400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b357bcb3bd6fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.335+0000 7f35fddd8640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 0x7f35e40a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f35f009b510 tx=0x7f35f000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.335+0000 7f35e37fe640 1 -- 172.21.15.52:0/197898476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f400d950 con 0x55687ef04480 2024-09-19T09:22:54.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.335+0000 7f35e37fe640 1 -- 172.21.15.52:0/197898476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f4019070 con 0x55687ef04480 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.335+0000 7f35e37fe640 1 -- 172.21.15.52:0/197898476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40123e0 con 0x55687ef04480 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- 172.21.15.52:0/197898476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 msgr2=0x55687ef0e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f35f400b820 tx=0x7f35f400bce0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- 172.21.15.52:0/197898476 shutdown_connections 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef11130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef04480 0x55687ef0e800 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 --2- 172.21.15.52:0/197898476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef03b60 0x55687ef03f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- 172.21.15.52:0/197898476 >> 172.21.15.52:0/197898476 conn(0x55687ef000f0 msgr2=0x55687ef004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- 172.21.15.52:0/197898476 shutdown_connections 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- 172.21.15.52:0/197898476 wait complete. 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 -- start start 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.336+0000 7f3601c14740 1 Processor -- start 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef0bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef0c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55687ef11910 con 0x55687ef03b60 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55687ee23f10 con 0x55687ef0ed40 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55687ef11a90 con 0x55687ef04480 2024-09-19T09:22:54.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 10 client.0 _ll_register_callbacks cb 0x55687edeca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38182/0 (socket says 172.21.15.52:38182) 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 -- 172.21.15.52:0/4121962056 learned_addr learned my addr 172.21.15.52:0/4121962056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef0bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef0c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 -- 172.21.15.52:0/4121962056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 msgr2=0x55687ef0bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef0bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 -- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 msgr2=0x55687ef0c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef0c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 -- 172.21.15.52:0/4121962056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687ebda6a0 con 0x55687ef03b60 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009900 tx=0x7f35e802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5368a8a82a9014b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:54.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8035040 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35e8004480 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.337+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f4019070 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35e8053050 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 10 client.15897 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55687ef1d440 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f4019070 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f35e803d720 con 0x55687ef03b60 2024-09-19T09:22:54.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 10 client.15897 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 20 client.15897 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef1e7f0 0x55687ef20c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 4 client.15897 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55687ee767f0 con 0x55687ef1e7f0 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.338+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef1e7f0 0x55687ef20c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.339+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef1e7f0 0x55687ef20c00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae5868c3a363b23 server_cookie=336a12c7a4463c34 in_seq=0 out_seq=0 2024-09-19T09:22:54.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.339+0000 7f35e0ff9640 10 client.15897 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:54.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.339+0000 7f35e0ff9640 1 -- 172.21.15.52:0/4121962056 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55687ee767f0 con 0x55687ef1e7f0 2024-09-19T09:22:54.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.339+0000 7f35e0ff9640 10 client.15897 handle_command_reply: tid=0 2024-09-19T09:22:54.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.339+0000 7f3601c14740 1 client.15897 shutdown 2024-09-19T09:22:54.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 msgr2=0x55687ef0e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009900 tx=0x7f35e802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 shutdown_connections 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef1e7f0 0x55687ef20c00 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef0ed40 0x55687ef0c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef0bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f35e0ff9640 0 client.15897 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 --2- 172.21.15.52:0/4121962056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef03b60 0x55687ef0e800 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 >> 172.21.15.52:0/4121962056 conn(0x55687ef000f0 msgr2=0x55687eeff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 shutdown_connections 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 1 -- 172.21.15.52:0/4121962056 wait complete. 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.340+0000 7f3601c14740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 Processor -- start 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 -- start start 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef264d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81b2290 con 0x55687ef0ed40 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81afb60 con 0x55687ef03b60 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.357+0000 7f3601c14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ad9b0 con 0x55687ef04480 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38198/0 (socket says 172.21.15.52:38198) 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 -- 172.21.15.52:0/665497545 learned_addr learned my addr 172.21.15.52:0/665497545 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 -- 172.21.15.52:0/665497545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 msgr2=0x55687ef264d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef264d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 -- 172.21.15.52:0/665497545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 msgr2=0x55687ef065c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 -- 172.21.15.52:0/665497545 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55687eefff20 con 0x55687ef0ed40 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef264d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f35e8032ff0 tx=0x7f35e8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a3e52cd3a6b052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35e2ffd640 1 -- 172.21.15.52:0/665497545 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8035070 con 0x55687ef0ed40 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35e2ffd640 1 -- 172.21.15.52:0/665497545 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e8004480 con 0x55687ef0ed40 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.358+0000 7f35e2ffd640 1 -- 172.21.15.52:0/665497545 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8041040 con 0x55687ef0ed40 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- 172.21.15.52:0/665497545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 msgr2=0x55687ef26a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f35e8032ff0 tx=0x7f35e8005a20 comp rx=0 tx=0).stop 2024-09-19T09:22:54.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- 172.21.15.52:0/665497545 shutdown_connections 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef26a10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef264d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 --2- 172.21.15.52:0/665497545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- 172.21.15.52:0/665497545 >> 172.21.15.52:0/665497545 conn(0x55687ef000f0 msgr2=0x55687ef0dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- 172.21.15.52:0/665497545 shutdown_connections 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- 172.21.15.52:0/665497545 wait complete. 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 -- start start 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.359+0000 7f3601c14740 1 Processor -- start 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef13b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef14060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ae020 con 0x55687ef0ed40 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81af490 con 0x55687ef03b60 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ae6f0 con 0x55687ef04480 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f3601c14740 10 client.0 _ll_register_callbacks cb 0x7f35e8032ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38206/0 (socket says 172.21.15.52:38206) 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 -- 172.21.15.52:0/2906995803 learned_addr learned my addr 172.21.15.52:0/2906995803 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef13b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef14060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 -- 172.21.15.52:0/2906995803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 msgr2=0x55687ef14060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef14060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 -- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 msgr2=0x55687ef13b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef13b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 -- 172.21.15.52:0/2906995803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55687ef011d0 con 0x55687ef0ed40 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef14060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35fcdd6640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009850 tx=0x7f35e8031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fffd42a09862acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.360+0000 7f35e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8041070 con 0x55687ef0ed40 2024-09-19T09:22:54.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35e80053c0 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35e8004480 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35e8035070 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 10 client.15903 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55687ef8a640 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35e8004480 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f35e8004aa0 con 0x55687ef0ed40 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 10 client.15903 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:54.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 20 client.15903 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef8ac40 0x55687ef8d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 4 client.15903 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.361+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55687ee70d00 con 0x55687ef8ac40 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.362+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef8ac40 0x55687ef8d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.362+0000 7f35fd5d7640 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef8ac40 0x55687ef8d030 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=793ff6ffc7e42a9e server_cookie=ddb57718f269ac22 in_seq=0 out_seq=0 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.362+0000 7f35e0ff9640 10 client.15903 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f35e0ff9640 1 -- 172.21.15.52:0/2906995803 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55687ee70d00 con 0x55687ef8ac40 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f35e0ff9640 10 client.15903 handle_command_reply: tid=0 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 client.15903 shutdown 2024-09-19T09:22:54.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 msgr2=0x55687ef145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009850 tx=0x7f35e8031710 comp rx=0 tx=0).stop 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 shutdown_connections 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55687ef8ac40 0x55687ef8d030 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55687ef0ed40 0x55687ef145a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f35e0ff9640 0 client.15903 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55687ef04480 0x55687ef14060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 --2- 172.21.15.52:0/2906995803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55687ef03b60 0x55687ef13b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 >> 172.21.15.52:0/2906995803 conn(0x55687ef000f0 msgr2=0x55687ef19b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 shutdown_connections 2024-09-19T09:22:54.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 1 -- 172.21.15.52:0/2906995803 wait complete. 2024-09-19T09:22:54.932 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "8afb9b38-ee13-4117-830c-e3853fcad8f5", 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.363+0000 7f3601c14740 20 client.15903 trim_cache size 0 max 16384 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 msgr2=0x7f35e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 0x7f35e40a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f35f009b510 tx=0x7f35f000e040 comp rx=0 tx=0).stop 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 msgr2=0x7f35f8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b970 tx=0x7f35f000be30 comp rx=0 tx=0).stop 2024-09-19T09:22:54.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 shutdown_connections 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35f8106f10 0x7f35f8074f70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35f8102790 0x7f35f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35e40a3240 0x7f35e40a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 --2- 172.21.15.52:0/3541932159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35f8101de0 0x7f35f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 >> 172.21.15.52:0/3541932159 conn(0x7f35f80fd8c0 msgr2=0x7f35f80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 shutdown_connections 2024-09-19T09:22:54.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:54.364+0000 7f35ff83b640 1 -- 172.21.15.52:0/3541932159 wait complete. 2024-09-19T09:22:55.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:55 smithi052 ceph-mon[30947]: pgmap v382: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2024-09-19T09:22:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:55 smithi169 ceph-mon[35454]: pgmap v382: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2024-09-19T09:22:55.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:55 smithi086 ceph-mon[34813]: pgmap v382: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.4 KiB/s wr, 11 op/s 2024-09-19T09:22:56.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:56 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:22:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:56 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:56 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:22:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:56 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:56 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:22:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:56 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:56 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:22:56.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:56 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:56 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:22:56.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:56 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:56 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:22:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:56 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:22:57.377 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:57 smithi052 ceph-mon[30947]: pgmap v383: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-19T09:22:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:57 smithi169 ceph-mon[35454]: pgmap v383: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-19T09:22:57.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:57 smithi086 ceph-mon[34813]: pgmap v383: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s 2024-09-19T09:22:57.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:22:57.997 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.491+0000 7faf18b1c640 1 -- 172.21.15.52:0/4197252870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf14102d30 msgr2=0x7faf14103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.491+0000 7faf18b1c640 1 --2- 172.21.15.52:0/4197252870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf14102d30 0x7faf14103110 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7faf04009930 tx=0x7faf0402a440 comp rx=0 tx=0).stop 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 -- 172.21.15.52:0/4197252870 shutdown_connections 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 --2- 172.21.15.52:0/4197252870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141082a0 0x7faf1410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 --2- 172.21.15.52:0/4197252870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf141036e0 0x7faf14107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 --2- 172.21.15.52:0/4197252870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf14102d30 0x7faf14103110 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 -- 172.21.15.52:0/4197252870 >> 172.21.15.52:0/4197252870 conn(0x7faf140fc7d0 msgr2=0x7faf140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 -- 172.21.15.52:0/4197252870 shutdown_connections 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.492+0000 7faf18b1c640 1 -- 172.21.15.52:0/4197252870 wait complete. 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 Processor -- start 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 -- start start 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf14102d30 0x7faf14198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141036e0 0x7faf14198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf141120e0 con 0x7faf141082a0 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf14111f60 con 0x7faf141036e0 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf18b1c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112260 con 0x7faf14102d30 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44926/0 (socket says 172.21.15.52:44926) 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 -- 172.21.15.52:0/2320770028 learned_addr learned my addr 172.21.15.52:0/2320770028 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:58.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141036e0 0x7faf14198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf1259c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf14102d30 0x7faf14198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 -- 172.21.15.52:0/2320770028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf14102d30 msgr2=0x7faf14198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf14102d30 0x7faf14198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 -- 172.21.15.52:0/2320770028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141036e0 msgr2=0x7faf14198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.493+0000 7faf12d9d640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141036e0 0x7faf14198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf12d9d640 1 -- 172.21.15.52:0/2320770028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1419d5d0 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf12d9d640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00cad0 tx=0x7faf0c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf037fe640 1 -- 172.21.15.52:0/2320770028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00ad60 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1419d8c0 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf037fe640 1 -- 172.21.15.52:0/2320770028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf0c005020 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf037fe640 1 -- 172.21.15.52:0/2320770028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00f6b0 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.494+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a51a0 con 0x7faf141082a0 2024-09-19T09:22:58.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.497+0000 7faf1aef5740 1 Processor -- start 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.497+0000 7faf037fe640 1 -- 172.21.15.52:0/2320770028 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faf0c005560 con 0x7faf141082a0 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.497+0000 7faf1aef5740 1 -- start start 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d99592dc0 0x561d9959d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d9959d680 0x561d9959fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561d994f82e0 con 0x561d995924a0 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561d9949fce0 con 0x561d9959d680 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1aef5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d994f42a0 con 0x561d99592dc0 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44938/0 (socket says 172.21.15.52:44938) 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 -- 172.21.15.52:0/3394543784 learned_addr learned my addr 172.21.15.52:0/3394543784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf1259c640 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d99592dc0 0x561d9959d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf037fe640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 0x7faefc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d9959d680 0x561d9959fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 -- 172.21.15.52:0/3394543784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d99592dc0 msgr2=0x561d9959d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d99592dc0 0x561d9959d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 -- 172.21.15.52:0/3394543784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d9959d680 msgr2=0x561d9959fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d9959d680 0x561d9959fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf11d9b640 1 -- 172.21.15.52:0/3394543784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d99484440 con 0x561d995924a0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf12d9d640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 0x7faefc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.498+0000 7faf037fe640 1 -- 172.21.15.52:0/2320770028 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf0c0cf980 con 0x7faf141082a0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.499+0000 7faf11d9b640 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faf08009330 tx=0x7faf08009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cdfa69f4b061b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.499+0000 7faf00ff9640 1 -- 172.21.15.52:0/3394543784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08017610 con 0x561d995924a0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.499+0000 7faf00ff9640 1 -- 172.21.15.52:0/3394543784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf0801c070 con 0x561d995924a0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.499+0000 7faf00ff9640 1 -- 172.21.15.52:0/3394543784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08015910 con 0x561d995924a0 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- 172.21.15.52:0/3394543784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 msgr2=0x561d99592880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf12d9d640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 0x7faefc0a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf0c098380 tx=0x7faf0c091400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faf08009330 tx=0x7faf08009570 comp rx=0 tx=0).stop 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- 172.21.15.52:0/3394543784 shutdown_connections 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d9959d680 0x561d9959fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d99592dc0 0x561d9959d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 --2- 172.21.15.52:0/3394543784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995924a0 0x561d99592880 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- 172.21.15.52:0/3394543784 >> 172.21.15.52:0/3394543784 conn(0x561d9958ea30 msgr2=0x561d9958ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- 172.21.15.52:0/3394543784 shutdown_connections 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- 172.21.15.52:0/3394543784 wait complete. 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.500+0000 7faf1aef5740 1 -- start start 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 Processor -- start 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d9959cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d9959a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561d995a0250 con 0x561d99592dc0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561d994b3050 con 0x561d995924a0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561d995a03d0 con 0x561d9959d680 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1aef5740 10 client.0 _ll_register_callbacks cb 0x561d994f3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44946/0 (socket says 172.21.15.52:44946) 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 -- 172.21.15.52:0/2845909807 learned_addr learned my addr 172.21.15.52:0/2845909807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d9959a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d9959cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 -- 172.21.15.52:0/2845909807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 msgr2=0x561d9959a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d9959a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 -- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 msgr2=0x561d9959cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d9959cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf1259c640 1 -- 172.21.15.52:0/2845909807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d992693c0 con 0x561d99592dc0 2024-09-19T09:22:58.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.501+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d9959cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faf1259c640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf04031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fd354afb78225a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04035040 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf04004300 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf0801c070 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf0404b030 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faf1aef5740 10 client.15915 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561d995abc20 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf0801c070 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.502+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf04046720 con 0x561d99592dc0 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 10 client.15915 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 20 client.15915 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:58.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d995ad0e0 0x561d995af500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 4 client.15915 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d99505850 con 0x561d995ad0e0 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d995ad0e0 0x561d995af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faef9ffb640 10 client.15915 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.503+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d995ad0e0 0x561d995af500 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a633f817a2fc74f7 server_cookie=a8d25e9473380ec9 in_seq=0 out_seq=0 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faef9ffb640 1 -- 172.21.15.52:0/2845909807 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d99505850 con 0x561d995ad0e0 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faef9ffb640 10 client.15915 handle_command_reply: tid=0 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 client.15915 shutdown 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 msgr2=0x561d9959a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faf04000c00 tx=0x7faf04031a60 comp rx=0 tx=0).stop 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 shutdown_connections 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d995ad0e0 0x561d995af500 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d9959a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d99592dc0 0x561d9959a2a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2845909807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d9959cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 >> 172.21.15.52:0/2845909807 conn(0x561d9958ea30 msgr2=0x561d99594710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faef9ffb640 0 client.15915 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.504+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 shutdown_connections 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.505+0000 7faf1aef5740 1 -- 172.21.15.52:0/2845909807 wait complete. 2024-09-19T09:22:58.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.505+0000 7faf1aef5740 20 client.15915 trim_cache size 0 max 16384 2024-09-19T09:22:58.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 Processor -- start 2024-09-19T09:22:58.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 -- start start 2024-09-19T09:22:58.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d995924a0 0x561d995a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995b5310 0x561d99597500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf141b0010 con 0x561d9959d680 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ad8e0 con 0x561d995b5310 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1aef5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ab730 con 0x561d995924a0 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44962/0 (socket says 172.21.15.52:44962) 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 -- 172.21.15.52:0/788132032 learned_addr learned my addr 172.21.15.52:0/788132032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf11d9b640 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d995924a0 0x561d995a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf11d9b640 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995b5310 0x561d99597500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 -- 172.21.15.52:0/788132032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d995924a0 msgr2=0x561d995a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d995924a0 0x561d995a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 -- 172.21.15.52:0/788132032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995b5310 msgr2=0x561d99597500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995b5310 0x561d99597500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.522+0000 7faf1259c640 1 -- 172.21.15.52:0/788132032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9959ab70 con 0x561d9959d680 2024-09-19T09:22:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.523+0000 7faf1259c640 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faf04046b70 tx=0x7faf04005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f6a285a4779f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.523+0000 7faefbfff640 1 -- 172.21.15.52:0/788132032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04035030 con 0x561d9959d680 2024-09-19T09:22:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.523+0000 7faefbfff640 1 -- 172.21.15.52:0/788132032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf040315b0 con 0x561d9959d680 2024-09-19T09:22:58.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.523+0000 7faefbfff640 1 -- 172.21.15.52:0/788132032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04005020 con 0x561d9959d680 2024-09-19T09:22:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- 172.21.15.52:0/788132032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 msgr2=0x561d995b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7faf04046b70 tx=0x7faf04005fd0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- 172.21.15.52:0/788132032 shutdown_connections 2024-09-19T09:22:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995b5310 0x561d99597500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d9959d680 0x561d995b4dd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- 172.21.15.52:0/788132032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d995924a0 0x561d995a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- 172.21.15.52:0/788132032 >> 172.21.15.52:0/788132032 conn(0x561d9958ea30 msgr2=0x561d99595900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- 172.21.15.52:0/788132032 shutdown_connections 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- 172.21.15.52:0/788132032 wait complete. 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- start start 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 Processor -- start 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d995a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d995a1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf141abda0 con 0x561d995b5310 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ad210 con 0x561d995924a0 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.524+0000 7faf1aef5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf141ac470 con 0x561d9959d680 2024-09-19T09:22:58.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf1aef5740 10 client.0 _ll_register_callbacks cb 0x7faf04009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44972/0 (socket says 172.21.15.52:44972) 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 -- 172.21.15.52:0/2515000444 learned_addr learned my addr 172.21.15.52:0/2515000444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf1259c640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d995a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d995a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 -- 172.21.15.52:0/2515000444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 msgr2=0x561d995a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d995a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 -- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 msgr2=0x561d995a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d995a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 -- 172.21.15.52:0/2515000444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d9959a240 con 0x561d995b5310 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf11d9b640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faf080155c0 tx=0x7faf08023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba282a675d52048f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faef9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0802b040 con 0x561d995b5310 2024-09-19T09:22:58.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf08015a40 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.525+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf040315b0 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf08042050 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 10 client.15921 fetch_fsmap learned FSMap version 24 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561d99617c80 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf040315b0 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf08021400 con 0x561d995b5310 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 10 client.15921 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 20 client.15921 populate_metadata read hostname 'smithi052' 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d99618010 0x561d9961a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 4 client.15921 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561d994ffd60 con 0x561d99618010 2024-09-19T09:22:58.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.526+0000 7faf1259c640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d99618010 0x561d9961a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faef9ffb640 10 client.15921 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1259c640 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d99618010 0x561d9961a400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f6ab76510b410d9 server_cookie=742cf39495db01 in_seq=0 out_seq=0 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faef9ffb640 1 -- 172.21.15.52:0/2515000444 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561d994ffd60 con 0x561d99618010 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faef9ffb640 10 client.15921 handle_command_reply: tid=0 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 client.15921 shutdown 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 msgr2=0x561d995a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7faf080155c0 tx=0x7faf08023040 comp rx=0 tx=0).stop 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 shutdown_connections 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561d99618010 0x561d9961a400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561d995b5310 0x561d995a1710 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561d9959d680 0x561d995a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faef9ffb640 0 client.15921 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 --2- 172.21.15.52:0/2515000444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561d995924a0 0x561d995a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 >> 172.21.15.52:0/2515000444 conn(0x561d9958ea30 msgr2=0x561d9958d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 shutdown_connections 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.527+0000 7faf1aef5740 1 -- 172.21.15.52:0/2515000444 wait complete. 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf1aef5740 20 client.15921 trim_cache size 0 max 16384 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:22:58.534 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 msgr2=0x7faefc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 0x7faefc0a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faf0c098380 tx=0x7faf0c091400 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 msgr2=0x7faf1419cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00cad0 tx=0x7faf0c00ced0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 shutdown_connections 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf141082a0 0x7faf1419cef0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf141036e0 0x7faf14198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faefc0a3240 0x7faefc0a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 --2- 172.21.15.52:0/2320770028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf14102d30 0x7faf14198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 >> 172.21.15.52:0/2320770028 conn(0x7faf140fc7d0 msgr2=0x7faf14105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 shutdown_connections 2024-09-19T09:22:58.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:58.528+0000 7faf18b1c640 1 -- 172.21.15.52:0/2320770028 wait complete. 2024-09-19T09:22:59.247 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:22:59.248 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:59 smithi052 ceph-mon[30947]: pgmap v384: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:22:59.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:22:59 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:22:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:59 smithi169 ceph-mon[35454]: pgmap v384: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:22:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:22:59 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:22:59.506 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:59 smithi086 ceph-mon[34813]: pgmap v384: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:22:59.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:22:59 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:22:59.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- 172.21.15.52:0/493215620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102570 msgr2=0x7f15d41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 --2- 172.21.15.52:0/493215620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102570 0x7f15d41029b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009900 tx=0x7f15c402a480 comp rx=0 tx=0).stop 2024-09-19T09:22:59.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- 172.21.15.52:0/493215620 shutdown_connections 2024-09-19T09:22:59.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 --2- 172.21.15.52:0/493215620 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4102ef0 0x7f15d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 --2- 172.21.15.52:0/493215620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102570 0x7f15d41029b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 --2- 172.21.15.52:0/493215620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4100e20 0x7f15d4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- 172.21.15.52:0/493215620 >> 172.21.15.52:0/493215620 conn(0x7f15d40fc7d0 msgr2=0x7f15d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- 172.21.15.52:0/493215620 shutdown_connections 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- 172.21.15.52:0/493215620 wait complete. 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 Processor -- start 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.963+0000 7f15dabb5640 1 -- start start 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4100e20 0x7f15d4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 0x7f15d4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110f80 con 0x7f15d4102ef0 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4110e00 con 0x7f15d4102570 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15dabb5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4111100 con 0x7f15d4100e20 2024-09-19T09:22:59.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44986/0 (socket says 172.21.15.52:44986) 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 -- 172.21.15.52:0/1896761849 learned_addr learned my addr 172.21.15.52:0/1896761849 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d8951640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4100e20 0x7f15d4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15cbfff640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 0x7f15d4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 -- 172.21.15.52:0/1896761849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4100e20 msgr2=0x7f15d4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4100e20 0x7f15d4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 -- 172.21.15.52:0/1896761849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 msgr2=0x7f15d4199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 0x7f15d4199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 -- 172.21.15.52:0/1896761849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41a4910 con 0x7f15d4102ef0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15cbfff640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 0x7f15d4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15d9152640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cad0 tx=0x7f15cc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.964+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00ae20 con 0x7f15d4102ef0 2024-09-19T09:22:59.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.965+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15cc005020 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.965+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41a4ae0 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.965+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00f6f0 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.965+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a5020 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.966+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d4101200 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.967+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f15cc0051d0 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.968+0000 7f15c9ffb640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 0x7f15bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.968+0000 7f15d8951640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 0x7f15bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.968+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f15cc0cfbf0 con 0x7f15d4102ef0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.968+0000 7f15d8951640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 0x7f15bc0a5780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15d000bbe0 tx=0x7f15d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:59.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:22:59.972+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15cc014030 con 0x7f15d4102ef0 2024-09-19T09:23:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.186+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d406a560 con 0x7f15d4102ef0 2024-09-19T09:23:00.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.187+0000 7f15c9ffb640 1 -- 172.21.15.52:0/1896761849 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f15d406a560 con 0x7f15d4102ef0 2024-09-19T09:23:00.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:23:00.188 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:23:00.188 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 msgr2=0x7f15bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 0x7f15bc0a5780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15d000bbe0 tx=0x7f15d000b390 comp rx=0 tx=0).stop 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 msgr2=0x7f15d41a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00cad0 tx=0x7f15cc00cf90 comp rx=0 tx=0).stop 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 shutdown_connections 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15d4102ef0 0x7f15d41a43d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15d4102570 0x7f15d4199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f15bc0a32c0 0x7f15bc0a5780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 --2- 172.21.15.52:0/1896761849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f15d4100e20 0x7f15d4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.189+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 >> 172.21.15.52:0/1896761849 conn(0x7f15d40fc7d0 msgr2=0x7f15d4106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.190+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 shutdown_connections 2024-09-19T09:23:00.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:00.190+0000 7f15dabb5640 1 -- 172.21.15.52:0/1896761849 wait complete. 2024-09-19T09:23:00.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:23:01.071 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:01.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:01 smithi052 ceph-mon[30947]: pgmap v385: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:23:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1896761849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:01 smithi169 ceph-mon[35454]: pgmap v385: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:23:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1896761849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:01 smithi086 ceph-mon[34813]: pgmap v385: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-09-19T09:23:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1896761849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 -- 172.21.15.52:0/383386361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff010109120 msgr2=0x7ff010110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 --2- 172.21.15.52:0/383386361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff010109120 0x7ff010110ca0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff008009ca0 tx=0x7ff00802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 -- 172.21.15.52:0/383386361 shutdown_connections 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 --2- 172.21.15.52:0/383386361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff010109120 0x7ff010110ca0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 --2- 172.21.15.52:0/383386361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0101049a0 0x7ff0101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 --2- 172.21.15.52:0/383386361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010103ff0 0x7ff0101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 -- 172.21.15.52:0/383386361 >> 172.21.15.52:0/383386361 conn(0x7ff0100ffa90 msgr2=0x7ff010101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 -- 172.21.15.52:0/383386361 shutdown_connections 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 -- 172.21.15.52:0/383386361 wait complete. 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.514+0000 7ff0180c6640 1 Processor -- start 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 -- start start 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 0x7ff01019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010109120 0x7ff01019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff010114150 con 0x7ff0101049a0 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff010113fd0 con 0x7ff010103ff0 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff0180c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101142d0 con 0x7ff010109120 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45002/0 (socket says 172.21.15.52:45002) 2024-09-19T09:23:01.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 -- 172.21.15.52:0/2256059805 learned_addr learned my addr 172.21.15.52:0/2256059805 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015e62640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 0x7ff01019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff016663640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010109120 0x7ff01019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 -- 172.21.15.52:0/2256059805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010109120 msgr2=0x7ff01019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010109120 0x7ff01019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 -- 172.21.15.52:0/2256059805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 msgr2=0x7ff01019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 0x7ff01019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 -- 172.21.15.52:0/2256059805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01019f540 con 0x7ff0101049a0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015e62640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 0x7ff01019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.515+0000 7ff015661640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c920 tx=0x7ff00000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.516+0000 7ff006ffd640 1 -- 172.21.15.52:0/2256059805 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000007c70 con 0x7ff0101049a0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.516+0000 7ff006ffd640 1 -- 172.21.15.52:0/2256059805 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff000007e10 con 0x7ff0101049a0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.516+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01019f830 con 0x7ff0101049a0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.516+0000 7ff006ffd640 1 -- 172.21.15.52:0/2256059805 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000018890 con 0x7ff0101049a0 2024-09-19T09:23:01.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.516+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0101a7110 con 0x7ff0101049a0 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.518+0000 7ff006ffd640 1 -- 172.21.15.52:0/2256059805 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff000018ad0 con 0x7ff0101049a0 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.518+0000 7ff01a49f740 1 Processor -- start 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 -- start start 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e891a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e89e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e1e7f72f0 con 0x560e1e892b40 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e1e79ecf0 con 0x560e1e8915d0 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff01a49f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e1e7f32b0 con 0x560e1e89c370 2024-09-19T09:23:01.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45016/0 (socket says 172.21.15.52:45016) 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 -- 172.21.15.52:0/4147406355 learned_addr learned my addr 172.21.15.52:0/4147406355 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff006ffd640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 0x7feffc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 0x7feffc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff015e62640 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e891a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff006ffd640 1 -- 172.21.15.52:0/2256059805 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff0000cfab0 con 0x7ff0101049a0 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff015661640 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e89e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 -- 172.21.15.52:0/4147406355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 msgr2=0x560e1e89e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e89e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 -- 172.21.15.52:0/4147406355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 msgr2=0x560e1e891a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e891a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.519+0000 7ff016663640 1 -- 172.21.15.52:0/4147406355 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1e7833a0 con 0x560e1e892b40 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7ff016663640 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff008009430 tx=0x7ff0080039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84c576eb6d291db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7feffbfff640 1 -- 172.21.15.52:0/4147406355 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008004040 con 0x560e1e892b40 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7feffbfff640 1 -- 172.21.15.52:0/4147406355 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff00804d070 con 0x560e1e892b40 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7feffbfff640 1 -- 172.21.15.52:0/4147406355 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00802f900 con 0x560e1e892b40 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7ff01a49f740 1 -- 172.21.15.52:0/4147406355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 msgr2=0x560e1e891090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7ff01a49f740 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff008009430 tx=0x7ff0080039f0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.520+0000 7ff016663640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 0x7feffc0a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff00804c000 tx=0x7ff00804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 -- 172.21.15.52:0/4147406355 shutdown_connections 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e89e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e891a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 --2- 172.21.15.52:0/4147406355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e891090 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 -- 172.21.15.52:0/4147406355 >> 172.21.15.52:0/4147406355 conn(0x560e1e85a310 msgr2=0x560e1e88dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 -- 172.21.15.52:0/4147406355 shutdown_connections 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 -- 172.21.15.52:0/4147406355 wait complete. 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 -- start start 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.521+0000 7ff01a49f740 1 Processor -- start 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 0x560e1e898ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e8995e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e1e89f070 con 0x560e1e8915d0 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e1e7b2060 con 0x560e1e892b40 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e1e89f1f0 con 0x560e1e89c370 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 10 client.0 _ll_register_callbacks cb 0x560e1e5058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45020/0 (socket says 172.21.15.52:45020) 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 -- 172.21.15.52:0/1738223794 learned_addr learned my addr 172.21.15.52:0/1738223794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff016663640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e8995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015661640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 0x560e1e898ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 -- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 msgr2=0x560e1e8995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e8995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 -- 172.21.15.52:0/1738223794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 msgr2=0x560e1e898ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 0x560e1e898ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 -- 172.21.15.52:0/1738223794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1e5683c0 con 0x560e1e8915d0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015661640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 0x560e1e898ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff015e62640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011850 tx=0x7ff00c011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806e09d06ed69567 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7feff97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00fe70 con 0x560e1e8915d0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff00804d070 con 0x560e1e8915d0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.522+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff00c004020 con 0x560e1e8915d0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff00c004220 con 0x560e1e8915d0 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 10 client.15939 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:01.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e1e8aab00 con 0x560e1e8915d0 2024-09-19T09:23:01.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff00804d070 con 0x560e1e8915d0 2024-09-19T09:23:01.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff00c018030 con 0x560e1e8915d0 2024-09-19T09:23:01.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 10 client.15939 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:01.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 10 client.15939 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:01.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 20 client.15939 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:01.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e8abf10 0x560e1e8ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 4 client.15939 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e1e804860 con 0x560e1e8abf10 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.523+0000 7ff015661640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e8abf10 0x560e1e8ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.524+0000 7ff015661640 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e8abf10 0x560e1e8ae370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=108b88c6af536f80 server_cookie=d427af95a255abd2 in_seq=0 out_seq=0 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.524+0000 7feff97fa640 10 client.15939 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.524+0000 7feff97fa640 1 -- 172.21.15.52:0/1738223794 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e1e804860 con 0x560e1e8abf10 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7feff97fa640 10 client.15939 handle_command_reply: tid=0 2024-09-19T09:23:01.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 client.15939 shutdown 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 msgr2=0x560e1e89bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff00c011850 tx=0x7ff00c011d10 comp rx=0 tx=0).stop 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 shutdown_connections 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e8abf10 0x560e1e8ae370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e8995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e892b40 0x560e1e898ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7feff97fa640 0 client.15939 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1738223794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e8915d0 0x560e1e89bd40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 >> 172.21.15.52:0/1738223794 conn(0x560e1e85a310 msgr2=0x560e1e893960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 shutdown_connections 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 1 -- 172.21.15.52:0/1738223794 wait complete. 2024-09-19T09:23:01.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.525+0000 7ff01a49f740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 Processor -- start 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 -- start start 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e8915d0 0x560e1e8978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e89c370 0x560e1e894660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101b21a0 con 0x560e1e892b40 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101afa70 con 0x560e1e89c370 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff01a49f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101ad8c0 con 0x560e1e8915d0 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45026/0 (socket says 172.21.15.52:45026) 2024-09-19T09:23:01.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 -- 172.21.15.52:0/1242025583 learned_addr learned my addr 172.21.15.52:0/1242025583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff016663640 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e89c370 0x560e1e894660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 -- 172.21.15.52:0/1242025583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e8915d0 msgr2=0x560e1e8978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e8915d0 0x560e1e8978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 -- 172.21.15.52:0/1242025583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e89c370 msgr2=0x560e1e894660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e89c370 0x560e1e894660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.538+0000 7ff015661640 1 -- 172.21.15.52:0/1242025583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e1e897fa0 con 0x560e1e892b40 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff015661640 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff0000984b0 tx=0x7ff0000cd400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17f0f3e938acaf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7feffb7fe640 1 -- 172.21.15.52:0/1242025583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000018dc0 con 0x560e1e892b40 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7feffb7fe640 1 -- 172.21.15.52:0/1242025583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0000bc0b0 con 0x560e1e892b40 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7feffb7fe640 1 -- 172.21.15.52:0/1242025583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000098700 con 0x560e1e892b40 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 -- 172.21.15.52:0/1242025583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 msgr2=0x560e1e894120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff0000984b0 tx=0x7ff0000cd400 comp rx=0 tx=0).stop 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 -- 172.21.15.52:0/1242025583 shutdown_connections 2024-09-19T09:23:01.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e89c370 0x560e1e894660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e894120 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1242025583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e8915d0 0x560e1e8978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.539+0000 7ff01a49f740 1 -- 172.21.15.52:0/1242025583 >> 172.21.15.52:0/1242025583 conn(0x560e1e85a310 msgr2=0x560e1e89b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- 172.21.15.52:0/1242025583 shutdown_connections 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- 172.21.15.52:0/1242025583 wait complete. 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- start start 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 Processor -- start 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e8a0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e915c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101adf30 con 0x560e1e892b40 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101af3a0 con 0x560e1e8915d0 2024-09-19T09:23:01.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0101ae600 con 0x560e1e89c370 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff01a49f740 10 client.0 _ll_register_callbacks cb 0x7ff00c00c830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.540+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45030/0 (socket says 172.21.15.52:45030) 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 -- 172.21.15.52:0/1255449896 learned_addr learned my addr 172.21.15.52:0/1255449896 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff016663640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e915c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015e62640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e8a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 -- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 msgr2=0x560e1e915c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e915c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 -- 172.21.15.52:0/1255449896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 msgr2=0x560e1e8a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e8a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 -- 172.21.15.52:0/1255449896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e1e8a1320 con 0x560e1e892b40 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015e62640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e8a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:01.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff015661640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff0000cd8a0 tx=0x7ff0000a4e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f634405fe80f8a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7feff97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0000a00b0 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff000098700 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0000bc0b0 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff00009c2b0 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff01a49f740 10 client.15945 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.541+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e1e917280 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0000bc0b0 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff000084070 con 0x560e1e892b40 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 10 client.15945 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 10 client.15945 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 20 client.15945 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:01.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e917920 0x560e1e919d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 4 client.15945 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e1e7fed70 con 0x560e1e917920 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.542+0000 7ff015e62640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e917920 0x560e1e919d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff015e62640 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e917920 0x560e1e919d40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=431bc064197a1457 server_cookie=175f5ae50d13ced2 in_seq=0 out_seq=0 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7feff97fa640 10 client.15945 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7feff97fa640 1 -- 172.21.15.52:0/1255449896 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e1e7fed70 con 0x560e1e917920 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7feff97fa640 10 client.15945 handle_command_reply: tid=0 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 client.15945 shutdown 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 msgr2=0x560e1e8a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff0000cd8a0 tx=0x7ff0000a4e40 comp rx=0 tx=0).stop 2024-09-19T09:23:01.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 shutdown_connections 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e1e917920 0x560e1e919d40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e1e89c370 0x560e1e915c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7feff97fa640 0 client.15945 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e1e892b40 0x560e1e8a0a70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 --2- 172.21.15.52:0/1255449896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e1e8915d0 0x560e1e8a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 >> 172.21.15.52:0/1255449896 conn(0x560e1e85a310 msgr2=0x560e1e88c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 shutdown_connections 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 1 -- 172.21.15.52:0/1255449896 wait complete. 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.543+0000 7ff01a49f740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T09:23:01.549 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 msgr2=0x7feffc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 0x7feffc0a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff00804c000 tx=0x7ff00804a000 comp rx=0 tx=0).stop 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 msgr2=0x7ff01019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c920 tx=0x7ff00000cde0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 shutdown_connections 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feffc0a32c0 0x7feffc0a5780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff010109120 0x7ff01019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0101049a0 0x7ff01019aad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 --2- 172.21.15.52:0/2256059805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff010103ff0 0x7ff01019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 >> 172.21.15.52:0/2256059805 conn(0x7ff0100ffa90 msgr2=0x7ff010100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 shutdown_connections 2024-09-19T09:23:01.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:01.544+0000 7ff0180c6640 1 -- 172.21.15.52:0/2256059805 wait complete. 2024-09-19T09:23:02.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:23:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:02.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 -- 172.21.15.52:0/2994417021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454106f10 msgr2=0x7f045410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 --2- 172.21.15.52:0/2994417021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454106f10 0x7f045410ea90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f044c009ca0 tx=0x7f044c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 -- 172.21.15.52:0/2994417021 shutdown_connections 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 --2- 172.21.15.52:0/2994417021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454106f10 0x7f045410ea90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 --2- 172.21.15.52:0/2994417021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454102790 0x7f04541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 --2- 172.21.15.52:0/2994417021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f04541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 -- 172.21.15.52:0/2994417021 >> 172.21.15.52:0/2994417021 conn(0x7f04540fd8c0 msgr2=0x7f04540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 -- 172.21.15.52:0/2994417021 shutdown_connections 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 -- 172.21.15.52:0/2994417021 wait complete. 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.914+0000 7f045a102640 1 Processor -- start 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 -- start start 2024-09-19T09:23:02.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f0454198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454106f10 0x7f045419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0454111f90 con 0x7f0454102790 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0454111e10 con 0x7f0454106f10 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f045a102640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0454112110 con 0x7f0454101de0 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45054/0 (socket says 172.21.15.52:45054) 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 -- 172.21.15.52:0/1299048822 learned_addr learned my addr 172.21.15.52:0/1299048822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f0453fff640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454106f10 0x7f045419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f04537fe640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f0454198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 -- 172.21.15.52:0/1299048822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 msgr2=0x7f0454198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f0454198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 -- 172.21.15.52:0/1299048822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454106f10 msgr2=0x7f045419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454106f10 0x7f045419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.915+0000 7f044affd640 1 -- 172.21.15.52:0/1299048822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045419d420 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f04537fe640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f0454198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f044affd640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f043c00d950 tx=0x7f043c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f04517fa640 1 -- 172.21.15.52:0/1299048822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c017070 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f04517fa640 1 -- 172.21.15.52:0/1299048822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c009c30 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f04517fa640 1 -- 172.21.15.52:0/1299048822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00f6b0 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045419d710 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.916+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541a4ff0 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.918+0000 7f04517fa640 1 -- 172.21.15.52:0/1299048822 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f043c0109d0 con 0x7f0454102790 2024-09-19T09:23:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 Processor -- start 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 -- start start 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d85d0 0x55e6002d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 0x55e6002e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e60023e2f0 con 0x55e6002d9b40 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6001e5cf0 con 0x55e6002e3370 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f045c4db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e60023a2b0 con 0x55e6002d85d0 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45060/0 (socket says 172.21.15.52:45060) 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f0453fff640 1 -- 172.21.15.52:0/2381967182 learned_addr learned my addr 172.21.15.52:0/2381967182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f04537fe640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d85d0 0x55e6002d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.919+0000 7f044affd640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 0x55e6002e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 -- 172.21.15.52:0/2381967182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d85d0 msgr2=0x55e6002d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d85d0 0x55e6002d8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 -- 172.21.15.52:0/2381967182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 msgr2=0x55e6002e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 0x55e6002e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 -- 172.21.15.52:0/2381967182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6001ca3a0 con 0x55e6002d9b40 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f04517fa640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 0x7f04400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f044affd640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 0x55e6002e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f04537fe640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 0x7f04400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f04517fa640 1 -- 172.21.15.52:0/1299048822 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f043c0cf680 con 0x7f0454102790 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0453fff640 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f044c035000 tx=0x7f044c02f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49793f04488a20c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0449ffb640 1 -- 172.21.15.52:0/2381967182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c003970 con 0x55e6002d9b40 2024-09-19T09:23:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0449ffb640 1 -- 172.21.15.52:0/2381967182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c036040 con 0x55e6002d9b40 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.920+0000 7f0449ffb640 1 -- 172.21.15.52:0/2381967182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0043c0 con 0x55e6002d9b40 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- 172.21.15.52:0/2381967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 msgr2=0x55e6002d8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f04537fe640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 0x7f04400a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e6002d5ac0 tx=0x7f0444008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f044c035000 tx=0x7f044c02f500 comp rx=0 tx=0).stop 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- 172.21.15.52:0/2381967182 shutdown_connections 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002e3370 0x55e6002e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d85d0 0x55e6002d8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 --2- 172.21.15.52:0/2381967182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002d8090 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- 172.21.15.52:0/2381967182 >> 172.21.15.52:0/2381967182 conn(0x55e6002a1310 msgr2=0x55e6002d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- 172.21.15.52:0/2381967182 shutdown_connections 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- 172.21.15.52:0/2381967182 wait complete. 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.921+0000 7f045c4db740 1 -- start start 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 Processor -- start 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002e3370 0x55e6002e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e6002e5e90 con 0x55e6002d9b40 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6001f9060 con 0x55e6002d85d0 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e6002e6010 con 0x55e6002e3370 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f045c4db740 10 client.0 _ll_register_callbacks cb 0x55e5fff4c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45064/0 (socket says 172.21.15.52:45064) 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 -- 172.21.15.52:0/3701978555 learned_addr learned my addr 172.21.15.52:0/3701978555 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f0453fff640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002e3370 0x55e6002e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f04537fe640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 -- 172.21.15.52:0/3701978555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002e3370 msgr2=0x55e6002e05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002e3370 0x55e6002e05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 -- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 msgr2=0x55e6002e2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.922+0000 7f044affd640 1 -- 172.21.15.52:0/3701978555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fffaf3c0 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f044affd640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f043c09bb50 tx=0x7f043c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b4f91889c7e69a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c020070 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f043c0d1b40 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044c036040 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f043c09bbc0 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 10 client.15957 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6002f18d0 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c036040 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f043c086240 con 0x55e6002d9b40 2024-09-19T09:23:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 10 client.15957 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 10 client.15957 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 20 client.15957 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e6002f2de0 0x55e6002f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 4 client.15957 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.923+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e60024b860 con 0x55e6002f2de0 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.924+0000 7f04537fe640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e6002f2de0 0x55e6002f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.924+0000 7f0432ffd640 10 client.15957 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.924+0000 7f04537fe640 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e6002f2de0 0x55e6002f51d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ceeb68b746a59048 server_cookie=106db6c0643ba7a6 in_seq=0 out_seq=0 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f0432ffd640 1 -- 172.21.15.52:0/3701978555 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e60024b860 con 0x55e6002f2de0 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f0432ffd640 10 client.15957 handle_command_reply: tid=0 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 client.15957 shutdown 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 msgr2=0x55e6002e0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f043c09bb50 tx=0x7f043c005f90 comp rx=0 tx=0).stop 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 shutdown_connections 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002e3370 0x55e6002e05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002d9b40 0x55e6002e0000 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e6002f2de0 0x55e6002f51d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 --2- 172.21.15.52:0/3701978555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 >> 172.21.15.52:0/3701978555 conn(0x55e6002a1310 msgr2=0x55e6002da960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f0432ffd640 0 client.15957 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 shutdown_connections 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 1 -- 172.21.15.52:0/3701978555 wait complete. 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.925+0000 7f045c4db740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.938+0000 7f045c4db740 1 Processor -- start 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.938+0000 7f045c4db740 1 -- start start 2024-09-19T09:23:02.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f04541afff0 con 0x55e6002e3370 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04541ad8c0 con 0x55e6002d85d0 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f045c4db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f04541ab710 con 0x55e6002d9b40 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45076/0 (socket says 172.21.15.52:45076) 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 -- 172.21.15.52:0/3217402945 learned_addr learned my addr 172.21.15.52:0/3217402945 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f04537fe640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 -- 172.21.15.52:0/3217402945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 msgr2=0x55e6002faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f044affd640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002faaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 -- 172.21.15.52:0/3217402945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 msgr2=0x55e6002ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f0453fff640 1 -- 172.21.15.52:0/3217402945 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6002db120 con 0x55e6002e3370 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.939+0000 7f04537fe640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.940+0000 7f0453fff640 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f044c004af0 tx=0x7f044c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e996a0ff9b492f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.940+0000 7f04497fa640 1 -- 172.21.15.52:0/3217402945 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c054070 con 0x55e6002e3370 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.940+0000 7f04497fa640 1 -- 172.21.15.52:0/3217402945 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c036040 con 0x55e6002e3370 2024-09-19T09:23:02.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.940+0000 7f04497fa640 1 -- 172.21.15.52:0/3217402945 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c0042a0 con 0x55e6002e3370 2024-09-19T09:23:02.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- 172.21.15.52:0/3217402945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 msgr2=0x55e6002fafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f044c004af0 tx=0x7f044c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- 172.21.15.52:0/3217402945 shutdown_connections 2024-09-19T09:23:02.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002fafe0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 --2- 172.21.15.52:0/3217402945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- 172.21.15.52:0/3217402945 >> 172.21.15.52:0/3217402945 conn(0x55e6002a1310 msgr2=0x55e6002de8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- 172.21.15.52:0/3217402945 shutdown_connections 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- 172.21.15.52:0/3217402945 wait complete. 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 -- start start 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.941+0000 7f045c4db740 1 Processor -- start 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002e77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f04541abd80 con 0x55e6002e3370 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04541ad1f0 con 0x55e6002d85d0 2024-09-19T09:23:02.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f04541ac450 con 0x55e6002d9b40 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45080/0 (socket says 172.21.15.52:45080) 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f045c4db740 10 client.0 _ll_register_callbacks cb 0x7f043c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f044affd640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002e77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 -- 172.21.15.52:0/2416244729 learned_addr learned my addr 172.21.15.52:0/2416244729 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f04537fe640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 -- 172.21.15.52:0/2416244729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 msgr2=0x55e6002e77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002e77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 -- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 msgr2=0x55e6002e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.942+0000 7f0453fff640 1 -- 172.21.15.52:0/2416244729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6003610d0 con 0x55e6002e3370 2024-09-19T09:23:02.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0453fff640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f044c009940 tx=0x7f044c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe06f1207e04af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c054030 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044c036040 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f044c003b80 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f044c003d80 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 10 client.15963 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6003622e0 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044c036040 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f044c04e070 con 0x55e6002e3370 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 10 client.15963 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 10 client.15963 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:02.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 20 client.15963 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e600362660 0x55e600364a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 4 client.15963 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.943+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e600245d70 con 0x55e600362660 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f04537fe640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e600362660 0x55e600364a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f0432ffd640 10 client.15963 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f04537fe640 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e600362660 0x55e600364a50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ded3ebdbdaf736a6 server_cookie=f42a71accc742f99 in_seq=0 out_seq=0 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f0432ffd640 1 -- 172.21.15.52:0/2416244729 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e600245d70 con 0x55e600362660 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f0432ffd640 10 client.15963 handle_command_reply: tid=0 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.944+0000 7f045c4db740 1 client.15963 shutdown 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 msgr2=0x55e6002e7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f044c009940 tx=0x7f044c031700 comp rx=0 tx=0).stop 2024-09-19T09:23:02.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 shutdown_connections 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6002e3370 0x55e6002e7d00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6002d9b40 0x55e6002e77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e600362660 0x55e600364a50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 --2- 172.21.15.52:0/2416244729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6002d85d0 0x55e6002e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 >> 172.21.15.52:0/2416244729 conn(0x55e6002a1310 msgr2=0x55e6002d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f0432ffd640 0 client.15963 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 shutdown_connections 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 1 -- 172.21.15.52:0/2416244729 wait complete. 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.945+0000 7f045c4db740 20 client.15963 trim_cache size 0 max 16384 2024-09-19T09:23:02.961 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:02.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 msgr2=0x7f04400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 0x7f04400a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55e6002d5ac0 tx=0x7f0444008040 comp rx=0 tx=0).stop 2024-09-19T09:23:02.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 msgr2=0x7f04541989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f043c00d950 tx=0x7f043c00de10 comp rx=0 tx=0).stop 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 shutdown_connections 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0454106f10 0x7f045419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0454102790 0x7f04541989b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f04400a3240 0x7f04400a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 --2- 172.21.15.52:0/1299048822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0454101de0 0x7f0454198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 >> 172.21.15.52:0/1299048822 conn(0x7f04540fd8c0 msgr2=0x7f04540fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 shutdown_connections 2024-09-19T09:23:02.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:02.946+0000 7f045a102640 1 -- 172.21.15.52:0/1299048822 wait complete. 2024-09-19T09:23:03.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:03 smithi052 ceph-mon[30947]: pgmap v386: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T09:23:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:03 smithi169 ceph-mon[35454]: pgmap v386: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T09:23:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:03 smithi086 ceph-mon[34813]: pgmap v386: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-19T09:23:03.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:23:03.797 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:04.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:04.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 -- 172.21.15.52:0/3257012268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff380103660 msgr2=0x7ff38010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 --2- 172.21.15.52:0/3257012268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff380103660 0x7ff38010bb50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff374009900 tx=0x7ff37402a480 comp rx=0 tx=0).stop 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 -- 172.21.15.52:0/3257012268 shutdown_connections 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 --2- 172.21.15.52:0/3257012268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff38010c170 0x7ff38010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 --2- 172.21.15.52:0/3257012268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff380103660 0x7ff38010bb50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 --2- 172.21.15.52:0/3257012268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 0x7ff380103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 -- 172.21.15.52:0/3257012268 >> 172.21.15.52:0/3257012268 conn(0x7ff3800fc7a0 msgr2=0x7ff3800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 -- 172.21.15.52:0/3257012268 shutdown_connections 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.340+0000 7ff386690640 1 -- 172.21.15.52:0/3257012268 wait complete. 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 Processor -- start 2024-09-19T09:23:04.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 -- start start 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 0x7ff3801984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff380103660 0x7ff3801989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff380111fb0 con 0x7ff38010c170 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff380111e30 con 0x7ff380102d40 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff386690640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff380112130 con 0x7ff380103660 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.341+0000 7ff384c2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45112/0 (socket says 172.21.15.52:45112) 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 -- 172.21.15.52:0/3911074696 learned_addr learned my addr 172.21.15.52:0/3911074696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff380103660 0x7ff3801989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff37ffff640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 0x7ff3801984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 -- 172.21.15.52:0/3911074696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff380103660 msgr2=0x7ff3801989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff380103660 0x7ff3801989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 -- 172.21.15.52:0/3911074696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 msgr2=0x7ff3801984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 0x7ff3801984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 -- 172.21.15.52:0/3911074696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38019d450 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff384c2d640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff37800b970 tx=0x7ff37800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff37d7fa640 1 -- 172.21.15.52:0/3911074696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378019070 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38019d740 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff37d7fa640 1 -- 172.21.15.52:0/3911074696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff37800cb40 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff37d7fa640 1 -- 172.21.15.52:0/3911074696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378007650 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.342+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3801a5020 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.344+0000 7ff37d7fa640 1 -- 172.21.15.52:0/3911074696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff37801c070 con 0x7ff38010c170 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 Processor -- start 2024-09-19T09:23:04.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 -- start start 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b45744c2f0 con 0x55b4574f1370 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b4573f3cf0 con 0x55b4574e7b40 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff388a69740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b4574482b0 con 0x55b4574e65d0 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45122/0 (socket says 172.21.15.52:45122) 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff37f7fe640 1 -- 172.21.15.52:0/102560799 learned_addr learned my addr 172.21.15.52:0/102560799 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.345+0000 7ff37d7fa640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 0x7ff3680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37ffff640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff384c2d640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 0x7ff3680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 -- 172.21.15.52:0/102560799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 msgr2=0x55b4574e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 -- 172.21.15.52:0/102560799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 msgr2=0x55b4574e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 -- 172.21.15.52:0/102560799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4573d83a0 con 0x55b4574f1370 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37d7fa640 1 -- 172.21.15.52:0/3911074696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff3780ceff0 con 0x7ff38010c170 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37ffff640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff374005ec0 tx=0x7ff3740314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3725afa439ff5b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff3667fc640 1 -- 172.21.15.52:0/102560799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374044030 con 0x55b4574f1370 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff3667fc640 1 -- 172.21.15.52:0/102560799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff374031810 con 0x55b4574f1370 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.346+0000 7ff3667fc640 1 -- 172.21.15.52:0/102560799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374035070 con 0x55b4574f1370 2024-09-19T09:23:04.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- 172.21.15.52:0/102560799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 msgr2=0x55b4574f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff384c2d640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 0x7ff3680a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff378097a40 tx=0x7ff37800f300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff374005ec0 tx=0x7ff3740314d0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- 172.21.15.52:0/102560799 shutdown_connections 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574f3760 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 --2- 172.21.15.52:0/102560799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- 172.21.15.52:0/102560799 >> 172.21.15.52:0/102560799 conn(0x55b4574af310 msgr2=0x55b4574e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- 172.21.15.52:0/102560799 shutdown_connections 2024-09-19T09:23:04.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- 172.21.15.52:0/102560799 wait complete. 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 -- start start 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.347+0000 7ff388a69740 1 Processor -- start 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b4574f4010 con 0x55b4574e7b40 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b457407060 con 0x55b4574e65d0 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b4574f4190 con 0x55b4574f1370 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff388a69740 10 client.0 _ll_register_callbacks cb 0x55b45715a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45138/0 (socket says 172.21.15.52:45138) 2024-09-19T09:23:04.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 -- 172.21.15.52:0/1707138761 learned_addr learned my addr 172.21.15.52:0/1707138761 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 -- 172.21.15.52:0/1707138761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 msgr2=0x55b4574ee7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 -- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 msgr2=0x55b4574f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 -- 172.21.15.52:0/1707138761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4571bd3c0 con 0x55b4574e7b40 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff37ffff640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff370012780 tx=0x7ff37000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a806f4ca23d53c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.348+0000 7ff35f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370010dc0 con 0x55b4574e7b40 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff370005020 con 0x55b4574e7b40 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff374031810 con 0x55b4574e7b40 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff370005260 con 0x55b4574e7b40 2024-09-19T09:23:04.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 10 client.15975 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b4574ffb60 con 0x55b4574e7b40 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff374031810 con 0x55b4574e7b40 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff37001a530 con 0x55b4574e7b40 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 10 client.15975 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 20 client.15975 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b457503480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 4 client.15975 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.349+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b457459860 con 0x55b457501020 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.350+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b457503480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.350+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b457503480 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e993716e77ae172b server_cookie=5371d33d5e00e478 in_seq=0 out_seq=0 2024-09-19T09:23:04.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.350+0000 7ff35f7fe640 10 client.15975 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff35f7fe640 1 -- 172.21.15.52:0/1707138761 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b457459860 con 0x55b457501020 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff35f7fe640 10 client.15975 handle_command_reply: tid=0 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 client.15975 shutdown 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 msgr2=0x55b4574ee060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff370012780 tx=0x7ff37000af90 comp rx=0 tx=0).stop 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 shutdown_connections 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b457503480 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574ee7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff35f7fe640 0 client.15975 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574ee060 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 --2- 172.21.15.52:0/1707138761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 >> 172.21.15.52:0/1707138761 conn(0x55b4574af310 msgr2=0x55b4574e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 shutdown_connections 2024-09-19T09:23:04.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 1 -- 172.21.15.52:0/1707138761 wait complete. 2024-09-19T09:23:04.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.351+0000 7ff388a69740 20 client.15975 trim_cache size 0 max 16384 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 Processor -- start 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 -- start start 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574ed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574effd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801b00f0 con 0x55b4574f1370 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801ad9c0 con 0x55b4574e7b40 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff388a69740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801ab810 con 0x55b4574e65d0 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45148/0 (socket says 172.21.15.52:45148) 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 -- 172.21.15.52:0/2154791310 learned_addr learned my addr 172.21.15.52:0/2154791310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:04.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37ffff640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 -- 172.21.15.52:0/2154791310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 msgr2=0x55b4574ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 -- 172.21.15.52:0/2154791310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 msgr2=0x55b4574effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37f7fe640 1 -- 172.21.15.52:0/2154791310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4574e3960 con 0x55b4574f1370 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.364+0000 7ff37ffff640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.365+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff37402a9a0 tx=0x7ff374005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aa2d96588588e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.365+0000 7ff365ffb640 1 -- 172.21.15.52:0/2154791310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374035040 con 0x55b4574f1370 2024-09-19T09:23:04.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.365+0000 7ff365ffb640 1 -- 172.21.15.52:0/2154791310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff374005400 con 0x55b4574f1370 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.365+0000 7ff365ffb640 1 -- 172.21.15.52:0/2154791310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3740035f0 con 0x55b4574f1370 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- 172.21.15.52:0/2154791310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 msgr2=0x55b4574e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff37402a9a0 tx=0x7ff374005390 comp rx=0 tx=0).stop 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- 172.21.15.52:0/2154791310 shutdown_connections 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574f1370 0x55b4574e9120 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e7b40 0x55b4574effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 --2- 172.21.15.52:0/2154791310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574e65d0 0x55b4574ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- 172.21.15.52:0/2154791310 >> 172.21.15.52:0/2154791310 conn(0x55b4574af310 msgr2=0x55b4574ef8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- 172.21.15.52:0/2154791310 shutdown_connections 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- 172.21.15.52:0/2154791310 wait complete. 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.366+0000 7ff388a69740 1 -- start start 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 Processor -- start 2024-09-19T09:23:04.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574f5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801abe80 con 0x55b4574e7b40 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801ad2f0 con 0x55b4574e65d0 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3801ac550 con 0x55b4574f1370 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff388a69740 10 client.0 _ll_register_callbacks cb 0x7ff37000a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45164/0 (socket says 172.21.15.52:45164) 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 -- 172.21.15.52:0/3367274794 learned_addr learned my addr 172.21.15.52:0/3367274794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 -- 172.21.15.52:0/3367274794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 msgr2=0x55b4574f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 -- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 msgr2=0x55b4574f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37ffff640 1 -- 172.21.15.52:0/3367274794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4574f5c50 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.367+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff37ffff640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff37001a970 tx=0x7ff3700056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdd943d5aec1761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370032070 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff37001a430 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff374005400 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff37001a650 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 10 client.15981 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b45756bd10 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff374005400 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff370035030 con 0x55b4574e7b40 2024-09-19T09:23:04.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 10 client.15981 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 20 client.15981 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.368+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b45756e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff388a69740 4 client.15981 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b457453d70 con 0x55b457501020 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b45756e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff35f7fe640 10 client.15981 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff37f7fe640 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b45756e390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b31d1bd1abb594c server_cookie=c6dc56a7bc0c1f63 in_seq=0 out_seq=0 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff35f7fe640 1 -- 172.21.15.52:0/3367274794 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b457453d70 con 0x55b457501020 2024-09-19T09:23:04.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.369+0000 7ff35f7fe640 10 client.15981 handle_command_reply: tid=0 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 client.15981 shutdown 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 msgr2=0x55b4574f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff37001a970 tx=0x7ff3700056b0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 shutdown_connections 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b457501020 0x55b45756e390 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b4574f1370 0x55b4574f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b4574e7b40 0x55b4574f4ee0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 --2- 172.21.15.52:0/3367274794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b4574e65d0 0x55b4574f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 >> 172.21.15.52:0/3367274794 conn(0x55b4574af310 msgr2=0x55b4574e1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff35f7fe640 0 client.15981 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 shutdown_connections 2024-09-19T09:23:04.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 1 -- 172.21.15.52:0/3367274794 wait complete. 2024-09-19T09:23:04.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.370+0000 7ff388a69740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T09:23:04.381 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:04.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 msgr2=0x7ff3680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 0x7ff3680a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff378097a40 tx=0x7ff37800f300 comp rx=0 tx=0).stop 2024-09-19T09:23:04.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 msgr2=0x7ff38019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff37800b970 tx=0x7ff37800be30 comp rx=0 tx=0).stop 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 shutdown_connections 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff38010c170 0x7ff38019cd70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3680a3240 0x7ff3680a5700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff380103660 0x7ff3801989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 --2- 172.21.15.52:0/3911074696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff380102d40 0x7ff3801984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 >> 172.21.15.52:0/3911074696 conn(0x7ff3800fc7a0 msgr2=0x7ff3800fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 shutdown_connections 2024-09-19T09:23:04.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:04.371+0000 7ff386690640 1 -- 172.21.15.52:0/3911074696 wait complete. 2024-09-19T09:23:05.095 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:05.335 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:05 smithi052 ceph-mon[30947]: pgmap v387: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:23:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:05 smithi169 ceph-mon[35454]: pgmap v387: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:23:05.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:05 smithi086 ceph-mon[34813]: pgmap v387: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T09:23:05.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 -- 172.21.15.52:0/1785681708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 msgr2=0x7ff99c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 --2- 172.21.15.52:0/1785681708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c10bb50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff990009900 tx=0x7ff99002a480 comp rx=0 tx=0).stop 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 -- 172.21.15.52:0/1785681708 shutdown_connections 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 --2- 172.21.15.52:0/1785681708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c10c170 0x7ff99c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 --2- 172.21.15.52:0/1785681708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c10bb50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 --2- 172.21.15.52:0/1785681708 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c102d40 0x7ff99c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.529+0000 7ff9a219b640 1 -- 172.21.15.52:0/1785681708 >> 172.21.15.52:0/1785681708 conn(0x7ff99c0fc7a0 msgr2=0x7ff99c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.530+0000 7ff9a219b640 1 -- 172.21.15.52:0/1785681708 shutdown_connections 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.530+0000 7ff9a219b640 1 -- 172.21.15.52:0/1785681708 wait complete. 2024-09-19T09:23:05.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.530+0000 7ff9a219b640 1 Processor -- start 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.530+0000 7ff9a219b640 1 -- start start 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 0x7ff99c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c10c170 0x7ff99c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c111f70 con 0x7ff99c103660 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c111df0 con 0x7ff99c102d40 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff9a219b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1120f0 con 0x7ff99c10c170 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45176/0 (socket says 172.21.15.52:45176) 2024-09-19T09:23:05.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 -- 172.21.15.52:0/2242619923 learned_addr learned my addr 172.21.15.52:0/2242619923 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99bfff640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c10c170 0x7ff99c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99b7fe640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 0x7ff99c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 -- 172.21.15.52:0/2242619923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c10c170 msgr2=0x7ff99c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c10c170 0x7ff99c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 -- 172.21.15.52:0/2242619923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 msgr2=0x7ff99c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 0x7ff99c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 -- 172.21.15.52:0/2242619923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c19d440 con 0x7ff99c103660 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99b7fe640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 0x7ff99c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.531+0000 7ff99affd640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff990006010 tx=0x7ff9900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.532+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99003f030 con 0x7ff99c103660 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.532+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff990003ce0 con 0x7ff99c103660 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.532+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c19d6d0 con 0x7ff99c103660 2024-09-19T09:23:05.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.532+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990035070 con 0x7ff99c103660 2024-09-19T09:23:05.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.532+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c1a5010 con 0x7ff99c103660 2024-09-19T09:23:05.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.533+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c103120 con 0x7ff99c103660 2024-09-19T09:23:05.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.534+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff990042030 con 0x7ff99c103660 2024-09-19T09:23:05.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.535+0000 7ff998ff9640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.535+0000 7ff99b7fe640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.535+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff9900f02e0 con 0x7ff99c103660 2024-09-19T09:23:05.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.535+0000 7ff99b7fe640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 0x7ff9840a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0058c0 tx=0x7ff98c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.538+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9900bcfe0 con 0x7ff99c103660 2024-09-19T09:23:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.752+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff99c1997f0 con 0x7ff99c103660 2024-09-19T09:23:05.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.753+0000 7ff998ff9640 1 -- 172.21.15.52:0/2242619923 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ff99c1997f0 con 0x7ff99c103660 2024-09-19T09:23:05.754 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:23:05.754 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:23:05.754 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:23:05.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 msgr2=0x7ff9840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 0x7ff9840a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0058c0 tx=0x7ff98c005850 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 msgr2=0x7ff99c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff990006010 tx=0x7ff9900042f0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 shutdown_connections 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff99c10c170 0x7ff99c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff99c103660 0x7ff99c1989d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 --2- 172.21.15.52:0/2242619923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff99c102d40 0x7ff99c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 >> 172.21.15.52:0/2242619923 conn(0x7ff99c0fc7a0 msgr2=0x7ff99c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 shutdown_connections 2024-09-19T09:23:05.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:05.755+0000 7ff9a219b640 1 -- 172.21.15.52:0/2242619923 wait complete. 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 -- 172.21.15.52:0/3889755307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c102610 msgr2=0x7ff15c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 --2- 172.21.15.52:0/3889755307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c102610 0x7ff15c108ea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff154009ca0 tx=0x7ff15402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 -- 172.21.15.52:0/3889755307 shutdown_connections 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 --2- 172.21.15.52:0/3889755307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c102610 0x7ff15c108ea0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 --2- 172.21.15.52:0/3889755307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c101c50 0x7ff15c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 --2- 172.21.15.52:0/3889755307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 0x7ff15c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 -- 172.21.15.52:0/3889755307 >> 172.21.15.52:0/3889755307 conn(0x7ff15c0fc1e0 msgr2=0x7ff15c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 -- 172.21.15.52:0/3889755307 shutdown_connections 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.899+0000 7ff161f76640 1 -- 172.21.15.52:0/3889755307 wait complete. 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 Processor -- start 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 -- start start 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 0x7ff15c1049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c102610 0x7ff15c103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c6e0 con 0x7ff15c101c50 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c560 con 0x7ff15c100a60 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff161f76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c10c860 con 0x7ff15c102610 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff153fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.900+0000 7ff153fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45194/0 (socket says 172.21.15.52:45194) 2024-09-19T09:23:05.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 -- 172.21.15.52:0/1490175073 learned_addr learned my addr 172.21.15.52:0/1490175073 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c102610 0x7ff15c103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 0x7ff15c1049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 -- 172.21.15.52:0/1490175073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c102610 msgr2=0x7ff15c103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c102610 0x7ff15c103570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 -- 172.21.15.52:0/1490175073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 msgr2=0x7ff15c1049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 0x7ff15c1049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 -- 172.21.15.52:0/1490175073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15c103e00 con 0x7ff15c101c50 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff153fff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d770 tx=0x7ff14400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff1597fa640 1 -- 172.21.15.52:0/1490175073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144017070 con 0x7ff15c101c50 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff1597fa640 1 -- 172.21.15.52:0/1490175073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff144005500 con 0x7ff15c101c50 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c1a1ef0 con 0x7ff15c101c50 2024-09-19T09:23:05.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff1597fa640 1 -- 172.21.15.52:0/1490175073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144004e00 con 0x7ff15c101c50 2024-09-19T09:23:05.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.901+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c1a2350 con 0x7ff15c101c50 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff1597fa640 1 -- 172.21.15.52:0/1490175073 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff144004fa0 con 0x7ff15c101c50 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 Processor -- start 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 -- start start 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62d9a0 0x56445b62dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b633370 0x56445b635830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56445b5912f0 con 0x56445b62e2e0 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56445b539270 con 0x56445b62d9a0 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff164ded740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56445b58d2b0 con 0x56445b633370 2024-09-19T09:23:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45202/0 (socket says 172.21.15.52:45202) 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff15b7fe640 1 -- 172.21.15.52:0/1996582840 learned_addr learned my addr 172.21.15.52:0/1996582840 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62d9a0 0x56445b62dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.904+0000 7ff153fff640 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b633370 0x56445b635830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff1597fa640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 0x7ff1480a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 -- 172.21.15.52:0/1996582840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b633370 msgr2=0x56445b635830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b633370 0x56445b635830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 -- 172.21.15.52:0/1996582840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62d9a0 msgr2=0x56445b62dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62d9a0 0x56445b62dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 -- 172.21.15.52:0/1996582840 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445b538340 con 0x56445b62e2e0 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 0x7ff1480a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff1597fa640 1 -- 172.21.15.52:0/1490175073 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff1440cf230 con 0x7ff15c101c50 2024-09-19T09:23:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00bcb0 tx=0x7ff14c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d4a149cc02f480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff151ffb640 1 -- 172.21.15.52:0/1996582840 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004020 con 0x56445b62e2e0 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff151ffb640 1 -- 172.21.15.52:0/1996582840 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c005500 con 0x56445b62e2e0 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.905+0000 7ff151ffb640 1 -- 172.21.15.52:0/1996582840 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004d80 con 0x56445b62e2e0 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- 172.21.15.52:0/1996582840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 msgr2=0x56445b632da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 0x7ff1480a5830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff154005e30 tx=0x7ff1540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00bcb0 tx=0x7ff14c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- 172.21.15.52:0/1996582840 shutdown_connections 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b633370 0x56445b635830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62e2e0 0x56445b632da0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 --2- 172.21.15.52:0/1996582840 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62d9a0 0x56445b62dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- 172.21.15.52:0/1996582840 >> 172.21.15.52:0/1996582840 conn(0x56445b629010 msgr2=0x56445b629410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- 172.21.15.52:0/1996582840 shutdown_connections 2024-09-19T09:23:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- 172.21.15.52:0/1996582840 wait complete. 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 -- start start 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.906+0000 7ff164ded740 1 Processor -- start 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b6380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b63f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56445b636340 con 0x56445b62d9a0 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56445b51a290 con 0x56445b633370 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56445b6364c0 con 0x56445b62e2e0 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 10 client.0 _ll_register_callbacks cb 0x56445b54b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45210/0 (socket says 172.21.15.52:45210) 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3856055862 learned_addr learned my addr 172.21.15.52:0/3856055862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff153fff640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b6380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15bfff640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b63f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3856055862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 msgr2=0x56445b6380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b6380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 msgr2=0x56445b63f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b63f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3856055862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445b2a4210 con 0x56445b62d9a0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00bfd0 tx=0x7ff14c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943b86b3cf256fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff13affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c02a060 con 0x56445b62d9a0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff14c004310 con 0x56445b62d9a0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.907+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14c005500 con 0x56445b62d9a0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff14c0035f0 con 0x56445b62d9a0 2024-09-19T09:23:05.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 10 client.15999 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56445b370620 con 0x56445b62d9a0 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c005500 con 0x56445b62d9a0 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff14c004ed0 con 0x56445b62d9a0 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 10 client.15999 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 20 client.15999 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b643500 0x56445b6458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 4 client.15999 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56445b59ea20 con 0x56445b643500 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.908+0000 7ff153fff640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b643500 0x56445b6458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.909+0000 7ff13affd640 10 client.15999 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.909+0000 7ff153fff640 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b643500 0x56445b6458f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27ea1df8d7037f92 server_cookie=d0d01e90dbd06f98 in_seq=0 out_seq=0 2024-09-19T09:23:05.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.909+0000 7ff13affd640 1 -- 172.21.15.52:0/3856055862 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56445b59ea20 con 0x56445b643500 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.909+0000 7ff13affd640 10 client.15999 handle_command_reply: tid=0 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.909+0000 7ff164ded740 1 client.15999 shutdown 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 msgr2=0x56445b637b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00bfd0 tx=0x7ff14c004790 comp rx=0 tx=0).stop 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 shutdown_connections 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b643500 0x56445b6458f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b63f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b6380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff13affd640 0 client.15999 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:05.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 --2- 172.21.15.52:0/3856055862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b637b70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 >> 172.21.15.52:0/3856055862 conn(0x56445b629010 msgr2=0x56445b62a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 shutdown_connections 2024-09-19T09:23:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 1 -- 172.21.15.52:0/3856055862 wait complete. 2024-09-19T09:23:05.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.910+0000 7ff164ded740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T09:23:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.924+0000 7ff164ded740 1 Processor -- start 2024-09-19T09:23:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.924+0000 7ff164ded740 1 -- start start 2024-09-19T09:23:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b63f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b6280b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1add30 con 0x56445b62d9a0 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1ab600 con 0x56445b633370 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff164ded740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1a9450 con 0x56445b62e2e0 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45218/0 (socket says 172.21.15.52:45218) 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3595911453 learned_addr learned my addr 172.21.15.52:0/3595911453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15bfff640 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b6280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3595911453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 msgr2=0x56445b63f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b63f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3595911453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 msgr2=0x56445b6280b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b6280b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 -- 172.21.15.52:0/3595911453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445b645c60 con 0x56445b62d9a0 2024-09-19T09:23:05.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15bfff640 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b6280b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0052a0 tx=0x7ff14c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fb77f4b1167be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff1517fa640 1 -- 172.21.15.52:0/3595911453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c02a070 con 0x56445b62d9a0 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff1517fa640 1 -- 172.21.15.52:0/3595911453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c005850 con 0x56445b62d9a0 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.925+0000 7ff1517fa640 1 -- 172.21.15.52:0/3595911453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004570 con 0x56445b62d9a0 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- 172.21.15.52:0/3595911453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 msgr2=0x56445b638140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0052a0 tx=0x7ff14c00b390 comp rx=0 tx=0).stop 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- 172.21.15.52:0/3595911453 shutdown_connections 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b633370 0x56445b6280b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62e2e0 0x56445b63f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 --2- 172.21.15.52:0/3595911453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b62d9a0 0x56445b638140 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- 172.21.15.52:0/3595911453 >> 172.21.15.52:0/3595911453 conn(0x56445b629010 msgr2=0x56445b6279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- 172.21.15.52:0/3595911453 shutdown_connections 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- 172.21.15.52:0/3595911453 wait complete. 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 -- start start 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.926+0000 7ff164ded740 1 Processor -- start 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 0x56445b63c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 0x56445b63cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1a9ac0 con 0x56445b633370 2024-09-19T09:23:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1aaf30 con 0x56445b62e2e0 2024-09-19T09:23:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c1aa190 con 0x56445b62d9a0 2024-09-19T09:23:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff164ded740 10 client.0 _ll_register_callbacks cb 0x7ff154005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45224/0 (socket says 172.21.15.52:45224) 2024-09-19T09:23:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 -- 172.21.15.52:0/1492061448 learned_addr learned my addr 172.21.15.52:0/1492061448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff153fff640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 0x56445b63cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 0x56445b63c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 -- 172.21.15.52:0/1492061448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 msgr2=0x56445b63c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 0x56445b63c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 -- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 msgr2=0x56445b63cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 0x56445b63cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 -- 172.21.15.52:0/1492061448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445b63e1c0 con 0x56445b633370 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff153fff640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 0x56445b63cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 0x56445b63c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff15bfff640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff154035000 tx=0x7ff154043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8631197b6a3de564 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.927+0000 7ff13affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154030a90 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff154030c30 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff14c005850 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff154030e30 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 10 client.16005 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56445b63f4b0 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff14c005850 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff154045070 con 0x56445b633370 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 10 client.16005 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 20 client.16005 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b6ae970 0x56445b6b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 4 client.16005 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56445b598d70 con 0x56445b6ae970 2024-09-19T09:23:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.928+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b6ae970 0x56445b6b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.929+0000 7ff13affd640 10 client.16005 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.929+0000 7ff15b7fe640 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b6ae970 0x56445b6b0d90 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c772e571f2a30607 server_cookie=ff86f9cbeedaac5 in_seq=0 out_seq=0 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff13affd640 1 -- 172.21.15.52:0/1492061448 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56445b598d70 con 0x56445b6ae970 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff13affd640 10 client.16005 handle_command_reply: tid=0 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 client.16005 shutdown 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 msgr2=0x56445b63dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff154035000 tx=0x7ff154043000 comp rx=0 tx=0).stop 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 shutdown_connections 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56445b6ae970 0x56445b6b0d90 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56445b633370 0x56445b63dbb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.938 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56445b62e2e0 0x56445b63cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff13affd640 0 client.16005 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 --2- 172.21.15.52:0/1492061448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56445b62d9a0 0x56445b63c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 >> 172.21.15.52:0/1492061448 conn(0x56445b629010 msgr2=0x56445b6281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 shutdown_connections 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 1 -- 172.21.15.52:0/1492061448 wait complete. 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.936+0000 7ff164ded740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:23:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:23:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:23:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 msgr2=0x7ff1480a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 0x7ff1480a5830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff154005e30 tx=0x7ff1540095c0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 msgr2=0x7ff15c103030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d770 tx=0x7ff14400dc30 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 shutdown_connections 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1480a3370 0x7ff1480a5830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff15c102610 0x7ff15c103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff15c101c50 0x7ff15c103030 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 --2- 172.21.15.52:0/1490175073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff15c100a60 0x7ff15c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 >> 172.21.15.52:0/1490175073 conn(0x7ff15c0fc1e0 msgr2=0x7ff15c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 shutdown_connections 2024-09-19T09:23:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:05.937+0000 7ff161f76640 1 -- 172.21.15.52:0/1490175073 wait complete. 2024-09-19T09:23:06.043 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:23:06.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:23:06.385 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2242619923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:06.412 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 3fb6f79e --release --await' 2024-09-19T09:23:06.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 3fb6f79e --release --await 2024-09-19T09:23:06.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2242619923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:06.484 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:06.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2242619923' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.974+0000 7f1be9ee5640 1 -- 172.21.15.52:0/1576908471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4101ba0 msgr2=0x7f1be410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.974+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/1576908471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4101ba0 0x7f1be410d970 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009900 tx=0x7f1bdc02a410 comp rx=0 tx=0).stop 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 -- 172.21.15.52:0/1576908471 shutdown_connections 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/1576908471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4101ba0 0x7f1be410d970 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/1576908471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/1576908471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4105ad0 0x7f1be4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 -- 172.21.15.52:0/1576908471 >> 172.21.15.52:0/1576908471 conn(0x7f1be4077210 msgr2=0x7f1be40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 -- 172.21.15.52:0/1576908471 shutdown_connections 2024-09-19T09:23:06.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 -- 172.21.15.52:0/1576908471 wait complete. 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 Processor -- start 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 -- start start 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.975+0000 7f1be9ee5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 0x7f1be4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4110f50 con 0x7f1be4105ad0 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1be4110dd0 con 0x7f1be4101ba0 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41110d0 con 0x7f1be4101200 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45246/0 (socket says 172.21.15.52:45246) 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 -- 172.21.15.52:0/318291549 learned_addr learned my addr 172.21.15.52:0/318291549 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 0x7f1be4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be37fe640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 -- 172.21.15.52:0/318291549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 msgr2=0x7f1be4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 -- 172.21.15.52:0/318291549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 msgr2=0x7f1be4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 0x7f1be4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 -- 172.21.15.52:0/318291549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be419d4b0 con 0x7f1be4105ad0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be37fe640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 0x7f1be4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be3fff640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009230 tx=0x7f1bdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be0ff9640 1 -- 172.21.15.52:0/318291549 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc03f070 con 0x7f1be4105ad0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be0ff9640 1 -- 172.21.15.52:0/318291549 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bdc031e30 con 0x7f1be4105ad0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be0ff9640 1 -- 172.21.15.52:0/318291549 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc035030 con 0x7f1be4105ad0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be419d740 con 0x7f1be4105ad0 2024-09-19T09:23:07.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.976+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be41a5080 con 0x7f1be4105ad0 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1be0ff9640 1 -- 172.21.15.52:0/318291549 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1bdc042070 con 0x7f1be4105ad0 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 Processor -- start 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 -- start start 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f68380 0x55a243f76c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243f79540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a243ecd280 con 0x55a243f67a60 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a243e74b10 con 0x55a243f68380 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.979+0000 7f1bec2be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a243ec9240 con 0x55a243f77150 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45250/0 (socket says 172.21.15.52:45250) 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1192126313 learned_addr learned my addr 172.21.15.52:0/1192126313 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:07.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f68380 0x55a243f76c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be0ff9640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 0x7f1bd00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1192126313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 msgr2=0x55a243f79540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243f79540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1192126313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f68380 msgr2=0x55a243f76c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f68380 0x55a243f76c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1192126313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a243e811f0 con 0x55a243f67a60 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be3fff640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 0x7f1bd00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be0ff9640 1 -- 172.21.15.52:0/318291549 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bdc0f0340 con 0x7f1be4105ad0 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00aac0 tx=0x7f1bcc00af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3b9bbe1ff15468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1bd9ffb640 1 -- 172.21.15.52:0/1192126313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00f040 con 0x55a243f67a60 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1bd9ffb640 1 -- 172.21.15.52:0/1192126313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bcc018070 con 0x55a243f67a60 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.980+0000 7f1bd9ffb640 1 -- 172.21.15.52:0/1192126313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0123e0 con 0x55a243f67a60 2024-09-19T09:23:07.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- 172.21.15.52:0/1192126313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 msgr2=0x55a243f67e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1be3fff640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 0x7f1bd00a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0bc870 tx=0x7f1bdc0b1dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00aac0 tx=0x7f1bcc00af80 comp rx=0 tx=0).stop 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- 172.21.15.52:0/1192126313 shutdown_connections 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243f79540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f68380 0x55a243f76c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1192126313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f67e40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- 172.21.15.52:0/1192126313 >> 172.21.15.52:0/1192126313 conn(0x55a243f640f0 msgr2=0x55a243f644d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- 172.21.15.52:0/1192126313 shutdown_connections 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- 172.21.15.52:0/1192126313 wait complete. 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.981+0000 7f1bec2be740 1 -- start start 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 Processor -- start 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f68380 0x55a243f745d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f74b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a243f79d20 con 0x55a243f67a60 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a243e87f10 con 0x55a243f77150 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a243f79ea0 con 0x55a243f68380 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1bec2be740 10 client.0 _ll_register_callbacks cb 0x55a243e50a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45266/0 (socket says 172.21.15.52:45266) 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1771809827 learned_addr learned my addr 172.21.15.52:0/1771809827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f68380 0x55a243f745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f74b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1771809827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f68380 msgr2=0x55a243f745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f68380 0x55a243f745d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 msgr2=0x55a243f74b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f74b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.982+0000 7f1be2ffd640 1 -- 172.21.15.52:0/1771809827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a243c3e6a0 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00eee0 tx=0x7f1bcc006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d11766176b5522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc013670 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bcc013810 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bcc018070 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bcc02c420 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 10 client.16017 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a243f859c0 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bcc018070 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1bcc01e410 con 0x55a243f67a60 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 10 client.16017 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:07.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 20 client.16017 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243f86dc0 0x55a243f891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 4 client.16017 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.983+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a243eda7f0 con 0x55a243f86dc0 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.984+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243f86dc0 0x55a243f891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.984+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243f86dc0 0x55a243f891b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e162c8ea33618af7 server_cookie=e9e05683e7225031 in_seq=0 out_seq=0 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.984+0000 7f1bc2ffd640 10 client.16017 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/1771809827 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a243eda7f0 con 0x55a243f86dc0 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bc2ffd640 10 client.16017 handle_command_reply: tid=0 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 client.16017 shutdown 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 msgr2=0x55a243f74090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00eee0 tx=0x7f1bcc006d50 comp rx=0 tx=0).stop 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 shutdown_connections 2024-09-19T09:23:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243f86dc0 0x55a243f891b0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f74b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bc2ffd640 0 client.16017 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f68380 0x55a243f745d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1771809827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f67a60 0x55a243f74090 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 >> 172.21.15.52:0/1771809827 conn(0x55a243f640f0 msgr2=0x55a243f69e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 shutdown_connections 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.985+0000 7f1bec2be740 1 -- 172.21.15.52:0/1771809827 wait complete. 2024-09-19T09:23:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:06.986+0000 7f1bec2be740 20 client.16017 trim_cache size 0 max 16384 2024-09-19T09:23:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 Processor -- start 2024-09-19T09:23:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 -- start start 2024-09-19T09:23:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f67a60 0x55a243f8e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41adf00 con 0x55a243f68380 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41ab7d0 con 0x55a243f77150 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1bec2be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41a9620 con 0x55a243f67a60 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45272/0 (socket says 172.21.15.52:45272) 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 -- 172.21.15.52:0/1952972808 learned_addr learned my addr 172.21.15.52:0/1952972808 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f67a60 0x55a243f8e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 -- 172.21.15.52:0/1952972808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f67a60 msgr2=0x55a243f8e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f67a60 0x55a243f8e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 -- 172.21.15.52:0/1952972808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 msgr2=0x55a243f712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be37fe640 1 -- 172.21.15.52:0/1952972808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a243f89520 con 0x55a243f68380 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.006+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.007+0000 7f1be37fe640 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4010550 tx=0x7f1bd4012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3f9be9e12e2c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.007+0000 7f1bd97fa640 1 -- 172.21.15.52:0/1952972808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd40120d0 con 0x55a243f68380 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.007+0000 7f1bd97fa640 1 -- 172.21.15.52:0/1952972808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd4012270 con 0x55a243f68380 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.007+0000 7f1bd97fa640 1 -- 172.21.15.52:0/1952972808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd401b830 con 0x55a243f68380 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- 172.21.15.52:0/1952972808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 msgr2=0x55a243f8ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4010550 tx=0x7f1bd4012950 comp rx=0 tx=0).stop 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- 172.21.15.52:0/1952972808 shutdown_connections 2024-09-19T09:23:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f77150 0x55a243f712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f8ecf0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 --2- 172.21.15.52:0/1952972808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f67a60 0x55a243f8e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- 172.21.15.52:0/1952972808 >> 172.21.15.52:0/1952972808 conn(0x55a243f640f0 msgr2=0x55a243f69db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- 172.21.15.52:0/1952972808 shutdown_connections 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- 172.21.15.52:0/1952972808 wait complete. 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.008+0000 7f1bec2be740 1 -- start start 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 Processor -- start 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f67a60 0x55a243f7b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243ff0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41a9c90 con 0x55a243f68380 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41ab100 con 0x55a243f67a60 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1be41aa360 con 0x55a243f77150 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1bec2be740 10 client.0 _ll_register_callbacks cb 0x7f1bd4007660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45286/0 (socket says 172.21.15.52:45286) 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 -- 172.21.15.52:0/3254125405 learned_addr learned my addr 172.21.15.52:0/3254125405 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f67a60 0x55a243f7b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243ff0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 -- 172.21.15.52:0/3254125405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 msgr2=0x55a243ff0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243ff0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 -- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f67a60 msgr2=0x55a243f7b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f67a60 0x55a243f7b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.009+0000 7f1be37fe640 1 -- 172.21.15.52:0/3254125405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a243f7bf90 con 0x55a243f68380 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1be37fe640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40073f0 tx=0x7f1bd4012650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f88b0a1f01a96c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4010890 con 0x55a243f68380 2024-09-19T09:23:07.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bd4020050 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd4012270 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bd4010a30 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bec2be740 10 client.16023 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a243ff1d40 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.010+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bd4012270 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1bd4037440 con 0x55a243f68380 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 10 client.16023 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 20 client.16023 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243ff2430 0x55a243ff4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 4 client.16023 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a243ed4d00 con 0x55a243ff2430 2024-09-19T09:23:07.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243ff2430 0x55a243ff4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1bc2ffd640 10 client.16023 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.011+0000 7f1be2ffd640 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243ff2430 0x55a243ff4850 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e470423d7a66196 server_cookie=56501800ef70d26c in_seq=0 out_seq=0 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.012+0000 7f1bc2ffd640 1 -- 172.21.15.52:0/3254125405 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a243ed4d00 con 0x55a243ff2430 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.012+0000 7f1bc2ffd640 10 client.16023 handle_command_reply: tid=0 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.012+0000 7f1bec2be740 1 client.16023 shutdown 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 msgr2=0x55a243f7b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40073f0 tx=0x7f1bd4012650 comp rx=0 tx=0).stop 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 shutdown_connections 2024-09-19T09:23:07.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a243ff2430 0x55a243ff4850 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a243f77150 0x55a243ff0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a243f68380 0x55a243f7b700 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 --2- 172.21.15.52:0/3254125405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a243f67a60 0x55a243f7b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 >> 172.21.15.52:0/3254125405 conn(0x55a243f640f0 msgr2=0x55a243f75700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bc2ffd640 0 client.16023 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 shutdown_connections 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 1 -- 172.21.15.52:0/3254125405 wait complete. 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.013+0000 7f1bec2be740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:07.019 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "2300b23c-837b-46af-8e76-ce569496d948", 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 msgr2=0x7f1bd00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 0x7f1bd00a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc0bc870 tx=0x7f1bdc0b1dc0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 msgr2=0x7f1be419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc009230 tx=0x7f1bdc003c10 comp rx=0 tx=0).stop 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 shutdown_connections 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1be4105ad0 0x7f1be419cdd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1be4101ba0 0x7f1be4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1bd00a32c0 0x7f1bd00a5780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 --2- 172.21.15.52:0/318291549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1be4101200 0x7f1be4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 >> 172.21.15.52:0/318291549 conn(0x7f1be4077210 msgr2=0x7f1be4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 shutdown_connections 2024-09-19T09:23:07.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:07.014+0000 7f1be9ee5640 1 -- 172.21.15.52:0/318291549 wait complete. 2024-09-19T09:23:07.335 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:07 smithi052 ceph-mon[30947]: pgmap v388: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:07 smithi169 ceph-mon[35454]: pgmap v388: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:07.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:07 smithi086 ceph-mon[34813]: pgmap v388: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:07.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:23:07.777 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:08.305 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:08 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:23:08.305 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:08 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:08.306 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:08 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:23:08.306 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:08 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:08.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 -- 172.21.15.52:0/692539616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058106f10 msgr2=0x7f005810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 --2- 172.21.15.52:0/692539616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058106f10 0x7f005810ea90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0050009ca0 tx=0x7f005002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 -- 172.21.15.52:0/692539616 shutdown_connections 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 --2- 172.21.15.52:0/692539616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058106f10 0x7f005810ea90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 --2- 172.21.15.52:0/692539616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058102790 0x7f00581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 --2- 172.21.15.52:0/692539616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058101de0 0x7f00581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 -- 172.21.15.52:0/692539616 >> 172.21.15.52:0/692539616 conn(0x7f00580fd8c0 msgr2=0x7f00580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 -- 172.21.15.52:0/692539616 shutdown_connections 2024-09-19T09:23:08.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.304+0000 7f005e925640 1 -- 172.21.15.52:0/692539616 wait complete. 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 Processor -- start 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 -- start start 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058101de0 0x7f0058198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058106f10 0x7f005819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0058111f90 con 0x7f0058102790 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0058111e10 con 0x7f0058101de0 2024-09-19T09:23:08.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f005e925640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0058112110 con 0x7f0058106f10 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34866/0 (socket says 172.21.15.52:34866) 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.305+0000 7f004ffff640 1 -- 172.21.15.52:0/472230305 learned_addr learned my addr 172.21.15.52:0/472230305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f005cec2640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058106f10 0x7f005819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f0057fff640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058101de0 0x7f0058198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 -- 172.21.15.52:0/472230305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058106f10 msgr2=0x7f005819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058106f10 0x7f005819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 -- 172.21.15.52:0/472230305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058101de0 msgr2=0x7f0058198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058101de0 0x7f0058198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 -- 172.21.15.52:0/472230305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005819d3c0 con 0x7f0058102790 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f004ffff640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f004000c890 tx=0x7f004000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f0055ffb640 1 -- 172.21.15.52:0/472230305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040004220 con 0x7f0058102790 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005819d6b0 con 0x7f0058102790 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f0055ffb640 1 -- 172.21.15.52:0/472230305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00400043c0 con 0x7f0058102790 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f0055ffb640 1 -- 172.21.15.52:0/472230305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040004a00 con 0x7f0058102790 2024-09-19T09:23:08.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.306+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581a4f90 con 0x7f0058102790 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.309+0000 7f0060cfe740 1 Processor -- start 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.309+0000 7f0055ffb640 1 -- 172.21.15.52:0/472230305 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f00400079b0 con 0x7f0058102790 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 -- start start 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8ef4060 0x5638d8ef4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8efed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638d8e59620 con 0x5638d8eff240 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5638d8e00e50 con 0x5638d8ef4980 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0060cfe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638d8e555e0 con 0x5638d8ef4060 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34878/0 (socket says 172.21.15.52:34878) 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 -- 172.21.15.52:0/2985350555 learned_addr learned my addr 172.21.15.52:0/2985350555 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f0057fff640 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8efed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f005cec2640 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8ef4060 0x5638d8ef4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 -- 172.21.15.52:0/2985350555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8ef4060 msgr2=0x5638d8ef4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8ef4060 0x5638d8ef4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 -- 172.21.15.52:0/2985350555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 msgr2=0x5638d8efed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8efed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.310+0000 7f004ffff640 1 -- 172.21.15.52:0/2985350555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d8df1d40 con 0x5638d8eff240 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f0055ffb640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 0x7f00440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f004ffff640 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00400d5630 tx=0x7f00400d5af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316bf3a206e108d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f005cec2640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 0x7f00440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f0055ffb640 1 -- 172.21.15.52:0/472230305 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f00400cf4c0 con 0x7f0058102790 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f004e7fc640 1 -- 172.21.15.52:0/2985350555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040097d00 con 0x5638d8eff240 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f004e7fc640 1 -- 172.21.15.52:0/2985350555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004009c160 con 0x5638d8eff240 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.311+0000 7f004e7fc640 1 -- 172.21.15.52:0/2985350555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004009b3c0 con 0x5638d8eff240 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- 172.21.15.52:0/2985350555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 msgr2=0x5638d8f01630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f005cec2640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 0x7f00440a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0050009430 tx=0x7f0050005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f00400d5630 tx=0x7f00400d5af0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- 172.21.15.52:0/2985350555 shutdown_connections 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8eff240 0x5638d8f01630 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8efed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 --2- 172.21.15.52:0/2985350555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8ef4060 0x5638d8ef4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- 172.21.15.52:0/2985350555 >> 172.21.15.52:0/2985350555 conn(0x5638d8ef05f0 msgr2=0x5638d8ef09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- 172.21.15.52:0/2985350555 shutdown_connections 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- 172.21.15.52:0/2985350555 wait complete. 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 -- start start 2024-09-19T09:23:08.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.312+0000 7f0060cfe740 1 Processor -- start 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 0x5638d8efc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8efcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638d8f01e10 con 0x5638d8ef4980 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5638d8de1f10 con 0x5638d8ef4060 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638d8f01f90 con 0x5638d8eff240 2024-09-19T09:23:08.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 10 client.0 _ll_register_callbacks cb 0x5638d8e05db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34892/0 (socket says 172.21.15.52:34892) 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 -- 172.21.15.52:0/1638889084 learned_addr learned my addr 172.21.15.52:0/1638889084 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f005cec2640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8efcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0057fff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 0x5638d8efc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 -- 172.21.15.52:0/1638889084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 msgr2=0x5638d8efcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8efcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 -- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 msgr2=0x5638d8efc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 0x5638d8efc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 -- 172.21.15.52:0/1638889084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d8b68580 con 0x5638d8ef4980 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0057fff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 0x5638d8efc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f005cec2640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8efcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f004ffff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00400d70e0 tx=0x7f0040004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e73682b5baabff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f00377fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004001d040 con 0x5638d8ef4980 2024-09-19T09:23:08.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f00400d5190 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.313+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f004009c160 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f004009b5a0 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 10 client.16035 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5638d8c32960 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f004009c160 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f00400860c0 con 0x5638d8ef4980 2024-09-19T09:23:08.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 10 client.16035 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 10 client.16035 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 20 client.16035 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f0ecf0 0x5638d8f110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 4 client.16035 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d8e66b90 con 0x5638d8f0ecf0 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.314+0000 7f0057fff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f0ecf0 0x5638d8f110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.315+0000 7f0057fff640 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f0ecf0 0x5638d8f110e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541d639d5a79c0e8 server_cookie=8f046d171b1cabe4 in_seq=0 out_seq=0 2024-09-19T09:23:08.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.315+0000 7f00377fe640 10 client.16035 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.315+0000 7f00377fe640 1 -- 172.21.15.52:0/1638889084 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638d8e66b90 con 0x5638d8f0ecf0 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.315+0000 7f00377fe640 10 client.16035 handle_command_reply: tid=0 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 client.16035 shutdown 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 msgr2=0x5638d8efc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00400d70e0 tx=0x7f0040004570 comp rx=0 tx=0).stop 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 shutdown_connections 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f0ecf0 0x5638d8f110e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8efcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4980 0x5638d8efc640 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 --2- 172.21.15.52:0/1638889084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4060 0x5638d8efc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 >> 172.21.15.52:0/1638889084 conn(0x5638d8ef05f0 msgr2=0x5638d8ef62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f00377fe640 0 client.16035 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 shutdown_connections 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 1 -- 172.21.15.52:0/1638889084 wait complete. 2024-09-19T09:23:08.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.316+0000 7f0060cfe740 20 client.16035 trim_cache size 0 max 16384 2024-09-19T09:23:08.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 Processor -- start 2024-09-19T09:23:08.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 -- start start 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f13d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f14260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0038010f30 con 0x5638d8ef4060 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f003800e800 con 0x5638d8ef4980 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0060cfe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f003800c650 con 0x5638d8eff240 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0057fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0057fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34908/0 (socket says 172.21.15.52:34908) 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.333+0000 7f0057fff640 1 -- 172.21.15.52:0/3344265503 learned_addr learned my addr 172.21.15.52:0/3344265503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f005cec2640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f14260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f004ffff640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f13d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 -- 172.21.15.52:0/3344265503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 msgr2=0x5638d8f14260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f14260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 -- 172.21.15.52:0/3344265503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 msgr2=0x5638d8f13d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f13d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 -- 172.21.15.52:0/3344265503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d8efb0d0 con 0x5638d8ef4060 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f004ffff640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f0057fff640 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f004800b4e0 tx=0x7f004800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f3968a9273c459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f004dffb640 1 -- 172.21.15.52:0/3344265503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048022070 con 0x5638d8ef4060 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f004dffb640 1 -- 172.21.15.52:0/3344265503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00480143b0 con 0x5638d8ef4060 2024-09-19T09:23:08.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.334+0000 7f004dffb640 1 -- 172.21.15.52:0/3344265503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480255c0 con 0x5638d8ef4060 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 -- 172.21.15.52:0/3344265503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 msgr2=0x5638d8ef61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f004800b4e0 tx=0x7f004800bf20 comp rx=0 tx=0).stop 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 -- 172.21.15.52:0/3344265503 shutdown_connections 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f14260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 --2- 172.21.15.52:0/3344265503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8ef61c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.335+0000 7f0060cfe740 1 -- 172.21.15.52:0/3344265503 >> 172.21.15.52:0/3344265503 conn(0x5638d8ef05f0 msgr2=0x5638d8ef5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- 172.21.15.52:0/3344265503 shutdown_connections 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- 172.21.15.52:0/3344265503 wait complete. 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- start start 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 Processor -- start 2024-09-19T09:23:08.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f12410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f7ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f003800ccc0 con 0x5638d8ef4060 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f003800e130 con 0x5638d8ef4980 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f003800d390 con 0x5638d8eff240 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.336+0000 7f0060cfe740 10 client.0 _ll_register_callbacks cb 0x7f0050009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34914/0 (socket says 172.21.15.52:34914) 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 -- 172.21.15.52:0/738727168 learned_addr learned my addr 172.21.15.52:0/738727168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f005cec2640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f7ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f004ffff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f12410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 -- 172.21.15.52:0/738727168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 msgr2=0x5638d8f7ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f7ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 -- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 msgr2=0x5638d8f12410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f12410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 -- 172.21.15.52:0/738727168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d8f7cf80 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0057fff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0048008010 tx=0x7f00480169d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0e416d319c5ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f00377fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004802b020 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0048014560 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.337+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00480143b0 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0048022040 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 10 client.16041 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5638d8f7e140 con 0x5638d8ef4060 2024-09-19T09:23:08.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00480143b0 con 0x5638d8ef4060 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f004802f3a0 con 0x5638d8ef4060 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 10 client.16041 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 10 client.16041 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 20 client.16041 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f7e7f0 0x5638d8f80c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 4 client.16041 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3fb6f79e", "release": true, "await": true}] 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3fb6f79e", "release": true, "await": true}) -- 0x5638d8e610a0 con 0x5638d8f7e7f0 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.338+0000 7f004ffff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f7e7f0 0x5638d8f80c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.339+0000 7f004ffff640 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f7e7f0 0x5638d8f80c10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8471d8388ac92e8 server_cookie=4e1054bcec168c4e in_seq=0 out_seq=0 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.339+0000 7f00377fe640 10 client.16041 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.341+0000 7f00377fe640 1 -- 172.21.15.52:0/738727168 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5638d8e610a0 con 0x5638d8f7e7f0 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.341+0000 7f00377fe640 10 client.16041 handle_command_reply: tid=0 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.341+0000 7f0060cfe740 1 client.16041 shutdown 2024-09-19T09:23:08.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.341+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 msgr2=0x5638d8f11ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.341+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0048008010 tx=0x7f00480169d0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 shutdown_connections 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5638d8f7e7f0 0x5638d8f80c10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f00377fe640 0 client.16041 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638d8eff240 0x5638d8f7ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638d8ef4980 0x5638d8f12410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 --2- 172.21.15.52:0/738727168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638d8ef4060 0x5638d8f11ed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 >> 172.21.15.52:0/738727168 conn(0x5638d8ef05f0 msgr2=0x5638d8efe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 shutdown_connections 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 1 -- 172.21.15.52:0/738727168 wait complete. 2024-09-19T09:23:08.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.342+0000 7f0060cfe740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 12, 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "3fb6f79e": { 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 12, 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:23:08.361 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 140.3, 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:08.362 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:08.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 msgr2=0x7f00440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 0x7f00440a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0050009430 tx=0x7f0050005ef0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 msgr2=0x7f0058198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f004000c890 tx=0x7f004000cd50 comp rx=0 tx=0).stop 2024-09-19T09:23:08.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 shutdown_connections 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f00440a3240 0x7f00440a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0058106f10 0x7f005819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0058102790 0x7f0058198950 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 --2- 172.21.15.52:0/472230305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0058101de0 0x7f0058198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 >> 172.21.15.52:0/472230305 conn(0x7f00580fd8c0 msgr2=0x7f00580fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 shutdown_connections 2024-09-19T09:23:08.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:08.343+0000 7f005e925640 1 -- 172.21.15.52:0/472230305 wait complete. 2024-09-19T09:23:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:08 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:23:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:08 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:08 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:23:08.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:08 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:08.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:08 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:23:08.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:08 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:08.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:08 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:23:08.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:08 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:09.041 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3fb6f79e', total seconds elapsed: 25.4 2024-09-19T09:23:09.104 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:09.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:09 smithi052 ceph-mon[30947]: pgmap v389: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:23:09.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:09 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:23:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:09 smithi169 ceph-mon[35454]: pgmap v389: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:23:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:09 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:23:09.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:09 smithi086 ceph-mon[34813]: pgmap v389: 97 pgs: 97 active+clean; 750 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:23:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:09 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 -- 172.21.15.52:0/440428748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814100a80 msgr2=0x7fc814100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 --2- 172.21.15.52:0/440428748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814100a80 0x7fc814100ee0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc800009930 tx=0x7fc80002a420 comp rx=0 tx=0).stop 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 -- 172.21.15.52:0/440428748 shutdown_connections 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 --2- 172.21.15.52:0/440428748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814101420 0x7fc81410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 --2- 172.21.15.52:0/440428748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814100a80 0x7fc814100ee0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 --2- 172.21.15.52:0/440428748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814106a80 0x7fc814106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 -- 172.21.15.52:0/440428748 >> 172.21.15.52:0/440428748 conn(0x7fc8140fc7a0 msgr2=0x7fc8140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 -- 172.21.15.52:0/440428748 shutdown_connections 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.600+0000 7fc81b12f640 1 -- 172.21.15.52:0/440428748 wait complete. 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.601+0000 7fc81b12f640 1 Processor -- start 2024-09-19T09:23:09.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.601+0000 7fc81b12f640 1 -- start start 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.601+0000 7fc81b12f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 0x7fc814199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.601+0000 7fc81b12f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814101420 0x7fc814199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.601+0000 7fc81b12f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc81b12f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc814110e80 con 0x7fc814106a80 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc81b12f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc814110d00 con 0x7fc814100a80 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc81b12f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111000 con 0x7fc814101420 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34940/0 (socket says 172.21.15.52:34940) 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 -- 172.21.15.52:0/3275523427 learned_addr learned my addr 172.21.15.52:0/3275523427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc813fff640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814101420 0x7fc814199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc818ecb640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 0x7fc814199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 -- 172.21.15.52:0/3275523427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814101420 msgr2=0x7fc814199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814101420 0x7fc814199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 -- 172.21.15.52:0/3275523427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 msgr2=0x7fc814199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 0x7fc814199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 -- 172.21.15.52:0/3275523427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8141a48d0 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc818ecb640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 0x7fc814199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc8196cc640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00eaa0 tx=0x7fc80c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc811ffb640 1 -- 172.21.15.52:0/3275523427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00cdb0 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc811ffb640 1 -- 172.21.15.52:0/3275523427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80c005020 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8141a4aa0 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.602+0000 7fc811ffb640 1 -- 172.21.15.52:0/3275523427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0116b0 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.603+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141a4f60 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.605+0000 7fc811ffb640 1 -- 172.21.15.52:0/3275523427 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc80c005560 con 0x7fc814106a80 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.605+0000 7fc81d508740 1 Processor -- start 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 -- start start 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a998740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9a7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b67a8fe2e0 con 0x55b67a9a7a90 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b67a8a5ce0 con 0x55b67a998c80 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc81d508740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b67a8fa2a0 con 0x55b67a998360 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc811ffb640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 0x7fc8040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc8196cc640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 0x7fc8040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34944/0 (socket says 172.21.15.52:34944) 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc813fff640 1 -- 172.21.15.52:0/2689828597 learned_addr learned my addr 172.21.15.52:0/2689828597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc818ecb640 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc813fff640 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a998740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.606+0000 7fc811ffb640 1 -- 172.21.15.52:0/3275523427 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc80c0cfcf0 con 0x7fc814106a80 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 -- 172.21.15.52:0/2689828597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 msgr2=0x55b67a998740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a998740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 -- 172.21.15.52:0/2689828597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 msgr2=0x55b67a9a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 -- 172.21.15.52:0/2689828597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67a88a440 con 0x55b67a9a7a90 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc8196cc640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 0x7fc8040a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc80c06f080 tx=0x7fc80c0c7000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc813fff640 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc800009930 tx=0x7fc8000056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e233ba21dc7b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc7feffd640 1 -- 172.21.15.52:0/2689828597 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800035040 con 0x55b67a9a7a90 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc7feffd640 1 -- 172.21.15.52:0/2689828597 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8000035f0 con 0x55b67a9a7a90 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.607+0000 7fc7feffd640 1 -- 172.21.15.52:0/2689828597 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80003d6e0 con 0x55b67a9a7a90 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- 172.21.15.52:0/2689828597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 msgr2=0x55b67a9a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc800009930 tx=0x7fc8000056d0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- 172.21.15.52:0/2689828597 shutdown_connections 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a9a7a90 0x55b67a9a9e80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 --2- 172.21.15.52:0/2689828597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a998740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- 172.21.15.52:0/2689828597 >> 172.21.15.52:0/2689828597 conn(0x55b67a994a30 msgr2=0x55b67a994e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- 172.21.15.52:0/2689828597 shutdown_connections 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- 172.21.15.52:0/2689828597 wait complete. 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 -- start start 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.608+0000 7fc81d508740 1 Processor -- start 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b67a9aa600 con 0x55b67a998c80 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b67a8b9050 con 0x55b67a9a7a90 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b67a9aa780 con 0x55b67a998360 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 10 client.0 _ll_register_callbacks cb 0x55b67a8f9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34948/0 (socket says 172.21.15.52:34948) 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 -- 172.21.15.52:0/3746140248 learned_addr learned my addr 172.21.15.52:0/3746140248 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc813fff640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 -- 172.21.15.52:0/3746140248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 msgr2=0x55b67a9a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc813fff640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 -- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 msgr2=0x55b67a9a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9a4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 -- 172.21.15.52:0/3746140248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67a66f3c0 con 0x55b67a998c80 2024-09-19T09:23:09.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc818ecb640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bfd0 tx=0x7fc808010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7e2ac9565f43b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc7f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80801d060 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc80800eda0 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.609+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8000035f0 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc808018430 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 10 client.16053 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b67a9b6160 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8000035f0 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc8080164f0 con 0x55b67a998c80 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 10 client.16053 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 20 client.16053 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:09.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67a9b7670 0x55b67a9b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 4 client.16053 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b67a90b850 con 0x55b67a9b7670 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.610+0000 7fc813fff640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67a9b7670 0x55b67a9b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.611+0000 7fc813fff640 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67a9b7670 0x55b67a9b9ab0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c301e1c25514e098 server_cookie=144d6e397dc99f99 in_seq=0 out_seq=0 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.611+0000 7fc7f3fff640 10 client.16053 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.611+0000 7fc7f3fff640 1 -- 172.21.15.52:0/3746140248 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b67a90b850 con 0x55b67a9b7670 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.611+0000 7fc7f3fff640 10 client.16053 handle_command_reply: tid=0 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.611+0000 7fc81d508740 1 client.16053 shutdown 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 msgr2=0x55b67a9a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc80800bfd0 tx=0x7fc808010c80 comp rx=0 tx=0).stop 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 shutdown_connections 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67a9b7670 0x55b67a9b9ab0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9a4750 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc7f3fff640 0 client.16053 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 --2- 172.21.15.52:0/3746140248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 >> 172.21.15.52:0/3746140248 conn(0x55b67a994a30 msgr2=0x55b67a99a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 shutdown_connections 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 1 -- 172.21.15.52:0/3746140248 wait complete. 2024-09-19T09:23:09.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.612+0000 7fc81d508740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.629+0000 7fc81d508740 1 Processor -- start 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.629+0000 7fc81d508740 1 -- start start 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ade60 con 0x55b67a998c80 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ab730 con 0x55b67a9a7a90 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc81d508740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141a9580 con 0x55b67a998360 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34950/0 (socket says 172.21.15.52:34950) 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 -- 172.21.15.52:0/4067312391 learned_addr learned my addr 172.21.15.52:0/4067312391 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc813fff640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc813fff640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 -- 172.21.15.52:0/4067312391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 msgr2=0x55b67a9b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 -- 172.21.15.52:0/4067312391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 msgr2=0x55b67a9bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 -- 172.21.15.52:0/4067312391 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67a9a2ca0 con 0x55b67a998c80 2024-09-19T09:23:09.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc813fff640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:09.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.630+0000 7fc818ecb640 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc808001eb0 tx=0x7fc808004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6745792267135da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc7fe7fc640 1 -- 172.21.15.52:0/4067312391 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808005d70 con 0x55b67a998c80 2024-09-19T09:23:09.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc7fe7fc640 1 -- 172.21.15.52:0/4067312391 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80800eba0 con 0x55b67a998c80 2024-09-19T09:23:09.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc7fe7fc640 1 -- 172.21.15.52:0/4067312391 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8080047c0 con 0x55b67a998c80 2024-09-19T09:23:09.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 -- 172.21.15.52:0/4067312391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 msgr2=0x55b67a9bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc808001eb0 tx=0x7fc808004660 comp rx=0 tx=0).stop 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 -- 172.21.15.52:0/4067312391 shutdown_connections 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a9a7a90 0x55b67a9bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998c80 0x55b67a9bf380 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 --2- 172.21.15.52:0/4067312391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a998360 0x55b67a9b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 -- 172.21.15.52:0/4067312391 >> 172.21.15.52:0/4067312391 conn(0x55b67a994a30 msgr2=0x55b67a9a3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 -- 172.21.15.52:0/4067312391 shutdown_connections 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.631+0000 7fc81d508740 1 -- 172.21.15.52:0/4067312391 wait complete. 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 -- start start 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 Processor -- start 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9ab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a9a7a90 0x55b67a9ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141a9bf0 con 0x55b67a998360 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ab060 con 0x55b67a998c80 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141aa2c0 con 0x55b67a9a7a90 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc81d508740 10 client.0 _ll_register_callbacks cb 0x7fc80800b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34960/0 (socket says 172.21.15.52:34960) 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.632+0000 7fc813fff640 1 -- 172.21.15.52:0/1341239661 learned_addr learned my addr 172.21.15.52:0/1341239661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a9a7a90 0x55b67a9ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc818ecb640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 -- 172.21.15.52:0/1341239661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a9a7a90 msgr2=0x55b67a9ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a9a7a90 0x55b67a9ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 -- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 msgr2=0x55b67a9ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 -- 172.21.15.52:0/1341239661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67a9ac1b0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc813fff640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc80800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad18b43d2d620f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc7f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800035040 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc8000041f0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc80800eba0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc8000043f0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc81d508740 10 client.16059 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.633+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b67aa222f0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80800eba0 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc80003a040 con 0x55b67a998360 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 10 client.16059 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 20 client.16059 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67aa22580 0x55b67aa24970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 4 client.16059 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b67a905d60 con 0x55b67aa22580 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc818ecb640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67aa22580 0x55b67aa24970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc818ecb640 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67aa22580 0x55b67aa24970 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50eae12b151f7107 server_cookie=d67e9becca66c604 in_seq=0 out_seq=0 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.634+0000 7fc7f3fff640 10 client.16059 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc7f3fff640 1 -- 172.21.15.52:0/1341239661 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b67a905d60 con 0x55b67aa22580 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc7f3fff640 10 client.16059 handle_command_reply: tid=0 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 client.16059 shutdown 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 msgr2=0x55b67a9b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc80800bd30 comp rx=0 tx=0).stop 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 shutdown_connections 2024-09-19T09:23:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b67aa22580 0x55b67aa24970 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b67a9a7a90 0x55b67a9ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b67a998c80 0x55b67a9ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 --2- 172.21.15.52:0/1341239661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b67a998360 0x55b67a9b0110 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 >> 172.21.15.52:0/1341239661 conn(0x55b67a994a30 msgr2=0x55b67a993350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc7f3fff640 0 client.16059 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 shutdown_connections 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 1 -- 172.21.15.52:0/1341239661 wait complete. 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.635+0000 7fc81d508740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:23:09.641 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:23:09.642 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 msgr2=0x7fc8040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 0x7fc8040a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc80c06f080 tx=0x7fc80c0c7000 comp rx=0 tx=0).stop 2024-09-19T09:23:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 msgr2=0x7fc8141a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00eaa0 tx=0x7fc80c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 shutdown_connections 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc814106a80 0x7fc8141a4390 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8040a3240 0x7fc8040a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc814101420 0x7fc814199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 --2- 172.21.15.52:0/3275523427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc814100a80 0x7fc814199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 >> 172.21.15.52:0/3275523427 conn(0x7fc8140fc7a0 msgr2=0x7fc8140fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 shutdown_connections 2024-09-19T09:23:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:09.636+0000 7fc81b12f640 1 -- 172.21.15.52:0/3275523427 wait complete. 2024-09-19T09:23:10.345 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:23:10.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:10.610 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:11.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 -- 172.21.15.52:0/3289814539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18106f10 msgr2=0x7f6e1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:11.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3289814539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18106f10 0x7f6e1810ea90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009ca0 tx=0x7f6e1002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 -- 172.21.15.52:0/3289814539 shutdown_connections 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3289814539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18106f10 0x7f6e1810ea90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3289814539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18102790 0x7f6e181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3289814539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18101de0 0x7f6e181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 -- 172.21.15.52:0/3289814539 >> 172.21.15.52:0/3289814539 conn(0x7f6e180fd8c0 msgr2=0x7f6e180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 -- 172.21.15.52:0/3289814539 shutdown_connections 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.082+0000 7f6e1e473640 1 -- 172.21.15.52:0/3289814539 wait complete. 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 Processor -- start 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 -- start start 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18101de0 0x7f6e18198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 0x7f6e1819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18111f70 con 0x7f6e18102790 2024-09-19T09:23:11.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18111df0 con 0x7f6e18106f10 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.083+0000 7f6e1e473640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e181120f0 con 0x7f6e18101de0 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34968/0 (socket says 172.21.15.52:34968) 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 -- 172.21.15.52:0/3028703754 learned_addr learned my addr 172.21.15.52:0/3028703754 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e17fff640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18101de0 0x7f6e18198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e1ca10640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 0x7f6e1819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 -- 172.21.15.52:0/3028703754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18101de0 msgr2=0x7f6e18198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18101de0 0x7f6e18198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 -- 172.21.15.52:0/3028703754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 msgr2=0x7f6e1819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 0x7f6e1819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 -- 172.21.15.52:0/3028703754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1819d2e0 con 0x7f6e18102790 2024-09-19T09:23:11.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e1ca10640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 0x7f6e1819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e177fe640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00d950 tx=0x7f6e0c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c017030 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e0c004020 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1819d5d0 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c005650 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.084+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e181a4eb0 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.085+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e181021c0 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.086+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e0c0041d0 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.087+0000 7f6e157fa640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 0x7f6e000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.087+0000 7f6e17fff640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 0x7f6e000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.087+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e0c0cf2e0 con 0x7f6e18102790 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.088+0000 7f6e17fff640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 0x7f6e000a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800abe0 tx=0x7f6e0800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:11.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.091+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e0c00e350 con 0x7f6e18102790 2024-09-19T09:23:11.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.302+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e18109b60 con 0x7f6e18102790 2024-09-19T09:23:11.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:11 smithi052 ceph-mon[30947]: pgmap v390: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:23:11.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.302+0000 7f6e157fa640 1 -- 172.21.15.52:0/3028703754 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f6e0c09bf80 con 0x7f6e18102790 2024-09-19T09:23:11.303 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:23:11.303 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:23:11.304 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:23:11.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.304+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 msgr2=0x7f6e000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:11.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.304+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 0x7f6e000a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800abe0 tx=0x7f6e0800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.304+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 msgr2=0x7f6e18198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.304+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00d950 tx=0x7f6e0c00dd50 comp rx=0 tx=0).stop 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 shutdown_connections 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e18106f10 0x7f6e1819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e18102790 0x7f6e18198870 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e000a32c0 0x7f6e000a5780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 --2- 172.21.15.52:0/3028703754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e18101de0 0x7f6e18198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 >> 172.21.15.52:0/3028703754 conn(0x7f6e180fd8c0 msgr2=0x7f6e180febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 shutdown_connections 2024-09-19T09:23:11.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:11.305+0000 7f6e1e473640 1 -- 172.21.15.52:0/3028703754 wait complete. 2024-09-19T09:23:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:11 smithi169 ceph-mon[35454]: pgmap v390: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:23:11.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:11 smithi086 ceph-mon[34813]: pgmap v390: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:23:11.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:23:12.181 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:12.420 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:12 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3028703754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:12.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:12 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3028703754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:12.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:12 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3028703754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 -- 172.21.15.52:0/4056683056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c102790 msgr2=0x7f928c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 --2- 172.21.15.52:0/4056683056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c102790 0x7f928c1067e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f927c009900 tx=0x7f927c02a410 comp rx=0 tx=0).stop 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 -- 172.21.15.52:0/4056683056 shutdown_connections 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 --2- 172.21.15.52:0/4056683056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c106f10 0x7f928c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 --2- 172.21.15.52:0/4056683056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c102790 0x7f928c1067e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 --2- 172.21.15.52:0/4056683056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c101de0 0x7f928c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 -- 172.21.15.52:0/4056683056 >> 172.21.15.52:0/4056683056 conn(0x7f928c0fd8c0 msgr2=0x7f928c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 -- 172.21.15.52:0/4056683056 shutdown_connections 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.624+0000 7f929417c640 1 -- 172.21.15.52:0/4056683056 wait complete. 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 Processor -- start 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 -- start start 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 0x7f928c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c102790 0x7f928c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f928c111f70 con 0x7f928c106f10 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f928c111df0 con 0x7f928c101de0 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f929417c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1120f0 con 0x7f928c102790 2024-09-19T09:23:12.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f9292719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f9292719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34992/0 (socket says 172.21.15.52:34992) 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f9292719640 1 -- 172.21.15.52:0/655403535 learned_addr learned my addr 172.21.15.52:0/655403535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f9291f18640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 0x7f928c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.625+0000 7f9291717640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c102790 0x7f928c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 -- 172.21.15.52:0/655403535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c102790 msgr2=0x7f928c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c102790 0x7f928c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 -- 172.21.15.52:0/655403535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 msgr2=0x7f928c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 0x7f928c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 -- 172.21.15.52:0/655403535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c19d380 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9291f18640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 0x7f928c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9292719640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f928400cce0 tx=0x7f928400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9282ffd640 1 -- 172.21.15.52:0/655403535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928400f450 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c19d670 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9282ffd640 1 -- 172.21.15.52:0/655403535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928400fad0 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f9282ffd640 1 -- 172.21.15.52:0/655403535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284018c10 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.626+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c1a4f50 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.628+0000 7f9282ffd640 1 -- 172.21.15.52:0/655403535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f928400f5f0 con 0x7f928c106f10 2024-09-19T09:23:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 Processor -- start 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 -- start start 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af332a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591af2982f0 con 0x5591af333b40 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591af23fcf0 con 0x5591af3325d0 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9296555740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5591af2942b0 con 0x5591af33d370 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9291717640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9291717640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34998/0 (socket says 172.21.15.52:34998) 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.629+0000 7f9291717640 1 -- 172.21.15.52:0/379813526 learned_addr learned my addr 172.21.15.52:0/379813526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9282ffd640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 0x7f92780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291f18640 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af332a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9292719640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 0x7f92780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 -- 172.21.15.52:0/379813526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 msgr2=0x5591af33f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 -- 172.21.15.52:0/379813526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 msgr2=0x5591af332a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af332a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 -- 172.21.15.52:0/379813526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591af2243a0 con 0x5591af333b40 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9282ffd640 1 -- 172.21.15.52:0/655403535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f92840d00e0 con 0x7f928c106f10 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9291717640 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f927c02a930 tx=0x7f927c005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ef409e633d9acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9277fff640 1 -- 172.21.15.52:0/379813526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c043020 con 0x5591af333b40 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9292719640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 0x7f92780a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92840cded0 tx=0x7f928406f500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9277fff640 1 -- 172.21.15.52:0/379813526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927c031980 con 0x5591af333b40 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.630+0000 7f9277fff640 1 -- 172.21.15.52:0/379813526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c035050 con 0x5591af333b40 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 -- 172.21.15.52:0/379813526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 msgr2=0x5591af332090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f927c02a930 tx=0x7f927c005d70 comp rx=0 tx=0).stop 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 -- 172.21.15.52:0/379813526 shutdown_connections 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af332a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 --2- 172.21.15.52:0/379813526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af332090 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 -- 172.21.15.52:0/379813526 >> 172.21.15.52:0/379813526 conn(0x5591af2fb310 msgr2=0x5591af32ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 -- 172.21.15.52:0/379813526 shutdown_connections 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.631+0000 7f9296555740 1 -- 172.21.15.52:0/379813526 wait complete. 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 -- start start 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 Processor -- start 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af333b40 0x5591af339fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591af340010 con 0x5591af3325d0 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591af253060 con 0x5591af333b40 2024-09-19T09:23:12.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5591af340190 con 0x5591af33d370 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9296555740 10 client.0 _ll_register_callbacks cb 0x5591aefa68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9291717640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9291717640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35004/0 (socket says 172.21.15.52:35004) 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.632+0000 7f9291717640 1 -- 172.21.15.52:0/3545759071 learned_addr learned my addr 172.21.15.52:0/3545759071 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291f18640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af333b40 0x5591af339fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 -- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 msgr2=0x5591af33a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 -- 172.21.15.52:0/3545759071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af333b40 msgr2=0x5591af339fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af333b40 0x5591af339fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 -- 172.21.15.52:0/3545759071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591af0093c0 con 0x5591af3325d0 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9291717640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f927c032fd0 tx=0x7f927c031b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5a1598771b1a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f92757fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c04c070 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f927c003bb0 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f927c031980 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f927c058050 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9296555740 10 client.16077 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5591af34ba40 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.633+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f927c031980 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f927c03aca0 con 0x5591af3325d0 2024-09-19T09:23:12.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 10 client.16077 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 10 client.16077 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 20 client.16077 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af34cd90 0x5591af34f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 4 client.16077 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591af2a5860 con 0x5591af34cd90 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9291f18640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af34cd90 0x5591af34f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f9291f18640 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af34cd90 0x5591af34f180 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7e65def4aac23ae server_cookie=fc9dcc91c54fad76 in_seq=0 out_seq=0 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.634+0000 7f92757fa640 10 client.16077 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f92757fa640 1 -- 172.21.15.52:0/3545759071 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591af2a5860 con 0x5591af34cd90 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f92757fa640 10 client.16077 handle_command_reply: tid=0 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 client.16077 shutdown 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 msgr2=0x5591af33cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f927c032fd0 tx=0x7f927c031b30 comp rx=0 tx=0).stop 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 shutdown_connections 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af34cd90 0x5591af34f180 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af33a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af333b40 0x5591af339fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f92757fa640 0 client.16077 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 --2- 172.21.15.52:0/3545759071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af3325d0 0x5591af33cd00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.635+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 >> 172.21.15.52:0/3545759071 conn(0x5591af2fb310 msgr2=0x5591af334930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.636+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 shutdown_connections 2024-09-19T09:23:12.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.636+0000 7f9296555740 1 -- 172.21.15.52:0/3545759071 wait complete. 2024-09-19T09:23:12.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.636+0000 7f9296555740 20 client.16077 trim_cache size 0 max 16384 2024-09-19T09:23:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.648+0000 7f9296555740 1 Processor -- start 2024-09-19T09:23:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 -- start start 2024-09-19T09:23:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af33bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1afef0 con 0x5591af333b40 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ad7c0 con 0x5591af3325d0 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9296555740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ab610 con 0x5591af33d370 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35012/0 (socket says 172.21.15.52:35012) 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 -- 172.21.15.52:0/4511284 learned_addr learned my addr 172.21.15.52:0/4511284 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291717640 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 -- 172.21.15.52:0/4511284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 msgr2=0x5591af3521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 -- 172.21.15.52:0/4511284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 msgr2=0x5591af33bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af33bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 -- 172.21.15.52:0/4511284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591af32e390 con 0x5591af333b40 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291717640 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f9291f18640 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x5591af339840 tx=0x7f928800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fc905c36e4e1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.649+0000 7f92777fe640 1 -- 172.21.15.52:0/4511284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288005220 con 0x5591af333b40 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f92777fe640 1 -- 172.21.15.52:0/4511284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928801e030 con 0x5591af333b40 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f92777fe640 1 -- 172.21.15.52:0/4511284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928801a600 con 0x5591af333b40 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 -- 172.21.15.52:0/4511284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 msgr2=0x5591af33c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x5591af339840 tx=0x7f928800b670 comp rx=0 tx=0).stop 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 -- 172.21.15.52:0/4511284 shutdown_connections 2024-09-19T09:23:12.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af33c460 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 --2- 172.21.15.52:0/4511284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af33bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 -- 172.21.15.52:0/4511284 >> 172.21.15.52:0/4511284 conn(0x5591af2fb310 msgr2=0x5591af33b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 -- 172.21.15.52:0/4511284 shutdown_connections 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.650+0000 7f9296555740 1 -- 172.21.15.52:0/4511284 wait complete. 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 -- start start 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 Processor -- start 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af350300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1abc80 con 0x5591af333b40 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ad0f0 con 0x5591af3325d0 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f928c1ac350 con 0x5591af33d370 2024-09-19T09:23:12.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9296555740 10 client.0 _ll_register_callbacks cb 0x7f927c0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9291f18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9291f18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35028/0 (socket says 172.21.15.52:35028) 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9291f18640 1 -- 172.21.15.52:0/955046070 learned_addr learned my addr 172.21.15.52:0/955046070 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9291717640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af350300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.651+0000 7f9291717640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 -- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 msgr2=0x5591af3b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 -- 172.21.15.52:0/955046070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 msgr2=0x5591af350300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af350300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 -- 172.21.15.52:0/955046070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591af351120 con 0x5591af333b40 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9291f18640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9288014fd0 tx=0x7f928800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e914d588894e542d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f92757fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:12.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288031060 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f928801e030 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f92880047f0 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f92880049f0 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9296555740 10 client.16083 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5591af3b7c90 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.652+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f928801e030 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f92880239a0 con 0x5591af333b40 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 10 client.16083 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 10 client.16083 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 20 client.16083 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af3b8380 0x5591af3ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 4 client.16083 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591af29fd70 con 0x5591af3b8380 2024-09-19T09:23:12.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9291717640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af3b8380 0x5591af3ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f92757fa640 10 client.16083 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.653+0000 7f9291717640 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af3b8380 0x5591af3ba7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd4e8c460a7fc151 server_cookie=f6658e91b153bb15 in_seq=0 out_seq=0 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f92757fa640 1 -- 172.21.15.52:0/955046070 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591af29fd70 con 0x5591af3b8380 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f92757fa640 10 client.16083 handle_command_reply: tid=0 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 client.16083 shutdown 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 msgr2=0x5591af350840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9288014fd0 tx=0x7f928800b3e0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 shutdown_connections 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5591af3b8380 0x5591af3ba7a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591af33d370 0x5591af3b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591af333b40 0x5591af350840 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 --2- 172.21.15.52:0/955046070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591af3325d0 0x5591af350300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f92757fa640 0 client.16083 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 >> 172.21.15.52:0/955046070 conn(0x5591af2fb310 msgr2=0x5591af33b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 shutdown_connections 2024-09-19T09:23:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 1 -- 172.21.15.52:0/955046070 wait complete. 2024-09-19T09:23:12.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f9296555740 20 client.16083 trim_cache size 0 max 16384 2024-09-19T09:23:12.661 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 msgr2=0x7f92780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 0x7f92780a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f92840cded0 tx=0x7f928406f500 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 msgr2=0x7f928c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f928400cce0 tx=0x7f928400a620 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.654+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 shutdown_connections 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c106f10 0x7f928c19cca0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f92780a3240 0x7f92780a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f928c102790 0x7f928c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 --2- 172.21.15.52:0/655403535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f928c101de0 0x7f928c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 >> 172.21.15.52:0/655403535 conn(0x7f928c0fd8c0 msgr2=0x7f928c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 shutdown_connections 2024-09-19T09:23:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:12.655+0000 7f929417c640 1 -- 172.21.15.52:0/655403535 wait complete. 2024-09-19T09:23:13.412 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:13 smithi086 ceph-mon[34813]: pgmap v391: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:13 smithi052 ceph-mon[30947]: pgmap v391: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:13 smithi169 ceph-mon[35454]: pgmap v391: 97 pgs: 97 active+clean; 751 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:23:13.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:23:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 -- 172.21.15.52:0/1213398812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 msgr2=0x7f26f81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1213398812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81021d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009ca0 tx=0x7f26e802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 -- 172.21.15.52:0/1213398812 shutdown_connections 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1213398812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f8106f20 0x7f26f810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1213398812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f81027a0 0x7f26f81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1213398812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81021d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 -- 172.21.15.52:0/1213398812 >> 172.21.15.52:0/1213398812 conn(0x7f26f80fd8b0 msgr2=0x7f26f80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 -- 172.21.15.52:0/1213398812 shutdown_connections 2024-09-19T09:23:14.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.209+0000 7f26fcd43640 1 -- 172.21.15.52:0/1213398812 wait complete. 2024-09-19T09:23:14.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 Processor -- start 2024-09-19T09:23:14.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 -- start start 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 0x7f26f81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f8106f20 0x7f26f819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8111fa0 con 0x7f26f8101df0 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8111e20 con 0x7f26f8106f20 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26fcd43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8112120 con 0x7f26f81027a0 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35052/0 (socket says 172.21.15.52:35052) 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 -- 172.21.15.52:0/1677442227 learned_addr learned my addr 172.21.15.52:0/1677442227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f8106f20 0x7f26f819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 0x7f26f81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 -- 172.21.15.52:0/1677442227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 msgr2=0x7f26f81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 0x7f26f81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 -- 172.21.15.52:0/1677442227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f8106f20 msgr2=0x7f26f819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f8106f20 0x7f26f819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f659c640 1 -- 172.21.15.52:0/1677442227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f819d350 con 0x7f26f8101df0 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.210+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 0x7f26f81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26f659c640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097b0 tx=0x7f26e8031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26e77fe640 1 -- 172.21.15.52:0/1677442227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e802fba0 con 0x7f26f8101df0 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26e77fe640 1 -- 172.21.15.52:0/1677442227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e802fd40 con 0x7f26f8101df0 2024-09-19T09:23:14.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f819d5e0 con 0x7f26f8101df0 2024-09-19T09:23:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26e77fe640 1 -- 172.21.15.52:0/1677442227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e803b930 con 0x7f26f8101df0 2024-09-19T09:23:14.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.211+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81a4f20 con 0x7f26f8101df0 2024-09-19T09:23:14.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.213+0000 7f26e77fe640 1 -- 172.21.15.52:0/1677442227 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f26e8030cc0 con 0x7f26f8101df0 2024-09-19T09:23:14.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.213+0000 7f26ff11c740 1 Processor -- start 2024-09-19T09:23:14.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 -- start start 2024-09-19T09:23:14.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b914b40 0x55ed7b913090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b920760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b8792f0 con 0x55ed7b9135d0 2024-09-19T09:23:14.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b820cf0 con 0x55ed7b91e370 2024-09-19T09:23:14.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26ff11c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b8752b0 con 0x55ed7b914b40 2024-09-19T09:23:14.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35060/0 (socket says 172.21.15.52:35060) 2024-09-19T09:23:14.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26f659c640 1 -- 172.21.15.52:0/4058924135 learned_addr learned my addr 172.21.15.52:0/4058924135 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b920760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b914b40 0x55ed7b913090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.214+0000 7f26e77fe640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 0x7f26e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 -- 172.21.15.52:0/4058924135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b914b40 msgr2=0x55ed7b913090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 0x7f26e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b914b40 0x55ed7b913090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 -- 172.21.15.52:0/4058924135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 msgr2=0x55ed7b920760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b920760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 -- 172.21.15.52:0/4058924135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7b8053a0 con 0x55ed7b9135d0 2024-09-19T09:23:14.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b920760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26e77fe640 1 -- 172.21.15.52:0/1677442227 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26e80f1060 con 0x7f26f8101df0 2024-09-19T09:23:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f659c640 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f26e80813f0 tx=0x7f26e8030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf4f0f3a01d0083 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26e4ff9640 1 -- 172.21.15.52:0/4058924135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b9070 con 0x55ed7b9135d0 2024-09-19T09:23:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 0x7f26e00a5780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009bc0 tx=0x7f26f0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26e4ff9640 1 -- 172.21.15.52:0/4058924135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e8036070 con 0x55ed7b9135d0 2024-09-19T09:23:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.215+0000 7f26e4ff9640 1 -- 172.21.15.52:0/4058924135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80098d0 con 0x55ed7b9135d0 2024-09-19T09:23:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- 172.21.15.52:0/4058924135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 msgr2=0x55ed7b913a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f26e80813f0 tx=0x7f26e8030c30 comp rx=0 tx=0).stop 2024-09-19T09:23:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- 172.21.15.52:0/4058924135 shutdown_connections 2024-09-19T09:23:14.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b920760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b913a10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 --2- 172.21.15.52:0/4058924135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b914b40 0x55ed7b913090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- 172.21.15.52:0/4058924135 >> 172.21.15.52:0/4058924135 conn(0x55ed7b8dc310 msgr2=0x55ed7b90fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- 172.21.15.52:0/4058924135 shutdown_connections 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- 172.21.15.52:0/4058924135 wait complete. 2024-09-19T09:23:14.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.216+0000 7f26ff11c740 1 -- start start 2024-09-19T09:23:14.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 Processor -- start 2024-09-19T09:23:14.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b91afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b91e370 0x55ed7b91b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b820cf0 con 0x55ed7b9135d0 2024-09-19T09:23:14.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b834060 con 0x55ed7b914b40 2024-09-19T09:23:14.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ed7b8792f0 con 0x55ed7b91e370 2024-09-19T09:23:14.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26ff11c740 10 client.0 _ll_register_callbacks cb 0x55ed7b5878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:14.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35068/0 (socket says 172.21.15.52:35068) 2024-09-19T09:23:14.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 -- 172.21.15.52:0/2653899646 learned_addr learned my addr 172.21.15.52:0/2653899646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:14.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b91afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b91e370 0x55ed7b91b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 -- 172.21.15.52:0/2653899646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b91e370 msgr2=0x55ed7b91b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b91e370 0x55ed7b91b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 -- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 msgr2=0x55ed7b91afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b91afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.217+0000 7f26f659c640 1 -- 172.21.15.52:0/2653899646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7b5ea3c0 con 0x55ed7b9135d0 2024-09-19T09:23:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26f659c640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f26e802a900 tx=0x7f26e80383a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfd20bcb2efa1d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b9040 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26e80b9490 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26e8036070 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26e80bd3d0 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 10 client.16095 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ed7b930990 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e8036070 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26e8043330 con 0x55ed7b9135d0 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 10 client.16095 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 10 client.16095 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 20 client.16095 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:14.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b931da0 0x55ed7b9341b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 4 client.16095 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.218+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed7b886860 con 0x55ed7b931da0 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.219+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b931da0 0x55ed7b9341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.219+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b931da0 0x55ed7b9341b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9a7f6473d96e4dc server_cookie=6b7601f7f3203029 in_seq=0 out_seq=0 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.219+0000 7f26ddffb640 10 client.16095 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ddffb640 1 -- 172.21.15.52:0/2653899646 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed7b886860 con 0x55ed7b931da0 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ddffb640 10 client.16095 handle_command_reply: tid=0 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 client.16095 shutdown 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 msgr2=0x55ed7b91dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f26e802a900 tx=0x7f26e80383a0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 shutdown_connections 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b91e370 0x55ed7b91b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b931da0 0x55ed7b9341b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b91afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 --2- 172.21.15.52:0/2653899646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b9135d0 0x55ed7b91dd20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 >> 172.21.15.52:0/2653899646 conn(0x55ed7b8dc310 msgr2=0x55ed7b915990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ddffb640 0 client.16095 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 shutdown_connections 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 1 -- 172.21.15.52:0/2653899646 wait complete. 2024-09-19T09:23:14.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.220+0000 7f26ff11c740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T09:23:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.233+0000 7f26ff11c740 1 Processor -- start 2024-09-19T09:23:14.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.233+0000 7f26ff11c740 1 -- start start 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.233+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b90ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.233+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b90f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26ff11c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81adce0 con 0x55ed7b91e370 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26ff11c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81ab5b0 con 0x55ed7b914b40 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26ff11c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81a93e0 con 0x55ed7b9135d0 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35078/0 (socket says 172.21.15.52:35078) 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 -- 172.21.15.52:0/1669574233 learned_addr learned my addr 172.21.15.52:0/1669574233 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:14.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b90f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 -- 172.21.15.52:0/1669574233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 msgr2=0x55ed7b90ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b90ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 -- 172.21.15.52:0/1669574233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 msgr2=0x55ed7b90f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b90f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 -- 172.21.15.52:0/1669574233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7b914750 con 0x55ed7b91e370 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f26f0012df0 tx=0x7f26f0009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46fc40a39a27ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26dffff640 1 -- 172.21.15.52:0/1669574233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0023430 con 0x55ed7b91e370 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26dffff640 1 -- 172.21.15.52:0/1669574233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26f0028070 con 0x55ed7b91e370 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.234+0000 7f26dffff640 1 -- 172.21.15.52:0/1669574233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00228f0 con 0x55ed7b91e370 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- 172.21.15.52:0/1669574233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 msgr2=0x55ed7b916120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f26f0012df0 tx=0x7f26f0009470 comp rx=0 tx=0).stop 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- 172.21.15.52:0/1669574233 shutdown_connections 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b91e370 0x55ed7b916120 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b914b40 0x55ed7b90f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1669574233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b90ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- 172.21.15.52:0/1669574233 >> 172.21.15.52:0/1669574233 conn(0x55ed7b8dc310 msgr2=0x55ed7b90e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- 172.21.15.52:0/1669574233 shutdown_connections 2024-09-19T09:23:14.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- 172.21.15.52:0/1669574233 wait complete. 2024-09-19T09:23:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.235+0000 7f26ff11c740 1 -- start start 2024-09-19T09:23:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 Processor -- start 2024-09-19T09:23:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b926210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b926c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81a9a70 con 0x55ed7b914b40 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81aaee0 con 0x55ed7b91e370 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81aa140 con 0x55ed7b9135d0 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26ff11c740 10 client.0 _ll_register_callbacks cb 0x7f26ec00b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35092/0 (socket says 172.21.15.52:35092) 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 -- 172.21.15.52:0/1451733233 learned_addr learned my addr 172.21.15.52:0/1451733233 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f6d9d640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b926c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f659c640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b926210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 -- 172.21.15.52:0/1451733233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 msgr2=0x55ed7b926210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b926210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 -- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 msgr2=0x55ed7b926c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b926c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f5d9b640 1 -- 172.21.15.52:0/1451733233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7b99bbc0 con 0x55ed7b914b40 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.236+0000 7f26f659c640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b926210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26f5d9b640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55ed7b914070 tx=0x7f26ec00f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df30bb19f3d7d8f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec01c840 con 0x55ed7b914b40 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26ec01c9e0 con 0x55ed7b914b40 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26f0028070 con 0x55ed7b914b40 2024-09-19T09:23:14.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26ec02c050 con 0x55ed7b914b40 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 10 client.16101 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ed7b99cf10 con 0x55ed7b914b40 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26f0028070 con 0x55ed7b914b40 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26ec01b390 con 0x55ed7b914b40 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 10 client.16101 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 10 client.16101 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 20 client.16101 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b99d670 0x55ed7b99fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 4 client.16101 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.237+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed7b880d70 con 0x55ed7b99d670 2024-09-19T09:23:14.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26f659c640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b99d670 0x55ed7b99fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ddffb640 10 client.16101 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26f659c640 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b99d670 0x55ed7b99fa90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=305c0312902c0fc0 server_cookie=ba030a5d5334f90 in_seq=0 out_seq=0 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ddffb640 1 -- 172.21.15.52:0/1451733233 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed7b880d70 con 0x55ed7b99d670 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ddffb640 10 client.16101 handle_command_reply: tid=0 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 client.16101 shutdown 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 msgr2=0x55ed7b926750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55ed7b914070 tx=0x7f26ec00f8b0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 shutdown_connections 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ed7b99d670 0x55ed7b99fa90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ed7b91e370 0x55ed7b926c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ed7b914b40 0x55ed7b926750 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 --2- 172.21.15.52:0/1451733233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ed7b9135d0 0x55ed7b926210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 >> 172.21.15.52:0/1451733233 conn(0x55ed7b8dc310 msgr2=0x55ed7b90ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.238+0000 7f26ddffb640 0 client.16101 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 shutdown_connections 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26ff11c740 1 -- 172.21.15.52:0/1451733233 wait complete. 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26ff11c740 20 client.16101 trim_cache size 0 max 16384 2024-09-19T09:23:14.254 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 msgr2=0x7f26e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 0x7f26e00a5780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009bc0 tx=0x7f26f0008040 comp rx=0 tx=0).stop 2024-09-19T09:23:14.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 msgr2=0x7f26f81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097b0 tx=0x7f26e8031b10 comp rx=0 tx=0).stop 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 shutdown_connections 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26f8106f20 0x7f26f819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26e00a32c0 0x7f26e00a5780 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26f81027a0 0x7f26f81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 --2- 172.21.15.52:0/1677442227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f8101df0 0x7f26f81983a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 >> 172.21.15.52:0/1677442227 conn(0x7f26f80fd8b0 msgr2=0x7f26f80ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 shutdown_connections 2024-09-19T09:23:14.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:14.239+0000 7f26fcd43640 1 -- 172.21.15.52:0/1677442227 wait complete. 2024-09-19T09:23:14.936 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:23:15.196 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:15 smithi052 ceph-mon[30947]: pgmap v392: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:15 smithi169 ceph-mon[35454]: pgmap v392: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:15 smithi086 ceph-mon[34813]: pgmap v392: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 -- 172.21.15.52:0/2285515649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8102790 msgr2=0x7fa6d81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/2285515649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8102790 0x7fa6d81067e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009900 tx=0x7fa6cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 -- 172.21.15.52:0/2285515649 shutdown_connections 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/2285515649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8106f10 0x7fa6d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/2285515649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8102790 0x7fa6d81067e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/2285515649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8101de0 0x7fa6d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 -- 172.21.15.52:0/2285515649 >> 172.21.15.52:0/2285515649 conn(0x7fa6d80fd8c0 msgr2=0x7fa6d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 -- 172.21.15.52:0/2285515649 shutdown_connections 2024-09-19T09:23:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.659+0000 7fa6ddc66640 1 -- 172.21.15.52:0/2285515649 wait complete. 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 Processor -- start 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 -- start start 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8102790 0x7fa6d8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8106f10 0x7fa6d819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8111f30 con 0x7fa6d8101de0 2024-09-19T09:23:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d8111db0 con 0x7fa6d8106f10 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6ddc66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81120b0 con 0x7fa6d8102790 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35116/0 (socket says 172.21.15.52:35116) 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.660+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3544723180 learned_addr learned my addr 172.21.15.52:0/3544723180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8102790 0x7fa6d8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8106f10 0x7fa6d819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3544723180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8102790 msgr2=0x7fa6d8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8102790 0x7fa6d8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3544723180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8106f10 msgr2=0x7fa6d819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8106f10 0x7fa6d819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3544723180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d819d4c0 con 0x7fa6d8101de0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800d950 tx=0x7fa6c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d4ff9640 1 -- 172.21.15.52:0/3544723180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8017070 con 0x7fa6d8101de0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d819d7b0 con 0x7fa6d8101de0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d4ff9640 1 -- 172.21.15.52:0/3544723180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8009c30 con 0x7fa6d8101de0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6d4ff9640 1 -- 172.21.15.52:0/3544723180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800f6b0 con 0x7fa6d8101de0 2024-09-19T09:23:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.661+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d81a5090 con 0x7fa6d8101de0 2024-09-19T09:23:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6d4ff9640 1 -- 172.21.15.52:0/3544723180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa6c80109d0 con 0x7fa6d8101de0 2024-09-19T09:23:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 Processor -- start 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 -- start start 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af762422f0 con 0x55af762dc5d0 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55af761e9cf0 con 0x55af762e7370 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6e003f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af7623e2b0 con 0x55af762ddb40 2024-09-19T09:23:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35132/0 (socket says 172.21.15.52:35132) 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.664+0000 7fa6d77fe640 1 -- 172.21.15.52:0/1369764648 learned_addr learned my addr 172.21.15.52:0/1369764648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d4ff9640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 0x7fa6c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 0x7fa6c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 -- 172.21.15.52:0/1369764648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 msgr2=0x55af762dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 -- 172.21.15.52:0/1369764648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 msgr2=0x55af762e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 -- 172.21.15.52:0/1369764648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af761ce3a0 con 0x55af762dc5d0 2024-09-19T09:23:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d4ff9640 1 -- 172.21.15.52:0/3544723180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa6c80cf550 con 0x7fa6d8101de0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa6c809bb30 tx=0x7fa6c8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89c443bb418e5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 0x7fa6c00a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a2c0 tx=0x7fa6d0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6bdffb640 1 -- 172.21.15.52:0/1369764648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801e9f0 con 0x55af762dc5d0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6bdffb640 1 -- 172.21.15.52:0/1369764648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8009de0 con 0x55af762dc5d0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.665+0000 7fa6bdffb640 1 -- 172.21.15.52:0/1369764648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801f760 con 0x55af762dc5d0 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- 172.21.15.52:0/1369764648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 msgr2=0x55af762dca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa6c809bb30 tx=0x7fa6c8022000 comp rx=0 tx=0).stop 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- 172.21.15.52:0/1369764648 shutdown_connections 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762dca10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 --2- 172.21.15.52:0/1369764648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- 172.21.15.52:0/1369764648 >> 172.21.15.52:0/1369764648 conn(0x55af762a5310 msgr2=0x55af762d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- 172.21.15.52:0/1369764648 shutdown_connections 2024-09-19T09:23:15.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- 172.21.15.52:0/1369764648 wait complete. 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.666+0000 7fa6e003f740 1 -- start start 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 Processor -- start 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af762e9fb0 con 0x55af762dc5d0 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55af761fd060 con 0x55af762e7370 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af762ea130 con 0x55af762ddb40 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6e003f740 10 client.0 _ll_register_callbacks cb 0x55af75f508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35142/0 (socket says 172.21.15.52:35142) 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3207993368 learned_addr learned my addr 172.21.15.52:0/3207993368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:15.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3207993368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 msgr2=0x55af762e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 msgr2=0x55af762e45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d77fe640 1 -- 172.21.15.52:0/3207993368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af75fb33c0 con 0x55af762dc5d0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.667+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8098000 tx=0x7fa6c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db625174ba21f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c801e7b0 con 0x55af762dc5d0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa6c8086110 con 0x55af762dc5d0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c8009de0 con 0x55af762dc5d0 2024-09-19T09:23:15.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6c80a4760 con 0x55af762dc5d0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 10 client.16113 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af762f5a20 con 0x55af762dc5d0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c8009de0 con 0x55af762dc5d0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c80cf0f0 con 0x55af762dc5d0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 10 client.16113 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 20 client.16113 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762f6d70 0x55af762f9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 4 client.16113 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.668+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af7624f860 con 0x55af762f6d70 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.669+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762f6d70 0x55af762f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.669+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762f6d70 0x55af762f9160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69cbb983d4d39f46 server_cookie=415dc1b5df3b289c in_seq=0 out_seq=0 2024-09-19T09:23:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.669+0000 7fa6b6ffd640 10 client.16113 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/3207993368 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af7624f860 con 0x55af762f6d70 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6b6ffd640 10 client.16113 handle_command_reply: tid=0 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 client.16113 shutdown 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 msgr2=0x55af762e6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8098000 tx=0x7fa6c8005880 comp rx=0 tx=0).stop 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 shutdown_connections 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762f6d70 0x55af762f9160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762e7370 0x55af762e45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762ddb40 0x55af762e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 --2- 172.21.15.52:0/3207993368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e6d40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6b6ffd640 0 client.16113 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:15.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 >> 172.21.15.52:0/3207993368 conn(0x55af762a5310 msgr2=0x55af762de990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 shutdown_connections 2024-09-19T09:23:15.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 1 -- 172.21.15.52:0/3207993368 wait complete. 2024-09-19T09:23:15.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.670+0000 7fa6e003f740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T09:23:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.683+0000 7fa6e003f740 1 Processor -- start 2024-09-19T09:23:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.683+0000 7fa6e003f740 1 -- start start 2024-09-19T09:23:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.683+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af762e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6e003f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81aff60 con 0x55af762dc5d0 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6e003f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81ad830 con 0x55af762ddb40 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6e003f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81ab680 con 0x55af762e7370 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35152/0 (socket says 172.21.15.52:35152) 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 -- 172.21.15.52:0/248058536 learned_addr learned my addr 172.21.15.52:0/248058536 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af762e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 -- 172.21.15.52:0/248058536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 msgr2=0x55af762fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 -- 172.21.15.52:0/248058536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 msgr2=0x55af762e2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af762e2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 -- 172.21.15.52:0/248058536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af762d8de0 con 0x55af762dc5d0 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af762e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80a4920 tx=0x7fa6c809a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f4da2cee6d77cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6bd7fa640 1 -- 172.21.15.52:0/248058536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c809fea0 con 0x55af762dc5d0 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6bd7fa640 1 -- 172.21.15.52:0/248058536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c80cf0f0 con 0x55af762dc5d0 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.684+0000 7fa6bd7fa640 1 -- 172.21.15.52:0/248058536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80860b0 con 0x55af762dc5d0 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- 172.21.15.52:0/248058536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 msgr2=0x55af762e38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80a4920 tx=0x7fa6c809a0b0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- 172.21.15.52:0/248058536 shutdown_connections 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af762e2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 --2- 172.21.15.52:0/248058536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af762e38b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- 172.21.15.52:0/248058536 >> 172.21.15.52:0/248058536 conn(0x55af762a5310 msgr2=0x55af762e28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- 172.21.15.52:0/248058536 shutdown_connections 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- 172.21.15.52:0/248058536 wait complete. 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 -- start start 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.685+0000 7fa6e003f740 1 Processor -- start 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af76359de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81abcf0 con 0x55af762dc5d0 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81ad160 con 0x55af762ddb40 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d81ac3c0 con 0x55af762e7370 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6e003f740 10 client.0 _ll_register_callbacks cb 0x7fa6cc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35164/0 (socket says 172.21.15.52:35164) 2024-09-19T09:23:15.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 -- 172.21.15.52:0/2565467861 learned_addr learned my addr 172.21.15.52:0/2565467861 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af76359de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 -- 172.21.15.52:0/2565467861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 msgr2=0x55af762fadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 -- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 msgr2=0x55af76359de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af76359de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 -- 172.21.15.52:0/2565467861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af762e70b0 con 0x55af762dc5d0 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af76359de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d7fff640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6d77fe640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa6c809bb30 tx=0x7fa6c800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53af3d0f5ce7f16b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.686+0000 7fa6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c809fea0 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa6c809b090 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c80cf0f0 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8098210 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 10 client.16119 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af762e70b0 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c80cf0f0 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c80104f0 con 0x55af762dc5d0 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 10 client.16119 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 20 client.16119 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762fc480 0x55af76367ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 4 client.16119 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55af76249d70 con 0x55af762fc480 2024-09-19T09:23:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.687+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762fc480 0x55af76367ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6d6ffd640 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762fc480 0x55af76367ac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d10e5d9cc81c0f4 server_cookie=2c093e31f58040ec in_seq=0 out_seq=0 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6b6ffd640 10 client.16119 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6b6ffd640 1 -- 172.21.15.52:0/2565467861 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55af76249d70 con 0x55af762fc480 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6b6ffd640 10 client.16119 handle_command_reply: tid=0 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 client.16119 shutdown 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 msgr2=0x55af763598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fa6c809bb30 tx=0x7fa6c800bf60 comp rx=0 tx=0).stop 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 shutdown_connections 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af762fc480 0x55af76367ac0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af762e7370 0x55af762fadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af762ddb40 0x55af76359de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 --2- 172.21.15.52:0/2565467861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af762dc5d0 0x55af763598a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 >> 172.21.15.52:0/2565467861 conn(0x55af762a5310 msgr2=0x55af762d7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6b6ffd640 0 client.16119 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 shutdown_connections 2024-09-19T09:23:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 1 -- 172.21.15.52:0/2565467861 wait complete. 2024-09-19T09:23:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.688+0000 7fa6e003f740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T09:23:15.696 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 msgr2=0x7fa6c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 0x7fa6c00a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a2c0 tx=0x7fa6d0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 msgr2=0x7fa6d8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800d950 tx=0x7fa6c800de10 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 shutdown_connections 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6d8106f10 0x7fa6d819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6c00a3240 0x7fa6c00a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6d8102790 0x7fa6d8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 --2- 172.21.15.52:0/3544723180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8101de0 0x7fa6d8198510 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 >> 172.21.15.52:0/3544723180 conn(0x7fa6d80fd8c0 msgr2=0x7fa6d80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:15.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 shutdown_connections 2024-09-19T09:23:15.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:15.689+0000 7fa6ddc66640 1 -- 172.21.15.52:0/3544723180 wait complete. 2024-09-19T09:23:17.413 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:23:17.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:23:17.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:17 smithi052 ceph-mon[30947]: pgmap v393: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:23:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:17 smithi169 ceph-mon[35454]: pgmap v393: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:23:17.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:17 smithi086 ceph-mon[34813]: pgmap v393: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:23:17.684 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 -- 172.21.15.52:0/3533193199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c101450 msgr2=0x7fce1c105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 --2- 172.21.15.52:0/3533193199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c101450 0x7fce1c105920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009900 tx=0x7fce0c02a470 comp rx=0 tx=0).stop 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 -- 172.21.15.52:0/3533193199 shutdown_connections 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 --2- 172.21.15.52:0/3533193199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c105f40 0x7fce1c1063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 --2- 172.21.15.52:0/3533193199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c101450 0x7fce1c105920 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 --2- 172.21.15.52:0/3533193199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c100b30 0x7fce1c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.185+0000 7fce2424e640 1 -- 172.21.15.52:0/3533193199 >> 172.21.15.52:0/3533193199 conn(0x7fce1c0fc7a0 msgr2=0x7fce1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- 172.21.15.52:0/3533193199 shutdown_connections 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- 172.21.15.52:0/3533193199 wait complete. 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 Processor -- start 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- start start 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 0x7fce1c1a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c105f40 0x7fce1c19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c118640 con 0x7fce1c100b30 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1184c0 con 0x7fce1c101450 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.186+0000 7fce2424e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1187c0 con 0x7fce1c105f40 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41322/0 (socket says 172.21.15.52:41322) 2024-09-19T09:23:18.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 -- 172.21.15.52:0/993968335 learned_addr learned my addr 172.21.15.52:0/993968335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce217e9640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 0x7fce1c1a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce227eb640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c105f40 0x7fce1c19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 -- 172.21.15.52:0/993968335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c105f40 msgr2=0x7fce1c19e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c105f40 0x7fce1c19e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 -- 172.21.15.52:0/993968335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 msgr2=0x7fce1c1a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 0x7fce1c1a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 -- 172.21.15.52:0/993968335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c19f100 con 0x7fce1c100b30 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce217e9640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 0x7fce1c1a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce21fea640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b4a0 tx=0x7fce1800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce12ffd640 1 -- 172.21.15.52:0/993968335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18014070 con 0x7fce1c100b30 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce12ffd640 1 -- 172.21.15.52:0/993968335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce18010af0 con 0x7fce1c100b30 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c19f3f0 con 0x7fce1c100b30 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce12ffd640 1 -- 172.21.15.52:0/993968335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017d10 con 0x7fce1c100b30 2024-09-19T09:23:18.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.187+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c1ab6e0 con 0x7fce1c100b30 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.189+0000 7fce12ffd640 1 -- 172.21.15.52:0/993968335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce18017070 con 0x7fce1c100b30 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 Processor -- start 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 -- start start 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b370cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b371a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5b3672280 con 0x55b5b370d480 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b5b3619b10 con 0x55b5b370cb60 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce26627740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5b366e240 con 0x55b5b3717d40 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce12ffd640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 0x7fce080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41330/0 (socket says 172.21.15.52:41330) 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.190+0000 7fce21fea640 1 -- 172.21.15.52:0/1967330813 learned_addr learned my addr 172.21.15.52:0/1967330813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce227eb640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 0x7fce080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce227eb640 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b370cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce217e9640 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b371a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce12ffd640 1 -- 172.21.15.52:0/993968335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce180ced90 con 0x7fce1c100b30 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 -- 172.21.15.52:0/1967330813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 msgr2=0x55b5b371a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b371a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 -- 172.21.15.52:0/1967330813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 msgr2=0x55b5b370cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b370cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 -- 172.21.15.52:0/1967330813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b36261f0 con 0x55b5b370d480 2024-09-19T09:23:18.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce21fea640 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce180a3a10 tx=0x7fce180047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72653d4a5fa2949f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce227eb640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 0x7fce080a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce14009fd0 tx=0x7fce14009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce07fff640 1 -- 172.21.15.52:0/1967330813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1801e070 con 0x55b5b370d480 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce07fff640 1 -- 172.21.15.52:0/1967330813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce180d0070 con 0x55b5b370d480 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.191+0000 7fce07fff640 1 -- 172.21.15.52:0/1967330813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017360 con 0x55b5b370d480 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 -- 172.21.15.52:0/1967330813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 msgr2=0x55b5b3717800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fce180a3a10 tx=0x7fce180047d0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 -- 172.21.15.52:0/1967330813 shutdown_connections 2024-09-19T09:23:18.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b371a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b3717800 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 --2- 172.21.15.52:0/1967330813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b370cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 -- 172.21.15.52:0/1967330813 >> 172.21.15.52:0/1967330813 conn(0x55b5b37090f0 msgr2=0x55b5b37094d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 -- 172.21.15.52:0/1967330813 shutdown_connections 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.192+0000 7fce26627740 1 -- 172.21.15.52:0/1967330813 wait complete. 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 -- start start 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 Processor -- start 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 0x55b5b3715200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b3717d40 0x55b5b3715740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5b371a910 con 0x55b5b370cb60 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b5b362cf10 con 0x55b5b3717d40 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5b371aa90 con 0x55b5b370d480 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce26627740 10 client.0 _ll_register_callbacks cb 0x55b5b35f5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41334/0 (socket says 172.21.15.52:41334) 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce21fea640 1 -- 172.21.15.52:0/1142127180 learned_addr learned my addr 172.21.15.52:0/1142127180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce227eb640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b3717d40 0x55b5b3715740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.193+0000 7fce217e9640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 0x55b5b3715200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 -- 172.21.15.52:0/1142127180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 msgr2=0x55b5b3715200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 0x55b5b3715200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 -- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b3717d40 msgr2=0x55b5b3715740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b3717d40 0x55b5b3715740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 -- 172.21.15.52:0/1142127180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b33e36a0 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce217e9640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 0x55b5b3715200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce21fea640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce180cf080 tx=0x7fce180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a958b08958bf20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1801e070 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce180995d0 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce180d0070 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce1809f440 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce26627740 10 client.16131 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5b37265c0 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce180d0070 con 0x55b5b370cb60 2024-09-19T09:23:18.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce180bb0b0 con 0x55b5b370cb60 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce26627740 10 client.16131 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.194+0000 7fce26627740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce26627740 20 client.16131 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3727910 0x55b5b3729d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce26627740 4 client.16131 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b367f7f0 con 0x55b5b3727910 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce217e9640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3727910 0x55b5b3729d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce217e9640 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3727910 0x55b5b3729d00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ad13e5393617e44 server_cookie=15b1c8f03f3b161 in_seq=0 out_seq=0 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.195+0000 7fce057fa640 10 client.16131 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce057fa640 1 -- 172.21.15.52:0/1142127180 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5b367f7f0 con 0x55b5b3727910 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce057fa640 10 client.16131 handle_command_reply: tid=0 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 client.16131 shutdown 2024-09-19T09:23:18.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 msgr2=0x55b5b3714cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fce180cf080 tx=0x7fce180046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 shutdown_connections 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3727910 0x55b5b3729d00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b3717d40 0x55b5b3715740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b370d480 0x55b5b3715200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce057fa640 0 client.16131 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 --2- 172.21.15.52:0/1142127180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b3714cc0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 >> 172.21.15.52:0/1142127180 conn(0x55b5b37090f0 msgr2=0x55b5b370ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.196+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 shutdown_connections 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.197+0000 7fce26627740 1 -- 172.21.15.52:0/1142127180 wait complete. 2024-09-19T09:23:18.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.197+0000 7fce26627740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 Processor -- start 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 -- start start 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370d480 0x55b5b372d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3711f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b67e0 con 0x55b5b370cb60 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b40b0 con 0x55b5b370d480 2024-09-19T09:23:18.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce26627740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b1f00 con 0x55b5b3717d40 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41338/0 (socket says 172.21.15.52:41338) 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 -- 172.21.15.52:0/1116575893 learned_addr learned my addr 172.21.15.52:0/1116575893 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 -- 172.21.15.52:0/1116575893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 msgr2=0x55b5b3711f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3711f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 -- 172.21.15.52:0/1116575893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370d480 msgr2=0x55b5b372d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.214+0000 7fce21fea640 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370d480 0x55b5b372d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce21fea640 1 -- 172.21.15.52:0/1116575893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b370d2b0 con 0x55b5b370cb60 2024-09-19T09:23:18.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce21fea640 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce1809b260 tx=0x7fce1809a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15d4ebf644732eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce077fe640 1 -- 172.21.15.52:0/1116575893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1801e070 con 0x55b5b370cb60 2024-09-19T09:23:18.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce077fe640 1 -- 172.21.15.52:0/1116575893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1809b9d0 con 0x55b5b370cb60 2024-09-19T09:23:18.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce077fe640 1 -- 172.21.15.52:0/1116575893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180b4240 con 0x55b5b370cb60 2024-09-19T09:23:18.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce26627740 1 -- 172.21.15.52:0/1116575893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 msgr2=0x55b5b372cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.215+0000 7fce26627740 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fce1809b260 tx=0x7fce1809a8d0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 -- 172.21.15.52:0/1116575893 shutdown_connections 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3711f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370d480 0x55b5b372d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 --2- 172.21.15.52:0/1116575893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370cb60 0x55b5b372cd20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 -- 172.21.15.52:0/1116575893 >> 172.21.15.52:0/1116575893 conn(0x55b5b37090f0 msgr2=0x55b5b3723500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 -- 172.21.15.52:0/1116575893 shutdown_connections 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 -- 172.21.15.52:0/1116575893 wait complete. 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 -- start start 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.216+0000 7fce26627740 1 Processor -- start 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b372add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3791250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b2570 con 0x55b5b370d480 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b39e0 con 0x55b5b370cb60 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c1b2c40 con 0x55b5b3717d40 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce26627740 10 client.0 _ll_register_callbacks cb 0x7fce1400a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41350/0 (socket says 172.21.15.52:41350) 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 -- 172.21.15.52:0/1304478928 learned_addr learned my addr 172.21.15.52:0/1304478928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce227eb640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3791250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce21fea640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b372add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 -- 172.21.15.52:0/1304478928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 msgr2=0x55b5b3791250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3791250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 -- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 msgr2=0x55b5b372add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b372add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 -- 172.21.15.52:0/1304478928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b372bba0 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce227eb640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3791250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce21fea640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b372add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce217e9640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce0c02a990 tx=0x7fce0c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36892f6bf725a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce057fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c048070 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.217+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce0c005020 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce1809b9d0 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce0c053050 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 10 client.16137 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5b37928d0 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce1809b9d0 con 0x55b5b370d480 2024-09-19T09:23:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce0c0035f0 con 0x55b5b370d480 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 10 client.16137 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 20 client.16137 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3793080 0x55b5b37954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 4 client.16137 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b5b3679d00 con 0x55b5b3793080 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.218+0000 7fce21fea640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3793080 0x55b5b37954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.219+0000 7fce21fea640 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3793080 0x55b5b37954a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0554fa4806deb4c server_cookie=1906672602a29e4e in_seq=0 out_seq=0 2024-09-19T09:23:18.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.219+0000 7fce057fa640 10 client.16137 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce057fa640 1 -- 172.21.15.52:0/1304478928 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b5b3679d00 con 0x55b5b3793080 2024-09-19T09:23:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce057fa640 10 client.16137 handle_command_reply: tid=0 2024-09-19T09:23:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 client.16137 shutdown 2024-09-19T09:23:18.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 msgr2=0x55b5b372b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fce0c02a990 tx=0x7fce0c031a50 comp rx=0 tx=0).stop 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 shutdown_connections 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5b3793080 0x55b5b37954a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5b3717d40 0x55b5b3791250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5b370d480 0x55b5b372b310 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 --2- 172.21.15.52:0/1304478928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5b370cb60 0x55b5b372add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 >> 172.21.15.52:0/1304478928 conn(0x55b5b37090f0 msgr2=0x55b5b3722ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce057fa640 0 client.16137 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 shutdown_connections 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 1 -- 172.21.15.52:0/1304478928 wait complete. 2024-09-19T09:23:18.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.220+0000 7fce26627740 20 client.16137 trim_cache size 0 max 16384 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "d166e840-3e95-4894-bca0-919bcb49b1bf", 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:18.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 msgr2=0x7fce080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 0x7fce080a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fce14009fd0 tx=0x7fce14009d80 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 msgr2=0x7fce1c1a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b4a0 tx=0x7fce1800b960 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 shutdown_connections 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce080a32c0 0x7fce080a5780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce1c105f40 0x7fce1c19e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce1c101450 0x7fce1c1a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 --2- 172.21.15.52:0/993968335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce1c100b30 0x7fce1c1a4810 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 >> 172.21.15.52:0/993968335 conn(0x7fce1c0fc7a0 msgr2=0x7fce1c10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 shutdown_connections 2024-09-19T09:23:18.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:18.221+0000 7fce2424e640 1 -- 172.21.15.52:0/993968335 wait complete. 2024-09-19T09:23:18.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 -- 172.21.15.52:0/592451168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac104ef0 msgr2=0x7fa1ac1072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/592451168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac1072e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa194009900 tx=0x7fa19402a410 comp rx=0 tx=0).stop 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 -- 172.21.15.52:0/592451168 shutdown_connections 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/592451168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/592451168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac1072e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/592451168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 -- 172.21.15.52:0/592451168 >> 172.21.15.52:0/592451168 conn(0x7fa1ac0fc1e0 msgr2=0x7fa1ac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 -- 172.21.15.52:0/592451168 shutdown_connections 2024-09-19T09:23:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.029+0000 7fa1b0a82640 1 -- 172.21.15.52:0/592451168 wait complete. 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 Processor -- start 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 -- start start 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10d7d0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10d650 con 0x7fa1ac107820 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1b0a82640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac10d950 con 0x7fa1ac104ef0 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41376/0 (socket says 172.21.15.52:41376) 2024-09-19T09:23:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 -- 172.21.15.52:0/4039450806 learned_addr learned my addr 172.21.15.52:0/4039450806 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 -- 172.21.15.52:0/4039450806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 msgr2=0x7fa1ac19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 -- 172.21.15.52:0/4039450806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 msgr2=0x7fa1ac1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.030+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1aa59c640 1 -- 172.21.15.52:0/4039450806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac1a1bf0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1a37fe640 1 -- 172.21.15.52:0/4039450806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c017070 con 0x7fa1ac1025c0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac1a1ee0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1a37fe640 1 -- 172.21.15.52:0/4039450806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa19c009c30 con 0x7fa1ac1025c0 2024-09-19T09:23:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1a37fe640 1 -- 172.21.15.52:0/4039450806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00f6b0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.031+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac1a2350 con 0x7fa1ac1025c0 2024-09-19T09:23:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.033+0000 7fa1b3821740 1 Processor -- start 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 -- start start 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1a37fe640 1 -- 172.21.15.52:0/4039450806 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa19c0109d0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a1317da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a131a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5632a12762f0 con 0x5632a13129a0 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5632a121e270 con 0x5632a1318370 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1b3821740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5632a12722b0 con 0x5632a13132e0 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41392/0 (socket says 172.21.15.52:41392) 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 -- 172.21.15.52:0/4010372210 learned_addr learned my addr 172.21.15.52:0/4010372210 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a1317da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a131a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 -- 172.21.15.52:0/4010372210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 msgr2=0x5632a1317da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a1317da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 -- 172.21.15.52:0/4010372210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 msgr2=0x5632a131a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a131a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 -- 172.21.15.52:0/4010372210 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a121d340 con 0x5632a13129a0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4008e30 tx=0x7fa1a400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a78f34b4bb026e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.034+0000 7fa1a37fe640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 0x7fa1980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.035+0000 7fa1a0ff9640 1 -- 172.21.15.52:0/4010372210 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400f830 con 0x5632a13129a0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.035+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 0x7fa1980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.035+0000 7fa1a37fe640 1 -- 172.21.15.52:0/4039450806 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa19c0cf9e0 con 0x7fa1ac1025c0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.035+0000 7fa1a0ff9640 1 -- 172.21.15.52:0/4010372210 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a4018480 con 0x5632a13129a0 2024-09-19T09:23:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.035+0000 7fa1a0ff9640 1 -- 172.21.15.52:0/4010372210 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400e5d0 con 0x5632a13129a0 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- 172.21.15.52:0/4010372210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 msgr2=0x5632a1312da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1aa59c640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 0x7fa1980a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5632a1313d10 tx=0x7fa19c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4008e30 tx=0x7fa1a400d710 comp rx=0 tx=0).stop 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- 172.21.15.52:0/4010372210 shutdown_connections 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a131a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a1317da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 --2- 172.21.15.52:0/4010372210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1312da0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- 172.21.15.52:0/4010372210 >> 172.21.15.52:0/4010372210 conn(0x5632a130e010 msgr2=0x5632a130e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- 172.21.15.52:0/4010372210 shutdown_connections 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- 172.21.15.52:0/4010372210 wait complete. 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 -- start start 2024-09-19T09:23:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.036+0000 7fa1b3821740 1 Processor -- start 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a131d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a1324170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5632a131b340 con 0x5632a13129a0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5632a11ff290 con 0x5632a1318370 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5632a131b4c0 con 0x5632a13132e0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1b3821740 10 client.0 _ll_register_callbacks cb 0x5632a1230140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41404/0 (socket says 172.21.15.52:41404) 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 -- 172.21.15.52:0/1700363784 learned_addr learned my addr 172.21.15.52:0/1700363784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a131d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a1324170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 -- 172.21.15.52:0/1700363784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 msgr2=0x5632a131d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a131d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 -- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 msgr2=0x5632a1324170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a1324170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 -- 172.21.15.52:0/1700363784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a0f89210 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4004fc0 tx=0x7fa1a4018ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46e3d9e9168b195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa191ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.037+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a401c070 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa1a400fa40 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1a4018480 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa1a4030050 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 10 client.16149 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5632a1055620 con 0x5632a13129a0 2024-09-19T09:23:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a4018480 con 0x5632a13129a0 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa1a400b3a0 con 0x5632a13129a0 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 10 client.16149 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 20 client.16149 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a1328530 0x5632a132a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 4 client.16149 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632a1283a20 con 0x5632a1328530 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.038+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a1328530 0x5632a132a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.039+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a1328530 0x5632a132a920 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3a713148d125a9b server_cookie=c32983eba884fd40 in_seq=0 out_seq=0 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.039+0000 7fa191ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.039+0000 7fa191ffb640 1 -- 172.21.15.52:0/1700363784 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632a1283a20 con 0x5632a1328530 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.039+0000 7fa191ffb640 10 client.16149 handle_command_reply: tid=0 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.039+0000 7fa1b3821740 1 client.16149 shutdown 2024-09-19T09:23:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 msgr2=0x5632a131cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4004fc0 tx=0x7fa1a4018ca0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 shutdown_connections 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a1328530 0x5632a132a920 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a1318370 0x5632a1324170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13132e0 0x5632a131d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 --2- 172.21.15.52:0/1700363784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a131cbf0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 >> 172.21.15.52:0/1700363784 conn(0x5632a130e010 msgr2=0x5632a130f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa191ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 shutdown_connections 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 1 -- 172.21.15.52:0/1700363784 wait complete. 2024-09-19T09:23:19.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.040+0000 7fa1b3821740 20 client.16149 trim_cache size 0 max 16384 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 Processor -- start 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 -- start start 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13129a0 0x5632a132abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1324130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1adc50 con 0x5632a1318370 2024-09-19T09:23:19.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1ab520 con 0x5632a13132e0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1b3821740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1a9370 con 0x5632a13129a0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41412/0 (socket says 172.21.15.52:41412) 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.054+0000 7fa1aad9d640 1 -- 172.21.15.52:0/2892392562 learned_addr learned my addr 172.21.15.52:0/2892392562 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1324130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13129a0 0x5632a132abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 -- 172.21.15.52:0/2892392562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13129a0 msgr2=0x5632a132abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13129a0 0x5632a132abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 -- 172.21.15.52:0/2892392562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 msgr2=0x5632a1324130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1324130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 -- 172.21.15.52:0/2892392562 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a130de30 con 0x5632a1318370 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400b7a0 tx=0x7fa1a401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ed4eff06060d53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.057 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa193fff640 1 -- 172.21.15.52:0/2892392562 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a401c070 con 0x5632a1318370 2024-09-19T09:23:19.058 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa193fff640 1 -- 172.21.15.52:0/2892392562 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a400bb10 con 0x5632a1318370 2024-09-19T09:23:19.058 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.055+0000 7fa193fff640 1 -- 172.21.15.52:0/2892392562 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a400b3a0 con 0x5632a1318370 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- 172.21.15.52:0/2892392562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 msgr2=0x5632a130d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400b7a0 tx=0x7fa1a401e040 comp rx=0 tx=0).stop 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- 172.21.15.52:0/2892392562 shutdown_connections 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a1318370 0x5632a130d0b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1324130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 --2- 172.21.15.52:0/2892392562 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a13129a0 0x5632a132abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- 172.21.15.52:0/2892392562 >> 172.21.15.52:0/2892392562 conn(0x5632a130e010 msgr2=0x5632a130c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- 172.21.15.52:0/2892392562 shutdown_connections 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- 172.21.15.52:0/2892392562 wait complete. 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 -- start start 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 Processor -- start 2024-09-19T09:23:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.056+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1321aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a1318370 0x5632a1322a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1a99e0 con 0x5632a13129a0 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1aae50 con 0x5632a13132e0 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1aa0b0 con 0x5632a1318370 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 10 client.0 _ll_register_callbacks cb 0x7fa1a4008c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41422/0 (socket says 172.21.15.52:41422) 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 -- 172.21.15.52:0/361796016 learned_addr learned my addr 172.21.15.52:0/361796016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1321aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 -- 172.21.15.52:0/361796016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a1318370 msgr2=0x5632a1322a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a1318370 0x5632a1322a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 -- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 msgr2=0x5632a1321aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1321aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 -- 172.21.15.52:0/361796016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a1323050 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1321aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1aad9d640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40088a0 tx=0x7fa1a4008d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7a84936d422c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa191ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a401c040 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa1a400b5a0 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1a400bb10 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa1a400fa50 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 10 client.16155 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.057+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5632a1324360 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1a400bb10 con 0x5632a13129a0 2024-09-19T09:23:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa1a4029860 con 0x5632a13129a0 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 10 client.16155 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 20 client.16155 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a13937b0 0x5632a1395bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 4 client.16155 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632a127dd70 con 0x5632a13937b0 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.058+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a13937b0 0x5632a1395bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.059+0000 7fa191ffb640 10 client.16155 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.059+0000 7fa1a9d9b640 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a13937b0 0x5632a1395bd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b12b1d00465859b server_cookie=67391cb410341a28 in_seq=0 out_seq=0 2024-09-19T09:23:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa191ffb640 1 -- 172.21.15.52:0/361796016 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632a127dd70 con 0x5632a13937b0 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa191ffb640 10 client.16155 handle_command_reply: tid=0 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 client.16155 shutdown 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 msgr2=0x5632a1321560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa1a40088a0 tx=0x7fa1a4008d80 comp rx=0 tx=0).stop 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 shutdown_connections 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5632a13937b0 0x5632a1395bd0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.068+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5632a1318370 0x5632a1322a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa191ffb640 0 client.16155 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5632a13132e0 0x5632a1321aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 1 --2- 172.21.15.52:0/361796016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5632a13129a0 0x5632a1321560 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 >> 172.21.15.52:0/361796016 conn(0x5632a130e010 msgr2=0x5632a130d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 shutdown_connections 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 1 -- 172.21.15.52:0/361796016 wait complete. 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b3821740 20 client.16155 trim_cache size 0 max 16384 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:23:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 msgr2=0x7fa1980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 0x7fa1980a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5632a1313d10 tx=0x7fa19c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 msgr2=0x7fa1ac199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00de10 comp rx=0 tx=0).stop 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 shutdown_connections 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1ac107820 0x7fa1ac1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1980a32f0 0x7fa1980a57b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa1ac104ef0 0x7fa1ac19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 --2- 172.21.15.52:0/4039450806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa1ac1025c0 0x7fa1ac199fd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 >> 172.21.15.52:0/4039450806 conn(0x7fa1ac0fc1e0 msgr2=0x7fa1ac101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 shutdown_connections 2024-09-19T09:23:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:19.069+0000 7fa1b0a82640 1 -- 172.21.15.52:0/4039450806 wait complete. 2024-09-19T09:23:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: pgmap v394: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:19.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:23:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:23:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:19 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:23:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: pgmap v394: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:23:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:23:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:19 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:23:19.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: pgmap v394: 97 pgs: 97 active+clean; 806 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T09:23:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:23:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:23:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:19 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:23:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 -- 172.21.15.52:0/2074726367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 msgr2=0x7f50bc10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 --2- 172.21.15.52:0/2074726367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc10bc00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f50a4009900 tx=0x7f50a402a410 comp rx=0 tx=0).stop 2024-09-19T09:23:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 -- 172.21.15.52:0/2074726367 shutdown_connections 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 --2- 172.21.15.52:0/2074726367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 0x7f50bc10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 --2- 172.21.15.52:0/2074726367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc10bc00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 --2- 172.21.15.52:0/2074726367 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 0x7f50bc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 -- 172.21.15.52:0/2074726367 >> 172.21.15.52:0/2074726367 conn(0x7f50bc0fc7d0 msgr2=0x7f50bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 -- 172.21.15.52:0/2074726367 shutdown_connections 2024-09-19T09:23:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.691+0000 7f50c28f7640 1 -- 172.21.15.52:0/2074726367 wait complete. 2024-09-19T09:23:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 Processor -- start 2024-09-19T09:23:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 -- start start 2024-09-19T09:23:19.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 0x7f50bc100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 0x7f50bc1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc112130 con 0x7f50bc1037a0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc111fb0 con 0x7f50bc102df0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50c28f7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1122b0 con 0x7f50bc10c2f0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41448/0 (socket says 172.21.15.52:41448) 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.692+0000 7f50b3fff640 1 -- 172.21.15.52:0/3316694535 learned_addr learned my addr 172.21.15.52:0/3316694535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50c0e94640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 0x7f50bc1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 0x7f50bc100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 -- 172.21.15.52:0/3316694535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 msgr2=0x7f50bc1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 0x7f50bc1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 -- 172.21.15.52:0/3316694535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 msgr2=0x7f50bc100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 0x7f50bc100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 -- 172.21.15.52:0/3316694535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc1a6af0 con 0x7f50bc1037a0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f50a4006010 tx=0x7f50a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b9ffb640 1 -- 172.21.15.52:0/3316694535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a403f030 con 0x7f50bc1037a0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b9ffb640 1 -- 172.21.15.52:0/3316694535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a4003ce0 con 0x7f50bc1037a0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc1a6d80 con 0x7f50bc1037a0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50b9ffb640 1 -- 172.21.15.52:0/3316694535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4035070 con 0x7f50bc1037a0 2024-09-19T09:23:19.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.693+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc1a7200 con 0x7f50bc1037a0 2024-09-19T09:23:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 Processor -- start 2024-09-19T09:23:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 -- start start 2024-09-19T09:23:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33ccd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33ccfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558d33c282e0 con 0x558d33cc2490 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558d33bcfce0 con 0x558d33cc2db0 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558d33c242a0 con 0x558d33ccd670 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c0e94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c0e94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41454/0 (socket says 172.21.15.52:41454) 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50c0e94640 1 -- 172.21.15.52:0/1896201132 learned_addr learned my addr 172.21.15.52:0/1896201132 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.696+0000 7f50b9ffb640 1 -- 172.21.15.52:0/3316694535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f50a4042030 con 0x7f50bc1037a0 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33ccd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 -- 172.21.15.52:0/1896201132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 msgr2=0x558d33ccfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33ccfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 -- 172.21.15.52:0/1896201132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 msgr2=0x558d33ccd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33ccd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 -- 172.21.15.52:0/1896201132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d33bb4440 con 0x558d33cc2490 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33ccd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50c0e94640 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007f40 tx=0x7f50b400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7c241e4c5eceaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50b27fc640 1 -- 172.21.15.52:0/1896201132 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4010900 con 0x558d33cc2490 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50b27fc640 1 -- 172.21.15.52:0/1896201132 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b40183f0 con 0x558d33cc2490 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50b27fc640 1 -- 172.21.15.52:0/1896201132 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4017600 con 0x558d33cc2490 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50b9ffb640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 0x7f50a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 0x7f50a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.697+0000 7f50b9ffb640 1 -- 172.21.15.52:0/3316694535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50a40ef790 con 0x7f50bc1037a0 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1896201132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 msgr2=0x558d33cc2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 0x7f50a80a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558d33cbf880 tx=0x7f50ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007f40 tx=0x7f50b400f850 comp rx=0 tx=0).stop 2024-09-19T09:23:19.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1896201132 shutdown_connections 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33ccfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33ccd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1896201132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33cc2870 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1896201132 >> 172.21.15.52:0/1896201132 conn(0x558d33cbea20 msgr2=0x558d33cbee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1896201132 shutdown_connections 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.698+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1896201132 wait complete. 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 -- start start 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 Processor -- start 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33cca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33cca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558d33cd0240 con 0x558d33cc2490 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558d33be3050 con 0x558d33cc2db0 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558d33cd03c0 con 0x558d33ccd670 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c4cd0740 10 client.0 _ll_register_callbacks cb 0x558d33c23160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41458/0 (socket says 172.21.15.52:41458) 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50bbfff640 1 -- 172.21.15.52:0/1024058940 learned_addr learned my addr 172.21.15.52:0/1024058940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33cca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.699+0000 7f50c0e94640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33cca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 -- 172.21.15.52:0/1024058940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 msgr2=0x558d33cca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33cca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 -- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 msgr2=0x558d33cca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33cca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 -- 172.21.15.52:0/1024058940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d339993c0 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0156c0 tx=0x7f50ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4117f4ba1720b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f509b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac025020 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50ac0144a0 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b40183f0 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50ac030050 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50c4cd0740 10 client.16167 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558d33cdbd60 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.700+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b40183f0 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f50ac021960 con 0x558d33cc2490 2024-09-19T09:23:19.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 10 client.16167 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 20 client.16167 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33cdd220 0x558d33cdf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 4 client.16167 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d33c35850 con 0x558d33cdd220 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33cdd220 0x558d33cdf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33cdd220 0x558d33cdf640 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=298417a2184768b6 server_cookie=63286943d78da5f7 in_seq=0 out_seq=0 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.701+0000 7f509b7fe640 10 client.16167 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f509b7fe640 1 -- 172.21.15.52:0/1024058940 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d33c35850 con 0x558d33cdd220 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f509b7fe640 10 client.16167 handle_command_reply: tid=0 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 client.16167 shutdown 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 msgr2=0x558d33ccd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0156c0 tx=0x7f50ac0046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 shutdown_connections 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33cdd220 0x558d33cdf640 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33ccd670 0x558d33cca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2db0 0x558d33cca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f509b7fe640 0 client.16167 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1024058940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2490 0x558d33ccd070 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 >> 172.21.15.52:0/1024058940 conn(0x558d33cbea20 msgr2=0x558d33cc4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.702+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 shutdown_connections 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.703+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1024058940 wait complete. 2024-09-19T09:23:19.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.703+0000 7f50c4cd0740 20 client.16167 trim_cache size 0 max 16384 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.719+0000 7f50c4cd0740 1 Processor -- start 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 -- start start 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 0x558d33cd9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33ccd670 0x558d33ce54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1b22f0 con 0x558d33cc2db0 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1afbc0 con 0x558d33ccd670 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1ada10 con 0x558d33cc2490 2024-09-19T09:23:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41460/0 (socket says 172.21.15.52:41460) 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 -- 172.21.15.52:0/1132534753 learned_addr learned my addr 172.21.15.52:0/1132534753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 0x558d33cd9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 -- 172.21.15.52:0/1132534753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 msgr2=0x558d33cd9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 0x558d33cd9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 -- 172.21.15.52:0/1132534753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33ccd670 msgr2=0x558d33ce54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33ccd670 0x558d33ce54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 -- 172.21.15.52:0/1132534753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d33cc92d0 con 0x558d33cc2db0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50bbfff640 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 0x558d33cd9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b3fff640 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ed580 tx=0x7f50a403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd53a89d497ac98b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.720+0000 7f50b1ffb640 1 -- 172.21.15.52:0/1132534753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a4049070 con 0x558d33cc2db0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50b1ffb640 1 -- 172.21.15.52:0/1132534753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a40bc430 con 0x558d33cc2db0 2024-09-19T09:23:19.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50b1ffb640 1 -- 172.21.15.52:0/1132534753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a40ba030 con 0x558d33cc2db0 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1132534753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 msgr2=0x558d33ce4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f50a40ed580 tx=0x7f50a403b6b0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1132534753 shutdown_connections 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33ccd670 0x558d33ce54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33cc2db0 0x558d33ce4f60 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/1132534753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2490 0x558d33cd9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1132534753 >> 172.21.15.52:0/1132534753 conn(0x558d33cbea20 msgr2=0x558d33cc58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1132534753 shutdown_connections 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.721+0000 7f50c4cd0740 1 -- 172.21.15.52:0/1132534753 wait complete. 2024-09-19T09:23:19.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 -- start start 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 Processor -- start 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2490 0x558d33cc74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 0x558d33cc79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1ae080 con 0x558d33ccd670 2024-09-19T09:23:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1af4f0 con 0x558d33cc2490 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc1ae750 con 0x558d33cc2db0 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c4cd0740 10 client.0 _ll_register_callbacks cb 0x7f50ac0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c0e94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c0e94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41474/0 (socket says 172.21.15.52:41474) 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50c0e94640 1 -- 172.21.15.52:0/3369895259 learned_addr learned my addr 172.21.15.52:0/3369895259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2490 0x558d33cc74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.722+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 0x558d33cc79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 -- 172.21.15.52:0/3369895259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 msgr2=0x558d33cc79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 0x558d33cc79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 -- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2490 msgr2=0x558d33cc74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2490 0x558d33cc74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 -- 172.21.15.52:0/3369895259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d33d47060 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50b3fff640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 0x558d33cc79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c0e94640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007f40 tx=0x7f50b4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5bdfe4a0246b28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f509b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4027020 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50b4010700 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50a40bc430 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50b4032050 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c4cd0740 10 client.16173 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558d33d48350 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.723+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50a40bc430 con 0x558d33ccd670 2024-09-19T09:23:19.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f50b40189c0 con 0x558d33ccd670 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 10 client.16173 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 20 client.16173 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33d48790 0x558d33d4abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 4 client.16173 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d33c2fd60 con 0x558d33d48790 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33d48790 0x558d33d4abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f509b7fe640 10 client.16173 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.724+0000 7f50bbfff640 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33d48790 0x558d33d4abb0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e60cc27f0742e6f server_cookie=fff2dcf04346c7b2 in_seq=0 out_seq=0 2024-09-19T09:23:19.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f509b7fe640 1 -- 172.21.15.52:0/3369895259 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558d33c2fd60 con 0x558d33d48790 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f509b7fe640 10 client.16173 handle_command_reply: tid=0 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 client.16173 shutdown 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 msgr2=0x558d33cc7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f50b4007f40 tx=0x7f50b4003ba0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 shutdown_connections 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558d33d48790 0x558d33d4abb0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d33ccd670 0x558d33cc7f30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f509b7fe640 0 client.16173 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d33cc2db0 0x558d33cc79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 --2- 172.21.15.52:0/3369895259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558d33cc2490 0x558d33cc74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 >> 172.21.15.52:0/3369895259 conn(0x558d33cbea20 msgr2=0x558d33cc4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 shutdown_connections 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 1 -- 172.21.15.52:0/3369895259 wait complete. 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.725+0000 7f50c4cd0740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:23:19.732 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 msgr2=0x7f50a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 0x7f50a80a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x558d33cbf880 tx=0x7f50ac008040 comp rx=0 tx=0).stop 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 msgr2=0x7f50bc100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f50a4006010 tx=0x7f50a40042f0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 shutdown_connections 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50a80a3240 0x7f50a80a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50bc10c2f0 0x7f50bc1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f50bc1037a0 0x7f50bc100f90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 --2- 172.21.15.52:0/3316694535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50bc102df0 0x7f50bc100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 >> 172.21.15.52:0/3316694535 conn(0x7f50bc0fc7d0 msgr2=0x7f50bc0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 shutdown_connections 2024-09-19T09:23:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:19.726+0000 7f50c28f7640 1 -- 172.21.15.52:0/3316694535 wait complete. 2024-09-19T09:23:20.445 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:23:20.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:20.748 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 -- 172.21.15.52:0/1418034718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 msgr2=0x7f1114106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 --2- 172.21.15.52:0/1418034718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f1114106e60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f1110009930 tx=0x7f111002a420 comp rx=0 tx=0).stop 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 -- 172.21.15.52:0/1418034718 shutdown_connections 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 --2- 172.21.15.52:0/1418034718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114101420 0x7f111410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 --2- 172.21.15.52:0/1418034718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114100a80 0x7f1114100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 --2- 172.21.15.52:0/1418034718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f1114106e60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.206+0000 7f111b66f640 1 -- 172.21.15.52:0/1418034718 >> 172.21.15.52:0/1418034718 conn(0x7f11140fc7a0 msgr2=0x7f11140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.207+0000 7f111b66f640 1 -- 172.21.15.52:0/1418034718 shutdown_connections 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.207+0000 7f111b66f640 1 -- 172.21.15.52:0/1418034718 wait complete. 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.207+0000 7f111b66f640 1 Processor -- start 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.207+0000 7f111b66f640 1 -- start start 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114100a80 0x7f11141974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114101420 0x7f1114197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1114110f20 con 0x7f1114106a80 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1114110da0 con 0x7f1114101420 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111b66f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11141110a0 con 0x7f1114100a80 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:21.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41490/0 (socket says 172.21.15.52:41490) 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 -- 172.21.15.52:0/3053893254 learned_addr learned my addr 172.21.15.52:0/3053893254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1118c0a640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114101420 0x7f1114197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f111940b640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114100a80 0x7f11141974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 -- 172.21.15.52:0/3053893254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114100a80 msgr2=0x7f11141974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114100a80 0x7f11141974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 -- 172.21.15.52:0/3053893254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114101420 msgr2=0x7f1114197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114101420 0x7f1114197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 -- 172.21.15.52:0/3053893254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111419c4a0 con 0x7f1114106a80 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f1119c0c640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b970 tx=0x7f110c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.208+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c019070 con 0x7f1114106a80 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.209+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f110c014440 con 0x7f1114106a80 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.209+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111419c790 con 0x7f1114106a80 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.209+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c0075d0 con 0x7f1114106a80 2024-09-19T09:23:21.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.209+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141a4070 con 0x7f1114106a80 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.210+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1114100f60 con 0x7f1114106a80 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.211+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f110c01c070 con 0x7f1114106a80 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.212+0000 7f110a7fc640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 0x7f11000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.212+0000 7f111940b640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 0x7f11000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.212+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f110c0cf3c0 con 0x7f1114106a80 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.213+0000 7f111940b640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 0x7f11000a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:21.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.216+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f110c09c000 con 0x7f1114106a80 2024-09-19T09:23:21.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:21 smithi052 ceph-mon[30947]: pgmap v395: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:23:21.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.429+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1114198850 con 0x7f1114106a80 2024-09-19T09:23:21.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.430+0000 7f110a7fc640 1 -- 172.21.15.52:0/3053893254 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f110c0afe20 con 0x7f1114106a80 2024-09-19T09:23:21.431 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:23:21.431 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:23:21.432 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 msgr2=0x7f11000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 0x7f11000a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110031490 comp rx=0 tx=0).stop 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 msgr2=0x7f111419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b970 tx=0x7f110c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 shutdown_connections 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1114106a80 0x7f111419bdc0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1114101420 0x7f1114197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11000a32c0 0x7f11000a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 --2- 172.21.15.52:0/3053893254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1114100a80 0x7f11141974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 >> 172.21.15.52:0/3053893254 conn(0x7f11140fc7a0 msgr2=0x7f11140fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 shutdown_connections 2024-09-19T09:23:21.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:21.432+0000 7f111b66f640 1 -- 172.21.15.52:0/3053893254 wait complete. 2024-09-19T09:23:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:21 smithi169 ceph-mon[35454]: pgmap v395: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:23:21.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:21 smithi086 ceph-mon[34813]: pgmap v395: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:23:22.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:23:22.343 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:22.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3053893254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:22.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3053893254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:22.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3053893254' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 -- 172.21.15.52:0/782132075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 msgr2=0x7ff58c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 --2- 172.21.15.52:0/782132075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c1021c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009ca0 tx=0x7ff57c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 -- 172.21.15.52:0/782132075 shutdown_connections 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 --2- 172.21.15.52:0/782132075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 0x7ff58c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 --2- 172.21.15.52:0/782132075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 0x7ff58c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 --2- 172.21.15.52:0/782132075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c1021c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 -- 172.21.15.52:0/782132075 >> 172.21.15.52:0/782132075 conn(0x7ff58c0fd8c0 msgr2=0x7ff58c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 -- 172.21.15.52:0/782132075 shutdown_connections 2024-09-19T09:23:22.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.800+0000 7ff59456a640 1 -- 172.21.15.52:0/782132075 wait complete. 2024-09-19T09:23:22.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 Processor -- start 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 -- start start 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 0x7ff58c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 0x7ff58c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c111f70 con 0x7ff58c101de0 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c111df0 con 0x7ff58c102790 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff59456a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1120f0 con 0x7ff58c106f10 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.801+0000 7ff592306640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41504/0 (socket says 172.21.15.52:41504) 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 -- 172.21.15.52:0/4189676995 learned_addr learned my addr 172.21.15.52:0/4189676995 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff591b05640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 0x7ff58c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592b07640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 0x7ff58c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 -- 172.21.15.52:0/4189676995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 msgr2=0x7ff58c19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 0x7ff58c19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 -- 172.21.15.52:0/4189676995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 msgr2=0x7ff58c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 0x7ff58c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 -- 172.21.15.52:0/4189676995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c19d2b0 con 0x7ff58c101de0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff592306640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097b0 tx=0x7ff57c031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff58b7fe640 1 -- 172.21.15.52:0/4189676995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c02fba0 con 0x7ff58c101de0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff58b7fe640 1 -- 172.21.15.52:0/4189676995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c02fd40 con 0x7ff58c101de0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c19d540 con 0x7ff58c101de0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff58b7fe640 1 -- 172.21.15.52:0/4189676995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c03b860 con 0x7ff58c101de0 2024-09-19T09:23:22.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.802+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1a4e80 con 0x7ff58c101de0 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff58b7fe640 1 -- 172.21.15.52:0/4189676995 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff57c030c30 con 0x7ff58c101de0 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff596943740 1 Processor -- start 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff596943740 1 -- start start 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff58b7fe640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff596943740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff596943740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77837a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.805+0000 7ff596943740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de77848b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff596943740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de7779d2f0 con 0x55de77846780 2024-09-19T09:23:22.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff596943740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de77744cf0 con 0x55de778375d0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff596943740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de777992b0 con 0x55de77838b40 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592b07640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff58b7fe640 1 -- 172.21.15.52:0/4189676995 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff57c0f1020 con 0x7ff58c101de0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592b07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de77848b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:42416/0 (socket says 172.21.15.52:42416) 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 -- 172.21.15.52:0/4143189135 learned_addr learned my addr 172.21.15.52:0/4143189135 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff591b05640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77837a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 -- 172.21.15.52:0/4143189135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 msgr2=0x55de77837a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77837a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 -- 172.21.15.52:0/4143189135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 msgr2=0x55de77848b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de77848b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 -- 172.21.15.52:0/4143189135 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de777293a0 con 0x55de77838b40 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff591b05640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77837a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592b07640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de77848b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592b07640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 0x7ff5740a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff584005fd0 tx=0x7ff58400ba40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.806+0000 7ff592306640 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0c5da0 tx=0x7ff57c0bd080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8547268bef83bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff588ff9640 1 -- 172.21.15.52:0/4143189135 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0bdd60 con 0x55de77838b40 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff588ff9640 1 -- 172.21.15.52:0/4143189135 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c036070 con 0x55de77838b40 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff588ff9640 1 -- 172.21.15.52:0/4143189135 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0bebc0 con 0x55de77838b40 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 -- 172.21.15.52:0/4143189135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 msgr2=0x55de77837090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0c5da0 tx=0x7ff57c0bd080 comp rx=0 tx=0).stop 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 -- 172.21.15.52:0/4143189135 shutdown_connections 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de77848b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77837a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 --2- 172.21.15.52:0/4143189135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77838b40 0x55de77837090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.807+0000 7ff596943740 1 -- 172.21.15.52:0/4143189135 >> 172.21.15.52:0/4143189135 conn(0x55de77800310 msgr2=0x55de77833c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- 172.21.15.52:0/4143189135 shutdown_connections 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- 172.21.15.52:0/4143189135 wait complete. 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- start start 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 Processor -- start 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de778461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77843c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55de777992b0 con 0x55de77838b40 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55de77758060 con 0x55de778375d0 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55de77849240 con 0x55de77846780 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.808+0000 7ff596943740 10 client.0 _ll_register_callbacks cb 0x55de774ab8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41518/0 (socket says 172.21.15.52:41518) 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 -- 172.21.15.52:0/2098947865 learned_addr learned my addr 172.21.15.52:0/2098947865 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff592306640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de778461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff592b07640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77843c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 -- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 msgr2=0x55de77843c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77843c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 -- 172.21.15.52:0/2098947865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 msgr2=0x55de778461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de778461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 -- 172.21.15.52:0/2098947865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de7750e3c0 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff591b05640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff580012780 tx=0x7ff580012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2351fe2eaac5ec78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001f060 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff580010d60 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff57c036070 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff58001a430 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff596943740 10 client.16191 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.809+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55de77854b50 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff57c036070 con 0x55de77838b40 2024-09-19T09:23:22.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff58000d4f0 con 0x55de77838b40 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 10 client.16191 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 20 client.16191 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de77856010 0x55de778584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 4 client.16191 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de777aa860 con 0x55de77856010 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.810+0000 7ff592306640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de77856010 0x55de778584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff592306640 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de77856010 0x55de778584a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=115d20af2ca5530c server_cookie=105de549c77977d5 in_seq=0 out_seq=0 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff571ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff571ffb640 1 -- 172.21.15.52:0/2098947865 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de777aa860 con 0x55de77856010 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff571ffb640 10 client.16191 handle_command_reply: tid=0 2024-09-19T09:23:22.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff596943740 1 client.16191 shutdown 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.811+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 msgr2=0x55de77843470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff580012780 tx=0x7ff580012c40 comp rx=0 tx=0).stop 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 shutdown_connections 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de77856010 0x55de778584a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77843c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de77843470 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff571ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 --2- 172.21.15.52:0/2098947865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de778461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 >> 172.21.15.52:0/2098947865 conn(0x55de77800310 msgr2=0x55de77839960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 shutdown_connections 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 1 -- 172.21.15.52:0/2098947865 wait complete. 2024-09-19T09:23:22.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.812+0000 7ff596943740 20 client.16191 trim_cache size 0 max 16384 2024-09-19T09:23:22.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 Processor -- start 2024-09-19T09:23:22.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 -- start start 2024-09-19T09:23:22.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77833e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77838300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1adce0 con 0x55de77838b40 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1ab5b0 con 0x55de778375d0 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff596943740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1a9400 con 0x55de77846780 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41530/0 (socket says 172.21.15.52:41530) 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 -- 172.21.15.52:0/2727884429 learned_addr learned my addr 172.21.15.52:0/2727884429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff592b07640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77838300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff592306640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77833e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 -- 172.21.15.52:0/2727884429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 msgr2=0x55de77838300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77838300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 -- 172.21.15.52:0/2727884429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 msgr2=0x55de77833e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77833e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff591b05640 1 -- 172.21.15.52:0/2727884429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de7783a120 con 0x55de77838b40 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff592b07640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77838300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.825+0000 7ff592306640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77833e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff591b05640 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff58000dab0 tx=0x7ff58000df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995bdbe85617f38f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff573fff640 1 -- 172.21.15.52:0/2727884429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58000dd30 con 0x55de77838b40 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff573fff640 1 -- 172.21.15.52:0/2727884429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58000d340 con 0x55de77838b40 2024-09-19T09:23:22.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff573fff640 1 -- 172.21.15.52:0/2727884429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58001ae60 con 0x55de77838b40 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 -- 172.21.15.52:0/2727884429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 msgr2=0x55de778461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff58000dab0 tx=0x7ff58000df80 comp rx=0 tx=0).stop 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 -- 172.21.15.52:0/2727884429 shutdown_connections 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de77846780 0x55de77838300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77838b40 0x55de778461c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 --2- 172.21.15.52:0/2727884429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de778375d0 0x55de77833e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 -- 172.21.15.52:0/2727884429 >> 172.21.15.52:0/2727884429 conn(0x55de77800310 msgr2=0x55de77833700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 -- 172.21.15.52:0/2727884429 shutdown_connections 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.826+0000 7ff596943740 1 -- 172.21.15.52:0/2727884429 wait complete. 2024-09-19T09:23:22.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 -- start start 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 Processor -- start 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de778375d0 0x55de7784e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 0x55de7784ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1a9a70 con 0x55de77846780 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1aaee0 con 0x55de77838b40 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1aa140 con 0x55de778375d0 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff596943740 10 client.0 _ll_register_callbacks cb 0x7ff58000ae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff592b07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff592b07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41540/0 (socket says 172.21.15.52:41540) 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff592b07640 1 -- 172.21.15.52:0/45954539 learned_addr learned my addr 172.21.15.52:0/45954539 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff591b05640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 0x55de7784ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.827+0000 7ff592306640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de778375d0 0x55de7784e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 -- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de778375d0 msgr2=0x55de7784e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de778375d0 0x55de7784e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 -- 172.21.15.52:0/45954539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 msgr2=0x55de7784ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 0x55de7784ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 -- 172.21.15.52:0/45954539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de778406e0 con 0x55de77846780 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff591b05640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 0x55de7784ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff592b07640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff584010c00 tx=0x7ff58401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802748f325b1be3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff571ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584011d80 con 0x55de77846780 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff584021440 con 0x55de77846780 2024-09-19T09:23:22.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff58000d340 con 0x55de77846780 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff584021640 con 0x55de77846780 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff596943740 10 client.16197 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55de778c0910 con 0x55de77846780 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.828+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58000d340 con 0x55de77846780 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff584034850 con 0x55de77846780 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 10 client.16197 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 20 client.16197 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de778c1090 0x55de778c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 4 client.16197 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de777a4d70 con 0x55de778c1090 2024-09-19T09:23:22.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff592306640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de778c1090 0x55de778c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff592306640 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de778c1090 0x55de778c34b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c7fc582ff037c87 server_cookie=1a44d2754f975310 in_seq=0 out_seq=0 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff571ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff571ffb640 1 -- 172.21.15.52:0/45954539 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de777a4d70 con 0x55de778c1090 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff571ffb640 10 client.16197 handle_command_reply: tid=0 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.829+0000 7ff596943740 1 client.16197 shutdown 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 msgr2=0x55de7783feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff584010c00 tx=0x7ff58401a000 comp rx=0 tx=0).stop 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 shutdown_connections 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55de778c1090 0x55de778c34b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55de77846780 0x55de7783feb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff571ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55de77838b40 0x55de7784ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 --2- 172.21.15.52:0/45954539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55de778375d0 0x55de7784e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 >> 172.21.15.52:0/45954539 conn(0x55de77800310 msgr2=0x55de77833700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 shutdown_connections 2024-09-19T09:23:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 1 -- 172.21.15.52:0/45954539 wait complete. 2024-09-19T09:23:22.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff596943740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T09:23:22.837 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 msgr2=0x7ff5740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 0x7ff5740a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff584005fd0 tx=0x7ff58400ba40 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 msgr2=0x7ff58c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097b0 tx=0x7ff57c031b10 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 shutdown_connections 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5740a3240 0x7ff5740a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff58c106f10 0x7ff58c19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff58c102790 0x7ff58c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 --2- 172.21.15.52:0/4189676995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff58c101de0 0x7ff58c198300 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:22.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.830+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 >> 172.21.15.52:0/4189676995 conn(0x7ff58c0fd8c0 msgr2=0x7ff58c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:22.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.831+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 shutdown_connections 2024-09-19T09:23:22.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:22.831+0000 7ff59456a640 1 -- 172.21.15.52:0/4189676995 wait complete. 2024-09-19T09:23:23.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:23 smithi052 ceph-mon[30947]: pgmap v396: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:23 smithi169 ceph-mon[35454]: pgmap v396: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:23.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:23 smithi086 ceph-mon[34813]: pgmap v396: 97 pgs: 97 active+clean; 863 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:23.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:23:24.106 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:24.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/568866147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 msgr2=0x7fcbec106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/568866147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec106840 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009930 tx=0x7fcbe002a420 comp rx=0 tx=0).stop 2024-09-19T09:23:24.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/568866147 shutdown_connections 2024-09-19T09:23:24.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/568866147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 0x7fcbec10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/568866147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec106840 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/568866147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 0x7fcbec1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/568866147 >> 172.21.15.52:0/568866147 conn(0x7fcbec077210 msgr2=0x7fcbec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/568866147 shutdown_connections 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.575+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/568866147 wait complete. 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 Processor -- start 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 -- start start 2024-09-19T09:23:24.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 0x7fcbec198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 0x7fcbec19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec112050 con 0x7fcbec100ca0 2024-09-19T09:23:24.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec111ed0 con 0x7fcbec106f50 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.576+0000 7fcbf0fbf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1121d0 con 0x7fcbec1002f0 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41558/0 (socket says 172.21.15.52:41558) 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3675005152 learned_addr learned my addr 172.21.15.52:0/3675005152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbea59c640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 0x7fcbec198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbead9d640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 0x7fcbec19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3675005152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 msgr2=0x7fcbec198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 0x7fcbec198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3675005152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 msgr2=0x7fcbec19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 0x7fcbec19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3675005152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec19d540 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcbe002a940 tx=0x7fcbe0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbdb7fe640 1 -- 172.21.15.52:0/3675005152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe003f070 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbdb7fe640 1 -- 172.21.15.52:0/3675005152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe0031c90 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec19d7d0 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbdb7fe640 1 -- 172.21.15.52:0/3675005152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0035030 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.577+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec1a5110 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.580+0000 7fcbdb7fe640 1 -- 172.21.15.52:0/3675005152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcbe0042070 con 0x7fcbec100ca0 2024-09-19T09:23:24.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.580+0000 7fcbf3398740 1 Processor -- start 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.580+0000 7fcbf3398740 1 -- start start 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.580+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613053e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.580+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbf3398740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5613053482f0 con 0x5613053e25d0 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbf3398740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5613052efcf0 con 0x5613053f1780 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbf3398740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5613053442b0 con 0x5613053e3b40 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41566/0 (socket says 172.21.15.52:41566) 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 -- 172.21.15.52:0/648120800 learned_addr learned my addr 172.21.15.52:0/648120800 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbead9d640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613053e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbdb7fe640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 0x7fcbd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 -- 172.21.15.52:0/648120800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 msgr2=0x5613053e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613053e2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 -- 172.21.15.52:0/648120800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 msgr2=0x5613053f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 -- 172.21.15.52:0/648120800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613052d43a0 con 0x5613053e25d0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbead9d640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 0x7fcbd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbdb7fe640 1 -- 172.21.15.52:0/3675005152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcbe00f01b0 con 0x7fcbec100ca0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbea59c640 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b760 tx=0x7fcbdc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f6e067b834deee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbd8ff9640 1 -- 172.21.15.52:0/648120800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc003dd0 con 0x5613053e25d0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbd8ff9640 1 -- 172.21.15.52:0/648120800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc015070 con 0x5613053e25d0 2024-09-19T09:23:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.581+0000 7fcbd8ff9640 1 -- 172.21.15.52:0/648120800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004e60 con 0x5613053e25d0 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 -- 172.21.15.52:0/648120800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 msgr2=0x5613053e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b760 tx=0x7fcbdc00bc20 comp rx=0 tx=0).stop 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbead9d640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 0x7fcbd40a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400a400 tx=0x7fcbe400c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 -- 172.21.15.52:0/648120800 shutdown_connections 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e25d0 0x5613053e2a10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 --2- 172.21.15.52:0/648120800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613053e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 -- 172.21.15.52:0/648120800 >> 172.21.15.52:0/648120800 conn(0x5613053ab310 msgr2=0x5613053dec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 -- 172.21.15.52:0/648120800 shutdown_connections 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.582+0000 7fcbf3398740 1 -- 172.21.15.52:0/648120800 wait complete. 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 -- start start 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 Processor -- start 2024-09-19T09:23:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e25d0 0x5613053f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5613053f4480 con 0x5613053e3b40 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561305303060 con 0x5613053f1780 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5613053f4600 con 0x5613053e25d0 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbf3398740 10 client.0 _ll_register_callbacks cb 0x5613050568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41582/0 (socket says 172.21.15.52:41582) 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/1371139801 learned_addr learned my addr 172.21.15.52:0/1371139801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbead9d640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.583+0000 7fcbea59c640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e25d0 0x5613053f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/1371139801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e25d0 msgr2=0x5613053f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e25d0 0x5613053f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 msgr2=0x5613053eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/1371139801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613050b93c0 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00edc30 tx=0x7fcbe003b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4fce057b8024e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0049030 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcbe00b8dc0 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.584+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbdc015070 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbe00bc750 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 10 client.16209 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613053e5310 con 0x5613053e3b40 2024-09-19T09:23:24.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc015070 con 0x5613053e3b40 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbe00c4f30 con 0x5613053e3b40 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 10 client.16209 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 10 client.16209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 20 client.16209 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053e6870 0x5613053e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 4 client.16209 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.585+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561305355860 con 0x5613053e6870 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.586+0000 7fcbea59c640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053e6870 0x5613053e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.586+0000 7fcbd1ffb640 10 client.16209 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.586+0000 7fcbea59c640 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053e6870 0x5613053e8cc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad807fdf68971444 server_cookie=7b476e54301ce8a0 in_seq=0 out_seq=0 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/1371139801 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561305355860 con 0x5613053e6870 2024-09-19T09:23:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbd1ffb640 10 client.16209 handle_command_reply: tid=0 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 client.16209 shutdown 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 msgr2=0x5613053ee420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00edc30 tx=0x7fcbe003b460 comp rx=0 tx=0).stop 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 shutdown_connections 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053e6870 0x5613053e8cc0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbd1ffb640 0 client.16209 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053f1780 0x5613053eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x5613053ee420 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 --2- 172.21.15.52:0/1371139801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e25d0 0x5613053f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 >> 172.21.15.52:0/1371139801 conn(0x5613053ab310 msgr2=0x5613053e4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 shutdown_connections 2024-09-19T09:23:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 1 -- 172.21.15.52:0/1371139801 wait complete. 2024-09-19T09:23:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.587+0000 7fcbf3398740 20 client.16209 trim_cache size 0 max 16384 2024-09-19T09:23:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.600+0000 7fcbf3398740 1 Processor -- start 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.600+0000 7fcbf3398740 1 -- start start 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.600+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x5613053e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.600+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.600+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 0x561305405340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbf3398740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1ade90 con 0x5613053e3b40 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbf3398740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1ab760 con 0x5613053e25d0 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbf3398740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1a95b0 con 0x5613053e6870 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41596/0 (socket says 172.21.15.52:41596) 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3580729835 learned_addr learned my addr 172.21.15.52:0/3580729835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbead9d640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 0x561305405340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3580729835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 msgr2=0x561305405340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbea59c640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x5613053e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 0x561305405340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3580729835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 msgr2=0x5613053e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x5613053e9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 -- 172.21.15.52:0/3580729835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613053fe240 con 0x5613053e3b40 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbead9d640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 0x561305405340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00bc6e0 tx=0x7fcbe00b89f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61afbd5a2ab37676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbd3fff640 1 -- 172.21.15.52:0/3580729835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0049070 con 0x5613053e3b40 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbd3fff640 1 -- 172.21.15.52:0/3580729835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe00c0b00 con 0x5613053e3b40 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.601+0000 7fcbd3fff640 1 -- 172.21.15.52:0/3580729835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00b8f20 con 0x5613053e3b40 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- 172.21.15.52:0/3580729835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 msgr2=0x561305404e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00bc6e0 tx=0x7fcbe00b89f0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- 172.21.15.52:0/3580729835 shutdown_connections 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e6870 0x561305405340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e3b40 0x561305404e00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 --2- 172.21.15.52:0/3580729835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x5613053e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- 172.21.15.52:0/3580729835 >> 172.21.15.52:0/3580729835 conn(0x5613053ab310 msgr2=0x5613053e9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- 172.21.15.52:0/3580729835 shutdown_connections 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- 172.21.15.52:0/3580729835 wait complete. 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 -- start start 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.602+0000 7fcbf3398740 1 Processor -- start 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x561305402c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613054031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1a9c20 con 0x5613053e6870 2024-09-19T09:23:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1ab090 con 0x5613053e25d0 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec1aa2f0 con 0x5613053e3b40 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbf3398740 10 client.0 _ll_register_callbacks cb 0x7fcbe00b8ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41608/0 (socket says 172.21.15.52:41608) 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 -- 172.21.15.52:0/862702596 learned_addr learned my addr 172.21.15.52:0/862702596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbe9d9b640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613054031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbea59c640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x561305402c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 -- 172.21.15.52:0/862702596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 msgr2=0x5613054031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613054031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 -- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 msgr2=0x561305402c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x561305402c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 -- 172.21.15.52:0/862702596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561305466ef0 con 0x5613053e6870 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbead9d640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4016c40 tx=0x7fcbe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8a2e39699a2048 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.603+0000 7fcbd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4028060 con 0x5613053e6870 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbe00c0b00 con 0x5613053e6870 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcbe4015d30 con 0x5613053e6870 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcbe4023440 con 0x5613053e6870 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 10 client.16215 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:24.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613054681a0 con 0x5613053e6870 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe00c0b00 con 0x5613053e6870 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcbe40226d0 con 0x5613053e6870 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 10 client.16215 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 20 client.16215 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053f1780 0x56130546a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 4 client.16215 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.604+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56130534fd70 con 0x5613053f1780 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbea59c640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053f1780 0x56130546a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbea59c640 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053f1780 0x56130546a8d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e69319bd6cb527ed server_cookie=267b0de117acd0cf in_seq=0 out_seq=0 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbd1ffb640 10 client.16215 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbd1ffb640 1 -- 172.21.15.52:0/862702596 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcbdc015020 con 0x5613053f1780 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbd1ffb640 10 client.16215 handle_command_reply: tid=0 2024-09-19T09:23:24.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 client.16215 shutdown 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 msgr2=0x5613054036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4016c40 tx=0x7fcbe4004a40 comp rx=0 tx=0).stop 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 shutdown_connections 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613053e6870 0x5613054036e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613053e3b40 0x5613054031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5613053f1780 0x56130546a8d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 --2- 172.21.15.52:0/862702596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613053e25d0 0x561305402c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 >> 172.21.15.52:0/862702596 conn(0x5613053ab310 msgr2=0x5613053efc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbd1ffb640 0 client.16215 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 shutdown_connections 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.605+0000 7fcbf3398740 1 -- 172.21.15.52:0/862702596 wait complete. 2024-09-19T09:23:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf3398740 20 client.16215 trim_cache size 0 max 16384 2024-09-19T09:23:24.614 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:24.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 msgr2=0x7fcbd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 0x7fcbd40a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400a400 tx=0x7fcbe400c040 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 msgr2=0x7fcbec198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcbe002a940 tx=0x7fcbe0003b90 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 shutdown_connections 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbec106f50 0x7fcbec19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcbec100ca0 0x7fcbec198ad0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcbd40a3240 0x7fcbd40a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 --2- 172.21.15.52:0/3675005152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcbec1002f0 0x7fcbec198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 >> 172.21.15.52:0/3675005152 conn(0x7fcbec077210 msgr2=0x7fcbec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 shutdown_connections 2024-09-19T09:23:24.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:24.606+0000 7fcbf0fbf640 1 -- 172.21.15.52:0/3675005152 wait complete. 2024-09-19T09:23:25.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:25 smithi052 ceph-mon[30947]: pgmap v397: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:23:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:25 smithi169 ceph-mon[35454]: pgmap v397: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:23:25.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:23:25.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:25 smithi086 ceph-mon[34813]: pgmap v397: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:23:25.717 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 -- 172.21.15.52:0/1212723118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8101de0 msgr2=0x7f85b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 --2- 172.21.15.52:0/1212723118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8101de0 0x7f85b81021c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009900 tx=0x7f85a802a410 comp rx=0 tx=0).stop 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 -- 172.21.15.52:0/1212723118 shutdown_connections 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 --2- 172.21.15.52:0/1212723118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8106f10 0x7f85b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 --2- 172.21.15.52:0/1212723118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8102790 0x7f85b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 --2- 172.21.15.52:0/1212723118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8101de0 0x7f85b81021c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 -- 172.21.15.52:0/1212723118 >> 172.21.15.52:0/1212723118 conn(0x7f85b80fd8c0 msgr2=0x7f85b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 -- 172.21.15.52:0/1212723118 shutdown_connections 2024-09-19T09:23:26.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.220+0000 7f85bd86a640 1 -- 172.21.15.52:0/1212723118 wait complete. 2024-09-19T09:23:26.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 Processor -- start 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 -- start start 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 0x7f85b80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8102790 0x7f85b8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8111f70 con 0x7f85b8106f10 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8111df0 con 0x7f85b8101de0 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85bd86a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81120f0 con 0x7f85b8102790 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41612/0 (socket says 172.21.15.52:41612) 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 -- 172.21.15.52:0/3814195899 learned_addr learned my addr 172.21.15.52:0/3814195899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 0x7f85b80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85affff640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8102790 0x7f85b8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 -- 172.21.15.52:0/3814195899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8102790 msgr2=0x7f85b8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8102790 0x7f85b8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 -- 172.21.15.52:0/3814195899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 msgr2=0x7f85b80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 0x7f85b80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b77fe640 1 -- 172.21.15.52:0/3814195899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b81a6990 con 0x7f85b8106f10 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.221+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 0x7f85b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85b77fe640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85b000eb10 tx=0x7f85b000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85bc868640 1 -- 172.21.15.52:0/3814195899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0004b20 con 0x7f85b8106f10 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85bc868640 1 -- 172.21.15.52:0/3814195899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b0004cc0 con 0x7f85b8106f10 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b81a6c80 con 0x7f85b8106f10 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85bc868640 1 -- 172.21.15.52:0/3814195899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0010760 con 0x7f85b8106f10 2024-09-19T09:23:26.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.222+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b81a7210 con 0x7f85b8106f10 2024-09-19T09:23:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.224+0000 7f85bc868640 1 -- 172.21.15.52:0/3814195899 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f85b0005020 con 0x7f85b8106f10 2024-09-19T09:23:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.224+0000 7f85bfc43740 1 Processor -- start 2024-09-19T09:23:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 -- start start 2024-09-19T09:23:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc13a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55873bb792f0 con 0x55873bc1e370 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55873bb20cf0 con 0x55873bc14b40 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85bfc43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55873bb752b0 con 0x55873bc135d0 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41618/0 (socket says 172.21.15.52:41618) 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 -- 172.21.15.52:0/483501296 learned_addr learned my addr 172.21.15.52:0/483501296 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc13a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 -- 172.21.15.52:0/483501296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 msgr2=0x55873bc13a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 -- 172.21.15.52:0/483501296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 msgr2=0x55873bc13090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.225+0000 7f85affff640 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc13090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85affff640 1 -- 172.21.15.52:0/483501296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873bb053a0 con 0x55873bc1e370 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85bc868640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 0x7f85a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85affff640 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f85a00149c0 tx=0x7f85a000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f4a8fbd334cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 0x7f85a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85bc868640 1 -- 172.21.15.52:0/3814195899 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f85b00d0080 con 0x7f85b8106f10 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85adffb640 1 -- 172.21.15.52:0/483501296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a00142d0 con 0x55873bc1e370 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85adffb640 1 -- 172.21.15.52:0/483501296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a000fc40 con 0x55873bc1e370 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.226+0000 7f85adffb640 1 -- 172.21.15.52:0/483501296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0012a90 con 0x55873bc1e370 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- 172.21.15.52:0/483501296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 msgr2=0x55873bc20760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 0x7f85a40a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55873bc10ac0 tx=0x7f85a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f85a00149c0 tx=0x7f85a000c4d0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- 172.21.15.52:0/483501296 shutdown_connections 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc20760 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 --2- 172.21.15.52:0/483501296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- 172.21.15.52:0/483501296 >> 172.21.15.52:0/483501296 conn(0x55873bbdc310 msgr2=0x55873bc0fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- 172.21.15.52:0/483501296 shutdown_connections 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- 172.21.15.52:0/483501296 wait complete. 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 -- start start 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.227+0000 7f85bfc43740 1 Processor -- start 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc1dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc1afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55873bc21070 con 0x55873bc1e370 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55873bb34060 con 0x55873bc14b40 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55873bc211f0 con 0x55873bc135d0 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85bfc43740 10 client.0 _ll_register_callbacks cb 0x55873b8878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41628/0 (socket says 172.21.15.52:41628) 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 -- 172.21.15.52:0/2783959547 learned_addr learned my addr 172.21.15.52:0/2783959547 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc1dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85affff640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc1afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 -- 172.21.15.52:0/2783959547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 msgr2=0x55873bc1dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc1dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 -- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 msgr2=0x55873bc1afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc1afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 -- 172.21.15.52:0/2783959547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873b8ea3c0 con 0x55873bc1e370 2024-09-19T09:23:26.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc1dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85affff640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc1afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b009c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ae6b04f3308c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.228+0000 7f8596ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b00b5060 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f85b0005310 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a000fc40 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f85b009c620 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 10 client.16227 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55873bc2cb60 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a000fc40 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f85b00b0c60 con 0x55873bc1e370 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 10 client.16227 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:26.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 20 client.16227 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:26.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc2dfc0 0x55873bc30420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 4 client.16227 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:26.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.229+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55873bb86860 con 0x55873bc2dfc0 2024-09-19T09:23:26.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.230+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc2dfc0 0x55873bc30420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.230+0000 7f8596ffd640 10 client.16227 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.230+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc2dfc0 0x55873bc30420 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7574f928d24d2d server_cookie=d69201113cc3b025 in_seq=0 out_seq=0 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f8596ffd640 1 -- 172.21.15.52:0/2783959547 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55873bb86860 con 0x55873bc2dfc0 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f8596ffd640 10 client.16227 handle_command_reply: tid=0 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 client.16227 shutdown 2024-09-19T09:23:26.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 msgr2=0x55873bc1b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b009c4b0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 shutdown_connections 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc2dfc0 0x55873bc30420 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc1b5d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc1afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2783959547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc1dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 >> 172.21.15.52:0/2783959547 conn(0x55873bbdc310 msgr2=0x55873bc15960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f8596ffd640 0 client.16227 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 shutdown_connections 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 1 -- 172.21.15.52:0/2783959547 wait complete. 2024-09-19T09:23:26.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.231+0000 7f85bfc43740 20 client.16227 trim_cache size 0 max 16384 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.249+0000 7f85bfc43740 1 Processor -- start 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.249+0000 7f85bfc43740 1 -- start start 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.249+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc2a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc0f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85bfc43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81b2310 con 0x55873bc1e370 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85bfc43740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81afbe0 con 0x55873bc14b40 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85bfc43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81ada30 con 0x55873bc135d0 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41638/0 (socket says 172.21.15.52:41638) 2024-09-19T09:23:26.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 -- 172.21.15.52:0/4102551134 learned_addr learned my addr 172.21.15.52:0/4102551134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85affff640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc2a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 -- 172.21.15.52:0/4102551134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 msgr2=0x55873bc2a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc2a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 -- 172.21.15.52:0/4102551134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 msgr2=0x55873bc0f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc0f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 -- 172.21.15.52:0/4102551134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55873bc10180 con 0x55873bc1e370 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85affff640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85b77fe640 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f85b0098ff0 tx=0x7f85b009ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc579c288671d48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85ad7fa640 1 -- 172.21.15.52:0/4102551134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b009bf80 con 0x55873bc1e370 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85ad7fa640 1 -- 172.21.15.52:0/4102551134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b00a09d0 con 0x55873bc1e370 2024-09-19T09:23:26.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.250+0000 7f85ad7fa640 1 -- 172.21.15.52:0/4102551134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0005310 con 0x55873bc1e370 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- 172.21.15.52:0/4102551134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 msgr2=0x55873bc0fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f85b0098ff0 tx=0x7f85b009ab30 comp rx=0 tx=0).stop 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- 172.21.15.52:0/4102551134 shutdown_connections 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc0fc40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 --2- 172.21.15.52:0/4102551134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- 172.21.15.52:0/4102551134 >> 172.21.15.52:0/4102551134 conn(0x55873bbdc310 msgr2=0x55873bc1afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- 172.21.15.52:0/4102551134 shutdown_connections 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- 172.21.15.52:0/4102551134 wait complete. 2024-09-19T09:23:26.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.251+0000 7f85bfc43740 1 -- start start 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 Processor -- start 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc26820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc26d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81ae0a0 con 0x55873bc1e370 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81af510 con 0x55873bc14b40 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81ae770 con 0x55873bc135d0 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85bfc43740 10 client.0 _ll_register_callbacks cb 0x7f85b00988c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41644/0 (socket says 172.21.15.52:41644) 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 -- 172.21.15.52:0/2396614068 learned_addr learned my addr 172.21.15.52:0/2396614068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85affff640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc26d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc26820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 -- 172.21.15.52:0/2396614068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 msgr2=0x55873bc26820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc26820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 -- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 msgr2=0x55873bc26d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc26d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.252+0000 7f85b77fe640 1 -- 172.21.15.52:0/2396614068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55873bc183a0 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85b77fe640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f85b009c320 tx=0x7f85b0098290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b63e7368a53af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b00aa060 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f85b0005520 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b00a09d0 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f85b009bf80 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 10 client.16233 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55873bc98890 con 0x55873bc1e370 2024-09-19T09:23:26.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b00a09d0 con 0x55873bc1e370 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f85b009b600 con 0x55873bc1e370 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 10 client.16233 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 20 client.16233 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc98d10 0x55873bc9b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 4 client.16233 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.253+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55873bb80d70 con 0x55873bc98d10 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc98d10 0x55873bc9b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f85b6ffd640 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc98d10 0x55873bc9b100 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d4a61ba0784daa6 server_cookie=13b4f16149d3008d in_seq=0 out_seq=0 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f8596ffd640 10 client.16233 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f8596ffd640 1 -- 172.21.15.52:0/2396614068 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55873bb80d70 con 0x55873bc98d10 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f8596ffd640 10 client.16233 handle_command_reply: tid=0 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.254+0000 7f85bfc43740 1 client.16233 shutdown 2024-09-19T09:23:26.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 msgr2=0x55873bc17b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f85b009c320 tx=0x7f85b0098290 comp rx=0 tx=0).stop 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 shutdown_connections 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55873bc98d10 0x55873bc9b100 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55873bc1e370 0x55873bc17b70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55873bc14b40 0x55873bc26d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 --2- 172.21.15.52:0/2396614068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55873bc135d0 0x55873bc26820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f8596ffd640 0 client.16233 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 >> 172.21.15.52:0/2396614068 conn(0x55873bbdc310 msgr2=0x55873bc1c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 shutdown_connections 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 1 -- 172.21.15.52:0/2396614068 wait complete. 2024-09-19T09:23:26.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bfc43740 20 client.16233 trim_cache size 0 max 16384 2024-09-19T09:23:26.261 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:23:26.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 msgr2=0x7f85a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 0x7f85a40a5780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55873bc10ac0 tx=0x7f85a8005b50 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 msgr2=0x7f85b8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.255+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85b000eb10 tx=0x7f85b000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 shutdown_connections 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85b8106f10 0x7f85b8074f70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85a40a32c0 0x7f85a40a5780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85b8102790 0x7f85b8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 --2- 172.21.15.52:0/3814195899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85b8101de0 0x7f85b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 >> 172.21.15.52:0/3814195899 conn(0x7f85b80fd8c0 msgr2=0x7f85b80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 shutdown_connections 2024-09-19T09:23:26.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:26.256+0000 7f85bd86a640 1 -- 172.21.15.52:0/3814195899 wait complete. 2024-09-19T09:23:27.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:27 smithi052 ceph-mon[30947]: pgmap v398: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:23:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:27 smithi169 ceph-mon[35454]: pgmap v398: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:23:27.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:27 smithi086 ceph-mon[34813]: pgmap v398: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:23:27.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:23:27.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:23:28.220 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:28.342 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:28.342 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.342 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.342 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.342 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:28.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:28.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:28.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:28.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.711+0000 7fb0e362a640 1 -- 172.21.15.52:0/1292696475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 msgr2=0x7fb0dc10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.711+0000 7fb0e362a640 1 --2- 172.21.15.52:0/1292696475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc10df30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009900 tx=0x7fb0d002a410 comp rx=0 tx=0).stop 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 -- 172.21.15.52:0/1292696475 shutdown_connections 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 --2- 172.21.15.52:0/1292696475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc10e470 0x7fb0dc1108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 --2- 172.21.15.52:0/1292696475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc10df30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 --2- 172.21.15.52:0/1292696475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc0745a0 0x7fb0dc074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 -- 172.21.15.52:0/1292696475 >> 172.21.15.52:0/1292696475 conn(0x7fb0dc0fd8d0 msgr2=0x7fb0dc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 -- 172.21.15.52:0/1292696475 shutdown_connections 2024-09-19T09:23:28.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 -- 172.21.15.52:0/1292696475 wait complete. 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 Processor -- start 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 -- start start 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.712+0000 7fb0e362a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0745a0 0x7fb0dc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e362a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e362a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc10e470 0x7fb0dc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e362a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1141d0 con 0x7fb0dc074f50 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e362a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc114050 con 0x7fb0dc10e470 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e362a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc114350 con 0x7fb0dc0745a0 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35616/0 (socket says 172.21.15.52:35616) 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 -- 172.21.15.52:0/3682359164 learned_addr learned my addr 172.21.15.52:0/3682359164 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0745a0 0x7fb0dc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc10e470 0x7fb0dc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 -- 172.21.15.52:0/3682359164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0745a0 msgr2=0x7fb0dc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0745a0 0x7fb0dc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 -- 172.21.15.52:0/3682359164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc10e470 msgr2=0x7fb0dc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc10e470 0x7fb0dc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 -- 172.21.15.52:0/3682359164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc19f5e0 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0006010 tx=0x7fb0d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0da7fc640 1 -- 172.21.15.52:0/3682359164 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d003f030 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.713+0000 7fb0da7fc640 1 -- 172.21.15.52:0/3682359164 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d0003ce0 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.714+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc19f870 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.714+0000 7fb0da7fc640 1 -- 172.21.15.52:0/3682359164 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0035070 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.714+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc1a71b0 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0da7fc640 1 -- 172.21.15.52:0/3682359164 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb0d0042030 con 0x7fb0dc074f50 2024-09-19T09:23:28.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 Processor -- start 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 -- start start 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 0x55e3ba9eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba955280 con 0x55e3ba9f0480 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba8fcb10 con 0x55e3ba9efb60 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.716+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba951240 con 0x55e3ba9fad40 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0da7fc640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 0x7fb0c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35622/0 (socket says 172.21.15.52:35622) 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 -- 172.21.15.52:0/2277205628 learned_addr learned my addr 172.21.15.52:0/2277205628 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 0x55e3ba9eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 0x7fb0c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0da7fc640 1 -- 172.21.15.52:0/3682359164 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb0d00efb40 con 0x7fb0dc074f50 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 -- 172.21.15.52:0/2277205628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 msgr2=0x55e3ba9fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 -- 172.21.15.52:0/2277205628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 msgr2=0x55e3ba9eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 0x55e3ba9eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 -- 172.21.15.52:0/2277205628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ba9091f0 con 0x55e3ba9f0480 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 0x55e3ba9eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0039f0 tx=0x7fb0cc003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c4f5e452c41125 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 0x7fb0c40a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40058c0 tx=0x7fb0d400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.717+0000 7fb0c37fe640 1 -- 172.21.15.52:0/2277205628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc004b20 con 0x55e3ba9f0480 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.718+0000 7fb0c37fe640 1 -- 172.21.15.52:0/2277205628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0cc004cc0 con 0x55e3ba9f0480 2024-09-19T09:23:28.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.718+0000 7fb0c37fe640 1 -- 172.21.15.52:0/2277205628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc012690 con 0x55e3ba9f0480 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.718+0000 7fb0e5a03740 1 -- 172.21.15.52:0/2277205628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 msgr2=0x55e3ba9fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.718+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0039f0 tx=0x7fb0cc003eb0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 -- 172.21.15.52:0/2277205628 shutdown_connections 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9f0480 0x55e3ba9fa800 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/2277205628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9efb60 0x55e3ba9eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 -- 172.21.15.52:0/2277205628 >> 172.21.15.52:0/2277205628 conn(0x55e3ba9ec0f0 msgr2=0x55e3ba9ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 -- 172.21.15.52:0/2277205628 shutdown_connections 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 -- 172.21.15.52:0/2277205628 wait complete. 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 -- start start 2024-09-19T09:23:28.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.719+0000 7fb0e5a03740 1 Processor -- start 2024-09-19T09:23:28.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3ba9f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba9fd910 con 0x55e3ba9efb60 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba90ff10 con 0x55e3ba9f0480 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e3ba9fda90 con 0x55e3ba9fad40 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e5a03740 10 client.0 _ll_register_callbacks cb 0x55e3ba8d8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35628/0 (socket says 172.21.15.52:35628) 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 -- 172.21.15.52:0/1584998282 learned_addr learned my addr 172.21.15.52:0/1584998282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3ba9f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 -- 172.21.15.52:0/1584998282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 msgr2=0x55e3ba9f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 -- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 msgr2=0x55e3ba9f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3ba9f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 -- 172.21.15.52:0/1584998282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ba6c66a0 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.720+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009cd0 tx=0x7fb0cc009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e98f3147c9b18a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005280 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb0cc005420 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0cc004cc0 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb0cc005620 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 10 client.16245 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e3baa09500 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0cc004cc0 con 0x55e3ba9efb60 2024-09-19T09:23:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb0cc00f040 con 0x55e3ba9efb60 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 10 client.16245 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 20 client.16245 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa0cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 4 client.16245 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.721+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3ba9627f0 con 0x55e3baa0a910 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.722+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa0cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.722+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa0cd00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed445adc90805d3 server_cookie=a0b169803c47b105 in_seq=0 out_seq=0 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.722+0000 7fb0c0ff9640 10 client.16245 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/1584998282 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3ba9627f0 con 0x55e3baa0a910 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0c0ff9640 10 client.16245 handle_command_reply: tid=0 2024-09-19T09:23:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 client.16245 shutdown 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 msgr2=0x55e3ba9f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009cd0 tx=0x7fb0cc009d00 comp rx=0 tx=0).stop 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 shutdown_connections 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa0cd00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0c0ff9640 0 client.16245 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3ba9f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/1584998282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3ba9f7ba0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 >> 172.21.15.52:0/1584998282 conn(0x55e3ba9ec0f0 msgr2=0x55e3ba9f1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 shutdown_connections 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 1 -- 172.21.15.52:0/1584998282 wait complete. 2024-09-19T09:23:28.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.723+0000 7fb0e5a03740 20 client.16245 trim_cache size 0 max 16384 2024-09-19T09:23:28.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 Processor -- start 2024-09-19T09:23:28.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 -- start start 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1b21a0 con 0x55e3ba9efb60 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1afa70 con 0x55e3ba9f0480 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1ad8c0 con 0x55e3ba9fad40 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35642/0 (socket says 172.21.15.52:35642) 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 -- 172.21.15.52:0/4232066696 learned_addr learned my addr 172.21.15.52:0/4232066696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 -- 172.21.15.52:0/4232066696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 msgr2=0x55e3ba9f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 -- 172.21.15.52:0/4232066696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 msgr2=0x55e3baa12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa12a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e13c6640 1 -- 172.21.15.52:0/4232066696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3ba9e7830 con 0x55e3ba9efb60 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e1bc7640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.741+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc012610 tx=0x7fb0cc0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03bbd3ce31e6121 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0c2ffd640 1 -- 172.21.15.52:0/4232066696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc035070 con 0x55e3ba9efb60 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0c2ffd640 1 -- 172.21.15.52:0/4232066696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0cc004c50 con 0x55e3ba9efb60 2024-09-19T09:23:28.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0c2ffd640 1 -- 172.21.15.52:0/4232066696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc030480 con 0x55e3ba9efb60 2024-09-19T09:23:28.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e5a03740 1 -- 172.21.15.52:0/4232066696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 msgr2=0x55e3baa12530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc012610 tx=0x7fb0cc0098a0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e5a03740 1 -- 172.21.15.52:0/4232066696 shutdown_connections 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9fad40 0x55e3ba9f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.742+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/4232066696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9efb60 0x55e3baa12530 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- 172.21.15.52:0/4232066696 >> 172.21.15.52:0/4232066696 conn(0x55e3ba9ec0f0 msgr2=0x55e3ba9f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- 172.21.15.52:0/4232066696 shutdown_connections 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- 172.21.15.52:0/4232066696 wait complete. 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- start start 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 Processor -- start 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa03540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1adf30 con 0x55e3ba9fad40 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1af3a0 con 0x55e3ba9f0480 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc1ae600 con 0x55e3ba9efb60 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.743+0000 7fb0e5a03740 10 client.0 _ll_register_callbacks cb 0x7fb0d400ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e1bc7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:44956/0 (socket says 172.21.15.52:44956) 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 -- 172.21.15.52:0/199098541 learned_addr learned my addr 172.21.15.52:0/199098541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa03540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 -- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 msgr2=0x55e3baa03540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa03540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 -- 172.21.15.52:0/199098541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9fad40 msgr2=0x55e3ba9fe450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fe450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 -- 172.21.15.52:0/199098541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3ba9fec80 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa03540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e13c6640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc012790 tx=0x7fb0cc0021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267b2306a2851e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc035040 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0cc004c50 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb0cc012d10 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb0cc0096f0 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e5a03740 10 client.25603 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.744+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e3baa75140 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0cc004c50 con 0x55e3ba9efb60 2024-09-19T09:23:28.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb0cc038070 con 0x55e3ba9efb60 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 10 client.25603 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 10 client.25603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 20 client.25603 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa77750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 4 client.25603 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e3ba95cd00 con 0x55e3baa0a910 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa77750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0e0bc5640 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa77750 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a10f04413fb6be server_cookie=100ec6ab33ef408d in_seq=0 out_seq=0 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.745+0000 7fb0c0ff9640 10 client.25603 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0c0ff9640 1 -- 172.21.15.52:0/199098541 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e3ba95cd00 con 0x55e3baa0a910 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0c0ff9640 10 client.25603 handle_command_reply: tid=0 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 client.25603 shutdown 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 msgr2=0x55e3baa03000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc012790 tx=0x7fb0cc0021d0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 shutdown_connections 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e3baa0a910 0x55e3baa77750 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e3ba9fad40 0x55e3ba9fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e3ba9f0480 0x55e3baa03540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0c0ff9640 0 client.25603 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 --2- 172.21.15.52:0/199098541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e3ba9efb60 0x55e3baa03000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.746+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 >> 172.21.15.52:0/199098541 conn(0x55e3ba9ec0f0 msgr2=0x55e3ba9f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 shutdown_connections 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e5a03740 1 -- 172.21.15.52:0/199098541 wait complete. 2024-09-19T09:23:28.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e5a03740 20 client.25603 trim_cache size 0 max 16384 2024-09-19T09:23:28.753 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:28.753 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:23:28.753 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "2878b100-dea4-439d-9842-db029e89c0c5", 2024-09-19T09:23:28.753 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:23:28.753 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 msgr2=0x7fb0c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 0x7fb0c40a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40058c0 tx=0x7fb0d400a250 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 msgr2=0x7fb0dc19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0006010 tx=0x7fb0d00042f0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 shutdown_connections 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb0dc10e470 0x7fb0dc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0dc074f50 0x7fb0dc19ab70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb0c40a3240 0x7fb0c40a5700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 --2- 172.21.15.52:0/3682359164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb0dc0745a0 0x7fb0dc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.747+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 >> 172.21.15.52:0/3682359164 conn(0x7fb0dc0fd8d0 msgr2=0x7fb0dc0fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:28.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.748+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 shutdown_connections 2024-09-19T09:23:28.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:28.748+0000 7fb0e362a640 1 -- 172.21.15.52:0/3682359164 wait complete. 2024-09-19T09:23:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:29 smithi052 ceph-mon[30947]: pgmap v399: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:29 smithi169 ceph-mon[35454]: pgmap v399: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:29.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:29 smithi086 ceph-mon[34813]: pgmap v399: 97 pgs: 97 active+clean; 928 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:29.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:23:29.780 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:30.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 -- 172.21.15.52:0/3070478838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 msgr2=0x7f99381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 --2- 172.21.15.52:0/3070478838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381067e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9928009900 tx=0x7f992802a410 comp rx=0 tx=0).stop 2024-09-19T09:23:30.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 -- 172.21.15.52:0/3070478838 shutdown_connections 2024-09-19T09:23:30.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 --2- 172.21.15.52:0/3070478838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938106f10 0x7f993810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 --2- 172.21.15.52:0/3070478838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381067e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 --2- 172.21.15.52:0/3070478838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938101de0 0x7f99381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 -- 172.21.15.52:0/3070478838 >> 172.21.15.52:0/3070478838 conn(0x7f99380fd8c0 msgr2=0x7f99380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 -- 172.21.15.52:0/3070478838 shutdown_connections 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.269+0000 7f993fd90640 1 -- 172.21.15.52:0/3070478838 wait complete. 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 Processor -- start 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 -- start start 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 0x7f9938198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 0x7f993819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9938111f70 con 0x7f9938102790 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9938111df0 con 0x7f9938106f10 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993fd90640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99381120f0 con 0x7f9938101de0 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993d32b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993d32b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35682/0 (socket says 172.21.15.52:35682) 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993d32b640 1 -- 172.21.15.52:0/2122257165 learned_addr learned my addr 172.21.15.52:0/2122257165 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993e32d640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 0x7f993819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.270+0000 7f993db2c640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 0x7f9938198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 -- 172.21.15.52:0/2122257165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 msgr2=0x7f9938198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 0x7f9938198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 -- 172.21.15.52:0/2122257165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 msgr2=0x7f993819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 0x7f993819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 -- 172.21.15.52:0/2122257165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993819d440 con 0x7f9938102790 2024-09-19T09:23:30.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993e32d640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 0x7f993819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993db2c640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 0x7f9938198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993d32b640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9928006010 tx=0x7f99280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f992effd640 1 -- 172.21.15.52:0/2122257165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992803f030 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993819d6d0 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f992effd640 1 -- 172.21.15.52:0/2122257165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9928003ce0 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99381a5010 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.271+0000 7f992effd640 1 -- 172.21.15.52:0/2122257165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928049060 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.273+0000 7f992effd640 1 -- 172.21.15.52:0/2122257165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9928042030 con 0x7f9938102790 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.273+0000 7f9942169740 1 Processor -- start 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 -- start start 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fad4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fadf680 0x55ac2fae1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac2fa3a2e0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ac2f9e1ce0 con 0x55ac2fadf680 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f9942169740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ac2fa362a0 con 0x55ac2fad44a0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f992effd640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 0x7f99240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35690/0 (socket says 172.21.15.52:35690) 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 -- 172.21.15.52:0/875297619 learned_addr learned my addr 172.21.15.52:0/875297619 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993d32b640 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fadf680 0x55ac2fae1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993e32d640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 0x7f99240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993e32d640 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fad4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f992effd640 1 -- 172.21.15.52:0/2122257165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f99280eff50 con 0x7f9938102790 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 -- 172.21.15.52:0/875297619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 msgr2=0x55ac2fad4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fad4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 -- 172.21.15.52:0/875297619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fadf680 msgr2=0x55ac2fae1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.274+0000 7f993db2c640 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fadf680 0x55ac2fae1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f993db2c640 1 -- 172.21.15.52:0/875297619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2f9c6440 con 0x55ac2fad4dc0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f993db2c640 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f993400bcc0 tx=0x7f993400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8490f6d50038ac18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f993e32d640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 0x7f99240a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9930009fd0 tx=0x7f9930009540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f9923fff640 1 -- 172.21.15.52:0/875297619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934005020 con 0x55ac2fad4dc0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f9923fff640 1 -- 172.21.15.52:0/875297619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99340047a0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.275+0000 7f9923fff640 1 -- 172.21.15.52:0/875297619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934011710 con 0x55ac2fad4dc0 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- 172.21.15.52:0/875297619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 msgr2=0x55ac2fadf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f993400bcc0 tx=0x7f993400f730 comp rx=0 tx=0).stop 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- 172.21.15.52:0/875297619 shutdown_connections 2024-09-19T09:23:30.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fadf680 0x55ac2fae1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadf140 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 --2- 172.21.15.52:0/875297619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fad4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- 172.21.15.52:0/875297619 >> 172.21.15.52:0/875297619 conn(0x55ac2fad0a30 msgr2=0x55ac2fad0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- 172.21.15.52:0/875297619 shutdown_connections 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- 172.21.15.52:0/875297619 wait complete. 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 -- start start 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.276+0000 7f9942169740 1 Processor -- start 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad44a0 0x55ac2fadef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2fadc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ac2fae2250 con 0x55ac2fad4dc0 2024-09-19T09:23:30.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ac2f9f5050 con 0x55ac2fad44a0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ac2fae23d0 con 0x55ac2fadf680 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f9942169740 10 client.0 _ll_register_callbacks cb 0x55ac2fa35160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35706/0 (socket says 172.21.15.52:35706) 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 -- 172.21.15.52:0/1284562976 learned_addr learned my addr 172.21.15.52:0/1284562976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993db2c640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad44a0 0x55ac2fadef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993e32d640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2fadc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 -- 172.21.15.52:0/1284562976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 msgr2=0x55ac2fadc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2fadc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 -- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad44a0 msgr2=0x55ac2fadef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad44a0 0x55ac2fadef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 -- 172.21.15.52:0/1284562976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2f7ab3c0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f993d32b640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f99280b1a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5caec2f63b0a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.277+0000 7f99217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928035040 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f99280b8c20 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99340047a0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f99280bbf10 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 10 client.16263 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ac2faedb70 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99340047a0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f992804ac90 con 0x55ac2fad4dc0 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 10 client.16263 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 20 client.16263 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:30.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2faeef30 0x55ac2faf13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 4 client.16263 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac2fa47850 con 0x55ac2faeef30 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.278+0000 7f993db2c640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2faeef30 0x55ac2faf13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.279+0000 7f993db2c640 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2faeef30 0x55ac2faf13a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c52ba2d5d2f3acf3 server_cookie=2abc412e2fc6106e in_seq=0 out_seq=0 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.279+0000 7f99217fa640 10 client.16263 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f99217fa640 1 -- 172.21.15.52:0/1284562976 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac2fa47850 con 0x55ac2faeef30 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f99217fa640 10 client.16263 handle_command_reply: tid=0 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 client.16263 shutdown 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 msgr2=0x55ac2fadc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9928000c00 tx=0x7f99280b1a90 comp rx=0 tx=0).stop 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 shutdown_connections 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2faeef30 0x55ac2faf13a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2fadc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad4dc0 0x55ac2fadc1d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f99217fa640 0 client.16263 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 --2- 172.21.15.52:0/1284562976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad44a0 0x55ac2fadef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 >> 172.21.15.52:0/1284562976 conn(0x55ac2fad0a30 msgr2=0x55ac2fad6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 shutdown_connections 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 1 -- 172.21.15.52:0/1284562976 wait complete. 2024-09-19T09:23:30.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.280+0000 7f9942169740 20 client.16263 trim_cache size 0 max 16384 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 Processor -- start 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 -- start start 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2faf6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2faf71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99381afff0 con 0x55ac2fad44a0 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99381ad8c0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f9942169740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99381ab710 con 0x55ac2fadf680 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.297+0000 7f993db2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35716/0 (socket says 172.21.15.52:35716) 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 -- 172.21.15.52:0/1298552041 learned_addr learned my addr 172.21.15.52:0/1298552041 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 -- 172.21.15.52:0/1298552041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 msgr2=0x55ac2faf71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2faf71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 -- 172.21.15.52:0/1298552041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 msgr2=0x55ac2faf6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2faf6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 -- 172.21.15.52:0/1298552041 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2fad4bf0 con 0x55ac2fad44a0 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f993db2c640 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f993400bcc0 tx=0x7f993400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510665b7b21d3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f99237fe640 1 -- 172.21.15.52:0/1298552041 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993402c020 con 0x55ac2fad44a0 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f99237fe640 1 -- 172.21.15.52:0/1298552041 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9934005490 con 0x55ac2fad44a0 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.298+0000 7f99237fe640 1 -- 172.21.15.52:0/1298552041 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99340276c0 con 0x55ac2fad44a0 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- 172.21.15.52:0/1298552041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 msgr2=0x55ac2faeb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f993400bcc0 tx=0x7f993400b5e0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- 172.21.15.52:0/1298552041 shutdown_connections 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fadf680 0x55ac2faf71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2faf6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 --2- 172.21.15.52:0/1298552041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fad44a0 0x55ac2faeb4b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- 172.21.15.52:0/1298552041 >> 172.21.15.52:0/1298552041 conn(0x55ac2fad0a30 msgr2=0x55ac2fadb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- 172.21.15.52:0/1298552041 shutdown_connections 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- 172.21.15.52:0/1298552041 wait complete. 2024-09-19T09:23:30.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 -- start start 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.299+0000 7f9942169740 1 Processor -- start 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fae7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2fae4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99381abd80 con 0x55ac2fadf680 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99381ad1f0 con 0x55ac2fad4dc0 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99381ac450 con 0x55ac2fad44a0 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f9942169740 10 client.0 _ll_register_callbacks cb 0x7f992803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35724/0 (socket says 172.21.15.52:35724) 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 -- 172.21.15.52:0/3850848489 learned_addr learned my addr 172.21.15.52:0/3850848489 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:30.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993d32b640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2fae4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993db2c640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fae7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 -- 172.21.15.52:0/3850848489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 msgr2=0x55ac2fae7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fae7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 -- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 msgr2=0x55ac2fae4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2fae4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 -- 172.21.15.52:0/3850848489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2fae5bc0 con 0x55ac2fadf680 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f993e32d640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f99300098c0 tx=0x7f9930009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc89fefb1d66987 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.300+0000 7f99217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9930010e60 con 0x55ac2fadf680 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f993001f620 con 0x55ac2fadf680 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9934005490 con 0x55ac2fadf680 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f993002e030 con 0x55ac2fadf680 2024-09-19T09:23:30.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 10 client.16269 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ac2fb59b80 con 0x55ac2fadf680 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9934005490 con 0x55ac2fadf680 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9930029ac0 con 0x55ac2fadf680 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 10 client.16269 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 20 client.16269 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2fb5a300 0x55ac2fb5c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 4 client.16269 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.301+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac2fa41d60 con 0x55ac2fb5a300 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f993db2c640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2fb5a300 0x55ac2fb5c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f993db2c640 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2fb5a300 0x55ac2fb5c720 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee827b89b703c5e server_cookie=4e4258929281e8b8 in_seq=0 out_seq=0 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f99217fa640 10 client.16269 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:30.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f99217fa640 1 -- 172.21.15.52:0/3850848489 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ac2fa41d60 con 0x55ac2fb5a300 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f99217fa640 10 client.16269 handle_command_reply: tid=0 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 client.16269 shutdown 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 msgr2=0x55ac2fae54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f99300098c0 tx=0x7f9930009d80 comp rx=0 tx=0).stop 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 shutdown_connections 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ac2fb5a300 0x55ac2fb5c720 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ac2fadf680 0x55ac2fae54d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ac2fad4dc0 0x55ac2fae4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f99217fa640 0 client.16269 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 --2- 172.21.15.52:0/3850848489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ac2fad44a0 0x55ac2fae7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 >> 172.21.15.52:0/3850848489 conn(0x55ac2fad0a30 msgr2=0x55ac2fadda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 shutdown_connections 2024-09-19T09:23:30.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.302+0000 7f9942169740 1 -- 172.21.15.52:0/3850848489 wait complete. 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f9942169740 20 client.16269 trim_cache size 0 max 16384 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "2878b100-dea4-439d-9842-db029e89c0c5": { 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "2878b100-dea4-439d-9842-db029e89c0c5", 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:23:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:23:30.316 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:23:30.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 msgr2=0x7f99240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 0x7f99240a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9930009fd0 tx=0x7f9930009540 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 msgr2=0x7f99381989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9928006010 tx=0x7f99280042f0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 shutdown_connections 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9938106f10 0x7f993819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9938102790 0x7f99381989d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99240a3240 0x7f99240a5700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 --2- 172.21.15.52:0/2122257165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9938101de0 0x7f9938198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 >> 172.21.15.52:0/2122257165 conn(0x7f99380fd8c0 msgr2=0x7f99380fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 shutdown_connections 2024-09-19T09:23:30.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:23:30.303+0000 7f993fd90640 1 -- 172.21.15.52:0/2122257165 wait complete. 2024-09-19T09:23:30.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:30 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:23:30.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:30 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:30.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:30 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:23:30.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:30 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:30.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:30 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:23:30.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:30 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:30.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:30 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:23:30.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:30 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:30.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:30 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:23:30.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:30 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:30 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:23:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:30 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:23:31.157 INFO:tasks.cephfs.filesystem:scrub status for tag:2878b100-dea4-439d-9842-db029e89c0c5 - {'path': '/', 'tag': '2878b100-dea4-439d-9842-db029e89c0c5', 'options': 'recursive,force'} 2024-09-19T09:23:31.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:31 smithi052 ceph-mon[30947]: pgmap v400: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:23:31.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:31 smithi169 ceph-mon[35454]: pgmap v400: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:23:31.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:31 smithi086 ceph-mon[34813]: pgmap v400: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:23:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.180+0000 7fbc83847640 1 -- 172.21.15.52:0/3679054353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 msgr2=0x7fbc7c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.180+0000 7fbc83847640 1 --2- 172.21.15.52:0/3679054353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c109fa0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbc74009ca0 tx=0x7fbc7402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 -- 172.21.15.52:0/3679054353 shutdown_connections 2024-09-19T09:23:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 --2- 172.21.15.52:0/3679054353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c109fa0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 --2- 172.21.15.52:0/3679054353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 0x7fbc7c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 --2- 172.21.15.52:0/3679054353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 -- 172.21.15.52:0/3679054353 >> 172.21.15.52:0/3679054353 conn(0x7fbc7c0fd2e0 msgr2=0x7fbc7c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 -- 172.21.15.52:0/3679054353 shutdown_connections 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 -- 172.21.15.52:0/3679054353 wait complete. 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 Processor -- start 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.181+0000 7fbc83847640 1 -- start start 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 0x7fbc7c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c10d7e0 con 0x7fbc7c103710 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c10d660 con 0x7fbc7c101b60 2024-09-19T09:23:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc83847640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c10d960 con 0x7fbc7c102d50 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc81de4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:46236/0 (socket says 172.21.15.52:46236) 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc81de4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35742/0 (socket says 172.21.15.52:35742) 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 -- 172.21.15.52:0/886373512 learned_addr learned my addr 172.21.15.52:0/886373512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc80de2640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 0x7fbc7c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 -- 172.21.15.52:0/886373512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 msgr2=0x7fbc7c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 0x7fbc7c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 -- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 msgr2=0x7fbc7c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 -- 172.21.15.52:0/886373512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc7c0753b0 con 0x7fbc7c101b60 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc81de4640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.182+0000 7fbc815e3640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e9c0 tx=0x7fbc7800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.183+0000 7fbc727fc640 1 -- 172.21.15.52:0/886373512 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800cd80 con 0x7fbc7c101b60 2024-09-19T09:23:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.183+0000 7fbc727fc640 1 -- 172.21.15.52:0/886373512 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc780035f0 con 0x7fbc7c101b60 2024-09-19T09:23:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.183+0000 7fbc727fc640 1 -- 172.21.15.52:0/886373512 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78010690 con 0x7fbc7c101b60 2024-09-19T09:23:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.183+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7c1a1ef0 con 0x7fbc7c101b60 2024-09-19T09:23:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.184+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7c1a2350 con 0x7fbc7c101b60 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.186+0000 7fbc727fc640 1 -- 172.21.15.52:0/886373512 <== mon.2 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbc780037a0 con 0x7fbc7c101b60 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.186+0000 7fbc865de740 1 Processor -- start 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.186+0000 7fbc865de740 1 -- start start 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.186+0000 7fbc865de740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d099884da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc865de740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d099889da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc865de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d09988c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc865de740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d0997e82f0 con 0x55d0998849a0 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc865de740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d099790270 con 0x55d0998852e0 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc865de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d0997e42b0 con 0x55d09988a370 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc727fc640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 0x7fbc680a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc81de4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d099884da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc81de4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d099884da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35750/0 (socket says 172.21.15.52:35750) 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc81de4640 1 -- 172.21.15.52:0/267867907 learned_addr learned my addr 172.21.15.52:0/267867907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d09988c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc81de4640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 0x7fbc680a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc815e3640 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d099889da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc727fc640 1 -- 172.21.15.52:0/886373512 <== mon.2 v2:172.21.15.86:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbc780cfc50 con 0x7fbc7c101b60 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 -- 172.21.15.52:0/267867907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 msgr2=0x55d099889da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d099889da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 -- 172.21.15.52:0/267867907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 msgr2=0x55d099884da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d099884da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 -- 172.21.15.52:0/267867907 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09978f340 con 0x55d09988a370 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc81de4640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 0x7fbc680a5830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc7402f540 tx=0x7fbc74005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.187+0000 7fbc80de2640 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d09988c830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005fd0 tx=0x7fbc6c00bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aeb1f2898ecf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc677fe640 1 -- 172.21.15.52:0/267867907 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c003bd0 con 0x55d09988a370 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc677fe640 1 -- 172.21.15.52:0/267867907 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc6c015070 con 0x55d09988a370 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc677fe640 1 -- 172.21.15.52:0/267867907 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c004d90 con 0x55d09988a370 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 -- 172.21.15.52:0/267867907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 msgr2=0x55d09988c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d09988c830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005fd0 tx=0x7fbc6c00bb20 comp rx=0 tx=0).stop 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 -- 172.21.15.52:0/267867907 shutdown_connections 2024-09-19T09:23:32.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d09988c830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d099889da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 --2- 172.21.15.52:0/267867907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d099884da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.188+0000 7fbc865de740 1 -- 172.21.15.52:0/267867907 >> 172.21.15.52:0/267867907 conn(0x55d099880010 msgr2=0x55d099880410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- 172.21.15.52:0/267867907 shutdown_connections 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- 172.21.15.52:0/267867907 wait complete. 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- start start 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 Processor -- start 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d09988f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d09988d340 con 0x55d0998849a0 2024-09-19T09:23:32.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d099771290 con 0x55d0998852e0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.189+0000 7fbc865de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d09988d4c0 con 0x55d09988a370 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc865de740 10 client.0 _ll_register_callbacks cb 0x55d0997a2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35756/0 (socket says 172.21.15.52:35756) 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 -- 172.21.15.52:0/1327984511 learned_addr learned my addr 172.21.15.52:0/1327984511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d09988f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc81de4640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 -- 172.21.15.52:0/1327984511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 msgr2=0x55d099896110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 -- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 msgr2=0x55d09988f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d09988f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 -- 172.21.15.52:0/1327984511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0994fb210 con 0x55d0998849a0 2024-09-19T09:23:32.199 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbc7809c180 tx=0x7fbc7801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ccae49f65b9bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc780a05a0 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbc780a01b0 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c015070 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbc780a4e60 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.190+0000 7fbc865de740 10 client.16281 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d0995c7620 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc6c015070 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbc7809c4e0 con 0x55d0998849a0 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 10 client.16281 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 20 client.16281 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:32.200 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09989a940 0x55d09989cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 4 client.16281 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0997f5a20 con 0x55d09989a940 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.191+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09989a940 0x55d09989cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc64ff9640 10 client.16281 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09989a940 0x55d09989cd30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f478a6686ada6f server_cookie=670a6ad59dafd427 in_seq=0 out_seq=0 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1327984511 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0997f5a20 con 0x55d09989a940 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc64ff9640 10 client.16281 handle_command_reply: tid=0 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc865de740 1 client.16281 shutdown 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 msgr2=0x55d09988ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.192+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbc7809c180 tx=0x7fbc7801c3b0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 shutdown_connections 2024-09-19T09:23:32.201 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09989a940 0x55d09989cd30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998852e0 0x55d09988f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 --2- 172.21.15.52:0/1327984511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998849a0 0x55d09988ec00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 >> 172.21.15.52:0/1327984511 conn(0x55d099880010 msgr2=0x55d099881820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc64ff9640 0 client.16281 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 shutdown_connections 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 1 -- 172.21.15.52:0/1327984511 wait complete. 2024-09-19T09:23:32.202 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.193+0000 7fbc865de740 20 client.16281 trim_cache size 0 max 16384 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.207+0000 7fbc865de740 1 Processor -- start 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.207+0000 7fbc865de740 1 -- start start 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d09988f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1adc10 con 0x55d0998852e0 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1ab4e0 con 0x55d0998849a0 2024-09-19T09:23:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc865de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1a9330 con 0x55d09988a370 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35760/0 (socket says 172.21.15.52:35760) 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 -- 172.21.15.52:0/3802198655 learned_addr learned my addr 172.21.15.52:0/3802198655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc81de4640 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc815e3640 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d09988f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 -- 172.21.15.52:0/3802198655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 msgr2=0x55d099896030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 -- 172.21.15.52:0/3802198655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 msgr2=0x55d09988f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d09988f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 -- 172.21.15.52:0/3802198655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09987fe30 con 0x55d0998852e0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc80de2640 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005fd0 tx=0x7fbc6c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5da1531aa1e2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc66ffd640 1 -- 172.21.15.52:0/3802198655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c003e50 con 0x55d0998852e0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc66ffd640 1 -- 172.21.15.52:0/3802198655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc6c015040 con 0x55d0998852e0 2024-09-19T09:23:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.208+0000 7fbc66ffd640 1 -- 172.21.15.52:0/3802198655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c019680 con 0x55d0998852e0 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- 172.21.15.52:0/3802198655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 msgr2=0x55d09989ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c005fd0 tx=0x7fbc6c005c50 comp rx=0 tx=0).stop 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- 172.21.15.52:0/3802198655 shutdown_connections 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099896030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d09989ccd0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 --2- 172.21.15.52:0/3802198655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d09988f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- 172.21.15.52:0/3802198655 >> 172.21.15.52:0/3802198655 conn(0x55d099880010 msgr2=0x55d09987e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- 172.21.15.52:0/3802198655 shutdown_connections 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- 172.21.15.52:0/3802198655 wait complete. 2024-09-19T09:23:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.209+0000 7fbc865de740 1 -- start start 2024-09-19T09:23:32.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 Processor -- start 2024-09-19T09:23:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d099893470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099894950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1a99a0 con 0x55d0998852e0 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1aae10 con 0x55d0998849a0 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7c1aa070 con 0x55d09988a370 2024-09-19T09:23:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc865de740 10 client.0 _ll_register_callbacks cb 0x7fbc7809bfc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc80de2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc80de2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35776/0 (socket says 172.21.15.52:35776) 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc80de2640 1 -- 172.21.15.52:0/1441201680 learned_addr learned my addr 172.21.15.52:0/1441201680 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d099893470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc81de4640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099894950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc80de2640 1 -- 172.21.15.52:0/1441201680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 msgr2=0x55d099894950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.210+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099894950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc80de2640 1 -- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 msgr2=0x55d099893470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:32.217 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d099893470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc80de2640 1 -- 172.21.15.52:0/1441201680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d099894f60 con 0x55d0998852e0 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d099893470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc80de2640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c004580 tx=0x7fbc6c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a707b6efbada2840 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c003c50 con 0x55d0998852e0 2024-09-19T09:23:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbc6c003df0 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c015040 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbc6c011440 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 10 client.16287 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d099896270 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc6c015040 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbc6c019bf0 con 0x55d0998852e0 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 10 client.16287 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 10 client.16287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.211+0000 7fbc865de740 20 client.16287 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09990e170 0x55d099910590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc865de740 4 client.16287 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0997efd70 con 0x55d09990e170 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09990e170 0x55d099910590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc815e3640 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09990e170 0x55d099910590 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c762650efc44e53 server_cookie=4fe83826eddd88d6 in_seq=0 out_seq=0 2024-09-19T09:23:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.212+0000 7fbc64ff9640 10 client.16287 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc64ff9640 1 -- 172.21.15.52:0/1441201680 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0997efd70 con 0x55d09990e170 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc64ff9640 10 client.16287 handle_command_reply: tid=0 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 client.16287 shutdown 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 msgr2=0x55d0998939b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c004580 tx=0x7fbc6c004290 comp rx=0 tx=0).stop 2024-09-19T09:23:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 shutdown_connections 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d09990e170 0x55d099910590 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d09988a370 0x55d099894950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d0998852e0 0x55d0998939b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc64ff9640 0 client.16287 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 --2- 172.21.15.52:0/1441201680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d0998849a0 0x55d099893470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 >> 172.21.15.52:0/1441201680 conn(0x55d099880010 msgr2=0x55d09987f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 shutdown_connections 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 1 -- 172.21.15.52:0/1441201680 wait complete. 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.223+0000 7fbc865de740 20 client.16287 trim_cache size 0 max 16384 2024-09-19T09:23:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 msgr2=0x7fbc680a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 0x7fbc680a5830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc7402f540 tx=0x7fbc74005c30 comp rx=0 tx=0).stop 2024-09-19T09:23:32.226 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 msgr2=0x7fbc7c075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800e9c0 tx=0x7fbc7800ee80 comp rx=0 tx=0).stop 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 shutdown_connections 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc7c103710 0x7fbc7c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbc680a3370 0x7fbc680a5830 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc7c102d50 0x7fbc7c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 --2- 172.21.15.52:0/886373512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc7c101b60 0x7fbc7c075fa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 >> 172.21.15.52:0/886373512 conn(0x7fbc7c0fd2e0 msgr2=0x7fbc7c105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 shutdown_connections 2024-09-19T09:23:32.227 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:32.224+0000 7fbc83847640 1 -- 172.21.15.52:0/886373512 wait complete. 2024-09-19T09:23:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:33 smithi169 ceph-mon[35454]: pgmap v401: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:33.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:33 smithi086 ceph-mon[34813]: pgmap v401: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:33 smithi052 ceph-mon[30947]: pgmap v401: 97 pgs: 97 active+clean; 985 KiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:23:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:34 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:23:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:34 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:23:34.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:34 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:23:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:35 smithi169 ceph-mon[35454]: pgmap v402: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:35.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:35 smithi086 ceph-mon[34813]: pgmap v402: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:35.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:35 smithi052 ceph-mon[30947]: pgmap v402: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:37 smithi086 ceph-mon[34813]: pgmap v403: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:37.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:37 smithi052 ceph-mon[30947]: pgmap v403: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:37.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:37 smithi169 ceph-mon[35454]: pgmap v403: 97 pgs: 97 active+clean; 1.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:39 smithi086 ceph-mon[34813]: pgmap v404: 97 pgs: 97 active+clean; 1.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:39.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:39 smithi052 ceph-mon[30947]: pgmap v404: 97 pgs: 97 active+clean; 1.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:39 smithi169 ceph-mon[35454]: pgmap v404: 97 pgs: 97 active+clean; 1.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:41.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:41 smithi086 ceph-mon[34813]: pgmap v405: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:41.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:41 smithi052 ceph-mon[30947]: pgmap v405: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:41.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:41 smithi169 ceph-mon[35454]: pgmap v405: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:23:43.494 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:43 smithi169 ceph-mon[35454]: pgmap v406: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:43.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:43 smithi086 ceph-mon[34813]: pgmap v406: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:43.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:43 smithi052 ceph-mon[30947]: pgmap v406: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/2179831260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc107840 msgr2=0x7fe3dc109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/2179831260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc107840 0x7fe3dc109cb0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4009ca0 tx=0x7fe3d402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/2179831260 shutdown_connections 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/2179831260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc107840 0x7fe3dc109cb0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/2179831260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc104f10 0x7fe3dc107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/2179831260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 0x7fe3dc1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.324+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/2179831260 >> 172.21.15.52:0/2179831260 conn(0x7fe3dc0fc1e0 msgr2=0x7fe3dc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.325+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/2179831260 shutdown_connections 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.325+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/2179831260 wait complete. 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.325+0000 7fe3e1bd8640 1 Processor -- start 2024-09-19T09:23:45.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.325+0000 7fe3e1bd8640 1 -- start start 2024-09-19T09:23:45.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 0x7fe3dc197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc107840 0x7fe3dc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10d870 con 0x7fe3dc104f10 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10d6f0 con 0x7fe3dc107840 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3e1bd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10d9f0 con 0x7fe3dc1025e0 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40906/0 (socket says 172.21.15.52:40906) 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 -- 172.21.15.52:0/3056684022 learned_addr learned my addr 172.21.15.52:0/3056684022 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc107840 0x7fe3dc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 0x7fe3dc197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 -- 172.21.15.52:0/3056684022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 msgr2=0x7fe3dc197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 0x7fe3dc197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 -- 172.21.15.52:0/3056684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc107840 msgr2=0x7fe3dc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc107840 0x7fe3dc19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 -- 172.21.15.52:0/3056684022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc19fa30 con 0x7fe3dc104f10 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.326+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d770 tx=0x7fe3d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.327+0000 7fe3d8ff9640 1 -- 172.21.15.52:0/3056684022 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0017070 con 0x7fe3dc104f10 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.327+0000 7fe3d8ff9640 1 -- 172.21.15.52:0/3056684022 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d0009c30 con 0x7fe3dc104f10 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.327+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc19fd20 con 0x7fe3dc104f10 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.327+0000 7fe3d8ff9640 1 -- 172.21.15.52:0/3056684022 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000f620 con 0x7fe3dc104f10 2024-09-19T09:23:45.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.327+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc1a0210 con 0x7fe3dc104f10 2024-09-19T09:23:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.329+0000 7fe3d8ff9640 1 -- 172.21.15.52:0/3056684022 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe3d001a070 con 0x7fe3dc104f10 2024-09-19T09:23:45.336 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.329+0000 7fe3e4a4c740 1 Processor -- start 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.329+0000 7fe3e4a4c740 1 -- start start 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c8eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142c96830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564142bf22f0 con 0x564142c8f2e0 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564142b9a270 con 0x564142c8e9a0 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564142bee2b0 con 0x564142c94370 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40914/0 (socket says 172.21.15.52:40914) 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 -- 172.21.15.52:0/62609766 learned_addr learned my addr 172.21.15.52:0/62609766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c8eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3d8ff9640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3daffd640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142c96830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 -- 172.21.15.52:0/62609766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 msgr2=0x564142c96830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142c96830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 -- 172.21.15.52:0/62609766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 msgr2=0x564142c8eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c8eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 -- 172.21.15.52:0/62609766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564142b99340 con 0x564142c8f2e0 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c8eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3d8ff9640 1 -- 172.21.15.52:0/3056684022 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3d00cf450 con 0x7fe3dc104f10 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.330+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00b760 tx=0x7fe3cc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4faf309daeb77c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3c1ffb640 1 -- 172.21.15.52:0/62609766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc003dd0 con 0x564142c8f2e0 2024-09-19T09:23:45.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3c1ffb640 1 -- 172.21.15.52:0/62609766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3cc015070 con 0x564142c8f2e0 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3c1ffb640 1 -- 172.21.15.52:0/62609766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc011440 con 0x564142c8f2e0 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/62609766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 msgr2=0x564142c93da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006010 tx=0x7fe3d40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00b760 tx=0x7fe3cc00bc20 comp rx=0 tx=0).stop 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/62609766 shutdown_connections 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142c96830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c93da0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/62609766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c8eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/62609766 >> 172.21.15.52:0/62609766 conn(0x564142c8a010 msgr2=0x564142c8a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/62609766 shutdown_connections 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.331+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/62609766 wait complete. 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 -- start start 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 Processor -- start 2024-09-19T09:23:45.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c98bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 0x564142ca0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564142c97340 con 0x564142c8f2e0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564142b7b290 con 0x564142c94370 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564142c974c0 con 0x564142c8e9a0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.332+0000 7fe3e4a4c740 10 client.0 _ll_register_callbacks cb 0x564142bac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40930/0 (socket says 172.21.15.52:40930) 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 -- 172.21.15.52:0/3935287687 learned_addr learned my addr 172.21.15.52:0/3935287687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c98bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 0x564142ca0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 -- 172.21.15.52:0/3935287687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 msgr2=0x564142c98bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c98bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 -- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 msgr2=0x564142ca0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 0x564142ca0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 -- 172.21.15.52:0/3935287687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564142905210 con 0x564142c8f2e0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 0x564142ca0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00cce70 tx=0x7fe3d009b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb9d15217d6381e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3baffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0021050 con 0x564142c8f2e0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3d00860b0 con 0x564142c8f2e0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3cc015070 con 0x564142c8f2e0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe3d00a4600 con 0x564142c8f2e0 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3e4a4c740 10 client.16299 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:45.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.333+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5641429d1620 con 0x564142c8f2e0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3cc015070 con 0x564142c8f2e0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe3d009a900 con 0x564142c8f2e0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 10 client.16299 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 20 client.16299 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142ca4870 0x564142ca6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 4 client.16299 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564142bffa20 con 0x564142ca4870 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.334+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142ca4870 0x564142ca6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142ca4870 0x564142ca6c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143a3e88a6d6435b server_cookie=8342fac3b7b0d932 in_seq=0 out_seq=0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3baffd640 10 client.16299 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3baffd640 1 -- 172.21.15.52:0/3935287687 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564142bffa20 con 0x564142ca4870 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3baffd640 10 client.16299 handle_command_reply: tid=0 2024-09-19T09:23:45.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3e4a4c740 1 client.16299 shutdown 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 msgr2=0x564142c99110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.335+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00cce70 tx=0x7fe3d009b490 comp rx=0 tx=0).stop 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 shutdown_connections 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142ca4870 0x564142ca6c60 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c94370 0x564142ca0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142c99110 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3baffd640 0 client.16299 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3935287687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c98bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 >> 172.21.15.52:0/3935287687 conn(0x564142c8a010 msgr2=0x564142c8b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 shutdown_connections 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3935287687 wait complete. 2024-09-19T09:23:45.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.336+0000 7fe3e4a4c740 20 client.16299 trim_cache size 0 max 16384 2024-09-19T09:23:45.355 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 Processor -- start 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 -- start start 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142cab520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1abac0 con 0x564142c8f2e0 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1a9390 con 0x564142c8e9a0 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1a71e0 con 0x564142c94370 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40936/0 (socket says 172.21.15.52:40936) 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 -- 172.21.15.52:0/2907958142 learned_addr learned my addr 172.21.15.52:0/2907958142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:45.356 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142cab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 -- 172.21.15.52:0/2907958142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 msgr2=0x564142cab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142cab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 -- 172.21.15.52:0/2907958142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 msgr2=0x564142c890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c890b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 -- 172.21.15.52:0/2907958142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564142ca6fd0 con 0x564142c8f2e0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.351+0000 7fe3daffd640 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0097e50 tx=0x7fe3d009fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b4c852f4c61fec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3c17fa640 1 -- 172.21.15.52:0/2907958142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0014020 con 0x564142c8f2e0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3c17fa640 1 -- 172.21.15.52:0/2907958142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d009ae90 con 0x564142c8f2e0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3c17fa640 1 -- 172.21.15.52:0/2907958142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0021070 con 0x564142c8f2e0 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/2907958142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 msgr2=0x564142ca0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0097e50 tx=0x7fe3d009fec0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.357 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/2907958142 shutdown_connections 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c94370 0x564142cab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c8f2e0 0x564142ca0110 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/2907958142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8e9a0 0x564142c890b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/2907958142 >> 172.21.15.52:0/2907958142 conn(0x564142c8a010 msgr2=0x564142c889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/2907958142 shutdown_connections 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.352+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/2907958142 wait complete. 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 -- start start 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 Processor -- start 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c9d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8f2e0 0x564142c9dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1a7850 con 0x564142c94370 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1a8cc0 con 0x564142c8f2e0 2024-09-19T09:23:45.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc1a7f20 con 0x564142c8e9a0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3e4a4c740 10 client.0 _ll_register_callbacks cb 0x7fe3d000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40942/0 (socket says 172.21.15.52:40942) 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3dbfff640 1 -- 172.21.15.52:0/3229647146 learned_addr learned my addr 172.21.15.52:0/3229647146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c9d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.353+0000 7fe3daffd640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8f2e0 0x564142c9dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 -- 172.21.15.52:0/3229647146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 msgr2=0x564142c9d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c9d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 -- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8f2e0 msgr2=0x564142c9dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8f2e0 0x564142c9dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 -- 172.21.15.52:0/3229647146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564142c9f270 con 0x564142c94370 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3dbfff640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4035000 tx=0x7fe3d402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385ae7e64ef2b93c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:45.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3baffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40045c0 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3d4004760 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d009ae90 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe3d4058030 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3e4a4c740 10 client.16305 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564142d0f500 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.354+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d009ae90 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe3d4044040 con 0x564142c94370 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 10 client.16305 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 20 client.16305 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142d0fe20 0x564142d12240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:45.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 4 client.16305 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564142bf9d70 con 0x564142d0fe20 2024-09-19T09:23:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142d0fe20 0x564142d12240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3baffd640 10 client.16305 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:45.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.355+0000 7fe3db7fe640 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142d0fe20 0x564142d12240 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e655800a5555ab7 server_cookie=8bb3ddc36c7b7fdb in_seq=0 out_seq=0 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3baffd640 1 -- 172.21.15.52:0/3229647146 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564142bf9d70 con 0x564142d0fe20 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3baffd640 10 client.16305 handle_command_reply: tid=0 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 client.16305 shutdown 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 msgr2=0x564142c9ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4035000 tx=0x7fe3d402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 shutdown_connections 2024-09-19T09:23:45.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564142d0fe20 0x564142d12240 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564142c94370 0x564142c9ec60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564142c8f2e0 0x564142c9dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3baffd640 0 client.16305 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 --2- 172.21.15.52:0/3229647146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564142c8e9a0 0x564142c9d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 >> 172.21.15.52:0/3229647146 conn(0x564142c8a010 msgr2=0x564142c8aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 shutdown_connections 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 1 -- 172.21.15.52:0/3229647146 wait complete. 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.368+0000 7fe3e4a4c740 20 client.16305 trim_cache size 0 max 16384 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:23:45.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:23:45.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:23:45.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:23:45.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 msgr2=0x7fe3c40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4006010 tx=0x7fe3d40095c0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 msgr2=0x7fe3dc198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d770 tx=0x7fe3d000dc30 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 shutdown_connections 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3dc107840 0x7fe3dc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3dc104f10 0x7fe3dc198350 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 --2- 172.21.15.52:0/3056684022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3dc1025e0 0x7fe3dc197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 >> 172.21.15.52:0/3056684022 conn(0x7fe3dc0fc1e0 msgr2=0x7fe3dc102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 shutdown_connections 2024-09-19T09:23:45.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:45.369+0000 7fe3e1bd8640 1 -- 172.21.15.52:0/3056684022 wait complete. 2024-09-19T09:23:45.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:45 smithi086 ceph-mon[34813]: pgmap v407: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:23:45.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:45 smithi052 ceph-mon[30947]: pgmap v407: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:23:45.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:45 smithi169 ceph-mon[35454]: pgmap v407: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:23:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:47 smithi086 ceph-mon[34813]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:47.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:47 smithi052 ceph-mon[30947]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:47.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:47 smithi169 ceph-mon[35454]: pgmap v408: 97 pgs: 97 active+clean; 1.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:23:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:49 smithi086 ceph-mon[34813]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:23:49.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:49 smithi052 ceph-mon[30947]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:23:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:49 smithi169 ceph-mon[35454]: pgmap v409: 97 pgs: 97 active+clean; 1.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:23:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:51 smithi086 ceph-mon[34813]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:23:51.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:51 smithi052 ceph-mon[30947]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:23:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:51 smithi169 ceph-mon[35454]: pgmap v410: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:23:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:53 smithi086 ceph-mon[34813]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:23:53.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:53 smithi052 ceph-mon[30947]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:23:53.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:53 smithi169 ceph-mon[35454]: pgmap v411: 97 pgs: 97 active+clean; 1.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:23:55.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:55 smithi086 ceph-mon[34813]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:23:55.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:55 smithi052 ceph-mon[30947]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:23:55.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:55 smithi169 ceph-mon[35454]: pgmap v412: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:23:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:57 smithi086 ceph-mon[34813]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:23:57.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:57 smithi052 ceph-mon[30947]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:23:57.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:57 smithi169 ceph-mon[35454]: pgmap v413: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:23:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 -- 172.21.15.52:0/415349593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 msgr2=0x7f7d00100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/415349593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00100e60 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009900 tx=0x7f7cf002a410 comp rx=0 tx=0).stop 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 -- 172.21.15.52:0/415349593 shutdown_connections 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/415349593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 0x7f7d00108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/415349593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 0x7f7d001020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/415349593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00100e60 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 -- 172.21.15.52:0/415349593 >> 172.21.15.52:0/415349593 conn(0x7f7d000fc1e0 msgr2=0x7f7d000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 -- 172.21.15.52:0/415349593 shutdown_connections 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.469+0000 7f7d05d8f640 1 -- 172.21.15.52:0/415349593 wait complete. 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 Processor -- start 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 -- start start 2024-09-19T09:23:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 0x7f7d00197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 0x7f7d0019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0010c6e0 con 0x7f7d00100a60 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0010c560 con 0x7f7d00101c50 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7d05d8f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0010c860 con 0x7f7d00102610 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.470+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45366/0 (socket says 172.21.15.52:45366) 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2618795603 learned_addr learned my addr 172.21.15.52:0/2618795603 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 0x7f7d00197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 0x7f7d0019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2618795603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 msgr2=0x7f7d0019e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 0x7f7d0019e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2618795603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 msgr2=0x7f7d00197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 0x7f7d00197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2618795603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0019e930 con 0x7f7d00100a60 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0031610 tx=0x7f7cf0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cfcff9640 1 -- 172.21.15.52:0/2618795603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0035070 con 0x7f7d00100a60 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cfcff9640 1 -- 172.21.15.52:0/2618795603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf0003ad0 con 0x7f7d00100a60 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0006a300 con 0x7f7d00100a60 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7cfcff9640 1 -- 172.21.15.52:0/2618795603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf003bdc0 con 0x7f7d00100a60 2024-09-19T09:23:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.471+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0006a7f0 con 0x7f7d00100a60 2024-09-19T09:23:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7cfcff9640 1 -- 172.21.15.52:0/2618795603 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7cf003b560 con 0x7f7d00100a60 2024-09-19T09:23:58.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 Processor -- start 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 -- start start 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x56144232cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x56144232f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56144228b2f0 con 0x5614423279a0 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561442233270 con 0x56144232d370 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7cfcff9640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 0x7f7ce80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7d08bff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5614422872b0 con 0x5614423282e0 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.474+0000 7f7cfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45372/0 (socket says 172.21.15.52:45372) 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 -- 172.21.15.52:0/2744268651 learned_addr learned my addr 172.21.15.52:0/2744268651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:58.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 0x7f7ce80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x56144232f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfcff9640 1 -- 172.21.15.52:0/2618795603 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7cf00f2430 con 0x7f7d00100a60 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x56144232cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 -- 172.21.15.52:0/2744268651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 msgr2=0x56144232cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x56144232cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 -- 172.21.15.52:0/2744268651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 msgr2=0x56144232f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x56144232f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 -- 172.21.15.52:0/2744268651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561442232340 con 0x5614423279a0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8012db0 tx=0x7f7cf80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda3cd642377a2dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 0x7f7ce80a57b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005c40 tx=0x7f7cf801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7ce5ffb640 1 -- 172.21.15.52:0/2744268651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800dba0 con 0x5614423279a0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7ce5ffb640 1 -- 172.21.15.52:0/2744268651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf8003e50 con 0x5614423279a0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.475+0000 7f7ce5ffb640 1 -- 172.21.15.52:0/2744268651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8004490 con 0x5614423279a0 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- 172.21.15.52:0/2744268651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 msgr2=0x561442327da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8012db0 tx=0x7f7cf80107a0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- 172.21.15.52:0/2744268651 shutdown_connections 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x56144232f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x56144232cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2744268651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442327da0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- 172.21.15.52:0/2744268651 >> 172.21.15.52:0/2744268651 conn(0x561442323010 msgr2=0x561442323410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- 172.21.15.52:0/2744268651 shutdown_connections 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- 172.21.15.52:0/2744268651 wait complete. 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.476+0000 7f7d08bff740 1 -- start start 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 Processor -- start 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423279a0 0x561442331c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442339160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5614423302e0 con 0x5614423282e0 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561442214290 con 0x5614423279a0 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561442330460 con 0x56144232d370 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7d08bff740 10 client.0 _ll_register_callbacks cb 0x561442245140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45388/0 (socket says 172.21.15.52:45388) 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7cfeffd640 1 -- 172.21.15.52:0/1920933501 learned_addr learned my addr 172.21.15.52:0/1920933501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423279a0 0x561442331c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.477+0000 7f7cfffff640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442339160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 -- 172.21.15.52:0/1920933501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 msgr2=0x561442339160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442339160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 -- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423279a0 msgr2=0x561442331c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423279a0 0x561442331c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 -- 172.21.15.52:0/1920933501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561441f9e210 con 0x5614423282e0 2024-09-19T09:23:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfffff640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442339160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400bad0 tx=0x7f7cf400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6526b10009f7e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4003e00 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7cf4005020 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf8003e50 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cf4020030 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7d08bff740 10 client.16317 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56144206a620 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.478+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf8003e50 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cf401b590 con 0x5614423282e0 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 10 client.16317 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 20 client.16317 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56144233d900 0x56144233fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 4 client.16317 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561442298a20 con 0x56144233d900 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56144233d900 0x56144233fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56144233d900 0x56144233fd10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40cfee4aa30c4a1d server_cookie=d7490fcc1e376249 in_seq=0 out_seq=0 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.479+0000 7f7cdeffd640 10 client.16317 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7cdeffd640 1 -- 172.21.15.52:0/1920933501 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561442298a20 con 0x56144233d900 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7cdeffd640 10 client.16317 handle_command_reply: tid=0 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 client.16317 shutdown 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 msgr2=0x561442332190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400bad0 tx=0x7f7cf400bf90 comp rx=0 tx=0).stop 2024-09-19T09:23:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 shutdown_connections 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56144233d900 0x56144233fd10 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442339160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423282e0 0x561442332190 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7cdeffd640 0 client.16317 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 --2- 172.21.15.52:0/1920933501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423279a0 0x561442331c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 >> 172.21.15.52:0/1920933501 conn(0x561442323010 msgr2=0x561442324820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 shutdown_connections 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.480+0000 7f7d08bff740 1 -- 172.21.15.52:0/1920933501 wait complete. 2024-09-19T09:23:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.481+0000 7f7d08bff740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T09:23:58.501 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.495+0000 7f7d08bff740 1 Processor -- start 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.495+0000 7f7d08bff740 1 -- start start 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 0x561442339120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442324400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a9900 con 0x5614423279a0 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a71d0 con 0x5614423282e0 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7d08bff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a5020 con 0x56144232d370 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45398/0 (socket says 172.21.15.52:45398) 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 -- 172.21.15.52:0/3445118585 learned_addr learned my addr 172.21.15.52:0/3445118585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:58.502 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 0x561442339120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cfffff640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442324400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 -- 172.21.15.52:0/3445118585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 msgr2=0x561442324400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442324400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 -- 172.21.15.52:0/3445118585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 msgr2=0x561442339120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 0x561442339120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 -- 172.21.15.52:0/3445118585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561442322e30 con 0x5614423279a0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 0x561442339120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0031440 tx=0x7f7cf00efd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b456620e808b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7ce57fa640 1 -- 172.21.15.52:0/3445118585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00c3eb0 con 0x5614423279a0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7ce57fa640 1 -- 172.21.15.52:0/3445118585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf00bf070 con 0x5614423279a0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.496+0000 7f7ce57fa640 1 -- 172.21.15.52:0/3445118585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00c75e0 con 0x5614423279a0 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- 172.21.15.52:0/3445118585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 msgr2=0x56144233fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.503 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0031440 tx=0x7f7cf00efd20 comp rx=0 tx=0).stop 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- 172.21.15.52:0/3445118585 shutdown_connections 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56144232d370 0x561442324400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5614423282e0 0x561442339120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 --2- 172.21.15.52:0/3445118585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x56144233fcf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- 172.21.15.52:0/3445118585 >> 172.21.15.52:0/3445118585 conn(0x561442323010 msgr2=0x5614423221c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- 172.21.15.52:0/3445118585 shutdown_connections 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- 172.21.15.52:0/3445118585 wait complete. 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.497+0000 7f7d08bff740 1 -- start start 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 Processor -- start 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x5614423374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x561442338480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.504 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a5690 con 0x5614423279a0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a6b00 con 0x56144232d370 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d001a5d60 con 0x5614423282e0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7d08bff740 10 client.0 _ll_register_callbacks cb 0x7f7cf4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45406/0 (socket says 172.21.15.52:45406) 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2329895499 learned_addr learned my addr 172.21.15.52:0/2329895499 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cfffff640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x561442338480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x5614423374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2329895499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 msgr2=0x5614423374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x5614423374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.505 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 msgr2=0x561442338480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x561442338480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cff7fe640 1 -- 172.21.15.52:0/2329895499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561442338a90 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.498+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x5614423374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cff7fe640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ba5c0 tx=0x7f7cf0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89c2c3ae7ca5852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00a90e0 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7cf0003c80 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf00bf070 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7cf00be970 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 10 client.16323 fetch_fsmap learned FSMap version 24 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5614423a8d70 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf00bf070 con 0x5614423279a0 2024-09-19T09:23:58.506 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7cf00c7150 con 0x5614423279a0 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 10 client.16323 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 20 client.16323 populate_metadata read hostname 'smithi052' 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5614423a96c0 0x5614423abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 4 client.16323 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.499+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561442322930 con 0x5614423a96c0 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.500+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5614423a96c0 0x5614423abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.500+0000 7f7cfeffd640 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5614423a96c0 0x5614423abae0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dac46be7c01b7b8 server_cookie=a4a18d2dc1f3cdb6 in_seq=0 out_seq=0 2024-09-19T09:23:58.507 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.500+0000 7f7cdeffd640 10 client.16323 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7cdeffd640 1 -- 172.21.15.52:0/2329895499 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561442322930 con 0x5614423a96c0 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7cdeffd640 10 client.16323 handle_command_reply: tid=0 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 client.16323 shutdown 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 msgr2=0x561442336f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00ba5c0 tx=0x7f7cf0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.516 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 shutdown_connections 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5614423a96c0 0x5614423abae0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56144232d370 0x561442338480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5614423282e0 0x5614423374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7cdeffd640 0 client.16323 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 --2- 172.21.15.52:0/2329895499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614423279a0 0x561442336f80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 >> 172.21.15.52:0/2329895499 conn(0x561442323010 msgr2=0x5614423233f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 shutdown_connections 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 1 -- 172.21.15.52:0/2329895499 wait complete. 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.514+0000 7f7d08bff740 20 client.16323 trim_cache size 0 max 16384 2024-09-19T09:23:58.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:23:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:23:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:23:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:23:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 msgr2=0x7f7ce80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 0x7f7ce80a57b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8005c40 tx=0x7f7cf801d000 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 msgr2=0x7f7d00196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0031610 tx=0x7f7cf0004270 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 shutdown_connections 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7ce80a32f0 0x7f7ce80a57b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d00102610 0x7f7d0019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d00101c50 0x7f7d00197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 --2- 172.21.15.52:0/2618795603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d00100a60 0x7f7d00196d20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 >> 172.21.15.52:0/2618795603 conn(0x7f7d000fc1e0 msgr2=0x7f7d00105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 shutdown_connections 2024-09-19T09:23:58.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:23:58.515+0000 7f7d05d8f640 1 -- 172.21.15.52:0/2618795603 wait complete. 2024-09-19T09:23:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:23:59 smithi086 ceph-mon[34813]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:23:59.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:23:59 smithi052 ceph-mon[30947]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:23:59.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:23:59 smithi169 ceph-mon[35454]: pgmap v414: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:01.159 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:24:01.433 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:01.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:01 smithi086 ceph-mon[34813]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:24:01.555 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:01 smithi052 ceph-mon[30947]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:24:01.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:01 smithi169 ceph-mon[35454]: pgmap v415: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:24:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 -- 172.21.15.52:0/410871947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0101420 msgr2=0x7f84f010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 --2- 172.21.15.52:0/410871947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0101420 0x7f84f010d950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009cd0 tx=0x7f84e802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 -- 172.21.15.52:0/410871947 shutdown_connections 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 --2- 172.21.15.52:0/410871947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0101420 0x7f84f010d950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 --2- 172.21.15.52:0/410871947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0100a80 0x7f84f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 --2- 172.21.15.52:0/410871947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0106a80 0x7f84f0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 -- 172.21.15.52:0/410871947 >> 172.21.15.52:0/410871947 conn(0x7f84f00fc7a0 msgr2=0x7f84f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 -- 172.21.15.52:0/410871947 shutdown_connections 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.917+0000 7f84f50e0640 1 -- 172.21.15.52:0/410871947 wait complete. 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 Processor -- start 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 -- start start 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0100a80 0x7f84f0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0101420 0x7f84f0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0110e80 con 0x7f84f0106a80 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0110d00 con 0x7f84f0100a80 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.918+0000 7f84f50e0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0111000 con 0x7f84f0101420 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45414/0 (socket says 172.21.15.52:45414) 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 -- 172.21.15.52:0/725382168 learned_addr learned my addr 172.21.15.52:0/725382168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ee59c640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0101420 0x7f84f0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84eed9d640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0100a80 0x7f84f0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 -- 172.21.15.52:0/725382168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0101420 msgr2=0x7f84f0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0101420 0x7f84f0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 -- 172.21.15.52:0/725382168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0100a80 msgr2=0x7f84f0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0100a80 0x7f84f0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 -- 172.21.15.52:0/725382168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f019d3f0 con 0x7f84f0106a80 2024-09-19T09:24:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84ef59e640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f84e8005cc0 tx=0x7f84e8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84e7fff640 1 -- 172.21.15.52:0/725382168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8004040 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f019d680 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84e7fff640 1 -- 172.21.15.52:0/725382168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e80046c0 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84e7fff640 1 -- 172.21.15.52:0/725382168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8046480 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.919+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a4fc0 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84e7fff640 1 -- 172.21.15.52:0/725382168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f84e80305a0 con 0x7f84f0106a80 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 Processor -- start 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 -- start start 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99265140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99267a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bc991c02e0 con 0x55bc9925a4a0 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc99167ce0 con 0x55bc99265680 2024-09-19T09:24:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.922+0000 7f84f74b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc991bc2a0 con 0x55bc9925adc0 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45430/0 (socket says 172.21.15.52:45430) 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 -- 172.21.15.52:0/504088520 learned_addr learned my addr 172.21.15.52:0/504088520 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84e7fff640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 0x7f84dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84eed9d640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99265140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ef59e640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 0x7f84dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99267a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 -- 172.21.15.52:0/504088520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 msgr2=0x55bc99265140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99265140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 -- 172.21.15.52:0/504088520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 msgr2=0x55bc99267a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99267a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84e7fff640 1 -- 172.21.15.52:0/725382168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f84e802e030 con 0x7f84f0106a80 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 -- 172.21.15.52:0/504088520 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc9914c440 con 0x55bc9925a4a0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84eed9d640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99265140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ee59c640 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f84d800b8c0 tx=0x7f84d8004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754d1312d90bfd0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84ef59e640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 0x7f84dc0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c5de0 tx=0x7f84e8090520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84e57fa640 1 -- 172.21.15.52:0/504088520 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003d70 con 0x55bc9925a4a0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84e57fa640 1 -- 172.21.15.52:0/504088520 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8005500 con 0x55bc9925a4a0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.923+0000 7f84e57fa640 1 -- 172.21.15.52:0/504088520 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80106c0 con 0x55bc9925a4a0 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 -- 172.21.15.52:0/504088520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 msgr2=0x55bc9925a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f84d800b8c0 tx=0x7f84d8004250 comp rx=0 tx=0).stop 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 -- 172.21.15.52:0/504088520 shutdown_connections 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99267a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99265140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 --2- 172.21.15.52:0/504088520 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc9925a880 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 -- 172.21.15.52:0/504088520 >> 172.21.15.52:0/504088520 conn(0x55bc99256a30 msgr2=0x55bc99256e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 -- 172.21.15.52:0/504088520 shutdown_connections 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.924+0000 7f84f74b9740 1 -- 172.21.15.52:0/504088520 wait complete. 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 -- start start 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 Processor -- start 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99262240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99262780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bc99268250 con 0x55bc9925a4a0 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bc9917b050 con 0x55bc99265680 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bc992683d0 con 0x55bc9925adc0 2024-09-19T09:24:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84f74b9740 10 client.0 _ll_register_callbacks cb 0x55bc991bb160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45442/0 (socket says 172.21.15.52:45442) 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.925+0000 7f84ee59c640 1 -- 172.21.15.52:0/1699498890 learned_addr learned my addr 172.21.15.52:0/1699498890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99262240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 -- 172.21.15.52:0/1699498890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 msgr2=0x55bc99262240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99262240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 -- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 msgr2=0x55bc99262780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99262780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 -- 172.21.15.52:0/1699498890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc98f313c0 con 0x55bc9925a4a0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99262240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004b00 tx=0x7f84d8004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b301deaf3380b064 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8004e50 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f84d8004ff0 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d8005500 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84d8030050 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84f74b9740 10 client.16335 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc99273bd0 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.926+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8005500 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84d801c450 con 0x55bc9925a4a0 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 10 client.16335 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 20 client.16335 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99274fe0 0x55bc992773d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 4 client.16335 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc991cd850 con 0x55bc99274fe0 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99274fe0 0x55bc992773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99274fe0 0x55bc992773d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9108ae395ddeefe server_cookie=1295d8230ceab7d5 in_seq=0 out_seq=0 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.927+0000 7f84d67fc640 10 client.16335 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84d67fc640 1 -- 172.21.15.52:0/1699498890 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc991cd850 con 0x55bc99274fe0 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84d67fc640 10 client.16335 handle_command_reply: tid=0 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 client.16335 shutdown 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 msgr2=0x55bc99264f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004b00 tx=0x7f84d8004b30 comp rx=0 tx=0).stop 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 shutdown_connections 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99274fe0 0x55bc992773d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99265680 0x55bc99262780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925adc0 0x55bc99262240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84d67fc640 0 client.16335 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1699498890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925a4a0 0x55bc99264f90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 >> 172.21.15.52:0/1699498890 conn(0x55bc99256a30 msgr2=0x55bc9925c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 shutdown_connections 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 1 -- 172.21.15.52:0/1699498890 wait complete. 2024-09-19T09:24:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.928+0000 7f84f74b9740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T09:24:01.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 Processor -- start 2024-09-19T09:24:01.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 -- start start 2024-09-19T09:24:01.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99256a30 0x55bc99255370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9927ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01affb0 con 0x55bc9925adc0 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ad880 con 0x55bc99256a30 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84f74b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ab6d0 con 0x55bc9925a4a0 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45452/0 (socket says 172.21.15.52:45452) 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84ee59c640 1 -- 172.21.15.52:0/25869343 learned_addr learned my addr 172.21.15.52:0/25869343 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84eed9d640 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9927ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.946+0000 7f84ee59c640 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99256a30 0x55bc99255370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 -- 172.21.15.52:0/25869343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 msgr2=0x55bc9927ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9927ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 -- 172.21.15.52:0/25869343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99256a30 msgr2=0x55bc99255370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99256a30 0x55bc99255370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 -- 172.21.15.52:0/25869343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc99257ae0 con 0x55bc9925adc0 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84ee59c640 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006010 tx=0x7f84d8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247e689bbc12782e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84e4ff9640 1 -- 172.21.15.52:0/25869343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80039c0 con 0x55bc9925adc0 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84e4ff9640 1 -- 172.21.15.52:0/25869343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8014030 con 0x55bc9925adc0 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.947+0000 7f84e4ff9640 1 -- 172.21.15.52:0/25869343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d801c9f0 con 0x55bc9925adc0 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- 172.21.15.52:0/25869343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 msgr2=0x55bc9927cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f84d8006010 tx=0x7f84d8005720 comp rx=0 tx=0).stop 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- 172.21.15.52:0/25869343 shutdown_connections 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc9925adc0 0x55bc9927cfa0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9927ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 --2- 172.21.15.52:0/25869343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc99256a30 0x55bc99255370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- 172.21.15.52:0/25869343 >> 172.21.15.52:0/25869343 conn(0x55bc992628e0 msgr2=0x55bc99261200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- 172.21.15.52:0/25869343 shutdown_connections 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- 172.21.15.52:0/25869343 wait complete. 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 -- start start 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.948+0000 7f84f74b9740 1 Processor -- start 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9926ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc9925adc0 0x55bc9926bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01abd40 con 0x55bc99256a30 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ad1b0 con 0x55bc9925adc0 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01ac410 con 0x55bc9925a4a0 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 10 client.0 _ll_register_callbacks cb 0x7f84d800b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45460/0 (socket says 172.21.15.52:45460) 2024-09-19T09:24:01.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 -- 172.21.15.52:0/1591882783 learned_addr learned my addr 172.21.15.52:0/1591882783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 -- 172.21.15.52:0/1591882783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 msgr2=0x55bc9926ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9926ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 -- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc9925adc0 msgr2=0x55bc9926bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc9925adc0 0x55bc9926bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 -- 172.21.15.52:0/1591882783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc992deba0 con 0x55bc99256a30 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84ee59c640 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d8003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6de070bd9cba42d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84d67fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80044a0 con 0x55bc99256a30 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f84d8004a10 con 0x55bc99256a30 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.949+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d8014030 con 0x55bc99256a30 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84d801c4c0 con 0x55bc99256a30 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 10 client.16341 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:01.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bc992dfe70 con 0x55bc99256a30 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84d8014030 con 0x55bc99256a30 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84d801d430 con 0x55bc99256a30 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 10 client.16341 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 20 client.16341 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99265680 0x55bc992e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 4 client.16341 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bc99256220 con 0x55bc99265680 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.950+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99265680 0x55bc992e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84eed9d640 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99265680 0x55bc992e2430 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6afe5717144c39a server_cookie=8da79d81b80f28c7 in_seq=0 out_seq=0 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84d67fc640 10 client.16341 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84d67fc640 1 -- 172.21.15.52:0/1591882783 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bc99256220 con 0x55bc99265680 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84d67fc640 10 client.16341 handle_command_reply: tid=0 2024-09-19T09:24:01.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 client.16341 shutdown 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 msgr2=0x55bc9926b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d8003a50 comp rx=0 tx=0).stop 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 shutdown_connections 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bc99265680 0x55bc992e2430 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bc9925adc0 0x55bc9926bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bc9925a4a0 0x55bc9926ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84d67fc640 0 client.16341 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 --2- 172.21.15.52:0/1591882783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bc99256a30 0x55bc9926b4f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 >> 172.21.15.52:0/1591882783 conn(0x55bc992628e0 msgr2=0x55bc99263aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 shutdown_connections 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 1 -- 172.21.15.52:0/1591882783 wait complete. 2024-09-19T09:24:01.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.951+0000 7f84f74b9740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T09:24:01.967 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:01.967 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:24:01.967 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:24:01.967 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 msgr2=0x7f84dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 0x7f84dc0a5700 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84e80c5de0 tx=0x7f84e8090520 comp rx=0 tx=0).stop 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 msgr2=0x7f84f019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f84e8005cc0 tx=0x7f84e8003970 comp rx=0 tx=0).stop 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 shutdown_connections 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84f0106a80 0x7f84f019cd10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84dc0a3240 0x7f84dc0a5700 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84f0101420 0x7f84f0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 --2- 172.21.15.52:0/725382168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84f0100a80 0x7f84f0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:01.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 >> 172.21.15.52:0/725382168 conn(0x7f84f00fc7a0 msgr2=0x7f84f006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:01.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 shutdown_connections 2024-09-19T09:24:01.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:01.952+0000 7f84f50e0640 1 -- 172.21.15.52:0/725382168 wait complete. 2024-09-19T09:24:02.786 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:24:02.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:24:03.054 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:03 smithi052 ceph-mon[30947]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:03.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:03 smithi086 ceph-mon[34813]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 -- 172.21.15.52:0/2645300994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102790 msgr2=0x7efcac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 --2- 172.21.15.52:0/2645300994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102790 0x7efcac1067e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009900 tx=0x7efc9c02a410 comp rx=0 tx=0).stop 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 -- 172.21.15.52:0/2645300994 shutdown_connections 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 --2- 172.21.15.52:0/2645300994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac106f10 0x7efcac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 --2- 172.21.15.52:0/2645300994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac102790 0x7efcac1067e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 --2- 172.21.15.52:0/2645300994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac101de0 0x7efcac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 -- 172.21.15.52:0/2645300994 >> 172.21.15.52:0/2645300994 conn(0x7efcac0fd8c0 msgr2=0x7efcac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 -- 172.21.15.52:0/2645300994 shutdown_connections 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.532+0000 7efcb39c6640 1 -- 172.21.15.52:0/2645300994 wait complete. 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 Processor -- start 2024-09-19T09:24:03.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 -- start start 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac101de0 0x7efcac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102790 0x7efcac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efcac111f30 con 0x7efcac106f10 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efcac111db0 con 0x7efcac101de0 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb39c6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efcac1120b0 con 0x7efcac102790 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45488/0 (socket says 172.21.15.52:45488) 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 -- 172.21.15.52:0/731389403 learned_addr learned my addr 172.21.15.52:0/731389403 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb0f61640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102790 0x7efcac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1762640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac101de0 0x7efcac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 -- 172.21.15.52:0/731389403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102790 msgr2=0x7efcac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:03.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102790 0x7efcac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 -- 172.21.15.52:0/731389403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac101de0 msgr2=0x7efcac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac101de0 0x7efcac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.533+0000 7efcb1f63640 1 -- 172.21.15.52:0/731389403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcac1a68f0 con 0x7efcac106f10 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efcb1f63640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efca400eaa0 tx=0x7efca400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca400cdb0 con 0x7efcac106f10 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efca4005020 con 0x7efcac106f10 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcac1a6be0 con 0x7efcac106f10 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca40116b0 con 0x7efcac106f10 2024-09-19T09:24:03.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.534+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcac1a70a0 con 0x7efcac106f10 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.535+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcac1021c0 con 0x7efcac106f10 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.537+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efca4005560 con 0x7efcac106f10 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.537+0000 7efca27fc640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 0x7efc980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.538+0000 7efcb1762640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 0x7efc980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.538+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efca40cfe80 con 0x7efcac106f10 2024-09-19T09:24:03.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.538+0000 7efcb1762640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 0x7efc980a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efca80058c0 tx=0x7efca800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:03.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.541+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efca4016030 con 0x7efcac106f10 2024-09-19T09:24:03.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:03 smithi169 ceph-mon[35454]: pgmap v416: 97 pgs: 97 active+clean; 1.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:03.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.753+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcac075a20 con 0x7efcac106f10 2024-09-19T09:24:03.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.754+0000 7efca27fc640 1 -- 172.21.15.52:0/731389403 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7efcac075a20 con 0x7efcac106f10 2024-09-19T09:24:03.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:24:03.757 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:24:03.757 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:24:03.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 msgr2=0x7efc980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:03.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 0x7efc980a5700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efca80058c0 tx=0x7efca800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 msgr2=0x7efcac074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:03.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efca400eaa0 tx=0x7efca400ef60 comp rx=0 tx=0).stop 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 shutdown_connections 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efcac106f10 0x7efcac074f70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efc980a3240 0x7efc980a5700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efcac102790 0x7efcac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 --2- 172.21.15.52:0/731389403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efcac101de0 0x7efcac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.756+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 >> 172.21.15.52:0/731389403 conn(0x7efcac0fd8c0 msgr2=0x7efcac0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.757+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 shutdown_connections 2024-09-19T09:24:03.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:03.757+0000 7efcb39c6640 1 -- 172.21.15.52:0/731389403 wait complete. 2024-09-19T09:24:04.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/731389403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:04.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:04 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/731389403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:04.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:24:04.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:04 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/731389403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 -- 172.21.15.52:0/1951781185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c106a80 msgr2=0x7fea5c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 --2- 172.21.15.52:0/1951781185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c106a80 0x7fea5c106e60 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009930 tx=0x7fea4c02a420 comp rx=0 tx=0).stop 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 -- 172.21.15.52:0/1951781185 shutdown_connections 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 --2- 172.21.15.52:0/1951781185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c101420 0x7fea5c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 --2- 172.21.15.52:0/1951781185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c100a80 0x7fea5c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 --2- 172.21.15.52:0/1951781185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c106a80 0x7fea5c106e60 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 -- 172.21.15.52:0/1951781185 >> 172.21.15.52:0/1951781185 conn(0x7fea5c0fc7a0 msgr2=0x7fea5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 -- 172.21.15.52:0/1951781185 shutdown_connections 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 -- 172.21.15.52:0/1951781185 wait complete. 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.269+0000 7fea6160a640 1 Processor -- start 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 -- start start 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 0x7fea5c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c106a80 0x7fea5c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c110ea0 con 0x7fea5c100a80 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c110d20 con 0x7fea5c101420 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea6160a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c111020 con 0x7fea5c106a80 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45496/0 (socket says 172.21.15.52:45496) 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 -- 172.21.15.52:0/2091630644 learned_addr learned my addr 172.21.15.52:0/2091630644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:05.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea527fc640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 0x7fea5c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c106a80 0x7fea5c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 -- 172.21.15.52:0/2091630644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c106a80 msgr2=0x7fea5c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c106a80 0x7fea5c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 -- 172.21.15.52:0/2091630644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 msgr2=0x7fea5c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 0x7fea5c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 -- 172.21.15.52:0/2091630644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5c19f5e0 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea527fc640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 0x7fea5c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.270+0000 7fea5affd640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009a50 tx=0x7fea4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.271+0000 7fea58ff9640 1 -- 172.21.15.52:0/2091630644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c03f030 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.271+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5c19f870 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.271+0000 7fea58ff9640 1 -- 172.21.15.52:0/2091630644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c003ce0 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.271+0000 7fea58ff9640 1 -- 172.21.15.52:0/2091630644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c035070 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.271+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea5c1a71b0 con 0x7fea5c100a80 2024-09-19T09:24:05.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.273+0000 7fea58ff9640 1 -- 172.21.15.52:0/2091630644 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea4c042030 con 0x7fea5c100a80 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.273+0000 7fea639e3740 1 Processor -- start 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.273+0000 7fea639e3740 1 -- start start 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b135d0 0x557d68b13a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d68a792f0 con 0x557d68b1e370 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557d68a20cf0 con 0x557d68b135d0 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea639e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d68a752b0 con 0x557d68b14b40 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45510/0 (socket says 172.21.15.52:45510) 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 -- 172.21.15.52:0/2155572340 learned_addr learned my addr 172.21.15.52:0/2155572340 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea58ff9640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 0x7fea480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea5affd640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b135d0 0x557d68b13a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 0x7fea480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea58ff9640 1 -- 172.21.15.52:0/2091630644 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fea4c0f0000 con 0x7fea5c100a80 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 -- 172.21.15.52:0/2155572340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 msgr2=0x557d68b13090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b13090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 -- 172.21.15.52:0/2155572340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b135d0 msgr2=0x557d68b13a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b135d0 0x557d68b13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea527fc640 1 -- 172.21.15.52:0/2155572340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d68a053a0 con 0x557d68b1e370 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.274+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea527fc640 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fea4400bbe0 tx=0x7fea4400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae49a562111ff77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea517fa640 1 -- 172.21.15.52:0/2155572340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44017620 con 0x557d68b1e370 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 0x7fea480a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fea54006c10 tx=0x7fea54005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea517fa640 1 -- 172.21.15.52:0/2155572340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea44017ca0 con 0x557d68b1e370 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea517fa640 1 -- 172.21.15.52:0/2155572340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4400fdd0 con 0x557d68b1e370 2024-09-19T09:24:05.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea639e3740 1 -- 172.21.15.52:0/2155572340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 msgr2=0x557d68b20760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.275+0000 7fea639e3740 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fea4400bbe0 tx=0x7fea4400d710 comp rx=0 tx=0).stop 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- 172.21.15.52:0/2155572340 shutdown_connections 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b20760 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b135d0 0x557d68b13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- 172.21.15.52:0/2155572340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- 172.21.15.52:0/2155572340 >> 172.21.15.52:0/2155572340 conn(0x557d68adc310 msgr2=0x557d68b0fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- 172.21.15.52:0/2155572340 shutdown_connections 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- 172.21.15.52:0/2155572340 wait complete. 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- start start 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 Processor -- start 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b1afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b1e370 0x557d68b1b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557d68b21070 con 0x557d68b135d0 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557d68a34060 con 0x557d68b1e370 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557d68b211f0 con 0x557d68b14b40 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea639e3740 10 client.0 _ll_register_callbacks cb 0x557d687878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45520/0 (socket says 172.21.15.52:45520) 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.276+0000 7fea5affd640 1 -- 172.21.15.52:0/2202423675 learned_addr learned my addr 172.21.15.52:0/2202423675 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea527fc640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b1afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 -- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 msgr2=0x557d68b1afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b1e370 0x557d68b1b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b1afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 -- 172.21.15.52:0/2202423675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b1e370 msgr2=0x557d68b1b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b1e370 0x557d68b1b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 -- 172.21.15.52:0/2202423675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d687ea3c0 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea527fc640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b1afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea5affd640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0bc2a0 tx=0x7fea4c08c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd02ae3b0208718 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea427fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c087440 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fea4c03bd00 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea44017ca0 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea4c0bcca0 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea639e3740 10 client.16359 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d68b2ca40 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.277+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea44017ca0 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fea4c0b8c10 con 0x557d68b135d0 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 10 client.16359 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 10 client.16359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:24:05.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 20 client.16359 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b303d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 4 client.16359 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d68a86860 con 0x557d68b2df80 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.278+0000 7fea527fc640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea427fc640 10 client.16359 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea527fc640 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b303d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3d793b32ce7fffe server_cookie=87f0fdb81d80d62c in_seq=0 out_seq=0 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea427fc640 1 -- 172.21.15.52:0/2202423675 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d68a86860 con 0x557d68b2df80 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea427fc640 10 client.16359 handle_command_reply: tid=0 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 client.16359 shutdown 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 msgr2=0x557d68b1dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0bc2a0 tx=0x7fea4c08c210 comp rx=0 tx=0).stop 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 shutdown_connections 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b303d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea427fc640 0 client.16359 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b1e370 0x557d68b1b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b14b40 0x557d68b1afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 --2- 172.21.15.52:0/2202423675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1dd30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.279+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 >> 172.21.15.52:0/2202423675 conn(0x557d68adc310 msgr2=0x557d68b15960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.280+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 shutdown_connections 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.280+0000 7fea639e3740 1 -- 172.21.15.52:0/2202423675 wait complete. 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.280+0000 7fea639e3740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 Processor -- start 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 -- start start 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b1d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 0x557d68b16120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1b2160 con 0x557d68b135d0 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1afa30 con 0x557d68b14b40 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea639e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1ad880 con 0x557d68b1e370 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45530/0 (socket says 172.21.15.52:45530) 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.293+0000 7fea5affd640 1 -- 172.21.15.52:0/529753308 learned_addr learned my addr 172.21.15.52:0/529753308 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea527fc640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b1d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 0x557d68b16120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 -- 172.21.15.52:0/529753308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 msgr2=0x557d68b16120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 0x557d68b16120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 -- 172.21.15.52:0/529753308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 msgr2=0x557d68b1d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b1d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 -- 172.21.15.52:0/529753308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d68b20f50 con 0x557d68b135d0 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 0x557d68b16120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea5affd640 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0ba850 tx=0x7fea4c0314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4028af195d5db0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea50ff9640 1 -- 172.21.15.52:0/529753308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0c5210 con 0x557d68b135d0 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea50ff9640 1 -- 172.21.15.52:0/529753308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c0bc5a0 con 0x557d68b135d0 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.294+0000 7fea50ff9640 1 -- 172.21.15.52:0/529753308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0bc850 con 0x557d68b135d0 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- 172.21.15.52:0/529753308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 msgr2=0x557d68b1cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0ba850 tx=0x7fea4c0314b0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- 172.21.15.52:0/529753308 shutdown_connections 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b1e370 0x557d68b16120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b1d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 --2- 172.21.15.52:0/529753308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b135d0 0x557d68b1cf50 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- 172.21.15.52:0/529753308 >> 172.21.15.52:0/529753308 conn(0x557d68adc310 msgr2=0x557d68b1c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- 172.21.15.52:0/529753308 shutdown_connections 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- 172.21.15.52:0/529753308 wait complete. 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 -- start start 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.295+0000 7fea639e3740 1 Processor -- start 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b135d0 0x557d68b26db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b220e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1adef0 con 0x557d68b1e370 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1af360 con 0x557d68b14b40 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fea5c1ae5c0 con 0x557d68b135d0 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 10 client.0 _ll_register_callbacks cb 0x7fea4c003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45536/0 (socket says 172.21.15.52:45536) 2024-09-19T09:24:05.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 -- 172.21.15.52:0/3047647491 learned_addr learned my addr 172.21.15.52:0/3047647491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5affd640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b135d0 0x557d68b26db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea527fc640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 -- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b135d0 msgr2=0x557d68b26db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b135d0 0x557d68b26db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 -- 172.21.15.52:0/3047647491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 msgr2=0x557d68b220e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b220e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 -- 172.21.15.52:0/3047647491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d68b97cb0 con 0x557d68b1e370 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea5b7fe640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea54015e60 tx=0x7fea54004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8738409b5f54540c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea427fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54021480 con 0x557d68b1e370 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fea54021620 con 0x557d68b1e370 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.296+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea4c0bc5a0 con 0x557d68b1e370 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea54021820 con 0x557d68b1e370 2024-09-19T09:24:05.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 10 client.16365 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d68b98e60 con 0x557d68b1e370 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c0bc5a0 con 0x557d68b1e370 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fea5402b970 con 0x557d68b1e370 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 10 client.16365 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 10 client.16365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 20 client.16365 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b9b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 4 client.16365 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.297+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d68a80d70 con 0x557d68b2df80 2024-09-19T09:24:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea5affd640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b9b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:05.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea427fc640 10 client.16365 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea5affd640 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b9b670 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84006a295e73fdcb server_cookie=c4fa84ba2258e64e in_seq=0 out_seq=0 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea427fc640 1 -- 172.21.15.52:0/3047647491 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d68a80d70 con 0x557d68b2df80 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea427fc640 10 client.16365 handle_command_reply: tid=0 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 client.16365 shutdown 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 msgr2=0x557d68b22870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fea54015e60 tx=0x7fea54004b50 comp rx=0 tx=0).stop 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 shutdown_connections 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x557d68b2df80 0x557d68b9b670 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557d68b1e370 0x557d68b22870 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557d68b14b40 0x557d68b220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 --2- 172.21.15.52:0/3047647491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557d68b135d0 0x557d68b26db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea427fc640 0 client.16365 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:05.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 >> 172.21.15.52:0/3047647491 conn(0x557d68adc310 msgr2=0x557d68b29300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.298+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 shutdown_connections 2024-09-19T09:24:05.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea639e3740 1 -- 172.21.15.52:0/3047647491 wait complete. 2024-09-19T09:24:05.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea639e3740 20 client.16365 trim_cache size 0 max 16384 2024-09-19T09:24:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 msgr2=0x7fea480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 0x7fea480a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fea54006c10 tx=0x7fea54005df0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 msgr2=0x7fea5c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009a50 tx=0x7fea4c004270 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 shutdown_connections 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fea480a3240 0x7fea480a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fea5c106a80 0x7fea5c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea5c101420 0x7fea5c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 --2- 172.21.15.52:0/2091630644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea5c100a80 0x7fea5c19a630 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 >> 172.21.15.52:0/2091630644 conn(0x7fea5c0fc7a0 msgr2=0x7fea5c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 shutdown_connections 2024-09-19T09:24:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:05.299+0000 7fea6160a640 1 -- 172.21.15.52:0/2091630644 wait complete. 2024-09-19T09:24:05.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:05 smithi086 ceph-mon[34813]: pgmap v417: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:05.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:05 smithi052 ceph-mon[30947]: pgmap v417: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:05 smithi169 ceph-mon[35454]: pgmap v417: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/600: open fd = 3 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/600: open fd = 3 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:3/600: open fd = 3 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.754 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:4/600: open fd = 3 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:5/600: open fd = 3 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:6/600: open fd = 3 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:7/600: open fd = 3 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:8/600: open fd = 3 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:9/600: open fd = 3 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:10/600: open fd = 3 2024-09-19T09:24:05.756 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:11/600: open fd = 3 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:12/600: open fd = 3 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:13/600: open fd = 3 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:14/600: open fd = 3 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:15/600: open fd = 3 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:16/600: open fd = 3 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:17/600: open fd = 3 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.758 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:18/600: open fd = 3 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:19/600: open fd = 3 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:20/600: open fd = 3 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:21/600: open fd = 3 2024-09-19T09:24:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:22/600: open fd = 3 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:23/600: open fd = 3 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:24/600: open fd = 3 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.760 INFO:tasks.workunit.client.0.smithi052.stdout:25/600: open fd = 3 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:26/600: open fd = 3 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:27/600: open fd = 3 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:28/600: open fd = 3 2024-09-19T09:24:05.761 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:29/600: open fd = 3 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:30/600: open fd = 3 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:31/600: open fd = 3 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.762 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:32/600: open fd = 3 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:33/600: open fd = 3 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:34/600: open fd = 3 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:35/600: open fd = 3 2024-09-19T09:24:05.763 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:36/600: open fd = 3 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:37/600: open fd = 3 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:38/600: open fd = 3 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.764 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:39/600: open fd = 3 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:40/600: open fd = 3 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:41/600: open fd = 3 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.765 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:42/600: open fd = 3 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:43/600: open fd = 3 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:44/600: open fd = 3 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:45/600: open fd = 3 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:46/600: open fd = 3 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:47/600: open fd = 3 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:48/600: open fd = 3 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:49/600: open fd = 3 2024-09-19T09:24:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:50/600: open fd = 3 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:51/600: open fd = 3 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:52/600: open fd = 3 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:53/600: open fd = 3 2024-09-19T09:24:05.768 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:54/600: open fd = 3 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:55/600: open fd = 3 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:56/600: open fd = 3 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.769 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:57/600: open fd = 3 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:58/600: open fd = 3 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:59/600: open fd = 3 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.770 INFO:tasks.workunit.client.0.smithi052.stdout:60/600: open fd = 3 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:61/600: open fd = 3 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:62/600: open fd = 3 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:63/600: open fd = 3 2024-09-19T09:24:05.771 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.772 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:24:05.772 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:24:05.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:24:06.227 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 -- 172.21.15.52:0/971844627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4101420 msgr2=0x7f1cd410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 --2- 172.21.15.52:0/971844627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4101420 0x7f1cd410d950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009cd0 tx=0x7f1ccc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 -- 172.21.15.52:0/971844627 shutdown_connections 2024-09-19T09:24:06.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 --2- 172.21.15.52:0/971844627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4101420 0x7f1cd410d950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 --2- 172.21.15.52:0/971844627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4100a80 0x7f1cd4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 --2- 172.21.15.52:0/971844627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 -- 172.21.15.52:0/971844627 >> 172.21.15.52:0/971844627 conn(0x7f1cd40fc7a0 msgr2=0x7f1cd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 -- 172.21.15.52:0/971844627 shutdown_connections 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.704+0000 7f1cdc588640 1 -- 172.21.15.52:0/971844627 wait complete. 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 Processor -- start 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 -- start start 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4101420 0x7f1cd41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4110e80 con 0x7f1cd4100a80 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4110d00 con 0x7f1cd4106a80 2024-09-19T09:24:06.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cdc588640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd4111000 con 0x7f1cd4101420 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45550/0 (socket says 172.21.15.52:45550) 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cda324640 1 -- 172.21.15.52:0/4191444988 learned_addr learned my addr 172.21.15.52:0/4191444988 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.705+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4101420 0x7f1cd41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 -- 172.21.15.52:0/4191444988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4101420 msgr2=0x7f1cd41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4101420 0x7f1cd41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 -- 172.21.15.52:0/4191444988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 msgr2=0x7f1cd419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 -- 172.21.15.52:0/4191444988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd419d410 con 0x7f1cd4100a80 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cda324640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c890 tx=0x7f1cd000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1ccb7fe640 1 -- 172.21.15.52:0/4191444988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0004220 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1ccb7fe640 1 -- 172.21.15.52:0/4191444988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd00043c0 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd419d700 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1ccb7fe640 1 -- 172.21.15.52:0/4191444988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00049e0 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.706+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd41a4fe0 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.708+0000 7f1ccb7fe640 1 -- 172.21.15.52:0/4191444988 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1cd00079b0 con 0x7f1cd4100a80 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 Processor -- start 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 -- start start 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216f4370 0x5641216f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56412164f2f0 con 0x5641216e95d0 2024-09-19T09:24:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5641215f6cf0 con 0x5641216eab40 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cde961740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56412164b2b0 con 0x5641216f4370 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1ccb7fe640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 0x7f1cc00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45556/0 (socket says 172.21.15.52:45556) 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cda324640 1 -- 172.21.15.52:0/1102319142 learned_addr learned my addr 172.21.15.52:0/1102319142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cdab25640 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.709+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216f4370 0x5641216f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 0x7f1cc00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1ccb7fe640 1 -- 172.21.15.52:0/4191444988 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1cd00cf950 con 0x7f1cd4100a80 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 -- 172.21.15.52:0/1102319142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216f4370 msgr2=0x5641216f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216f4370 0x5641216f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 -- 172.21.15.52:0/1102319142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 msgr2=0x5641216e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 -- 172.21.15.52:0/1102319142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641215db3a0 con 0x5641216e95d0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cda324640 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001f000 tx=0x7f1cd00054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a9db999c7a4fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cc8ff9640 1 -- 172.21.15.52:0/1102319142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd001d070 con 0x5641216e95d0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 0x7f1cc00a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006010 tx=0x7f1ccc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cc8ff9640 1 -- 172.21.15.52:0/1102319142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd009c590 con 0x5641216e95d0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.710+0000 7f1cc8ff9640 1 -- 172.21.15.52:0/1102319142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0098500 con 0x5641216e95d0 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- 172.21.15.52:0/1102319142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 msgr2=0x5641216e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1cd001f000 tx=0x7f1cd00054a0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- 172.21.15.52:0/1102319142 shutdown_connections 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216f4370 0x5641216f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e9a10 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 --2- 172.21.15.52:0/1102319142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- 172.21.15.52:0/1102319142 >> 172.21.15.52:0/1102319142 conn(0x5641216b2310 msgr2=0x5641216e5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- 172.21.15.52:0/1102319142 shutdown_connections 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- 172.21.15.52:0/1102319142 wait complete. 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.711+0000 7f1cde961740 1 -- start start 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 Processor -- start 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216e95d0 0x5641216f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641216f7010 con 0x5641216f4370 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56412160a060 con 0x5641216eab40 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5641216f7190 con 0x5641216e95d0 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cde961740 10 client.0 _ll_register_callbacks cb 0x56412135d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45566/0 (socket says 172.21.15.52:45566) 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 -- 172.21.15.52:0/4072937593 learned_addr learned my addr 172.21.15.52:0/4072937593 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cda324640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216e95d0 0x5641216f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 -- 172.21.15.52:0/4072937593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216e95d0 msgr2=0x5641216f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216e95d0 0x5641216f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 -- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 msgr2=0x5641216f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 -- 172.21.15.52:0/4072937593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641213c03c0 con 0x5641216f4370 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cdab25640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc003bf0 tx=0x7f1ccc02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686ab2fb486fe0e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.712+0000 7f1cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc043070 con 0x5641216f4370 2024-09-19T09:24:06.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1ccc004650 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd009c590 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1ccc057070 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 10 client.16377 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564121702af0 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd009c590 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1ccc030070 con 0x5641216f4370 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 10 client.16377 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 10 client.16377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 20 client.16377 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564121703fb0 0x564121706410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 4 client.16377 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.713+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56412165c860 con 0x564121703fb0 2024-09-19T09:24:06.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.714+0000 7f1cda324640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564121703fb0 0x564121706410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.714+0000 7f1cda324640 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564121703fb0 0x564121706410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec8c4fa72d55400c server_cookie=95441edb817da29a in_seq=0 out_seq=0 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.714+0000 7f1cbdffb640 10 client.16377 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cbdffb640 1 -- 172.21.15.52:0/4072937593 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56412165c860 con 0x564121703fb0 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cbdffb640 10 client.16377 handle_command_reply: tid=0 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 client.16377 shutdown 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 msgr2=0x5641216f17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc003bf0 tx=0x7f1ccc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 shutdown_connections 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216f4370 0x5641216f17e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564121703fb0 0x564121706410 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216eab40 0x5641216f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 --2- 172.21.15.52:0/4072937593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216e95d0 0x5641216f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 >> 172.21.15.52:0/4072937593 conn(0x5641216b2310 msgr2=0x5641216eb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cbdffb640 0 client.16377 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:06.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 shutdown_connections 2024-09-19T09:24:06.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 1 -- 172.21.15.52:0/4072937593 wait complete. 2024-09-19T09:24:06.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.715+0000 7f1cde961740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 Processor -- start 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 -- start start 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216ec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41b0110 con 0x5641216e95d0 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41ad9e0 con 0x5641216f4370 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cde961740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41ab830 con 0x5641216eab40 2024-09-19T09:24:06.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45576/0 (socket says 172.21.15.52:45576) 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cda324640 1 -- 172.21.15.52:0/2612643262 learned_addr learned my addr 172.21.15.52:0/2612643262 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.728+0000 7f1cdab25640 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 -- 172.21.15.52:0/2612643262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 msgr2=0x5641216ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 -- 172.21.15.52:0/2612643262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 msgr2=0x5641216ec6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216ec6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 -- 172.21.15.52:0/2612643262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641216ef5a0 con 0x5641216e95d0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cda324640 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00982f0 tx=0x7f1cd00bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fa76fde74d2433 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cbffff640 1 -- 172.21.15.52:0/2612643262 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd001d040 con 0x5641216e95d0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cbffff640 1 -- 172.21.15.52:0/2612643262 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd009c590 con 0x5641216e95d0 2024-09-19T09:24:06.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.729+0000 7f1cbffff640 1 -- 172.21.15.52:0/2612643262 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0098500 con 0x5641216e95d0 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- 172.21.15.52:0/2612643262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 msgr2=0x5641216e5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00982f0 tx=0x7f1cd00bc040 comp rx=0 tx=0).stop 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- 172.21.15.52:0/2612643262 shutdown_connections 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216ec6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- 172.21.15.52:0/2612643262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216e5e10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- 172.21.15.52:0/2612643262 >> 172.21.15.52:0/2612643262 conn(0x5641216b2310 msgr2=0x5641216e5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- 172.21.15.52:0/2612643262 shutdown_connections 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- 172.21.15.52:0/2612643262 wait complete. 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 -- start start 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 Processor -- start 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.730+0000 7f1cde961740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216f8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41abea0 con 0x5641216e95d0 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41ad310 con 0x5641216f4370 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd41ac570 con 0x5641216eab40 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 10 client.0 _ll_register_callbacks cb 0x7f1ccc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45580/0 (socket says 172.21.15.52:45580) 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 -- 172.21.15.52:0/3119293158 learned_addr learned my addr 172.21.15.52:0/3119293158 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cdab25640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 -- 172.21.15.52:0/3119293158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 msgr2=0x5641216f7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 -- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 msgr2=0x5641216f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 -- 172.21.15.52:0/3119293158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641216f8900 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cdab25640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cda324640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0098860 tx=0x7f1cd009baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86410d3c1895dc99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00a9060 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1cd0098500 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd009c590 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1cd001d040 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.731+0000 7f1cde961740 10 client.16383 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564121772f30 con 0x5641216e95d0 2024-09-19T09:24:06.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd009c590 con 0x5641216e95d0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1cd00a4670 con 0x5641216e95d0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 10 client.16383 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 10 client.16383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 20 client.16383 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5641217731b0 0x5641217755a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 4 client.16383 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564121656d70 con 0x5641217731b0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.732+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5641217731b0 0x5641217755a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cbdffb640 10 client.16383 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cd9b23640 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5641217731b0 0x5641217755a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9405a26fabc2661b server_cookie=2dae472262c7e9a1 in_seq=0 out_seq=0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cbdffb640 1 -- 172.21.15.52:0/3119293158 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564121656d70 con 0x5641217731b0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cbdffb640 10 client.16383 handle_command_reply: tid=0 2024-09-19T09:24:06.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 client.16383 shutdown 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 msgr2=0x5641216fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0098860 tx=0x7f1cd009baf0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 shutdown_connections 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5641217731b0 0x5641217755a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5641216f4370 0x5641216f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5641216eab40 0x5641216f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cbdffb640 0 client.16383 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 --2- 172.21.15.52:0/3119293158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641216e95d0 0x5641216fc9d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 >> 172.21.15.52:0/3119293158 conn(0x5641216b2310 msgr2=0x5641216e44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 shutdown_connections 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 1 -- 172.21.15.52:0/3119293158 wait complete. 2024-09-19T09:24:06.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.733+0000 7f1cde961740 20 client.16383 trim_cache size 0 max 16384 2024-09-19T09:24:06.744 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 msgr2=0x7f1cc00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 0x7f1cc00a5780 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc006010 tx=0x7f1ccc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 msgr2=0x7f1cd4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c890 tx=0x7f1cd000cd50 comp rx=0 tx=0).stop 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 shutdown_connections 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1cd4106a80 0x7f1cd419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1cc00a32c0 0x7f1cc00a5780 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1cd4101420 0x7f1cd41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 --2- 172.21.15.52:0/4191444988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cd4100a80 0x7f1cd4198460 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 >> 172.21.15.52:0/4191444988 conn(0x7f1cd40fc7a0 msgr2=0x7f1cd406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 shutdown_connections 2024-09-19T09:24:06.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:06.734+0000 7f1cdc588640 1 -- 172.21.15.52:0/4191444988 wait complete. 2024-09-19T09:24:07.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:07 smithi052 ceph-mon[30947]: pgmap v418: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:07.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:24:07.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:07 smithi086 ceph-mon[34813]: pgmap v418: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:07.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:07 smithi169 ceph-mon[35454]: pgmap v418: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:07.751 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:08.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 -- 172.21.15.52:0/2466505095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 msgr2=0x7f190810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 --2- 172.21.15.52:0/2466505095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f190810bb50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f18fc009900 tx=0x7f18fc02a480 comp rx=0 tx=0).stop 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 -- 172.21.15.52:0/2466505095 shutdown_connections 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 --2- 172.21.15.52:0/2466505095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 0x7f190810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 --2- 172.21.15.52:0/2466505095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f190810bb50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 --2- 172.21.15.52:0/2466505095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 0x7f1908103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 -- 172.21.15.52:0/2466505095 >> 172.21.15.52:0/2466505095 conn(0x7f19080fc7a0 msgr2=0x7f19080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 -- 172.21.15.52:0/2466505095 shutdown_connections 2024-09-19T09:24:08.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.239+0000 7f190e291640 1 -- 172.21.15.52:0/2466505095 wait complete. 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 Processor -- start 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 -- start start 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 0x7f19081009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 0x7f1908101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1908111fb0 con 0x7f1908103660 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1908111e30 con 0x7f190810c170 2024-09-19T09:24:08.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f190e291640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1908112130 con 0x7f1908102d40 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.240+0000 7f19077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60112/0 (socket says 172.21.15.52:60112) 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 -- 172.21.15.52:0/2995999646 learned_addr learned my addr 172.21.15.52:0/2995999646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f1907fff640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 0x7f19081009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f190c82e640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 0x7f1908101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 -- 172.21.15.52:0/2995999646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 msgr2=0x7f19081009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 0x7f19081009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 -- 172.21.15.52:0/2995999646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 msgr2=0x7f1908101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 0x7f1908101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 -- 172.21.15.52:0/2995999646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081a6920 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19077fe640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f18fc005ab0 tx=0x7f18fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19057fa640 1 -- 172.21.15.52:0/2995999646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc03f030 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19057fa640 1 -- 172.21.15.52:0/2995999646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18fc003ce0 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19081a6bb0 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f19057fa640 1 -- 172.21.15.52:0/2995999646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc035070 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.241+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19081a7090 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f19057fa640 1 -- 172.21.15.52:0/2995999646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f18fc042030 con 0x7f1908103660 2024-09-19T09:24:08.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 Processor -- start 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 -- start start 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 0x55b477e9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b477df82f0 con 0x55b477e925d0 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b477d9fcf0 con 0x55b477e93b40 2024-09-19T09:24:08.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f191066a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b477df42b0 con 0x55b477e9d370 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60120/0 (socket says 172.21.15.52:60120) 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f1907fff640 1 -- 172.21.15.52:0/1233481663 learned_addr learned my addr 172.21.15.52:0/1233481663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f19057fa640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 0x7f18f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f190c82e640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f1907fff640 1 -- 172.21.15.52:0/1233481663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 msgr2=0x55b477e9f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.244+0000 7f19077fe640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 0x55b477e9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f19057fa640 1 -- 172.21.15.52:0/2995999646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f18fc0f0050 con 0x7f1908103660 2024-09-19T09:24:08.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f1907fff640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 0x55b477e9f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f1907fff640 1 -- 172.21.15.52:0/1233481663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 msgr2=0x55b477e92090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f1907fff640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e92090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f1907fff640 1 -- 172.21.15.52:0/1233481663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b477d843a0 con 0x55b477e925d0 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f190c82e640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f19077fe640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 0x55b477e9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f190c82e640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 0x7f18f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f1907fff640 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009a70 tx=0x7f18f8009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa85d3aae603838a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f18ee7fc640 1 -- 172.21.15.52:0/1233481663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x55b477e925d0 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f18ee7fc640 1 -- 172.21.15.52:0/1233481663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8013470 con 0x55b477e925d0 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.245+0000 7f18ee7fc640 1 -- 172.21.15.52:0/1233481663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80125f0 con 0x55b477e925d0 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- 172.21.15.52:0/1233481663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 msgr2=0x55b477e92a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009a70 tx=0x7f18f8009f30 comp rx=0 tx=0).stop 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f190c82e640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 0x7f18f00a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1900005c40 tx=0x7f1900004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- 172.21.15.52:0/1233481663 shutdown_connections 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e9d370 0x55b477e9f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e92a10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 --2- 172.21.15.52:0/1233481663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e92090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- 172.21.15.52:0/1233481663 >> 172.21.15.52:0/1233481663 conn(0x55b477e5b310 msgr2=0x55b477e8ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- 172.21.15.52:0/1233481663 shutdown_connections 2024-09-19T09:24:08.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- 172.21.15.52:0/1233481663 wait complete. 2024-09-19T09:24:08.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 -- start start 2024-09-19T09:24:08.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.246+0000 7f191066a740 1 Processor -- start 2024-09-19T09:24:08.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e93b40 0x55b477e99ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e9d370 0x55b477e9a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b477ea0070 con 0x55b477e925d0 2024-09-19T09:24:08.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b477db3060 con 0x55b477e9d370 2024-09-19T09:24:08.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b477ea01f0 con 0x55b477e93b40 2024-09-19T09:24:08.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f191066a740 10 client.0 _ll_register_callbacks cb 0x55b477b068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:08.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60124/0 (socket says 172.21.15.52:60124) 2024-09-19T09:24:08.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 -- 172.21.15.52:0/3419507999 learned_addr learned my addr 172.21.15.52:0/3419507999 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f190c82e640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e9d370 0x55b477e9a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 -- 172.21.15.52:0/3419507999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e93b40 msgr2=0x55b477e99ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e93b40 0x55b477e99ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 -- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e9d370 msgr2=0x55b477e9a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e9d370 0x55b477e9a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 -- 172.21.15.52:0/3419507999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b477b693c0 con 0x55b477e925d0 2024-09-19T09:24:08.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f1907fff640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f18f8004700 tx=0x7f18f80138d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cf5fa933e6d6a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f18e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:08.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.247+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017050 con 0x55b477e925d0 2024-09-19T09:24:08.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f18f801c450 con 0x55b477e925d0 2024-09-19T09:24:08.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f8013470 con 0x55b477e925d0 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f18f802b020 con 0x55b477e925d0 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 10 client.16395 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b477eab9d0 con 0x55b477e925d0 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8013470 con 0x55b477e925d0 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f18f8030920 con 0x55b477e925d0 2024-09-19T09:24:08.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 10 client.16395 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 20 client.16395 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477eacd20 0x55b477eaf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 4 client.16395 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b477e05860 con 0x55b477eacd20 2024-09-19T09:24:08.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.248+0000 7f19077fe640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477eacd20 0x55b477eaf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.249+0000 7f18e77fe640 10 client.16395 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.249+0000 7f19077fe640 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477eacd20 0x55b477eaf110 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7526ff33d1df2172 server_cookie=9605dcc95daf542d in_seq=0 out_seq=0 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f18e77fe640 1 -- 172.21.15.52:0/3419507999 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b477e05860 con 0x55b477eacd20 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f18e77fe640 10 client.16395 handle_command_reply: tid=0 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 client.16395 shutdown 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 msgr2=0x55b477e9cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f18f8004700 tx=0x7f18f80138d0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 shutdown_connections 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477eacd20 0x55b477eaf110 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e9d370 0x55b477e9a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e93b40 0x55b477e99ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f18e77fe640 0 client.16395 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 --2- 172.21.15.52:0/3419507999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e925d0 0x55b477e9cc30 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 >> 172.21.15.52:0/3419507999 conn(0x55b477e5b310 msgr2=0x55b477e94930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 shutdown_connections 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 1 -- 172.21.15.52:0/3419507999 wait complete. 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.250+0000 7f191066a740 20 client.16395 trim_cache size 0 max 16384 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 Processor -- start 2024-09-19T09:24:08.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 -- start start 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e9f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19081b2250 con 0x55b477e5b310 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f19081afb20 con 0x55b477e93b40 2024-09-19T09:24:08.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f191066a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19081ad970 con 0x55b477e925d0 2024-09-19T09:24:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f1907fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60138/0 (socket says 172.21.15.52:60138) 2024-09-19T09:24:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f1907fff640 1 -- 172.21.15.52:0/3876155931 learned_addr learned my addr 172.21.15.52:0/3876155931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f190c82e640 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e9f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f1907fff640 1 -- 172.21.15.52:0/3876155931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 msgr2=0x55b477e997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.263+0000 7f1907fff640 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f1907fff640 1 -- 172.21.15.52:0/3876155931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 msgr2=0x55b477e9f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f1907fff640 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e9f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f1907fff640 1 -- 172.21.15.52:0/3876155931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b477e8d310 con 0x55b477e5b310 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f190c82e640 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e9f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:08.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f1907fff640 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f18f8004810 tx=0x7f18f80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aad07a0a1012d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f18edffb640 1 -- 172.21.15.52:0/3876155931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x55b477e5b310 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f18edffb640 1 -- 172.21.15.52:0/3876155931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8013940 con 0x55b477e5b310 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f18edffb640 1 -- 172.21.15.52:0/3876155931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f801c760 con 0x55b477e5b310 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f191066a740 1 -- 172.21.15.52:0/3876155931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 msgr2=0x55b477ea9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.264+0000 7f191066a740 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f18f8004810 tx=0x7f18f80094c0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- 172.21.15.52:0/3876155931 shutdown_connections 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e93b40 0x55b477e9f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- 172.21.15.52:0/3876155931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e5b310 0x55b477ea9370 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- 172.21.15.52:0/3876155931 >> 172.21.15.52:0/3876155931 conn(0x55b477e9a580 msgr2=0x55b477e8dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- 172.21.15.52:0/3876155931 shutdown_connections 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- 172.21.15.52:0/3876155931 wait complete. 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- start start 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 Processor -- start 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e5b310 0x55b477e9e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19081adfe0 con 0x55b477e93b40 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f19081af450 con 0x55b477e5b310 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19081ae6b0 con 0x55b477e925d0 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f191066a740 10 client.0 _ll_register_callbacks cb 0x7f18f80098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.265+0000 7f190c82e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60140/0 (socket says 172.21.15.52:60140) 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 -- 172.21.15.52:0/1835299695 learned_addr learned my addr 172.21.15.52:0/1835299695 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f19077fe640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f1907fff640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e5b310 0x55b477e9e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 -- 172.21.15.52:0/1835299695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 msgr2=0x55b477e9ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e9ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 -- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e5b310 msgr2=0x55b477e9e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e5b310 0x55b477e9e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 -- 172.21.15.52:0/1835299695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b477ea3df0 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f190c82e640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1900012ce0 tx=0x7f1900007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bb31de52a40d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f18e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190001edb0 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1900003970 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f8013940 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1900003b70 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f191066a740 10 client.16401 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.266+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b477f17b10 con 0x55b477e93b40 2024-09-19T09:24:08.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8013940 con 0x55b477e93b40 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1900025070 con 0x55b477e93b40 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 10 client.16401 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 20 client.16401 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477e9d370 0x55b477f1a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 4 client.16401 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b477dffd70 con 0x55b477e9d370 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f1907fff640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477e9d370 0x55b477f1a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f18e77fe640 10 client.16401 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.267+0000 7f1907fff640 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477e9d370 0x55b477f1a300 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c8c048267172f server_cookie=3389257613d171a in_seq=0 out_seq=0 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f18e77fe640 1 -- 172.21.15.52:0/1835299695 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b477dffd70 con 0x55b477e9d370 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f18e77fe640 10 client.16401 handle_command_reply: tid=0 2024-09-19T09:24:08.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 client.16401 shutdown 2024-09-19T09:24:08.298 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 msgr2=0x55b477e9f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1900012ce0 tx=0x7f1900007520 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 shutdown_connections 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b477e9d370 0x55b477f1a300 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b477e93b40 0x55b477e9f200 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b477e925d0 0x55b477e9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f18e77fe640 0 client.16401 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 --2- 172.21.15.52:0/1835299695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b477e5b310 0x55b477e9e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 >> 172.21.15.52:0/1835299695 conn(0x55b477e9a580 msgr2=0x55b477e94110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 shutdown_connections 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 1 -- 172.21.15.52:0/1835299695 wait complete. 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f191066a740 20 client.16401 trim_cache size 0 max 16384 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.268+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 msgr2=0x7f18f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 0x7f18f00a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1900005c40 tx=0x7f1900004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:08.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 msgr2=0x7f1908100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f18fc005ab0 tx=0x7f18fc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 shutdown_connections 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f190810c170 0x7f1908101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1908103660 0x7f1908100ee0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18f00a3240 0x7f18f00a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 --2- 172.21.15.52:0/2995999646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1908102d40 0x7f19081009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 >> 172.21.15.52:0/2995999646 conn(0x7f19080fc7a0 msgr2=0x7f19080fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 shutdown_connections 2024-09-19T09:24:08.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:08.269+0000 7f190e291640 1 -- 172.21.15.52:0/2995999646 wait complete. 2024-09-19T09:24:09.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:09 smithi086 ceph-mon[34813]: pgmap v419: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:09.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:09 smithi052 ceph-mon[30947]: pgmap v419: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:09.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:09 smithi169 ceph-mon[35454]: pgmap v419: 97 pgs: 97 active+clean; 1.4 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:09.931 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:24:09.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:24:10.203 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 -- 172.21.15.52:0/3291675319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f8102d40 msgr2=0x7f94f8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 --2- 172.21.15.52:0/3291675319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f8102d40 0x7f94f8103120 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009900 tx=0x7f94e802a480 comp rx=0 tx=0).stop 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 -- 172.21.15.52:0/3291675319 shutdown_connections 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 --2- 172.21.15.52:0/3291675319 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f810c170 0x7f94f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 --2- 172.21.15.52:0/3291675319 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 0x7f94f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 --2- 172.21.15.52:0/3291675319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f8102d40 0x7f94f8103120 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 -- 172.21.15.52:0/3291675319 >> 172.21.15.52:0/3291675319 conn(0x7f94f80fc7a0 msgr2=0x7f94f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.679+0000 7f94febb4640 1 -- 172.21.15.52:0/3291675319 shutdown_connections 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 -- 172.21.15.52:0/3291675319 wait complete. 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 Processor -- start 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 -- start start 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f8102d40 0x7f94f8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 0x7f94f8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8111f70 con 0x7f94f810c170 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8111df0 con 0x7f94f8103660 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94febb4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81120f0 con 0x7f94f8102d40 2024-09-19T09:24:10.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94fd151640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94fd151640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60154/0 (socket says 172.21.15.52:60154) 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94fd151640 1 -- 172.21.15.52:0/3570782627 learned_addr learned my addr 172.21.15.52:0/3570782627 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.680+0000 7f94fc950640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f8102d40 0x7f94f8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94f7fff640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 0x7f94f8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 -- 172.21.15.52:0/3570782627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f8102d40 msgr2=0x7f94f8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f8102d40 0x7f94f8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 -- 172.21.15.52:0/3570782627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 msgr2=0x7f94f8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 0x7f94f8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 -- 172.21.15.52:0/3570782627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f819d400 con 0x7f94f810c170 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94fd151640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cad0 tx=0x7f94f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94f5ffb640 1 -- 172.21.15.52:0/3570782627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f000ae20 con 0x7f94f810c170 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94f5ffb640 1 -- 172.21.15.52:0/3570782627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f0005020 con 0x7f94f810c170 2024-09-19T09:24:10.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f819d6f0 con 0x7f94f810c170 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.681+0000 7f94f5ffb640 1 -- 172.21.15.52:0/3570782627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f000f6f0 con 0x7f94f810c170 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.682+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f81a4fd0 con 0x7f94f810c170 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f94f5ffb640 1 -- 172.21.15.52:0/3570782627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f94f00051d0 con 0x7f94f810c170 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 Processor -- start 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 -- start start 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfb6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f94f5ffb640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 0x7f94e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfc4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56533cf1c280 con 0x56533cfb7480 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56533cec3b10 con 0x56533cfc1d40 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f9500f8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56533cf18240 con 0x56533cfb6b60 2024-09-19T09:24:10.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.684+0000 7f94fc950640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 0x7f94e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f5ffb640 1 -- 172.21.15.52:0/3570782627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94f00cfbc0 con 0x7f94f810c170 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60160/0 (socket says 172.21.15.52:60160) 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 -- 172.21.15.52:0/4213844458 learned_addr learned my addr 172.21.15.52:0/4213844458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfb6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 -- 172.21.15.52:0/4213844458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 msgr2=0x56533cfb6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfb6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 -- 172.21.15.52:0/4213844458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 msgr2=0x56533cfc4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfc4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 -- 172.21.15.52:0/4213844458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533ced01f0 con 0x56533cfb7480 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94fc950640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 0x7f94e00a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009230 tx=0x7f94e80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94f7fff640 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f94ec014b50 tx=0x7f94ec00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be80de4e0304fd25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94deffd640 1 -- 172.21.15.52:0/4213844458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00db70 con 0x56533cfb7480 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94deffd640 1 -- 172.21.15.52:0/4213844458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec0145b0 con 0x56533cfb7480 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.685+0000 7f94deffd640 1 -- 172.21.15.52:0/4213844458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec012cc0 con 0x56533cfb7480 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- 172.21.15.52:0/4213844458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 msgr2=0x56533cfc1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f94ec014b50 tx=0x7f94ec00b7b0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- 172.21.15.52:0/4213844458 shutdown_connections 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfc4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc1800 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 --2- 172.21.15.52:0/4213844458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfb6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- 172.21.15.52:0/4213844458 >> 172.21.15.52:0/4213844458 conn(0x56533cfb30f0 msgr2=0x56533cfb34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- 172.21.15.52:0/4213844458 shutdown_connections 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- 172.21.15.52:0/4213844458 wait complete. 2024-09-19T09:24:10.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.686+0000 7f9500f8d740 1 -- start start 2024-09-19T09:24:10.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 Processor -- start 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb7480 0x56533cfbf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533cfbf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56533cfc4910 con 0x56533cfb6b60 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56533ced6f10 con 0x56533cfb7480 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56533cfc4a90 con 0x56533cfc1d40 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f9500f8d740 10 client.0 _ll_register_callbacks cb 0x56533ce9fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f94fc950640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f94fc950640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60162/0 (socket says 172.21.15.52:60162) 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f94fc950640 1 -- 172.21.15.52:0/643345930 learned_addr learned my addr 172.21.15.52:0/643345930 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f94f7fff640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb7480 0x56533cfbf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.687+0000 7f94fd151640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533cfbf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 -- 172.21.15.52:0/643345930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 msgr2=0x56533cfbf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533cfbf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 -- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb7480 msgr2=0x56533cfbf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb7480 0x56533cfbf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 -- 172.21.15.52:0/643345930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533cc8d6a0 con 0x56533cfb6b60 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fd151640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533cfbf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94fc950640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94e8033000 tx=0x7f94e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0ded8cd0994605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e804d020 con 0x56533cfb6b60 2024-09-19T09:24:10.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94e8003a00 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ec0145b0 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94e8058050 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f9500f8d740 10 client.16413 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56533cfd0610 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.688+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec0145b0 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f94e8049cd0 con 0x56533cfb6b60 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 10 client.16413 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 20 client.16413 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533cfd1b20 0x56533cfd3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 4 client.16413 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533cf297f0 con 0x56533cfd1b20 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f94f7fff640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533cfd1b20 0x56533cfd3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f94d7fff640 10 client.16413 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.689+0000 7f94f7fff640 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533cfd1b20 0x56533cfd3f60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d2b8fba1926161d server_cookie=ec426320c3ee0d5f in_seq=0 out_seq=0 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f94d7fff640 1 -- 172.21.15.52:0/643345930 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56533cf297f0 con 0x56533cfd1b20 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f94d7fff640 10 client.16413 handle_command_reply: tid=0 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 client.16413 shutdown 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 msgr2=0x56533cfbed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94e8033000 tx=0x7f94e8009260 comp rx=0 tx=0).stop 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 shutdown_connections 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533cfd1b20 0x56533cfd3f60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533cfbf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb7480 0x56533cfbf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 --2- 172.21.15.52:0/643345930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb6b60 0x56533cfbed20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 >> 172.21.15.52:0/643345930 conn(0x56533cfb30f0 msgr2=0x56533cfb8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.690+0000 7f94d7fff640 0 client.16413 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.691+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 shutdown_connections 2024-09-19T09:24:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.691+0000 7f9500f8d740 1 -- 172.21.15.52:0/643345930 wait complete. 2024-09-19T09:24:10.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.691+0000 7f9500f8d740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 Processor -- start 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 -- start start 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfbf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfd9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81adf50 con 0x56533cfb7480 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81ab820 con 0x56533cfc1d40 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f9500f8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81a9670 con 0x56533cfb6b60 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60178/0 (socket says 172.21.15.52:60178) 2024-09-19T09:24:10.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94f7fff640 1 -- 172.21.15.52:0/449474021 learned_addr learned my addr 172.21.15.52:0/449474021 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94fd151640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfd9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94fc950640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfbf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.708+0000 7f94f7fff640 1 -- 172.21.15.52:0/449474021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 msgr2=0x56533cfbf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94f7fff640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfbf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94f7fff640 1 -- 172.21.15.52:0/449474021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 msgr2=0x56533cfd9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94f7fff640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfd9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94f7fff640 1 -- 172.21.15.52:0/449474021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56533cfae830 con 0x56533cfb7480 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94fd151640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfd9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94f7fff640 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0058c0 tx=0x7f94ec00bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769fa709fca228d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94de7fc640 1 -- 172.21.15.52:0/449474021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec02f070 con 0x56533cfb7480 2024-09-19T09:24:10.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94de7fc640 1 -- 172.21.15.52:0/449474021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec0144f0 con 0x56533cfb7480 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f94de7fc640 1 -- 172.21.15.52:0/449474021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec005280 con 0x56533cfb7480 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f9500f8d740 1 -- 172.21.15.52:0/449474021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 msgr2=0x56533cfd9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f9500f8d740 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0058c0 tx=0x7f94ec00bb70 comp rx=0 tx=0).stop 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f9500f8d740 1 -- 172.21.15.52:0/449474021 shutdown_connections 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.709+0000 7f9500f8d740 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfc1d40 0x56533cfd9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfd9830 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 --2- 172.21.15.52:0/449474021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfb6b60 0x56533cfbf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- 172.21.15.52:0/449474021 >> 172.21.15.52:0/449474021 conn(0x56533cfb30f0 msgr2=0x56533cfb8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- 172.21.15.52:0/449474021 shutdown_connections 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- 172.21.15.52:0/449474021 wait complete. 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- start start 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 Processor -- start 2024-09-19T09:24:10.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb6b60 0x56533cfc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533d03b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81a9ce0 con 0x56533cfb7480 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81ab150 con 0x56533cfb6b60 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81aa3b0 con 0x56533cfc1d40 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.710+0000 7f9500f8d740 10 client.0 _ll_register_callbacks cb 0x7f94e8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60188/0 (socket says 172.21.15.52:60188) 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 -- 172.21.15.52:0/1980774927 learned_addr learned my addr 172.21.15.52:0/1980774927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94fc950640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb6b60 0x56533cfc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94fd151640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533d03b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 -- 172.21.15.52:0/1980774927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 msgr2=0x56533d03b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533d03b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 -- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb6b60 msgr2=0x56533cfc5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb6b60 0x56533cfc5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 -- 172.21.15.52:0/1980774927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56533cfb72b0 con 0x56533cfb7480 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94fd151640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533d03b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94f7fff640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33f6d85e56451da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec02f030 con 0x56533cfb7480 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94ec00db40 con 0x56533cfb7480 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94ec0144f0 con 0x56533cfb7480 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94ec039030 con 0x56533cfb7480 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f9500f8d740 10 client.16419 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:10.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.711+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56533d03cbe0 con 0x56533cfb7480 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec0144f0 con 0x56533cfb7480 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f94ec020020 con 0x56533cfb7480 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 10 client.16419 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 20 client.16419 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533d03d0c0 0x56533d03f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 4 client.16419 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56533cf23d00 con 0x56533d03d0c0 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f94fc950640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533d03d0c0 0x56533d03f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f94fc950640 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533d03d0c0 0x56533d03f4e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13ade339abbfc7e server_cookie=71926383bd3f0ce6 in_seq=0 out_seq=0 2024-09-19T09:24:10.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.712+0000 7f94d7fff640 10 client.16419 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:10.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.713+0000 7f94d7fff640 1 -- 172.21.15.52:0/1980774927 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56533cf23d00 con 0x56533d03d0c0 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.713+0000 7f94d7fff640 10 client.16419 handle_command_reply: tid=0 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.713+0000 7f9500f8d740 1 client.16419 shutdown 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.713+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 msgr2=0x56533cfc62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.713+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec005c50 comp rx=0 tx=0).stop 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 shutdown_connections 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56533d03d0c0 0x56533d03f4e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533cfc1d40 0x56533d03b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56533cfb7480 0x56533cfc62b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 --2- 172.21.15.52:0/1980774927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56533cfb6b60 0x56533cfc5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 >> 172.21.15.52:0/1980774927 conn(0x56533cfb30f0 msgr2=0x56533cfb85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f94d7fff640 0 client.16419 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:10.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 shutdown_connections 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 1 -- 172.21.15.52:0/1980774927 wait complete. 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f9500f8d740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b96fabff-72b8-4f4a-808e-22671449fe7d", 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:24:10.721 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 msgr2=0x7f94e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 0x7f94e00a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009230 tx=0x7f94e80058d0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 msgr2=0x7f94f819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.714+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cad0 tx=0x7f94f000cf90 comp rx=0 tx=0).stop 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 shutdown_connections 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94f810c170 0x7f94f819cd20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f94f8103660 0x7f94f8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94e00a3240 0x7f94e00a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 --2- 172.21.15.52:0/3570782627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f94f8102d40 0x7f94f8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:10.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 >> 172.21.15.52:0/3570782627 conn(0x7f94f80fc7a0 msgr2=0x7f94f80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:10.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 shutdown_connections 2024-09-19T09:24:10.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:10.715+0000 7f94febb4640 1 -- 172.21.15.52:0/3570782627 wait complete. 2024-09-19T09:24:11.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:11 smithi086 ceph-mon[34813]: pgmap v420: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:11.514 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:11 smithi052 ceph-mon[30947]: pgmap v420: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:11.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:24:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 -- 172.21.15.52:0/922595559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658104ef0 msgr2=0x7f56581072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 --2- 172.21.15.52:0/922595559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658104ef0 0x7f56581072e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5644009900 tx=0x7f564402a410 comp rx=0 tx=0).stop 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 -- 172.21.15.52:0/922595559 shutdown_connections 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 --2- 172.21.15.52:0/922595559 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5658107820 0x7f5658109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 --2- 172.21.15.52:0/922595559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658104ef0 0x7f56581072e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 --2- 172.21.15.52:0/922595559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56581025c0 0x7f56581049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 -- 172.21.15.52:0/922595559 >> 172.21.15.52:0/922595559 conn(0x7f56580fc1e0 msgr2=0x7f56580fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 -- 172.21.15.52:0/922595559 shutdown_connections 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.608+0000 7f565eeb7640 1 -- 172.21.15.52:0/922595559 wait complete. 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 Processor -- start 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 -- start start 2024-09-19T09:24:11.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56581025c0 0x7f5658101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658104ef0 0x7f5658100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f565810d800 con 0x7f5658107820 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f565810d680 con 0x7f5658104ef0 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565eeb7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f565810d980 con 0x7f56581025c0 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565d454640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565d454640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60208/0 (socket says 172.21.15.52:60208) 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565d454640 1 -- 172.21.15.52:0/766064046 learned_addr learned my addr 172.21.15.52:0/766064046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:11.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.609+0000 7f565cc53640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56581025c0 0x7f5658101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f5657fff640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658104ef0 0x7f5658100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 -- 172.21.15.52:0/766064046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56581025c0 msgr2=0x7f5658101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56581025c0 0x7f5658101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 -- 172.21.15.52:0/766064046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658104ef0 msgr2=0x7f5658100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658104ef0 0x7f5658100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 -- 172.21.15.52:0/766064046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5658101340 con 0x7f5658107820 2024-09-19T09:24:11.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565d454640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f565000eb40 tx=0x7f565000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f5655ffb640 1 -- 172.21.15.52:0/766064046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650004b20 con 0x7f5658107820 2024-09-19T09:24:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f5655ffb640 1 -- 172.21.15.52:0/766064046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5650004cc0 con 0x7f5658107820 2024-09-19T09:24:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f5655ffb640 1 -- 172.21.15.52:0/766064046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650010850 con 0x7f5658107820 2024-09-19T09:24:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56581a1f50 con 0x7f5658107820 2024-09-19T09:24:11.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.610+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56581a23b0 con 0x7f5658107820 2024-09-19T09:24:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5655ffb640 1 -- 172.21.15.52:0/766064046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5650005020 con 0x7f5658107820 2024-09-19T09:24:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 Processor -- start 2024-09-19T09:24:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 -- start start 2024-09-19T09:24:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac153dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac1540830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ac149c2f0 con 0x556ac15389a0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556ac1444270 con 0x556ac153e370 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5661c4e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556ac14982b0 con 0x556ac15392e0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5655ffb640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 0x7f56480a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60224/0 (socket says 172.21.15.52:60224) 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.613+0000 7f5657fff640 1 -- 172.21.15.52:0/2697207067 learned_addr learned my addr 172.21.15.52:0/2697207067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f565d454640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 0x7f56480a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f565cc53640 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac153dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5655ffb640 1 -- 172.21.15.52:0/766064046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f56500d01c0 con 0x7f5658107820 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac1540830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 -- 172.21.15.52:0/2697207067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 msgr2=0x556ac153dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac153dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 -- 172.21.15.52:0/2697207067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 msgr2=0x556ac1540830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac1540830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 -- 172.21.15.52:0/2697207067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac1443340 con 0x556ac15389a0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f565d454640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 0x7f56480a57b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5650098bc0 tx=0x7f5650091c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5657fff640 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5644031440 tx=0x7f5644009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83923f0c5e8baff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5642ffd640 1 -- 172.21.15.52:0/2697207067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644035070 con 0x556ac15389a0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5642ffd640 1 -- 172.21.15.52:0/2697207067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644044070 con 0x556ac15389a0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.614+0000 7f5642ffd640 1 -- 172.21.15.52:0/2697207067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644004920 con 0x556ac15389a0 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- 172.21.15.52:0/2697207067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 msgr2=0x556ac1538da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5644031440 tx=0x7f5644009620 comp rx=0 tx=0).stop 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- 172.21.15.52:0/2697207067 shutdown_connections 2024-09-19T09:24:11.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac1540830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac153dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2697207067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1538da0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- 172.21.15.52:0/2697207067 >> 172.21.15.52:0/2697207067 conn(0x556ac1534010 msgr2=0x556ac1534410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- 172.21.15.52:0/2697207067 shutdown_connections 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- 172.21.15.52:0/2697207067 wait complete. 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.615+0000 7f5661c4e740 1 -- start start 2024-09-19T09:24:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 Processor -- start 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac15430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac154a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ac15412e0 con 0x556ac15389a0 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556ac1425290 con 0x556ac153e370 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556ac1541460 con 0x556ac15392e0 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5661c4e740 10 client.0 _ll_register_callbacks cb 0x556ac1456140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60230/0 (socket says 172.21.15.52:60230) 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 -- 172.21.15.52:0/1712769444 learned_addr learned my addr 172.21.15.52:0/1712769444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f565cc53640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac15430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 -- 172.21.15.52:0/1712769444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 msgr2=0x556ac15430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac15430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 -- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 msgr2=0x556ac154a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac154a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f5657fff640 1 -- 172.21.15.52:0/1712769444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac11af210 con 0x556ac15389a0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.616+0000 7f565cc53640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac15430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5657fff640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f56440314e0 tx=0x7f5644005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26814d294bdcf3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644035030 con 0x556ac15389a0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f56440037f0 con 0x556ac15389a0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5644044070 con 0x556ac15389a0 2024-09-19T09:24:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56440039f0 con 0x556ac15389a0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 10 client.16431 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ac127b620 con 0x556ac15389a0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644044070 con 0x556ac15389a0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f564403dcd0 con 0x556ac15389a0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 10 client.16431 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 20 client.16431 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac154e4b0 0x556ac15508e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 4 client.16431 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.617+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ac14a9a20 con 0x556ac154e4b0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.618+0000 7f565cc53640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac154e4b0 0x556ac15508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.618+0000 7f565cc53640 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac154e4b0 0x556ac15508e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cee3a9dccdbe9597 server_cookie=14bc1188bb568386 in_seq=0 out_seq=0 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.618+0000 7f5637fff640 10 client.16431 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5637fff640 1 -- 172.21.15.52:0/1712769444 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ac14a9a20 con 0x556ac154e4b0 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5637fff640 10 client.16431 handle_command_reply: tid=0 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 client.16431 shutdown 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 msgr2=0x556ac1542b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f56440314e0 tx=0x7f5644005b70 comp rx=0 tx=0).stop 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 shutdown_connections 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac154e4b0 0x556ac15508e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac153e370 0x556ac154a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac15430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5637fff640 0 client.16431 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 --2- 172.21.15.52:0/1712769444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac15389a0 0x556ac1542b90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 >> 172.21.15.52:0/1712769444 conn(0x556ac1534010 msgr2=0x556ac1535820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 shutdown_connections 2024-09-19T09:24:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 1 -- 172.21.15.52:0/1712769444 wait complete. 2024-09-19T09:24:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.619+0000 7f5661c4e740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 Processor -- start 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 -- start start 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15389a0 0x556ac15339b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac154a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56581adc00 con 0x556ac153e370 2024-09-19T09:24:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56581ab4d0 con 0x556ac15389a0 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5661c4e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56581a9320 con 0x556ac15392e0 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60232/0 (socket says 172.21.15.52:60232) 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 -- 172.21.15.52:0/2674364655 learned_addr learned my addr 172.21.15.52:0/2674364655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15389a0 0x556ac15339b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f565cc53640 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac154a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 -- 172.21.15.52:0/2674364655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 msgr2=0x556ac154a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac154a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 -- 172.21.15.52:0/2674364655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15389a0 msgr2=0x556ac15339b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15389a0 0x556ac15339b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 -- 172.21.15.52:0/2674364655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ac15426d0 con 0x556ac153e370 2024-09-19T09:24:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.634+0000 7f5657fff640 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f56440059d0 tx=0x7f5644031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fe6a53edf46fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f56427fc640 1 -- 172.21.15.52:0/2674364655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644035070 con 0x556ac153e370 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f56427fc640 1 -- 172.21.15.52:0/2674364655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644044040 con 0x556ac153e370 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f56427fc640 1 -- 172.21.15.52:0/2674364655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644060840 con 0x556ac153e370 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 -- 172.21.15.52:0/2674364655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 msgr2=0x556ac1542fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f56440059d0 tx=0x7f5644031400 comp rx=0 tx=0).stop 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 -- 172.21.15.52:0/2674364655 shutdown_connections 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1542fb0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15392e0 0x556ac154a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 --2- 172.21.15.52:0/2674364655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15389a0 0x556ac15339b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 -- 172.21.15.52:0/2674364655 >> 172.21.15.52:0/2674364655 conn(0x556ac1534010 msgr2=0x556ac15356e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.635+0000 7f5661c4e740 1 -- 172.21.15.52:0/2674364655 shutdown_connections 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 -- 172.21.15.52:0/2674364655 wait complete. 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 -- start start 2024-09-19T09:24:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 Processor -- start 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15389a0 0x556ac1547c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15392e0 0x556ac15481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56581a9990 con 0x556ac153e370 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56581aae00 con 0x556ac15392e0 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56581aa060 con 0x556ac15389a0 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5661c4e740 10 client.0 _ll_register_callbacks cb 0x7f564c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5657fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60240/0 (socket says 172.21.15.52:60240) 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.636+0000 7f5657fff640 1 -- 172.21.15.52:0/3175693062 learned_addr learned my addr 172.21.15.52:0/3175693062 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f565cc53640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15392e0 0x556ac15481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15389a0 0x556ac1547c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 -- 172.21.15.52:0/3175693062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15389a0 msgr2=0x556ac1547c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15389a0 0x556ac1547c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 -- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15392e0 msgr2=0x556ac15481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15392e0 0x556ac15481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 -- 172.21.15.52:0/3175693062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ac15497a0 con 0x556ac153e370 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5657fff640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x556ac1547260 tx=0x7f564402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1277d6c02988a818 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5637fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644035070 con 0x556ac153e370 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f564403d450 con 0x556ac153e370 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5644044040 con 0x556ac153e370 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f564403a580 con 0x556ac153e370 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5661c4e740 10 client.16437 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ac15b95f0 con 0x556ac153e370 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.637+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5644044040 con 0x556ac153e370 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5644060810 con 0x556ac153e370 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 10 client.16437 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 20 client.16437 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac15b9e60 0x556ac15bc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 4 client.16437 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ac14a3d70 con 0x556ac15b9e60 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.638+0000 7f565cc53640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac15b9e60 0x556ac15bc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.639+0000 7f5637fff640 10 client.16437 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.639+0000 7f565cc53640 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac15b9e60 0x556ac15bc280 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21200e03fa707cc9 server_cookie=98288d90bc2c8689 in_seq=0 out_seq=0 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5637fff640 1 -- 172.21.15.52:0/3175693062 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ac14a3d70 con 0x556ac15b9e60 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5637fff640 10 client.16437 handle_command_reply: tid=0 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 client.16437 shutdown 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 msgr2=0x556ac1549190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x556ac1547260 tx=0x7f564402a410 comp rx=0 tx=0).stop 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 shutdown_connections 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ac15b9e60 0x556ac15bc280 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.652 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ac153e370 0x556ac1549190 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ac15392e0 0x556ac15481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5637fff640 0 client.16437 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 --2- 172.21.15.52:0/3175693062 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ac15389a0 0x556ac1547c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 >> 172.21.15.52:0/3175693062 conn(0x556ac1534010 msgr2=0x556ac15329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 shutdown_connections 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 1 -- 172.21.15.52:0/3175693062 wait complete. 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.650+0000 7f5661c4e740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:24:11.653 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:24:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:24:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 msgr2=0x7f56480a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 0x7f56480a57b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5650098bc0 tx=0x7f5650091c40 comp rx=0 tx=0).stop 2024-09-19T09:24:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 msgr2=0x7f5658100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.654 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f565000eb40 tx=0x7f565000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 shutdown_connections 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5658107820 0x7f5658100ab0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5658104ef0 0x7f5658100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56480a32f0 0x7f56480a57b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 --2- 172.21.15.52:0/766064046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56581025c0 0x7f5658101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 >> 172.21.15.52:0/766064046 conn(0x7f56580fc1e0 msgr2=0x7f5658102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 shutdown_connections 2024-09-19T09:24:11.655 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:11.651+0000 7f565eeb7640 1 -- 172.21.15.52:0/766064046 wait complete. 2024-09-19T09:24:11.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:11 smithi169 ceph-mon[35454]: pgmap v420: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:24:11.781 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 -- 172.21.15.52:0/739627560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc10c170 msgr2=0x7fccbc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 --2- 172.21.15.52:0/739627560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc10c170 0x7fccbc10e610 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009ca0 tx=0x7fccb402a950 comp rx=0 tx=0).stop 2024-09-19T09:24:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 -- 172.21.15.52:0/739627560 shutdown_connections 2024-09-19T09:24:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 --2- 172.21.15.52:0/739627560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc10c170 0x7fccbc10e610 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 --2- 172.21.15.52:0/739627560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc103660 0x7fccbc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 --2- 172.21.15.52:0/739627560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 0x7fccbc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 -- 172.21.15.52:0/739627560 >> 172.21.15.52:0/739627560 conn(0x7fccbc0fc7a0 msgr2=0x7fccbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 -- 172.21.15.52:0/739627560 shutdown_connections 2024-09-19T09:24:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.227+0000 7fccc162f640 1 -- 172.21.15.52:0/739627560 wait complete. 2024-09-19T09:24:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 Processor -- start 2024-09-19T09:24:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 -- start start 2024-09-19T09:24:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 0x7fccbc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc10c170 0x7fccbc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111fb0 con 0x7fccbc103660 2024-09-19T09:24:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111e30 con 0x7fccbc10c170 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccc162f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc112130 con 0x7fccbc102d40 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60248/0 (socket says 172.21.15.52:60248) 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.228+0000 7fccb3fff640 1 -- 172.21.15.52:0/2720680598 learned_addr learned my addr 172.21.15.52:0/2720680598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc10c170 0x7fccbc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccbaffd640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 0x7fccbc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 -- 172.21.15.52:0/2720680598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 msgr2=0x7fccbc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 0x7fccbc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 -- 172.21.15.52:0/2720680598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc10c170 msgr2=0x7fccbc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc10c170 0x7fccbc19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 -- 172.21.15.52:0/2720680598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc19d380 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb3fff640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c970 tx=0x7fcca400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb8ff9640 1 -- 172.21.15.52:0/2720680598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4007bb0 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb8ff9640 1 -- 172.21.15.52:0/2720680598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca4007d50 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc19d670 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccb8ff9640 1 -- 172.21.15.52:0/2720680598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4018820 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.229+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc1a4f50 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.231+0000 7fccb8ff9640 1 -- 172.21.15.52:0/2720680598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcca40189c0 con 0x7fccbc103660 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 Processor -- start 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 -- start start 2024-09-19T09:24:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d801363880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d80136e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccb8ff9640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 0x7fcca80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8012c92e0 con 0x55d80136e680 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d801270ce0 con 0x55d801363dc0 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.232+0000 7fccc3a08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8012c52a0 con 0x55d8013634a0 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 0x7fcca80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60250/0 (socket says 172.21.15.52:60250) 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 -- 172.21.15.52:0/1538817734 learned_addr learned my addr 172.21.15.52:0/1538817734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d80136e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d801363880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb8ff9640 1 -- 172.21.15.52:0/2720680598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcca40cf9a0 con 0x7fccbc103660 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 -- 172.21.15.52:0/1538817734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 msgr2=0x55d801363880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d801363880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 -- 172.21.15.52:0/1538817734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 msgr2=0x55d80136e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d80136e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 -- 172.21.15.52:0/1538817734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d801255440 con 0x55d80136e680 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 0x7fcca80a5780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fccb40098d0 tx=0x7fccb402fee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb3fff640 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cd420 tx=0x7fcca4091420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a87b5d01d449ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb17fa640 1 -- 172.21.15.52:0/1538817734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40a4510 con 0x55d80136e680 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb17fa640 1 -- 172.21.15.52:0/1538817734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca409c640 con 0x55d80136e680 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.233+0000 7fccb17fa640 1 -- 172.21.15.52:0/1538817734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40bc040 con 0x55d80136e680 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- 172.21.15.52:0/1538817734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 msgr2=0x55d801370a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcca40cd420 tx=0x7fcca4091420 comp rx=0 tx=0).stop 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- 172.21.15.52:0/1538817734 shutdown_connections 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801370a70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d80136e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1538817734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d801363880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- 172.21.15.52:0/1538817734 >> 172.21.15.52:0/1538817734 conn(0x55d80135fa30 msgr2=0x55d80135fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- 172.21.15.52:0/1538817734 shutdown_connections 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- 172.21.15.52:0/1538817734 wait complete. 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.234+0000 7fccc3a08740 1 -- start start 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 Processor -- start 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80136df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d80136e680 0x55d80136b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d801371250 con 0x55d801363dc0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d801284050 con 0x55d80136e680 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8013713d0 con 0x55d8013634a0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccc3a08740 10 client.0 _ll_register_callbacks cb 0x55d8012c4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60262/0 (socket says 172.21.15.52:60262) 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 -- 172.21.15.52:0/927036417 learned_addr learned my addr 172.21.15.52:0/927036417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d80136e680 0x55d80136b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccbaffd640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80136df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 -- 172.21.15.52:0/927036417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 msgr2=0x55d80136df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80136df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 -- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d80136e680 msgr2=0x55d80136b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d80136e680 0x55d80136b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 -- 172.21.15.52:0/927036417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80103a3c0 con 0x55d801363dc0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fccb3fff640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcca4098910 tx=0x7fcca409bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8f20bd7d23308c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.235+0000 7fcca27fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b4070 con 0x55d801363dc0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcca409a240 con 0x55d801363dc0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca409c640 con 0x55d801363dc0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcca4018cb0 con 0x55d801363dc0 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 10 client.16449 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:12.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d80137cbc0 con 0x55d801363dc0 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca409c640 con 0x55d801363dc0 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcca40ba050 con 0x55d801363dc0 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 10 client.16449 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 20 client.16449 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d80137df10 0x55d801380300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 4 client.16449 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8012d6850 con 0x55d80137df10 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.236+0000 7fccbaffd640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d80137df10 0x55d801380300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.237+0000 7fccbaffd640 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d80137df10 0x55d801380300 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abc8f9437fa85569 server_cookie=91a00a7efda466a1 in_seq=0 out_seq=0 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.237+0000 7fcca27fc640 10 client.16449 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.237+0000 7fcca27fc640 1 -- 172.21.15.52:0/927036417 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8012d6850 con 0x55d80137df10 2024-09-19T09:24:12.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.237+0000 7fcca27fc640 10 client.16449 handle_command_reply: tid=0 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 client.16449 shutdown 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 msgr2=0x55d80136b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcca4098910 tx=0x7fcca409bb70 comp rx=0 tx=0).stop 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 shutdown_connections 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d80137df10 0x55d801380300 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d80136e680 0x55d80136b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d801363dc0 0x55d80136b220 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fcca27fc640 0 client.16449 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 --2- 172.21.15.52:0/927036417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80136df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 >> 172.21.15.52:0/927036417 conn(0x55d80135fa30 msgr2=0x55d801365760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 shutdown_connections 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 1 -- 172.21.15.52:0/927036417 wait complete. 2024-09-19T09:24:12.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.238+0000 7fccc3a08740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 Processor -- start 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 -- start start 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80137a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d8013858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1b0020 con 0x55d80136e680 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ad8f0 con 0x55d801363dc0 2024-09-19T09:24:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccc3a08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ab740 con 0x55d8013634a0 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60276/0 (socket says 172.21.15.52:60276) 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 -- 172.21.15.52:0/616323976 learned_addr learned my addr 172.21.15.52:0/616323976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccb3fff640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d8013858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbaffd640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80137a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 -- 172.21.15.52:0/616323976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 msgr2=0x55d80137a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80137a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 -- 172.21.15.52:0/616323976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 msgr2=0x55d8013858a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.256+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d8013858a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccbb7fe640 1 -- 172.21.15.52:0/616323976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d80135f860 con 0x55d80136e680 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccbaffd640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80137a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fccb4035000 tx=0x7fccb4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc09061b78f5855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccb0ff9640 1 -- 172.21.15.52:0/616323976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4034040 con 0x55d80136e680 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccb0ff9640 1 -- 172.21.15.52:0/616323976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb4040040 con 0x55d80136e680 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.257+0000 7fccb0ff9640 1 -- 172.21.15.52:0/616323976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb40052a0 con 0x55d80136e680 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- 172.21.15.52:0/616323976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 msgr2=0x55d801385de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fccb4035000 tx=0x7fccb4031000 comp rx=0 tx=0).stop 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- 172.21.15.52:0/616323976 shutdown_connections 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801385de0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d801363dc0 0x55d8013858a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- 172.21.15.52:0/616323976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8013634a0 0x55d80137a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- 172.21.15.52:0/616323976 >> 172.21.15.52:0/616323976 conn(0x55d80135fa30 msgr2=0x55d801365710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- 172.21.15.52:0/616323976 shutdown_connections 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- 172.21.15.52:0/616323976 wait complete. 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 -- start start 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 Processor -- start 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8013634a0 0x55d801372290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.258+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801363dc0 0x55d8013727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1abdb0 con 0x55d80136e680 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ad220 con 0x55d8013634a0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc1ac480 con 0x55d801363dc0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 10 client.0 _ll_register_callbacks cb 0x7fcca40981e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60292/0 (socket says 172.21.15.52:60292) 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 -- 172.21.15.52:0/1945514329 learned_addr learned my addr 172.21.15.52:0/1945514329 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbaffd640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8013634a0 0x55d801372290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccb3fff640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801363dc0 0x55d8013727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 -- 172.21.15.52:0/1945514329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801363dc0 msgr2=0x55d8013727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801363dc0 0x55d8013727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 -- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8013634a0 msgr2=0x55d801372290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8013634a0 0x55d801372290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 -- 172.21.15.52:0/1945514329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8013e7870 con 0x55d80136e680 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccbb7fe640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fccb40099e0 tx=0x7fccb4003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42ba62d4aa9c598 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fcca27fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb4004810 con 0x55d80136e680 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fccb4054480 con 0x55d80136e680 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.259+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccb4040040 con 0x55d80136e680 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fccb4054680 con 0x55d80136e680 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 10 client.16455 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:12.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d8013e8a80 con 0x55d80136e680 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccb4040040 con 0x55d80136e680 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fccb40306e0 con 0x55d80136e680 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 10 client.16455 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 20 client.16455 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8013e9130 0x55d8013eb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 4 client.16455 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8012d0d60 con 0x55d8013e9130 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.260+0000 7fccbaffd640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8013e9130 0x55d8013eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fcca27fc640 10 client.16455 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccbaffd640 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8013e9130 0x55d8013eb550 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb03e2e96c40d733 server_cookie=990b15f1697154d6 in_seq=0 out_seq=0 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fcca27fc640 1 -- 172.21.15.52:0/1945514329 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d8012d0d60 con 0x55d8013e9130 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fcca27fc640 10 client.16455 handle_command_reply: tid=0 2024-09-19T09:24:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 client.16455 shutdown 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 msgr2=0x55d801372d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fccb40099e0 tx=0x7fccb4003de0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 shutdown_connections 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8013e9130 0x55d8013eb550 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d80136e680 0x55d801372d10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d801363dc0 0x55d8013727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 --2- 172.21.15.52:0/1945514329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8013634a0 0x55d801372290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 >> 172.21.15.52:0/1945514329 conn(0x55d80135fa30 msgr2=0x55d80135e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fcca27fc640 0 client.16455 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 shutdown_connections 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.261+0000 7fccc3a08740 1 -- 172.21.15.52:0/1945514329 wait complete. 2024-09-19T09:24:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc3a08740 20 client.16455 trim_cache size 0 max 16384 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "b96fabff-72b8-4f4a-808e-22671449fe7d": { 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "b96fabff-72b8-4f4a-808e-22671449fe7d", 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:12.280 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:12.281 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 msgr2=0x7fcca80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 0x7fcca80a5780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fccb40098d0 tx=0x7fccb402fee0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 msgr2=0x7fccbc198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fcca400c970 tx=0x7fcca400ce30 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 shutdown_connections 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccbc10c170 0x7fccbc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc103660 0x7fccbc198910 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcca80a32c0 0x7fcca80a5780 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 --2- 172.21.15.52:0/2720680598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccbc102d40 0x7fccbc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 >> 172.21.15.52:0/2720680598 conn(0x7fccbc0fc7a0 msgr2=0x7fccbc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 shutdown_connections 2024-09-19T09:24:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:12.262+0000 7fccc162f640 1 -- 172.21.15.52:0/2720680598 wait complete. 2024-09-19T09:24:12.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:12 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:24:12.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:12.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:12 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:24:12.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:12.582 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:12 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:24:12.583 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:12.583 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:12 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:24:12.583 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:12 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:24:12.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:12 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:24:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:13.072 INFO:tasks.cephfs.filesystem:scrub status for tag:b96fabff-72b8-4f4a-808e-22671449fe7d - {'path': '/', 'tag': 'b96fabff-72b8-4f4a-808e-22671449fe7d', 'options': 'recursive,force'} 2024-09-19T09:24:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:13 smithi052 ceph-mon[30947]: pgmap v421: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:13.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:13 smithi086 ceph-mon[34813]: pgmap v421: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:13.593 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:13 smithi169 ceph-mon[35454]: pgmap v421: 97 pgs: 97 active+clean; 1.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:24:14.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:14 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:24:14.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:14 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:24:14.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:14 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:24:15.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:15 smithi086 ceph-mon[34813]: pgmap v422: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:24:15.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:15 smithi052 ceph-mon[30947]: pgmap v422: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:24:15.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:15 smithi169 ceph-mon[35454]: pgmap v422: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:24:17.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:17 smithi052 ceph-mon[30947]: pgmap v423: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:17 smithi169 ceph-mon[35454]: pgmap v423: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:17.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:17 smithi086 ceph-mon[34813]: pgmap v423: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:24:19.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:19 smithi052 ceph-mon[30947]: pgmap v424: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:19.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:19 smithi169 ceph-mon[35454]: pgmap v424: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:19.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:19 smithi086 ceph-mon[34813]: pgmap v424: 97 pgs: 97 active+clean; 1.5 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:21.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:21 smithi052 ceph-mon[30947]: pgmap v425: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:21.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:21 smithi169 ceph-mon[35454]: pgmap v425: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:21.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:21 smithi086 ceph-mon[34813]: pgmap v425: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:23.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:23 smithi052 ceph-mon[30947]: pgmap v426: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:23 smithi169 ceph-mon[35454]: pgmap v426: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:23.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:23 smithi086 ceph-mon[34813]: pgmap v426: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:24:24.628 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:24:24.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:24:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 -- 172.21.15.52:0/1795426687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c1025c0 msgr2=0x7f570c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 --2- 172.21.15.52:0/1795426687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c1025c0 0x7f570c1049b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009900 tx=0x7f56fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 -- 172.21.15.52:0/1795426687 shutdown_connections 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 --2- 172.21.15.52:0/1795426687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c107820 0x7f570c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 --2- 172.21.15.52:0/1795426687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 0x7f570c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 --2- 172.21.15.52:0/1795426687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c1025c0 0x7f570c1049b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 -- 172.21.15.52:0/1795426687 >> 172.21.15.52:0/1795426687 conn(0x7f570c0fc1e0 msgr2=0x7f570c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 -- 172.21.15.52:0/1795426687 shutdown_connections 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.749+0000 7f5711b23640 1 -- 172.21.15.52:0/1795426687 wait complete. 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.750+0000 7f5711b23640 1 Processor -- start 2024-09-19T09:24:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.750+0000 7f5711b23640 1 -- start start 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 0x7f570c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 0x7f570c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f570c10d830 con 0x7f570c107820 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f570c10d6b0 con 0x7f570c104ef0 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5711b23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f570c10d9b0 con 0x7f570c1025c0 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41852/0 (socket says 172.21.15.52:41852) 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 -- 172.21.15.52:0/1615214488 learned_addr learned my addr 172.21.15.52:0/1615214488 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f5702ffd640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 0x7f570c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 0x7f570c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 -- 172.21.15.52:0/1615214488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 msgr2=0x7f570c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 0x7f570c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 -- 172.21.15.52:0/1615214488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 msgr2=0x7f570c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 0x7f570c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570bfff640 1 -- 172.21.15.52:0/1615214488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c19fa80 con 0x7f570c107820 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.751+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 0x7f570c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f570bfff640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f570400e9d0 tx=0x7f570400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f57097fa640 1 -- 172.21.15.52:0/1615214488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570400cd80 con 0x7f570c107820 2024-09-19T09:24:24.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f57097fa640 1 -- 172.21.15.52:0/1615214488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5704005020 con 0x7f570c107820 2024-09-19T09:24:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c19fd70 con 0x7f570c107820 2024-09-19T09:24:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f57097fa640 1 -- 172.21.15.52:0/1615214488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57040116d0 con 0x7f570c107820 2024-09-19T09:24:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.752+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c1a0260 con 0x7f570c107820 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.754+0000 7f57148ba740 1 Processor -- start 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.754+0000 7f57097fa640 1 -- 172.21.15.52:0/1615214488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57040051d0 con 0x7f570c107820 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.754+0000 7f57148ba740 1 -- start start 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 0x55cca34e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34ea830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cca34462f0 con 0x55cca34e32e0 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cca33ee270 con 0x55cca34e8370 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57148ba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cca34422b0 con 0x55cca34e29a0 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41866/0 (socket says 172.21.15.52:41866) 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 -- 172.21.15.52:0/3425861891 learned_addr learned my addr 172.21.15.52:0/3425861891 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 0x55cca34e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 -- 172.21.15.52:0/3425861891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 msgr2=0x55cca34e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 0x55cca34e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 -- 172.21.15.52:0/3425861891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 msgr2=0x55cca34ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f57097fa640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 0x7f56f80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 -- 172.21.15.52:0/3425861891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca33ed340 con 0x55cca34e32e0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 0x55cca34e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570bfff640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 0x7f56f80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.755+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031610 tx=0x7f56fc032d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b82a86110191dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f57097fa640 1 -- 172.21.15.52:0/1615214488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f57040cfe90 con 0x7f570c107820 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f5701ffb640 1 -- 172.21.15.52:0/3425861891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc03f070 con 0x55cca34e32e0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f5701ffb640 1 -- 172.21.15.52:0/3425861891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56fc031970 con 0x55cca34e32e0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f5701ffb640 1 -- 172.21.15.52:0/3425861891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc035070 con 0x55cca34e32e0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f57148ba740 1 -- 172.21.15.52:0/3425861891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 msgr2=0x55cca34e7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f570bfff640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 0x7f56f80a57b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f570400cfd0 tx=0x7f5704066e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.756+0000 7f57148ba740 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031610 tx=0x7f56fc032d80 comp rx=0 tx=0).stop 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- 172.21.15.52:0/3425861891 shutdown_connections 2024-09-19T09:24:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34e7da0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- 172.21.15.52:0/3425861891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e29a0 0x55cca34e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- 172.21.15.52:0/3425861891 >> 172.21.15.52:0/3425861891 conn(0x55cca34de010 msgr2=0x55cca34de410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- 172.21.15.52:0/3425861891 shutdown_connections 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- 172.21.15.52:0/3425861891 wait complete. 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- start start 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 Processor -- start 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e8370 0x55cca34f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cca34eb2e0 con 0x55cca34e32e0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cca33cf290 con 0x55cca34e29a0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cca34eb460 con 0x55cca34e8370 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.757+0000 7f57148ba740 10 client.0 _ll_register_callbacks cb 0x55cca3400140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41874/0 (socket says 172.21.15.52:41874) 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 -- 172.21.15.52:0/3458868105 learned_addr learned my addr 172.21.15.52:0/3458868105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e8370 0x55cca34f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 -- 172.21.15.52:0/3458868105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e8370 msgr2=0x55cca34f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e8370 0x55cca34f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 -- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 msgr2=0x55cca34ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 -- 172.21.15.52:0/3458868105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca3159210 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f570b7fe640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031440 tx=0x7f56fc009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72fcd8e6a052661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f56eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56fc04a020 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56fc031970 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.758+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f56fc003a00 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56fc055050 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 10 client.16467 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cca3225620 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56fc031970 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f56fc043400 con 0x55cca34e32e0 2024-09-19T09:24:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 10 client.16467 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 20 client.16467 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca34f8410 0x55cca34fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 4 client.16467 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca3453a20 con 0x55cca34f8410 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.759+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca34f8410 0x55cca34fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.760+0000 7f5702ffd640 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca34f8410 0x55cca34fa800 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eda02e5da81dff7 server_cookie=72ed25a612d2921d in_seq=0 out_seq=0 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.760+0000 7f56eaffd640 10 client.16467 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f56eaffd640 1 -- 172.21.15.52:0/3458868105 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cca3453a20 con 0x55cca34f8410 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f56eaffd640 10 client.16467 handle_command_reply: tid=0 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 client.16467 shutdown 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 msgr2=0x55cca34ed0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031440 tx=0x7f56fc009230 comp rx=0 tx=0).stop 2024-09-19T09:24:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 shutdown_connections 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca34f8410 0x55cca34fa800 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e8370 0x55cca34f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e32e0 0x55cca34ed0d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f56eaffd640 0 client.16467 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 --2- 172.21.15.52:0/3458868105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 >> 172.21.15.52:0/3458868105 conn(0x55cca34de010 msgr2=0x55cca34df820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 shutdown_connections 2024-09-19T09:24:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 1 -- 172.21.15.52:0/3458868105 wait complete. 2024-09-19T09:24:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.761+0000 7f57148ba740 20 client.16467 trim_cache size 0 max 16384 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 Processor -- start 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 -- start start 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34dd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1abb70 con 0x55cca34e8370 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1a9440 con 0x55cca34e29a0 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f57148ba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1a7290 con 0x55cca34e32e0 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41890/0 (socket says 172.21.15.52:41890) 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f5702ffd640 1 -- 172.21.15.52:0/4234228968 learned_addr learned my addr 172.21.15.52:0/4234228968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f570b7fe640 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.776+0000 7f5702ffd640 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34dd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 -- 172.21.15.52:0/4234228968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 msgr2=0x55cca34f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 -- 172.21.15.52:0/4234228968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 msgr2=0x55cca34dd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34dd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 -- 172.21.15.52:0/4234228968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca34fab70 con 0x55cca34e8370 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f5702ffd640 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f56f400b830 tx=0x7f56f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df238731ae8d2da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f57017fa640 1 -- 172.21.15.52:0/4234228968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f402e070 con 0x55cca34e8370 2024-09-19T09:24:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f57017fa640 1 -- 172.21.15.52:0/4234228968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f4004220 con 0x55cca34e8370 2024-09-19T09:24:24.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.777+0000 7f57017fa640 1 -- 172.21.15.52:0/4234228968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4005620 con 0x55cca34e8370 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- 172.21.15.52:0/4234228968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 msgr2=0x55cca34df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f56f400b830 tx=0x7f56f4004730 comp rx=0 tx=0).stop 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- 172.21.15.52:0/4234228968 shutdown_connections 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e8370 0x55cca34df400 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 --2- 172.21.15.52:0/4234228968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e29a0 0x55cca34dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- 172.21.15.52:0/4234228968 >> 172.21.15.52:0/4234228968 conn(0x55cca34de010 msgr2=0x55cca34dc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- 172.21.15.52:0/4234228968 shutdown_connections 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- 172.21.15.52:0/4234228968 wait complete. 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 -- start start 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.778+0000 7f57148ba740 1 Processor -- start 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1a7900 con 0x55cca34e29a0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1a8d70 con 0x55cca34e8370 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f570c1a7fd0 con 0x55cca34e32e0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f57148ba740 10 client.0 _ll_register_callbacks cb 0x7f56f400bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41906/0 (socket says 172.21.15.52:41906) 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 -- 172.21.15.52:0/1124203153 learned_addr learned my addr 172.21.15.52:0/1124203153 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 -- 172.21.15.52:0/1124203153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 msgr2=0x55cca34f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 -- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 msgr2=0x55cca34f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 -- 172.21.15.52:0/1124203153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca34f39b0 con 0x55cca34e29a0 2024-09-19T09:24:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f5702ffd640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f56f4004700 tx=0x7f56f4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa32f10d442c1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.779+0000 7f56eaffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f403d060 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f4004220 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f56f40055a0 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56f402e040 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 10 client.16473 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cca35636d0 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f4004220 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f56f4004d00 con 0x55cca34e29a0 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 10 client.16473 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 20 client.16473 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca3564060 0x55cca3566480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 4 client.16473 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.780+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cca34e80c0 con 0x55cca3564060 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.781+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca3564060 0x55cca3566480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.781+0000 7f56eaffd640 10 client.16473 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.781+0000 7f570b7fe640 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca3564060 0x55cca3566480 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0055518fc3b728 server_cookie=b7add86f0e0426af in_seq=0 out_seq=0 2024-09-19T09:24:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f56eaffd640 1 -- 172.21.15.52:0/1124203153 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cca34e80c0 con 0x55cca3564060 2024-09-19T09:24:24.795 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f56eaffd640 10 client.16473 handle_command_reply: tid=0 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 client.16473 shutdown 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 msgr2=0x55cca34f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f56f4004700 tx=0x7f56f4005850 comp rx=0 tx=0).stop 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 shutdown_connections 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cca3564060 0x55cca3566480 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cca34e8370 0x55cca34f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f56eaffd640 0 client.16473 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cca34e32e0 0x55cca34f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 --2- 172.21.15.52:0/1124203153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cca34e29a0 0x55cca34f1e50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 >> 172.21.15.52:0/1124203153 conn(0x55cca34de010 msgr2=0x55cca34dd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.796 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 shutdown_connections 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.794+0000 7f57148ba740 1 -- 172.21.15.52:0/1124203153 wait complete. 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f57148ba740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:24:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 msgr2=0x7f56f80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 0x7f56f80a57b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f570400cfd0 tx=0x7f5704066e70 comp rx=0 tx=0).stop 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 msgr2=0x7f570c19f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f570400e9d0 tx=0x7f570400ee90 comp rx=0 tx=0).stop 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 shutdown_connections 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f570c107820 0x7f570c19f410 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f570c104ef0 0x7f570c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56f80a32f0 0x7f56f80a57b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 --2- 172.21.15.52:0/1615214488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f570c1025c0 0x7f570c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 >> 172.21.15.52:0/1615214488 conn(0x7f570c0fc1e0 msgr2=0x7f570c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.795+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 shutdown_connections 2024-09-19T09:24:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:24.796+0000 7f5711b23640 1 -- 172.21.15.52:0/1615214488 wait complete. 2024-09-19T09:24:24.914 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:25.379 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:25 smithi052 ceph-mon[30947]: pgmap v427: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:25.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 -- 172.21.15.52:0/3811869945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930101de0 msgr2=0x7fd9301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 --2- 172.21.15.52:0/3811869945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930101de0 0x7fd9301021c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd918009900 tx=0x7fd91802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 -- 172.21.15.52:0/3811869945 shutdown_connections 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 --2- 172.21.15.52:0/3811869945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930106f10 0x7fd93010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 --2- 172.21.15.52:0/3811869945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930102790 0x7fd9301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 --2- 172.21.15.52:0/3811869945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930101de0 0x7fd9301021c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 -- 172.21.15.52:0/3811869945 >> 172.21.15.52:0/3811869945 conn(0x7fd9300fd8c0 msgr2=0x7fd9300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 -- 172.21.15.52:0/3811869945 shutdown_connections 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.462+0000 7fd935fd8640 1 -- 172.21.15.52:0/3811869945 wait complete. 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 Processor -- start 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 -- start start 2024-09-19T09:24:25.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930101de0 0x7fd930198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 0x7fd93019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd930111f30 con 0x7fd930102790 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd930111db0 con 0x7fd930101de0 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd935fd8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301120b0 con 0x7fd930106f10 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd92effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd92effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41930/0 (socket says 172.21.15.52:41930) 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.463+0000 7fd92effd640 1 -- 172.21.15.52:0/1482778662 learned_addr learned my addr 172.21.15.52:0/1482778662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92f7fe640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930101de0 0x7fd930198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92ffff640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 0x7fd93019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 -- 172.21.15.52:0/1482778662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 msgr2=0x7fd93019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 0x7fd93019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 -- 172.21.15.52:0/1482778662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930101de0 msgr2=0x7fd930198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930101de0 0x7fd930198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 -- 172.21.15.52:0/1482778662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93019d2c0 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92ffff640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 0x7fd93019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92effd640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c920 tx=0x7fd92000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920007c70 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd920007e10 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93019d5b0 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920018890 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.464+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301a4e90 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.465+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9301021c0 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.466+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd920018a50 con 0x7fd930102790 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.468+0000 7fd92cff9640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 0x7fd91c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.468+0000 7fd92f7fe640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 0x7fd91c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.468+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd9200cfe30 con 0x7fd930102790 2024-09-19T09:24:25.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.468+0000 7fd92f7fe640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 0x7fd91c0a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9180096c0 tx=0x7fd918031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:25.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.471+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd920014030 con 0x7fd930102790 2024-09-19T09:24:25.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.682+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9301a5150 con 0x7fd930102790 2024-09-19T09:24:25.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.683+0000 7fd92cff9640 1 -- 172.21.15.52:0/1482778662 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fd92009cb60 con 0x7fd930102790 2024-09-19T09:24:25.684 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:24:25.684 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:24:25.684 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:24:25.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 msgr2=0x7fd91c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 0x7fd91c0a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd9180096c0 tx=0x7fd918031490 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 msgr2=0x7fd930198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd92000c920 tx=0x7fd92000cde0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 shutdown_connections 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd91c0a3240 0x7fd91c0a5700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd930106f10 0x7fd93019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd930102790 0x7fd930198850 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 --2- 172.21.15.52:0/1482778662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd930101de0 0x7fd930198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.685+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 >> 172.21.15.52:0/1482778662 conn(0x7fd9300fd8c0 msgr2=0x7fd9300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:25.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.686+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 shutdown_connections 2024-09-19T09:24:25.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:25.686+0000 7fd935fd8640 1 -- 172.21.15.52:0/1482778662 wait complete. 2024-09-19T09:24:25.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:25 smithi169 ceph-mon[35454]: pgmap v427: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:25 smithi086 ceph-mon[34813]: pgmap v427: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:24:26.384 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1482778662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:26.417 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:24:26.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:24:26.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1482778662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:26.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1482778662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:27.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.221+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1661079074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04102790 msgr2=0x7f5d041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.221+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1661079074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04102790 0x7f5d041067e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009900 tx=0x7f5cf802a410 comp rx=0 tx=0).stop 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1661079074 shutdown_connections 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1661079074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04106f10 0x7f5d0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1661079074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04102790 0x7f5d041067e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1661079074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 0x7f5d041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1661079074 >> 172.21.15.52:0/1661079074 conn(0x7f5d040fd8c0 msgr2=0x7f5d040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1661079074 shutdown_connections 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1661079074 wait complete. 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 Processor -- start 2024-09-19T09:24:27.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.222+0000 7f5d0a59d640 1 -- start start 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 0x7f5d040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 0x7f5d04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04111f30 con 0x7f5d04106f10 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d04111db0 con 0x7f5d04101de0 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d0a59d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041120b0 con 0x7f5d04102790 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41954/0 (socket says 172.21.15.52:41954) 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 -- 172.21.15.52:0/1393230589 learned_addr learned my addr 172.21.15.52:0/1393230589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d03fff640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 0x7f5d040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d037fe640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 0x7f5d04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 -- 172.21.15.52:0/1393230589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 msgr2=0x7f5d04074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 0x7f5d04074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 -- 172.21.15.52:0/1393230589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 msgr2=0x7f5d040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 0x7f5d040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 -- 172.21.15.52:0/1393230589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d041a68f0 con 0x7f5d04106f10 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d037fe640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 0x7f5d04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.223+0000 7f5d08b3a640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00eaa0 tx=0x7f5cfc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.224+0000 7f5d017fa640 1 -- 172.21.15.52:0/1393230589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc00cdb0 con 0x7f5d04106f10 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.224+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d041a6be0 con 0x7f5d04106f10 2024-09-19T09:24:27.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.224+0000 7f5d017fa640 1 -- 172.21.15.52:0/1393230589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cfc005020 con 0x7f5d04106f10 2024-09-19T09:24:27.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.224+0000 7f5d017fa640 1 -- 172.21.15.52:0/1393230589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0116b0 con 0x7f5d04106f10 2024-09-19T09:24:27.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.224+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d041a70d0 con 0x7f5d04106f10 2024-09-19T09:24:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d017fa640 1 -- 172.21.15.52:0/1393230589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5cfc005560 con 0x7f5d04106f10 2024-09-19T09:24:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d0c976740 1 Processor -- start 2024-09-19T09:24:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d0c976740 1 -- start start 2024-09-19T09:24:27.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e37fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.226+0000 7f5d017fa640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 0x7f5cec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e3809d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d0c976740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5573e37622a0 con 0x5573e37fd080 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d0c976740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5573e3709b10 con 0x5573e37fc760 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d0c976740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5573e375e260 con 0x5573e3807940 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41966/0 (socket says 172.21.15.52:41966) 2024-09-19T09:24:27.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 -- 172.21.15.52:0/811001991 learned_addr learned my addr 172.21.15.52:0/811001991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d08b3a640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 0x7f5cec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d037fe640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e37fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d017fa640 1 -- 172.21.15.52:0/1393230589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5cfc0cfc00 con 0x7f5d04106f10 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d037fe640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e3809d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 -- 172.21.15.52:0/811001991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 msgr2=0x5573e3809d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e3809d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 -- 172.21.15.52:0/811001991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 msgr2=0x5573e37fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e37fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d03fff640 1 -- 172.21.15.52:0/811001991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e34d3b90 con 0x5573e37fd080 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d037fe640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e37fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:27.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.227+0000 7f5d08b3a640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 0x7f5cec0a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc098b10 tx=0x7f5cfc007f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d03fff640 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400bcd0 tx=0x7f5cf40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584317df589da63d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5cea7fc640 1 -- 172.21.15.52:0/811001991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4005220 con 0x5573e37fd080 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5cea7fc640 1 -- 172.21.15.52:0/811001991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf4004c80 con 0x5573e37fd080 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5cea7fc640 1 -- 172.21.15.52:0/811001991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40117e0 con 0x5573e37fd080 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 -- 172.21.15.52:0/811001991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 msgr2=0x5573e3807400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400bcd0 tx=0x7f5cf40107a0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 -- 172.21.15.52:0/811001991 shutdown_connections 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e3809d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3807400 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 --2- 172.21.15.52:0/811001991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e37fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.228+0000 7f5d0c976740 1 -- 172.21.15.52:0/811001991 >> 172.21.15.52:0/811001991 conn(0x5573e37f8cf0 msgr2=0x5573e37f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 -- 172.21.15.52:0/811001991 shutdown_connections 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 -- 172.21.15.52:0/811001991 wait complete. 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 -- start start 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 Processor -- start 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fc760 0x5573e3804880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.229+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 0x5573e3805300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d0c976740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5573e380a510 con 0x5573e37fd080 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d0c976740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5573e36ea6e0 con 0x5573e3807940 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d0c976740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5573e380a690 con 0x5573e37fc760 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d0c976740 10 client.0 _ll_register_callbacks cb 0x5573e370ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41982/0 (socket says 172.21.15.52:41982) 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 -- 172.21.15.52:0/3331752732 learned_addr learned my addr 172.21.15.52:0/3331752732 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d037fe640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fc760 0x5573e3804880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d037fe640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 0x5573e3805300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 -- 172.21.15.52:0/3331752732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fc760 msgr2=0x5573e3804880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fc760 0x5573e3804880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 -- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 msgr2=0x5573e3805300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 0x5573e3805300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 -- 172.21.15.52:0/3331752732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e3813a50 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d037fe640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 0x5573e3805300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d03fff640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005d00 tx=0x7f5cf40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35d165fdb5f1175 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5ce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400be80 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5cf4004020 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.230+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf4004c80 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5cf402b030 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 10 client.16491 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5573e38163e0 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf4004c80 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5cf4003bb0 con 0x5573e37fd080 2024-09-19T09:24:27.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 10 client.16491 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 10 client.16491 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 20 client.16491 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3817790 0x5573e3819b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 4 client.16491 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573e376f9d0 con 0x5573e3817790 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.231+0000 7f5d037fe640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3817790 0x5573e3819b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.232+0000 7f5d037fe640 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3817790 0x5573e3819b80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2b4e0c977537f5e server_cookie=24c8b265d54e2ade in_seq=0 out_seq=0 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.232+0000 7f5ce37fe640 10 client.16491 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:27.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.232+0000 7f5ce37fe640 1 -- 172.21.15.52:0/3331752732 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573e376f9d0 con 0x5573e3817790 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.232+0000 7f5ce37fe640 10 client.16491 handle_command_reply: tid=0 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.232+0000 7f5d0c976740 1 client.16491 shutdown 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 msgr2=0x5573e3804dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005d00 tx=0x7f5cf40048f0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 shutdown_connections 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3817790 0x5573e3819b80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e3807940 0x5573e3805300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e3804dc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 --2- 172.21.15.52:0/3331752732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fc760 0x5573e3804880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5ce37fe640 0 client.16491 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 >> 172.21.15.52:0/3331752732 conn(0x5573e37f8cf0 msgr2=0x5573e37f7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 shutdown_connections 2024-09-19T09:24:27.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 1 -- 172.21.15.52:0/3331752732 wait complete. 2024-09-19T09:24:27.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.233+0000 7f5d0c976740 20 client.16491 trim_cache size 0 max 16384 2024-09-19T09:24:27.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 Processor -- start 2024-09-19T09:24:27.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 -- start start 2024-09-19T09:24:27.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e3806750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fd080 0x5573e381f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041b22a0 con 0x5573e3807940 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041afb70 con 0x5573e37fc760 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.250+0000 7f5d0c976740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041ad9c0 con 0x5573e37fd080 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41992/0 (socket says 172.21.15.52:41992) 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 -- 172.21.15.52:0/2679640702 learned_addr learned my addr 172.21.15.52:0/2679640702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:27.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e3806750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d03fff640 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fd080 0x5573e381f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 -- 172.21.15.52:0/2679640702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fd080 msgr2=0x5573e381f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fd080 0x5573e381f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 -- 172.21.15.52:0/2679640702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 msgr2=0x5573e3806750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e3806750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 -- 172.21.15.52:0/2679640702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573e37f4260 con 0x5573e3807940 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5d037fe640 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8031780 tx=0x7f5cf802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb9541c0d9f637b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5ce9ffb640 1 -- 172.21.15.52:0/2679640702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8048040 con 0x5573e3807940 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5ce9ffb640 1 -- 172.21.15.52:0/2679640702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf8005500 con 0x5573e3807940 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.251+0000 7f5ce9ffb640 1 -- 172.21.15.52:0/2679640702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8035040 con 0x5573e3807940 2024-09-19T09:24:27.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- 172.21.15.52:0/2679640702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 msgr2=0x5573e381f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8031780 tx=0x7f5cf802a410 comp rx=0 tx=0).stop 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- 172.21.15.52:0/2679640702 shutdown_connections 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e3807940 0x5573e381f720 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e37fd080 0x5573e381f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 --2- 172.21.15.52:0/2679640702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e3806750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- 172.21.15.52:0/2679640702 >> 172.21.15.52:0/2679640702 conn(0x5573e37f8cf0 msgr2=0x5573e3803860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- 172.21.15.52:0/2679640702 shutdown_connections 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- 172.21.15.52:0/2679640702 wait complete. 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.252+0000 7f5d0c976740 1 -- start start 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 Processor -- start 2024-09-19T09:24:27.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e380f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e380c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041ae030 con 0x5573e37fd080 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041af4a0 con 0x5573e37fc760 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d041ae700 con 0x5573e3807940 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d0c976740 10 client.0 _ll_register_callbacks cb 0x7f5cf400b900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41998/0 (socket says 172.21.15.52:41998) 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 -- 172.21.15.52:0/713770169 learned_addr learned my addr 172.21.15.52:0/713770169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:27.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d037fe640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e380f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d037fe640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e380c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 -- 172.21.15.52:0/713770169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 msgr2=0x5573e380c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e380c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 -- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 msgr2=0x5573e380f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e380f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 -- 172.21.15.52:0/713770169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573e380cdf0 con 0x5573e37fd080 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d037fe640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e380c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5d03fff640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5573e3805ec0 tx=0x7f5cf400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f20ac5fb7c2427 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.253+0000 7f5ce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf401f040 con 0x5573e37fd080 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5cf402c070 con 0x5573e37fd080 2024-09-19T09:24:27.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf8005500 con 0x5573e37fd080 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5cf403d030 con 0x5573e37fd080 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 10 client.16497 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5573e3882920 con 0x5573e37fd080 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf8005500 con 0x5573e37fd080 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5cf4037030 con 0x5573e37fd080 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 10 client.16497 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 10 client.16497 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 20 client.16497 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3883020 0x5573e3885440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 4 client.16497 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.254+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x5573e3769d20 con 0x5573e3883020 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.255+0000 7f5d037fe640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3883020 0x5573e3885440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.255+0000 7f5d037fe640 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3883020 0x5573e3885440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e936d0fef6cea811 server_cookie=d90ce543d70f80c9 in_seq=0 out_seq=0 2024-09-19T09:24:27.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.255+0000 7f5ce37fe640 10 client.16497 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:27.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.265+0000 7f5ce37fe640 1 -- 172.21.15.52:0/713770169 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5573e3769d20 con 0x5573e3883020 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.265+0000 7f5ce37fe640 10 client.16497 handle_command_reply: tid=0 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.265+0000 7f5d0c976740 1 client.16497 shutdown 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 msgr2=0x5573e380fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5573e3805ec0 tx=0x7f5cf400b810 comp rx=0 tx=0).stop 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 shutdown_connections 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5573e3883020 0x5573e3885440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5573e3807940 0x5573e380c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5573e37fd080 0x5573e380fe20 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 --2- 172.21.15.52:0/713770169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5573e37fc760 0x5573e380f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 >> 172.21.15.52:0/713770169 conn(0x5573e37f8cf0 msgr2=0x5573e37f7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5ce37fe640 0 client.16497 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:27.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 shutdown_connections 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 1 -- 172.21.15.52:0/713770169 wait complete. 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.266+0000 7f5d0c976740 20 client.16497 trim_cache size 0 max 16384 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 14, 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "3f05df59": { 2024-09-19T09:24:27.268 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 14, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 136.6, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:24:27.269 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:27.270 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 msgr2=0x7f5cec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 0x7f5cec0a5700 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc098b10 tx=0x7f5cfc007f90 comp rx=0 tx=0).stop 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 msgr2=0x7f5d04074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00eaa0 tx=0x7f5cfc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 shutdown_connections 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d04106f10 0x7f5d04074f70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5cec0a3240 0x7f5cec0a5700 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d04102790 0x7f5d04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 --2- 172.21.15.52:0/1393230589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d04101de0 0x7f5d040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 >> 172.21.15.52:0/1393230589 conn(0x7f5d040fd8c0 msgr2=0x7f5d040fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 shutdown_connections 2024-09-19T09:24:27.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:27.267+0000 7f5d0a59d640 1 -- 172.21.15.52:0/1393230589 wait complete. 2024-09-19T09:24:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:27 smithi052 ceph-mon[30947]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:27.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:27 smithi169 ceph-mon[35454]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:27.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:27 smithi086 ceph-mon[34813]: pgmap v428: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:28.033 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f05df59', quiesce took 3.4 seconds. Will release after: 13.200000000000001 2024-09-19T09:24:28.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:28 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:28.868 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:28 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:28.869 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:28 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:29 smithi052 ceph-mon[30947]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:24:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:24:29.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:29 smithi169 ceph-mon[35454]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:24:29.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:29.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:29.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:24:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:29 smithi086 ceph-mon[34813]: pgmap v429: 97 pgs: 97 active+clean; 1.6 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:24:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:24:31.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:31 smithi052 ceph-mon[30947]: pgmap v430: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:24:31.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:31 smithi169 ceph-mon[35454]: pgmap v430: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:24:31.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:31 smithi086 ceph-mon[34813]: pgmap v430: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:24:33.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:33 smithi052 ceph-mon[30947]: pgmap v431: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:33.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:33 smithi169 ceph-mon[35454]: pgmap v431: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:33 smithi086 ceph-mon[34813]: pgmap v431: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:35.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:35 smithi052 ceph-mon[30947]: pgmap v432: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:35 smithi169 ceph-mon[35454]: pgmap v432: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:35.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:35 smithi086 ceph-mon[34813]: pgmap v432: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:36.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:36 smithi052 ceph-mon[30947]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:24:36.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:36 smithi169 ceph-mon[35454]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:24:36.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:36 smithi086 ceph-mon[34813]: pgmap v433: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:24:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.899+0000 7fc798b18640 1 -- 172.21.15.52:0/1589223476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794107840 msgr2=0x7fc794109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.899+0000 7fc798b18640 1 --2- 172.21.15.52:0/1589223476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794107840 0x7fc794109cb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009ca0 tx=0x7fc78c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 -- 172.21.15.52:0/1589223476 shutdown_connections 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 --2- 172.21.15.52:0/1589223476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794107840 0x7fc794109cb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 --2- 172.21.15.52:0/1589223476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794104f10 0x7fc794107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 --2- 172.21.15.52:0/1589223476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 0x7fc7941049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 -- 172.21.15.52:0/1589223476 >> 172.21.15.52:0/1589223476 conn(0x7fc7940fc1e0 msgr2=0x7fc7940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 -- 172.21.15.52:0/1589223476 shutdown_connections 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 -- 172.21.15.52:0/1589223476 wait complete. 2024-09-19T09:24:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 Processor -- start 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.900+0000 7fc798b18640 1 -- start start 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 0x7fc794197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 0x7fc79419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc79410d820 con 0x7fc794104f10 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc79410d6a0 con 0x7fc794107840 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc798b18640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc79410d9a0 con 0x7fc7941025e0 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35062/0 (socket says 172.21.15.52:35062) 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 -- 172.21.15.52:0/1766182379 learned_addr learned my addr 172.21.15.52:0/1766182379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc79259c640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 0x7fc794197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc792d9d640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 0x7fc79419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 -- 172.21.15.52:0/1766182379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 msgr2=0x7fc794197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 0x7fc794197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 -- 172.21.15.52:0/1766182379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 msgr2=0x7fc79419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 0x7fc79419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 -- 172.21.15.52:0/1766182379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79419fa30 con 0x7fc794104f10 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc792d9d640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 0x7fc79419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc791d9b640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc78800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.901+0000 7fc7837fe640 1 -- 172.21.15.52:0/1766182379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788017070 con 0x7fc794104f10 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.902+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79419fd20 con 0x7fc794104f10 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.902+0000 7fc7837fe640 1 -- 172.21.15.52:0/1766182379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc788009c30 con 0x7fc794104f10 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.902+0000 7fc7837fe640 1 -- 172.21.15.52:0/1766182379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788010460 con 0x7fc794104f10 2024-09-19T09:24:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.902+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7941a0260 con 0x7fc794104f10 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.904+0000 7fc7837fe640 1 -- 172.21.15.52:0/1766182379 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc788003e70 con 0x7fc794104f10 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.904+0000 7fc79b8b0740 1 Processor -- start 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 -- start start 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fed9a0 0x563580fedda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 0x563580ff5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563580f512f0 con 0x563580fee2e0 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563580ef9270 con 0x563580fed9a0 2024-09-19T09:24:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563580f4d2b0 con 0x563580ff3370 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35076/0 (socket says 172.21.15.52:35076) 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 -- 172.21.15.52:0/3689038183 learned_addr learned my addr 172.21.15.52:0/3689038183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fed9a0 0x563580fedda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc791d9b640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 0x563580ff5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 -- 172.21.15.52:0/3689038183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 msgr2=0x563580ff5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 0x563580ff5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 -- 172.21.15.52:0/3689038183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fed9a0 msgr2=0x563580fedda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fed9a0 0x563580fedda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc7837fe640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 0x7fc77c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc79259c640 1 -- 172.21.15.52:0/3689038183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563580ef8340 con 0x563580fee2e0 2024-09-19T09:24:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.905+0000 7fc791d9b640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 0x563580ff5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc791d9b640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 0x7fc77c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc79259c640 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc784009d20 tx=0x7fc784011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2830ffccb1118b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc7837fe640 1 -- 172.21.15.52:0/1766182379 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc7880cf610 con 0x7fc794104f10 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc780ff9640 1 -- 172.21.15.52:0/3689038183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78401e070 con 0x563580fee2e0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc780ff9640 1 -- 172.21.15.52:0/3689038183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc784019b10 con 0x563580fee2e0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.906+0000 7fc780ff9640 1 -- 172.21.15.52:0/3689038183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78400eb90 con 0x563580fee2e0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3689038183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 msgr2=0x563580ff2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc791d9b640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 0x7fc77c0a57b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc788097ff0 tx=0x7fc788003910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc784009d20 tx=0x7fc784011810 comp rx=0 tx=0).stop 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3689038183 shutdown_connections 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580ff3370 0x563580ff5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff2da0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3689038183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fed9a0 0x563580fedda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3689038183 >> 172.21.15.52:0/3689038183 conn(0x563580fe9010 msgr2=0x563580fe9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3689038183 shutdown_connections 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3689038183 wait complete. 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- start start 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 Processor -- start 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563580ff7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563580ff6340 con 0x563580fee2e0 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563580eda290 con 0x563580ff3370 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563580ff64c0 con 0x563580fed9a0 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.907+0000 7fc79b8b0740 10 client.0 _ll_register_callbacks cb 0x563580f0b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35082/0 (socket says 172.21.15.52:35082) 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 -- 172.21.15.52:0/3411662137 learned_addr learned my addr 172.21.15.52:0/3411662137 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc792d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563580ff7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 -- 172.21.15.52:0/3411662137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 msgr2=0x563580ff7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563580ff7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 -- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 msgr2=0x563580fff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 -- 172.21.15.52:0/3411662137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563580c64210 con 0x563580fee2e0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79259c640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc784009cf0 tx=0x7fc784019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669f4f6dafb3afa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784027020 con 0x563580fee2e0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc78400eaf0 con 0x563580fee2e0 2024-09-19T09:24:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc784019b10 con 0x563580fee2e0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc784032050 con 0x563580fee2e0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79b8b0740 10 client.16509 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.908+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563580d30620 con 0x563580fee2e0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc784019b10 con 0x563580fee2e0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc7840046c0 con 0x563580fee2e0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 10 client.16509 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 20 client.16509 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581003640 0x563581005a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 4 client.16509 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563580f5ea20 con 0x563581003640 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.909+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581003640 0x563581005a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc779ffb640 10 client.16509 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581003640 0x563581005a80 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3a65afaaecf115 server_cookie=512b885f3d5fa3f7 in_seq=0 out_seq=0 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc779ffb640 1 -- 172.21.15.52:0/3411662137 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563580f5ea20 con 0x563581003640 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc779ffb640 10 client.16509 handle_command_reply: tid=0 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 client.16509 shutdown 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 msgr2=0x563580ff8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc784009cf0 tx=0x7fc784019660 comp rx=0 tx=0).stop 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 shutdown_connections 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581003640 0x563581005a80 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fee2e0 0x563580ff8170 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3411662137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563580ff7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc779ffb640 0 client.16509 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 >> 172.21.15.52:0/3411662137 conn(0x563580fe9010 msgr2=0x563580fea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.910+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 shutdown_connections 2024-09-19T09:24:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.911+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3411662137 wait complete. 2024-09-19T09:24:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.911+0000 7fc79b8b0740 20 client.16509 trim_cache size 0 max 16384 2024-09-19T09:24:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.925+0000 7fc79b8b0740 1 Processor -- start 2024-09-19T09:24:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.925+0000 7fc79b8b0740 1 -- start start 2024-09-19T09:24:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fee2e0 0x563580fe9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fe9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941abae0 con 0x563580fed9a0 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941a93b0 con 0x563580ff3370 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941a7200 con 0x563580fee2e0 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35084/0 (socket says 172.21.15.52:35084) 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 -- 172.21.15.52:0/3651753268 learned_addr learned my addr 172.21.15.52:0/3651753268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc79259c640 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fee2e0 0x563580fe9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 -- 172.21.15.52:0/3651753268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fee2e0 msgr2=0x563580fe9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fee2e0 0x563580fe9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 -- 172.21.15.52:0/3651753268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 msgr2=0x563580fe9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fe9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 -- 172.21.15.52:0/3651753268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563580ff6660 con 0x563580fed9a0 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc792d9d640 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc78c006010 tx=0x7fc78c02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0121d302a6832f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc77bfff640 1 -- 172.21.15.52:0/3651753268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c04e070 con 0x563580fed9a0 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc77bfff640 1 -- 172.21.15.52:0/3651753268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc78c036040 con 0x563580fed9a0 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.926+0000 7fc77bfff640 1 -- 172.21.15.52:0/3651753268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c043040 con 0x563580fed9a0 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3651753268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 msgr2=0x563580fe93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc78c006010 tx=0x7fc78c02f310 comp rx=0 tx=0).stop 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3651753268 shutdown_connections 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580ff3370 0x563580fe9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fee2e0 0x563580fe9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/3651753268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580fed9a0 0x563580fe93f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3651753268 >> 172.21.15.52:0/3651753268 conn(0x563580fe9010 msgr2=0x563580ff7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3651753268 shutdown_connections 2024-09-19T09:24:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- 172.21.15.52:0/3651753268 wait complete. 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 -- start start 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.927+0000 7fc79b8b0740 1 Processor -- start 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563581069490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fee2e0 0x5635810699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941a7870 con 0x563580ff3370 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941a8ce0 con 0x563580fee2e0 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc7941a7f40 con 0x563580fed9a0 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79b8b0740 10 client.0 _ll_register_callbacks cb 0x7fc78401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35096/0 (socket says 172.21.15.52:35096) 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 -- 172.21.15.52:0/140512034 learned_addr learned my addr 172.21.15.52:0/140512034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc79259c640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fee2e0 0x5635810699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 -- 172.21.15.52:0/140512034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 msgr2=0x563581069490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563581069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 -- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fee2e0 msgr2=0x5635810699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fee2e0 0x5635810699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 -- 172.21.15.52:0/140512034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563581071020 con 0x563580ff3370 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc792d9d640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc78c004af0 tx=0x7fc78c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3ca340f1144210 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.928+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c04e040 con 0x563580ff3370 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc78c031450 con 0x563580ff3370 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc78c036040 con 0x563580ff3370 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc78c031650 con 0x563580ff3370 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 10 client.16515 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563581072330 con 0x563580ff3370 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc78c036040 con 0x563580ff3370 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc78c049070 con 0x563580ff3370 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 10 client.16515 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 10 client.16515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 20 client.16515 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581072ce0 0x563581075100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 4 client.16515 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563580f58d70 con 0x563581072ce0 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.929+0000 7fc79259c640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581072ce0 0x563581075100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.930+0000 7fc79259c640 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581072ce0 0x563581075100 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd0453d51a29ef6a server_cookie=d88fbcc127270310 in_seq=0 out_seq=0 2024-09-19T09:24:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.930+0000 7fc779ffb640 10 client.16515 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc779ffb640 1 -- 172.21.15.52:0/140512034 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563580f58d70 con 0x563581072ce0 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc779ffb640 10 client.16515 handle_command_reply: tid=0 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 client.16515 shutdown 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 msgr2=0x563581070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc78c004af0 tx=0x7fc78c004610 comp rx=0 tx=0).stop 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 shutdown_connections 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563581072ce0 0x563581075100 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563580ff3370 0x563581070a10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563580fee2e0 0x5635810699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc779ffb640 0 client.16515 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 --2- 172.21.15.52:0/140512034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563580fed9a0 0x563581069490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 >> 172.21.15.52:0/140512034 conn(0x563580fe9010 msgr2=0x563580fe79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 shutdown_connections 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 1 -- 172.21.15.52:0/140512034 wait complete. 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc79b8b0740 20 client.16515 trim_cache size 0 max 16384 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:24:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 msgr2=0x7fc77c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 0x7fc77c0a57b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc788097ff0 tx=0x7fc788003910 comp rx=0 tx=0).stop 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 msgr2=0x7fc794198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc788005fd0 tx=0x7fc78800dde0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 shutdown_connections 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.942+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc794107840 0x7fc79419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc794104f10 0x7fc794198350 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc77c0a32f0 0x7fc77c0a57b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 --2- 172.21.15.52:0/1766182379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc7941025e0 0x7fc794197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 >> 172.21.15.52:0/1766182379 conn(0x7fc7940fc1e0 msgr2=0x7fc794102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 shutdown_connections 2024-09-19T09:24:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:37.943+0000 7fc798b18640 1 -- 172.21.15.52:0/1766182379 wait complete. 2024-09-19T09:24:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:38 smithi052 ceph-mon[30947]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:24:38.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:38 smithi169 ceph-mon[35454]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:24:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:38 smithi086 ceph-mon[34813]: pgmap v434: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:24:40.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:40 smithi052 ceph-mon[30947]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 12 op/s 2024-09-19T09:24:40.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:40 smithi169 ceph-mon[35454]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 12 op/s 2024-09-19T09:24:40.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:40 smithi086 ceph-mon[34813]: pgmap v435: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.3 KiB/s wr, 12 op/s 2024-09-19T09:24:41.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:24:41.507 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 -- 172.21.15.52:0/3551729412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da81055b0 msgr2=0x7f3da810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/3551729412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da81055b0 0x7f3da810d130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009ca0 tx=0x7f3da002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 -- 172.21.15.52:0/3551729412 shutdown_connections 2024-09-19T09:24:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/3551729412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da81055b0 0x7f3da810d130 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/3551729412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/3551729412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da8100480 0x7f3da8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 -- 172.21.15.52:0/3551729412 >> 172.21.15.52:0/3551729412 conn(0x7f3da8077210 msgr2=0x7f3da80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 -- 172.21.15.52:0/3551729412 shutdown_connections 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.968+0000 7f3dad2cf640 1 -- 172.21.15.52:0/3551729412 wait complete. 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 Processor -- start 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 -- start start 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 0x7f3da819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810fd90 con 0x7f3da8100480 2024-09-19T09:24:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810fc10 con 0x7f3da8100e30 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3dad2cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3da810ff10 con 0x7f3da81055b0 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55832/0 (socket says 172.21.15.52:55832) 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 -- 172.21.15.52:0/794045142 learned_addr learned my addr 172.21.15.52:0/794045142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da77fe640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 0x7f3da819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da67fc640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 -- 172.21.15.52:0/794045142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 msgr2=0x7f3da819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 0x7f3da819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 -- 172.21.15.52:0/794045142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 msgr2=0x7f3da8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.969+0000 7f3da6ffd640 1 -- 172.21.15.52:0/794045142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da819d3b0 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3da77fe640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 0x7f3da819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3da67fc640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3da6ffd640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800ea20 tx=0x7f3d9800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800cd40 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da819d6a0 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d980168f0 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800b920 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.970+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a4f80 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.971+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da8100860 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.972+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3d98016aa0 con 0x7f3da8100480 2024-09-19T09:24:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.973+0000 7f3d8ffff640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 0x7f3d900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.973+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3d980cf9a0 con 0x7f3da8100480 2024-09-19T09:24:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.973+0000 7f3da67fc640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 0x7f3d900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.973+0000 7f3da67fc640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 0x7f3d900a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3da80ffbb0 tx=0x7f3d9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:41.977+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d9809c5e0 con 0x7f3da8100480 2024-09-19T09:24:42.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.191+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3da802d7c0 con 0x7f3da8100480 2024-09-19T09:24:42.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.192+0000 7f3d8ffff640 1 -- 172.21.15.52:0/794045142 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f3d9809bee0 con 0x7f3da8100480 2024-09-19T09:24:42.193 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:24:42.193 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:24:42.194 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 msgr2=0x7f3d900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 0x7f3d900a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3da80ffbb0 tx=0x7f3d9c005f90 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 msgr2=0x7f3da8198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800ea20 tx=0x7f3d9800eee0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 shutdown_connections 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3d900a3240 0x7f3d900a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3da81055b0 0x7f3da819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3da8100e30 0x7f3da8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 --2- 172.21.15.52:0/794045142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3da8100480 0x7f3da8198400 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 >> 172.21.15.52:0/794045142 conn(0x7f3da8077210 msgr2=0x7f3da8103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:42.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 shutdown_connections 2024-09-19T09:24:42.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:42.194+0000 7f3dad2cf640 1 -- 172.21.15.52:0/794045142 wait complete. 2024-09-19T09:24:42.637 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:42 smithi052 ceph-mon[30947]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-19T09:24:42.637 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:42 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/794045142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:42.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:42 smithi169 ceph-mon[35454]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-19T09:24:42.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:42 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/794045142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:42.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:42 smithi086 ceph-mon[34813]: pgmap v436: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 9 op/s 2024-09-19T09:24:42.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:42 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/794045142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:42.954 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 3f05df59 --release --await' 2024-09-19T09:24:42.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 3f05df59 --release --await 2024-09-19T09:24:43.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:24:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 -- 172.21.15.52:0/3299186329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270101de0 msgr2=0x7ff2701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 --2- 172.21.15.52:0/3299186329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270101de0 0x7ff2701021c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff260009900 tx=0x7ff26002a410 comp rx=0 tx=0).stop 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 -- 172.21.15.52:0/3299186329 shutdown_connections 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 --2- 172.21.15.52:0/3299186329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 --2- 172.21.15.52:0/3299186329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270102790 0x7ff2701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 --2- 172.21.15.52:0/3299186329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270101de0 0x7ff2701021c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 -- 172.21.15.52:0/3299186329 >> 172.21.15.52:0/3299186329 conn(0x7ff2700fd8c0 msgr2=0x7ff2700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 -- 172.21.15.52:0/3299186329 shutdown_connections 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 -- 172.21.15.52:0/3299186329 wait complete. 2024-09-19T09:24:43.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.760+0000 7ff2753d9640 1 Processor -- start 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 -- start start 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270101de0 0x7ff270198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff270111fc0 con 0x7ff270102790 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff270111e40 con 0x7ff270106f10 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff2753d9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff270112140 con 0x7ff270101de0 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55842/0 (socket says 172.21.15.52:55842) 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 -- 172.21.15.52:0/2796430578 learned_addr learned my addr 172.21.15.52:0/2796430578 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26effd640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270101de0 0x7ff270198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 -- 172.21.15.52:0/2796430578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270101de0 msgr2=0x7ff270198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270101de0 0x7ff270198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 -- 172.21.15.52:0/2796430578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 msgr2=0x7ff27019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26e7fc640 1 -- 172.21.15.52:0/2796430578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27019d3d0 con 0x7ff270102790 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.761+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d770 tx=0x7ff26400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff257fff640 1 -- 172.21.15.52:0/2796430578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264017070 con 0x7ff270102790 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27019d6c0 con 0x7ff270102790 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff257fff640 1 -- 172.21.15.52:0/2796430578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff264005500 con 0x7ff270102790 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff257fff640 1 -- 172.21.15.52:0/2796430578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264004e00 con 0x7ff270102790 2024-09-19T09:24:43.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.762+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701a4fa0 con 0x7ff270102790 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.764+0000 7ff257fff640 1 -- 172.21.15.52:0/2796430578 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff264004fa0 con 0x7ff270102790 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 Processor -- start 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 -- start start 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff257fff640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 0x7ff2580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f949c33620 con 0x55f949cd9240 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f949bdae50 con 0x55f949cce980 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff2777b2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f949c2f5e0 con 0x55f949cce060 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 0x7ff2580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55856/0 (socket says 172.21.15.52:55856) 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26f7fe640 1 -- 172.21.15.52:0/110498522 learned_addr learned my addr 172.21.15.52:0/110498522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff257fff640 1 -- 172.21.15.52:0/2796430578 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff2640cf470 con 0x7ff270102790 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.765+0000 7ff26effd640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 -- 172.21.15.52:0/110498522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 msgr2=0x55f949cce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 -- 172.21.15.52:0/110498522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 msgr2=0x55f949cdb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 -- 172.21.15.52:0/110498522 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f949bcbd40 con 0x55f949cce980 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 0x7ff2580a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff268012be0 tx=0x7ff268009db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd8d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff26409b6b0 tx=0x7ff264004780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363190ac875cd240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff2557fa640 1 -- 172.21.15.52:0/110498522 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264020070 con 0x55f949cce980 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff2557fa640 1 -- 172.21.15.52:0/110498522 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26406bde0 con 0x55f949cce980 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.766+0000 7ff2557fa640 1 -- 172.21.15.52:0/110498522 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2640ccfa0 con 0x55f949cce980 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- 172.21.15.52:0/110498522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 msgr2=0x55f949cd8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd8d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff26409b6b0 tx=0x7ff264004780 comp rx=0 tx=0).stop 2024-09-19T09:24:43.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- 172.21.15.52:0/110498522 shutdown_connections 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cdb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd8d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 --2- 172.21.15.52:0/110498522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- 172.21.15.52:0/110498522 >> 172.21.15.52:0/110498522 conn(0x55f949cca5f0 msgr2=0x55f949cca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- 172.21.15.52:0/110498522 shutdown_connections 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- 172.21.15.52:0/110498522 wait complete. 2024-09-19T09:24:43.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 -- start start 2024-09-19T09:24:43.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.767+0000 7ff2777b2740 1 Processor -- start 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cd61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f949cdbe10 con 0x55f949cd9240 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f949bbbf10 con 0x55f949cce980 2024-09-19T09:24:43.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f949cdbf90 con 0x55f949cce060 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff2777b2740 10 client.0 _ll_register_callbacks cb 0x55f949bdfdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55862/0 (socket says 172.21.15.52:55862) 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 -- 172.21.15.52:0/1587871874 learned_addr learned my addr 172.21.15.52:0/1587871874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26effd640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cd61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 -- 172.21.15.52:0/1587871874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 msgr2=0x55f949cd61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cd61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 -- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 msgr2=0x55f949cd66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 -- 172.21.15.52:0/1587871874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f949942580 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff268010d80 tx=0x7ff268009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736ad69808b38e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.768+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26801ed40 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff268004b20 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26406bde0 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff26802d020 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 10 client.16533 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f949a0c960 con 0x55f949cd9240 2024-09-19T09:24:43.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26406bde0 con 0x55f949cd9240 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff26801f070 con 0x55f949cd9240 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 10 client.16533 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 10 client.16533 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 20 client.16533 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949ce8d80 0x55f949ceb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 4 client.16533 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.769+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f949c40b90 con 0x55f949ce8d80 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.770+0000 7ff26effd640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949ce8d80 0x55f949ceb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.770+0000 7ff252ff5640 10 client.16533 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.770+0000 7ff26effd640 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949ce8d80 0x55f949ceb170 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b64f5eee508844a3 server_cookie=2a3471c78962a8c2 in_seq=0 out_seq=0 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff252ff5640 1 -- 172.21.15.52:0/1587871874 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f949c40b90 con 0x55f949ce8d80 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff252ff5640 10 client.16533 handle_command_reply: tid=0 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 client.16533 shutdown 2024-09-19T09:24:43.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 msgr2=0x55f949cd6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff268010d80 tx=0x7ff268009280 comp rx=0 tx=0).stop 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 shutdown_connections 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949ce8d80 0x55f949ceb170 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cd6c30 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce980 0x55f949cd66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 --2- 172.21.15.52:0/1587871874 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce060 0x55f949cd61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 >> 172.21.15.52:0/1587871874 conn(0x55f949cca5f0 msgr2=0x55f949cd0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff252ff5640 0 client.16533 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 shutdown_connections 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 1 -- 172.21.15.52:0/1587871874 wait complete. 2024-09-19T09:24:43.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.771+0000 7ff2777b2740 20 client.16533 trim_cache size 0 max 16384 2024-09-19T09:24:43.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 Processor -- start 2024-09-19T09:24:43.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 -- start start 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 0x55f949cd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cc9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ade80 con 0x55f949cd9240 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ab750 con 0x55f949cce060 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff2777b2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701a95a0 con 0x55f949cce980 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55868/0 (socket says 172.21.15.52:55868) 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26f7fe640 1 -- 172.21.15.52:0/3011089873 learned_addr learned my addr 172.21.15.52:0/3011089873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 0x55f949cd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cc9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 -- 172.21.15.52:0/3011089873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 msgr2=0x55f949cc9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cc9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 -- 172.21.15.52:0/3011089873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 msgr2=0x55f949cf0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26effd640 1 -- 172.21.15.52:0/3011089873 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f949ceb4e0 con 0x55f949cce060 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.791+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.792+0000 7ff26effd640 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 0x55f949cd0ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff26002aa00 tx=0x7ff260005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec6c71b7d5c050a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.792+0000 7ff254ff9640 1 -- 172.21.15.52:0/3011089873 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260035040 con 0x55f949cce060 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.792+0000 7ff254ff9640 1 -- 172.21.15.52:0/3011089873 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff260005520 con 0x55f949cce060 2024-09-19T09:24:43.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.792+0000 7ff254ff9640 1 -- 172.21.15.52:0/3011089873 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004e00 con 0x55f949cce060 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- 172.21.15.52:0/3011089873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 msgr2=0x55f949cd0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 0x55f949cd0ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff26002aa00 tx=0x7ff260005c00 comp rx=0 tx=0).stop 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- 172.21.15.52:0/3011089873 shutdown_connections 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cd9240 0x55f949cf0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cc9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 --2- 172.21.15.52:0/3011089873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cce060 0x55f949cd0ac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- 172.21.15.52:0/3011089873 >> 172.21.15.52:0/3011089873 conn(0x55f949cca5f0 msgr2=0x55f949cc8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- 172.21.15.52:0/3011089873 shutdown_connections 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- 172.21.15.52:0/3011089873 wait complete. 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 -- start start 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.793+0000 7ff2777b2740 1 Processor -- start 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 0x55f949d4ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701a9c10 con 0x55f949cce060 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701ab080 con 0x55f949cd9240 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701aa2e0 con 0x55f949cce980 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff2777b2740 10 client.0 _ll_register_callbacks cb 0x7ff2680096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55884/0 (socket says 172.21.15.52:55884) 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 -- 172.21.15.52:0/718780266 learned_addr learned my addr 172.21.15.52:0/718780266 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 0x55f949d4ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 -- 172.21.15.52:0/718780266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 msgr2=0x55f949cddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 -- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 msgr2=0x55f949d4ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 0x55f949d4ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 -- 172.21.15.52:0/718780266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f949d4d070 con 0x55f949cce060 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26f7fe640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 0x55f949d4ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff26effd640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff260000c00 tx=0x7ff260005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e6ccb0f97679c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.794+0000 7ff252ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260035050 con 0x55f949cce060 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff260004b80 con 0x55f949cce060 2024-09-19T09:24:43.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff260005520 con 0x55f949cce060 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff260064030 con 0x55f949cce060 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 10 client.16539 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f949d54420 con 0x55f949cce060 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff260005520 con 0x55f949cce060 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff260003a80 con 0x55f949cce060 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 10 client.16539 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 10 client.16539 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 20 client.16539 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949d54ae0 0x55f949d56f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 4 client.16539 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f05df59", "release": true, "await": true}] 2024-09-19T09:24:43.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.795+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f05df59", "release": true, "await": true}) -- 0x55f949c3b0a0 con 0x55f949d54ae0 2024-09-19T09:24:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.796+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949d54ae0 0x55f949d56f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.796+0000 7ff252ff5640 10 client.16539 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.796+0000 7ff26e7fc640 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949d54ae0 0x55f949d56f00 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=478ddbc246771c12 server_cookie=291e8e4285a1d433 in_seq=0 out_seq=0 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.798+0000 7ff252ff5640 1 -- 172.21.15.52:0/718780266 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f949c3b0a0 con 0x55f949d54ae0 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.798+0000 7ff252ff5640 10 client.16539 handle_command_reply: tid=0 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 client.16539 shutdown 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 msgr2=0x55f949cdd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff260000c00 tx=0x7ff260005fd0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 shutdown_connections 2024-09-19T09:24:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f949d54ae0 0x55f949d56f00 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff252ff5640 0 client.16539 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f949cd9240 0x55f949d4ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f949cce980 0x55f949cddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 --2- 172.21.15.52:0/718780266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f949cce060 0x55f949cdd830 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 >> 172.21.15.52:0/718780266 conn(0x55f949cca5f0 msgr2=0x55f949cd6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 shutdown_connections 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 1 -- 172.21.15.52:0/718780266 wait complete. 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.799+0000 7ff2777b2740 20 client.16539 trim_cache size 0 max 16384 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:43.803 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 16, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "3f05df59": { 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 16, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 136.6, 2024-09-19T09:24:43.804 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:43.805 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 msgr2=0x7ff2580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 0x7ff2580a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff268012be0 tx=0x7ff268009db0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 msgr2=0x7ff270198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d770 tx=0x7ff26400dc30 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 shutdown_connections 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff270106f10 0x7ff27019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff270102790 0x7ff270198960 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2580a3240 0x7ff2580a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 --2- 172.21.15.52:0/2796430578 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff270101de0 0x7ff270198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 >> 172.21.15.52:0/2796430578 conn(0x7ff2700fd8c0 msgr2=0x7ff2700febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:43.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 shutdown_connections 2024-09-19T09:24:43.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:43.800+0000 7ff2753d9640 1 -- 172.21.15.52:0/2796430578 wait complete. 2024-09-19T09:24:44.581 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f05df59', total seconds elapsed: 20.0 2024-09-19T09:24:44.655 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:44.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:44 smithi052 ceph-mon[30947]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:44.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:44 smithi169 ceph-mon[35454]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:44.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:44 smithi086 ceph-mon[34813]: pgmap v437: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:45.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 -- 172.21.15.52:0/2447024549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878101de0 msgr2=0x7f68781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 --2- 172.21.15.52:0/2447024549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878101de0 0x7f68781021c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6868009900 tx=0x7f686802a410 comp rx=0 tx=0).stop 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 -- 172.21.15.52:0/2447024549 shutdown_connections 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 --2- 172.21.15.52:0/2447024549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878106f10 0x7f687810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 --2- 172.21.15.52:0/2447024549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 0x7f68781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 --2- 172.21.15.52:0/2447024549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878101de0 0x7f68781021c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 -- 172.21.15.52:0/2447024549 >> 172.21.15.52:0/2447024549 conn(0x7f68780fd8c0 msgr2=0x7f68780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 -- 172.21.15.52:0/2447024549 shutdown_connections 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.119+0000 7f687dca5640 1 -- 172.21.15.52:0/2447024549 wait complete. 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 Processor -- start 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 -- start start 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878101de0 0x7f6878198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 0x7f68781989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6878111f90 con 0x7f6878106f10 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6878111e10 con 0x7f6878102790 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.120+0000 7f687dca5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6878112110 con 0x7f6878101de0 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55890/0 (socket says 172.21.15.52:55890) 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 -- 172.21.15.52:0/3075671276 learned_addr learned my addr 172.21.15.52:0/3075671276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 0x7f68781989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f68777fe640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878101de0 0x7f6878198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 -- 172.21.15.52:0/3075671276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878101de0 msgr2=0x7f6878198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878101de0 0x7f6878198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 -- 172.21.15.52:0/3075671276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 msgr2=0x7f68781989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 0x7f68781989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 -- 172.21.15.52:0/3075671276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687819d440 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6877fff640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f687000b970 tx=0x7f687000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6874ff9640 1 -- 172.21.15.52:0/3075671276 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870019070 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687819d730 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6874ff9640 1 -- 172.21.15.52:0/3075671276 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687000cb40 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f6874ff9640 1 -- 172.21.15.52:0/3075671276 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870007610 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.121+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68781a5010 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.123+0000 7f6874ff9640 1 -- 172.21.15.52:0/3075671276 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f687001c070 con 0x7f6878106f10 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 Processor -- start 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 -- start start 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a2dc0 0x55966e4ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4ad680 0x55966e4afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55966e4082e0 con 0x55966e4a24a0 2024-09-19T09:24:45.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55966e3afce0 con 0x55966e4ad680 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f688007e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55966e4042a0 con 0x55966e4a2dc0 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55896/0 (socket says 172.21.15.52:55896) 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f6876ffd640 1 -- 172.21.15.52:0/3157687141 learned_addr learned my addr 172.21.15.52:0/3157687141 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f68777fe640 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a2dc0 0x55966e4ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f6874ff9640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 0x7f68640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.124+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4ad680 0x55966e4afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 -- 172.21.15.52:0/3157687141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a2dc0 msgr2=0x55966e4ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a2dc0 0x55966e4ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 -- 172.21.15.52:0/3157687141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4ad680 msgr2=0x55966e4afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4ad680 0x55966e4afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6877fff640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 0x7f68640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 -- 172.21.15.52:0/3157687141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966e394440 con 0x55966e4a24a0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6874ff9640 1 -- 172.21.15.52:0/3075671276 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68700ceee0 con 0x7f6878106f10 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f68600058a0 tx=0x7f686000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8825b432a650887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f686dffb640 1 -- 172.21.15.52:0/3157687141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860004030 con 0x55966e4a24a0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f6877fff640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 0x7f68640a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f687000b940 tx=0x7f687000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f686dffb640 1 -- 172.21.15.52:0/3157687141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68600041d0 con 0x55966e4a24a0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.125+0000 7f686dffb640 1 -- 172.21.15.52:0/3157687141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600104c0 con 0x55966e4a24a0 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- 172.21.15.52:0/3157687141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 msgr2=0x55966e4a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f68600058a0 tx=0x7f686000b840 comp rx=0 tx=0).stop 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- 172.21.15.52:0/3157687141 shutdown_connections 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4ad680 0x55966e4afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a2dc0 0x55966e4ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 --2- 172.21.15.52:0/3157687141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a2880 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- 172.21.15.52:0/3157687141 >> 172.21.15.52:0/3157687141 conn(0x55966e49ea30 msgr2=0x55966e49ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- 172.21.15.52:0/3157687141 shutdown_connections 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- 172.21.15.52:0/3157687141 wait complete. 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 -- start start 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.126+0000 7f688007e740 1 Processor -- start 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55966e4b0250 con 0x55966e4ad680 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55966e3c3050 con 0x55966e4a2dc0 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55966e4b03d0 con 0x55966e4a24a0 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f688007e740 10 client.0 _ll_register_callbacks cb 0x55966e403160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55898/0 (socket says 172.21.15.52:55898) 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 -- 172.21.15.52:0/70408222 learned_addr learned my addr 172.21.15.52:0/70408222 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f68777fe640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 -- 172.21.15.52:0/70408222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 msgr2=0x55966e4ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 -- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 msgr2=0x55966e4aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.127+0000 7f6876ffd640 1 -- 172.21.15.52:0/70408222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966e1793c0 con 0x55966e4ad680 2024-09-19T09:24:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6876ffd640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f68600059b0 tx=0x7f6860003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717abab99b08a2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860023060 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68600035f0 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68600041d0 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f68600037f0 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 10 client.16551 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55966e4bbc70 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68600041d0 con 0x55966e4ad680 2024-09-19T09:24:45.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6860004810 con 0x55966e4ad680 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 10 client.16551 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 20 client.16551 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e4bcfc0 0x55966e4bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 4 client.16551 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.128+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55966e415850 con 0x55966e4bcfc0 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.129+0000 7f68777fe640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e4bcfc0 0x55966e4bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.129+0000 7f68777fe640 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e4bcfc0 0x55966e4bf3b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61f08b5de6dace3b server_cookie=3ce5d20334e90ce in_seq=0 out_seq=0 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.129+0000 7f6856ffd640 10 client.16551 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f6856ffd640 1 -- 172.21.15.52:0/70408222 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55966e415850 con 0x55966e4bcfc0 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f6856ffd640 10 client.16551 handle_command_reply: tid=0 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 client.16551 shutdown 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 msgr2=0x55966e4aa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f68600059b0 tx=0x7f6860003c10 comp rx=0 tx=0).stop 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 shutdown_connections 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e4bcfc0 0x55966e4bf3b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4aa8e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f6856ffd640 0 client.16551 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:45.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 --2- 172.21.15.52:0/70408222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 >> 172.21.15.52:0/70408222 conn(0x55966e49ea30 msgr2=0x55966e4a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 shutdown_connections 2024-09-19T09:24:45.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 1 -- 172.21.15.52:0/70408222 wait complete. 2024-09-19T09:24:45.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.130+0000 7f688007e740 20 client.16551 trim_cache size 0 max 16384 2024-09-19T09:24:45.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.147+0000 7f688007e740 1 Processor -- start 2024-09-19T09:24:45.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.147+0000 7f688007e740 1 -- start start 2024-09-19T09:24:45.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4ad680 0x55966e4c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68781b01d0 con 0x55966e4a24a0 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68781adaa0 con 0x55966e4a2dc0 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f688007e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ab8f0 con 0x55966e4ad680 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55908/0 (socket says 172.21.15.52:55908) 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 -- 172.21.15.52:0/3775874948 learned_addr learned my addr 172.21.15.52:0/3775874948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 -- 172.21.15.52:0/3775874948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4ad680 msgr2=0x55966e4c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4ad680 0x55966e4c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 -- 172.21.15.52:0/3775874948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 msgr2=0x55966e4c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 -- 172.21.15.52:0/3775874948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966e4afde0 con 0x55966e4a24a0 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6860012fd0 tx=0x7f686000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3426e76efbad6be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f686d7fa640 1 -- 172.21.15.52:0/3775874948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600122e0 con 0x55966e4a24a0 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f686d7fa640 1 -- 172.21.15.52:0/3775874948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686000b770 con 0x55966e4a24a0 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.148+0000 7f686d7fa640 1 -- 172.21.15.52:0/3775874948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600041b0 con 0x55966e4a24a0 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- 172.21.15.52:0/3775874948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 msgr2=0x55966e4a8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6860012fd0 tx=0x7f686000bb40 comp rx=0 tx=0).stop 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- 172.21.15.52:0/3775874948 shutdown_connections 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4ad680 0x55966e4c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 --2- 172.21.15.52:0/3775874948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4a24a0 0x55966e4a8be0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- 172.21.15.52:0/3775874948 >> 172.21.15.52:0/3775874948 conn(0x55966e49ea30 msgr2=0x55966e4ac370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- 172.21.15.52:0/3775874948 shutdown_connections 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- 172.21.15.52:0/3775874948 wait complete. 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.149+0000 7f688007e740 1 -- start start 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 Processor -- start 2024-09-19T09:24:45.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68781abf60 con 0x55966e4ad680 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ad3d0 con 0x55966e4a2dc0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68781ac630 con 0x55966e4a24a0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f688007e740 10 client.0 _ll_register_callbacks cb 0x7f6868009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55924/0 (socket says 172.21.15.52:55924) 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 -- 172.21.15.52:0/3354389172 learned_addr learned my addr 172.21.15.52:0/3354389172 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f68777fe640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 -- 172.21.15.52:0/3354389172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 msgr2=0x55966e4b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 -- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 msgr2=0x55966e4b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.150+0000 7f6876ffd640 1 -- 172.21.15.52:0/3354389172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966e526b00 con 0x55966e4ad680 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6876ffd640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6860004c60 tx=0x7f686000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b762b28003e1e24c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686003e060 con 0x55966e4ad680 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6860004590 con 0x55966e4ad680 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686000b770 con 0x55966e4ad680 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6860004790 con 0x55966e4ad680 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 10 client.16557 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:45.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55966e527df0 con 0x55966e4ad680 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686000b770 con 0x55966e4ad680 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6860010510 con 0x55966e4ad680 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 10 client.16557 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 20 client.16557 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e528450 0x55966e52a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 4 client.16557 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.151+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55966e40fd60 con 0x55966e528450 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f68777fe640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e528450 0x55966e52a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f68777fe640 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e528450 0x55966e52a840 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744e8026ca46bfd2 server_cookie=2a9d21edb9c90629 in_seq=0 out_seq=0 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f6856ffd640 10 client.16557 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f6856ffd640 1 -- 172.21.15.52:0/3354389172 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55966e40fd60 con 0x55966e528450 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f6856ffd640 10 client.16557 handle_command_reply: tid=0 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f688007e740 1 client.16557 shutdown 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 msgr2=0x55966e4b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.152+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6860004c60 tx=0x7f686000bbb0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 shutdown_connections 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55966e528450 0x55966e52a840 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55966e4ad680 0x55966e4b3e20 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55966e4a2dc0 0x55966e4b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 --2- 172.21.15.52:0/3354389172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55966e4a24a0 0x55966e4b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 >> 172.21.15.52:0/3354389172 conn(0x55966e49ea30 msgr2=0x55966e49d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f6856ffd640 0 client.16557 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 shutdown_connections 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 1 -- 172.21.15.52:0/3354389172 wait complete. 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f688007e740 20 client.16557 trim_cache size 0 max 16384 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:24:45.161 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 msgr2=0x7f68640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 0x7f68640a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f687000b940 tx=0x7f687000e040 comp rx=0 tx=0).stop 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 msgr2=0x7f687819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f687000b970 tx=0x7f687000be30 comp rx=0 tx=0).stop 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 shutdown_connections 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6878106f10 0x7f687819cd60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878102790 0x7f68781989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68640a3240 0x7f68640a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 --2- 172.21.15.52:0/3075671276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6878101de0 0x7f6878198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.153+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 >> 172.21.15.52:0/3075671276 conn(0x7f68780fd8c0 msgr2=0x7f68780fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.154+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 shutdown_connections 2024-09-19T09:24:45.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:45.154+0000 7f687dca5640 1 -- 172.21.15.52:0/3075671276 wait complete. 2024-09-19T09:24:45.945 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:24:45.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:24:46.215 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:46.672 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:46 smithi052 ceph-mon[30947]: pgmap v438: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:24:46.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:46 smithi169 ceph-mon[35454]: pgmap v438: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:24:46.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:46 smithi086 ceph-mon[34813]: pgmap v438: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 -- 172.21.15.52:0/2552231389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94102790 msgr2=0x7ffa941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/2552231389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94102790 0x7ffa941067e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009ca0 tx=0x7ffa8402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 -- 172.21.15.52:0/2552231389 shutdown_connections 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/2552231389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 0x7ffa9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/2552231389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94102790 0x7ffa941067e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/2552231389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94101de0 0x7ffa941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 -- 172.21.15.52:0/2552231389 >> 172.21.15.52:0/2552231389 conn(0x7ffa940fd8c0 msgr2=0x7ffa940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 -- 172.21.15.52:0/2552231389 shutdown_connections 2024-09-19T09:24:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.754+0000 7ffa9ae78640 1 -- 172.21.15.52:0/2552231389 wait complete. 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 Processor -- start 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 -- start start 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 0x7ffa941989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 0x7ffa9419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94111f70 con 0x7ffa94101de0 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94111df0 con 0x7ffa94106f10 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa9ae78640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941120f0 con 0x7ffa94102790 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa98c14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa98c14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55956/0 (socket says 172.21.15.52:55956) 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa98c14640 1 -- 172.21.15.52:0/3207725982 learned_addr learned my addr 172.21.15.52:0/3207725982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa93fff640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 0x7ffa941989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa99415640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 0x7ffa9419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.755+0000 7ffa98c14640 1 -- 172.21.15.52:0/3207725982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 msgr2=0x7ffa941989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa98c14640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 0x7ffa941989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa98c14640 1 -- 172.21.15.52:0/3207725982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 msgr2=0x7ffa9419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa98c14640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 0x7ffa9419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa98c14640 1 -- 172.21.15.52:0/3207725982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9419d460 con 0x7ffa94101de0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa93fff640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 0x7ffa941989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa98c14640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d770 tx=0x7ffa7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c017070 con 0x7ffa94101de0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9419d750 con 0x7ffa94101de0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa7c005500 con 0x7ffa94101de0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c004e00 con 0x7ffa94101de0 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.756+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa941a5030 con 0x7ffa94101de0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.757+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa941021c0 con 0x7ffa94101de0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.758+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffa7c004fa0 con 0x7ffa94101de0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.759+0000 7ffa91ffb640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.759+0000 7ffa93fff640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.759+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffa7c0cf4d0 con 0x7ffa94101de0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.760+0000 7ffa93fff640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 0x7ffa800a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa94108880 tx=0x7ffa840093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.764+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa7c09c110 con 0x7ffa94101de0 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.980+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa9410a150 con 0x7ffa94101de0 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.981+0000 7ffa91ffb640 1 -- 172.21.15.52:0/3207725982 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ffa7c09ba10 con 0x7ffa94101de0 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 msgr2=0x7ffa800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 0x7ffa800a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffa94108880 tx=0x7ffa840093f0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 msgr2=0x7ffa941984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c00d770 tx=0x7ffa7c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 shutdown_connections 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa94106f10 0x7ffa9419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa800a3240 0x7ffa800a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa94102790 0x7ffa941989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 --2- 172.21.15.52:0/3207725982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa94101de0 0x7ffa941984b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 >> 172.21.15.52:0/3207725982 conn(0x7ffa940fd8c0 msgr2=0x7ffa940fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 shutdown_connections 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:46.983+0000 7ffa9ae78640 1 -- 172.21.15.52:0/3207725982 wait complete. 2024-09-19T09:24:47.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3207725982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:47.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3207725982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:47.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:24:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3207725982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:48.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 -- 172.21.15.52:0/3657025909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4101de0 msgr2=0x7fc1c41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 --2- 172.21.15.52:0/3657025909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4101de0 0x7fc1c41021c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009900 tx=0x7fc1b402a410 comp rx=0 tx=0).stop 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 -- 172.21.15.52:0/3657025909 shutdown_connections 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 --2- 172.21.15.52:0/3657025909 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4106f10 0x7fc1c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 --2- 172.21.15.52:0/3657025909 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4102790 0x7fc1c41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 --2- 172.21.15.52:0/3657025909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4101de0 0x7fc1c41021c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 -- 172.21.15.52:0/3657025909 >> 172.21.15.52:0/3657025909 conn(0x7fc1c40fd8c0 msgr2=0x7fc1c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 -- 172.21.15.52:0/3657025909 shutdown_connections 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.461+0000 7fc1c9048640 1 -- 172.21.15.52:0/3657025909 wait complete. 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 Processor -- start 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 -- start start 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4102790 0x7fc1c41988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111f30 con 0x7fc1c4106f10 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111db0 con 0x7fc1c4102790 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c9048640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41120b0 con 0x7fc1c4101de0 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57538/0 (socket says 172.21.15.52:57538) 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c359e640 1 -- 172.21.15.52:0/2482156328 learned_addr learned my addr 172.21.15.52:0/2482156328 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4102790 0x7fc1c41988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.462+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 -- 172.21.15.52:0/2482156328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 msgr2=0x7fc1c4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 -- 172.21.15.52:0/2482156328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4102790 msgr2=0x7fc1c41988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4102790 0x7fc1c41988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 -- 172.21.15.52:0/2482156328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c419d340 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c359e640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00eaa0 tx=0x7fc1bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1abfff640 1 -- 172.21.15.52:0/2482156328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc004d20 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1abfff640 1 -- 172.21.15.52:0/2482156328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1bc005020 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c419d630 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1abfff640 1 -- 172.21.15.52:0/2482156328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0116d0 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.463+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c41a4f10 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1abfff640 1 -- 172.21.15.52:0/2482156328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1bc0051d0 con 0x7fc1c4106f10 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 Processor -- start 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 -- start start 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5651ea31b2f0 con 0x5651ea3b6b40 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5651ea2c2cf0 con 0x5651ea3c4780 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1cb421740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5651ea3172b0 con 0x5651ea3b55d0 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57552/0 (socket says 172.21.15.52:57552) 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 -- 172.21.15.52:0/2293120548 learned_addr learned my addr 172.21.15.52:0/2293120548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 -- 172.21.15.52:0/2293120548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 msgr2=0x5651ea3b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 -- 172.21.15.52:0/2293120548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 msgr2=0x5651ea3c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.466+0000 7fc1c259c640 1 -- 172.21.15.52:0/2293120548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ea2a73a0 con 0x5651ea3b6b40 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1abfff640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ad10 tx=0x7fc1b80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f491572d11b642b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1abfff640 1 -- 172.21.15.52:0/2482156328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc1bc0cfaa0 con 0x7fc1c4106f10 2024-09-19T09:24:48.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1a97fa640 1 -- 172.21.15.52:0/2293120548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8012450 con 0x5651ea3b6b40 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1a97fa640 1 -- 172.21.15.52:0/2293120548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b8012ad0 con 0x5651ea3b6b40 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.467+0000 7fc1a97fa640 1 -- 172.21.15.52:0/2293120548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b801aa80 con 0x5651ea3b6b40 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- 172.21.15.52:0/2293120548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 msgr2=0x5651ea3b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009230 tx=0x7fc1b40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ad10 tx=0x7fc1b80117b0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- 172.21.15.52:0/2293120548 shutdown_connections 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2293120548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3b5090 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- 172.21.15.52:0/2293120548 >> 172.21.15.52:0/2293120548 conn(0x5651ea37e310 msgr2=0x5651ea3b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- 172.21.15.52:0/2293120548 shutdown_connections 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- 172.21.15.52:0/2293120548 wait complete. 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- start start 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 Processor -- start 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b55d0 0x5651ea3c4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b6b40 0x5651ea3c1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5651ea3c7480 con 0x5651ea3c4780 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5651ea2d6060 con 0x5651ea3b55d0 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.468+0000 7fc1cb421740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5651ea3c7600 con 0x5651ea3b6b40 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1cb421740 10 client.0 _ll_register_callbacks cb 0x5651ea0298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57566/0 (socket says 172.21.15.52:57566) 2024-09-19T09:24:48.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 -- 172.21.15.52:0/364022809 learned_addr learned my addr 172.21.15.52:0/364022809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c259c640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b6b40 0x5651ea3c1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b55d0 0x5651ea3c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 -- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b6b40 msgr2=0x5651ea3c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b6b40 0x5651ea3c1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 -- 172.21.15.52:0/364022809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b55d0 msgr2=0x5651ea3c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b55d0 0x5651ea3c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 -- 172.21.15.52:0/364022809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ea08c3c0 con 0x5651ea3c4780 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1c359e640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0984a0 tx=0x7fc1bc09c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df95967a2d8bc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc01f030 con 0x5651ea3c4780 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b8012ad0 con 0x5651ea3c4780 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc1bc005560 con 0x5651ea3c4780 2024-09-19T09:24:48.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc1bc0b5020 con 0x5651ea3c4780 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1cb421740 10 client.16575 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.469+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5651ea3d3000 con 0x5651ea3c4780 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b8012ad0 con 0x5651ea3c4780 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc1bc00f040 con 0x5651ea3c4780 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 10 client.16575 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 10 client.16575 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 20 client.16575 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea3d48d0 0x5651ea3d6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 4 client.16575 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651ea328860 con 0x5651ea3d48d0 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.470+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea3d48d0 0x5651ea3d6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1a6ff5640 10 client.16575 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea3d48d0 0x5651ea3d6d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d782cf2c3bd715ea server_cookie=299c8ad022493e1b in_seq=0 out_seq=0 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/364022809 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651ea328860 con 0x5651ea3d48d0 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1a6ff5640 10 client.16575 handle_command_reply: tid=0 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 client.16575 shutdown 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 msgr2=0x5651ea3c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc0984a0 tx=0x7fc1bc09c800 comp rx=0 tx=0).stop 2024-09-19T09:24:48.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 shutdown_connections 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea3d48d0 0x5651ea3d6d20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3c4780 0x5651ea3c1a50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b6b40 0x5651ea3c1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 --2- 172.21.15.52:0/364022809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b55d0 0x5651ea3c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.471+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 >> 172.21.15.52:0/364022809 conn(0x5651ea37e310 msgr2=0x5651ea3b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.472+0000 7fc1a6ff5640 0 client.16575 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:48.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.472+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 shutdown_connections 2024-09-19T09:24:48.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.472+0000 7fc1cb421740 1 -- 172.21.15.52:0/364022809 wait complete. 2024-09-19T09:24:48.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.472+0000 7fc1cb421740 20 client.16575 trim_cache size 0 max 16384 2024-09-19T09:24:48.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 Processor -- start 2024-09-19T09:24:48.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 -- start start 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3bfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41addc0 con 0x5651ea3b6b40 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41ab690 con 0x5651ea3c4780 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1cb421740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41a94e0 con 0x5651ea3b55d0 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57574/0 (socket says 172.21.15.52:57574) 2024-09-19T09:24:48.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 -- 172.21.15.52:0/2271859151 learned_addr learned my addr 172.21.15.52:0/2271859151 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:48.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 -- 172.21.15.52:0/2271859151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 msgr2=0x5651ea3d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 -- 172.21.15.52:0/2271859151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 msgr2=0x5651ea3bfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3bfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 -- 172.21.15.52:0/2271859151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ea3b6760 con 0x5651ea3b6b40 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ace0 tx=0x7fc1b801a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3982ebd09eba32a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.485+0000 7fc1a8ff9640 1 -- 172.21.15.52:0/2271859151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8029070 con 0x5651ea3b6b40 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1a8ff9640 1 -- 172.21.15.52:0/2271859151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b800a870 con 0x5651ea3b6b40 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1a8ff9640 1 -- 172.21.15.52:0/2271859151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80129e0 con 0x5651ea3b6b40 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- 172.21.15.52:0/2271859151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 msgr2=0x5651ea3c0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800ace0 tx=0x7fc1b801a620 comp rx=0 tx=0).stop 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- 172.21.15.52:0/2271859151 shutdown_connections 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3c4780 0x5651ea3bfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b6b40 0x5651ea3c0d00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2271859151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3b55d0 0x5651ea3d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- 172.21.15.52:0/2271859151 >> 172.21.15.52:0/2271859151 conn(0x5651ea37e310 msgr2=0x5651ea3bc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- 172.21.15.52:0/2271859151 shutdown_connections 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- 172.21.15.52:0/2271859151 wait complete. 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.486+0000 7fc1cb421740 1 -- start start 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 Processor -- start 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b6b40 0x5651ea3c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 0x5651ea43d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41a9b50 con 0x5651ea3b55d0 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41aafc0 con 0x5651ea3b6b40 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c41aa220 con 0x5651ea3c4780 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1cb421740 10 client.0 _ll_register_callbacks cb 0x7fc1bc005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57590/0 (socket says 172.21.15.52:57590) 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 -- 172.21.15.52:0/2613565820 learned_addr learned my addr 172.21.15.52:0/2613565820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b6b40 0x5651ea3c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c359e640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 0x5651ea43d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 -- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 msgr2=0x5651ea43d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 0x5651ea43d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 -- 172.21.15.52:0/2613565820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b6b40 msgr2=0x5651ea3c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b6b40 0x5651ea3c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c2d9d640 1 -- 172.21.15.52:0/2613565820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651ea43db00 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.487+0000 7fc1c359e640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 0x5651ea43d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1c2d9d640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc1b402a930 tx=0x7fc1b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a754a736b2f87e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b405a060 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc1b40037f0 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b800a870 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc1b4035040 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 10 client.16581 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5651ea43ecb0 con 0x5651ea3b55d0 2024-09-19T09:24:48.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b800a870 con 0x5651ea3b55d0 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc1b4054070 con 0x5651ea3b55d0 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 10 client.16581 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 10 client.16581 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 20 client.16581 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea43f3d0 0x5651ea4417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 4 client.16581 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.488+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651ea322d70 con 0x5651ea43f3d0 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea43f3d0 0x5651ea4417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1c259c640 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea43f3d0 0x5651ea4417c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed8fb5e4b5a2475d server_cookie=2dce354442dde3f0 in_seq=0 out_seq=0 2024-09-19T09:24:48.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1a6ff5640 10 client.16581 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1a6ff5640 1 -- 172.21.15.52:0/2613565820 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651ea322d70 con 0x5651ea43f3d0 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1a6ff5640 10 client.16581 handle_command_reply: tid=0 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 client.16581 shutdown 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 msgr2=0x5651ea3c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc1b402a930 tx=0x7fc1b402a410 comp rx=0 tx=0).stop 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 shutdown_connections 2024-09-19T09:24:48.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5651ea43f3d0 0x5651ea4417c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651ea3c4780 0x5651ea43d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651ea3b6b40 0x5651ea3c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 --2- 172.21.15.52:0/2613565820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651ea3b55d0 0x5651ea3c7930 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 >> 172.21.15.52:0/2613565820 conn(0x5651ea37e310 msgr2=0x5651ea3bfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1a6ff5640 0 client.16581 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.489+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 shutdown_connections 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1cb421740 1 -- 172.21.15.52:0/2613565820 wait complete. 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1cb421740 20 client.16581 trim_cache size 0 max 16384 2024-09-19T09:24:48.512 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 msgr2=0x7fc1ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009230 tx=0x7fc1b40058d0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 msgr2=0x7fc1c419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00eaa0 tx=0x7fc1bc00eea0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 shutdown_connections 2024-09-19T09:24:48.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1c4106f10 0x7fc1c419cc60 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc1c4102790 0x7fc1c41988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 --2- 172.21.15.52:0/2482156328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc1c4101de0 0x7fc1c4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 >> 172.21.15.52:0/2482156328 conn(0x7fc1c40fd8c0 msgr2=0x7fc1c40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 shutdown_connections 2024-09-19T09:24:48.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:48.490+0000 7fc1c9048640 1 -- 172.21.15.52:0/2482156328 wait complete. 2024-09-19T09:24:48.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:48 smithi052 ceph-mon[30947]: pgmap v439: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:48.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:48 smithi169 ceph-mon[35454]: pgmap v439: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:48.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:48 smithi086 ceph-mon[34813]: pgmap v439: 97 pgs: 97 active+clean; 1.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:24:49.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:24:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 -- 172.21.15.52:0/2246552022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86141036e0 msgr2=0x7f8614107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 --2- 172.21.15.52:0/2246552022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86141036e0 0x7f8614107b90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8608009930 tx=0x7f860802a420 comp rx=0 tx=0).stop 2024-09-19T09:24:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 -- 172.21.15.52:0/2246552022 shutdown_connections 2024-09-19T09:24:49.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 --2- 172.21.15.52:0/2246552022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 0x7f861410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 --2- 172.21.15.52:0/2246552022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86141036e0 0x7f8614107b90 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 --2- 172.21.15.52:0/2246552022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8614102d30 0x7f8614103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 -- 172.21.15.52:0/2246552022 >> 172.21.15.52:0/2246552022 conn(0x7f86140fc7d0 msgr2=0x7f86140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 -- 172.21.15.52:0/2246552022 shutdown_connections 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.819+0000 7f8618c8b640 1 -- 172.21.15.52:0/2246552022 wait complete. 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 Processor -- start 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 -- start start 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 0x7f8614198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 0x7f861419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86141120a0 con 0x7f8614102d30 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8614111f20 con 0x7f86141036e0 2024-09-19T09:24:49.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8618c8b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8614112220 con 0x7f86141082a0 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57604/0 (socket says 172.21.15.52:57604) 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 -- 172.21.15.52:0/4032075445 learned_addr learned my addr 172.21.15.52:0/4032075445 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8612d9d640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 0x7f861419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8611d9b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 0x7f8614198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 -- 172.21.15.52:0/4032075445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 msgr2=0x7f861419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 0x7f861419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 -- 172.21.15.52:0/4032075445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 msgr2=0x7f8614198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 0x7f8614198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 -- 172.21.15.52:0/4032075445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861419d4d0 con 0x7f8614102d30 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f8611d9b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 0x7f8614198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:49.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.820+0000 7f861259c640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f860400cce0 tx=0x7f860400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.821+0000 7f86037fe640 1 -- 172.21.15.52:0/4032075445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860400f650 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.821+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861419d7c0 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.821+0000 7f86037fe640 1 -- 172.21.15.52:0/4032075445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f860400fcd0 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.821+0000 7f86037fe640 1 -- 172.21.15.52:0/4032075445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604018c70 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.821+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141a50a0 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.823+0000 7f86037fe640 1 -- 172.21.15.52:0/4032075445 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f860400f7f0 con 0x7f8614102d30 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.823+0000 7f861b064740 1 Processor -- start 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 -- start start 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8360090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf83605d0 0x563bf8360a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563bf82c62f0 con 0x563bf836b370 2024-09-19T09:24:49.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563bf826dcf0 con 0x563bf83605d0 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861b064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563bf82c22b0 con 0x563bf8361b40 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57606/0 (socket says 172.21.15.52:57606) 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 -- 172.21.15.52:0/2946289950 learned_addr learned my addr 172.21.15.52:0/2946289950 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f861259c640 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf83605d0 0x563bf8360a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8612d9d640 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8360090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f86037fe640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 0x7f85fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 -- 172.21.15.52:0/2946289950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 msgr2=0x563bf8360090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8360090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 -- 172.21.15.52:0/2946289950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf83605d0 msgr2=0x563bf8360a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf83605d0 0x563bf8360a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8611d9b640 1 -- 172.21.15.52:0/2946289950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf82523a0 con 0x563bf836b370 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.824+0000 7f8612d9d640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 0x7f85fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.825+0000 7f86037fe640 1 -- 172.21.15.52:0/4032075445 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86040cfe30 con 0x7f8614102d30 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.825+0000 7f8611d9b640 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8608006010 tx=0x7f8608009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b2172bbd58ab33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.825+0000 7f8600ff9640 1 -- 172.21.15.52:0/2946289950 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860803f070 con 0x563bf836b370 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.825+0000 7f8600ff9640 1 -- 172.21.15.52:0/2946289950 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86080317b0 con 0x563bf836b370 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.825+0000 7f8600ff9640 1 -- 172.21.15.52:0/2946289950 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608035070 con 0x563bf836b370 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- 172.21.15.52:0/2946289950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 msgr2=0x563bf836d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f8612d9d640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 0x7f85fc0a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b6c0 tx=0x7f860c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8608006010 tx=0x7f8608009680 comp rx=0 tx=0).stop 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- 172.21.15.52:0/2946289950 shutdown_connections 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf836d760 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf83605d0 0x563bf8360a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 --2- 172.21.15.52:0/2946289950 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8360090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- 172.21.15.52:0/2946289950 >> 172.21.15.52:0/2946289950 conn(0x563bf8329310 msgr2=0x563bf835cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- 172.21.15.52:0/2946289950 shutdown_connections 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- 172.21.15.52:0/2946289950 wait complete. 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 -- start start 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.826+0000 7f861b064740 1 Processor -- start 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8367f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf83684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563bf836e010 con 0x563bf83605d0 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563bf8281060 con 0x563bf836b370 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563bf836e190 con 0x563bf8361b40 2024-09-19T09:24:49.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 10 client.0 _ll_register_callbacks cb 0x563bf7fd48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57614/0 (socket says 172.21.15.52:57614) 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 -- 172.21.15.52:0/612525961 learned_addr learned my addr 172.21.15.52:0/612525961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f8611d9b640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8367f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 -- 172.21.15.52:0/612525961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 msgr2=0x563bf8367f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8367f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f8612d9d640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf83684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 -- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 msgr2=0x563bf83684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf83684f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 -- 172.21.15.52:0/612525961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bf80373c0 con 0x563bf83605d0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861259c640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8604098830 tx=0x7f8604007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa6b3292bde1aa7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f85f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860409bf10 con 0x563bf83605d0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8604098a40 con 0x563bf83605d0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.827+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86080317b0 con 0x563bf83605d0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f860409bd30 con 0x563bf83605d0 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 10 client.16593 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:49.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563bf8379a20 con 0x563bf83605d0 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86080317b0 con 0x563bf83605d0 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86040b5210 con 0x563bf83605d0 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 10 client.16593 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 10 client.16593 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 20 client.16593 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf837ae30 0x563bf837d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 4 client.16593 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bf82d3860 con 0x563bf837ae30 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.828+0000 7f8611d9b640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf837ae30 0x563bf837d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.829+0000 7f8611d9b640 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf837ae30 0x563bf837d2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=61eff7a89b1a7ce9 server_cookie=dd6ae944b649308e in_seq=0 out_seq=0 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.829+0000 7f85f9ffb640 10 client.16593 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.829+0000 7f85f9ffb640 1 -- 172.21.15.52:0/612525961 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bf82d3860 con 0x563bf837ae30 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.829+0000 7f85f9ffb640 10 client.16593 handle_command_reply: tid=0 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.829+0000 7f861b064740 1 client.16593 shutdown 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 msgr2=0x563bf836ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8604098830 tx=0x7f8604007910 comp rx=0 tx=0).stop 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 shutdown_connections 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf837ae30 0x563bf837d2c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf83684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8367f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f85f9ffb640 0 client.16593 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:49.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 --2- 172.21.15.52:0/612525961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf836ace0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 >> 172.21.15.52:0/612525961 conn(0x563bf8329310 msgr2=0x563bf8362960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 shutdown_connections 2024-09-19T09:24:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 1 -- 172.21.15.52:0/612525961 wait complete. 2024-09-19T09:24:49.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.830+0000 7f861b064740 20 client.16593 trim_cache size 0 max 16384 2024-09-19T09:24:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 Processor -- start 2024-09-19T09:24:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 -- start start 2024-09-19T09:24:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8363120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf8363660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86141b0040 con 0x563bf83605d0 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ad910 con 0x563bf836b370 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861b064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ab760 con 0x563bf8361b40 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57626/0 (socket says 172.21.15.52:57626) 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 -- 172.21.15.52:0/3492802232 learned_addr learned my addr 172.21.15.52:0/3492802232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f8612d9d640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf8363660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f8611d9b640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8363120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 -- 172.21.15.52:0/3492802232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 msgr2=0x563bf8363120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8363120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 -- 172.21.15.52:0/3492802232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 msgr2=0x563bf8363660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf8363660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f861259c640 1 -- 172.21.15.52:0/3492802232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bf8363ba0 con 0x563bf83605d0 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.843+0000 7f8612d9d640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf8363660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861259c640 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f86040cdc20 tx=0x7f86040a4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28e2d1ebe325a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f85fbfff640 1 -- 172.21.15.52:0/3492802232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860409cad0 con 0x563bf83605d0 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f85fbfff640 1 -- 172.21.15.52:0/3492802232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86040a5040 con 0x563bf83605d0 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f85fbfff640 1 -- 172.21.15.52:0/3492802232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604098bd0 con 0x563bf83605d0 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 -- 172.21.15.52:0/3492802232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 msgr2=0x563bf8369f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f86040cdc20 tx=0x7f86040a4c00 comp rx=0 tx=0).stop 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 -- 172.21.15.52:0/3492802232 shutdown_connections 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf836b370 0x563bf8363660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf8361b40 0x563bf8363120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 --2- 172.21.15.52:0/3492802232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf83605d0 0x563bf8369f00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 -- 172.21.15.52:0/3492802232 >> 172.21.15.52:0/3492802232 conn(0x563bf8329310 msgr2=0x563bf83697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.844+0000 7f861b064740 1 -- 172.21.15.52:0/3492802232 shutdown_connections 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 -- 172.21.15.52:0/3492802232 wait complete. 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 -- start start 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 Processor -- start 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 0x563bf8365690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86141abdd0 con 0x563bf836b370 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ad240 con 0x563bf8361b40 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86141ac4a0 con 0x563bf83605d0 2024-09-19T09:24:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861b064740 10 client.0 _ll_register_callbacks cb 0x7f860400cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f8612d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:42428/0 (socket says 172.21.15.52:42428) 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f8612d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57640/0 (socket says 172.21.15.52:57640) 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f8611d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 0x563bf8365690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.845+0000 7f861259c640 1 -- 172.21.15.52:0/516100240 learned_addr learned my addr 172.21.15.52:0/516100240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 -- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 msgr2=0x563bf8365690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 0x563bf8365690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 -- 172.21.15.52:0/516100240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 msgr2=0x563bf8365bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 -- 172.21.15.52:0/516100240 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bf83e4d60 con 0x563bf83605d0 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f8612d9d640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f8611d9b640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 0x563bf8365690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861259c640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86040185f0 tx=0x7f86040d3470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=290296f6ae00741e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f85f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604066060 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f860409ba20 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86040a5040 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8604098bb0 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861b064740 10 client.25849 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.846+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563bf83e6000 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86040a5040 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86040a1910 con 0x563bf83605d0 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 10 client.25849 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 10 client.25849 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:24:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 20 client.25849 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf83e6610 0x563bf83e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 4 client.25849 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bf82cdd70 con 0x563bf83e6610 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.847+0000 7f8611d9b640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf83e6610 0x563bf83e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f8611d9b640 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf83e6610 0x563bf83e8a00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73d4d8676645437a server_cookie=ef916084246d3a07 in_seq=0 out_seq=0 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f85f9ffb640 10 client.25849 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f85f9ffb640 1 -- 172.21.15.52:0/516100240 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bf82cdd70 con 0x563bf83e6610 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f85f9ffb640 10 client.25849 handle_command_reply: tid=0 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 client.25849 shutdown 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 msgr2=0x563bf8365150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f86040185f0 tx=0x7f86040d3470 comp rx=0 tx=0).stop 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 shutdown_connections 2024-09-19T09:24:49.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563bf836b370 0x563bf8365bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563bf83e6610 0x563bf83e8a00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563bf8361b40 0x563bf8365690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 --2- 172.21.15.52:0/516100240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563bf83605d0 0x563bf8365150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 >> 172.21.15.52:0/516100240 conn(0x563bf8329310 msgr2=0x563bf836a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f85f9ffb640 0 client.25849 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 shutdown_connections 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 1 -- 172.21.15.52:0/516100240 wait complete. 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.848+0000 7f861b064740 20 client.25849 trim_cache size 0 max 16384 2024-09-19T09:24:49.859 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 msgr2=0x7f85fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 0x7f85fc0a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b6c0 tx=0x7f860c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 msgr2=0x7f8614198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f860400cce0 tx=0x7f860400a620 comp rx=0 tx=0).stop 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 shutdown_connections 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85fc0a3240 0x7f85fc0a5700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86141082a0 0x7f861419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86141036e0 0x7f8614198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 --2- 172.21.15.52:0/4032075445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8614102d30 0x7f8614198520 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 >> 172.21.15.52:0/4032075445 conn(0x7f86140fc7d0 msgr2=0x7f8614105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 shutdown_connections 2024-09-19T09:24:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:49.849+0000 7f8618c8b640 1 -- 172.21.15.52:0/4032075445 wait complete. 2024-09-19T09:24:50.675 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:50 smithi052 ceph-mon[30947]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 11 op/s 2024-09-19T09:24:50.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:50 smithi169 ceph-mon[35454]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 11 op/s 2024-09-19T09:24:50.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:24:50.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:50 smithi086 ceph-mon[34813]: pgmap v440: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.4 KiB/s wr, 11 op/s 2024-09-19T09:24:50.975 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 -- 172.21.15.52:0/3188908122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420101c30 msgr2=0x7f84201020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 --2- 172.21.15.52:0/3188908122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420101c30 0x7f84201020b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f841402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 -- 172.21.15.52:0/3188908122 shutdown_connections 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 --2- 172.21.15.52:0/3188908122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84201025f0 0x7f8420108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 --2- 172.21.15.52:0/3188908122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420101c30 0x7f84201020b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 --2- 172.21.15.52:0/3188908122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8420100a40 0x7f8420100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 -- 172.21.15.52:0/3188908122 >> 172.21.15.52:0/3188908122 conn(0x7f84200fc1e0 msgr2=0x7f84200fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 -- 172.21.15.52:0/3188908122 shutdown_connections 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.035+0000 7f84286fa640 1 -- 172.21.15.52:0/3188908122 wait complete. 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 Processor -- start 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 -- start start 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420101c30 0x7f84201971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84201025f0 0x7f842019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f842010c710 con 0x7f8420100a40 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f842010c590 con 0x7f84201025f0 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f84286fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f842010c890 con 0x7f8420101c30 2024-09-19T09:24:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57652/0 (socket says 172.21.15.52:57652) 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 -- 172.21.15.52:0/1899413157 learned_addr learned my addr 172.21.15.52:0/1899413157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426c97640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84201025f0 0x7f842019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 -- 172.21.15.52:0/1899413157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420101c30 msgr2=0x7f84201971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420101c30 0x7f84201971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 -- 172.21.15.52:0/1899413157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84201025f0 msgr2=0x7f842019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84201025f0 0x7f842019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.036+0000 7f8426496640 1 -- 172.21.15.52:0/1899413157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842019e8f0 con 0x7f8420100a40 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f8426496640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f841800d770 tx=0x7f841800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f841f7fe640 1 -- 172.21.15.52:0/1899413157 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418017070 con 0x7f8420100a40 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f841f7fe640 1 -- 172.21.15.52:0/1899413157 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8418009c30 con 0x7f8420100a40 2024-09-19T09:24:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f841f7fe640 1 -- 172.21.15.52:0/1899413157 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418003dd0 con 0x7f8420100a40 2024-09-19T09:24:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842019ebe0 con 0x7f8420100a40 2024-09-19T09:24:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.037+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842019f130 con 0x7f8420100a40 2024-09-19T09:24:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.040+0000 7f842b494740 1 Processor -- start 2024-09-19T09:24:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.040+0000 7f841f7fe640 1 -- 172.21.15.52:0/1899413157 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8418003f70 con 0x7f8420100a40 2024-09-19T09:24:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.040+0000 7f842b494740 1 -- start start 2024-09-19T09:24:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.040+0000 7f842b494740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966b9bb0 0x5565966b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.040+0000 7f842b494740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966ba4f0 0x5565966befb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f842b494740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f842b494740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55659661b2f0 con 0x5565966bf580 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f842b494740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5565965c3270 con 0x5565966b9bb0 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f842b494740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565966172b0 con 0x5565966ba4f0 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57658/0 (socket says 172.21.15.52:57658) 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8426496640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966ba4f0 0x5565966befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 -- 172.21.15.52:0/2971124117 learned_addr learned my addr 172.21.15.52:0/2971124117 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8426c97640 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966b9bb0 0x5565966b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 -- 172.21.15.52:0/2971124117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966ba4f0 msgr2=0x5565966befb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966ba4f0 0x5565966befb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f841f7fe640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 0x7f84080a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 -- 172.21.15.52:0/2971124117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966b9bb0 msgr2=0x5565966b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966b9bb0 0x5565966b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 -- 172.21.15.52:0/2971124117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565965c2340 con 0x5565966bf580 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8426c97640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 0x7f84080a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f841f7fe640 1 -- 172.21.15.52:0/1899413157 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f84180cf320 con 0x7f8420100a40 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f8425c95640 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84140314e0 tx=0x7f8414000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f7be572209f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.041+0000 7f841cff9640 1 -- 172.21.15.52:0/2971124117 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403e070 con 0x5565966bf580 2024-09-19T09:24:51.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f841cff9640 1 -- 172.21.15.52:0/2971124117 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84140043c0 con 0x5565966bf580 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f841cff9640 1 -- 172.21.15.52:0/2971124117 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035040 con 0x5565966bf580 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 -- 172.21.15.52:0/2971124117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 msgr2=0x5565966c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f8426c97640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 0x7f84080a5830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8410005fd0 tx=0x7f8410004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f84140314e0 tx=0x7f8414000bc0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 -- 172.21.15.52:0/2971124117 shutdown_connections 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966bf580 0x5565966c1a40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966ba4f0 0x5565966befb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 --2- 172.21.15.52:0/2971124117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966b9bb0 0x5565966b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 -- 172.21.15.52:0/2971124117 >> 172.21.15.52:0/2971124117 conn(0x5565966b3010 msgr2=0x5565966b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 -- 172.21.15.52:0/2971124117 shutdown_connections 2024-09-19T09:24:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.042+0000 7f842b494740 1 -- 172.21.15.52:0/2971124117 wait complete. 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 -- start start 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 Processor -- start 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5565966c24f0 con 0x5565966ba4f0 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5565965a4290 con 0x5565966bf580 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565966c2670 con 0x5565966b9bb0 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f842b494740 10 client.0 _ll_register_callbacks cb 0x5565965d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57666/0 (socket says 172.21.15.52:57666) 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f8425c95640 1 -- 172.21.15.52:0/1374292332 learned_addr learned my addr 172.21.15.52:0/1374292332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.043+0000 7f8426496640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 -- 172.21.15.52:0/1374292332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 msgr2=0x5565966c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8426c97640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 -- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 msgr2=0x5565966cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 -- 172.21.15.52:0/1374292332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659632e210 con 0x5565966ba4f0 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8425c95640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8414005c40 tx=0x7f8414004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2a8d2cb68ceda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841404b020 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8414005250 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84140043c0 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8414056050 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f842b494740 10 client.16611 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565963fa620 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84140043c0 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.044+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f84140035f0 con 0x5565966ba4f0 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 10 client.16611 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 10 client.16611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 20 client.16611 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565966cf5e0 0x5565966d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 4 client.16611 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556596628a20 con 0x5565966cf5e0 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f8426496640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565966cf5e0 0x5565966d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f8426496640 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565966cf5e0 0x5565966d19d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aaaf0c52ea00d31 server_cookie=3ae80cf5c5b6e43 in_seq=0 out_seq=0 2024-09-19T09:24:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.045+0000 7f8405ffb640 10 client.16611 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f8405ffb640 1 -- 172.21.15.52:0/1374292332 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556596628a20 con 0x5565966cf5e0 2024-09-19T09:24:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f8405ffb640 10 client.16611 handle_command_reply: tid=0 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 client.16611 shutdown 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 msgr2=0x5565966c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8414005c40 tx=0x7f8414004eb0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 shutdown_connections 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565966cf5e0 0x5565966d19d0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c4250 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f8405ffb640 0 client.16611 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 --2- 172.21.15.52:0/1374292332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 >> 172.21.15.52:0/1374292332 conn(0x5565966b3010 msgr2=0x5565966b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 shutdown_connections 2024-09-19T09:24:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.046+0000 7f842b494740 1 -- 172.21.15.52:0/1374292332 wait complete. 2024-09-19T09:24:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.047+0000 7f842b494740 20 client.16611 trim_cache size 0 max 16384 2024-09-19T09:24:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 Processor -- start 2024-09-19T09:24:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 -- start start 2024-09-19T09:24:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966d6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a9740 con 0x5565966ba4f0 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a7010 con 0x5565966bf580 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f842b494740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a4e60 con 0x5565966b9bb0 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57674/0 (socket says 172.21.15.52:57674) 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 -- 172.21.15.52:0/1096452911 learned_addr learned my addr 172.21.15.52:0/1096452911 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8426c97640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966d6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8426496640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 -- 172.21.15.52:0/1096452911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 msgr2=0x5565966b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 -- 172.21.15.52:0/1096452911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 msgr2=0x5565966d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966d6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8425c95640 1 -- 172.21.15.52:0/1096452911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565966ae2d0 con 0x5565966ba4f0 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8426c97640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966d6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.061+0000 7f8426496640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f8425c95640 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f841402a910 tx=0x7f84140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad9e284c1e7f3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f8407fff640 1 -- 172.21.15.52:0/1096452911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841404b040 con 0x5565966ba4f0 2024-09-19T09:24:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f8407fff640 1 -- 172.21.15.52:0/1096452911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84140035f0 con 0x5565966ba4f0 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f8407fff640 1 -- 172.21.15.52:0/1096452911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403e070 con 0x5565966ba4f0 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 -- 172.21.15.52:0/1096452911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 msgr2=0x5565966cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f841402a910 tx=0x7f84140045e0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 -- 172.21.15.52:0/1096452911 shutdown_connections 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966d6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966cb250 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 --2- 172.21.15.52:0/1096452911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 -- 172.21.15.52:0/1096452911 >> 172.21.15.52:0/1096452911 conn(0x5565966b3010 msgr2=0x5565966b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 -- 172.21.15.52:0/1096452911 shutdown_connections 2024-09-19T09:24:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.062+0000 7f842b494740 1 -- 172.21.15.52:0/1096452911 wait complete. 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 -- start start 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 Processor -- start 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a54d0 con 0x5565966ba4f0 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a6940 con 0x5565966bf580 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84201a5ba0 con 0x5565966b9bb0 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f842b494740 10 client.0 _ll_register_callbacks cb 0x7f8410009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57678/0 (socket says 172.21.15.52:57678) 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 -- 172.21.15.52:0/1763129445 learned_addr learned my addr 172.21.15.52:0/1763129445 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8426496640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8426c97640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 -- 172.21.15.52:0/1763129445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 msgr2=0x5565966c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 -- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 msgr2=0x5565966ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.063+0000 7f8425c95640 1 -- 172.21.15.52:0/1763129445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565966cab00 con 0x5565966ba4f0 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8425c95640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8414005ec0 tx=0x7f8414005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643c2c12c3f3e3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841405e020 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8414003dd0 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84140035f0 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f841404b070 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 10 client.16617 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55659673a810 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84140035f0 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8414043450 con 0x5565966ba4f0 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 10 client.16617 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 20 client.16617 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55659673afc0 0x55659673d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 4 client.16617 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.064+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556596622d70 con 0x55659673afc0 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.065+0000 7f8426496640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55659673afc0 0x55659673d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.065+0000 7f8426496640 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55659673afc0 0x55659673d3e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7caf2805ac4524d server_cookie=c49342edadd43b47 in_seq=0 out_seq=0 2024-09-19T09:24:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.065+0000 7f8405ffb640 10 client.16617 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f8405ffb640 1 -- 172.21.15.52:0/1763129445 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556596622d70 con 0x55659673afc0 2024-09-19T09:24:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f8405ffb640 10 client.16617 handle_command_reply: tid=0 2024-09-19T09:24:51.077 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 client.16617 shutdown 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 msgr2=0x5565966c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8414005ec0 tx=0x7f8414005720 comp rx=0 tx=0).stop 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 shutdown_connections 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55659673afc0 0x55659673d3e0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565966bf580 0x5565966ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565966ba4f0 0x5565966c94e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f8405ffb640 0 client.16617 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 --2- 172.21.15.52:0/1763129445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565966b9bb0 0x5565966c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 >> 172.21.15.52:0/1763129445 conn(0x5565966b3010 msgr2=0x5565966b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.078 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 shutdown_connections 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 1 -- 172.21.15.52:0/1763129445 wait complete. 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.076+0000 7f842b494740 20 client.16617 trim_cache size 0 max 16384 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:24:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 msgr2=0x7f84080a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 0x7f84080a5830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8410005fd0 tx=0x7f8410004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 msgr2=0x7f8420196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f841800d770 tx=0x7f841800dc30 comp rx=0 tx=0).stop 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 shutdown_connections 2024-09-19T09:24:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84201025f0 0x7f842019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84080a3370 0x7f84080a5830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8420101c30 0x7f84201971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 --2- 172.21.15.52:0/1899413157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8420100a40 0x7f8420196cb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 >> 172.21.15.52:0/1899413157 conn(0x7f84200fc1e0 msgr2=0x7f8420104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 shutdown_connections 2024-09-19T09:24:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:24:51.077+0000 7f84286fa640 1 -- 172.21.15.52:0/1899413157 wait complete. 2024-09-19T09:24:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 -- 172.21.15.52:0/92420206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 msgr2=0x7f7f6c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/92420206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c10ec40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009cd0 tx=0x7f7f6402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 -- 172.21.15.52:0/92420206 shutdown_connections 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/92420206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c10ec40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/92420206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 0x7f7f6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/92420206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 0x7f7f6c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 -- 172.21.15.52:0/92420206 >> 172.21.15.52:0/92420206 conn(0x7f7f6c0fc7d0 msgr2=0x7f7f6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 -- 172.21.15.52:0/92420206 shutdown_connections 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.436+0000 7f7f73bc3640 1 -- 172.21.15.52:0/92420206 wait complete. 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 Processor -- start 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 -- start start 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 0x7f7f6c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1120a0 con 0x7f7f6c1082a0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c111f20 con 0x7f7f6c102d30 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f73bc3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c112220 con 0x7f7f6c1036e0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57698/0 (socket says 172.21.15.52:57698) 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 -- 172.21.15.52:0/4243230386 learned_addr learned my addr 172.21.15.52:0/4243230386 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f7195f640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 0x7f7f6c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 -- 172.21.15.52:0/4243230386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 msgr2=0x7f7f6c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 0x7f7f6c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 -- 172.21.15.52:0/4243230386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 msgr2=0x7f7f6c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.437+0000 7f7f72160640 1 -- 172.21.15.52:0/4243230386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c19d490 con 0x7f7f6c1082a0 2024-09-19T09:24:51.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f72160640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005cc0 tx=0x7f7f64003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f62ffd640 1 -- 172.21.15.52:0/4243230386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64004040 con 0x7f7f6c1082a0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f62ffd640 1 -- 172.21.15.52:0/4243230386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f640046c0 con 0x7f7f6c1082a0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c19d720 con 0x7f7f6c1082a0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f62ffd640 1 -- 172.21.15.52:0/4243230386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64030e70 con 0x7f7f6c1082a0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.438+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1a5060 con 0x7f7f6c1082a0 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.441+0000 7f7f75f9c740 1 Processor -- start 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.441+0000 7f7f75f9c740 1 -- start start 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a526f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a527c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8a51d52f0 con 0x55e8a5270b40 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e8a517ccf0 con 0x55e8a527a370 2024-09-19T09:24:51.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8a51d12b0 con 0x55e8a526f5d0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:42502/0 (socket says 172.21.15.52:42502) 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 -- 172.21.15.52:0/1389140157 learned_addr learned my addr 172.21.15.52:0/1389140157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7115e640 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a527c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7115e640 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a526f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 -- 172.21.15.52:0/1389140157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 msgr2=0x55e8a527c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a527c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 -- 172.21.15.52:0/1389140157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 msgr2=0x55e8a526f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a526f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.442+0000 7f7f7195f640 1 -- 172.21.15.52:0/1389140157 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a51613a0 con 0x55e8a526f5d0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.443+0000 7f7f7195f640 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800ad00 tx=0x7f7f6800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58f361464122522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.443+0000 7f7f57fff640 1 -- 172.21.15.52:0/1389140157 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6801d070 con 0x55e8a526f5d0 2024-09-19T09:24:51.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.443+0000 7f7f57fff640 1 -- 172.21.15.52:0/1389140157 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f68018b20 con 0x55e8a526f5d0 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.443+0000 7f7f57fff640 1 -- 172.21.15.52:0/1389140157 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f68010b60 con 0x55e8a526f5d0 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 -- 172.21.15.52:0/1389140157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 msgr2=0x55e8a526fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800ad00 tx=0x7f7f6800f790 comp rx=0 tx=0).stop 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f62ffd640 1 -- 172.21.15.52:0/4243230386 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f640305a0 con 0x7f7f6c1082a0 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 -- 172.21.15.52:0/1389140157 shutdown_connections 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a527c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a526fa10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/1389140157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a526f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 -- 172.21.15.52:0/1389140157 >> 172.21.15.52:0/1389140157 conn(0x55e8a5238310 msgr2=0x55e8a526bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 -- 172.21.15.52:0/1389140157 shutdown_connections 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.444+0000 7f7f75f9c740 1 -- 172.21.15.52:0/1389140157 wait complete. 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 -- start start 2024-09-19T09:24:51.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 Processor -- start 2024-09-19T09:24:51.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f62ffd640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 0x7f7f580a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 0x7f7f580a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f62ffd640 1 -- 172.21.15.52:0/4243230386 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f6402e030 con 0x7f7f6c1082a0 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a5270b40 0x55e8a5276ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52775e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e8a527d070 con 0x55e8a526f5d0 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e8a5190060 con 0x55e8a5270b40 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e8a527d1f0 con 0x55e8a527a370 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.445+0000 7f7f75f9c740 10 client.0 _ll_register_callbacks cb 0x55e8a4ee38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:51.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57716/0 (socket says 172.21.15.52:57716) 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 -- 172.21.15.52:0/482959007 learned_addr learned my addr 172.21.15.52:0/482959007 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f72160640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 0x7f7f580a5690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bfd0 tx=0x7f7f5c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7115e640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a5270b40 0x55e8a5276ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 -- 172.21.15.52:0/482959007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 msgr2=0x55e8a52775e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52775e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 -- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a5270b40 msgr2=0x55e8a5276ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a5270b40 0x55e8a5276ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 -- 172.21.15.52:0/482959007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a4f463c0 con 0x55e8a526f5d0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f72160640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f7195f640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f680186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2550f16739506 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6801d040 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f68018b20 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.446+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f680108e0 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f6800a910 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 10 client.16629 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e8a528cec0 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f68018b20 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7f68020030 con 0x55e8a526f5d0 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 10 client.16629 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 20 client.16629 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a528e210 0x55e8a5290600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 4 client.16629 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8a51e2860 con 0x55e8a528e210 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.447+0000 7f7f7115e640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a528e210 0x55e8a5290600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.448+0000 7f7f557fa640 10 client.16629 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.448+0000 7f7f7115e640 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a528e210 0x55e8a5290600 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee9e13e5de3792 server_cookie=b1b0b3bcc9106f17 in_seq=0 out_seq=0 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.448+0000 7f7f557fa640 1 -- 172.21.15.52:0/482959007 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8a51e2860 con 0x55e8a528e210 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.448+0000 7f7f557fa640 10 client.16629 handle_command_reply: tid=0 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 client.16629 shutdown 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 msgr2=0x55e8a5279d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7f68000c00 tx=0x7f7f680186f0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 shutdown_connections 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a528e210 0x55e8a5290600 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a5270b40 0x55e8a5276ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f557fa640 0 client.16629 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/482959007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a526f5d0 0x55e8a5279d40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 >> 172.21.15.52:0/482959007 conn(0x55e8a5238310 msgr2=0x55e8a5271960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 shutdown_connections 2024-09-19T09:24:51.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 1 -- 172.21.15.52:0/482959007 wait complete. 2024-09-19T09:24:51.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.449+0000 7f7f75f9c740 20 client.16629 trim_cache size 0 max 16384 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 Processor -- start 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 -- start start 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a5272120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a5295c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1ade80 con 0x55e8a5270b40 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1ab750 con 0x55e8a527a370 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a95a0 con 0x55e8a526f5d0 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f7115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f7115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57718/0 (socket says 172.21.15.52:57718) 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.462+0000 7f7f7115e640 1 -- 172.21.15.52:0/2868228526 learned_addr learned my addr 172.21.15.52:0/2868228526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f72160640 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a5295c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7195f640 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a5272120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 -- 172.21.15.52:0/2868228526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 msgr2=0x55e8a5272120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a5272120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 -- 172.21.15.52:0/2868228526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 msgr2=0x55e8a5295c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a5295c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 -- 172.21.15.52:0/2868228526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8a526cdd0 con 0x55e8a5270b40 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f7115e640 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c004280 tx=0x7f7f5c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9308948d6481bbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f577fe640 1 -- 172.21.15.52:0/2868228526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0043f0 con 0x55e8a5270b40 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f577fe640 1 -- 172.21.15.52:0/2868228526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c005500 con 0x55e8a5270b40 2024-09-19T09:24:51.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.463+0000 7f7f577fe640 1 -- 172.21.15.52:0/2868228526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0035f0 con 0x55e8a5270b40 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- 172.21.15.52:0/2868228526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 msgr2=0x55e8a5272660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c004280 tx=0x7f7f5c00b690 comp rx=0 tx=0).stop 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- 172.21.15.52:0/2868228526 shutdown_connections 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a527a370 0x55e8a5295c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5272660 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/2868228526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a526f5d0 0x55e8a5272120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- 172.21.15.52:0/2868228526 >> 172.21.15.52:0/2868228526 conn(0x55e8a5238310 msgr2=0x55e8a5276120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- 172.21.15.52:0/2868228526 shutdown_connections 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- 172.21.15.52:0/2868228526 wait complete. 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 -- start start 2024-09-19T09:24:51.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.464+0000 7f7f75f9c740 1 Processor -- start 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a526f5d0 0x55e8a52829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a9c10 con 0x55e8a5270b40 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1ab080 con 0x55e8a526f5d0 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1aa2e0 con 0x55e8a527a370 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f75f9c740 10 client.0 _ll_register_callbacks cb 0x7f7f6801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57726/0 (socket says 172.21.15.52:57726) 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 -- 172.21.15.52:0/4009770202 learned_addr learned my addr 172.21.15.52:0/4009770202 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7195f640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a526f5d0 0x55e8a52829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f72160640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 -- 172.21.15.52:0/4009770202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 msgr2=0x55e8a52740e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52740e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 -- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a526f5d0 msgr2=0x55e8a52829d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a526f5d0 0x55e8a52829d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 -- 172.21.15.52:0/4009770202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8a52746d0 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f7115e640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c035040 tx=0x7f7f5c00b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cf4b7c378df57e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f557fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.465+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c004730 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f5c0048d0 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5c005500 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c004ad0 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 10 client.16635 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e8a52f8a30 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c005500 con 0x55e8a5270b40 2024-09-19T09:24:51.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7f5c032030 con 0x55e8a5270b40 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 10 client.16635 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 20 client.16635 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a52f9120 0x55e8a52fb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 4 client.16635 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.466+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8a51dcd70 con 0x55e8a52f9120 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f7195f640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a52f9120 0x55e8a52fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f7195f640 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a52f9120 0x55e8a52fb540 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70b0004ea344f93 server_cookie=56d622e22dc15ca5 in_seq=0 out_seq=0 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f557fa640 10 client.16635 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f557fa640 1 -- 172.21.15.52:0/4009770202 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8a51dcd70 con 0x55e8a52f9120 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f557fa640 10 client.16635 handle_command_reply: tid=0 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 client.16635 shutdown 2024-09-19T09:24:51.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 msgr2=0x55e8a5273ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c035040 tx=0x7f7f5c00b7f0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 shutdown_connections 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e8a52f9120 0x55e8a52fb540 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e8a527a370 0x55e8a52740e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e8a5270b40 0x55e8a5273ba0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 --2- 172.21.15.52:0/4009770202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e8a526f5d0 0x55e8a52829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 >> 172.21.15.52:0/4009770202 conn(0x55e8a5238310 msgr2=0x55e8a526a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f557fa640 0 client.16635 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 shutdown_connections 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.467+0000 7f7f75f9c740 1 -- 172.21.15.52:0/4009770202 wait complete. 2024-09-19T09:24:51.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f75f9c740 20 client.16635 trim_cache size 0 max 16384 2024-09-19T09:24:51.474 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:24:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 msgr2=0x7f7f580a5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 0x7f7f580a5690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bfd0 tx=0x7f7f5c00b390 comp rx=0 tx=0).stop 2024-09-19T09:24:51.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 msgr2=0x7f7f6c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005cc0 tx=0x7f7f64003970 comp rx=0 tx=0).stop 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 shutdown_connections 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f6c1082a0 0x7f7f6c19cdb0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f580a31d0 0x7f7f580a5690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f6c1036e0 0x7f7f6c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 --2- 172.21.15.52:0/4243230386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 >> 172.21.15.52:0/4243230386 conn(0x7f7f6c0fc7d0 msgr2=0x7f7f6c0fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 shutdown_connections 2024-09-19T09:24:51.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:51.468+0000 7f7f73bc3640 1 -- 172.21.15.52:0/4243230386 wait complete. 2024-09-19T09:24:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:52 smithi169 ceph-mon[35454]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:24:52.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:52 smithi086 ceph-mon[34813]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:24:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:52 smithi052 ceph-mon[30947]: pgmap v441: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:24:53.260 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:24:53.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:24:53.533 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:53.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.997+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/1894397135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 msgr2=0x7ff2a010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:53.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.997+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/1894397135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a010ea90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff298009ca0 tx=0x7ff29802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:53.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/1894397135 shutdown_connections 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/1894397135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a010ea90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/1894397135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 0x7ff2a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/1894397135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/1894397135 >> 172.21.15.52:0/1894397135 conn(0x7ff2a00fd8c0 msgr2=0x7ff2a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/1894397135 shutdown_connections 2024-09-19T09:24:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/1894397135 wait complete. 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 Processor -- start 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- start start 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 0x7ff2a019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111f70 con 0x7ff2a0106f10 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111df0 con 0x7ff2a0101de0 2024-09-19T09:24:54.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.998+0000 7ff2a6d9a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01120f0 con 0x7ff2a0102790 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57738/0 (socket says 172.21.15.52:57738) 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 -- 172.21.15.52:0/478766499 learned_addr learned my addr 172.21.15.52:0/478766499 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff29ffff640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 0x7ff2a019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 -- 172.21.15.52:0/478766499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 msgr2=0x7ff2a019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 0x7ff2a019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 -- 172.21.15.52:0/478766499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 msgr2=0x7ff2a019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 -- 172.21.15.52:0/478766499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a019f580 con 0x7ff2a0106f10 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a5337640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff298031a20 tx=0x7ff298031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff29dffb640 1 -- 172.21.15.52:0/478766499 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298003c30 con 0x7ff2a0106f10 2024-09-19T09:24:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff29dffb640 1 -- 172.21.15.52:0/478766499 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff298003dd0 con 0x7ff2a0106f10 2024-09-19T09:24:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:53.999+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a019f810 con 0x7ff2a0106f10 2024-09-19T09:24:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.000+0000 7ff29dffb640 1 -- 172.21.15.52:0/478766499 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29802fcf0 con 0x7ff2a0106f10 2024-09-19T09:24:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.000+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a01a7150 con 0x7ff2a0106f10 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff29dffb640 1 -- 172.21.15.52:0/478766499 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff298004050 con 0x7ff2a0106f10 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 Processor -- start 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 -- start start 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fbcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7f22280 con 0x55c2d7fc7d40 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7ec9b10 con 0x55c2d7fbd480 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.002+0000 7ff2a9173740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7f1e240 con 0x55c2d7fbcb60 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29dffb640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 0x7ff2900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57744/0 (socket says 172.21.15.52:57744) 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 -- 172.21.15.52:0/2642720982 learned_addr learned my addr 172.21.15.52:0/2642720982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fbcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff2a5337640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 0x7ff2900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29dffb640 1 -- 172.21.15.52:0/478766499 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff2980f0d40 con 0x7ff2a0106f10 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 -- 172.21.15.52:0/2642720982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 msgr2=0x55c2d7fbcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fbcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 -- 172.21.15.52:0/2642720982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbd480 msgr2=0x55c2d7fc7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 -- 172.21.15.52:0/2642720982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d7ed61f0 con 0x55c2d7fc7d40 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff29ffff640 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00bf90 tx=0x7ff28c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b569d314179d070e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.003+0000 7ff2a5337640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 0x7ff2900a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff2980bd2a0 tx=0x7ff29802f790 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff28affd640 1 -- 172.21.15.52:0/2642720982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004300 con 0x55c2d7fc7d40 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff28affd640 1 -- 172.21.15.52:0/2642720982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c0044a0 con 0x55c2d7fc7d40 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff28affd640 1 -- 172.21.15.52:0/2642720982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c003850 con 0x55c2d7fc7d40 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 -- 172.21.15.52:0/2642720982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 msgr2=0x55c2d7fca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00bf90 tx=0x7ff28c00b790 comp rx=0 tx=0).stop 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 -- 172.21.15.52:0/2642720982 shutdown_connections 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fca130 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 --2- 172.21.15.52:0/2642720982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fbcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 -- 172.21.15.52:0/2642720982 >> 172.21.15.52:0/2642720982 conn(0x55c2d7fb90f0 msgr2=0x55c2d7fb94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 -- 172.21.15.52:0/2642720982 shutdown_connections 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.004+0000 7ff2a9173740 1 -- 172.21.15.52:0/2642720982 wait complete. 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 -- start start 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 Processor -- start 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fc5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7fca910 con 0x55c2d7fbd480 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7edcf10 con 0x55c2d7fc7d40 2024-09-19T09:24:54.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2d7fcaa90 con 0x55c2d7fbcb60 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a9173740 10 client.0 _ll_register_callbacks cb 0x55c2d7ea5a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a4b36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a4b36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57758/0 (socket says 172.21.15.52:57758) 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.005+0000 7ff2a4b36640 1 -- 172.21.15.52:0/4232422642 learned_addr learned my addr 172.21.15.52:0/4232422642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff29ffff640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff29ffff640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fc5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 -- 172.21.15.52:0/4232422642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 msgr2=0x55c2d7fc4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 -- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 msgr2=0x55c2d7fc5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fc5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 -- 172.21.15.52:0/4232422642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d7c936a0 con 0x55c2d7fbd480 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff29ffff640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fc5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:54.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bb70 tx=0x7ff2940039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ab21f1bfda230d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294005220 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff2940053c0 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2d7f2f7f0 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff29401f020 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a9173740 10 client.16647 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.006+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2d7fd65d0 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55c2d7f2f7f0 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff294019030 con 0x55c2d7fbd480 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 10 client.16647 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 20 client.16647 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d7fd9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 4 client.16647 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2d7f29d00 con 0x55c2d7fd7a30 2024-09-19T09:24:54.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff29ffff640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d7fd9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff29ffff640 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d7fd9e70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2b837f0ade3a5a7 server_cookie=1de9cf444aa657a3 in_seq=0 out_seq=0 2024-09-19T09:24:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.007+0000 7ff27ffff640 10 client.16647 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:54.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff27ffff640 1 -- 172.21.15.52:0/4232422642 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2d7f29d00 con 0x55c2d7fd7a30 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff27ffff640 10 client.16647 handle_command_reply: tid=0 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 client.16647 shutdown 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 msgr2=0x55c2d7fc51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bb70 tx=0x7ff2940039c0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 shutdown_connections 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d7fd9e70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fc5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff27ffff640 0 client.16647 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fc51c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 --2- 172.21.15.52:0/4232422642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.008+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 >> 172.21.15.52:0/4232422642 conn(0x55c2d7fb90f0 msgr2=0x55c2d7fbedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:54.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.009+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 shutdown_connections 2024-09-19T09:24:54.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.009+0000 7ff2a9173740 1 -- 172.21.15.52:0/4232422642 wait complete. 2024-09-19T09:24:54.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.009+0000 7ff2a9173740 20 client.16647 trim_cache size 0 max 16384 2024-09-19T09:24:54.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 Processor -- start 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 -- start start 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 0x55c2d7fdf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fdfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01b2270 con 0x55c2d7fbcb60 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01afb40 con 0x55c2d7fc7d40 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff2a9173740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ad990 con 0x55c2d7fbd480 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57760/0 (socket says 172.21.15.52:57760) 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.026+0000 7ff29ffff640 1 -- 172.21.15.52:0/3736372316 learned_addr learned my addr 172.21.15.52:0/3736372316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 0x55c2d7fdf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 -- 172.21.15.52:0/3736372316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 msgr2=0x55c2d7fdf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 0x55c2d7fdf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 -- 172.21.15.52:0/3736372316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 msgr2=0x55c2d7fdfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fdfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 -- 172.21.15.52:0/3736372316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d7fca4a0 con 0x55c2d7fbcb60 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 0x55c2d7fdf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55c2d7fba470 tx=0x7ff28c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57775bd4dc7feae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff28a7fc640 1 -- 172.21.15.52:0/3736372316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c004100 con 0x55c2d7fbcb60 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff28a7fc640 1 -- 172.21.15.52:0/3736372316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c0042a0 con 0x55c2d7fbcb60 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.027+0000 7ff28a7fc640 1 -- 172.21.15.52:0/3736372316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c02c8a0 con 0x55c2d7fbcb60 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- 172.21.15.52:0/3736372316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 msgr2=0x55c2d7fc3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55c2d7fba470 tx=0x7ff28c005f30 comp rx=0 tx=0).stop 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- 172.21.15.52:0/3736372316 shutdown_connections 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fdfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fbd480 0x55c2d7fdf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3736372316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fc3b50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- 172.21.15.52:0/3736372316 >> 172.21.15.52:0/3736372316 conn(0x55c2d7fb90f0 msgr2=0x55c2d7fc3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- 172.21.15.52:0/3736372316 shutdown_connections 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- 172.21.15.52:0/3736372316 wait complete. 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 -- start start 2024-09-19T09:24:54.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.028+0000 7ff2a9173740 1 Processor -- start 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fcfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fcccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ae000 con 0x55c2d7fbd480 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01af470 con 0x55c2d7fbcb60 2024-09-19T09:24:54.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ae6d0 con 0x55c2d7fc7d40 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a9173740 10 client.0 _ll_register_callbacks cb 0x7ff2940043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57770/0 (socket says 172.21.15.52:57770) 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 -- 172.21.15.52:0/3445677544 learned_addr learned my addr 172.21.15.52:0/3445677544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fcccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fcfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 -- 172.21.15.52:0/3445677544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fc7d40 msgr2=0x55c2d7fcccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fcccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 -- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 msgr2=0x55c2d7fcfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fcfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 -- 172.21.15.52:0/3445677544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d7fcd1f0 con 0x55c2d7fbd480 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fcfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff2a4b36640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff2940119d0 tx=0x7ff294004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72eaa8ac4c26c57c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:54.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.029+0000 7ff27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294005240 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff28c0042a0 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff2940053e0 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff294005600 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 10 client.16653 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2d8042dc0 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff28c0042a0 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff294011ce0 con 0x55c2d7fbd480 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 10 client.16653 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 20 client.16653 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d8045580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:54.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 4 client.16653 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.030+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2d7ea6110 con 0x55c2d7fd7a30 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.031+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d8045580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.031+0000 7ff27ffff640 10 client.16653 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.031+0000 7ff29ffff640 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d8045580 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ea954de03629076 server_cookie=640a6887be813c87 in_seq=0 out_seq=0 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff27ffff640 1 -- 172.21.15.52:0/3445677544 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2d7ea6110 con 0x55c2d7fd7a30 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff27ffff640 10 client.16653 handle_command_reply: tid=0 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 client.16653 shutdown 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 msgr2=0x55c2d7fd0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7ff2940119d0 tx=0x7ff294004080 comp rx=0 tx=0).stop 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 shutdown_connections 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2d7fd7a30 0x55c2d8045580 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2d7fc7d40 0x55c2d7fcccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2d7fbd480 0x55c2d7fd0220 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff27ffff640 0 client.16653 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 --2- 172.21.15.52:0/3445677544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2d7fbcb60 0x55c2d7fcfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 >> 172.21.15.52:0/3445677544 conn(0x55c2d7fb90f0 msgr2=0x55c2d7fb8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 shutdown_connections 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 1 -- 172.21.15.52:0/3445677544 wait complete. 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.032+0000 7ff2a9173740 20 client.16653 trim_cache size 0 max 16384 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "e3550b33-eec9-4919-aa4e-b154ad80ceba", 2024-09-19T09:24:54.038 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:24:54.039 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 msgr2=0x7ff2900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 0x7ff2900a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff2980bd2a0 tx=0x7ff29802f790 comp rx=0 tx=0).stop 2024-09-19T09:24:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 msgr2=0x7ff2a019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:54.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff298031a20 tx=0x7ff298031a50 comp rx=0 tx=0).stop 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 shutdown_connections 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2a0106f10 0x7ff2a019eea0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff2900a3240 0x7ff2900a5700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2a0102790 0x7ff2a019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 --2- 172.21.15.52:0/478766499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a0101de0 0x7ff2a019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 >> 172.21.15.52:0/478766499 conn(0x7ff2a00fd8c0 msgr2=0x7ff2a00feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 shutdown_connections 2024-09-19T09:24:54.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:54.033+0000 7ff2a6d9a640 1 -- 172.21.15.52:0/478766499 wait complete. 2024-09-19T09:24:54.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:54 smithi052 ceph-mon[30947]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T09:24:54.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:54 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:24:54.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:54 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:54.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:54 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:24:54.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:54 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:54.757 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:24:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:54 smithi086 ceph-mon[34813]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T09:24:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:54 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:24:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:54 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:54 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:24:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:54 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:54.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:54 smithi169 ceph-mon[35454]: pgmap v442: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-19T09:24:54.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:54 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:24:54.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:54 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:54.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:54 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:24:54.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:54 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:24:55.018 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:55.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 -- 172.21.15.52:0/3711729180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102ef0 msgr2=0x7f3cb410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 --2- 172.21.15.52:0/3711729180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410da40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009ca0 tx=0x7f3cac02a950 comp rx=0 tx=0).stop 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 -- 172.21.15.52:0/3711729180 shutdown_connections 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 --2- 172.21.15.52:0/3711729180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410da40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 --2- 172.21.15.52:0/3711729180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102570 0x7f3cb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 --2- 172.21.15.52:0/3711729180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 0x7f3cb4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 -- 172.21.15.52:0/3711729180 >> 172.21.15.52:0/3711729180 conn(0x7f3cb40fc7d0 msgr2=0x7f3cb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 -- 172.21.15.52:0/3711729180 shutdown_connections 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 -- 172.21.15.52:0/3711729180 wait complete. 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.494+0000 7f3cb98df640 1 Processor -- start 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 -- start start 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 0x7f3cb410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41120c0 con 0x7f3cb4102570 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4111f40 con 0x7f3cb4102ef0 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb98df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4112240 con 0x7f3cb4100e20 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57790/0 (socket says 172.21.15.52:57790) 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 -- 172.21.15.52:0/1477018888 learned_addr learned my addr 172.21.15.52:0/1477018888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 0x7f3cb410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 -- 172.21.15.52:0/1477018888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 msgr2=0x7f3cb410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 0x7f3cb410e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 -- 172.21.15.52:0/1477018888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 msgr2=0x7f3cb410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 -- 172.21.15.52:0/1477018888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb41a69c0 con 0x7f3cb4102570 2024-09-19T09:24:55.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.495+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800b4a0 tx=0x7f3ca800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.496+0000 7f3cb88dd640 1 -- 172.21.15.52:0/1477018888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8014070 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.496+0000 7f3cb88dd640 1 -- 172.21.15.52:0/1477018888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca8010af0 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.496+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41a6cb0 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.496+0000 7f3cb88dd640 1 -- 172.21.15.52:0/1477018888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8017d10 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.496+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a71a0 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.498+0000 7f3cb88dd640 1 -- 172.21.15.52:0/1477018888 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ca8017070 con 0x7f3cb4102570 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.498+0000 7f3cbbcb8740 1 Processor -- start 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.498+0000 7f3cbbcb8740 1 -- start start 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b350880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 0x55eb1b35da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b2b62e0 con 0x55eb1b350dc0 2024-09-19T09:24:55.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b25dce0 con 0x55eb1b35b680 2024-09-19T09:24:55.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b2b22a0 con 0x55eb1b3504a0 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb88dd640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 0x7f3c9c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57798/0 (socket says 172.21.15.52:57798) 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2771369049 learned_addr learned my addr 172.21.15.52:0/2771369049 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 0x7f3c9c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b350880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb88dd640 1 -- 172.21.15.52:0/1477018888 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3ca80cee10 con 0x7f3cb4102570 2024-09-19T09:24:55.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 0x55eb1b35da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2771369049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 msgr2=0x55eb1b350880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b350880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2771369049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 msgr2=0x55eb1b35da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 0x55eb1b35da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2771369049 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1b242440 con 0x55eb1b350dc0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 0x55eb1b35da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 0x7f3c9c0a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005cc0 tx=0x7f3cac005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.499+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bcf0 tx=0x7f3ca400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb35dc2d2d64250 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3c99ffb640 1 -- 172.21.15.52:0/2771369049 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4015070 con 0x55eb1b350dc0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3c99ffb640 1 -- 172.21.15.52:0/2771369049 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca401a940 con 0x55eb1b350dc0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3c99ffb640 1 -- 172.21.15.52:0/2771369049 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011a30 con 0x55eb1b350dc0 2024-09-19T09:24:55.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2771369049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 msgr2=0x55eb1b35b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bcf0 tx=0x7f3ca400f730 comp rx=0 tx=0).stop 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2771369049 shutdown_connections 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b35b680 0x55eb1b35da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b350dc0 0x55eb1b35b140 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2771369049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b350880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2771369049 >> 172.21.15.52:0/2771369049 conn(0x55eb1b34ca30 msgr2=0x55eb1b34ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2771369049 shutdown_connections 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.500+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2771369049 wait complete. 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 -- start start 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 Processor -- start 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b3504a0 0x55eb1b35af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b350dc0 0x55eb1b358230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b35e250 con 0x55eb1b35b680 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b271050 con 0x55eb1b3504a0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb1b35e3d0 con 0x55eb1b350dc0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cbbcb8740 10 client.0 _ll_register_callbacks cb 0x55eb1b2b1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cb37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cb37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57806/0 (socket says 172.21.15.52:57806) 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cb37fe640 1 -- 172.21.15.52:0/2365029482 learned_addr learned my addr 172.21.15.52:0/2365029482 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b3504a0 0x55eb1b35af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.501+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b350dc0 0x55eb1b358230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 -- 172.21.15.52:0/2365029482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b350dc0 msgr2=0x55eb1b358230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b350dc0 0x55eb1b358230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 -- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b3504a0 msgr2=0x55eb1b35af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b3504a0 0x55eb1b35af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 -- 172.21.15.52:0/2365029482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1b0273c0 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3cac035000 tx=0x7f3cac0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105b31b8e4ce5ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3c92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac04f020 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3cac004250 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca401a940 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3cac034040 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cbbcb8740 10 client.16665 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.502+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb1b369bc0 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca401a940 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3cac04ba00 con 0x55eb1b35b680 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 10 client.16665 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:55.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 20 client.16665 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b36b080 0x55eb1b36d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 4 client.16665 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb1b2c3850 con 0x55eb1b36b080 2024-09-19T09:24:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.503+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b36b080 0x55eb1b36d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3c92ffd640 10 client.16665 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:55.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b36b080 0x55eb1b36d520 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1a3a97d793d616 server_cookie=914cb1563eece717 in_seq=0 out_seq=0 2024-09-19T09:24:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2365029482 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb1b2c3850 con 0x55eb1b36b080 2024-09-19T09:24:55.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3c92ffd640 10 client.16665 handle_command_reply: tid=0 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 client.16665 shutdown 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 msgr2=0x55eb1b358770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3cac035000 tx=0x7f3cac0095c0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 shutdown_connections 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b36b080 0x55eb1b36d520 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b358770 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b350dc0 0x55eb1b358230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2365029482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b3504a0 0x55eb1b35af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.504+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 >> 172.21.15.52:0/2365029482 conn(0x55eb1b34ca30 msgr2=0x55eb1b352710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.505+0000 7f3c92ffd640 0 client.16665 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.505+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 shutdown_connections 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.505+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2365029482 wait complete. 2024-09-19T09:24:55.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.505+0000 7f3cbbcb8740 20 client.16665 trim_cache size 0 max 16384 2024-09-19T09:24:55.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 Processor -- start 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 -- start start 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b373380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b35b680 0x55eb1b3554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41b22a0 con 0x55eb1b3504a0 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41afb70 con 0x55eb1b350dc0 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ad9c0 con 0x55eb1b35b680 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57818/0 (socket says 172.21.15.52:57818) 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/1031965903 learned_addr learned my addr 172.21.15.52:0/1031965903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:55.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b373380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/1031965903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b35b680 msgr2=0x55eb1b3554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b35b680 0x55eb1b3554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/1031965903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 msgr2=0x55eb1b373380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b373380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/1031965903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1b34c4d0 con 0x55eb1b3504a0 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.522+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b373380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400fc30 tx=0x7f3ca400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64529ebec71f0db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3c997fa640 1 -- 172.21.15.52:0/1031965903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4015050 con 0x55eb1b3504a0 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3c997fa640 1 -- 172.21.15.52:0/1031965903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca400be60 con 0x55eb1b3504a0 2024-09-19T09:24:55.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3c997fa640 1 -- 172.21.15.52:0/1031965903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40048e0 con 0x55eb1b3504a0 2024-09-19T09:24:55.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/1031965903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 msgr2=0x55eb1b372e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400fc30 tx=0x7f3ca400b5e0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/1031965903 shutdown_connections 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b35b680 0x55eb1b3554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b373380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/1031965903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b3504a0 0x55eb1b372e40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/1031965903 >> 172.21.15.52:0/1031965903 conn(0x55eb1b34ca30 msgr2=0x55eb1b35a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/1031965903 shutdown_connections 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.523+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/1031965903 wait complete. 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 -- start start 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 Processor -- start 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b361010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b361550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ae030 con 0x55eb1b35b680 2024-09-19T09:24:55.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41af4a0 con 0x55eb1b350dc0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ae700 con 0x55eb1b3504a0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cbbcb8740 10 client.0 _ll_register_callbacks cb 0x7f3cac009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.524+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:42658/0 (socket says 172.21.15.52:42658) 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2928711227 learned_addr learned my addr 172.21.15.52:0/2928711227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b361550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b361010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 msgr2=0x55eb1b361010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b361010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2928711227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 msgr2=0x55eb1b361550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b361550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 -- 172.21.15.52:0/2928711227 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1b361d80 con 0x55eb1b3504a0 2024-09-19T09:24:55.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb37fe640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b361550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cb2ffd640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400f770 tx=0x7f3ca4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883beb3f8ab5d624 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3c92ffd640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4005640 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca400be60 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.525+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3ca4011570 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3ca4015020 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 10 client.25909 fetch_fsmap learned FSMap version 24 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb1b3d5d30 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca400be60 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3ca4032470 con 0x55eb1b3504a0 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 10 client.25909 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:55.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 20 client.25909 populate_metadata read hostname 'smithi052' 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b3d62b0 0x55eb1b3d86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 4 client.25909 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eb1b2bdd60 con 0x55eb1b3d62b0 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.526+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b3d62b0 0x55eb1b3d86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cb27fc640 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b3d62b0 0x55eb1b3d86a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d338cfc320c0409 server_cookie=a64ad2245b2be22b in_seq=0 out_seq=0 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3c92ffd640 10 client.25909 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3c92ffd640 1 -- 172.21.15.52:0/2928711227 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55eb1b2bdd60 con 0x55eb1b3d62b0 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3c92ffd640 10 client.25909 handle_command_reply: tid=0 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 client.25909 shutdown 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 msgr2=0x55eb1b363c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400f770 tx=0x7f3ca4005040 comp rx=0 tx=0).stop 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 shutdown_connections 2024-09-19T09:24:55.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb1b3d62b0 0x55eb1b3d86a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb1b35b680 0x55eb1b361550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb1b350dc0 0x55eb1b361010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3c92ffd640 0 client.25909 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 --2- 172.21.15.52:0/2928711227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb1b3504a0 0x55eb1b363c70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 >> 172.21.15.52:0/2928711227 conn(0x55eb1b34ca30 msgr2=0x55eb1b34b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 shutdown_connections 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 1 -- 172.21.15.52:0/2928711227 wait complete. 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.527+0000 7f3cbbcb8740 20 client.25909 trim_cache size 0 max 16384 2024-09-19T09:24:55.534 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "e3550b33-eec9-4919-aa4e-b154ad80ceba": { 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "e3550b33-eec9-4919-aa4e-b154ad80ceba", 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:24:55.535 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:24:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 msgr2=0x7f3c9c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 0x7f3c9c0a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005cc0 tx=0x7f3cac005c30 comp rx=0 tx=0).stop 2024-09-19T09:24:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 msgr2=0x7f3cb410ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800b4a0 tx=0x7f3ca800b960 comp rx=0 tx=0).stop 2024-09-19T09:24:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 shutdown_connections 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4102ef0 0x7f3cb410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cb4102570 0x7f3cb410ea10 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3c9c0a3240 0x7f3c9c0a5700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 --2- 172.21.15.52:0/1477018888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3cb4100e20 0x7f3cb410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 >> 172.21.15.52:0/1477018888 conn(0x7f3cb40fc7d0 msgr2=0x7f3cb4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 shutdown_connections 2024-09-19T09:24:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:24:55.528+0000 7f3cb98df640 1 -- 172.21.15.52:0/1477018888 wait complete. 2024-09-19T09:24:56.235 INFO:tasks.cephfs.filesystem:scrub status for tag:e3550b33-eec9-4919-aa4e-b154ad80ceba - {'path': '/', 'tag': 'e3550b33-eec9-4919-aa4e-b154ad80ceba', 'options': 'recursive,force'} 2024-09-19T09:24:56.549 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:56 smithi052 ceph-mon[30947]: pgmap v443: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:56.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:56 smithi086 ceph-mon[34813]: pgmap v443: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:56.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:56 smithi169 ceph-mon[35454]: pgmap v443: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:24:58.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:58 smithi086 ceph-mon[34813]: pgmap v444: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:58.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:24:58 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:24:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:58 smithi052 ceph-mon[30947]: pgmap v444: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:24:58 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:24:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:58 smithi169 ceph-mon[35454]: pgmap v444: 97 pgs: 97 active+clean; 1.8 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:24:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:24:58 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:25:00.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:00 smithi086 ceph-mon[34813]: pgmap v445: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:00.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:00 smithi052 ceph-mon[30947]: pgmap v445: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:00 smithi169 ceph-mon[35454]: pgmap v445: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:02.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:02 smithi086 ceph-mon[34813]: pgmap v446: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:25:02.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:02 smithi052 ceph-mon[30947]: pgmap v446: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:25:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:02 smithi169 ceph-mon[35454]: pgmap v446: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:25:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/3464221625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 msgr2=0x7f6cb0109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/3464221625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0109fa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009ca0 tx=0x7f6ca802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/3464221625 shutdown_connections 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/3464221625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0109fa0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/3464221625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0102d50 0x7f6cb01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/3464221625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0101b60 0x7f6cb0101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/3464221625 >> 172.21.15.52:0/3464221625 conn(0x7f6cb00fd2e0 msgr2=0x7f6cb00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/3464221625 shutdown_connections 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.177+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/3464221625 wait complete. 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 Processor -- start 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 -- start start 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0101b60 0x7f6cb0075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0102d50 0x7f6cb00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb010d830 con 0x7f6cb0103710 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb010d6b0 con 0x7f6cb0102d50 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb6e5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb010d9b0 con 0x7f6cb0101b60 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb53f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb53f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39000/0 (socket says 172.21.15.52:39000) 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.178+0000 7f6cb53f9640 1 -- 172.21.15.52:0/671212554 learned_addr learned my addr 172.21.15.52:0/671212554 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0101b60 0x7f6cb0075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6caffff640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0102d50 0x7f6cb00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 -- 172.21.15.52:0/671212554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0101b60 msgr2=0x7f6cb0075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0101b60 0x7f6cb0075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 -- 172.21.15.52:0/671212554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0102d50 msgr2=0x7f6cb00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0102d50 0x7f6cb00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 -- 172.21.15.52:0/671212554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb00753b0 con 0x7f6cb0103710 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb53f9640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009430 tx=0x7f6ca80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cadffb640 1 -- 172.21.15.52:0/671212554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8003b70 con 0x7f6cb0103710 2024-09-19T09:25:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cadffb640 1 -- 172.21.15.52:0/671212554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca8003d10 con 0x7f6cb0103710 2024-09-19T09:25:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cadffb640 1 -- 172.21.15.52:0/671212554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca802fc50 con 0x7f6cb0103710 2024-09-19T09:25:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.179+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb01a1eb0 con 0x7f6cb0103710 2024-09-19T09:25:04.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.180+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01a2370 con 0x7f6cb0103710 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cadffb640 1 -- 172.21.15.52:0/671212554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ca8004040 con 0x7f6cb0103710 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 Processor -- start 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 -- start start 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df772182f0 con 0x55df772ba370 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55df771c0270 con 0x55df772b49a0 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.182+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df772142b0 con 0x55df772b52e0 2024-09-19T09:25:04.188 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39012/0 (socket says 172.21.15.52:39012) 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cadffb640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 0x7f6c9c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 -- 172.21.15.52:0/2460643899 learned_addr learned my addr 172.21.15.52:0/2460643899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cb53f9640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 0x7f6c9c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 -- 172.21.15.52:0/2460643899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 msgr2=0x55df772b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 -- 172.21.15.52:0/2460643899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 msgr2=0x55df772b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cadffb640 1 -- 172.21.15.52:0/671212554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6ca80f0da0 con 0x7f6cb0103710 2024-09-19T09:25:04.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 -- 172.21.15.52:0/2460643899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df771bf340 con 0x55df772ba370 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6caffff640 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6c980125a0 tx=0x7f6c9800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6ea507e27081bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6ca6ffd640 1 -- 172.21.15.52:0/2460643899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004250 con 0x55df772ba370 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6cb53f9640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 0x7f6c9c0a5830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80bcfe0 tx=0x7f6ca80882e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6ca6ffd640 1 -- 172.21.15.52:0/2460643899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c980043f0 con 0x55df772ba370 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.183+0000 7f6ca6ffd640 1 -- 172.21.15.52:0/2460643899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004e40 con 0x55df772ba370 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/2460643899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 msgr2=0x55df772bc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6c980125a0 tx=0x7f6c9800b870 comp rx=0 tx=0).stop 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/2460643899 shutdown_connections 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772bc830 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/2460643899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/2460643899 >> 172.21.15.52:0/2460643899 conn(0x55df772b0010 msgr2=0x55df772b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/2460643899 shutdown_connections 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.184+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/2460643899 wait complete. 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 -- start start 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 Processor -- start 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772bec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df772bd340 con 0x55df772b52e0 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55df771a1290 con 0x55df772b49a0 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55df772bd4c0 con 0x55df772ba370 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb9bf3740 10 client.0 _ll_register_callbacks cb 0x55df771d2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:04.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb4bf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb4bf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39016/0 (socket says 172.21.15.52:39016) 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/1813167333 learned_addr learned my addr 172.21.15.52:0/1813167333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.185+0000 7f6caffff640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6caffff640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/1813167333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 msgr2=0x55df772c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 msgr2=0x55df772bec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772bec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/1813167333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df76f2b210 con 0x55df772b52e0 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6caffff640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00126e0 tx=0x7f6ca0012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacdb6a843f1d303 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0012190 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6ca000f920 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c980043f0 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6ca000fb20 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb9bf3740 10 client.16683 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df76ff7620 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.186+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c980043f0 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6ca0010430 con 0x55df772b52e0 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 10 client.16683 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 10 client.16683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 20 client.16683 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df772ca930 0x55df772ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 4 client.16683 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:04.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df77225a20 con 0x55df772ca930 2024-09-19T09:25:04.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.187+0000 7f6caffff640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df772ca930 0x55df772ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6caffff640 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df772ca930 0x55df772ccd90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3a68098a22b6c5 server_cookie=32ddc10cade3ea96 in_seq=0 out_seq=0 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6c8ffff640 10 client.16683 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1813167333 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df77225a20 con 0x55df772ca930 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6c8ffff640 10 client.16683 handle_command_reply: tid=0 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 client.16683 shutdown 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 msgr2=0x55df772bf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00126e0 tx=0x7f6ca0012ba0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 shutdown_connections 2024-09-19T09:25:04.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df772ca930 0x55df772ccd90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772bf1d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6c8ffff640 0 client.16683 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1813167333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772bec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.188+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 >> 172.21.15.52:0/1813167333 conn(0x55df772b0010 msgr2=0x55df772b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.189+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 shutdown_connections 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.189+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1813167333 wait complete. 2024-09-19T09:25:04.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.189+0000 7f6cb9bf3740 20 client.16683 trim_cache size 0 max 16384 2024-09-19T09:25:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 Processor -- start 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 -- start start 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01adc60 con 0x55df772b52e0 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01ab530 con 0x55df772b49a0 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.203+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01a9380 con 0x55df772ba370 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39022/0 (socket says 172.21.15.52:39022) 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/668602222 learned_addr learned my addr 172.21.15.52:0/668602222 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/668602222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 msgr2=0x55df772d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/668602222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 msgr2=0x55df772b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 -- 172.21.15.52:0/668602222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df772afe30 con 0x55df772b52e0 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009e00 tx=0x7f6ca0005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d379ca5873db09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6ca67fc640 1 -- 172.21.15.52:0/668602222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000f920 con 0x55df772b52e0 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6ca67fc640 1 -- 172.21.15.52:0/668602222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca0012190 con 0x55df772b52e0 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.204+0000 7f6ca67fc640 1 -- 172.21.15.52:0/668602222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0005330 con 0x55df772b52e0 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/668602222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 msgr2=0x55df772c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009e00 tx=0x7f6ca0005db0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/668602222 shutdown_connections 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772ba370 0x55df772d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772b52e0 0x55df772c61d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/668602222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/668602222 >> 172.21.15.52:0/668602222 conn(0x55df772b0010 msgr2=0x55df772b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/668602222 shutdown_connections 2024-09-19T09:25:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/668602222 wait complete. 2024-09-19T09:25:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 -- start start 2024-09-19T09:25:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.205+0000 7f6cb9bf3740 1 Processor -- start 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01a99f0 con 0x55df772ba370 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01aae60 con 0x55df772b49a0 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01aa0c0 con 0x55df772b52e0 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 10 client.0 _ll_register_callbacks cb 0x7f6ca0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.211 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39034/0 (socket says 172.21.15.52:39034) 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 -- 172.21.15.52:0/1281185576 learned_addr learned my addr 172.21.15.52:0/1281185576 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 -- 172.21.15.52:0/1281185576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 msgr2=0x55df772c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 -- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 msgr2=0x55df772c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.212 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 -- 172.21.15.52:0/1281185576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df772c5a40 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6caffff640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6c98005d00 tx=0x7f6c9800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6e14f0e28d244b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98028040 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6c98004240 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.206+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ca0012190 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c9803d050 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 10 client.16689 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df77335bb0 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca0012190 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6c980106a0 con 0x55df772ba370 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 10 client.16689 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:04.213 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 20 client.16689 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df773363c0 0x55df773387e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 4 client.16689 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55df7721fd70 con 0x55df773363c0 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.207+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df773363c0 0x55df773387e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.208+0000 7f6c8ffff640 10 client.16689 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:04.214 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.208+0000 7f6cb4bf8640 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df773363c0 0x55df773387e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00318de16a21f9e server_cookie=92c384f1798e6465 in_seq=0 out_seq=0 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6c8ffff640 1 -- 172.21.15.52:0/1281185576 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55df7721fd70 con 0x55df773363c0 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6c8ffff640 10 client.16689 handle_command_reply: tid=0 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 client.16689 shutdown 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 msgr2=0x55df772c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f6c98005d00 tx=0x7f6c9800b850 comp rx=0 tx=0).stop 2024-09-19T09:25:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 shutdown_connections 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55df773363c0 0x55df773387e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df772ba370 0x55df772c5430 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55df772b52e0 0x55df772c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6c8ffff640 0 client.16689 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 --2- 172.21.15.52:0/1281185576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55df772b49a0 0x55df772c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 >> 172.21.15.52:0/1281185576 conn(0x55df772b0010 msgr2=0x55df772b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 shutdown_connections 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 1 -- 172.21.15.52:0/1281185576 wait complete. 2024-09-19T09:25:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.220+0000 7f6cb9bf3740 20 client.16689 trim_cache size 0 max 16384 2024-09-19T09:25:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:25:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:25:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:25:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 msgr2=0x7f6c9c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 0x7f6c9c0a5830 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80bcfe0 tx=0x7f6ca80882e0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 msgr2=0x7f6cb0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009430 tx=0x7f6ca80319f0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 shutdown_connections 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cb0103710 0x7f6cb0074b20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cb0102d50 0x7f6cb00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6c9c0a3370 0x7f6c9c0a5830 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 --2- 172.21.15.52:0/671212554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cb0101b60 0x7f6cb0075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 >> 172.21.15.52:0/671212554 conn(0x7f6cb00fd2e0 msgr2=0x7f6cb0106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.224 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 shutdown_connections 2024-09-19T09:25:04.225 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:04.221+0000 7f6cb6e5c640 1 -- 172.21.15.52:0/671212554 wait complete. 2024-09-19T09:25:04.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:04 smithi086 ceph-mon[34813]: pgmap v447: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:04.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:04 smithi052 ceph-mon[30947]: pgmap v447: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:04.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:04 smithi169 ceph-mon[35454]: pgmap v447: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:25:06.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:06 smithi086 ceph-mon[34813]: pgmap v448: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:06.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:06 smithi052 ceph-mon[30947]: pgmap v448: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:06 smithi169 ceph-mon[35454]: pgmap v448: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:08.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:08 smithi086 ceph-mon[34813]: pgmap v449: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:25:08.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:08 smithi052 ceph-mon[30947]: pgmap v449: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:25:08.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:08 smithi169 ceph-mon[35454]: pgmap v449: 97 pgs: 97 active+clean; 1.9 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:25:10.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:10 smithi086 ceph-mon[34813]: pgmap v450: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:10.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:10 smithi052 ceph-mon[30947]: pgmap v450: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:10.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:10 smithi169 ceph-mon[35454]: pgmap v450: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:12 smithi086 ceph-mon[34813]: pgmap v451: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:25:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:12 smithi052 ceph-mon[30947]: pgmap v451: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:25:12.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:12 smithi169 ceph-mon[35454]: pgmap v451: 97 pgs: 97 active+clean; 2.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:25:14.732 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:14 smithi052 ceph-mon[30947]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:25:14.744 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:14 smithi169 ceph-mon[35454]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:25:14.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:14 smithi086 ceph-mon[34813]: pgmap v452: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:25:15.411 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:25:15.412 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:25:15.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:15.680 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 -- 172.21.15.52:0/4108904626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5250112640 msgr2=0x7f5250112a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 --2- 172.21.15.52:0/4108904626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5250112640 0x7f5250112a20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5240009900 tx=0x7f524002a410 comp rx=0 tx=0).stop 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 -- 172.21.15.52:0/4108904626 shutdown_connections 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 --2- 172.21.15.52:0/4108904626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010cf30 0x7f5250119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 --2- 172.21.15.52:0/4108904626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f525010c590 0x7f525010c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 --2- 172.21.15.52:0/4108904626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5250112640 0x7f5250112a20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 -- 172.21.15.52:0/4108904626 >> 172.21.15.52:0/4108904626 conn(0x7f525006cdc0 msgr2=0x7f525006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 -- 172.21.15.52:0/4108904626 shutdown_connections 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.184+0000 7f5256462640 1 -- 172.21.15.52:0/4108904626 wait complete. 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 Processor -- start 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 -- start start 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 0x7f52501a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5250112640 0x7f52501a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f525011c9a0 con 0x7f525010cf30 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f525011c820 con 0x7f5250112640 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f5256462640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f525011cb20 con 0x7f525010c590 2024-09-19T09:25:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42044/0 (socket says 172.21.15.52:42044) 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 -- 172.21.15.52:0/3667273615 learned_addr learned my addr 172.21.15.52:0/3667273615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f52549ff640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5250112640 0x7f52501a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524ffff640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 0x7f52501a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 -- 172.21.15.52:0/3667273615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 msgr2=0x7f52501a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 0x7f52501a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 -- 172.21.15.52:0/3667273615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5250112640 msgr2=0x7f52501a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5250112640 0x7f52501a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.185+0000 7f524f7fe640 1 -- 172.21.15.52:0/3667273615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52501a7d90 con 0x7f525010cf30 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f524ffff640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 0x7f52501a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f524f7fe640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f524400d950 tx=0x7f524400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244017070 con 0x7f525010cf30 2024-09-19T09:25:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5244009c30 con 0x7f525010cf30 2024-09-19T09:25:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52501a8080 con 0x7f525010cf30 2024-09-19T09:25:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524400f6b0 con 0x7f525010cf30 2024-09-19T09:25:16.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.186+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52501af960 con 0x7f525010cf30 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.187+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525010c9f0 con 0x7f525010cf30 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.188+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52440109d0 con 0x7f525010cf30 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.189+0000 7f524d7fa640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 0x7f52380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.189+0000 7f524ffff640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 0x7f52380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.189+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f52440cf630 con 0x7f525010cf30 2024-09-19T09:25:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.190+0000 7f524ffff640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 0x7f52380a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.193+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5244009de0 con 0x7f525010cf30 2024-09-19T09:25:16.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.403+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52501a4140 con 0x7f525010cf30 2024-09-19T09:25:16.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.404+0000 7f524d7fa640 1 -- 172.21.15.52:0/3667273615 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f52501a4140 con 0x7f525010cf30 2024-09-19T09:25:16.406 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:25:16.406 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:25:16.406 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 msgr2=0x7f52380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 0x7f52380a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f5240004100 comp rx=0 tx=0).stop 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 msgr2=0x7f52501a3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f524400d950 tx=0x7f524400de10 comp rx=0 tx=0).stop 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 shutdown_connections 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5250112640 0x7f52501a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f525010cf30 0x7f52501a3320 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f52380a3240 0x7f52380a5700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 --2- 172.21.15.52:0/3667273615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f525010c590 0x7f52501a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 >> 172.21.15.52:0/3667273615 conn(0x7f525006cdc0 msgr2=0x7f525010aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 shutdown_connections 2024-09-19T09:25:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:16.406+0000 7f5256462640 1 -- 172.21.15.52:0/3667273615 wait complete. 2024-09-19T09:25:16.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:16 smithi052 ceph-mon[30947]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:25:16.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:16 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3667273615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:16.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:16 smithi086 ceph-mon[34813]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:25:16.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:16 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3667273615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:16.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:16 smithi169 ceph-mon[35454]: pgmap v453: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:25:16.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:16 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3667273615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:17.130 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:25:17.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:25:17.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 -- 172.21.15.52:0/3048003650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9968100a40 msgr2=0x7f9968100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 --2- 172.21.15.52:0/3048003650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9968100a40 0x7f9968100e40 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9964009900 tx=0x7f996402a410 comp rx=0 tx=0).stop 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 -- 172.21.15.52:0/3048003650 shutdown_connections 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 --2- 172.21.15.52:0/3048003650 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99681025f0 0x7f9968108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 --2- 172.21.15.52:0/3048003650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968101c30 0x7f99681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 --2- 172.21.15.52:0/3048003650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9968100a40 0x7f9968100e40 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 -- 172.21.15.52:0/3048003650 >> 172.21.15.52:0/3048003650 conn(0x7f99680fc1e0 msgr2=0x7f99680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 -- 172.21.15.52:0/3048003650 shutdown_connections 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.311+0000 7f996f417640 1 -- 172.21.15.52:0/3048003650 wait complete. 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 Processor -- start 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 -- start start 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968100a40 0x7f99681049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 0x7f9968103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f996810c6c0 con 0x7f99681025f0 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f996810c540 con 0x7f9968100a40 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996f417640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f996810c840 con 0x7f9968101c30 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42072/0 (socket says 172.21.15.52:42072) 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 -- 172.21.15.52:0/4123602688 learned_addr learned my addr 172.21.15.52:0/4123602688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996c9b2640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 0x7f9968103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d1b3640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968100a40 0x7f99681049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 -- 172.21.15.52:0/4123602688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 msgr2=0x7f9968103010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 0x7f9968103010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 -- 172.21.15.52:0/4123602688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968100a40 msgr2=0x7f99681049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968100a40 0x7f99681049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996d9b4640 1 -- 172.21.15.52:0/4123602688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9968103de0 con 0x7f99681025f0 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.312+0000 7f996c9b2640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 0x7f9968103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f996d9b4640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f996000eb10 tx=0x7f996000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f995e7fc640 1 -- 172.21.15.52:0/4123602688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960004b20 con 0x7f99681025f0 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99681a1f30 con 0x7f99681025f0 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f995e7fc640 1 -- 172.21.15.52:0/4123602688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9960004cc0 con 0x7f99681025f0 2024-09-19T09:25:17.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f995e7fc640 1 -- 172.21.15.52:0/4123602688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960010760 con 0x7f99681025f0 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.313+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99681a23f0 con 0x7f99681025f0 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f995e7fc640 1 -- 172.21.15.52:0/4123602688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9960005020 con 0x7f99681025f0 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 Processor -- start 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 -- start start 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c24da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c27830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559151b832f0 con 0x559151c1f9a0 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559151b2b270 con 0x559151c25370 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f9972288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559151b7f2b0 con 0x559151c202e0 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42086/0 (socket says 172.21.15.52:42086) 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f996c9b2640 1 -- 172.21.15.52:0/1956876288 learned_addr learned my addr 172.21.15.52:0/1956876288 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.316+0000 7f996d1b3640 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c24da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f995e7fc640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 0x7f99540a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 -- 172.21.15.52:0/1956876288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 msgr2=0x559151c24da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c24da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 -- 172.21.15.52:0/1956876288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 msgr2=0x559151c27830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c27830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.321 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 -- 172.21.15.52:0/1956876288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559151b2a340 con 0x559151c1f9a0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996d9b4640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 0x7f99540a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f996c9b2640 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f995800bdb0 tx=0x7f9958011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6889ab062a513535 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f995e7fc640 1 -- 172.21.15.52:0/4123602688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f99600d0180 con 0x7f99681025f0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f99537fe640 1 -- 172.21.15.52:0/1956876288 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958011e60 con 0x559151c1f9a0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f99537fe640 1 -- 172.21.15.52:0/1956876288 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99580128d0 con 0x559151c1f9a0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.317+0000 7f99537fe640 1 -- 172.21.15.52:0/1956876288 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995800fa20 con 0x559151c1f9a0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- 172.21.15.52:0/1956876288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 msgr2=0x559151c1fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f996d9b4640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 0x7f99540a57b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f996009c6b0 tx=0x7f9960091c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f995800bdb0 tx=0x7f9958011750 comp rx=0 tx=0).stop 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- 172.21.15.52:0/1956876288 shutdown_connections 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c27830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c24da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 --2- 172.21.15.52:0/1956876288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c1fda0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- 172.21.15.52:0/1956876288 >> 172.21.15.52:0/1956876288 conn(0x559151c1b010 msgr2=0x559151c1b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- 172.21.15.52:0/1956876288 shutdown_connections 2024-09-19T09:25:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- 172.21.15.52:0/1956876288 wait complete. 2024-09-19T09:25:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 -- start start 2024-09-19T09:25:17.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.318+0000 7f9972288740 1 Processor -- start 2024-09-19T09:25:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c31150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559151c28340 con 0x559151c1f9a0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559151b0c290 con 0x559151c25370 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559151c284c0 con 0x559151c202e0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9972288740 10 client.0 _ll_register_callbacks cb 0x559151b3d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42088/0 (socket says 172.21.15.52:42088) 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 -- 172.21.15.52:0/3867238760 learned_addr learned my addr 172.21.15.52:0/3867238760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c31150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996d1b3640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 -- 172.21.15.52:0/3867238760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 msgr2=0x559151c2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 -- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 msgr2=0x559151c31150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c31150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 -- 172.21.15.52:0/3867238760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559151896210 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f996c9b2640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99580057a0 tx=0x7f99580056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02d0c48fa51aa01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.319+0000 7f9950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958005030 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f99580051d0 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99580128d0 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f99580053d0 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 10 client.16707 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559151962620 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99580128d0 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9958032070 con 0x559151c1f9a0 2024-09-19T09:25:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 10 client.16707 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 10 client.16707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 20 client.16707 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151c35510 0x559151c37900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 4 client.16707 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.320+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559151b90a20 con 0x559151c35510 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.321+0000 7f996d1b3640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151c35510 0x559151c37900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.321+0000 7f996d1b3640 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151c35510 0x559151c37900 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3baf54a5f9002a81 server_cookie=206a874d620827ce in_seq=0 out_seq=0 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.321+0000 7f9950ff9640 10 client.16707 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9950ff9640 1 -- 172.21.15.52:0/3867238760 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559151b90a20 con 0x559151c35510 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9950ff9640 10 client.16707 handle_command_reply: tid=0 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 client.16707 shutdown 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 msgr2=0x559151c29bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f99580057a0 tx=0x7f99580056f0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 shutdown_connections 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151c35510 0x559151c37900 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c31150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9950ff9640 0 client.16707 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 --2- 172.21.15.52:0/3867238760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c1f9a0 0x559151c29bd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 >> 172.21.15.52:0/3867238760 conn(0x559151c1b010 msgr2=0x559151c1c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 shutdown_connections 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 1 -- 172.21.15.52:0/3867238760 wait complete. 2024-09-19T09:25:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.322+0000 7f9972288740 20 client.16707 trim_cache size 0 max 16384 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 Processor -- start 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 -- start start 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c202e0 0x559151c2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c25370 0x559151c31070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99681adda0 con 0x559151c199a0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99681ab670 con 0x559151c202e0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.339+0000 7f9972288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99681a94c0 con 0x559151c25370 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42102/0 (socket says 172.21.15.52:42102) 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 -- 172.21.15.52:0/2646772508 learned_addr learned my addr 172.21.15.52:0/2646772508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996d1b3640 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c25370 0x559151c31070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c202e0 0x559151c2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 -- 172.21.15.52:0/2646772508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c25370 msgr2=0x559151c31070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c25370 0x559151c31070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 -- 172.21.15.52:0/2646772508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c202e0 msgr2=0x559151c2a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c202e0 0x559151c2a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 -- 172.21.15.52:0/2646772508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559151c152f0 con 0x559151c199a0 2024-09-19T09:25:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f99580059f0 tx=0x7f9958011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ceca4a5d4df781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f9952ffd640 1 -- 172.21.15.52:0/2646772508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99580128b0 con 0x559151c199a0 2024-09-19T09:25:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f9952ffd640 1 -- 172.21.15.52:0/2646772508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995802f070 con 0x559151c199a0 2024-09-19T09:25:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.340+0000 7f9952ffd640 1 -- 172.21.15.52:0/2646772508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995800f9e0 con 0x559151c199a0 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- 172.21.15.52:0/2646772508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 msgr2=0x559151c19e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f99580059f0 tx=0x7f9958011750 comp rx=0 tx=0).stop 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- 172.21.15.52:0/2646772508 shutdown_connections 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c19e30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c25370 0x559151c31070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 --2- 172.21.15.52:0/2646772508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c202e0 0x559151c2a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- 172.21.15.52:0/2646772508 >> 172.21.15.52:0/2646772508 conn(0x559151c1b010 msgr2=0x559151c29980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- 172.21.15.52:0/2646772508 shutdown_connections 2024-09-19T09:25:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- 172.21.15.52:0/2646772508 wait complete. 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.341+0000 7f9972288740 1 -- start start 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 Processor -- start 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c2fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99681a9b30 con 0x559151c199a0 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f99681aafa0 con 0x559151c25370 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99681aa200 con 0x559151c202e0 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f9972288740 10 client.0 _ll_register_callbacks cb 0x7f99600093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42108/0 (socket says 172.21.15.52:42108) 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 -- 172.21.15.52:0/2899567493 learned_addr learned my addr 172.21.15.52:0/2899567493 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c2fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996d1b3640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 -- 172.21.15.52:0/2899567493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 msgr2=0x559151c2eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 -- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 msgr2=0x559151c2fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c2fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.342+0000 7f996c9b2640 1 -- 172.21.15.52:0/2899567493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559151c303c0 con 0x559151c199a0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f996c9b2640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f99580058c0 tx=0x7f9958005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aabe46a2ba7259 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958005570 con 0x559151c199a0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f995800b3a0 con 0x559151c199a0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f995802f070 con 0x559151c199a0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9958004b40 con 0x559151c199a0 2024-09-19T09:25:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 10 client.16713 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559151ca0160 con 0x559151c199a0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995802f070 con 0x559151c199a0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9958032070 con 0x559151c199a0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 10 client.16713 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 10 client.16713 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 20 client.16713 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151ca09b0 0x559151ca2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 4 client.16713 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.343+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559151b8ad70 con 0x559151ca09b0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.344+0000 7f996d1b3640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151ca09b0 0x559151ca2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.344+0000 7f996d1b3640 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151ca09b0 0x559151ca2dd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0be534f1bc27ce server_cookie=de7582a56fd5e904 in_seq=0 out_seq=0 2024-09-19T09:25:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.344+0000 7f9950ff9640 10 client.16713 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9950ff9640 1 -- 172.21.15.52:0/2899567493 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559151b8ad70 con 0x559151ca09b0 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9950ff9640 10 client.16713 handle_command_reply: tid=0 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 client.16713 shutdown 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 msgr2=0x559151c2e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f99580058c0 tx=0x7f9958005850 comp rx=0 tx=0).stop 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 shutdown_connections 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559151ca09b0 0x559151ca2dd0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559151c25370 0x559151c2fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559151c202e0 0x559151c2eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 --2- 172.21.15.52:0/2899567493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559151c199a0 0x559151c2e860 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9950ff9640 0 client.16713 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 >> 172.21.15.52:0/2899567493 conn(0x559151c1b010 msgr2=0x559151c1bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 shutdown_connections 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 1 -- 172.21.15.52:0/2899567493 wait complete. 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.356+0000 7f9972288740 20 client.16713 trim_cache size 0 max 16384 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:25:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:25:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:25:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 msgr2=0x7f99540a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 0x7f99540a57b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f996009c6b0 tx=0x7f9960091c00 comp rx=0 tx=0).stop 2024-09-19T09:25:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 msgr2=0x7f9968103550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f996000eb10 tx=0x7f996000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 shutdown_connections 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99681025f0 0x7f9968103550 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f99540a32f0 0x7f99540a57b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9968101c30 0x7f9968103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 --2- 172.21.15.52:0/4123602688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9968100a40 0x7f99681049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 >> 172.21.15.52:0/4123602688 conn(0x7f99680fc1e0 msgr2=0x7f99680fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 shutdown_connections 2024-09-19T09:25:17.361 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:17.357+0000 7f996f417640 1 -- 172.21.15.52:0/4123602688 wait complete. 2024-09-19T09:25:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3950378146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd581036f0 msgr2=0x7fdd5810bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3950378146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd581036f0 0x7fdd5810bbe0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009900 tx=0x7fdd4c02a480 comp rx=0 tx=0).stop 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3950378146 shutdown_connections 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3950378146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd5810c1b0 0x7fdd5810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3950378146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd581036f0 0x7fdd5810bbe0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3950378146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd58102dd0 0x7fdd581031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3950378146 >> 172.21.15.52:0/3950378146 conn(0x7fdd580fc7d0 msgr2=0x7fdd580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3950378146 shutdown_connections 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.871+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3950378146 wait complete. 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 Processor -- start 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 -- start start 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd58102dd0 0x7fdd58100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd581036f0 0x7fdd58100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58112040 con 0x7fdd5810c1b0 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58111ec0 con 0x7fdd58102dd0 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.872+0000 7fdd5dd34640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581121c0 con 0x7fdd581036f0 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42130/0 (socket says 172.21.15.52:42130) 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 -- 172.21.15.52:0/3197365791 learned_addr learned my addr 172.21.15.52:0/3197365791 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd581036f0 0x7fdd58100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd577fe640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd58102dd0 0x7fdd58100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 -- 172.21.15.52:0/3197365791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd581036f0 msgr2=0x7fdd58100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd581036f0 0x7fdd58100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 -- 172.21.15.52:0/3197365791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd58102dd0 msgr2=0x7fdd58100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd58102dd0 0x7fdd58100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 -- 172.21.15.52:0/3197365791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581a6a60 con 0x7fdd5810c1b0 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd57fff640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000b970 tx=0x7fdd5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd54ff9640 1 -- 172.21.15.52:0/3197365791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50019070 con 0x7fdd5810c1b0 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581a6d50 con 0x7fdd5810c1b0 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd54ff9640 1 -- 172.21.15.52:0/3197365791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5000cb40 con 0x7fdd5810c1b0 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.873+0000 7fdd54ff9640 1 -- 172.21.15.52:0/3197365791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd50007650 con 0x7fdd5810c1b0 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.874+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a7210 con 0x7fdd5810c1b0 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd54ff9640 1 -- 172.21.15.52:0/3197365791 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd5001c070 con 0x7fdd5810c1b0 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 Processor -- start 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 -- start start 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb01091760 0x55eb01091b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb0109c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eb00ff72a0 con 0x55eb0109c940 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.876+0000 7fdd6010d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55eb00f9eb10 con 0x55eb01092080 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd6010d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb00ff3260 con 0x55eb01091760 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd54ff9640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42132/0 (socket says 172.21.15.52:42132) 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 -- 172.21.15.52:0/967590788 learned_addr learned my addr 172.21.15.52:0/967590788 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd577fe640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb0109c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb01091760 0x55eb01091b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd57fff640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd54ff9640 1 -- 172.21.15.52:0/3197365791 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdd500cef90 con 0x7fdd5810c1b0 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 -- 172.21.15.52:0/967590788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb01091760 msgr2=0x55eb01091b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb01091760 0x55eb01091b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 -- 172.21.15.52:0/967590788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 msgr2=0x55eb0109c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb0109c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 -- 172.21.15.52:0/967590788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb00d68b90 con 0x55eb0109c940 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd57fff640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 0x7fdd400a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd500979e0 tx=0x7fdd5000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.877+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009900 tx=0x7fdd4c0314d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc42f1732d229b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd577fe640 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb0109c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd3dffb640 1 -- 172.21.15.52:0/967590788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c035070 con 0x55eb0109c940 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd3dffb640 1 -- 172.21.15.52:0/967590788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd4c031a10 con 0x55eb0109c940 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd3dffb640 1 -- 172.21.15.52:0/967590788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c03d6b0 con 0x55eb0109c940 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 -- 172.21.15.52:0/967590788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 msgr2=0x55eb0109ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009900 tx=0x7fdd4c0314d0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 -- 172.21.15.52:0/967590788 shutdown_connections 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb0109c940 0x55eb0109ed30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb0109c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 --2- 172.21.15.52:0/967590788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb01091760 0x55eb01091b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 -- 172.21.15.52:0/967590788 >> 172.21.15.52:0/967590788 conn(0x55eb0108dcf0 msgr2=0x55eb0108e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 -- 172.21.15.52:0/967590788 shutdown_connections 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.878+0000 7fdd6010d740 1 -- 172.21.15.52:0/967590788 wait complete. 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 -- start start 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 Processor -- start 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb01099e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb0109a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55eb0109f510 con 0x55eb01091760 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55eb00f7f6e0 con 0x55eb01092080 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55eb0109f690 con 0x55eb0109c940 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd6010d740 10 client.0 _ll_register_callbacks cb 0x55eb00fa3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42144/0 (socket says 172.21.15.52:42144) 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.879+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1831524654 learned_addr learned my addr 172.21.15.52:0/1831524654 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb0109a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb01099e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1831524654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 msgr2=0x55eb0109a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb0109a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 msgr2=0x55eb01099e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb01099e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1831524654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb010a8b10 con 0x55eb01091760 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c032da0 tx=0x7fdd4c003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f187110ff17552 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c041030 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdd4c004150 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.880+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb010049d0 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdd4c035040 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 10 client.16725 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb010ab440 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55eb010049d0 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdd4c0048c0 con 0x55eb01091760 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 10 client.16725 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 10 client.16725 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 20 client.16725 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb010ac790 0x55eb010aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 4 client.16725 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb00ffed20 con 0x55eb010ac790 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.881+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb010ac790 0x55eb010aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.882+0000 7fdd36ffd640 10 client.16725 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.882+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb010ac790 0x55eb010aeb80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e41075c85bebe0 server_cookie=55f2aef407afd3f in_seq=0 out_seq=0 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.882+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1831524654 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb00ffed20 con 0x55eb010ac790 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.882+0000 7fdd36ffd640 10 client.16725 handle_command_reply: tid=0 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.882+0000 7fdd6010d740 1 client.16725 shutdown 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 msgr2=0x55eb010998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c032da0 tx=0x7fdd4c003db0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 shutdown_connections 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb010ac790 0x55eb010aeb80 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb0109a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb01099e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1831524654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010998c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 >> 172.21.15.52:0/1831524654 conn(0x55eb0108dcf0 msgr2=0x55eb0108ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd36ffd640 0 client.16725 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 shutdown_connections 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 1 -- 172.21.15.52:0/1831524654 wait complete. 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.883+0000 7fdd6010d740 20 client.16725 trim_cache size 0 max 16384 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 Processor -- start 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 -- start start 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 0x55eb010b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb01096b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581b22e0 con 0x55eb01092080 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581afbb0 con 0x55eb01091760 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd6010d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ada00 con 0x55eb0109c940 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42150/0 (socket says 172.21.15.52:42150) 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 -- 172.21.15.52:0/2109168700 learned_addr learned my addr 172.21.15.52:0/2109168700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 -- 172.21.15.52:0/2109168700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 msgr2=0x55eb01096b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb01096b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb01096b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 -- 172.21.15.52:0/2109168700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 msgr2=0x55eb010b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 0x55eb010b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 0x55eb010b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd577fe640 1 -- 172.21.15.52:0/2109168700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb01091eb0 con 0x55eb01092080 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.900+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 0x55eb010b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd577fe640 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800bb00 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e4647d1572c13a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd3d7fa640 1 -- 172.21.15.52:0/2109168700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48027070 con 0x55eb01092080 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd3d7fa640 1 -- 172.21.15.52:0/2109168700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48022900 con 0x55eb01092080 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd3d7fa640 1 -- 172.21.15.52:0/2109168700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4801a900 con 0x55eb01092080 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 -- 172.21.15.52:0/2109168700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 msgr2=0x55eb010b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800bb00 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 -- 172.21.15.52:0/2109168700 shutdown_connections 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb01096b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01092080 0x55eb010b20e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 --2- 172.21.15.52:0/2109168700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01091760 0x55eb010b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.901+0000 7fdd6010d740 1 -- 172.21.15.52:0/2109168700 >> 172.21.15.52:0/2109168700 conn(0x55eb0108dcf0 msgr2=0x55eb010a8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- 172.21.15.52:0/2109168700 shutdown_connections 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- 172.21.15.52:0/2109168700 wait complete. 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- start start 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 Processor -- start 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb010b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb010b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ae070 con 0x55eb01091760 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581af4e0 con 0x55eb01092080 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581ae740 con 0x55eb0109c940 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd6010d740 10 client.0 _ll_register_callbacks cb 0x7fdd4c031960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42162/0 (socket says 172.21.15.52:42162) 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.902+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1226484083 learned_addr learned my addr 172.21.15.52:0/1226484083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb010b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb010b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1226484083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 msgr2=0x55eb010b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb010b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 msgr2=0x55eb010b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb010b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 -- 172.21.15.52:0/1226484083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb010b0890 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd56ffd640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009850 tx=0x7fdd4c003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500e6d8306370995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c041040 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdd4c031dd0 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd48022900 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdd4c06c020 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd6010d740 10 client.16731 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.903+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55eb01117b60 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48022900 con 0x55eb01091760 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdd4c004f50 con 0x55eb01091760 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 10 client.16731 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 10 client.16731 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 20 client.16731 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb011180b0 0x55eb0111a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 4 client.16731 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55eb00f7aec0 con 0x55eb011180b0 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.904+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb011180b0 0x55eb0111a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.905+0000 7fdd36ffd640 10 client.16731 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.905+0000 7fdd577fe640 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb011180b0 0x55eb0111a4a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f30bb1853d4f669 server_cookie=c60b44c703771228 in_seq=0 out_seq=0 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.914+0000 7fdd36ffd640 1 -- 172.21.15.52:0/1226484083 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55eb00f7aec0 con 0x55eb011180b0 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.914+0000 7fdd36ffd640 10 client.16731 handle_command_reply: tid=0 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.914+0000 7fdd6010d740 1 client.16731 shutdown 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 msgr2=0x55eb010b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009850 tx=0x7fdd4c003d10 comp rx=0 tx=0).stop 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 shutdown_connections 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55eb011180b0 0x55eb0111a4a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55eb0109c940 0x55eb010b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55eb01092080 0x55eb010b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 --2- 172.21.15.52:0/1226484083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55eb01091760 0x55eb010b1c20 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd36ffd640 0 client.16731 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 >> 172.21.15.52:0/1226484083 conn(0x55eb0108dcf0 msgr2=0x55eb010931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 shutdown_connections 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 1 -- 172.21.15.52:0/1226484083 wait complete. 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd6010d740 20 client.16731 trim_cache size 0 max 16384 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 18, 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "962788b6": { 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 18, 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.8, 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 msgr2=0x7fdd400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 0x7fdd400a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdd500979e0 tx=0x7fdd5000e040 comp rx=0 tx=0).stop 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 msgr2=0x7fdd581014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000b970 tx=0x7fdd5000be30 comp rx=0 tx=0).stop 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 shutdown_connections 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdd5810c1b0 0x7fdd581014b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd400a3240 0x7fdd400a5700 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd581036f0 0x7fdd58100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 --2- 172.21.15.52:0/3197365791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd58102dd0 0x7fdd58100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.915+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 >> 172.21.15.52:0/3197365791 conn(0x7fdd580fc7d0 msgr2=0x7fdd580fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.916+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 shutdown_connections 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:17.916+0000 7fdd5dd34640 1 -- 172.21.15.52:0/3197365791 wait complete. 2024-09-19T09:25:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:18 smithi052 ceph-mon[30947]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:18.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:18 smithi086 ceph-mon[34813]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:18.779 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '962788b6', quiesce took 3.4 seconds. Will release after: 26.400000000000002 2024-09-19T09:25:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:18 smithi169 ceph-mon[35454]: pgmap v454: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:20.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:20 smithi086 ceph-mon[34813]: pgmap v455: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:20.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:20 smithi052 ceph-mon[30947]: pgmap v455: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:20.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:20 smithi169 ceph-mon[35454]: pgmap v455: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:25:22.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:22 smithi086 ceph-mon[34813]: pgmap v456: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:22.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:22 smithi052 ceph-mon[30947]: pgmap v456: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:22 smithi169 ceph-mon[35454]: pgmap v456: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:25:24.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:24 smithi086 ceph-mon[34813]: pgmap v457: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:24 smithi052 ceph-mon[30947]: pgmap v457: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:24.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:24 smithi169 ceph-mon[35454]: pgmap v457: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:25:26.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:25:26.503 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:26.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:26 smithi086 ceph-mon[34813]: pgmap v458: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:25:26.769 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:26 smithi052 ceph-mon[30947]: pgmap v458: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:25:26.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:26 smithi169 ceph-mon[35454]: pgmap v458: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.3 KiB/s wr, 10 op/s 2024-09-19T09:25:26.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 -- 172.21.15.52:0/604797022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 msgr2=0x7fd7f810bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:26.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/604797022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f810bbd0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009900 tx=0x7fd7e802a480 comp rx=0 tx=0).stop 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 -- 172.21.15.52:0/604797022 shutdown_connections 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/604797022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f810c160 0x7fd7f810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/604797022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f810bbd0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/604797022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f8102dc0 0x7fd7f81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 -- 172.21.15.52:0/604797022 >> 172.21.15.52:0/604797022 conn(0x7fd7f80fc780 msgr2=0x7fd7f80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 -- 172.21.15.52:0/604797022 shutdown_connections 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.968+0000 7fd7ff73b640 1 -- 172.21.15.52:0/604797022 wait complete. 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 Processor -- start 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 -- start start 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f8102dc0 0x7fd7f8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f810c160 0x7fd7f819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8111f50 con 0x7fd7f81036e0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8111dd0 con 0x7fd7f8102dc0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7ff73b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81120d0 con 0x7fd7f810c160 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38868/0 (socket says 172.21.15.52:38868) 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 -- 172.21.15.52:0/2442278749 learned_addr learned my addr 172.21.15.52:0/2442278749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f8102dc0 0x7fd7f8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f810c160 0x7fd7f819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 -- 172.21.15.52:0/2442278749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f810c160 msgr2=0x7fd7f819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f810c160 0x7fd7f819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 -- 172.21.15.52:0/2442278749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f8102dc0 msgr2=0x7fd7f8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f8102dc0 0x7fd7f8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.969+0000 7fd7fccd6640 1 -- 172.21.15.52:0/2442278749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f819d400 con 0x7fd7f81036e0 2024-09-19T09:25:26.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005ab0 tx=0x7fd7e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7ee7fc640 1 -- 172.21.15.52:0/2442278749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e803f030 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f819d690 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7ee7fc640 1 -- 172.21.15.52:0/2442278749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e8003ce0 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7ee7fc640 1 -- 172.21.15.52:0/2442278749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8035070 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.970+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a4fd0 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.972+0000 7fd7ee7fc640 1 -- 172.21.15.52:0/2442278749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd7e8042030 con 0x7fd7f81036e0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 Processor -- start 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 -- start start 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 0x55c9be996140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 0x55c9be998a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9be8f12e0 con 0x55c9be98b4a0 2024-09-19T09:25:26.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c9be898ce0 con 0x55c9be98bdc0 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd801b14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9be8ed2a0 con 0x55c9be996680 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38884/0 (socket says 172.21.15.52:38884) 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/55194593 learned_addr learned my addr 172.21.15.52:0/55194593 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7ee7fc640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 0x7fd7e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 0x55c9be996140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/55194593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 msgr2=0x55c9be998a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 0x55c9be998a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 0x55c9be998a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/55194593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 msgr2=0x55c9be996140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 0x55c9be996140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7ee7fc640 1 -- 172.21.15.52:0/2442278749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd7e80f0010 con 0x7fd7f81036e0 2024-09-19T09:25:26.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/55194593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9be87d440 con 0x55c9be98b4a0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 0x55c9be996140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.973+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 0x55c9be998a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.974+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 0x7fd7e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.974+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0008ec0 tx=0x7fd7f000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627440b6f2b9c57c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.974+0000 7fd7e37fe640 1 -- 172.21.15.52:0/55194593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0022070 con 0x55c9be98b4a0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.974+0000 7fd7e37fe640 1 -- 172.21.15.52:0/55194593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f001c470 con 0x55c9be98b4a0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.974+0000 7fd7e37fe640 1 -- 172.21.15.52:0/55194593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f001a600 con 0x55c9be98b4a0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- 172.21.15.52:0/55194593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 msgr2=0x55c9be98b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0008ec0 tx=0x7fd7f000e720 comp rx=0 tx=0).stop 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 0x7fd7e40a5700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd7f001f000 tx=0x7fd7f0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- 172.21.15.52:0/55194593 shutdown_connections 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be996680 0x55c9be998a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98bdc0 0x55c9be996140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 --2- 172.21.15.52:0/55194593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be98b880 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- 172.21.15.52:0/55194593 >> 172.21.15.52:0/55194593 conn(0x55c9be987a30 msgr2=0x55c9be987e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- 172.21.15.52:0/55194593 shutdown_connections 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- 172.21.15.52:0/55194593 wait complete. 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 -- start start 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.975+0000 7fd801b14740 1 Processor -- start 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be993260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be996680 0x55c9be9937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c9be999250 con 0x55c9be98b4a0 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c9be8ac050 con 0x55c9be996680 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c9be9993d0 con 0x55c9be98bdc0 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd801b14740 10 client.0 _ll_register_callbacks cb 0x55c9be8ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:26.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38898/0 (socket says 172.21.15.52:38898) 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 -- 172.21.15.52:0/3160201298 learned_addr learned my addr 172.21.15.52:0/3160201298 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be996680 0x55c9be9937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be993260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 -- 172.21.15.52:0/3160201298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 msgr2=0x55c9be993260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be993260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 -- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be996680 msgr2=0x55c9be9937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be996680 0x55c9be9937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 -- 172.21.15.52:0/3160201298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9be6623c0 con 0x55c9be98b4a0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4010840 tx=0x7fd7f4010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769cf9571cf95a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.976+0000 7fd7e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f400ed40 con 0x55c9be98b4a0 2024-09-19T09:25:26.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd7f4011440 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f001c470 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd7f4021030 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 10 client.16743 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c9be9a8fe0 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f001c470 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd7f401c780 con 0x55c9be98b4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 10 client.16743 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 20 client.16743 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9be9aa4a0 0x55c9be9ac910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 4 client.16743 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9be8fe850 con 0x55c9be9aa4a0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.977+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9be9aa4a0 0x55c9be9ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.978+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9be9aa4a0 0x55c9be9ac910 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb58a67b04eb33f server_cookie=b53f040c234c1692 in_seq=0 out_seq=0 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.978+0000 7fd7e0ff9640 10 client.16743 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.978+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/3160201298 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd7e80a1e80 con 0x55c9be9aa4a0 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.978+0000 7fd7e0ff9640 10 client.16743 handle_command_reply: tid=0 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 client.16743 shutdown 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 msgr2=0x55c9be995fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4010840 tx=0x7fd7f4010d00 comp rx=0 tx=0).stop 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 shutdown_connections 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9be9aa4a0 0x55c9be9ac910 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be996680 0x55c9be9937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd7e0ff9640 0 client.16743 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be993260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 --2- 172.21.15.52:0/3160201298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be98b4a0 0x55c9be995fb0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:26.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 >> 172.21.15.52:0/3160201298 conn(0x55c9be987a30 msgr2=0x55c9be986b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:26.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 shutdown_connections 2024-09-19T09:25:26.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 1 -- 172.21.15.52:0/3160201298 wait complete. 2024-09-19T09:25:26.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.979+0000 7fd801b14740 20 client.16743 trim_cache size 0 max 16384 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 Processor -- start 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 -- start start 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be98e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ade20 con 0x55c9be996680 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ab6f0 con 0x55c9be98b4a0 2024-09-19T09:25:26.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.996+0000 7fd801b14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81a9540 con 0x55c9be98bdc0 2024-09-19T09:25:26.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:26.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38900/0 (socket says 172.21.15.52:38900) 2024-09-19T09:25:26.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/4196249468 learned_addr learned my addr 172.21.15.52:0/4196249468 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:27.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/4196249468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 msgr2=0x55c9be98e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:27.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be98e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be98e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/4196249468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 msgr2=0x55c9be9a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/4196249468 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9be98b2d0 con 0x55c9be996680 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000ec20 tx=0x7fd7f0025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8459ce2c391fbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7e2ffd640 1 -- 172.21.15.52:0/4196249468 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0036070 con 0x55c9be996680 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7e2ffd640 1 -- 172.21.15.52:0/4196249468 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f001ad40 con 0x55c9be996680 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.997+0000 7fd7e2ffd640 1 -- 172.21.15.52:0/4196249468 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0022040 con 0x55c9be996680 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- 172.21.15.52:0/4196249468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 msgr2=0x55c9be9b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000ec20 tx=0x7fd7f0025000 comp rx=0 tx=0).stop 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- 172.21.15.52:0/4196249468 shutdown_connections 2024-09-19T09:25:27.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be9b21e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be98e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 --2- 172.21.15.52:0/4196249468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- 172.21.15.52:0/4196249468 >> 172.21.15.52:0/4196249468 conn(0x55c9be987a30 msgr2=0x55c9be98e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- 172.21.15.52:0/4196249468 shutdown_connections 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- 172.21.15.52:0/4196249468 wait complete. 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 -- start start 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.998+0000 7fd801b14740 1 Processor -- start 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:27.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be99e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81a9bb0 con 0x55c9be996680 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ab020 con 0x55c9be98b4a0 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81aa280 con 0x55c9be98bdc0 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd801b14740 10 client.0 _ll_register_callbacks cb 0x7fd7f400c430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38910/0 (socket says 172.21.15.52:38910) 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/1499384214 learned_addr learned my addr 172.21.15.52:0/1499384214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be99e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/1499384214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 msgr2=0x55c9be99e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be99e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 msgr2=0x55c9be9a3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fdcd8640 1 -- 172.21.15.52:0/1499384214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9be99f480 con 0x55c9be996680 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:26.999+0000 7fd7fccd6640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be99e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7fdcd8640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0011910 tx=0x7fd7f00084c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45054c322986e9d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f003f060 con 0x55c9be996680 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd7f001aa30 con 0x55c9be996680 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f001ad40 con 0x55c9be996680 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd7f0036030 con 0x55c9be996680 2024-09-19T09:25:27.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 10 client.16749 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c9bea15230 con 0x55c9be996680 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f001ad40 con 0x55c9be996680 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd7f0030030 con 0x55c9be996680 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 10 client.16749 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 20 client.16749 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9bea15700 0x55c9bea17af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 4 client.16749 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.000+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c9be8f8d60 con 0x55c9bea15700 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9bea15700 0x55c9bea17af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7fd4d7640 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9bea15700 0x55c9bea17af0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d30ab5897c013f36 server_cookie=a988896f5fce83d2 in_seq=0 out_seq=0 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7e0ff9640 10 client.16749 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:27.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7e0ff9640 1 -- 172.21.15.52:0/1499384214 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c9be8f8d60 con 0x55c9bea15700 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7e0ff9640 10 client.16749 handle_command_reply: tid=0 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 client.16749 shutdown 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 msgr2=0x55c9be99ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0011910 tx=0x7fd7f00084c0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 shutdown_connections 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c9bea15700 0x55c9bea17af0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c9be996680 0x55c9be99ec50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c9be98bdc0 0x55c9be99e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 --2- 172.21.15.52:0/1499384214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c9be98b4a0 0x55c9be9a3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 >> 172.21.15.52:0/1499384214 conn(0x55c9be987a30 msgr2=0x55c9be986b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.001+0000 7fd7e0ff9640 0 client.16749 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 shutdown_connections 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd801b14740 1 -- 172.21.15.52:0/1499384214 wait complete. 2024-09-19T09:25:27.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd801b14740 20 client.16749 trim_cache size 0 max 16384 2024-09-19T09:25:27.010 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:27.010 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:25:27.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:25:27.010 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 msgr2=0x7fd7e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 0x7fd7e40a5700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd7f001f000 tx=0x7fd7f0020000 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 msgr2=0x7fd7f8198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005ab0 tx=0x7fd7e80042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 shutdown_connections 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7e40a3240 0x7fd7e40a5700 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7f810c160 0x7fd7f819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7f81036e0 0x7fd7f8198990 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 --2- 172.21.15.52:0/2442278749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd7f8102dc0 0x7fd7f8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 >> 172.21.15.52:0/2442278749 conn(0x7fd7f80fc780 msgr2=0x7fd7f80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:27.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 shutdown_connections 2024-09-19T09:25:27.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:27.002+0000 7fd7ff73b640 1 -- 172.21.15.52:0/2442278749 wait complete. 2024-09-19T09:25:27.772 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:25:27.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:28.032 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 -- 172.21.15.52:0/516091522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10106f70 msgr2=0x7fbe1010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 --2- 172.21.15.52:0/516091522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10106f70 0x7fbe1010eab0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009ca0 tx=0x7fbe0802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 -- 172.21.15.52:0/516091522 shutdown_connections 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 --2- 172.21.15.52:0/516091522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10106f70 0x7fbe1010eab0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 --2- 172.21.15.52:0/516091522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100eb0 0x7fbe10106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 --2- 172.21.15.52:0/516091522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10100500 0x7fbe101008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 -- 172.21.15.52:0/516091522 >> 172.21.15.52:0/516091522 conn(0x7fbe100fc5c0 msgr2=0x7fbe100fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 -- 172.21.15.52:0/516091522 shutdown_connections 2024-09-19T09:25:28.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.473+0000 7fbe16568640 1 -- 172.21.15.52:0/516091522 wait complete. 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 Processor -- start 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 -- start start 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100500 0x7fbe10101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10106f70 0x7fbe10101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10111f90 con 0x7fbe10100eb0 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10111e10 con 0x7fbe10106f70 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe16568640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe10112110 con 0x7fbe10100500 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe0f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39032/0 (socket says 172.21.15.52:39032) 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.474+0000 7fbe0f7fe640 1 -- 172.21.15.52:0/2163224182 learned_addr learned my addr 172.21.15.52:0/2163224182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:28.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0ffff640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100500 0x7fbe10101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe14b05640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10106f70 0x7fbe10101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 -- 172.21.15.52:0/2163224182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100500 msgr2=0x7fbe10101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100500 0x7fbe10101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 -- 172.21.15.52:0/2163224182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10106f70 msgr2=0x7fbe10101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10106f70 0x7fbe10101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 -- 172.21.15.52:0/2163224182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe101a68f0 con 0x7fbe10100eb0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0f7fe640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d750 tx=0x7fbe0400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04017070 con 0x7fbe10100eb0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe04005500 con 0x7fbe10100eb0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe101a6be0 con 0x7fbe10100eb0 2024-09-19T09:25:28.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04004e00 con 0x7fbe10100eb0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.475+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe101a70d0 con 0x7fbe10100eb0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.476+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe101008e0 con 0x7fbe10100eb0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.478+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe04004fa0 con 0x7fbe10100eb0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.478+0000 7fbe0d7fa640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 0x7fbdf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.478+0000 7fbe0ffff640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 0x7fbdf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.478+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe040cf740 con 0x7fbe10100eb0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.479+0000 7fbe0ffff640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 0x7fbdf80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbe00005db0 tx=0x7fbe00005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:28.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.481+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe0409c3e0 con 0x7fbe10100eb0 2024-09-19T09:25:28.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.693+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe101029b0 con 0x7fbe10100eb0 2024-09-19T09:25:28.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.694+0000 7fbe0d7fa640 1 -- 172.21.15.52:0/2163224182 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fbe0409bce0 con 0x7fbe10100eb0 2024-09-19T09:25:28.696 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:25:28.696 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:25:28.697 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 msgr2=0x7fbdf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 0x7fbdf80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbe00005db0 tx=0x7fbe00005d40 comp rx=0 tx=0).stop 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 msgr2=0x7fbe101019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400d750 tx=0x7fbe0400dc10 comp rx=0 tx=0).stop 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 shutdown_connections 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe10106f70 0x7fbe10101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe10100eb0 0x7fbe101019c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdf80a3240 0x7fbdf80a5700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 --2- 172.21.15.52:0/2163224182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe10100500 0x7fbe10101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:28.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 >> 172.21.15.52:0/2163224182 conn(0x7fbe100fc5c0 msgr2=0x7fbe101057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:28.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 shutdown_connections 2024-09-19T09:25:28.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:28.696+0000 7fbe16568640 1 -- 172.21.15.52:0/2163224182 wait complete. 2024-09-19T09:25:28.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:28 smithi086 ceph-mon[34813]: pgmap v459: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:25:28.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:28 smithi052 ceph-mon[30947]: pgmap v459: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:25:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:28 smithi169 ceph-mon[35454]: pgmap v459: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T09:25:29.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:25:29.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:29 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2163224182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:29 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:25:29.763 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:29.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:29 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2163224182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:29.874 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:29 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:25:29.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:29 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2163224182' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:29.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:29 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 -- 172.21.15.52:0/1792369991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064103720 msgr2=0x7f1064107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 --2- 172.21.15.52:0/1792369991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064103720 0x7f1064107b60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f104c009930 tx=0x7f104c02a420 comp rx=0 tx=0).stop 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 -- 172.21.15.52:0/1792369991 shutdown_connections 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 --2- 172.21.15.52:0/1792369991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106410ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 --2- 172.21.15.52:0/1792369991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064103720 0x7f1064107b60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 --2- 172.21.15.52:0/1792369991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064102d70 0x7f1064103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 -- 172.21.15.52:0/1792369991 >> 172.21.15.52:0/1792369991 conn(0x7f10640fc7d0 msgr2=0x7f10640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 -- 172.21.15.52:0/1792369991 shutdown_connections 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.227+0000 7f1069c54640 1 -- 172.21.15.52:0/1792369991 wait complete. 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 Processor -- start 2024-09-19T09:25:30.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 -- start start 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064103720 0x7f1064198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10641120c0 con 0x7f1064102d70 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1064111f40 con 0x7f1064103720 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f1069c54640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1064112240 con 0x7f10641082a0 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f10637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f10637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39048/0 (socket says 172.21.15.52:39048) 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f10637fe640 1 -- 172.21.15.52:0/3135347900 learned_addr learned my addr 172.21.15.52:0/3135347900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.228+0000 7f105bfff640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064103720 0x7f1064198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f1063fff640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 -- 172.21.15.52:0/3135347900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 msgr2=0x7f106419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 -- 172.21.15.52:0/3135347900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064103720 msgr2=0x7f1064198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064103720 0x7f1064198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 -- 172.21.15.52:0/3135347900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106419d5d0 con 0x7f1064102d70 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f1063fff640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10637fe640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f105400c890 tx=0x7f105400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10617fa640 1 -- 172.21.15.52:0/3135347900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054004220 con 0x7f1064102d70 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106419d8c0 con 0x7f1064102d70 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10617fa640 1 -- 172.21.15.52:0/3135347900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10540043c0 con 0x7f1064102d70 2024-09-19T09:25:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f10617fa640 1 -- 172.21.15.52:0/3135347900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1054004a00 con 0x7f1064102d70 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.229+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10641a51a0 con 0x7f1064102d70 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f10617fa640 1 -- 172.21.15.52:0/3135347900 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f10540079b0 con 0x7f1064102d70 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 Processor -- start 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 -- start start 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690379a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690386760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606902df2f0 con 0x56069037ab40 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560690286cf0 con 0x560690384370 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f106c02d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5606902db2b0 con 0x5606903795d0 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f1063fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f10617fa640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 0x7f10500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f1063fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39050/0 (socket says 172.21.15.52:39050) 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f1063fff640 1 -- 172.21.15.52:0/4171196253 learned_addr learned my addr 172.21.15.52:0/4171196253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f10617fa640 1 -- 172.21.15.52:0/3135347900 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f10540cf690 con 0x7f1064102d70 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f1063fff640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 0x7f10500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f10637fe640 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690379a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.232+0000 7f105bfff640 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690386760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 -- 172.21.15.52:0/4171196253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 msgr2=0x560690379a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690379a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 -- 172.21.15.52:0/4171196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 msgr2=0x560690386760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690386760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 -- 172.21.15.52:0/4171196253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069026b3a0 con 0x56069037ab40 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f105c010a30 tx=0x7f105c010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533a774079edd61d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1059ffb640 1 -- 172.21.15.52:0/4171196253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c020070 con 0x56069037ab40 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1059ffb640 1 -- 172.21.15.52:0/4171196253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105c01bbd0 con 0x56069037ab40 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1059ffb640 1 -- 172.21.15.52:0/4171196253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c00e350 con 0x56069037ab40 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.233+0000 7f1063fff640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 0x7f10500a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f105c01d000 tx=0x7f105c019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- 172.21.15.52:0/4171196253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 msgr2=0x560690379090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f105c010a30 tx=0x7f105c010ef0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- 172.21.15.52:0/4171196253 shutdown_connections 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690386760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690379a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 --2- 172.21.15.52:0/4171196253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690379090 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- 172.21.15.52:0/4171196253 >> 172.21.15.52:0/4171196253 conn(0x560690342310 msgr2=0x560690375c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- 172.21.15.52:0/4171196253 shutdown_connections 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- 172.21.15.52:0/4171196253 wait complete. 2024-09-19T09:25:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.234+0000 7f106c02d740 1 -- start start 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 Processor -- start 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690383d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690381600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560690387070 con 0x56069037ab40 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56069029a060 con 0x560690384370 2024-09-19T09:25:30.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5606903871f0 con 0x5606903795d0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f106c02d740 10 client.0 _ll_register_callbacks cb 0x56068ffed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39052/0 (socket says 172.21.15.52:39052) 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 -- 172.21.15.52:0/4059873396 learned_addr learned my addr 172.21.15.52:0/4059873396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f1063fff640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690381600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f10637fe640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690383d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 -- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 msgr2=0x560690383d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690383d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 -- 172.21.15.52:0/4059873396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 msgr2=0x560690381600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690381600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.235+0000 7f105bfff640 1 -- 172.21.15.52:0/4059873396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606900503c0 con 0x56069037ab40 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f105bfff640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f104c009900 tx=0x7f104c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aef02ea97c9434 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c035040 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f104c004300 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105c01bbd0 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f104c0035f0 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 10 client.16767 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560690396f20 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105c01bbd0 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f104c04f8c0 con 0x56069037ab40 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 10 client.16767 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 10 client.16767 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 20 client.16767 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x56069039a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 4 client.16767 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.236+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606902ec860 con 0x560690398380 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.237+0000 7f10637fe640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x56069039a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.237+0000 7f10637fe640 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x56069039a7c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24e193ba97cdcc8a server_cookie=4967b6f04a990344 in_seq=0 out_seq=0 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.237+0000 7f1042ffd640 10 client.16767 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f1042ffd640 1 -- 172.21.15.52:0/4059873396 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606902ec860 con 0x560690398380 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f1042ffd640 10 client.16767 handle_command_reply: tid=0 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 client.16767 shutdown 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 msgr2=0x560690381010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f104c009900 tx=0x7f104c0319b0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 shutdown_connections 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x56069039a7c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f1042ffd640 0 client.16767 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:25:30.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560690384370 0x560690381600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56069037ab40 0x560690381010 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 --2- 172.21.15.52:0/4059873396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606903795d0 0x560690383d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 >> 172.21.15.52:0/4059873396 conn(0x560690342310 msgr2=0x56069037b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 shutdown_connections 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 1 -- 172.21.15.52:0/4059873396 wait complete. 2024-09-19T09:25:30.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.238+0000 7f106c02d740 20 client.16767 trim_cache size 0 max 16384 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.251+0000 7f106c02d740 1 Processor -- start 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.251+0000 7f106c02d740 1 -- start start 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 0x560690380050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 0x5606903a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10641adfe0 con 0x5606903795d0 2024-09-19T09:25:30.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10641ab8b0 con 0x56069037ab40 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f106c02d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10641a9700 con 0x560690384370 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39062/0 (socket says 172.21.15.52:39062) 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 -- 172.21.15.52:0/3077778801 learned_addr learned my addr 172.21.15.52:0/3077778801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f105bfff640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 0x560690380050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f1063fff640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 0x5606903a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 -- 172.21.15.52:0/3077778801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 msgr2=0x5606903a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 0x5606903a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 -- 172.21.15.52:0/3077778801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 msgr2=0x560690380050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 0x560690380050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 -- 172.21.15.52:0/3077778801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560690375de0 con 0x5606903795d0 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f1063fff640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 0x5606903a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f105bfff640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 0x560690380050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10637fe640 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1054005fd0 tx=0x7f10540cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88167646d530a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10597fa640 1 -- 172.21.15.52:0/3077778801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10540b9070 con 0x5606903795d0 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.252+0000 7f10597fa640 1 -- 172.21.15.52:0/3077778801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105409bc30 con 0x5606903795d0 2024-09-19T09:25:30.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f10597fa640 1 -- 172.21.15.52:0/3077778801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105401d040 con 0x5606903795d0 2024-09-19T09:25:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- 172.21.15.52:0/3077778801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 msgr2=0x5606903947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1054005fd0 tx=0x7f10540cf040 comp rx=0 tx=0).stop 2024-09-19T09:25:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- 172.21.15.52:0/3077778801 shutdown_connections 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560690384370 0x5606903a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56069037ab40 0x560690380050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 --2- 172.21.15.52:0/3077778801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606903795d0 0x5606903947a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- 172.21.15.52:0/3077778801 >> 172.21.15.52:0/3077778801 conn(0x560690342310 msgr2=0x56069037f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- 172.21.15.52:0/3077778801 shutdown_connections 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- 172.21.15.52:0/3077778801 wait complete. 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.253+0000 7f106c02d740 1 -- start start 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 Processor -- start 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 0x56069037e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56069037ab40 0x56069037e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10641a9d70 con 0x560690384370 2024-09-19T09:25:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10641ab1e0 con 0x5606903795d0 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10641aa440 con 0x56069037ab40 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f106c02d740 10 client.0 _ll_register_callbacks cb 0x7f104c0314b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f1063fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f1063fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39064/0 (socket says 172.21.15.52:39064) 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f1063fff640 1 -- 172.21.15.52:0/3237082903 learned_addr learned my addr 172.21.15.52:0/3237082903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f10637fe640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 0x56069037e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f105bfff640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56069037ab40 0x56069037e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.254+0000 7f1063fff640 1 -- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56069037ab40 msgr2=0x56069037e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1063fff640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56069037ab40 0x56069037e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1063fff640 1 -- 172.21.15.52:0/3237082903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 msgr2=0x56069037e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1063fff640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 0x56069037e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1063fff640 1 -- 172.21.15.52:0/3237082903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606903840d0 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f10637fe640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 0x56069037e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1063fff640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f105c004b90 tx=0x7f105c007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba85e64e6fabf48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1042ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c020040 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f105c01bdd0 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105409bc30 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f105c0105d0 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f106c02d740 10 client.16773 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5606904030a0 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.255+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105409bc30 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f105c00e6d0 con 0x560690384370 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 10 client.16773 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 10 client.16773 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 20 client.16773 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x560690405660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 4 client.16773 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606902e6d70 con 0x560690398380 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f10637fe640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x560690405660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f10637fe640 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x560690405660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=647bf6057abb9d68 server_cookie=e649c9b85391358a in_seq=0 out_seq=0 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.256+0000 7f1042ffd640 10 client.16773 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f1042ffd640 1 -- 172.21.15.52:0/3237082903 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606902e6d70 con 0x560690398380 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f1042ffd640 10 client.16773 handle_command_reply: tid=0 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 client.16773 shutdown 2024-09-19T09:25:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 msgr2=0x56069037eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f105c004b90 tx=0x7f105c007810 comp rx=0 tx=0).stop 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 shutdown_connections 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560690398380 0x560690405660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560690384370 0x56069037eab0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56069037ab40 0x56069037e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f1042ffd640 0 client.16773 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 --2- 172.21.15.52:0/3237082903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606903795d0 0x56069037e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 >> 172.21.15.52:0/3237082903 conn(0x560690342310 msgr2=0x560690380160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 shutdown_connections 2024-09-19T09:25:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 1 -- 172.21.15.52:0/3237082903 wait complete. 2024-09-19T09:25:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.257+0000 7f106c02d740 20 client.16773 trim_cache size 0 max 16384 2024-09-19T09:25:30.266 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:25:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 msgr2=0x7f10500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 0x7f10500a5700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f105c01d000 tx=0x7f105c019000 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 msgr2=0x7f1064198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f105400c890 tx=0x7f105400cd50 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 shutdown_connections 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f10500a3240 0x7f10500a5700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10641082a0 0x7f106419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1064103720 0x7f1064198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 --2- 172.21.15.52:0/3135347900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1064102d70 0x7f1064198620 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 >> 172.21.15.52:0/3135347900 conn(0x7f10640fc7d0 msgr2=0x7f1064106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 shutdown_connections 2024-09-19T09:25:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:30.258+0000 7f1069c54640 1 -- 172.21.15.52:0/3135347900 wait complete. 2024-09-19T09:25:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 -- 172.21.15.52:0/310839246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 msgr2=0x7f9d94109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/310839246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94109c90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009ca0 tx=0x7f9d8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 -- 172.21.15.52:0/310839246 shutdown_connections 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/310839246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94109c90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/310839246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 0x7f9d94107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/310839246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 -- 172.21.15.52:0/310839246 >> 172.21.15.52:0/310839246 conn(0x7f9d940fc1e0 msgr2=0x7f9d940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 -- 172.21.15.52:0/310839246 shutdown_connections 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.449+0000 7f9d9aa45640 1 -- 172.21.15.52:0/310839246 wait complete. 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 Processor -- start 2024-09-19T09:25:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 -- start start 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 0x7f9d941005d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9410d7e0 con 0x7f9d94107880 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9410d660 con 0x7f9d94104f50 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d9aa45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9410d960 con 0x7f9d94102620 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d98fe2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d98fe2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39088/0 (socket says 172.21.15.52:39088) 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d98fe2640 1 -- 172.21.15.52:0/2246733224 learned_addr learned my addr 172.21.15.52:0/2246733224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d937fe640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 0x7f9d941005d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.450+0000 7f9d93fff640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 -- 172.21.15.52:0/2246733224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 msgr2=0x7f9d94101f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94101f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 -- 172.21.15.52:0/2246733224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 msgr2=0x7f9d941005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 0x7f9d941005d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 -- 172.21.15.52:0/2246733224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d941013a0 con 0x7f9d94107880 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d93fff640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d98fe2640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c031ae0 tx=0x7f9d8c02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d917fa640 1 -- 172.21.15.52:0/2246733224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c02fc30 con 0x7f9d94107880 2024-09-19T09:25:30.456 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d917fa640 1 -- 172.21.15.52:0/2246733224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d8c003e50 con 0x7f9d94107880 2024-09-19T09:25:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d941a1dc0 con 0x7f9d94107880 2024-09-19T09:25:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d917fa640 1 -- 172.21.15.52:0/2246733224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0047e0 con 0x7f9d94107880 2024-09-19T09:25:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.451+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d941a2280 con 0x7f9d94107880 2024-09-19T09:25:30.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.453+0000 7f9d917fa640 1 -- 172.21.15.52:0/2246733224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9d8c003970 con 0x7f9d94107880 2024-09-19T09:25:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 Processor -- start 2024-09-19T09:25:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 -- start start 2024-09-19T09:25:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5629a78142f0 con 0x5629a78b12e0 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5629a77bc270 con 0x5629a78b09a0 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5629a78102b0 con 0x5629a78b6370 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d917fa640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 0x7f9d7c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39090/0 (socket says 172.21.15.52:39090) 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 -- 172.21.15.52:0/1612907255 learned_addr learned my addr 172.21.15.52:0/1612907255 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d937fe640 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d98fe2640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 0x7f9d7c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d917fa640 1 -- 172.21.15.52:0/2246733224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9d8c0f0d20 con 0x7f9d94107880 2024-09-19T09:25:30.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 -- 172.21.15.52:0/1612907255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 msgr2=0x5629a78b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 -- 172.21.15.52:0/1612907255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 msgr2=0x5629a78b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.454+0000 7f9d93fff640 1 -- 172.21.15.52:0/1612907255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a77bb340 con 0x5629a78b12e0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400bc20 tx=0x7f9d8400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721ed62844825e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d98fe2640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 0x7f9d7c0a5830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0c59a0 tx=0x7f9d8c087bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d7a7fc640 1 -- 172.21.15.52:0/1612907255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84017620 con 0x5629a78b12e0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d7a7fc640 1 -- 172.21.15.52:0/1612907255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d84017ca0 con 0x5629a78b12e0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d7a7fc640 1 -- 172.21.15.52:0/1612907255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400fcd0 con 0x5629a78b12e0 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1612907255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 msgr2=0x5629a78b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400bc20 tx=0x7f9d8400d710 comp rx=0 tx=0).stop 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1612907255 shutdown_connections 2024-09-19T09:25:30.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78b5da0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1612907255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1612907255 >> 172.21.15.52:0/1612907255 conn(0x5629a78ac010 msgr2=0x5629a78ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1612907255 shutdown_connections 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.455+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1612907255 wait complete. 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 -- start start 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 Processor -- start 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78babd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5629a78b9340 con 0x5629a78b12e0 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5629a779d290 con 0x5629a78b09a0 2024-09-19T09:25:30.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5629a78b94c0 con 0x5629a78b6370 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d9d7d9740 10 client.0 _ll_register_callbacks cb 0x5629a77ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39100/0 (socket says 172.21.15.52:39100) 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d93fff640 1 -- 172.21.15.52:0/1232163784 learned_addr learned my addr 172.21.15.52:0/1232163784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.456+0000 7f9d937fe640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d937fe640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 -- 172.21.15.52:0/1232163784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 msgr2=0x5629a78c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 -- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 msgr2=0x5629a78babd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78babd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 -- 172.21.15.52:0/1232163784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a7527210 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d93fff640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400b390 tx=0x7f9d840176d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc76caecc430be04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84025020 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d84017ca0 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9d84005050 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d84030050 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d9d7d9740 10 client.16785 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629a75f3620 con 0x5629a78b12e0 2024-09-19T09:25:30.469 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.457+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d84017ca0 con 0x5629a78b12e0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d840046c0 con 0x5629a78b12e0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 10 client.16785 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 20 client.16785 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a78c65c0 0x5629a78c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 4 client.16785 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629a7821a20 con 0x5629a78c65c0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d937fe640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a78c65c0 0x5629a78c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d937fe640 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a78c65c0 0x5629a78c89b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6156aa267c208eb8 server_cookie=89053f7acb026100 in_seq=0 out_seq=0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.458+0000 7f9d737fe640 10 client.16785 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d737fe640 1 -- 172.21.15.52:0/1232163784 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629a7821a20 con 0x5629a78c65c0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d737fe640 10 client.16785 handle_command_reply: tid=0 2024-09-19T09:25:30.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 client.16785 shutdown 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 msgr2=0x5629a78bb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400b390 tx=0x7f9d840176d0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 shutdown_connections 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a78c65c0 0x5629a78c89b0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d737fe640 0 client.16785 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78bb110 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/1232163784 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78babd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 >> 172.21.15.52:0/1232163784 conn(0x5629a78ac010 msgr2=0x5629a78ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 shutdown_connections 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.459+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/1232163784 wait complete. 2024-09-19T09:25:30.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.460+0000 7f9d9d7d9740 20 client.16785 trim_cache size 0 max 16384 2024-09-19T09:25:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 Processor -- start 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 -- start start 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78ad400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78ad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941adb50 con 0x5629a78b12e0 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941ab420 con 0x5629a78b09a0 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941a9270 con 0x5629a78b6370 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39104/0 (socket says 172.21.15.52:39104) 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 -- 172.21.15.52:0/3735666706 learned_addr learned my addr 172.21.15.52:0/3735666706 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d937fe640 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d937fe640 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 -- 172.21.15.52:0/3735666706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 msgr2=0x5629a78ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78ad940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 -- 172.21.15.52:0/3735666706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 msgr2=0x5629a78ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.475+0000 7f9d93fff640 1 -- 172.21.15.52:0/3735666706 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629a78c8d20 con 0x5629a78b12e0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d93fff640 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400dc10 tx=0x7f9d8400f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac89da59ea97ea30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d79ffb640 1 -- 172.21.15.52:0/3735666706 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84039070 con 0x5629a78b12e0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d79ffb640 1 -- 172.21.15.52:0/3735666706 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d8400b620 con 0x5629a78b12e0 2024-09-19T09:25:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d79ffb640 1 -- 172.21.15.52:0/3735666706 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84025070 con 0x5629a78b12e0 2024-09-19T09:25:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/3735666706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 msgr2=0x5629a78c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400dc10 tx=0x7f9d8400f770 comp rx=0 tx=0).stop 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/3735666706 shutdown_connections 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a78ad940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b12e0 0x5629a78c2110 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/3735666706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b09a0 0x5629a78ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/3735666706 >> 172.21.15.52:0/3735666706 conn(0x5629a78ac010 msgr2=0x5629a78ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.476+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/3735666706 shutdown_connections 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/3735666706 wait complete. 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 -- start start 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 Processor -- start 2024-09-19T09:25:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b12e0 0x5629a78bf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a792f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941a98e0 con 0x5629a78b09a0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941aad50 con 0x5629a78b12e0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9d941a9fb0 con 0x5629a78b6370 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d9d7d9740 10 client.0 _ll_register_callbacks cb 0x7f9d8800a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39110/0 (socket says 172.21.15.52:39110) 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d937fe640 1 -- 172.21.15.52:0/4103204128 learned_addr learned my addr 172.21.15.52:0/4103204128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.477+0000 7f9d93fff640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b12e0 0x5629a78bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a792f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 -- 172.21.15.52:0/4103204128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 msgr2=0x5629a792f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a792f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 -- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b12e0 msgr2=0x5629a78bf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b12e0 0x5629a78bf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 -- 172.21.15.52:0/4103204128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629a792f700 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d937fe640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9d94101d00 tx=0x7f9d88011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9213452c15f9e419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88012820 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9d88020e80 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d8400b620 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d88030020 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d9d7d9740 10 client.16791 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629a79309a0 con 0x5629a78b09a0 2024-09-19T09:25:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.478+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d8400b620 con 0x5629a78b09a0 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d880134b0 con 0x5629a78b09a0 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 10 client.16791 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 10 client.16791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 20 client.16791 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a79312e0 0x5629a7933700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 4 client.16791 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629a781bd70 con 0x5629a79312e0 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d93fff640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a79312e0 0x5629a7933700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d93fff640 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a79312e0 0x5629a7933700 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba20a91a84084ac server_cookie=fd2b5222d9917cf1 in_seq=0 out_seq=0 2024-09-19T09:25:30.486 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.479+0000 7f9d737fe640 10 client.16791 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d737fe640 1 -- 172.21.15.52:0/4103204128 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629a781bd70 con 0x5629a79312e0 2024-09-19T09:25:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d737fe640 10 client.16791 handle_command_reply: tid=0 2024-09-19T09:25:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 client.16791 shutdown 2024-09-19T09:25:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 msgr2=0x5629a78beff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9d94101d00 tx=0x7f9d88011040 comp rx=0 tx=0).stop 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 shutdown_connections 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5629a79312e0 0x5629a7933700 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629a78b6370 0x5629a792f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629a78b12e0 0x5629a78bf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d737fe640 0 client.16791 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 --2- 172.21.15.52:0/4103204128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629a78b09a0 0x5629a78beff0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 >> 172.21.15.52:0/4103204128 conn(0x5629a78ac010 msgr2=0x5629a78ab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 shutdown_connections 2024-09-19T09:25:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 1 -- 172.21.15.52:0/4103204128 wait complete. 2024-09-19T09:25:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.491+0000 7f9d9d7d9740 20 client.16791 trim_cache size 0 max 16384 2024-09-19T09:25:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:25:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:25:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:25:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 msgr2=0x7f9d7c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 0x7f9d7c0a5830 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0c59a0 tx=0x7f9d8c087bf0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 msgr2=0x7f9d94100b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c031ae0 tx=0x7f9d8c02f840 comp rx=0 tx=0).stop 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 shutdown_connections 2024-09-19T09:25:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9d94107880 0x7f9d94100b10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d94104f50 0x7f9d941005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9d7c0a3370 0x7f9d7c0a5830 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 --2- 172.21.15.52:0/2246733224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9d94102620 0x7f9d94101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 >> 172.21.15.52:0/2246733224 conn(0x7f9d940fc1e0 msgr2=0x7f9d94102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 shutdown_connections 2024-09-19T09:25:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:30.492+0000 7f9d9aa45640 1 -- 172.21.15.52:0/2246733224 wait complete. 2024-09-19T09:25:30.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:30 smithi086 ceph-mon[34813]: pgmap v460: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 11 op/s 2024-09-19T09:25:30.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:25:30.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:25:30.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:25:30.897 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:30 smithi052 ceph-mon[30947]: pgmap v460: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 11 op/s 2024-09-19T09:25:30.898 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:25:30.898 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:25:30.898 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:25:30.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:25:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:30 smithi169 ceph-mon[35454]: pgmap v460: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 KiB/s wr, 11 op/s 2024-09-19T09:25:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:25:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:25:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:25:31.225 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:31.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 -- 172.21.15.52:0/3361970928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2501055b0 msgr2=0x7fb25010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 --2- 172.21.15.52:0/3361970928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2501055b0 0x7fb25010d130 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb24800aa10 tx=0x7fb24802b750 comp rx=0 tx=0).stop 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 -- 172.21.15.52:0/3361970928 shutdown_connections 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 --2- 172.21.15.52:0/3361970928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2501055b0 0x7fb25010d130 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 --2- 172.21.15.52:0/3361970928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100e30 0x7fb250104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 --2- 172.21.15.52:0/3361970928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb250100480 0x7fb250100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.715+0000 7fb257b8a640 1 -- 172.21.15.52:0/3361970928 >> 172.21.15.52:0/3361970928 conn(0x7fb250077210 msgr2=0x7fb2500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 -- 172.21.15.52:0/3361970928 shutdown_connections 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 -- 172.21.15.52:0/3361970928 wait complete. 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 Processor -- start 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 -- start start 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 0x7fb250198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.716+0000 7fb257b8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 0x7fb25019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010fdd0 con 0x7fb250100e30 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010fc50 con 0x7fb2501055b0 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb25010ff50 con 0x7fb250100480 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39128/0 (socket says 172.21.15.52:39128) 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 -- 172.21.15.52:0/4187842892 learned_addr learned my addr 172.21.15.52:0/4187842892 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255926640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 0x7fb250198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb256127640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 0x7fb25019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 -- 172.21.15.52:0/4187842892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 msgr2=0x7fb250198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 0x7fb250198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 -- 172.21.15.52:0/4187842892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 msgr2=0x7fb25019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 0x7fb25019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 -- 172.21.15.52:0/4187842892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25019d4c0 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255926640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 0x7fb250198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb256127640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 0x7fb25019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb255125640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb24000b450 tx=0x7fb24000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb246ffd640 1 -- 172.21.15.52:0/4187842892 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240015020 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb246ffd640 1 -- 172.21.15.52:0/4187842892 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb240011d70 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25019d7b0 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb246ffd640 1 -- 172.21.15.52:0/4187842892 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24000f340 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.717+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2501a5090 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.720+0000 7fb246ffd640 1 -- 172.21.15.52:0/4187842892 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb240018020 con 0x7fb250100e30 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.720+0000 7fb259f63740 1 Processor -- start 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.720+0000 7fb259f63740 1 -- start start 2024-09-19T09:25:31.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6dd92f0 con 0x55e2c6e735d0 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6d80cf0 con 0x55e2c6e7e370 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb259f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6dd52b0 con 0x55e2c6e74b40 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39132/0 (socket says 172.21.15.52:39132) 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 -- 172.21.15.52:0/3699298582 learned_addr learned my addr 172.21.15.52:0/3699298582 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb256127640 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb246ffd640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255125640 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 -- 172.21.15.52:0/3699298582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 msgr2=0x55e2c6e73090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e73090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 -- 172.21.15.52:0/3699298582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 msgr2=0x55e2c6e80760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb256127640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e80760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 -- 172.21.15.52:0/3699298582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c6d653a0 con 0x55e2c6e735d0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb246ffd640 1 -- 172.21.15.52:0/4187842892 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2400cf550 con 0x7fb250100e30 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.721+0000 7fb255926640 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0103a0 tx=0x7fb24c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c718afeb2f3be13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb23bfff640 1 -- 172.21.15.52:0/3699298582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c016070 con 0x55e2c6e735d0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb23bfff640 1 -- 172.21.15.52:0/3699298582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb24c012bf0 con 0x55e2c6e735d0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb23bfff640 1 -- 172.21.15.52:0/3699298582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c01bcf0 con 0x55e2c6e735d0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb256127640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 0x7fb23c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb248005ec0 tx=0x7fb24802b750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb259f63740 1 -- 172.21.15.52:0/3699298582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 msgr2=0x55e2c6e73a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb259f63740 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0103a0 tx=0x7fb24c010860 comp rx=0 tx=0).stop 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb259f63740 1 -- 172.21.15.52:0/3699298582 shutdown_connections 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb259f63740 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e80760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.722+0000 7fb259f63740 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e73a10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 --2- 172.21.15.52:0/3699298582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e73090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 -- 172.21.15.52:0/3699298582 >> 172.21.15.52:0/3699298582 conn(0x55e2c6e3c310 msgr2=0x55e2c6e6fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 -- 172.21.15.52:0/3699298582 shutdown_connections 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 -- 172.21.15.52:0/3699298582 wait complete. 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 -- start start 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.723+0000 7fb259f63740 1 Processor -- start 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e735d0 0x55e2c6e7dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 0x55e2c6e7b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6e81070 con 0x55e2c6e74b40 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6d94060 con 0x55e2c6e7e370 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e2c6e811f0 con 0x55e2c6e735d0 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb259f63740 10 client.0 _ll_register_callbacks cb 0x55e2c6ae78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb255125640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 0x55e2c6e7b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb256127640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb256127640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:42090/0 (socket says 172.21.15.52:42090) 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb256127640 1 -- 172.21.15.52:0/1358835414 learned_addr learned my addr 172.21.15.52:0/1358835414 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.724+0000 7fb255926640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e735d0 0x55e2c6e7dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 -- 172.21.15.52:0/1358835414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e735d0 msgr2=0x55e2c6e7dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e735d0 0x55e2c6e7dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 -- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 msgr2=0x55e2c6e7b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 -- 172.21.15.52:0/1358835414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c6b4a3c0 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb256127640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb255125640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 0x55e2c6e7b030 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x55e2c6e74070 tx=0x7fb24009b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8bbe5dacd19ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24009ba90 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb240098100 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24c012bf0 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb24009fe40 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb259f63740 10 client.16803 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e2c6e90f50 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb24c012bf0 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb2400cf070 con 0x55e2c6e74b40 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb259f63740 10 client.16803 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.725+0000 7fb259f63740 10 client.16803 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb259f63740 20 client.16803 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6e922a0 0x55e2c6e94690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb259f63740 4 client.16803 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2c6de6860 con 0x55e2c6e922a0 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb255926640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6e922a0 0x55e2c6e94690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb255926640 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6e922a0 0x55e2c6e94690 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d39854669d3c42a9 server_cookie=8666844b4f56f415 in_seq=0 out_seq=0 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.726+0000 7fb2397fa640 10 client.16803 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb2397fa640 1 -- 172.21.15.52:0/1358835414 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2c6de6860 con 0x55e2c6e922a0 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb2397fa640 10 client.16803 handle_command_reply: tid=0 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 client.16803 shutdown 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 msgr2=0x55e2c6e7b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 0x55e2c6e7b030 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x55e2c6e74070 tx=0x7fb24009b5d0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 shutdown_connections 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6e922a0 0x55e2c6e94690 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e7e370 0x55e2c6e7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e74b40 0x55e2c6e7b030 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb2397fa640 0 client.16803 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 --2- 172.21.15.52:0/1358835414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e735d0 0x55e2c6e7dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 >> 172.21.15.52:0/1358835414 conn(0x55e2c6e3c310 msgr2=0x55e2c6e75960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 shutdown_connections 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 1 -- 172.21.15.52:0/1358835414 wait complete. 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.727+0000 7fb259f63740 20 client.16803 trim_cache size 0 max 16384 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 Processor -- start 2024-09-19T09:25:31.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 -- start start 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 0x55e2c6e8eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501adf90 con 0x55e2c6e735d0 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501ab860 con 0x55e2c6e74b40 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.741+0000 7fb259f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501a96b0 con 0x55e2c6e7e370 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb256127640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39160/0 (socket says 172.21.15.52:39160) 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb256127640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:50382/0 (socket says 172.21.15.52:50382) 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 -- 172.21.15.52:0/2254613109 learned_addr learned my addr 172.21.15.52:0/2254613109 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:31.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255125640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 0x55e2c6e8eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 -- 172.21.15.52:0/2254613109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 msgr2=0x55e2c6e8a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 -- 172.21.15.52:0/2254613109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 msgr2=0x55e2c6e8eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 0x55e2c6e8eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 -- 172.21.15.52:0/2254613109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2c6e795c0 con 0x55e2c6e735d0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb256127640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255125640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 0x55e2c6e8eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb255926640 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x55e2c6e70ac0 tx=0x7fb24c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d947d3148fc9f0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb23b7fe640 1 -- 172.21.15.52:0/2254613109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c016070 con 0x55e2c6e735d0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb23b7fe640 1 -- 172.21.15.52:0/2254613109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb24c0129f0 con 0x55e2c6e735d0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.742+0000 7fb23b7fe640 1 -- 172.21.15.52:0/2254613109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0052e0 con 0x55e2c6e735d0 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- 172.21.15.52:0/2254613109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 msgr2=0x55e2c6e6fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x55e2c6e70ac0 tx=0x7fb24c009920 comp rx=0 tx=0).stop 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- 172.21.15.52:0/2254613109 shutdown_connections 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e7e370 0x55e2c6e8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e74b40 0x55e2c6e8eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 --2- 172.21.15.52:0/2254613109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e735d0 0x55e2c6e6fe10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- 172.21.15.52:0/2254613109 >> 172.21.15.52:0/2254613109 conn(0x55e2c6e3c310 msgr2=0x55e2c6e6f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- 172.21.15.52:0/2254613109 shutdown_connections 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- 172.21.15.52:0/2254613109 wait complete. 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.743+0000 7fb259f63740 1 -- start start 2024-09-19T09:25:31.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 Processor -- start 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e735d0 0x55e2c6e78c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e86480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501a9d20 con 0x55e2c6e7e370 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501ab190 con 0x55e2c6e735d0 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501aa3f0 con 0x55e2c6e74b40 2024-09-19T09:25:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb259f63740 10 client.0 _ll_register_callbacks cb 0x7fb24009b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39168/0 (socket says 172.21.15.52:39168) 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 -- 172.21.15.52:0/825223431 learned_addr learned my addr 172.21.15.52:0/825223431 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb255926640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e735d0 0x55e2c6e78c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb255125640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e86480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 -- 172.21.15.52:0/825223431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 msgr2=0x55e2c6e86480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e86480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 -- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e735d0 msgr2=0x55e2c6e78c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e735d0 0x55e2c6e78c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb256127640 1 -- 172.21.15.52:0/825223431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2c6e8ce80 con 0x55e2c6e7e370 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.744+0000 7fb255125640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e86480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb256127640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb24800aa10 tx=0x7fb24800a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd26236fb3b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248036040 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb248003d90 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24c0129f0 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb248056410 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 10 client.16809 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e2c6ef90d0 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb24c0129f0 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb24803b070 con 0x55e2c6e7e370 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 10 client.16809 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 10 client.16809 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 20 client.16809 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6ef9820 0x55e2c6efbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 4 client.16809 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:25:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.745+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2c6de0d70 con 0x55e2c6ef9820 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb255926640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6ef9820 0x55e2c6efbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb255926640 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6ef9820 0x55e2c6efbc40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5ffe6124eb764d9 server_cookie=777623d17c7c51d7 in_seq=0 out_seq=0 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb2397fa640 10 client.16809 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb2397fa640 1 -- 172.21.15.52:0/825223431 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2c6de0d70 con 0x55e2c6ef9820 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb2397fa640 10 client.16809 handle_command_reply: tid=0 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.746+0000 7fb259f63740 1 client.16809 shutdown 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 msgr2=0x55e2c6e869c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb24800aa10 tx=0x7fb24800a370 comp rx=0 tx=0).stop 2024-09-19T09:25:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 shutdown_connections 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e2c6e7e370 0x55e2c6e869c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e2c6e74b40 0x55e2c6e86480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55e2c6ef9820 0x55e2c6efbc40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 --2- 172.21.15.52:0/825223431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e2c6e735d0 0x55e2c6e78c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb2397fa640 0 client.16809 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 >> 172.21.15.52:0/825223431 conn(0x55e2c6e3c310 msgr2=0x55e2c6e75110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 shutdown_connections 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 1 -- 172.21.15.52:0/825223431 wait complete. 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb259f63740 20 client.16809 trim_cache size 0 max 16384 2024-09-19T09:25:31.768 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:25:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 msgr2=0x7fb23c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 0x7fb23c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb248005ec0 tx=0x7fb24802b750 comp rx=0 tx=0).stop 2024-09-19T09:25:31.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 msgr2=0x7fb250198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.747+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb24000b450 tx=0x7fb24000b910 comp rx=0 tx=0).stop 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 shutdown_connections 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2501055b0 0x7fb25019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb250100e30 0x7fb250198a50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb23c0a3240 0x7fb23c0a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 --2- 172.21.15.52:0/4187842892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb250100480 0x7fb250198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 >> 172.21.15.52:0/4187842892 conn(0x7fb250077210 msgr2=0x7fb2500fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 shutdown_connections 2024-09-19T09:25:31.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:31.748+0000 7fb257b8a640 1 -- 172.21.15.52:0/4187842892 wait complete. 2024-09-19T09:25:32.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:25:32.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:32 smithi052 ceph-mon[30947]: pgmap v461: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:25:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:32.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:32 smithi086 ceph-mon[34813]: pgmap v461: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:25:32.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:32 smithi169 ceph-mon[35454]: pgmap v461: 97 pgs: 97 active+clean; 2.1 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 -- 172.21.15.52:0/3187301951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 msgr2=0x7fdbcc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 --2- 172.21.15.52:0/3187301951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc10eaa0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009ca0 tx=0x7fdbc402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 -- 172.21.15.52:0/3187301951 shutdown_connections 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 --2- 172.21.15.52:0/3187301951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc10eaa0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 --2- 172.21.15.52:0/3187301951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 0x7fdbcc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 --2- 172.21.15.52:0/3187301951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 0x7fdbcc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 -- 172.21.15.52:0/3187301951 >> 172.21.15.52:0/3187301951 conn(0x7fdbcc0fd8f0 msgr2=0x7fdbcc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.165+0000 7fdbd1174640 1 -- 172.21.15.52:0/3187301951 shutdown_connections 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.166+0000 7fdbd1174640 1 -- 172.21.15.52:0/3187301951 wait complete. 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.166+0000 7fdbd1174640 1 Processor -- start 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 -- start start 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 0x7fdbcc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 0x7fdbcc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc111fd0 con 0x7fdbcc106f20 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc111e50 con 0x7fdbcc1027a0 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbd1174640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc112150 con 0x7fdbcc101df0 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbca59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 0x7fdbcc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39196/0 (socket says 172.21.15.52:39196) 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcb59e640 1 -- 172.21.15.52:0/658320711 learned_addr learned my addr 172.21.15.52:0/658320711 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 0x7fdbcc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcb59e640 1 -- 172.21.15.52:0/658320711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 msgr2=0x7fdbcc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.167+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 0x7fdbcc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbcb59e640 1 -- 172.21.15.52:0/658320711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 msgr2=0x7fdbcc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 0x7fdbcc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbcb59e640 1 -- 172.21.15.52:0/658320711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc1a68d0 con 0x7fdbcc106f20 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4003f10 tx=0x7fdbc4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbc3fff640 1 -- 172.21.15.52:0/658320711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4031710 con 0x7fdbcc106f20 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbc3fff640 1 -- 172.21.15.52:0/658320711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc40318b0 con 0x7fdbcc106f20 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc1a6b60 con 0x7fdbcc106f20 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbc3fff640 1 -- 172.21.15.52:0/658320711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc402fb50 con 0x7fdbcc106f20 2024-09-19T09:25:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.168+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1a70a0 con 0x7fdbcc106f20 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.170+0000 7fdbc3fff640 1 -- 172.21.15.52:0/658320711 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdbc402fd30 con 0x7fdbcc106f20 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.170+0000 7fdbd354d740 1 Processor -- start 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 -- start start 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fae63172f0 con 0x55fae63bc370 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fae62becf0 con 0x55fae63b15d0 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbd354d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fae63132b0 con 0x55fae63b2b40 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbca59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbca59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39210/0 (socket says 172.21.15.52:39210) 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbca59c640 1 -- 172.21.15.52:0/132396454 learned_addr learned my addr 172.21.15.52:0/132396454 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:33.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.171+0000 7fdbca59c640 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 -- 172.21.15.52:0/132396454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 msgr2=0x55fae63b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 -- 172.21.15.52:0/132396454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 msgr2=0x55fae63b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbc3fff640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 0x7fdbb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 -- 172.21.15.52:0/132396454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae62a33a0 con 0x55fae63bc370 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbc3fff640 1 -- 172.21.15.52:0/658320711 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbc40f0f90 con 0x7fdbcc106f20 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bfb0 tx=0x7fdbb400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947d25b6f67befc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbca59c640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 0x7fdbb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbc17fa640 1 -- 172.21.15.52:0/132396454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401e640 con 0x55fae63bc370 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbc17fa640 1 -- 172.21.15.52:0/132396454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb401ecc0 con 0x55fae63bc370 2024-09-19T09:25:33.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.172+0000 7fdbc17fa640 1 -- 172.21.15.52:0/132396454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401d3e0 con 0x55fae63bc370 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- 172.21.15.52:0/132396454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 msgr2=0x55fae63be760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bfb0 tx=0x7fdbb400b7b0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbca59c640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 0x7fdbb80a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdbb401e000 tx=0x7fdbb401d6c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- 172.21.15.52:0/132396454 shutdown_connections 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63be760 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 --2- 172.21.15.52:0/132396454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- 172.21.15.52:0/132396454 >> 172.21.15.52:0/132396454 conn(0x55fae637a310 msgr2=0x55fae63adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- 172.21.15.52:0/132396454 shutdown_connections 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- 172.21.15.52:0/132396454 wait complete. 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 -- start start 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.173+0000 7fdbd354d740 1 Processor -- start 2024-09-19T09:25:33.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 0x55fae63b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fae63bf070 con 0x55fae63b15d0 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fae62d2060 con 0x55fae63bc370 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fae63bf1f0 con 0x55fae63b2b40 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbd354d740 10 client.0 _ll_register_callbacks cb 0x55fae60258c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39226/0 (socket says 172.21.15.52:39226) 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 -- 172.21.15.52:0/3678800486 learned_addr learned my addr 172.21.15.52:0/3678800486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 0x55fae63b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbca59c640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 -- 172.21.15.52:0/3678800486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 msgr2=0x55fae63b8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 -- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 msgr2=0x55fae63b94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 0x55fae63b94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 -- 172.21.15.52:0/3678800486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae60883c0 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 0x55fae63b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00bf60 tx=0x7fdbbc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a45f779269f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.174+0000 7fdbb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004230 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbbc0043d0 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb401ecc0 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbbc0106a0 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 10 client.16821 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fae63cab10 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb401ecc0 con 0x55fae63b15d0 2024-09-19T09:25:33.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbbc019070 con 0x55fae63b15d0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 10 client.16821 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 20 client.16821 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae63cbfc0 0x55fae63ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 4 client.16821 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.175+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fae6324860 con 0x55fae63cbfc0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.176+0000 7fdbca59c640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae63cbfc0 0x55fae63ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.176+0000 7fdbca59c640 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae63cbfc0 0x55fae63ce440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbf2b8cca8bd724d server_cookie=a5c854156ef55b7 in_seq=0 out_seq=0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.176+0000 7fdbb27fc640 10 client.16821 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbb27fc640 1 -- 172.21.15.52:0/3678800486 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fae6324860 con 0x55fae63cbfc0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbb27fc640 10 client.16821 handle_command_reply: tid=0 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 client.16821 shutdown 2024-09-19T09:25:33.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 msgr2=0x55fae63bbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00bf60 tx=0x7fdbbc00bf90 comp rx=0 tx=0).stop 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 shutdown_connections 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae63cbfc0 0x55fae63ce440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63bc370 0x55fae63b94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 --2- 172.21.15.52:0/3678800486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63b15d0 0x55fae63bbcd0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbb27fc640 0 client.16821 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 >> 172.21.15.52:0/3678800486 conn(0x55fae637a310 msgr2=0x55fae63b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 shutdown_connections 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 1 -- 172.21.15.52:0/3678800486 wait complete. 2024-09-19T09:25:33.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.177+0000 7fdbd354d740 20 client.16821 trim_cache size 0 max 16384 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.190+0000 7fdbd354d740 1 Processor -- start 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.190+0000 7fdbd354d740 1 -- start start 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b15d0 0x55fae63aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b2b40 0x55fae63acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1b2280 con 0x55fae63bc370 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1afb50 con 0x55fae63b2b40 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbd354d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1ad9a0 con 0x55fae63b15d0 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39238/0 (socket says 172.21.15.52:39238) 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 -- 172.21.15.52:0/1325379914 learned_addr learned my addr 172.21.15.52:0/1325379914 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b15d0 0x55fae63aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbca59c640 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b2b40 0x55fae63acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 -- 172.21.15.52:0/1325379914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b15d0 msgr2=0x55fae63aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b15d0 0x55fae63aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 -- 172.21.15.52:0/1325379914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b2b40 msgr2=0x55fae63acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b2b40 0x55fae63acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.191+0000 7fdbcb59e640 1 -- 172.21.15.52:0/1325379914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae63aedf0 con 0x55fae63bc370 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.192+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40b9ea0 tx=0x7fdbc40b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a928c010c012b0f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.192+0000 7fdbc0ff9640 1 -- 172.21.15.52:0/1325379914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40d6070 con 0x55fae63bc370 2024-09-19T09:25:33.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.192+0000 7fdbc0ff9640 1 -- 172.21.15.52:0/1325379914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc4036030 con 0x55fae63bc370 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.192+0000 7fdbc0ff9640 1 -- 172.21.15.52:0/1325379914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40bd730 con 0x55fae63bc370 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- 172.21.15.52:0/1325379914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 msgr2=0x55fae63b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40b9ea0 tx=0x7fdbc40b9040 comp rx=0 tx=0).stop 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- 172.21.15.52:0/1325379914 shutdown_connections 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b4120 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b2b40 0x55fae63acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 --2- 172.21.15.52:0/1325379914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b15d0 0x55fae63aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- 172.21.15.52:0/1325379914 >> 172.21.15.52:0/1325379914 conn(0x55fae637a310 msgr2=0x55fae63ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- 172.21.15.52:0/1325379914 shutdown_connections 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- 172.21.15.52:0/1325379914 wait complete. 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 -- start start 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.193+0000 7fdbd354d740 1 Processor -- start 2024-09-19T09:25:33.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1ae010 con 0x55fae63bc370 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1af480 con 0x55fae63b15d0 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc1ae6e0 con 0x55fae63b2b40 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39248/0 (socket says 172.21.15.52:39248) 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 -- 172.21.15.52:0/795258133 learned_addr learned my addr 172.21.15.52:0/795258133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbd354d740 10 client.0 _ll_register_callbacks cb 0x7fdbbc00b790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbca59c640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 -- 172.21.15.52:0/795258133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 msgr2=0x55fae63b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 -- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 msgr2=0x55fae63c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 -- 172.21.15.52:0/795258133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae63b6be0 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbcb59e640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4030040 tx=0x7fdbc40bd550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eec7e0fb4e06b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.194+0000 7fdbb27fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40da020 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbc40bd730 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbc4036030 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbc40d6050 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 10 client.16827 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fae6436dc0 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc4036030 con 0x55fae63bc370 2024-09-19T09:25:33.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbc40d61f0 con 0x55fae63bc370 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 10 client.16827 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 20 client.16827 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae6437480 0x55fae64398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 4 client.16827 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.195+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fae631ed70 con 0x55fae6437480 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae6437480 0x55fae64398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbcad9d640 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae6437480 0x55fae64398a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73b04460a451c7 server_cookie=e35dd73fbe497236 in_seq=0 out_seq=0 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbb27fc640 10 client.16827 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbb27fc640 1 -- 172.21.15.52:0/795258133 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fae631ed70 con 0x55fae6437480 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbb27fc640 10 client.16827 handle_command_reply: tid=0 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 client.16827 shutdown 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 msgr2=0x55fae63b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4030040 tx=0x7fdbc40bd550 comp rx=0 tx=0).stop 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 shutdown_connections 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fae6437480 0x55fae64398a0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbb27fc640 0 client.16827 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fae63bc370 0x55fae63b63b0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fae63b2b40 0x55fae63b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 --2- 172.21.15.52:0/795258133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fae63b15d0 0x55fae63c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.196+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 >> 172.21.15.52:0/795258133 conn(0x55fae637a310 msgr2=0x55fae63acb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 shutdown_connections 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd354d740 1 -- 172.21.15.52:0/795258133 wait complete. 2024-09-19T09:25:33.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd354d740 20 client.16827 trim_cache size 0 max 16384 2024-09-19T09:25:33.209 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:25:33.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 msgr2=0x7fdbb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 0x7fdbb80a5700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdbb401e000 tx=0x7fdbb401d6c0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 msgr2=0x7fdbcc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4003f10 tx=0x7fdbc4003f40 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 shutdown_connections 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbcc106f20 0x7fdbcc074f70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbcc1027a0 0x7fdbcc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbb80a3240 0x7fdbb80a5700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 --2- 172.21.15.52:0/658320711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbcc101df0 0x7fdbcc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.197+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 >> 172.21.15.52:0/658320711 conn(0x7fdbcc0fd8f0 msgr2=0x7fdbcc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.198+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 shutdown_connections 2024-09-19T09:25:33.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:33.198+0000 7fdbd1174640 1 -- 172.21.15.52:0/658320711 wait complete. 2024-09-19T09:25:34.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:34 smithi086 ceph-mon[34813]: pgmap v462: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:25:34.810 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:25:34.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:25:34.839 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:34 smithi052 ceph-mon[30947]: pgmap v462: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:25:34.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:34 smithi169 ceph-mon[35454]: pgmap v462: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-19T09:25:35.084 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 -- 172.21.15.52:0/1427290043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 msgr2=0x7f67f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 --2- 172.21.15.52:0/1427290043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f41021c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009900 tx=0x7f67e802a410 comp rx=0 tx=0).stop 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 -- 172.21.15.52:0/1427290043 shutdown_connections 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 --2- 172.21.15.52:0/1427290043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 --2- 172.21.15.52:0/1427290043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 0x7f67f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 --2- 172.21.15.52:0/1427290043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f41021c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 -- 172.21.15.52:0/1427290043 >> 172.21.15.52:0/1427290043 conn(0x7f67f40fd8c0 msgr2=0x7f67f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 -- 172.21.15.52:0/1427290043 shutdown_connections 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 -- 172.21.15.52:0/1427290043 wait complete. 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.568+0000 7f67faea9640 1 Processor -- start 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 -- start start 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 0x7f67f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111f70 con 0x7f67f4101de0 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67f4111df0 con 0x7f67f4102790 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67faea9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41120f0 con 0x7f67f4106f10 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39262/0 (socket says 172.21.15.52:39262) 2024-09-19T09:25:35.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 -- 172.21.15.52:0/2685910648 learned_addr learned my addr 172.21.15.52:0/2685910648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f3fff640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 0x7f67f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f9446640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 -- 172.21.15.52:0/2685910648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 msgr2=0x7f67f4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 -- 172.21.15.52:0/2685910648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 msgr2=0x7f67f4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 0x7f67f4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 -- 172.21.15.52:0/2685910648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f41a68f0 con 0x7f67f4101de0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f9446640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.569+0000 7f67f8c45640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f67e8006010 tx=0x7f67e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.570+0000 7f67f1ffb640 1 -- 172.21.15.52:0/2685910648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e803f030 con 0x7f67f4101de0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.570+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f41a6b80 con 0x7f67f4101de0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.570+0000 7f67f1ffb640 1 -- 172.21.15.52:0/2685910648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67e8003ce0 con 0x7f67f4101de0 2024-09-19T09:25:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.570+0000 7f67f1ffb640 1 -- 172.21.15.52:0/2685910648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8035070 con 0x7f67f4101de0 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.570+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41a70b0 con 0x7f67f4101de0 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.572+0000 7f67f1ffb640 1 -- 172.21.15.52:0/2685910648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f67e8042030 con 0x7f67f4101de0 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 Processor -- start 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 -- start start 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a775800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a778130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56545a6d0280 con 0x56545a76ab60 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56545a677b10 con 0x56545a76b480 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67fd282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56545a6cc240 con 0x56545a775d40 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39266/0 (socket says 172.21.15.52:39266) 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f9446640 1 -- 172.21.15.52:0/415236686 learned_addr learned my addr 172.21.15.52:0/415236686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f1ffb640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 0x7f67e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f8c45640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a775800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f3fff640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a778130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.573+0000 7f67f9446640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 0x7f67e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 -- 172.21.15.52:0/415236686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 msgr2=0x56545a778130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a778130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 -- 172.21.15.52:0/415236686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 msgr2=0x56545a775800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a775800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 -- 172.21.15.52:0/415236686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545a6841f0 con 0x56545a76ab60 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f8c45640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a775800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f1ffb640 1 -- 172.21.15.52:0/2685910648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f67e80eff00 con 0x7f67f4101de0 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f67ec013910 tx=0x7f67ec013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3650561d4f4ab80a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67deffd640 1 -- 172.21.15.52:0/415236686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec004b20 con 0x56545a76ab60 2024-09-19T09:25:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67deffd640 1 -- 172.21.15.52:0/415236686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67ec004cc0 con 0x56545a76ab60 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67deffd640 1 -- 172.21.15.52:0/415236686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec005850 con 0x56545a76ab60 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.574+0000 7f67f9446640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 0x7f67e40a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f67ec020000 tx=0x7f67ec01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- 172.21.15.52:0/415236686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 msgr2=0x56545a76af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f67ec013910 tx=0x7f67ec013dd0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- 172.21.15.52:0/415236686 shutdown_connections 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a778130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a775800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 --2- 172.21.15.52:0/415236686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a76af40 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- 172.21.15.52:0/415236686 >> 172.21.15.52:0/415236686 conn(0x56545a7670f0 msgr2=0x56545a7674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- 172.21.15.52:0/415236686 shutdown_connections 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- 172.21.15.52:0/415236686 wait complete. 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 -- start start 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.575+0000 7f67fd282740 1 Processor -- start 2024-09-19T09:25:35.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a7730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56545a778910 con 0x56545a76ab60 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56545a68af10 con 0x56545a76b480 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56545a778a90 con 0x56545a775d40 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 10 client.0 _ll_register_callbacks cb 0x56545a653a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39276/0 (socket says 172.21.15.52:39276) 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 -- 172.21.15.52:0/336344308 learned_addr learned my addr 172.21.15.52:0/336344308 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f3fff640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a7730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f9446640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 -- 172.21.15.52:0/336344308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 msgr2=0x56545a773630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a773630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 -- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 msgr2=0x56545a7730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a7730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 -- 172.21.15.52:0/336344308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545a4416a0 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67f8c45640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f67e80c4c40 tx=0x7f67e80095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236f592eb8d33a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8049070 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f67e80bc760 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.576+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67ec004cc0 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67e80bbe60 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 10 client.16839 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56545a7844d0 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67ec004cc0 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f67e80f1030 con 0x56545a76ab60 2024-09-19T09:25:35.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 10 client.16839 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 20 client.16839 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7858c0 0x56545a787d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 4 client.16839 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545a6dd7f0 con 0x56545a7858c0 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.577+0000 7f67f3fff640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7858c0 0x56545a787d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.578+0000 7f67d3fff640 10 client.16839 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.578+0000 7f67f3fff640 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7858c0 0x56545a787d10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf874ebfba6c2737 server_cookie=f54d7a1c0de56dd9 in_seq=0 out_seq=0 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.578+0000 7f67d3fff640 1 -- 172.21.15.52:0/336344308 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56545a6dd7f0 con 0x56545a7858c0 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.578+0000 7f67d3fff640 10 client.16839 handle_command_reply: tid=0 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.578+0000 7f67fd282740 1 client.16839 shutdown 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 msgr2=0x56545a772bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f67e80c4c40 tx=0x7f67e80095e0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 shutdown_connections 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7858c0 0x56545a787d10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a775d40 0x56545a773630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76b480 0x56545a7730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 --2- 172.21.15.52:0/336344308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a76ab60 0x56545a772bb0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67d3fff640 0 client.16839 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 >> 172.21.15.52:0/336344308 conn(0x56545a7670f0 msgr2=0x56545a766270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 shutdown_connections 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 1 -- 172.21.15.52:0/336344308 wait complete. 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.579+0000 7f67fd282740 20 client.16839 trim_cache size 0 max 16384 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 Processor -- start 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 -- start start 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a774a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a78d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41b2200 con 0x56545a775d40 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41afad0 con 0x56545a76ab60 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67fd282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41ad920 con 0x56545a76b480 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39278/0 (socket says 172.21.15.52:39278) 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.596+0000 7f67f9446640 1 -- 172.21.15.52:0/1462809081 learned_addr learned my addr 172.21.15.52:0/1462809081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f3fff640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a78d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f8c45640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a774a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 -- 172.21.15.52:0/1462809081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 msgr2=0x56545a78d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a78d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 -- 172.21.15.52:0/1462809081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 msgr2=0x56545a774a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a774a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 -- 172.21.15.52:0/1462809081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545a766f20 con 0x56545a775d40 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f3fff640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a78d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67f9446640 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006010 tx=0x7f67ec005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e42e9623cce179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67de7fc640 1 -- 172.21.15.52:0/1462809081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec013030 con 0x56545a775d40 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67de7fc640 1 -- 172.21.15.52:0/1462809081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67ec026470 con 0x56545a775d40 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.597+0000 7f67de7fc640 1 -- 172.21.15.52:0/1462809081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01d440 con 0x56545a775d40 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- 172.21.15.52:0/1462809081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 msgr2=0x56545a78dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f67ec006010 tx=0x7f67ec005e30 comp rx=0 tx=0).stop 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- 172.21.15.52:0/1462809081 shutdown_connections 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a78dad0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a78d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 --2- 172.21.15.52:0/1462809081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a774a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- 172.21.15.52:0/1462809081 >> 172.21.15.52:0/1462809081 conn(0x56545a7670f0 msgr2=0x56545a774300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- 172.21.15.52:0/1462809081 shutdown_connections 2024-09-19T09:25:35.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- 172.21.15.52:0/1462809081 wait complete. 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 -- start start 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.598+0000 7f67fd282740 1 Processor -- start 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a779cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a77a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41adf90 con 0x56545a775d40 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41af400 con 0x56545a76ab60 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67f41ae660 con 0x56545a76b480 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67fd282740 10 client.0 _ll_register_callbacks cb 0x7f67e80dc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39286/0 (socket says 172.21.15.52:39286) 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 -- 172.21.15.52:0/3633562724 learned_addr learned my addr 172.21.15.52:0/3633562724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:35.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f8c45640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a779cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f3fff640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a77a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 -- 172.21.15.52:0/3633562724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 msgr2=0x56545a77a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a77a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 -- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 msgr2=0x56545a779cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a779cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 -- 172.21.15.52:0/3633562724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545a7ef7b0 con 0x56545a775d40 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f3fff640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a77a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f8c45640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a779cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67f9446640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f67ec013e10 tx=0x7f67ec0098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd56d22c28a95c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.599+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec03d060 con 0x56545a775d40 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f67ec013480 con 0x56545a775d40 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67ec026470 con 0x56545a775d40 2024-09-19T09:25:35.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f67ec026620 con 0x56545a775d40 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 10 client.16845 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56545a7f0af0 con 0x56545a775d40 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67ec026470 con 0x56545a775d40 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f67ec01dc70 con 0x56545a775d40 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 10 client.16845 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 20 client.16845 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7f1010 0x56545a7f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 4 client.16845 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.600+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56545a6d7d00 con 0x56545a7f1010 2024-09-19T09:25:35.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.601+0000 7f67f8c45640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7f1010 0x56545a7f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:35.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.601+0000 7f67f8c45640 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7f1010 0x56545a7f3400 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85095f2e406c614d server_cookie=1407a403b323cb5b in_seq=0 out_seq=0 2024-09-19T09:25:35.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.601+0000 7f67d3fff640 10 client.16845 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:35.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67d3fff640 1 -- 172.21.15.52:0/3633562724 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56545a6d7d00 con 0x56545a7f1010 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67d3fff640 10 client.16845 handle_command_reply: tid=0 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 client.16845 shutdown 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 msgr2=0x56545a77a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f67ec013e10 tx=0x7f67ec0098d0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 shutdown_connections 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56545a7f1010 0x56545a7f3400 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545a775d40 0x56545a77a750 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56545a76b480 0x56545a77a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 --2- 172.21.15.52:0/3633562724 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56545a76ab60 0x56545a779cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67d3fff640 0 client.16845 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 >> 172.21.15.52:0/3633562724 conn(0x56545a7670f0 msgr2=0x56545a766270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 shutdown_connections 2024-09-19T09:25:35.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 1 -- 172.21.15.52:0/3633562724 wait complete. 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.602+0000 7f67fd282740 20 client.16845 trim_cache size 0 max 16384 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "70fc1357-d22c-4bac-9089-6a7ddf61c6bf", 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:25:35.619 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 msgr2=0x7f67e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 0x7f67e40a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f67ec020000 tx=0x7f67ec01f000 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 msgr2=0x7f67f40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f67e8006010 tx=0x7f67e80042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 shutdown_connections 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f67e40a3240 0x7f67e40a5700 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67f4106f10 0x7f67f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67f4102790 0x7f67f4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 --2- 172.21.15.52:0/2685910648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67f4101de0 0x7f67f40744f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 >> 172.21.15.52:0/2685910648 conn(0x7f67f40fd8c0 msgr2=0x7f67f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 shutdown_connections 2024-09-19T09:25:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:35.603+0000 7f67faea9640 1 -- 172.21.15.52:0/2685910648 wait complete. 2024-09-19T09:25:36.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:25:36.722 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:36.843 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:36 smithi052 ceph-mon[30947]: pgmap v463: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-19T09:25:36.843 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:36 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:25:36.843 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:36 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:36.844 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:36 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:25:36.844 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:36 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:36.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:36 smithi169 ceph-mon[35454]: pgmap v463: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-19T09:25:36.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:36 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:25:36.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:36 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:36.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:36 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:25:36.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:36 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:37.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:36 smithi086 ceph-mon[34813]: pgmap v463: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-09-19T09:25:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:36 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:25:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:36 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:36 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:25:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:36 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 -- 172.21.15.52:0/2242918241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98102790 msgr2=0x7fbf981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 --2- 172.21.15.52:0/2242918241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98102790 0x7fbf981067e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009900 tx=0x7fbf8002a410 comp rx=0 tx=0).stop 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 -- 172.21.15.52:0/2242918241 shutdown_connections 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 --2- 172.21.15.52:0/2242918241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98106f10 0x7fbf9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 --2- 172.21.15.52:0/2242918241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98102790 0x7fbf981067e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 --2- 172.21.15.52:0/2242918241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98101de0 0x7fbf981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 -- 172.21.15.52:0/2242918241 >> 172.21.15.52:0/2242918241 conn(0x7fbf980fd8c0 msgr2=0x7fbf980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 -- 172.21.15.52:0/2242918241 shutdown_connections 2024-09-19T09:25:37.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 -- 172.21.15.52:0/2242918241 wait complete. 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.158+0000 7fbf9d124640 1 Processor -- start 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 -- start start 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98102790 0x7fbf9819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98106f10 0x7fbf9819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98111f70 con 0x7fbf98101de0 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98111df0 con 0x7fbf98102790 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9d124640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981120f0 con 0x7fbf98106f10 2024-09-19T09:25:37.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39300/0 (socket says 172.21.15.52:39300) 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 -- 172.21.15.52:0/1844011847 learned_addr learned my addr 172.21.15.52:0/1844011847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9659c640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98102790 0x7fbf9819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98106f10 0x7fbf9819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 -- 172.21.15.52:0/1844011847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98106f10 msgr2=0x7fbf9819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98106f10 0x7fbf9819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.159+0000 7fbf96d9d640 1 -- 172.21.15.52:0/1844011847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98102790 msgr2=0x7fbf9819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98102790 0x7fbf9819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf96d9d640 1 -- 172.21.15.52:0/1844011847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9819f6e0 con 0x7fbf98101de0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800d770 tx=0x7fbf8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf8ffff640 1 -- 172.21.15.52:0/1844011847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88017070 con 0x7fbf98101de0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9819f9d0 con 0x7fbf98101de0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf8ffff640 1 -- 172.21.15.52:0/1844011847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf88005500 con 0x7fbf98101de0 2024-09-19T09:25:37.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf8ffff640 1 -- 172.21.15.52:0/1844011847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88004e00 con 0x7fbf98101de0 2024-09-19T09:25:37.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.160+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a72b0 con 0x7fbf98101de0 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.162+0000 7fbf8ffff640 1 -- 172.21.15.52:0/1844011847 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbf88004fa0 con 0x7fbf98101de0 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.162+0000 7fbf9f4fd740 1 Processor -- start 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 -- start start 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 0x562217236140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x562217238a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5622171912e0 con 0x56221722b4a0 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562217138ce0 con 0x562217236680 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56221718d2a0 con 0x56221722bdc0 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39310/0 (socket says 172.21.15.52:39310) 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9759e640 1 -- 172.21.15.52:0/1035478147 learned_addr learned my addr 172.21.15.52:0/1035478147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 0x562217236140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf9659c640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x562217238a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.163+0000 7fbf8ffff640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf8ffff640 1 -- 172.21.15.52:0/1844011847 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbf880cf410 con 0x7fbf98101de0 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 -- 172.21.15.52:0/1035478147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 msgr2=0x562217236140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 0x562217236140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 -- 172.21.15.52:0/1035478147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 msgr2=0x562217238a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x562217238a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 -- 172.21.15.52:0/1035478147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221711d440 con 0x56221722b4a0 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 0x562217236140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbf90012810 tx=0x7fbf90012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d3fdab20167d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf8d7fa640 1 -- 172.21.15.52:0/1035478147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90003d40 con 0x56221722b4a0 2024-09-19T09:25:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf8d7fa640 1 -- 172.21.15.52:0/1035478147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf90004500 con 0x56221722b4a0 2024-09-19T09:25:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.164+0000 7fbf8d7fa640 1 -- 172.21.15.52:0/1035478147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9001c700 con 0x56221722b4a0 2024-09-19T09:25:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1035478147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 msgr2=0x56221722b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9759e640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 0x7fbf840a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf9001f000 tx=0x7fbf9001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbf90012810 tx=0x7fbf90012cd0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1035478147 shutdown_connections 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x562217238a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722bdc0 0x562217236140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1035478147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x56221722b880 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1035478147 >> 172.21.15.52:0/1035478147 conn(0x562217227a30 msgr2=0x562217227e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1035478147 shutdown_connections 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.165+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1035478147 wait complete. 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 -- start start 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 Processor -- start 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x562217233250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 0x562217233790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562217239250 con 0x56221722b4a0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56221714c050 con 0x56221722bdc0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622172393d0 con 0x562217236680 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9f4fd740 10 client.0 _ll_register_callbacks cb 0x56221718c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39320/0 (socket says 172.21.15.52:39320) 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 -- 172.21.15.52:0/2864308885 learned_addr learned my addr 172.21.15.52:0/2864308885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x562217233250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9759e640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 0x562217233790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 -- 172.21.15.52:0/2864308885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 msgr2=0x562217233790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 0x562217233790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 -- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 msgr2=0x562217233250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x562217233250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf96d9d640 1 -- 172.21.15.52:0/2864308885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562216f023c0 con 0x56221722b4a0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9759e640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 0x562217233790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.166+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x562217233250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf880cce90 tx=0x7fbf880048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b043d79b2af365cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88020070 con 0x56221722b4a0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbf880860b0 con 0x56221722b4a0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf90004500 con 0x56221722b4a0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbf880046c0 con 0x56221722b4a0 2024-09-19T09:25:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 10 client.16857 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562217244c20 con 0x56221722b4a0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf90004500 con 0x56221722b4a0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbf8809cce0 con 0x56221722b4a0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 10 client.16857 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 10 client.16857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.167+0000 7fbf9f4fd740 20 client.16857 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172460e0 0x562217248530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf9f4fd740 4 client.16857 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56221719e850 con 0x5622172460e0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172460e0 0x562217248530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172460e0 0x562217248530 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4966f9faeb0a31 server_cookie=c3a8d888f5a00bca in_seq=0 out_seq=0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.168+0000 7fbf7e7fc640 10 client.16857 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/2864308885 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56221719e850 con 0x5622172460e0 2024-09-19T09:25:37.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf7e7fc640 10 client.16857 handle_command_reply: tid=0 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 client.16857 shutdown 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 msgr2=0x562217235fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf880cce90 tx=0x7fbf880048a0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 shutdown_connections 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172460e0 0x562217248530 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf7e7fc640 0 client.16857 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562217236680 0x562217233790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x562217233250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2864308885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722b4a0 0x562217235fa0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 >> 172.21.15.52:0/2864308885 conn(0x562217227a30 msgr2=0x562217226b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 shutdown_connections 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2864308885 wait complete. 2024-09-19T09:25:37.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.169+0000 7fbf9f4fd740 20 client.16857 trim_cache size 0 max 16384 2024-09-19T09:25:37.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.186+0000 7fbf9f4fd740 1 Processor -- start 2024-09-19T09:25:37.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.186+0000 7fbf9f4fd740 1 -- start start 2024-09-19T09:25:37.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x5622172351c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x56221724e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981b2230 con 0x56221722bdc0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981afb00 con 0x562217236680 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981ad950 con 0x56221722b4a0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39328/0 (socket says 172.21.15.52:39328) 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 -- 172.21.15.52:0/2873433769 learned_addr learned my addr 172.21.15.52:0/2873433769 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x5622172351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 -- 172.21.15.52:0/2873433769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 msgr2=0x5622172351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x5622172351c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 -- 172.21.15.52:0/2873433769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 msgr2=0x56221724e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x56221724e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 -- 172.21.15.52:0/2873433769 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221722b2d0 con 0x56221722bdc0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.187+0000 7fbf9659c640 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a930 tx=0x7fbf800058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4f5a5b1e2db42a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf8cff9640 1 -- 172.21.15.52:0/2873433769 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8004a070 con 0x56221722bdc0 2024-09-19T09:25:37.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf8cff9640 1 -- 172.21.15.52:0/2873433769 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf800043b0 con 0x56221722bdc0 2024-09-19T09:25:37.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf8cff9640 1 -- 172.21.15.52:0/2873433769 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80035040 con 0x56221722bdc0 2024-09-19T09:25:37.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2873433769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 msgr2=0x56221724ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a930 tx=0x7fbf800058d0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2873433769 shutdown_connections 2024-09-19T09:25:37.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562217236680 0x56221724e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56221722bdc0 0x56221724ddf0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/2873433769 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x5622172351c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2873433769 >> 172.21.15.52:0/2873433769 conn(0x562217227a30 msgr2=0x562217234ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2873433769 shutdown_connections 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.188+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/2873433769 wait complete. 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 -- start start 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 Processor -- start 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x56221723ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x56221723c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 0x56221723c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981adfc0 con 0x562217236680 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981af430 con 0x56221722bdc0 2024-09-19T09:25:37.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981ae690 con 0x56221722b4a0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9f4fd740 10 client.0 _ll_register_callbacks cb 0x7fbf880056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 0x56221723c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x56221723c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 0x56221723c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39342/0 (socket says 172.21.15.52:39342) 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf9759e640 1 -- 172.21.15.52:0/1688976794 learned_addr learned my addr 172.21.15.52:0/1688976794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.189+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x56221723ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 -- 172.21.15.52:0/1688976794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 msgr2=0x56221723ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x56221723ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 -- 172.21.15.52:0/1688976794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 msgr2=0x56221723c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 0x56221723c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 -- 172.21.15.52:0/1688976794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221723cd80 con 0x56221722bdc0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9659c640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x56221723c030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562217228b20 tx=0x7fbf80004230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef437d10b28c8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:37.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8004a050 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbf80004b90 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf800043b0 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbf8005c020 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9f4fd740 10 client.26219 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.190+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5622172b0d50 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf800043b0 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbf80003860 con 0x56221722bdc0 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 10 client.26219 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 10 client.26219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 20 client.26219 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172b13d0 0x5622172b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 4 client.26219 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:25:37.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562217198d60 con 0x5622172b13d0 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.191+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172b13d0 0x5622172b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf96d9d640 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172b13d0 0x5622172b37f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2401165bf6c232d3 server_cookie=a1f72c484d1e5823 in_seq=0 out_seq=0 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf7e7fc640 10 client.26219 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf7e7fc640 1 -- 172.21.15.52:0/1688976794 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562217198d60 con 0x5622172b13d0 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf7e7fc640 10 client.26219 handle_command_reply: tid=0 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 client.26219 shutdown 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 msgr2=0x56221723c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x56221723c030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x562217228b20 tx=0x7fbf80004230 comp rx=0 tx=0).stop 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 shutdown_connections 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622172b13d0 0x5622172b37f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562217236680 0x56221723c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56221722bdc0 0x56221723c030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf7e7fc640 0 client.26219 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 --2- 172.21.15.52:0/1688976794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56221722b4a0 0x56221723ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 >> 172.21.15.52:0/1688976794 conn(0x562217227a30 msgr2=0x5622172352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 shutdown_connections 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 1 -- 172.21.15.52:0/1688976794 wait complete. 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.192+0000 7fbf9f4fd740 20 client.26219 trim_cache size 0 max 16384 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stdout: "70fc1357-d22c-4bac-9089-6a7ddf61c6bf": { 2024-09-19T09:25:37.198 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "70fc1357-d22c-4bac-9089-6a7ddf61c6bf", 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 msgr2=0x7fbf840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 0x7fbf840a5700 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf9001f000 tx=0x7fbf9001e000 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 msgr2=0x7fbf9819a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800d770 tx=0x7fbf8800dc30 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 shutdown_connections 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbf840a3240 0x7fbf840a5700 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf98106f10 0x7fbf9819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf98102790 0x7fbf9819ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 --2- 172.21.15.52:0/1844011847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf98101de0 0x7fbf9819a730 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 >> 172.21.15.52:0/1844011847 conn(0x7fbf980fd8c0 msgr2=0x7fbf980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 shutdown_connections 2024-09-19T09:25:37.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:37.193+0000 7fbf9d124640 1 -- 172.21.15.52:0/1844011847 wait complete. 2024-09-19T09:25:38.036 INFO:tasks.cephfs.filesystem:scrub status for tag:70fc1357-d22c-4bac-9089-6a7ddf61c6bf - {'path': '/', 'tag': '70fc1357-d22c-4bac-9089-6a7ddf61c6bf', 'options': 'recursive,force'} 2024-09-19T09:25:38.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:38 smithi052 ceph-mon[30947]: pgmap v464: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:25:38.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:38 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:25:38.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:38 smithi169 ceph-mon[35454]: pgmap v464: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:25:38.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:38 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:25:39.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:38 smithi086 ceph-mon[34813]: pgmap v464: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:25:39.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:38 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:25:40.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:40 smithi052 ceph-mon[30947]: pgmap v465: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:25:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:40 smithi169 ceph-mon[35454]: pgmap v465: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:25:41.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:40 smithi086 ceph-mon[34813]: pgmap v465: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T09:25:42.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:42 smithi052 ceph-mon[30947]: pgmap v466: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:25:42.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:42 smithi169 ceph-mon[35454]: pgmap v466: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:25:43.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:42 smithi086 ceph-mon[34813]: pgmap v466: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:25:43.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 -- 172.21.15.52:0/2694324269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 msgr2=0x7f42cc108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 --2- 172.21.15.52:0/2694324269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc108e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009ca0 tx=0x7f42c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 -- 172.21.15.52:0/2694324269 shutdown_connections 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 --2- 172.21.15.52:0/2694324269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc108e80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 --2- 172.21.15.52:0/2694324269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc101c30 0x7f42cc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 --2- 172.21.15.52:0/2694324269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc100a40 0x7f42cc100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 -- 172.21.15.52:0/2694324269 >> 172.21.15.52:0/2694324269 conn(0x7f42cc0fc1e0 msgr2=0x7f42cc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 -- 172.21.15.52:0/2694324269 shutdown_connections 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.595+0000 7f42d28d0640 1 -- 172.21.15.52:0/2694324269 wait complete. 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.596+0000 7f42d28d0640 1 Processor -- start 2024-09-19T09:25:43.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.596+0000 7f42d28d0640 1 -- start start 2024-09-19T09:25:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 0x7f42cc196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc101c30 0x7f42cc1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10c6a0 con 0x7f42cc1025f0 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10c520 con 0x7f42cc100a40 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d28d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10c820 con 0x7f42cc101c30 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52468/0 (socket says 172.21.15.52:52468) 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 -- 172.21.15.52:0/3293931224 learned_addr learned my addr 172.21.15.52:0/3293931224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42cbfff640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 0x7f42cc196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc101c30 0x7f42cc1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 -- 172.21.15.52:0/3293931224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc101c30 msgr2=0x7f42cc1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc101c30 0x7f42cc1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 -- 172.21.15.52:0/3293931224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 msgr2=0x7f42cc196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 0x7f42cc196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.600 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 -- 172.21.15.52:0/3293931224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc19e890 con 0x7f42cc1025f0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42cbfff640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 0x7f42cc196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42d0e6d640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005e30 tx=0x7f42c4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.597+0000 7f42c97fa640 1 -- 172.21.15.52:0/3293931224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4003c30 con 0x7f42cc1025f0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.598+0000 7f42c97fa640 1 -- 172.21.15.52:0/3293931224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c4003dd0 con 0x7f42cc1025f0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.598+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc19eb20 con 0x7f42cc1025f0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.598+0000 7f42c97fa640 1 -- 172.21.15.52:0/3293931224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c402fde0 con 0x7f42cc1025f0 2024-09-19T09:25:43.601 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.598+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc19f070 con 0x7f42cc1025f0 2024-09-19T09:25:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.600+0000 7f42c97fa640 1 -- 172.21.15.52:0/3293931224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42c4004050 con 0x7f42cc1025f0 2024-09-19T09:25:43.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.600+0000 7f42d566c740 1 Processor -- start 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.600+0000 7f42d566c740 1 -- start start 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a68cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a68f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559b2a5eb2f0 con 0x559b2a6879a0 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559b2a593270 con 0x559b2a6882e0 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d566c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b2a5e72b0 con 0x559b2a68d370 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42c97fa640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 0x7f42b40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52480/0 (socket says 172.21.15.52:52480) 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2679702115 learned_addr learned my addr 172.21.15.52:0/2679702115 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:43.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cbfff640 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a68cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42d0e6d640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 0x7f42b40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a68f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42c97fa640 1 -- 172.21.15.52:0/3293931224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42c40f0dc0 con 0x7f42cc1025f0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2679702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 msgr2=0x559b2a68f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a68f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2679702115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 msgr2=0x559b2a68cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a68cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.601+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2679702115 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2a592340 con 0x559b2a6879a0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009fc0 tx=0x7f42c0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3525da6c3bb762ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d0e6d640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 0x7f42b40a57b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42c40bd290 tx=0x7f42c40c1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42b27fc640 1 -- 172.21.15.52:0/2679702115 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0005020 con 0x559b2a6879a0 2024-09-19T09:25:43.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42b27fc640 1 -- 172.21.15.52:0/2679702115 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c00056a0 con 0x559b2a6879a0 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42b27fc640 1 -- 172.21.15.52:0/2679702115 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00106e0 con 0x559b2a6879a0 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 -- 172.21.15.52:0/2679702115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 msgr2=0x559b2a687da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009fc0 tx=0x7f42c0009510 comp rx=0 tx=0).stop 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 -- 172.21.15.52:0/2679702115 shutdown_connections 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a68f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a68cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.602+0000 7f42d566c740 1 --2- 172.21.15.52:0/2679702115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a687da0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 -- 172.21.15.52:0/2679702115 >> 172.21.15.52:0/2679702115 conn(0x559b2a683010 msgr2=0x559b2a683410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 -- 172.21.15.52:0/2679702115 shutdown_connections 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 -- 172.21.15.52:0/2679702115 wait complete. 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 -- start start 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 Processor -- start 2024-09-19T09:25:43.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.603+0000 7f42d566c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a694290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a69b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559b2a6902e0 con 0x559b2a6879a0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559b2a574290 con 0x559b2a6882e0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b2a690460 con 0x559b2a68d370 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 10 client.0 _ll_register_callbacks cb 0x559b2a5a5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52488/0 (socket says 172.21.15.52:52488) 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 -- 172.21.15.52:0/1411341611 learned_addr learned my addr 172.21.15.52:0/1411341611 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cbfff640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a694290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a69b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 -- 172.21.15.52:0/1411341611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 msgr2=0x559b2a69b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a69b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 -- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 msgr2=0x559b2a694290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a694290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 -- 172.21.15.52:0/1411341611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2a2fe210 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009da0 tx=0x7f42c00092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c804eec6592916 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c002a060 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42c0004fc0 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.604+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c00056a0 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42c00051c0 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 10 client.16875 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b2a3ca620 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c00056a0 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42c0022040 con 0x559b2a6879a0 2024-09-19T09:25:43.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 10 client.16875 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 20 client.16875 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a69f790 0x559b2a6a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 4 client.16875 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.605+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2a5f8a20 con 0x559b2a69f790 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.606+0000 7f42cbfff640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a69f790 0x559b2a6a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.606+0000 7f42cbfff640 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a69f790 0x559b2a6a1b80 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51b1e1b2a3eaef7e server_cookie=40fd67bbf55637f5 in_seq=0 out_seq=0 2024-09-19T09:25:43.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.606+0000 7f42ab7fe640 10 client.16875 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42ab7fe640 1 -- 172.21.15.52:0/1411341611 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b2a5f8a20 con 0x559b2a69f790 2024-09-19T09:25:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42ab7fe640 10 client.16875 handle_command_reply: tid=0 2024-09-19T09:25:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 client.16875 shutdown 2024-09-19T09:25:43.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 msgr2=0x559b2a693d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009da0 tx=0x7f42c00092a0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 shutdown_connections 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a69f790 0x559b2a6a1b80 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a68d370 0x559b2a69b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a694290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42ab7fe640 0 client.16875 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 --2- 172.21.15.52:0/1411341611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a693d50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 >> 172.21.15.52:0/1411341611 conn(0x559b2a683010 msgr2=0x559b2a684820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 shutdown_connections 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 1 -- 172.21.15.52:0/1411341611 wait complete. 2024-09-19T09:25:43.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.607+0000 7f42d566c740 20 client.16875 trim_cache size 0 max 16384 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 Processor -- start 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 -- start start 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6879a0 0x559b2a694320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a69b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a97f0 con 0x559b2a68d370 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a70c0 con 0x559b2a6882e0 2024-09-19T09:25:43.629 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42d566c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a4f10 con 0x559b2a6879a0 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52496/0 (socket says 172.21.15.52:52496) 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 -- 172.21.15.52:0/896950234 learned_addr learned my addr 172.21.15.52:0/896950234 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cbfff640 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a69b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 -- 172.21.15.52:0/896950234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6879a0 msgr2=0x559b2a694320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6879a0 0x559b2a694320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 -- 172.21.15.52:0/896950234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 msgr2=0x559b2a69b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a69b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.622+0000 7f42cb7fe640 1 -- 172.21.15.52:0/896950234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2a6a1ef0 con 0x559b2a68d370 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f42c00096c0 tx=0x7f42c00055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68684ab18c601f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42b1ffb640 1 -- 172.21.15.52:0/896950234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c002a040 con 0x559b2a68d370 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42b1ffb640 1 -- 172.21.15.52:0/896950234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c00048d0 con 0x559b2a68d370 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42b1ffb640 1 -- 172.21.15.52:0/896950234 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0004ec0 con 0x559b2a68d370 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 -- 172.21.15.52:0/896950234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 msgr2=0x559b2a6846b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f42c00096c0 tx=0x7f42c00055d0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 -- 172.21.15.52:0/896950234 shutdown_connections 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a68d370 0x559b2a6846b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a6882e0 0x559b2a69b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 --2- 172.21.15.52:0/896950234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6879a0 0x559b2a694320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.623+0000 7f42d566c740 1 -- 172.21.15.52:0/896950234 >> 172.21.15.52:0/896950234 conn(0x559b2a683010 msgr2=0x559b2a683fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- 172.21.15.52:0/896950234 shutdown_connections 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- 172.21.15.52:0/896950234 wait complete. 2024-09-19T09:25:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- start start 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 Processor -- start 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6882e0 0x559b2a698ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a68d370 0x559b2a699ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a5580 con 0x559b2a6879a0 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a69f0 con 0x559b2a68d370 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1a5c50 con 0x559b2a6882e0 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42d566c740 10 client.0 _ll_register_callbacks cb 0x7f42bc009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52498/0 (socket says 172.21.15.52:52498) 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.624+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2668939715 learned_addr learned my addr 172.21.15.52:0/2668939715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cbfff640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6882e0 0x559b2a698ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2668939715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6882e0 msgr2=0x559b2a698ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6882e0 0x559b2a698ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a68d370 msgr2=0x559b2a699ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a68d370 0x559b2a699ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 -- 172.21.15.52:0/2668939715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2a69a0d0 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42cb7fe640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f42c0028040 tx=0x7f42c0024ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c0c48a70866be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c002a040 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42c0004df0 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c00048d0 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42c0005010 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42d566c740 10 client.16881 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.625+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b2a69b3e0 con 0x559b2a6879a0 2024-09-19T09:25:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42c00048d0 con 0x559b2a6879a0 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42c000c030 con 0x559b2a6879a0 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 10 client.16881 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 20 client.16881 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a70a970 0x559b2a70cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 4 client.16881 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b2a5f2d70 con 0x559b2a70a970 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42cbfff640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a70a970 0x559b2a70cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42ab7fe640 10 client.16881 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:43.634 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.626+0000 7f42cbfff640 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a70a970 0x559b2a70cd90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10597bda843eef15 server_cookie=c2121176d82c074f in_seq=0 out_seq=0 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.635+0000 7f42ab7fe640 1 -- 172.21.15.52:0/2668939715 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b2a5f2d70 con 0x559b2a70a970 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.635+0000 7f42ab7fe640 10 client.16881 handle_command_reply: tid=0 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.635+0000 7f42d566c740 1 client.16881 shutdown 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 msgr2=0x559b2a698570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f42c0028040 tx=0x7f42c0024ed0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 shutdown_connections 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b2a70a970 0x559b2a70cd90 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b2a68d370 0x559b2a699ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b2a6882e0 0x559b2a698ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42ab7fe640 0 client.16881 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 --2- 172.21.15.52:0/2668939715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b2a6879a0 0x559b2a698570 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.637 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 >> 172.21.15.52:0/2668939715 conn(0x559b2a683010 msgr2=0x559b2a683ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 shutdown_connections 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 1 -- 172.21.15.52:0/2668939715 wait complete. 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d566c740 20 client.16881 trim_cache size 0 max 16384 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:25:43.638 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 msgr2=0x7f42b40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 0x7f42b40a57b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f42c40bd290 tx=0x7f42c40c1040 comp rx=0 tx=0).stop 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 msgr2=0x7f42cc19e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.636+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005e30 tx=0x7f42c4031ee0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 shutdown_connections 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42cc1025f0 0x7f42cc19e1f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.639 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42b40a32f0 0x7f42b40a57b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42cc101c30 0x7f42cc1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 --2- 172.21.15.52:0/3293931224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42cc100a40 0x7f42cc196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 >> 172.21.15.52:0/3293931224 conn(0x7f42cc0fc1e0 msgr2=0x7f42cc104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 shutdown_connections 2024-09-19T09:25:43.640 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:43.637+0000 7f42d28d0640 1 -- 172.21.15.52:0/3293931224 wait complete. 2024-09-19T09:25:44.810 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:44 smithi086 ceph-mon[34813]: pgmap v467: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:25:44.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:44 smithi052 ceph-mon[30947]: pgmap v467: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:25:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:44 smithi169 ceph-mon[35454]: pgmap v467: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-19T09:25:45.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:45.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 -- 172.21.15.52:0/69386924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 msgr2=0x7fbdac10df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:46.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 --2- 172.21.15.52:0/69386924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac10df00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009900 tx=0x7fbda002a480 comp rx=0 tx=0).stop 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 -- 172.21.15.52:0/69386924 shutdown_connections 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 --2- 172.21.15.52:0/69386924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 0x7fbdac110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 --2- 172.21.15.52:0/69386924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac10df00 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 --2- 172.21.15.52:0/69386924 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 -- 172.21.15.52:0/69386924 >> 172.21.15.52:0/69386924 conn(0x7fbdac0fd8e0 msgr2=0x7fbdac0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 -- 172.21.15.52:0/69386924 shutdown_connections 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 -- 172.21.15.52:0/69386924 wait complete. 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.927+0000 7fbdb254d640 1 Processor -- start 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 -- start start 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:46.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 0x7fbdac19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac114160 con 0x7fbdac074e30 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac113fe0 con 0x7fbdac10e440 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb254d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac1142e0 con 0x7fbdac074510 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52520/0 (socket says 172.21.15.52:52520) 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 -- 172.21.15.52:0/3192594735 learned_addr learned my addr 172.21.15.52:0/3192594735 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdb0aea640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 0x7fbdac19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdabfff640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 -- 172.21.15.52:0/3192594735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 msgr2=0x7fbdac19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 -- 172.21.15.52:0/3192594735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 msgr2=0x7fbdac19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:46.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 0x7fbdac19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdab7fe640 1 -- 172.21.15.52:0/3192594735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac19f6f0 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.928+0000 7fbdabfff640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbdab7fe640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda003f030 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac19f980 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbda0003ce0 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0035070 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.929+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac1a72c0 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.930+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac0748f0 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.931+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbda0042030 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.932+0000 7fbda97fa640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 0x7fbd940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.932+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbda00f02b0 con 0x7fbdac074e30 2024-09-19T09:25:46.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.932+0000 7fbdabfff640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 0x7fbd940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:46.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.932+0000 7fbdabfff640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 0x7fbd940a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009b40 tx=0x7fbd9c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:46.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:45.935+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbda00bd010 con 0x7fbdac074e30 2024-09-19T09:25:46.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.151+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdac1095c0 con 0x7fbdac074e30 2024-09-19T09:25:46.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.152+0000 7fbda97fa640 1 -- 172.21.15.52:0/3192594735 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fbda00bc910 con 0x7fbdac074e30 2024-09-19T09:25:46.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:25:46.420 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.154+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 msgr2=0x7fbd940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.154+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 0x7fbd940a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009b40 tx=0x7fbd9c005e50 comp rx=0 tx=0).stop 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 msgr2=0x7fbdac19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fbda0006010 tx=0x7fbda00042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 shutdown_connections 2024-09-19T09:25:46.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdac10e440 0x7fbdac19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdac074e30 0x7fbdac19ac80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd940a3240 0x7fbd940a5700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 --2- 172.21.15.52:0/3192594735 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdac074510 0x7fbdac19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 >> 172.21.15.52:0/3192594735 conn(0x7fbdac0fd8e0 msgr2=0x7fbdac0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 shutdown_connections 2024-09-19T09:25:46.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:46.155+0000 7fbdb254d640 1 -- 172.21.15.52:0/3192594735 wait complete. 2024-09-19T09:25:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:46 smithi052 ceph-mon[30947]: pgmap v468: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:25:46.838 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:46 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3192594735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:46.872 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 962788b6 --release --await' 2024-09-19T09:25:46.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 962788b6 --release --await 2024-09-19T09:25:46.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:46 smithi169 ceph-mon[35454]: pgmap v468: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:25:46.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:46 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3192594735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:47.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:46 smithi086 ceph-mon[34813]: pgmap v468: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:25:47.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:46 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3192594735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:47.136 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:47.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.598+0000 7fe3c9630640 1 -- 172.21.15.52:0/3307965822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 msgr2=0x7fe3c41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3307965822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c41031c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009900 tx=0x7fe3b402a480 comp rx=0 tx=0).stop 2024-09-19T09:25:47.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 -- 172.21.15.52:0/3307965822 shutdown_connections 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3307965822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c410c180 0x7fe3c410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3307965822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c4103700 0x7fe3c410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3307965822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c41031c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 -- 172.21.15.52:0/3307965822 >> 172.21.15.52:0/3307965822 conn(0x7fe3c40fc7a0 msgr2=0x7fe3c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 -- 172.21.15.52:0/3307965822 shutdown_connections 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 -- 172.21.15.52:0/3307965822 wait complete. 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.599+0000 7fe3c9630640 1 Processor -- start 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 -- start start 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c4103700 0x7fe3c4100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c410c180 0x7fe3c41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4111f30 con 0x7fe3c4102de0 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c4111db0 con 0x7fe3c410c180 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c9630640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41120b0 con 0x7fe3c4103700 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52536/0 (socket says 172.21.15.52:52536) 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 -- 172.21.15.52:0/3645622699 learned_addr learned my addr 172.21.15.52:0/3645622699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c410c180 0x7fe3c41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c4103700 0x7fe3c4100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 -- 172.21.15.52:0/3645622699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c4103700 msgr2=0x7fe3c4100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c4103700 0x7fe3c4100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 -- 172.21.15.52:0/3645622699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c410c180 msgr2=0x7fe3c41014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c410c180 0x7fe3c41014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.600+0000 7fe3c2ffd640 1 -- 172.21.15.52:0/3645622699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41a6890 con 0x7fe3c4102de0 2024-09-19T09:25:47.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4005ab0 tx=0x7fe3b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3abfff640 1 -- 172.21.15.52:0/3645622699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b403f030 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3abfff640 1 -- 172.21.15.52:0/3645622699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b4003ce0 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3abfff640 1 -- 172.21.15.52:0/3645622699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4035070 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41a6b20 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.601+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41a7050 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.603+0000 7fe3abfff640 1 -- 172.21.15.52:0/3645622699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe3b4042030 con 0x7fe3c4102de0 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.603+0000 7fe3cba09740 1 Processor -- start 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.603+0000 7fe3cba09740 1 -- start start 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 0x55dca79f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79f4240 0x55dca79f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dca794e620 con 0x55dca79e9060 2024-09-19T09:25:47.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dca78f5e50 con 0x55dca79e9980 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3cba09740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dca794a5e0 con 0x55dca79f4240 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3abfff640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 0x7fe3ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52540/0 (socket says 172.21.15.52:52540) 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 -- 172.21.15.52:0/3058879806 learned_addr learned my addr 172.21.15.52:0/3058879806 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 0x7fe3ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3abfff640 1 -- 172.21.15.52:0/3645622699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3b40f01e0 con 0x7fe3c4102de0 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 0x55dca79f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79f4240 0x55dca79f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 -- 172.21.15.52:0/3058879806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79f4240 msgr2=0x55dca79f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79f4240 0x55dca79f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 -- 172.21.15.52:0/3058879806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 msgr2=0x55dca79f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 0x55dca79f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c37fe640 1 -- 172.21.15.52:0/3058879806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca78e6d40 con 0x55dca79e9060 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.604+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 0x55dca79f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005cc0 tx=0x7fe3bc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de168fc3be3999 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 0x7fe3ac0a5780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc011cb0 tx=0x7fe3bc016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3a97fa640 1 -- 172.21.15.52:0/3058879806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc024070 con 0x55dca79e9060 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3a97fa640 1 -- 172.21.15.52:0/3058879806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3bc00ac90 con 0x55dca79e9060 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3a97fa640 1 -- 172.21.15.52:0/3058879806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc020460 con 0x55dca79e9060 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3cba09740 1 -- 172.21.15.52:0/3058879806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 msgr2=0x55dca79e9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3cba09740 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc005cc0 tx=0x7fe3bc0117b0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.605+0000 7fe3cba09740 1 -- 172.21.15.52:0/3058879806 shutdown_connections 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79f4240 0x55dca79f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9980 0x55dca79f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- 172.21.15.52:0/3058879806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9060 0x55dca79e9440 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- 172.21.15.52:0/3058879806 >> 172.21.15.52:0/3058879806 conn(0x55dca79e55f0 msgr2=0x55dca79e59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- 172.21.15.52:0/3058879806 shutdown_connections 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- 172.21.15.52:0/3058879806 wait complete. 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- start start 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 Processor -- start 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dca79f6e10 con 0x55dca79f4240 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dca78d6f10 con 0x55dca79e9060 2024-09-19T09:25:47.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dca79f6f90 con 0x55dca79e9980 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3cba09740 10 client.0 _ll_register_callbacks cb 0x55dca78fadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52550/0 (socket says 172.21.15.52:52550) 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3c37fe640 1 -- 172.21.15.52:0/2269572801 learned_addr learned my addr 172.21.15.52:0/2269572801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.606+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 -- 172.21.15.52:0/2269572801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 msgr2=0x55dca79f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 -- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 msgr2=0x55dca79f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 -- 172.21.15.52:0/2269572801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca765d580 con 0x55dca79f4240 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:47.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00a340 tx=0x7fe3bc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf10a735606d149 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc02f070 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3bc004d00 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3bc00ac90 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe3bc038030 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3cba09740 10 client.16899 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.607+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dca7727960 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3bc00ac90 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe3bc020bc0 con 0x55dca79f4240 2024-09-19T09:25:47.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 10 client.16899 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 10 client.16899 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 20 client.16899 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a03d30 0x55dca7a06120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 4 client.16899 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dca795bb90 con 0x55dca7a03d30 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a03d30 0x55dca7a06120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.608+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a03d30 0x55dca7a06120 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f52c3ac080f4e27 server_cookie=85b4a3a295f5c92a in_seq=0 out_seq=0 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3a6ff5640 10 client.16899 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/2269572801 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dca795bb90 con 0x55dca7a03d30 2024-09-19T09:25:47.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3a6ff5640 10 client.16899 handle_command_reply: tid=0 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 client.16899 shutdown 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 msgr2=0x55dca79f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00a340 tx=0x7fe3bc00ce00 comp rx=0 tx=0).stop 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 shutdown_connections 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a03d30 0x55dca7a06120 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca79f1be0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 --2- 172.21.15.52:0/2269572801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3a6ff5640 0 client.16899 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.609+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 >> 172.21.15.52:0/2269572801 conn(0x55dca79e55f0 msgr2=0x55dca79e4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.610+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 shutdown_connections 2024-09-19T09:25:47.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.610+0000 7fe3cba09740 1 -- 172.21.15.52:0/2269572801 wait complete. 2024-09-19T09:25:47.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.610+0000 7fe3cba09740 20 client.16899 trim_cache size 0 max 16384 2024-09-19T09:25:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 Processor -- start 2024-09-19T09:25:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 -- start start 2024-09-19T09:25:47.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9060 0x55dca79ebac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79f4240 0x55dca7a0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41b21c0 con 0x55dca79e9980 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41afa90 con 0x55dca79f4240 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3cba09740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41ad8e0 con 0x55dca79e9060 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52566/0 (socket says 172.21.15.52:52566) 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 -- 172.21.15.52:0/4270562885 learned_addr learned my addr 172.21.15.52:0/4270562885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79f4240 0x55dca7a0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9060 0x55dca79ebac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 -- 172.21.15.52:0/4270562885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9060 msgr2=0x55dca79ebac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9060 0x55dca79ebac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 -- 172.21.15.52:0/4270562885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79f4240 msgr2=0x55dca7a0b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79f4240 0x55dca7a0b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.627+0000 7fe3c27fc640 1 -- 172.21.15.52:0/4270562885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca79e97b0 con 0x55dca79e9980 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ac10 tx=0x7fe3b8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927c78c009c7894d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3a8ff9640 1 -- 172.21.15.52:0/4270562885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b8005020 con 0x55dca79e9980 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3a8ff9640 1 -- 172.21.15.52:0/4270562885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b80047a0 con 0x55dca79e9980 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3a8ff9640 1 -- 172.21.15.52:0/4270562885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b800f770 con 0x55dca79e9980 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 -- 172.21.15.52:0/4270562885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 msgr2=0x55dca79e4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe3b800ac10 tx=0x7fe3b8012820 comp rx=0 tx=0).stop 2024-09-19T09:25:47.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 -- 172.21.15.52:0/4270562885 shutdown_connections 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79f4240 0x55dca7a0b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79e9980 0x55dca79e4640 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 --2- 172.21.15.52:0/4270562885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9060 0x55dca79ebac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.628+0000 7fe3cba09740 1 -- 172.21.15.52:0/4270562885 >> 172.21.15.52:0/4270562885 conn(0x55dca79e55f0 msgr2=0x55dca79e3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- 172.21.15.52:0/4270562885 shutdown_connections 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- 172.21.15.52:0/4270562885 wait complete. 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- start start 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 Processor -- start 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41adf50 con 0x55dca79f4240 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41af3c0 con 0x55dca79e9060 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c41ae620 con 0x55dca79e9980 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3cba09740 10 client.0 _ll_register_callbacks cb 0x7fe3bc014b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52578/0 (socket says 172.21.15.52:52578) 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3c37fe640 1 -- 172.21.15.52:0/1352341444 learned_addr learned my addr 172.21.15.52:0/1352341444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.629+0000 7fe3c27fc640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 -- 172.21.15.52:0/1352341444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 msgr2=0x55dca79f8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 -- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 msgr2=0x55dca79f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 -- 172.21.15.52:0/1352341444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca7a6dd20 con 0x55dca79f4240 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3c37fe640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ab60 tx=0x7fe3bc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5112962b723904d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3a6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:47.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc02f040 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3bc003b80 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3b80047a0 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe3bc04c020 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3cba09740 10 client.16905 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.630+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dca7a6efc0 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3b80047a0 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe3bc0207f0 con 0x55dca79f4240 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 10 client.16905 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:47.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 10 client.16905 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 20 client.16905 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a6f630 0x55dca7a71a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 4 client.16905 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "962788b6", "release": true, "await": true}] 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "962788b6", "release": true, "await": true}) -- 0x55dca79e0950 con 0x55dca7a6f630 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a6f630 0x55dca7a71a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3c2ffd640 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a6f630 0x55dca7a71a50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e7c6e52fc6dc482 server_cookie=14c3974216f0d607 in_seq=0 out_seq=0 2024-09-19T09:25:47.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.631+0000 7fe3a6ff5640 10 client.16905 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3a6ff5640 1 -- 172.21.15.52:0/1352341444 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55dca79e0950 con 0x55dca7a6f630 2024-09-19T09:25:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3a6ff5640 10 client.16905 handle_command_reply: tid=0 2024-09-19T09:25:47.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 client.16905 shutdown 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 msgr2=0x55dca7a6d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00ab60 tx=0x7fe3bc00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 shutdown_connections 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dca7a6f630 0x55dca7a71a50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dca79f4240 0x55dca7a6d7e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dca79e9980 0x55dca79f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3a6ff5640 0 client.16905 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 --2- 172.21.15.52:0/1352341444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dca79e9060 0x55dca79f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 >> 172.21.15.52:0/1352341444 conn(0x55dca79e55f0 msgr2=0x55dca79f18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 shutdown_connections 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 1 -- 172.21.15.52:0/1352341444 wait complete. 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.634+0000 7fe3cba09740 20 client.16905 trim_cache size 0 max 16384 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 20, 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "962788b6": { 2024-09-19T09:25:47.643 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 20, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.8, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:25:47.644 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:47.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 msgr2=0x7fe3ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 0x7fe3ac0a5780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc011cb0 tx=0x7fe3bc016000 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 msgr2=0x7fe3c4100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4005ab0 tx=0x7fe3b40042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 shutdown_connections 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c410c180 0x7fe3c41014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe3ac0a32c0 0x7fe3ac0a5780 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3c4103700 0x7fe3c4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 --2- 172.21.15.52:0/3645622699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3c4102de0 0x7fe3c4100a40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 >> 172.21.15.52:0/3645622699 conn(0x7fe3c40fc7a0 msgr2=0x7fe3c40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 shutdown_connections 2024-09-19T09:25:47.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:47.635+0000 7fe3c9630640 1 -- 172.21.15.52:0/3645622699 wait complete. 2024-09-19T09:25:48.470 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '962788b6', total seconds elapsed: 33.1 2024-09-19T09:25:48.470 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:25:48.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:48.733 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:48.854 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:48 smithi052 ceph-mon[30947]: pgmap v469: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:25:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:48 smithi169 ceph-mon[35454]: pgmap v469: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:25:49.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:48 smithi086 ceph-mon[34813]: pgmap v469: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 -- 172.21.15.52:0/4132562340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 msgr2=0x7fd04c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 --2- 172.21.15.52:0/4132562340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c101200 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd048009900 tx=0x7fd04802a480 comp rx=0 tx=0).stop 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 -- 172.21.15.52:0/4132562340 shutdown_connections 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 --2- 172.21.15.52:0/4132562340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102ef0 0x7fd04c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 --2- 172.21.15.52:0/4132562340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd04c102570 0x7fd04c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 --2- 172.21.15.52:0/4132562340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c101200 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 -- 172.21.15.52:0/4132562340 >> 172.21.15.52:0/4132562340 conn(0x7fd04c0fc7d0 msgr2=0x7fd04c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:49.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 -- 172.21.15.52:0/4132562340 shutdown_connections 2024-09-19T09:25:49.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.232+0000 7fd054545640 1 -- 172.21.15.52:0/4132562340 wait complete. 2024-09-19T09:25:49.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 Processor -- start 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 -- start start 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102570 0x7fd04c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd04c102ef0 0x7fd04c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c110fa0 con 0x7fd04c100e20 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c110e20 con 0x7fd04c102570 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd054545640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c111120 con 0x7fd04c102ef0 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49980/0 (socket says 172.21.15.52:49980) 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 -- 172.21.15.52:0/729063363 learned_addr learned my addr 172.21.15.52:0/729063363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd051ae0640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102570 0x7fd04c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 -- 172.21.15.52:0/729063363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd04c102ef0 msgr2=0x7fd04c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:49.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd04c102ef0 0x7fd04c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 -- 172.21.15.52:0/729063363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102570 msgr2=0x7fd04c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102570 0x7fd04c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.233+0000 7fd0522e1640 1 -- 172.21.15.52:0/729063363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c19d4e0 con 0x7fd04c100e20 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd0522e1640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd048003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04803f070 con 0x7fd04c100e20 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048031c30 con 0x7fd04c100e20 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c19d770 con 0x7fd04c100e20 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048035030 con 0x7fd04c100e20 2024-09-19T09:25:49.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.234+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c1a50b0 con 0x7fd04c100e20 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.235+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c101200 con 0x7fd04c100e20 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.236+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd048042070 con 0x7fd04c100e20 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.237+0000 7fd0437fe640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 0x7fd0380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.237+0000 7fd051ae0640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 0x7fd0380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.237+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd0480f01b0 con 0x7fd04c100e20 2024-09-19T09:25:49.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.237+0000 7fd051ae0640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 0x7fd0380a5700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd04c100010 tx=0x7fd03c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:49.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.241+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0480bcdf0 con 0x7fd04c100e20 2024-09-19T09:25:49.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.454+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd04c10a0a0 con 0x7fd04c100e20 2024-09-19T09:25:49.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.455+0000 7fd0437fe640 1 -- 172.21.15.52:0/729063363 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fd048031de0 con 0x7fd04c100e20 2024-09-19T09:25:49.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:25:49.456 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:25:49.456 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 msgr2=0x7fd0380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 0x7fd0380a5700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd04c100010 tx=0x7fd03c009110 comp rx=0 tx=0).stop 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 msgr2=0x7fd04c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd048006010 tx=0x7fd048003c10 comp rx=0 tx=0).stop 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 shutdown_connections 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0380a3240 0x7fd0380a5700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd04c102ef0 0x7fd04c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd04c102570 0x7fd04c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 --2- 172.21.15.52:0/729063363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd04c100e20 0x7fd04c198530 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 >> 172.21.15.52:0/729063363 conn(0x7fd04c0fc7d0 msgr2=0x7fd04c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.457+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 shutdown_connections 2024-09-19T09:25:49.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:49.458+0000 7fd054545640 1 -- 172.21.15.52:0/729063363 wait complete. 2024-09-19T09:25:49.876 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:49 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/729063363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:49.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:49 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/729063363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:50.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:49 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/729063363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:50.218 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:25:50.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:25:50.477 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:50.788 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:50 smithi052 ceph-mon[30947]: pgmap v470: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:25:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:50 smithi169 ceph-mon[35454]: pgmap v470: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:25:51.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 -- 172.21.15.52:0/3391535153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c102ef0 msgr2=0x7f584c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 --2- 172.21.15.52:0/3391535153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c102ef0 0x7f584c10da40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5844009ca0 tx=0x7f584402a950 comp rx=0 tx=0).stop 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 -- 172.21.15.52:0/3391535153 shutdown_connections 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 --2- 172.21.15.52:0/3391535153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c102ef0 0x7f584c10da40 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 --2- 172.21.15.52:0/3391535153 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102570 0x7f584c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 --2- 172.21.15.52:0/3391535153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c100e20 0x7f584c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 -- 172.21.15.52:0/3391535153 >> 172.21.15.52:0/3391535153 conn(0x7f584c0fc7d0 msgr2=0x7f584c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 -- 172.21.15.52:0/3391535153 shutdown_connections 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 -- 172.21.15.52:0/3391535153 wait complete. 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.983+0000 7f585313a640 1 Processor -- start 2024-09-19T09:25:51.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 -- start start 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c102570 0x7f584c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 0x7f584c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f584c110fc0 con 0x7f584c100e20 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f584c110e40 con 0x7f584c102570 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f585313a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f584c111140 con 0x7f584c102ef0 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49996/0 (socket says 172.21.15.52:49996) 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 -- 172.21.15.52:0/1517600426 learned_addr learned my addr 172.21.15.52:0/1517600426 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f584bfff640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c102570 0x7f584c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f58516d7640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 0x7f584c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 -- 172.21.15.52:0/1517600426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 msgr2=0x7f584c1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 0x7f584c1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 -- 172.21.15.52:0/1517600426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c102570 msgr2=0x7f584c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c102570 0x7f584c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f5850ed6640 1 -- 172.21.15.52:0/1517600426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c1a4910 con 0x7f584c100e20 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.984+0000 7f58516d7640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 0x7f584c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f5850ed6640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f583c00b4a0 tx=0x7f583c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f5849ffb640 1 -- 172.21.15.52:0/1517600426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c014070 con 0x7f584c100e20 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f5849ffb640 1 -- 172.21.15.52:0/1517600426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c010af0 con 0x7f584c100e20 2024-09-19T09:25:51.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f584c1a4ae0 con 0x7f584c100e20 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f5849ffb640 1 -- 172.21.15.52:0/1517600426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c017d10 con 0x7f584c100e20 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.985+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f584c1a4ff0 con 0x7f584c100e20 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.987+0000 7f5849ffb640 1 -- 172.21.15.52:0/1517600426 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f583c017070 con 0x7f584c100e20 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.987+0000 7f5855513740 1 Processor -- start 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.987+0000 7f5855513740 1 -- start start 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b003760 0x56415b003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b00e940 0x56415b010d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56415af692a0 con 0x56415b004080 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56415af10b10 con 0x56415b003760 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5855513740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56415af65260 con 0x56415b00e940 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5849ffb640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 0x7f58340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50002/0 (socket says 172.21.15.52:50002) 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 -- 172.21.15.52:0/3948339997 learned_addr learned my addr 172.21.15.52:0/3948339997 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f58516d7640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 0x7f58340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f584bfff640 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b00e940 0x56415b010d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f58516d7640 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b003760 0x56415b003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5849ffb640 1 -- 172.21.15.52:0/1517600426 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f583c0ced00 con 0x7f584c100e20 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 -- 172.21.15.52:0/3948339997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b00e940 msgr2=0x56415b010d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b00e940 0x56415b010d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 -- 172.21.15.52:0/3948339997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b003760 msgr2=0x56415b003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b003760 0x56415b003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 -- 172.21.15.52:0/3948339997 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415acdab90 con 0x56415b004080 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f583c0a39e0 tx=0x7f583c009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c684982f3c49dd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.988+0000 7f58516d7640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 0x7f58340a5700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5844005e30 tx=0x7f584402fb80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5832ffd640 1 -- 172.21.15.52:0/3948339997 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c01e050 con 0x56415b004080 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5832ffd640 1 -- 172.21.15.52:0/3948339997 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c0b9ee0 con 0x56415b004080 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5832ffd640 1 -- 172.21.15.52:0/3948339997 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c017360 con 0x56415b004080 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 -- 172.21.15.52:0/3948339997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 msgr2=0x56415b00e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f583c0a39e0 tx=0x7f583c009390 comp rx=0 tx=0).stop 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 -- 172.21.15.52:0/3948339997 shutdown_connections 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b00e940 0x56415b010d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b004080 0x56415b00e400 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 --2- 172.21.15.52:0/3948339997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b003760 0x56415b003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.989+0000 7f5855513740 1 -- 172.21.15.52:0/3948339997 >> 172.21.15.52:0/3948339997 conn(0x56415afffcf0 msgr2=0x56415b0000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 -- 172.21.15.52:0/3948339997 shutdown_connections 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 -- 172.21.15.52:0/3948339997 wait complete. 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 -- start start 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 Processor -- start 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b003760 0x56415b00b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 0x56415b00be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.990+0000 7f5855513740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56415b0114b0 con 0x56415b00e940 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f5855513740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56415aef16e0 con 0x56415b004080 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f5855513740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56415b011630 con 0x56415b003760 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f5855513740 10 client.0 _ll_register_callbacks cb 0x56415af15a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50008/0 (socket says 172.21.15.52:50008) 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 -- 172.21.15.52:0/3272505133 learned_addr learned my addr 172.21.15.52:0/3272505133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f584bfff640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 0x56415b00be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b003760 0x56415b00b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 -- 172.21.15.52:0/3272505133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b003760 msgr2=0x56415b00b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b003760 0x56415b00b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 -- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 msgr2=0x56415b00be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 0x56415b00be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 -- 172.21.15.52:0/3272505133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415b01aab0 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f584bfff640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 0x56415b00be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f58516d7640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f58440098f0 tx=0x7f5844045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e57e57a200fc69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f582bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5844034040 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5844003cc0 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.991+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f583c0b9ee0 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5844058020 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 10 client.16923 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56415b01d3e0 con 0x56415b00e940 2024-09-19T09:25:51.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c0b9ee0 con 0x56415b00e940 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58440497a0 con 0x56415b00e940 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 10 client.16923 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 10 client.16923 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 20 client.16923 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b01e8f0 0x56415b020d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 4 client.16923 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56415af769d0 con 0x56415b01e8f0 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.992+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b01e8f0 0x56415b020d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f582bfff640 10 client.16923 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b01e8f0 0x56415b020d50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9a892262db1b26 server_cookie=853dd240a6781c5c in_seq=0 out_seq=0 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f582bfff640 1 -- 172.21.15.52:0/3272505133 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56415af769d0 con 0x56415b01e8f0 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f582bfff640 10 client.16923 handle_command_reply: tid=0 2024-09-19T09:25:51.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f5855513740 1 client.16923 shutdown 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 msgr2=0x56415b00c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.993+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f58440098f0 tx=0x7f5844045000 comp rx=0 tx=0).stop 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 shutdown_connections 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b01e8f0 0x56415b020d50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b00e940 0x56415b00c340 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b004080 0x56415b00be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f582bfff640 0 client.16923 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 --2- 172.21.15.52:0/3272505133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b003760 0x56415b00b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 >> 172.21.15.52:0/3272505133 conn(0x56415afffcf0 msgr2=0x56415b005a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 shutdown_connections 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 1 -- 172.21.15.52:0/3272505133 wait complete. 2024-09-19T09:25:51.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:50.994+0000 7f5855513740 20 client.16923 trim_cache size 0 max 16384 2024-09-19T09:25:51.013 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:50 smithi086 ceph-mon[34813]: pgmap v470: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:25:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.011+0000 7f5855513740 1 Processor -- start 2024-09-19T09:25:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.011+0000 7f5855513740 1 -- start start 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415affed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b026620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1b0170 con 0x56415b003760 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1ada40 con 0x56415b00e940 2024-09-19T09:25:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5855513740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1ab890 con 0x56415b004080 2024-09-19T09:25:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50024/0 (socket says 172.21.15.52:50024) 2024-09-19T09:25:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 -- 172.21.15.52:0/726066793 learned_addr learned my addr 172.21.15.52:0/726066793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f584bfff640 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415affed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 -- 172.21.15.52:0/726066793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 msgr2=0x56415affed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415affed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 -- 172.21.15.52:0/726066793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 msgr2=0x56415b026620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b026620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 -- 172.21.15.52:0/726066793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56415b003590 con 0x56415b003760 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f584bfff640 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415affed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:51.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f5850ed6640 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f583c00be60 tx=0x7f583c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff0e461e0828985 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.012+0000 7f58327fc640 1 -- 172.21.15.52:0/726066793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c01e040 con 0x56415b003760 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f58327fc640 1 -- 172.21.15.52:0/726066793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c017360 con 0x56415b003760 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f58327fc640 1 -- 172.21.15.52:0/726066793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c0841b0 con 0x56415b003760 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 -- 172.21.15.52:0/726066793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 msgr2=0x56415b006210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f583c00be60 tx=0x7f583c00bf90 comp rx=0 tx=0).stop 2024-09-19T09:25:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 -- 172.21.15.52:0/726066793 shutdown_connections 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b026620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415affed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 --2- 172.21.15.52:0/726066793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b006210 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 -- 172.21.15.52:0/726066793 >> 172.21.15.52:0/726066793 conn(0x56415afffcf0 msgr2=0x56415affe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 -- 172.21.15.52:0/726066793 shutdown_connections 2024-09-19T09:25:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.013+0000 7f5855513740 1 -- 172.21.15.52:0/726066793 wait complete. 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 -- start start 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 Processor -- start 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415b013320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b0885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1abf00 con 0x56415b003760 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1ad370 con 0x56415b00e940 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f584c1ac5d0 con 0x56415b004080 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5855513740 10 client.0 _ll_register_callbacks cb 0x7f5844009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5850ed6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50028/0 (socket says 172.21.15.52:50028) 2024-09-19T09:25:51.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f5850ed6640 1 -- 172.21.15.52:0/3325741037 learned_addr learned my addr 172.21.15.52:0/3325741037 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:51.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f58516d7640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b0885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.014+0000 7f584bfff640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415b013320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 -- 172.21.15.52:0/3325741037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 msgr2=0x56415b013320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415b013320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 -- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 msgr2=0x56415b0885f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b0885f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 -- 172.21.15.52:0/3325741037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56415b006750 con 0x56415b003760 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f58516d7640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b0885f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5850ed6640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f583c097700 tx=0x7f583c0bcd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a964593350b0479 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:51.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583c0b4060 con 0x56415b003760 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f583c097910 con 0x56415b003760 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f583c017360 con 0x56415b003760 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f583c01e070 con 0x56415b003760 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 10 client.16929 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56415affb260 con 0x56415b003760 2024-09-19T09:25:51.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f583c017360 con 0x56415b003760 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f583c0a3a80 con 0x56415b003760 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 10 client.16929 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 10 client.16929 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 20 client.16929 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.015+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b089ca0 0x56415b08c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:51.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.016+0000 7f5855513740 4 client.16929 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:25:51.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.016+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x56415af70d20 con 0x56415b089ca0 2024-09-19T09:25:51.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.016+0000 7f584bfff640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b089ca0 0x56415b08c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:51.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.016+0000 7f584bfff640 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b089ca0 0x56415b08c090 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85c9714ac173bf7 server_cookie=2df67ba5ea86626e in_seq=0 out_seq=0 2024-09-19T09:25:51.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.016+0000 7f582bfff640 10 client.16929 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:51.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f582bfff640 1 -- 172.21.15.52:0/3325741037 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56415af70d20 con 0x56415b089ca0 2024-09-19T09:25:51.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f582bfff640 10 client.16929 handle_command_reply: tid=0 2024-09-19T09:25:51.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 client.16929 shutdown 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 msgr2=0x56415b012de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f583c097700 tx=0x7f583c0bcd40 comp rx=0 tx=0).stop 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 shutdown_connections 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56415b089ca0 0x56415b08c090 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56415b00e940 0x56415b0885f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56415b004080 0x56415b013320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 --2- 172.21.15.52:0/3325741037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56415b003760 0x56415b012de0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 >> 172.21.15.52:0/3325741037 conn(0x56415afffcf0 msgr2=0x56415b00c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f582bfff640 0 client.16929 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 shutdown_connections 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 1 -- 172.21.15.52:0/3325741037 wait complete. 2024-09-19T09:25:51.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.026+0000 7f5855513740 20 client.16929 trim_cache size 0 max 16384 2024-09-19T09:25:51.036 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:25:51.036 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:25:51.036 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:25:51.036 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 22, 2024-09-19T09:25:51.037 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:25:51.037 INFO:teuthology.orchestra.run.smithi052.stdout: "622b104a": { 2024-09-19T09:25:51.037 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 22, 2024-09-19T09:25:51.037 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:25:51.037 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.8, 2024-09-19T09:25:51.038 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:25:51.039 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:25:51.039 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:25:51.039 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:25:51.039 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:25:51.039 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:25:51.040 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:25:51.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 msgr2=0x7f58340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 0x7f58340a5700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5844005e30 tx=0x7f584402fb80 comp rx=0 tx=0).stop 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 msgr2=0x7f584c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f583c00b4a0 tx=0x7f583c00b960 comp rx=0 tx=0).stop 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 shutdown_connections 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58340a3240 0x7f58340a5700 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f584c102ef0 0x7f584c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f584c102570 0x7f584c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 --2- 172.21.15.52:0/1517600426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f584c100e20 0x7f584c199350 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 >> 172.21.15.52:0/1517600426 conn(0x7f584c0fc7d0 msgr2=0x7f584c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 shutdown_connections 2024-09-19T09:25:51.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:25:51.027+0000 7f585313a640 1 -- 172.21.15.52:0/1517600426 wait complete. 2024-09-19T09:25:51.820 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '622b104a', quiesce took 3.3 seconds. Will release after: 26.5 2024-09-19T09:25:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:52 smithi052 ceph-mon[30947]: pgmap v471: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:25:52.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:52 smithi169 ceph-mon[35454]: pgmap v471: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:25:53.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:52 smithi086 ceph-mon[34813]: pgmap v471: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:25:54.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:54 smithi052 ceph-mon[30947]: pgmap v472: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 10 op/s 2024-09-19T09:25:54.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:54 smithi169 ceph-mon[35454]: pgmap v472: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 10 op/s 2024-09-19T09:25:55.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:54 smithi086 ceph-mon[34813]: pgmap v472: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 KiB/s wr, 10 op/s 2024-09-19T09:25:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 -- 172.21.15.52:0/1741581328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30141025e0 msgr2=0x7f30141049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 --2- 172.21.15.52:0/1741581328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30141025e0 0x7f30141049d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3004009900 tx=0x7f300402a410 comp rx=0 tx=0).stop 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 -- 172.21.15.52:0/1741581328 shutdown_connections 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 --2- 172.21.15.52:0/1741581328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3014107840 0x7f3014109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 --2- 172.21.15.52:0/1741581328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014104f10 0x7f3014107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 --2- 172.21.15.52:0/1741581328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30141025e0 0x7f30141049d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 -- 172.21.15.52:0/1741581328 >> 172.21.15.52:0/1741581328 conn(0x7f30140fc1e0 msgr2=0x7f30140fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 -- 172.21.15.52:0/1741581328 shutdown_connections 2024-09-19T09:25:56.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.739+0000 7f301aa0e640 1 -- 172.21.15.52:0/1741581328 wait complete. 2024-09-19T09:25:56.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 Processor -- start 2024-09-19T09:25:56.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 -- start start 2024-09-19T09:25:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30141025e0 0x7f3014197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014107840 0x7f301419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f301410d8a0 con 0x7f3014104f10 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f301410d720 con 0x7f3014107840 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f301aa0e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f301410da20 con 0x7f30141025e0 2024-09-19T09:25:56.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f30137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f30137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50044/0 (socket says 172.21.15.52:50044) 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f30137fe640 1 -- 172.21.15.52:0/2492445331 learned_addr learned my addr 172.21.15.52:0/2492445331 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.740+0000 7f3018fab640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014107840 0x7f301419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f3013fff640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30141025e0 0x7f3014197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 -- 172.21.15.52:0/2492445331 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30141025e0 msgr2=0x7f3014197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30141025e0 0x7f3014197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 -- 172.21.15.52:0/2492445331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014107840 msgr2=0x7f301419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014107840 0x7f301419f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 -- 172.21.15.52:0/2492445331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301419fac0 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30137fe640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f300800d770 tx=0x7f300800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30117fa640 1 -- 172.21.15.52:0/2492445331 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008017070 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301419fdb0 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30117fa640 1 -- 172.21.15.52:0/2492445331 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3008009c30 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f30117fa640 1 -- 172.21.15.52:0/2492445331 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300800f620 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.741+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30141a0300 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.743+0000 7f30117fa640 1 -- 172.21.15.52:0/2492445331 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f300801a070 con 0x7f3014104f10 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 Processor -- start 2024-09-19T09:25:56.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 -- start start 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae0f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0fa370 0x5600ae0fc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600ae0582f0 con 0x5600ae0f49a0 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5600ae000270 con 0x5600ae0fa370 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f301d885740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5600ae0542b0 con 0x5600ae0f52e0 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50060/0 (socket says 172.21.15.52:50060) 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f3018fab640 1 -- 172.21.15.52:0/1764875015 learned_addr learned my addr 172.21.15.52:0/1764875015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f30117fa640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 0x7f2ffc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f3013fff640 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae0f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f30137fe640 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0fa370 0x5600ae0fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.744+0000 7f3018fab640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 0x7f2ffc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f30117fa640 1 -- 172.21.15.52:0/2492445331 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f30080cf4a0 con 0x7f3014104f10 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 -- 172.21.15.52:0/1764875015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 msgr2=0x5600ae0f9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae0f9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 -- 172.21.15.52:0/1764875015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0fa370 msgr2=0x5600ae0fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0fa370 0x5600ae0fc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 -- 172.21.15.52:0/1764875015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600adfff340 con 0x5600ae0f49a0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f300c00a960 tx=0x7f300c00ae20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3d78660861b130 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f3018fab640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 0x7f2ffc0a57b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f300c0155c0 tx=0x7f300c01c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f2ffa7fc640 1 -- 172.21.15.52:0/1764875015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c01d040 con 0x5600ae0f49a0 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f2ffa7fc640 1 -- 172.21.15.52:0/1764875015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f300c00a500 con 0x5600ae0f49a0 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.745+0000 7f2ffa7fc640 1 -- 172.21.15.52:0/1764875015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c022d60 con 0x5600ae0f49a0 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- 172.21.15.52:0/1764875015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 msgr2=0x5600ae0f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f300c00a960 tx=0x7f300c00ae20 comp rx=0 tx=0).stop 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- 172.21.15.52:0/1764875015 shutdown_connections 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0fa370 0x5600ae0fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae0f9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 --2- 172.21.15.52:0/1764875015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0f49a0 0x5600ae0f4da0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- 172.21.15.52:0/1764875015 >> 172.21.15.52:0/1764875015 conn(0x5600ae0f0010 msgr2=0x5600ae0f0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- 172.21.15.52:0/1764875015 shutdown_connections 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- 172.21.15.52:0/1764875015 wait complete. 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.746+0000 7f301d885740 1 -- start start 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 Processor -- start 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f49a0 0x5600ae0feb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 0x5600ae0ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5600ae0fd2e0 con 0x5600ae0fa370 2024-09-19T09:25:56.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5600adfe1290 con 0x5600ae0f52e0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5600ae0fd460 con 0x5600ae0f49a0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f301d885740 10 client.0 _ll_register_callbacks cb 0x5600ae012140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50076/0 (socket says 172.21.15.52:50076) 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 -- 172.21.15.52:0/3837522953 learned_addr learned my addr 172.21.15.52:0/3837522953 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f30137fe640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 0x5600ae0ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3013fff640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f49a0 0x5600ae0feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 -- 172.21.15.52:0/3837522953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f49a0 msgr2=0x5600ae0feb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f49a0 0x5600ae0feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 -- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 msgr2=0x5600ae0ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 0x5600ae0ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f3018fab640 1 -- 172.21.15.52:0/3837522953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600add6b210 con 0x5600ae0fa370 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.747+0000 7f30137fe640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 0x5600ae0ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f3018fab640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f300c0226a0 tx=0x7f300c022f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dfa4fcd2168ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c030070 con 0x5600ae0fa370 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f300c019c20 con 0x5600ae0fa370 2024-09-19T09:25:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f300c00a500 con 0x5600ae0fa370 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f300c03c050 con 0x5600ae0fa370 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f301d885740 10 client.16941 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600ade37620 con 0x5600ae0fa370 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f300c00a500 con 0x5600ae0fa370 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.748+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f300c020410 con 0x5600ae0fa370 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 10 client.16941 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 20 client.16941 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae10a680 0x5600ae10ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 4 client.16941 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:25:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600ae065a20 con 0x5600ae10a680 2024-09-19T09:25:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f3013fff640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae10a680 0x5600ae10ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f2ff37fe640 10 client.16941 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.749+0000 7f3013fff640 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae10a680 0x5600ae10ca70 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14e9b704a4368be7 server_cookie=f81ed5bb004c49b3 in_seq=0 out_seq=0 2024-09-19T09:25:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f2ff37fe640 1 -- 172.21.15.52:0/3837522953 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600ae065a20 con 0x5600ae10a680 2024-09-19T09:25:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f2ff37fe640 10 client.16941 handle_command_reply: tid=0 2024-09-19T09:25:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 client.16941 shutdown 2024-09-19T09:25:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 msgr2=0x5600ae1060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f300c0226a0 tx=0x7f300c022f90 comp rx=0 tx=0).stop 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 shutdown_connections 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae10a680 0x5600ae10ca70 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae1060f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f52e0 0x5600ae0ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f2ff37fe640 0 client.16941 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 --2- 172.21.15.52:0/3837522953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f49a0 0x5600ae0feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 >> 172.21.15.52:0/3837522953 conn(0x5600ae0f0010 msgr2=0x5600ae0f1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 shutdown_connections 2024-09-19T09:25:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 1 -- 172.21.15.52:0/3837522953 wait complete. 2024-09-19T09:25:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.750+0000 7f301d885740 20 client.16941 trim_cache size 0 max 16384 2024-09-19T09:25:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 Processor -- start 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 -- start start 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae0f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae1060b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30141abb90 con 0x5600ae0fa370 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30141a9460 con 0x5600ae0f49a0 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f301d885740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30141a72b0 con 0x5600ae0f52e0 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50078/0 (socket says 172.21.15.52:50078) 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 -- 172.21.15.52:0/2288325056 learned_addr learned my addr 172.21.15.52:0/2288325056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3013fff640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae0f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f30137fe640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae1060b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 -- 172.21.15.52:0/2288325056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 msgr2=0x5600ae1060b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae1060b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 -- 172.21.15.52:0/2288325056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 msgr2=0x5600ae0f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.765+0000 7f3018fab640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae0f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f3018fab640 1 -- 172.21.15.52:0/2288325056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600ae0fd220 con 0x5600ae0fa370 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f3013fff640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae0f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f3018fab640 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f300c0099b0 tx=0x7f300c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785c3a8ffca26154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f2ff9ffb640 1 -- 172.21.15.52:0/2288325056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c045070 con 0x5600ae0fa370 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f2ff9ffb640 1 -- 172.21.15.52:0/2288325056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f300c00a500 con 0x5600ae0fa370 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f2ff9ffb640 1 -- 172.21.15.52:0/2288325056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c030070 con 0x5600ae0fa370 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f301d885740 1 -- 172.21.15.52:0/2288325056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 msgr2=0x5600ae0f0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.766+0000 7f301d885740 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f300c0099b0 tx=0x7f300c004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- 172.21.15.52:0/2288325056 shutdown_connections 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae0f0930 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae1060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- 172.21.15.52:0/2288325056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae0f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- 172.21.15.52:0/2288325056 >> 172.21.15.52:0/2288325056 conn(0x5600ae0f0010 msgr2=0x5600ae0f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- 172.21.15.52:0/2288325056 shutdown_connections 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- 172.21.15.52:0/2288325056 wait complete. 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- start start 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 Processor -- start 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae103000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae103540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30141a7920 con 0x5600ae0fa370 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30141a8d90 con 0x5600ae0f49a0 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30141a7ff0 con 0x5600ae0f52e0 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.767+0000 7f301d885740 10 client.0 _ll_register_callbacks cb 0x7f3004009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50084/0 (socket says 172.21.15.52:50084) 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 -- 172.21.15.52:0/1991632405 learned_addr learned my addr 172.21.15.52:0/1991632405 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:25:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3013fff640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f30137fe640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 -- 172.21.15.52:0/1991632405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 msgr2=0x5600ae103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 -- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 msgr2=0x5600ae103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 -- 172.21.15.52:0/1991632405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600ae173840 con 0x5600ae0fa370 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f30137fe640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3013fff640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f3018fab640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f300c009820 tx=0x7f300c022890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b8224958c8ed5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f2ff37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c045050 con 0x5600ae0fa370 2024-09-19T09:25:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f300c020370 con 0x5600ae0fa370 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f300c00a500 con 0x5600ae0fa370 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f300c030040 con 0x5600ae0fa370 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f301d885740 10 client.16947 fetch_fsmap learned FSMap version 24 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.768+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600ae1749f0 con 0x5600ae0fa370 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f300c00a500 con 0x5600ae0fa370 2024-09-19T09:25:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f300c049a00 con 0x5600ae0fa370 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 10 client.16947 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 10 client.16947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 20 client.16947 populate_metadata read hostname 'smithi052' 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae175330 0x5600ae177720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 4 client.16947 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:25:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600ae05fd70 con 0x5600ae175330 2024-09-19T09:25:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f3013fff640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae175330 0x5600ae177720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f3013fff640 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae175330 0x5600ae177720 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b893a9ceee1ae8 server_cookie=c1d7319ba69a40c5 in_seq=0 out_seq=0 2024-09-19T09:25:56.782 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.769+0000 7f2ff37fe640 10 client.16947 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f2ff37fe640 1 -- 172.21.15.52:0/1991632405 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600ae05fd70 con 0x5600ae175330 2024-09-19T09:25:56.784 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f2ff37fe640 10 client.16947 handle_command_reply: tid=0 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 client.16947 shutdown 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 msgr2=0x5600ae173300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f300c009820 tx=0x7f300c022890 comp rx=0 tx=0).stop 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 shutdown_connections 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5600ae175330 0x5600ae177720 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.785 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5600ae0fa370 0x5600ae173300 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5600ae0f52e0 0x5600ae103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 --2- 172.21.15.52:0/1991632405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5600ae0f49a0 0x5600ae103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f2ff37fe640 0 client.16947 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 >> 172.21.15.52:0/1991632405 conn(0x5600ae0f0010 msgr2=0x5600ae0ee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 shutdown_connections 2024-09-19T09:25:56.786 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.777+0000 7f301d885740 1 -- 172.21.15.52:0/1991632405 wait complete. 2024-09-19T09:25:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301d885740 20 client.16947 trim_cache size 0 max 16384 2024-09-19T09:25:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:25:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:25:56.787 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:25:56.788 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:25:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 msgr2=0x7f2ffc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 0x7f2ffc0a57b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f300c0155c0 tx=0x7f300c01c000 comp rx=0 tx=0).stop 2024-09-19T09:25:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 msgr2=0x7f30141983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f300800d770 tx=0x7f300800dc30 comp rx=0 tx=0).stop 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 shutdown_connections 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3014107840 0x7f301419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3014104f10 0x7f30141983e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2ffc0a32f0 0x7f2ffc0a57b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 --2- 172.21.15.52:0/2492445331 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30141025e0 0x7f3014197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 >> 172.21.15.52:0/2492445331 conn(0x7f30140fc1e0 msgr2=0x7f3014102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 shutdown_connections 2024-09-19T09:25:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:25:56.778+0000 7f301aa0e640 1 -- 172.21.15.52:0/2492445331 wait complete. 2024-09-19T09:25:56.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:56 smithi052 ceph-mon[30947]: pgmap v473: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-19T09:25:56.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:56 smithi169 ceph-mon[35454]: pgmap v473: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-19T09:25:57.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:56 smithi086 ceph-mon[34813]: pgmap v473: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-09-19T09:25:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:25:58 smithi052 ceph-mon[30947]: pgmap v474: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-09-19T09:25:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:25:58 smithi169 ceph-mon[35454]: pgmap v474: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-09-19T09:25:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:25:58 smithi086 ceph-mon[34813]: pgmap v474: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2024-09-19T09:26:00.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:00 smithi052 ceph-mon[30947]: pgmap v475: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-19T09:26:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:00 smithi169 ceph-mon[35454]: pgmap v475: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-19T09:26:01.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:00 smithi086 ceph-mon[34813]: pgmap v475: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.5 KiB/s wr, 10 op/s 2024-09-19T09:26:02.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:02 smithi052 ceph-mon[30947]: pgmap v476: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:26:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:02 smithi169 ceph-mon[35454]: pgmap v476: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:26:03.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:02 smithi086 ceph-mon[34813]: pgmap v476: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:26:04.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:04 smithi052 ceph-mon[30947]: pgmap v477: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T09:26:04.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:04 smithi169 ceph-mon[35454]: pgmap v477: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T09:26:05.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:04 smithi086 ceph-mon[34813]: pgmap v477: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T09:26:06.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:06 smithi052 ceph-mon[30947]: pgmap v478: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:26:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:06 smithi169 ceph-mon[35454]: pgmap v478: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:26:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:06 smithi086 ceph-mon[34813]: pgmap v478: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:26:08.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:26:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:08.700 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:08 smithi052 ceph-mon[30947]: pgmap v479: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:26:08.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.784+0000 7f4b2cc73640 1 -- 172.21.15.52:0/4081347195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28106a80 msgr2=0x7f4b28106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.784+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/4081347195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28106a80 0x7f4b28106e60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009930 tx=0x7f4b1802a420 comp rx=0 tx=0).stop 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 -- 172.21.15.52:0/4081347195 shutdown_connections 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/4081347195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28101420 0x7f4b2810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/4081347195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28100a80 0x7f4b28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/4081347195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28106a80 0x7f4b28106e60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 -- 172.21.15.52:0/4081347195 >> 172.21.15.52:0/4081347195 conn(0x7f4b280fc7a0 msgr2=0x7f4b280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 -- 172.21.15.52:0/4081347195 shutdown_connections 2024-09-19T09:26:08.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 -- 172.21.15.52:0/4081347195 wait complete. 2024-09-19T09:26:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 Processor -- start 2024-09-19T09:26:08.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.785+0000 7f4b2cc73640 1 -- start start 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28100a80 0x7f4b281984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28106a80 0x7f4b2819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28110ea0 con 0x7f4b28101420 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28110d20 con 0x7f4b28100a80 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2cc73640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28111020 con 0x7f4b28106a80 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57910/0 (socket says 172.21.15.52:57910) 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 -- 172.21.15.52:0/2049002 learned_addr learned my addr 172.21.15.52:0/2049002 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b2659c640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28100a80 0x7f4b281984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28106a80 0x7f4b2819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 -- 172.21.15.52:0/2049002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28106a80 msgr2=0x7f4b2819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28106a80 0x7f4b2819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 -- 172.21.15.52:0/2049002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28100a80 msgr2=0x7f4b281984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28100a80 0x7f4b281984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 -- 172.21.15.52:0/2049002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2819d470 con 0x7f4b28101420 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00b4a0 tx=0x7f4b1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.786+0000 7f4b177fe640 1 -- 172.21.15.52:0/2049002 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c014070 con 0x7f4b28101420 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.787+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2819d760 con 0x7f4b28101420 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.787+0000 7f4b177fe640 1 -- 172.21.15.52:0/2049002 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b1c010af0 con 0x7f4b28101420 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.787+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b280fccc0 con 0x7f4b28101420 2024-09-19T09:26:08.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.787+0000 7f4b177fe640 1 -- 172.21.15.52:0/2049002 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c017d10 con 0x7f4b28101420 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.789+0000 7f4b177fe640 1 -- 172.21.15.52:0/2049002 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4b1c017070 con 0x7f4b28101420 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.789+0000 7f4b2f04c740 1 Processor -- start 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 -- start start 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 0x55cb44f84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f845d0 0x55cb44f8e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb44ee12e0 con 0x55cb44f8ee90 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cb44e88ce0 con 0x55cb44f83cb0 2024-09-19T09:26:08.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cb44edd2a0 con 0x55cb44f845d0 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f91280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57918/0 (socket says 172.21.15.52:57918) 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b25d9b640 1 -- 172.21.15.52:0/1516854091 learned_addr learned my addr 172.21.15.52:0/1516854091 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 0x55cb44f84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b2659c640 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f845d0 0x55cb44f8e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b177fe640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 0x7f4b100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 -- 172.21.15.52:0/1516854091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f845d0 msgr2=0x55cb44f8e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f845d0 0x55cb44f8e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 -- 172.21.15.52:0/1516854091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 msgr2=0x55cb44f91280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f91280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.790+0000 7f4b26d9d640 1 -- 172.21.15.52:0/1516854091 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb44e6d440 con 0x55cb44f83cb0 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b177fe640 1 -- 172.21.15.52:0/2049002 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b1c0cea40 con 0x7f4b28101420 2024-09-19T09:26:08.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 0x55cb44f84090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d20 tx=0x7f4b2000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad8ab3b2a40f084c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 0x7f4b100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b14ff9640 1 -- 172.21.15.52:0/1516854091 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20003d10 con 0x55cb44f83cb0 2024-09-19T09:26:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b14ff9640 1 -- 172.21.15.52:0/1516854091 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20011920 con 0x55cb44f83cb0 2024-09-19T09:26:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.791+0000 7f4b14ff9640 1 -- 172.21.15.52:0/1516854091 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2001d890 con 0x55cb44f83cb0 2024-09-19T09:26:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1516854091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 msgr2=0x55cb44f84090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 0x55cb44f84090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009d20 tx=0x7f4b2000f730 comp rx=0 tx=0).stop 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 0x7f4b100a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009fd0 tx=0x7f4b20021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1516854091 shutdown_connections 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f91280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f845d0 0x55cb44f8e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1516854091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f83cb0 0x55cb44f84090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1516854091 >> 172.21.15.52:0/1516854091 conn(0x55cb44f80240 msgr2=0x55cb44f80620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1516854091 shutdown_connections 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1516854091 wait complete. 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 -- start start 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.792+0000 7f4b2f04c740 1 Processor -- start 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f8e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f8ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cb44f91a60 con 0x55cb44f8ee90 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cb44e9c050 con 0x55cb44f845d0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cb44f91be0 con 0x55cb44f83cb0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2f04c740 10 client.0 _ll_register_callbacks cb 0x55cb44edc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57928/0 (socket says 172.21.15.52:57928) 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b26d9d640 1 -- 172.21.15.52:0/3381072867 learned_addr learned my addr 172.21.15.52:0/3381072867 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f8ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f8e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 -- 172.21.15.52:0/3381072867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 msgr2=0x55cb44f8e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f8e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 -- 172.21.15.52:0/3381072867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 msgr2=0x55cb44f8bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 -- 172.21.15.52:0/3381072867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb44c523c0 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f8ba10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c097950 tx=0x7f4b1c0179a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d52777494f7682e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.793+0000 7f4b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c01e070 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b20011920 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b1c010ca0 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b1c0092b0 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 10 client.26294 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cb44f9d4c0 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b1c0b5080 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b1c0b9bc0 con 0x55cb44f845d0 2024-09-19T09:26:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 10 client.26294 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 10 client.26294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 20 client.26294 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb44f9e980 0x55cb44fa0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 4 client.26294 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb44eee850 con 0x55cb44f9e980 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.794+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb44f9e980 0x55cb44fa0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.795+0000 7f4b0dffb640 10 client.26294 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.795+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb44f9e980 0x55cb44fa0da0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37da9a92824a6270 server_cookie=a0f3f3abdc37e45c in_seq=0 out_seq=0 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.795+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3381072867 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb44eee850 con 0x55cb44f9e980 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.795+0000 7f4b0dffb640 10 client.26294 handle_command_reply: tid=0 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 client.26294 shutdown 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 msgr2=0x55cb44f8ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f8ba10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c097950 tx=0x7f4b1c0179a0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 shutdown_connections 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb44f9e980 0x55cb44fa0da0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f8bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f8ba10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b0dffb640 0 client.26294 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3381072867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f8e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 >> 172.21.15.52:0/3381072867 conn(0x55cb44f80240 msgr2=0x55cb44f85f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 shutdown_connections 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3381072867 wait complete. 2024-09-19T09:26:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.796+0000 7f4b2f04c740 20 client.26294 trim_cache size 0 max 16384 2024-09-19T09:26:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 Processor -- start 2024-09-19T09:26:08.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 -- start start 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f9ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f8ee90 0x55cb44fa6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b08010f20 con 0x55cb44f845d0 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0800e7f0 con 0x55cb44f8ee90 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0800c640 con 0x55cb44f83cb0 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b25d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57934/0 (socket says 172.21.15.52:57934) 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b25d9b640 1 -- 172.21.15.52:0/1027284248 learned_addr learned my addr 172.21.15.52:0/1027284248 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f8ee90 0x55cb44fa6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.813+0000 7f4b2659c640 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f9ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 -- 172.21.15.52:0/1027284248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 msgr2=0x55cb44f9ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f9ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 -- 172.21.15.52:0/1027284248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f8ee90 msgr2=0x55cb44fa6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f8ee90 0x55cb44fa6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 -- 172.21.15.52:0/1027284248 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb44f84400 con 0x55cb44f845d0 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0973e0 tx=0x7f4b1c0b9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f11a981a4f3615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b0ffff640 1 -- 172.21.15.52:0/1027284248 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0b8070 con 0x55cb44f845d0 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b0ffff640 1 -- 172.21.15.52:0/1027284248 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20011920 con 0x55cb44f845d0 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b0ffff640 1 -- 172.21.15.52:0/1027284248 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c01e050 con 0x55cb44f845d0 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1027284248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 msgr2=0x55cb44f76a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0973e0 tx=0x7f4b1c0b9f90 comp rx=0 tx=0).stop 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1027284248 shutdown_connections 2024-09-19T09:26:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f8ee90 0x55cb44fa6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.814+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f845d0 0x55cb44f76a60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/1027284248 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f9ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1027284248 >> 172.21.15.52:0/1027284248 conn(0x55cb44f80240 msgr2=0x55cb44f76350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1027284248 shutdown_connections 2024-09-19T09:26:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- 172.21.15.52:0/1027284248 wait complete. 2024-09-19T09:26:08.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- start start 2024-09-19T09:26:08.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 Processor -- start 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f96e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f973d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0800ccb0 con 0x55cb44f8ee90 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0800e120 con 0x55cb44f845d0 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0800d380 con 0x55cb44f83cb0 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b2f04c740 10 client.0 _ll_register_callbacks cb 0x7f4b1c0cc3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57936/0 (socket says 172.21.15.52:57936) 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.815+0000 7f4b26d9d640 1 -- 172.21.15.52:0/3617890987 learned_addr learned my addr 172.21.15.52:0/3617890987 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b25d9b640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f96e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 -- 172.21.15.52:0/3617890987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 msgr2=0x55cb44f96e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f96e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 -- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 msgr2=0x55cb44f973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 -- 172.21.15.52:0/3617890987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb44f898c0 con 0x55cb44f8ee90 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b26d9d640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006010 tx=0x7f4b2001d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b6666cd323b968 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20009960 con 0x55cb44f8ee90 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b2001db40 con 0x55cb44f8ee90 2024-09-19T09:26:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b20011920 con 0x55cb44f8ee90 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b2001dd40 con 0x55cb44f8ee90 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b2f04c740 10 client.16965 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.816+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cb45009ad0 con 0x55cb44f8ee90 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b20011920 con 0x55cb44f8ee90 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b20004b60 con 0x55cb44f8ee90 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 10 client.16965 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 20 client.16965 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb45009f60 0x55cb4500c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 4 client.16965 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb44ee8d60 con 0x55cb45009f60 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb45009f60 0x55cb4500c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b0dffb640 10 client.16965 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.817+0000 7f4b2659c640 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb45009f60 0x55cb4500c380 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181a2dc25cfc1c19 server_cookie=1295e6a6945c3458 in_seq=0 out_seq=0 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b0dffb640 1 -- 172.21.15.52:0/3617890987 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cb44ee8d60 con 0x55cb45009f60 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b0dffb640 10 client.16965 handle_command_reply: tid=0 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 client.16965 shutdown 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 msgr2=0x55cb44f93e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006010 tx=0x7f4b2001d850 comp rx=0 tx=0).stop 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 shutdown_connections 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cb45009f60 0x55cb4500c380 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cb44f8ee90 0x55cb44f93e60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cb44f845d0 0x55cb44f973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 --2- 172.21.15.52:0/3617890987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cb44f83cb0 0x55cb44f96e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 >> 172.21.15.52:0/3617890987 conn(0x55cb44f80240 msgr2=0x55cb44f76350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b0dffb640 0 client.16965 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 shutdown_connections 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 1 -- 172.21.15.52:0/3617890987 wait complete. 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.818+0000 7f4b2f04c740 20 client.16965 trim_cache size 0 max 16384 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:26:08.826 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 msgr2=0x7f4b100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 0x7f4b100a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009fd0 tx=0x7f4b20021000 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 msgr2=0x7f4b28198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00b4a0 tx=0x7f4b1c00b960 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 shutdown_connections 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b100a32c0 0x7f4b100a5780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28106a80 0x7f4b2819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b28101420 0x7f4b28198a00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 --2- 172.21.15.52:0/2049002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b28100a80 0x7f4b281984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 >> 172.21.15.52:0/2049002 conn(0x7f4b280fc7a0 msgr2=0x7f4b2806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 shutdown_connections 2024-09-19T09:26:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:08.819+0000 7f4b2cc73640 1 -- 172.21.15.52:0/2049002 wait complete. 2024-09-19T09:26:08.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:08 smithi169 ceph-mon[35454]: pgmap v479: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:26:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:08 smithi086 ceph-mon[34813]: pgmap v479: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-19T09:26:09.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:26:09.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:26:09.854 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 -- 172.21.15.52:0/385739058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 msgr2=0x7fbd14100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/385739058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14100e50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009900 tx=0x7fbd1002a410 comp rx=0 tx=0).stop 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 -- 172.21.15.52:0/385739058 shutdown_connections 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/385739058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14102600 0x7fbd14108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/385739058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14101c40 0x7fbd141020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/385739058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14100e50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 -- 172.21.15.52:0/385739058 >> 172.21.15.52:0/385739058 conn(0x7fbd140fc1b0 msgr2=0x7fbd140fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 -- 172.21.15.52:0/385739058 shutdown_connections 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.878+0000 7fbd1ad11640 1 -- 172.21.15.52:0/385739058 wait complete. 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 Processor -- start 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 -- start start 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14101c40 0x7fbd1419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14102600 0x7fbd141a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1410c730 con 0x7fbd14100a50 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1410c5b0 con 0x7fbd14102600 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd1ad11640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1410c8b0 con 0x7fbd14101c40 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.882 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57956/0 (socket says 172.21.15.52:57956) 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 -- 172.21.15.52:0/1389948899 learned_addr learned my addr 172.21.15.52:0/1389948899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14102600 0x7fbd141a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd0bfff640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14101c40 0x7fbd1419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 -- 172.21.15.52:0/1389948899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14101c40 msgr2=0x7fbd1419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14101c40 0x7fbd1419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 -- 172.21.15.52:0/1389948899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14102600 msgr2=0x7fbd141a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14102600 0x7fbd141a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.879+0000 7fbd18aad640 1 -- 172.21.15.52:0/1389948899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd141a1ba0 con 0x7fbd14100a50 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbd10031610 tx=0x7fbd100043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd09ffb640 1 -- 172.21.15.52:0/1389948899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1003f030 con 0x7fbd14100a50 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd09ffb640 1 -- 172.21.15.52:0/1389948899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd10003ce0 con 0x7fbd14100a50 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd141a1e30 con 0x7fbd14100a50 2024-09-19T09:26:09.883 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd09ffb640 1 -- 172.21.15.52:0/1389948899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10035070 con 0x7fbd14100a50 2024-09-19T09:26:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.880+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd141a2310 con 0x7fbd14100a50 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.882+0000 7fbd1daac740 1 Processor -- start 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.882+0000 7fbd1daac740 1 -- start start 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd09ffb640 1 -- 172.21.15.52:0/1389948899 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbd10042030 con 0x7fbd14100a50 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369437da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55636943d370 0x55636943f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55636939b2f0 con 0x5563694382e0 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556369343270 con 0x55636943d370 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd1daac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5563693972b0 con 0x5563694379a0 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57968/0 (socket says 172.21.15.52:57968) 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 -- 172.21.15.52:0/3506948723 learned_addr learned my addr 172.21.15.52:0/3506948723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd192ae640 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369437da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd0bfff640 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55636943d370 0x55636943f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 -- 172.21.15.52:0/3506948723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 msgr2=0x556369437da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369437da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 -- 172.21.15.52:0/3506948723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55636943d370 msgr2=0x55636943f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55636943d370 0x55636943f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.883+0000 7fbd18aad640 1 -- 172.21.15.52:0/3506948723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556369342340 con 0x5563694382e0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fbd100f81b0 tx=0x7fbd100f82a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f873680ae2fae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbd09ffb640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 0x7fbcfc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 0x7fbcfc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbd09ffb640 1 -- 172.21.15.52:0/1389948899 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd100effa0 con 0x7fbd14100a50 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbcfaffd640 1 -- 172.21.15.52:0/3506948723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100b87e0 con 0x5563694382e0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbcfaffd640 1 -- 172.21.15.52:0/3506948723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd100fd030 con 0x5563694382e0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.884+0000 7fbcfaffd640 1 -- 172.21.15.52:0/3506948723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100bbea0 con 0x5563694382e0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- 172.21.15.52:0/3506948723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 msgr2=0x55636943cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fbd100f81b0 tx=0x7fbd100f82a0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 0x7fbcfc0a5830 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a400 tx=0x7fbd0c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- 172.21.15.52:0/3506948723 shutdown_connections 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55636943d370 0x55636943f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694382e0 0x55636943cda0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3506948723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369437da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- 172.21.15.52:0/3506948723 >> 172.21.15.52:0/3506948723 conn(0x556369433010 msgr2=0x556369433410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- 172.21.15.52:0/3506948723 shutdown_connections 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- 172.21.15.52:0/3506948723 wait complete. 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 -- start start 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.885+0000 7fbd1daac740 1 Processor -- start 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x5563694418b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369441df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556369440100 con 0x55636943d370 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556369324290 con 0x5563694382e0 2024-09-19T09:26:09.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556369440280 con 0x5563694379a0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd1daac740 10 client.0 _ll_register_callbacks cb 0x556369355140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd192ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd192ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57978/0 (socket says 172.21.15.52:57978) 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd192ae640 1 -- 172.21.15.52:0/1544111086 learned_addr learned my addr 172.21.15.52:0/1544111086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.886+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x5563694418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd0bfff640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369441df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 -- 172.21.15.52:0/1544111086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 msgr2=0x5563694418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x5563694418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 -- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 msgr2=0x556369441df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369441df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 -- 172.21.15.52:0/1544111086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563690ae210 con 0x55636943d370 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd192ae640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c018ed0 tx=0x7fbd0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987f441eb4a7f5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbcf3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c028060 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd0c0177d0 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd100fd030 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd0c016e40 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd1daac740 10 client.16977 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55636917a620 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.887+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd100fd030 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd0c023bb0 con 0x55636943d370 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 10 client.16977 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 10 client.16977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 20 client.16977 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55636944d5d0 0x55636944f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 4 client.16977 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:09.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563693a8a20 con 0x55636944d5d0 2024-09-19T09:26:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55636944d5d0 0x55636944f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbd18aad640 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55636944d5d0 0x55636944f9e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0f8475674494958 server_cookie=23de5c5d278af1f9 in_seq=0 out_seq=0 2024-09-19T09:26:09.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.888+0000 7fbcf3fff640 10 client.16977 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbcf3fff640 1 -- 172.21.15.52:0/1544111086 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563693a8a20 con 0x55636944d5d0 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbcf3fff640 10 client.16977 handle_command_reply: tid=0 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 client.16977 shutdown 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 msgr2=0x556369448e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c018ed0 tx=0x7fbd0c004a40 comp rx=0 tx=0).stop 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 shutdown_connections 2024-09-19T09:26:09.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55636944d5d0 0x55636944f9e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x556369448e30 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369441df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbcf3fff640 0 client.16977 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 --2- 172.21.15.52:0/1544111086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x5563694418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.889+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 >> 172.21.15.52:0/1544111086 conn(0x556369433010 msgr2=0x556369434820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.890+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 shutdown_connections 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.890+0000 7fbd1daac740 1 -- 172.21.15.52:0/1544111086 wait complete. 2024-09-19T09:26:09.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.890+0000 7fbd1daac740 20 client.16977 trim_cache size 0 max 16384 2024-09-19T09:26:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 Processor -- start 2024-09-19T09:26:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 -- start start 2024-09-19T09:26:09.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369448df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55636943d370 0x556369434400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141add10 con 0x5563694379a0 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141ab5e0 con 0x5563694382e0 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd1daac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141a9430 con 0x55636943d370 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57980/0 (socket says 172.21.15.52:57980) 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 -- 172.21.15.52:0/280766346 learned_addr learned my addr 172.21.15.52:0/280766346 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 -- 172.21.15.52:0/280766346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55636943d370 msgr2=0x556369434400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55636943d370 0x556369434400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 -- 172.21.15.52:0/280766346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 msgr2=0x556369448df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369448df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.904+0000 7fbd18aad640 1 -- 172.21.15.52:0/280766346 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556369433ca0 con 0x5563694379a0 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbd18aad640 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd100edd90 tx=0x7fbd1003b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3b7bfb6da552ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbcfa7fc640 1 -- 172.21.15.52:0/280766346 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a1e80 con 0x5563694379a0 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbcfa7fc640 1 -- 172.21.15.52:0/280766346 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd100fd040 con 0x5563694379a0 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbcfa7fc640 1 -- 172.21.15.52:0/280766346 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10049040 con 0x5563694379a0 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbd1daac740 1 -- 172.21.15.52:0/280766346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 msgr2=0x556369433ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbd1daac740 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fbd100edd90 tx=0x7fbd1003b8e0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.905+0000 7fbd1daac740 1 -- 172.21.15.52:0/280766346 shutdown_connections 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55636943d370 0x556369434400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369448df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- 172.21.15.52:0/280766346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5563694379a0 0x556369433ec0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- 172.21.15.52:0/280766346 >> 172.21.15.52:0/280766346 conn(0x556369433010 msgr2=0x5563694418b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- 172.21.15.52:0/280766346 shutdown_connections 2024-09-19T09:26:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- 172.21.15.52:0/280766346 wait complete. 2024-09-19T09:26:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- start start 2024-09-19T09:26:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 Processor -- start 2024-09-19T09:26:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369446050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369446590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141a9aa0 con 0x55636943d370 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141aaf10 con 0x5563694382e0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd141aa170 con 0x5563694379a0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd1daac740 10 client.0 _ll_register_callbacks cb 0x7fbd0c009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd192ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd192ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57988/0 (socket says 172.21.15.52:57988) 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.906+0000 7fbd192ae640 1 -- 172.21.15.52:0/3334667517 learned_addr learned my addr 172.21.15.52:0/3334667517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369446050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd0bfff640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369446590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 -- 172.21.15.52:0/3334667517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 msgr2=0x556369446050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369446050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 -- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 msgr2=0x556369446590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369446590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 -- 172.21.15.52:0/3334667517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55636943d110 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd192ae640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004b90 tx=0x7fbd0c015bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a59d73cd74f70f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbcf3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c0177d0 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd0c017970 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd100fd040 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd0c028030 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd1daac740 10 client.16983 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556369448cf0 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.907+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd100fd040 con 0x55636943d370 2024-09-19T09:26:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd0c023a70 con 0x55636943d370 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 10 client.16983 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 10 client.16983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 20 client.16983 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5563694b8680 0x5563694baaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 4 client.16983 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5563693a2d70 con 0x5563694b8680 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5563694b8680 0x5563694baaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbd18aad640 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5563694b8680 0x5563694baaa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a6f019871fce39 server_cookie=2fd7b14b3413550d in_seq=0 out_seq=0 2024-09-19T09:26:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.908+0000 7fbcf3fff640 10 client.16983 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbcf3fff640 1 -- 172.21.15.52:0/3334667517 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5563693a2d70 con 0x5563694b8680 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbcf3fff640 10 client.16983 handle_command_reply: tid=0 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 client.16983 shutdown 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 msgr2=0x5563694475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c004b90 tx=0x7fbd0c015bb0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 shutdown_connections 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5563694b8680 0x5563694baaa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55636943d370 0x5563694475a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5563694382e0 0x556369446590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbcf3fff640 0 client.16983 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 --2- 172.21.15.52:0/3334667517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5563694379a0 0x556369446050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.912+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 >> 172.21.15.52:0/3334667517 conn(0x556369433010 msgr2=0x5563694319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 shutdown_connections 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1daac740 1 -- 172.21.15.52:0/3334667517 wait complete. 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1daac740 20 client.16983 trim_cache size 0 max 16384 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:26:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 msgr2=0x7fbcfc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 0x7fbcfc0a5830 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00a400 tx=0x7fbd0c00d040 comp rx=0 tx=0).stop 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 msgr2=0x7fbd14199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fbd10031610 tx=0x7fbd100043b0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 shutdown_connections 2024-09-19T09:26:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd14102600 0x7fbd141a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbcfc0a3370 0x7fbcfc0a5830 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd14101c40 0x7fbd1419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 --2- 172.21.15.52:0/1389948899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd14100a50 0x7fbd14199f80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 >> 172.21.15.52:0/1389948899 conn(0x7fbd140fc1b0 msgr2=0x7fbd140fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 shutdown_connections 2024-09-19T09:26:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:09.913+0000 7fbd1ad11640 1 -- 172.21.15.52:0/1389948899 wait complete. 2024-09-19T09:26:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 -- 172.21.15.52:0/1354697295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 msgr2=0x7f7890106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:10.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 --2- 172.21.15.52:0/1354697295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f7890106e40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7880009930 tx=0x7f788002a440 comp rx=0 tx=0).stop 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 -- 172.21.15.52:0/1354697295 shutdown_connections 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 --2- 172.21.15.52:0/1354697295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 0x7f789010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 --2- 172.21.15.52:0/1354697295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 0x7f7890100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 --2- 172.21.15.52:0/1354697295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f7890106e40 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 -- 172.21.15.52:0/1354697295 >> 172.21.15.52:0/1354697295 conn(0x7f78900fc780 msgr2=0x7f78900feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 -- 172.21.15.52:0/1354697295 shutdown_connections 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.332+0000 7f7895086640 1 -- 172.21.15.52:0/1354697295 wait complete. 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 Processor -- start 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 -- start start 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 0x7f78901972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:10.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 0x7f78901977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7890110e20 con 0x7f7890106a60 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7890110ca0 con 0x7f7890101400 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f7895086640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7890110fa0 con 0x7f7890100a60 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f788f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f788f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58008/0 (socket says 172.21.15.52:58008) 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f788f59e640 1 -- 172.21.15.52:0/1141565896 learned_addr learned my addr 172.21.15.52:0/1141565896 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.333+0000 7f788ed9d640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 0x7f78901972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:10.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788e59c640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 0x7f78901977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 -- 172.21.15.52:0/1141565896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 msgr2=0x7f78901972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 0x7f78901972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 -- 172.21.15.52:0/1141565896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 msgr2=0x7f78901977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 0x7f78901977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 -- 172.21.15.52:0/1141565896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789019c250 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f788f59e640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f788800cce0 tx=0x7f788800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788800f450 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f789019c540 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f788800fad0 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7888018b60 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.334+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78901a3e20 con 0x7f7890106a60 2024-09-19T09:26:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.335+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7890100ec0 con 0x7f7890106a60 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.337+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f788800fc80 con 0x7f7890106a60 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.337+0000 7f7877fff640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 0x7f78780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.337+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f78880d01a0 con 0x7f7890106a60 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.337+0000 7f788ed9d640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 0x7f78780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.338+0000 7f788ed9d640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 0x7f78780a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7880009900 tx=0x7f78800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.340+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7888014030 con 0x7f7890106a60 2024-09-19T09:26:10.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.555+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7890198600 con 0x7f7890106a60 2024-09-19T09:26:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.556+0000 7f7877fff640 1 -- 172.21.15.52:0/1141565896 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f7890198600 con 0x7f7890106a60 2024-09-19T09:26:10.557 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:26:10.557 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:26:10.557 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 msgr2=0x7f78780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 0x7f78780a5700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7880009900 tx=0x7f78800058d0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 msgr2=0x7f789019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f788800cce0 tx=0x7f788800a620 comp rx=0 tx=0).stop 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 shutdown_connections 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7890106a60 0x7f789019bb70 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7890101400 0x7f78901977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78780a3240 0x7f78780a5700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 --2- 172.21.15.52:0/1141565896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7890100a60 0x7f78901972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.558+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 >> 172.21.15.52:0/1141565896 conn(0x7f78900fc780 msgr2=0x7f78900fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.559+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 shutdown_connections 2024-09-19T09:26:10.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:10.559+0000 7f7895086640 1 -- 172.21.15.52:0/1141565896 wait complete. 2024-09-19T09:26:10.880 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:10 smithi052 ceph-mon[30947]: pgmap v480: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T09:26:10.880 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:10 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1141565896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:10.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:10 smithi169 ceph-mon[35454]: pgmap v480: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T09:26:10.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:10 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1141565896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:10 smithi086 ceph-mon[34813]: pgmap v480: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-19T09:26:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:10 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1141565896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:11.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:26:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:11.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 -- 172.21.15.52:0/1264478540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 msgr2=0x7f285010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:11.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 --2- 172.21.15.52:0/1264478540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f285010da40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f2848009900 tx=0x7f284802a480 comp rx=0 tx=0).stop 2024-09-19T09:26:11.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 -- 172.21.15.52:0/1264478540 shutdown_connections 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 --2- 172.21.15.52:0/1264478540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f285010da40 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 --2- 172.21.15.52:0/1264478540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 --2- 172.21.15.52:0/1264478540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 0x7f2850101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 -- 172.21.15.52:0/1264478540 >> 172.21.15.52:0/1264478540 conn(0x7f28500fc7d0 msgr2=0x7f28500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 -- 172.21.15.52:0/1264478540 shutdown_connections 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 -- 172.21.15.52:0/1264478540 wait complete. 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.968+0000 7f285813d640 1 Processor -- start 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 -- start start 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 0x7f28500fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2850110f80 con 0x7f2850102ef0 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2850110e00 con 0x7f2850102570 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f285813d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2850111100 con 0x7f2850100e20 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58020/0 (socket says 172.21.15.52:58020) 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 -- 172.21.15.52:0/2566459307 learned_addr learned my addr 172.21.15.52:0/2566459307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:11.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f2855ed9640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 0x7f28500fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28556d8640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 -- 172.21.15.52:0/2566459307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 msgr2=0x7f28500fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 0x7f28500fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 -- 172.21.15.52:0/2566459307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 msgr2=0x7f28500fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28500fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28566da640 1 -- 172.21.15.52:0/2566459307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28501a69a0 con 0x7f2850102ef0 2024-09-19T09:26:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.969+0000 7f28556d8640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28500fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f28566da640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2848005ab0 tx=0x7f2848003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f284effd640 1 -- 172.21.15.52:0/2566459307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284803f070 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28501a6c30 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f284effd640 1 -- 172.21.15.52:0/2566459307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2848031e30 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f284effd640 1 -- 172.21.15.52:0/2566459307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848035030 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.970+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28501a7160 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.972+0000 7f284effd640 1 -- 172.21.15.52:0/2566459307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2848042070 con 0x7f2850102ef0 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 Processor -- start 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 -- start start 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 0x56093e0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0dbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56093e02c2f0 con 0x56093e0c65d0 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56093dfd3cf0 con 0x56093e0d9b80 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f285a516740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56093e0282b0 con 0x56093e0c7b40 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58026/0 (socket says 172.21.15.52:58026) 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f2855ed9640 1 -- 172.21.15.52:0/2159547979 learned_addr learned my addr 172.21.15.52:0/2159547979 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f28556d8640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 0x56093e0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.973+0000 7f284effd640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 0x7f28380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f28556d8640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0dbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 -- 172.21.15.52:0/2159547979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 msgr2=0x56093e0c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 0x56093e0c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 -- 172.21.15.52:0/2159547979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 msgr2=0x56093e0dbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0dbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:11.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 -- 172.21.15.52:0/2159547979 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56093dfb83a0 con 0x56093e0c65d0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f28556d8640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 0x56093e0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f28566da640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 0x7f28380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f284effd640 1 -- 172.21.15.52:0/2566459307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f28480f0280 con 0x7f2850102ef0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2855ed9640 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f284000af30 tx=0x7f284000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e187a013996ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2837fff640 1 -- 172.21.15.52:0/2159547979 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840010900 con 0x56093e0c65d0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2837fff640 1 -- 172.21.15.52:0/2159547979 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2840018430 con 0x56093e0c65d0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.974+0000 7f2837fff640 1 -- 172.21.15.52:0/2159547979 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840017640 con 0x56093e0c65d0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- 172.21.15.52:0/2159547979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 msgr2=0x56093e0c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f28566da640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 0x7f28380a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f28480b8c20 tx=0x7f28480e7590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f284000af30 tx=0x7f284000f850 comp rx=0 tx=0).stop 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- 172.21.15.52:0/2159547979 shutdown_connections 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0dbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c65d0 0x56093e0c6a10 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 --2- 172.21.15.52:0/2159547979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c7b40 0x56093e0c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- 172.21.15.52:0/2159547979 >> 172.21.15.52:0/2159547979 conn(0x56093e08f310 msgr2=0x56093e0c2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- 172.21.15.52:0/2159547979 shutdown_connections 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- 172.21.15.52:0/2159547979 wait complete. 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 -- start start 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.975+0000 7f285a516740 1 Processor -- start 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0d94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 0x56093e0d6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56093e0dc880 con 0x56093e0d9b80 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56093dfe7060 con 0x56093e0c7b40 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56093e0dca00 con 0x56093e0c65d0 2024-09-19T09:26:12.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f285a516740 10 client.0 _ll_register_callbacks cb 0x56093dd3a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58028/0 (socket says 172.21.15.52:58028) 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 -- 172.21.15.52:0/383735139 learned_addr learned my addr 172.21.15.52:0/383735139 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f2855ed9640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 0x56093e0d6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0d94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 -- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 msgr2=0x56093e0d94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0d94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 -- 172.21.15.52:0/383735139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 msgr2=0x56093e0d6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 0x56093e0d6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 -- 172.21.15.52:0/383735139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56093dd9d3c0 con 0x56093e0d9b80 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f2855ed9640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 0x56093e0d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28556d8640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2844013c00 tx=0x7f284400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bb1e8988b78830 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.976+0000 7f28357fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28440132d0 con 0x56093e0d9b80 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2840018430 con 0x56093e0d9b80 2024-09-19T09:26:12.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2844004020 con 0x56093e0d9b80 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2844024050 con 0x56093e0d9b80 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 10 client.17001 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56093e0e8350 con 0x56093e0d9b80 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2840018430 con 0x56093e0d9b80 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f284400f5d0 con 0x56093e0d9b80 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 10 client.17001 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 20 client.17001 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e0e9760 0x56093e0ebba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 4 client.17001 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:12.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.977+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56093e039860 con 0x56093e0e9760 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.978+0000 7f2855ed9640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e0e9760 0x56093e0ebba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.978+0000 7f2855ed9640 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e0e9760 0x56093e0ebba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=361d4c0aa2621557 server_cookie=bc8f9f638016cbde in_seq=0 out_seq=0 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.978+0000 7f28357fa640 10 client.17001 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f28357fa640 1 -- 172.21.15.52:0/383735139 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56093e039860 con 0x56093e0e9760 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f28357fa640 10 client.17001 handle_command_reply: tid=0 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 client.17001 shutdown 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 msgr2=0x56093e0d6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2844013c00 tx=0x7f284400e3c0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 shutdown_connections 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e0e9760 0x56093e0ebba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0d9b80 0x56093e0d6cf0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c7b40 0x56093e0d6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 --2- 172.21.15.52:0/383735139 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0d94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f28357fa640 0 client.17001 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 >> 172.21.15.52:0/383735139 conn(0x56093e08f310 msgr2=0x56093e0c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 shutdown_connections 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 1 -- 172.21.15.52:0/383735139 wait complete. 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.979+0000 7f285a516740 20 client.17001 trim_cache size 0 max 16384 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 Processor -- start 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 -- start start 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f28501ade70 con 0x56093e0c7b40 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f28501ab740 con 0x56093e0d9b80 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.992+0000 7f285a516740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28501a9590 con 0x56093e0c65d0 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58032/0 (socket says 172.21.15.52:58032) 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 -- 172.21.15.52:0/1687058093 learned_addr learned my addr 172.21.15.52:0/1687058093 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 -- 172.21.15.52:0/1687058093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 msgr2=0x56093e0e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 -- 172.21.15.52:0/1687058093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 msgr2=0x56093e0f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f28556d8640 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0f1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 -- 172.21.15.52:0/1687058093 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56093e0c9120 con 0x56093e0c7b40 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f2855ed9640 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f284000af30 tx=0x7f2840012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc382781a497db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f28377fe640 1 -- 172.21.15.52:0/1687058093 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840018430 con 0x56093e0c7b40 2024-09-19T09:26:12.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f28377fe640 1 -- 172.21.15.52:0/1687058093 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2840030070 con 0x56093e0c7b40 2024-09-19T09:26:12.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.993+0000 7f28377fe640 1 -- 172.21.15.52:0/1687058093 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840010960 con 0x56093e0c7b40 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- 172.21.15.52:0/1687058093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 msgr2=0x56093e0d5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f284000af30 tx=0x7f2840012040 comp rx=0 tx=0).stop 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- 172.21.15.52:0/1687058093 shutdown_connections 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0d9b80 0x56093e0f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0d5770 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 --2- 172.21.15.52:0/1687058093 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0c65d0 0x56093e0e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- 172.21.15.52:0/1687058093 >> 172.21.15.52:0/1687058093 conn(0x56093e08f310 msgr2=0x56093e0d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- 172.21.15.52:0/1687058093 shutdown_connections 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- 172.21.15.52:0/1687058093 wait complete. 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.994+0000 7f285a516740 1 -- start start 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 Processor -- start 2024-09-19T09:26:12.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c65d0 0x56093e0e2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0d9b80 0x56093e0ddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f28501a9c00 con 0x56093e0c7b40 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f28501ab070 con 0x56093e0c65d0 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f28501aa2d0 con 0x56093e0d9b80 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f285a516740 10 client.0 _ll_register_callbacks cb 0x7f2844013810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58040/0 (socket says 172.21.15.52:58040) 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 -- 172.21.15.52:0/3460336592 learned_addr learned my addr 172.21.15.52:0/3460336592 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f28556d8640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c65d0 0x56093e0e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f28556d8640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0d9b80 0x56093e0ddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 -- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0d9b80 msgr2=0x56093e0ddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0d9b80 0x56093e0ddb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 -- 172.21.15.52:0/3460336592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c65d0 msgr2=0x56093e0e2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c65d0 0x56093e0e2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.995+0000 7f2855ed9640 1 -- 172.21.15.52:0/3460336592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56093e0de280 con 0x56093e0c7b40 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f2855ed9640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2840005c40 tx=0x7f2840004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3a92e7761cb724 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840038020 con 0x56093e0c7b40 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f28400186e0 con 0x56093e0c7b40 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2840030070 con 0x56093e0c7b40 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f28400188e0 con 0x56093e0c7b40 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 10 client.17007 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56093e154320 con 0x56093e0c7b40 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2840030070 con 0x56093e0c7b40 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2840010c00 con 0x56093e0c7b40 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 10 client.17007 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 10 client.17007 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 20 client.17007 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.996+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e154890 0x56093e156c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.997+0000 7f285a516740 4 client.17007 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.997+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56093e033d70 con 0x56093e154890 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.997+0000 7f28556d8640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e154890 0x56093e156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:12.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.997+0000 7f28556d8640 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e154890 0x56093e156c80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=662f786554562d41 server_cookie=a64e743bb82ac37a in_seq=0 out_seq=0 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.997+0000 7f28357fa640 10 client.17007 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f28357fa640 1 -- 172.21.15.52:0/3460336592 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56093e033d70 con 0x56093e154890 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f28357fa640 10 client.17007 handle_command_reply: tid=0 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 client.17007 shutdown 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 msgr2=0x56093e0dd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2840005c40 tx=0x7f2840004a60 comp rx=0 tx=0).stop 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 shutdown_connections 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56093e154890 0x56093e156c80 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56093e0d9b80 0x56093e0ddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56093e0c7b40 0x56093e0dd650 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 --2- 172.21.15.52:0/3460336592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56093e0c65d0 0x56093e0e2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f28357fa640 0 client.17007 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:12.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 >> 172.21.15.52:0/3460336592 conn(0x56093e08f310 msgr2=0x56093e0d5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 shutdown_connections 2024-09-19T09:26:12.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 1 -- 172.21.15.52:0/3460336592 wait complete. 2024-09-19T09:26:12.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.998+0000 7f285a516740 20 client.17007 trim_cache size 0 max 16384 2024-09-19T09:26:12.018 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:12.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 msgr2=0x7f28380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 0x7f28380a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f28480b8c20 tx=0x7f28480e7590 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 msgr2=0x7f28500fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2848005ab0 tx=0x7f2848003c30 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 shutdown_connections 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2850102ef0 0x7f28500fd700 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2850102570 0x7f28500fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f28380a3240 0x7f28380a5700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 --2- 172.21.15.52:0/2566459307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2850100e20 0x7f28500fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:12.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 >> 172.21.15.52:0/2566459307 conn(0x7f28500fc7d0 msgr2=0x7f285006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:12.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 shutdown_connections 2024-09-19T09:26:12.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:11.999+0000 7f285813d640 1 -- 172.21.15.52:0/2566459307 wait complete. 2024-09-19T09:26:12.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:12 smithi052 ceph-mon[30947]: pgmap v481: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:26:12.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:26:12.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:12 smithi169 ceph-mon[35454]: pgmap v481: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:26:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:12 smithi086 ceph-mon[34813]: pgmap v481: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:26:13.049 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 -- 172.21.15.52:0/2870710294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834102790 msgr2=0x7f78341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 --2- 172.21.15.52:0/2870710294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834102790 0x7f78341067e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f781c009900 tx=0x7f781c02a410 comp rx=0 tx=0).stop 2024-09-19T09:26:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 -- 172.21.15.52:0/2870710294 shutdown_connections 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 --2- 172.21.15.52:0/2870710294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834106f10 0x7f783410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 --2- 172.21.15.52:0/2870710294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834102790 0x7f78341067e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 --2- 172.21.15.52:0/2870710294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834101de0 0x7f78341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 -- 172.21.15.52:0/2870710294 >> 172.21.15.52:0/2870710294 conn(0x7f78340fd8c0 msgr2=0x7f78340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 -- 172.21.15.52:0/2870710294 shutdown_connections 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.535+0000 7f7839689640 1 -- 172.21.15.52:0/2870710294 wait complete. 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 Processor -- start 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 -- start start 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834101de0 0x7f7834198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834102790 0x7f78341989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7834111f70 con 0x7f7834106f10 2024-09-19T09:26:13.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7834111df0 con 0x7f7834102790 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.536+0000 7f7839689640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78341120f0 con 0x7f7834101de0 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58062/0 (socket says 172.21.15.52:58062) 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 -- 172.21.15.52:0/1152733601 learned_addr learned my addr 172.21.15.52:0/1152733601 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f782a7fc640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834102790 0x7f78341989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f7832ffd640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834101de0 0x7f7834198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 -- 172.21.15.52:0/1152733601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834101de0 msgr2=0x7f7834198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834101de0 0x7f7834198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 -- 172.21.15.52:0/1152733601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834102790 msgr2=0x7f78341989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834102790 0x7f78341989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 -- 172.21.15.52:0/1152733601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783419d440 con 0x7f7834106f10 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f78337fe640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f782c00eb10 tx=0x7f782c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f7830ff9640 1 -- 172.21.15.52:0/1152733601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c004b20 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f7830ff9640 1 -- 172.21.15.52:0/1152733601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f782c004cc0 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783419d730 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.537+0000 7f7830ff9640 1 -- 172.21.15.52:0/1152733601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c010760 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.538+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78341a5010 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.540+0000 7f7830ff9640 1 -- 172.21.15.52:0/1152733601 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f782c005020 con 0x7f7834106f10 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.540+0000 7f783ba62740 1 Processor -- start 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.540+0000 7f783ba62740 1 -- start start 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f469090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f476760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d00f3cf2f0 con 0x55d00f4695d0 2024-09-19T09:26:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d00f376cf0 con 0x55d00f46ab40 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f783ba62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d00f3cb2b0 con 0x55d00f474370 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58074/0 (socket says 172.21.15.52:58074) 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 -- 172.21.15.52:0/3256423563 learned_addr learned my addr 172.21.15.52:0/3256423563 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7830ff9640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 0x7f78200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f476760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f469090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7830ff9640 1 -- 172.21.15.52:0/1152733601 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f782c0cffd0 con 0x7f7834106f10 2024-09-19T09:26:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 -- 172.21.15.52:0/3256423563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 msgr2=0x55d00f476760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f476760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 -- 172.21.15.52:0/3256423563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 msgr2=0x55d00f469090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f469090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f78337fe640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 0x7f78200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 -- 172.21.15.52:0/3256423563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00f35b3a0 con 0x55d00f4695d0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f476760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.541+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f782400ac20 tx=0x7f782400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f9b5f93a500a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f78337fe640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 0x7f78200a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f782c005ba0 tx=0x7f782c00efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f78297fa640 1 -- 172.21.15.52:0/3256423563 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782401d070 con 0x55d00f4695d0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f78297fa640 1 -- 172.21.15.52:0/3256423563 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7824018b20 con 0x55d00f4695d0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f78297fa640 1 -- 172.21.15.52:0/3256423563 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824010c00 con 0x55d00f4695d0 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 -- 172.21.15.52:0/3256423563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 msgr2=0x55d00f469a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f782400ac20 tx=0x7f782400f790 comp rx=0 tx=0).stop 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 -- 172.21.15.52:0/3256423563 shutdown_connections 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f476760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f469a10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 --2- 172.21.15.52:0/3256423563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f469090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 -- 172.21.15.52:0/3256423563 >> 172.21.15.52:0/3256423563 conn(0x55d00f432310 msgr2=0x55d00f465c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 -- 172.21.15.52:0/3256423563 shutdown_connections 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.542+0000 7f783ba62740 1 -- 172.21.15.52:0/3256423563 wait complete. 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 -- start start 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 Processor -- start 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f471000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f4715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d00f477070 con 0x55d00f4695d0 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d00f38a060 con 0x55d00f46ab40 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d00f4771f0 con 0x55d00f474370 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f783ba62740 10 client.0 _ll_register_callbacks cb 0x55d00f0dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58090/0 (socket says 172.21.15.52:58090) 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f782a7fc640 1 -- 172.21.15.52:0/4226376378 learned_addr learned my addr 172.21.15.52:0/4226376378 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f7832ffd640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f471000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.543+0000 7f782a7fc640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f4715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 -- 172.21.15.52:0/4226376378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 msgr2=0x55d00f4715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f4715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 -- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 msgr2=0x55d00f471000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f471000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 -- 172.21.15.52:0/4226376378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00f1403c0 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f782a7fc640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f781c009900 tx=0x7f781c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbb86a63a1ce033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f781a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c035070 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f781c004450 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7824018b20 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f781c005020 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f783ba62740 10 client.17019 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d00f482af0 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.544+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7824018b20 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f781c0035f0 con 0x55d00f4695d0 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 10 client.17019 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 10 client.17019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:26:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 20 client.17019 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f483f00 0x55d00f4862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 4 client.17019 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d00f3dc860 con 0x55d00f483f00 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f7832ffd640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f483f00 0x55d00f4862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f7832ffd640 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f483f00 0x55d00f4862f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4f934bd16096094 server_cookie=44508c79772c144b in_seq=0 out_seq=0 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.545+0000 7f781a7fc640 10 client.17019 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f781a7fc640 1 -- 172.21.15.52:0/4226376378 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d00f3dc860 con 0x55d00f483f00 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f781a7fc640 10 client.17019 handle_command_reply: tid=0 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 client.17019 shutdown 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 msgr2=0x55d00f473d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f781c009900 tx=0x7f781c009260 comp rx=0 tx=0).stop 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 shutdown_connections 2024-09-19T09:26:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f4715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f483f00 0x55d00f4862f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f471000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 --2- 172.21.15.52:0/4226376378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f473d50 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f781a7fc640 0 client.17019 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.546+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 >> 172.21.15.52:0/4226376378 conn(0x55d00f432310 msgr2=0x55d00f46b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.547+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 shutdown_connections 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.547+0000 7f783ba62740 1 -- 172.21.15.52:0/4226376378 wait complete. 2024-09-19T09:26:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.547+0000 7f783ba62740 20 client.17019 trim_cache size 0 max 16384 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.560+0000 7f783ba62740 1 Processor -- start 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.560+0000 7f783ba62740 1 -- start start 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f46c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f48bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78341b0040 con 0x55d00f4695d0 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78341ad910 con 0x55d00f46ab40 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f783ba62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78341ab760 con 0x55d00f474370 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58096/0 (socket says 172.21.15.52:58096) 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 -- 172.21.15.52:0/3230908474 learned_addr learned my addr 172.21.15.52:0/3230908474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f46c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 -- 172.21.15.52:0/3230908474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 msgr2=0x55d00f48bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f48bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 -- 172.21.15.52:0/3230908474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 msgr2=0x55d00f46c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f46c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 -- 172.21.15.52:0/3230908474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00f46a300 con 0x55d00f4695d0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f781c006010 tx=0x7f781c009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222d0e32ef4a9873 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.561+0000 7f7828ff9640 1 -- 172.21.15.52:0/3230908474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c035050 con 0x55d00f4695d0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f7828ff9640 1 -- 172.21.15.52:0/3230908474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f781c003c00 con 0x55d00f4695d0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f7828ff9640 1 -- 172.21.15.52:0/3230908474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c031bb0 con 0x55d00f4695d0 2024-09-19T09:26:13.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 -- 172.21.15.52:0/3230908474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 msgr2=0x55d00f46c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f781c006010 tx=0x7f781c009830 comp rx=0 tx=0).stop 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 -- 172.21.15.52:0/3230908474 shutdown_connections 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f474370 0x55d00f48bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f46ab40 0x55d00f46c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 --2- 172.21.15.52:0/3230908474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f4695d0 0x55d00f46c120 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 -- 172.21.15.52:0/3230908474 >> 172.21.15.52:0/3230908474 conn(0x55d00f432310 msgr2=0x55d00f464d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 -- 172.21.15.52:0/3230908474 shutdown_connections 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.562+0000 7f783ba62740 1 -- 172.21.15.52:0/3230908474 wait complete. 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 -- start start 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 Processor -- start 2024-09-19T09:26:13.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f4695d0 0x55d00f47c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f46ab40 0x55d00f47c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78341abdd0 con 0x55d00f474370 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78341ad240 con 0x55d00f4695d0 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f78341ac4a0 con 0x55d00f46ab40 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f783ba62740 10 client.0 _ll_register_callbacks cb 0x7f781c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f782a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58106/0 (socket says 172.21.15.52:58106) 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f782a7fc640 1 -- 172.21.15.52:0/3080759777 learned_addr learned my addr 172.21.15.52:0/3080759777 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f46ab40 0x55d00f47c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.563+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f4695d0 0x55d00f47c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 -- 172.21.15.52:0/3080759777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f46ab40 msgr2=0x55d00f47c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f46ab40 0x55d00f47c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 -- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f4695d0 msgr2=0x55d00f47c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f4695d0 0x55d00f47c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 -- 172.21.15.52:0/3080759777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00f479990 con 0x55d00f474370 2024-09-19T09:26:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f782a7fc640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f781c009610 tx=0x7f781c005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6535c18ec3978ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:13.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.564+0000 7f781a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:13.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c035070 con 0x55d00f474370 2024-09-19T09:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f781c0053c0 con 0x55d00f474370 2024-09-19T09:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f781c003c00 con 0x55d00f474370 2024-09-19T09:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f781c0055c0 con 0x55d00f474370 2024-09-19T09:26:13.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 10 client.17025 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d00f4ef290 con 0x55d00f474370 2024-09-19T09:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f781c003c00 con 0x55d00f474370 2024-09-19T09:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f781c04a7a0 con 0x55d00f474370 2024-09-19T09:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 10 client.17025 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:13.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 10 client.17025 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 20 client.17025 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f4ef8a0 0x55d00f4f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 4 client.17025 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.566+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d00f3d6d70 con 0x55d00f4ef8a0 2024-09-19T09:26:13.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f4ef8a0 0x55d00f4f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f781a7fc640 10 client.17025 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f7832ffd640 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f4ef8a0 0x55d00f4f1cc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bccc56c8a37cbff4 server_cookie=db5c729837609b15 in_seq=0 out_seq=0 2024-09-19T09:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f781a7fc640 1 -- 172.21.15.52:0/3080759777 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d00f3d6d70 con 0x55d00f4ef8a0 2024-09-19T09:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f781a7fc640 10 client.17025 handle_command_reply: tid=0 2024-09-19T09:26:13.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f783ba62740 1 client.17025 shutdown 2024-09-19T09:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 msgr2=0x55d00f479450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.567+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f781c009610 tx=0x7f781c005950 comp rx=0 tx=0).stop 2024-09-19T09:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 shutdown_connections 2024-09-19T09:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d00f474370 0x55d00f479450 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d00f46ab40 0x55d00f47c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55d00f4ef8a0 0x55d00f4f1cc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 --2- 172.21.15.52:0/3080759777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d00f4695d0 0x55d00f47c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 >> 172.21.15.52:0/3080759777 conn(0x55d00f432310 msgr2=0x55d00f472860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f781a7fc640 0 client.17025 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 shutdown_connections 2024-09-19T09:26:13.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 1 -- 172.21.15.52:0/3080759777 wait complete. 2024-09-19T09:26:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f783ba62740 20 client.17025 trim_cache size 0 max 16384 2024-09-19T09:26:13.579 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 msgr2=0x7f78200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 0x7f78200a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f782c005ba0 tx=0x7f782c00efd0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 msgr2=0x7f783419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f782c00eb10 tx=0x7f782c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 shutdown_connections 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834106f10 0x7f783419cd60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7834102790 0x7f78341989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f78200a3240 0x7f78200a5700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 --2- 172.21.15.52:0/1152733601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7834101de0 0x7f7834198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.568+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 >> 172.21.15.52:0/1152733601 conn(0x7f78340fd8c0 msgr2=0x7f78340fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.569+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 shutdown_connections 2024-09-19T09:26:13.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:13.569+0000 7f7839689640 1 -- 172.21.15.52:0/1152733601 wait complete. 2024-09-19T09:26:14.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:26:14.635 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:14.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:14 smithi052 ceph-mon[30947]: pgmap v482: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:14 smithi169 ceph-mon[35454]: pgmap v482: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:14 smithi086 ceph-mon[34813]: pgmap v482: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.136+0000 7fdbed69c640 1 -- 172.21.15.52:0/3551397094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8103660 msgr2=0x7fdbe810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.136+0000 7fdbed69c640 1 --2- 172.21.15.52:0/3551397094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8103660 0x7fdbe810bb50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009900 tx=0x7fdbdc02a480 comp rx=0 tx=0).stop 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 -- 172.21.15.52:0/3551397094 shutdown_connections 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 --2- 172.21.15.52:0/3551397094 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 --2- 172.21.15.52:0/3551397094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8103660 0x7fdbe810bb50 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 --2- 172.21.15.52:0/3551397094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8102d40 0x7fdbe8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 -- 172.21.15.52:0/3551397094 >> 172.21.15.52:0/3551397094 conn(0x7fdbe80fc7a0 msgr2=0x7fdbe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 -- 172.21.15.52:0/3551397094 shutdown_connections 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 -- 172.21.15.52:0/3551397094 wait complete. 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 Processor -- start 2024-09-19T09:26:15.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.137+0000 7fdbed69c640 1 -- start start 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8103660 0x7fdbe8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8111f70 con 0x7fdbe8102d40 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8111df0 con 0x7fdbe810c170 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81120f0 con 0x7fdbe8103660 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58116/0 (socket says 172.21.15.52:58116) 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/4172913050 learned_addr learned my addr 172.21.15.52:0/4172913050 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8103660 0x7fdbe8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/4172913050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8103660 msgr2=0x7fdbe8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8103660 0x7fdbe8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/4172913050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 msgr2=0x7fdbe819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/4172913050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe819d480 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800e9f0 tx=0x7fdbd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbcffff640 1 -- 172.21.15.52:0/4172913050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800cd80 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbcffff640 1 -- 172.21.15.52:0/4172913050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbd8005500 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe819d770 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.138+0000 7fdbcffff640 1 -- 172.21.15.52:0/4172913050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8010690 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.139+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe81a5050 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbcffff640 1 -- 172.21.15.52:0/4172913050 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdbd80046c0 con 0x7fdbe8102d40 2024-09-19T09:26:15.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 Processor -- start 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 -- start start 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd36978a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36985760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cd368de2f0 con 0x55cd36979b40 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cd36885cf0 con 0x55cd369785d0 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.141+0000 7fdbefa75740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd368da2b0 con 0x55cd36983370 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58126/0 (socket says 172.21.15.52:58126) 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 -- 172.21.15.52:0/4224298602 learned_addr learned my addr 172.21.15.52:0/4224298602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:15.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd36978a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36985760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbcffff640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 0x7fdbd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 -- 172.21.15.52:0/4224298602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 msgr2=0x55cd36985760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36985760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 -- 172.21.15.52:0/4224298602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 msgr2=0x55cd36978a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd36978a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 -- 172.21.15.52:0/4224298602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3686a3a0 con 0x55cd36979b40 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbcffff640 1 -- 172.21.15.52:0/4172913050 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbd80cfe80 con 0x7fdbe8102d40 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 0x7fdbd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009f10 tx=0x7fdbe000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca6e1404d84e307 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.142+0000 7fdbcd7fa640 1 -- 172.21.15.52:0/4224298602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0011a40 con 0x55cd36979b40 2024-09-19T09:26:15.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbcd7fa640 1 -- 172.21.15.52:0/4224298602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbe0011c60 con 0x55cd36979b40 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbcd7fa640 1 -- 172.21.15.52:0/4224298602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0010e50 con 0x55cd36979b40 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 -- 172.21.15.52:0/4224298602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 msgr2=0x55cd36978090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009f10 tx=0x7fdbe000f730 comp rx=0 tx=0).stop 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 0x7fdbd00a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdbe001e000 tx=0x7fdbe0021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 -- 172.21.15.52:0/4224298602 shutdown_connections 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36985760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd36978a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 --2- 172.21.15.52:0/4224298602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36978090 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 -- 172.21.15.52:0/4224298602 >> 172.21.15.52:0/4224298602 conn(0x55cd36941310 msgr2=0x55cd36974c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 -- 172.21.15.52:0/4224298602 shutdown_connections 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.143+0000 7fdbefa75740 1 -- 172.21.15.52:0/4224298602 wait complete. 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 -- start start 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 Processor -- start 2024-09-19T09:26:15.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd369785d0 0x55cd36982d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 0x55cd36980690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cd36986070 con 0x55cd36979b40 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cd36899060 con 0x55cd36983370 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cd369861f0 con 0x55cd369785d0 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbefa75740 10 client.0 _ll_register_callbacks cb 0x55cd365ec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58134/0 (socket says 172.21.15.52:58134) 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 -- 172.21.15.52:0/2410664822 learned_addr learned my addr 172.21.15.52:0/2410664822 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 0x55cd36980690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd369785d0 0x55cd36982d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 -- 172.21.15.52:0/2410664822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd369785d0 msgr2=0x55cd36982d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd369785d0 0x55cd36982d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 -- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 msgr2=0x55cd36980690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 0x55cd36980690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.144+0000 7fdbe67fc640 1 -- 172.21.15.52:0/2410664822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd3664f3c0 con 0x55cd36979b40 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 0x55cd36980690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc02a9a0 tx=0x7fdbdc0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2ddba8d2ab6492 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc035040 con 0x55cd36979b40 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbdc004040 con 0x55cd36979b40 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbe0011c60 con 0x55cd36979b40 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbdc004240 con 0x55cd36979b40 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 10 client.17037 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:15.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cd36991b10 con 0x55cd36979b40 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbe0011c60 con 0x55cd36979b40 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbdc0504a0 con 0x55cd36979b40 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 10 client.17037 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.145+0000 7fdbefa75740 20 client.17037 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd36992f70 0x55cd369953d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbefa75740 4 client.17037 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd368eb860 con 0x55cd36992f70 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd36992f70 0x55cd369953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd36992f70 0x55cd369953d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06b50348913628a server_cookie=9a6ec55ad3050742 in_seq=0 out_seq=0 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.146+0000 7fdbcaff5640 10 client.17037 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbcaff5640 1 -- 172.21.15.52:0/2410664822 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd368eb860 con 0x55cd36992f70 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbcaff5640 10 client.17037 handle_command_reply: tid=0 2024-09-19T09:26:15.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 client.17037 shutdown 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 msgr2=0x55cd36980030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc02a9a0 tx=0x7fdbdc0317e0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 shutdown_connections 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd36992f70 0x55cd369953d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36983370 0x55cd36980690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36980030 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbcaff5640 0 client.17037 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 --2- 172.21.15.52:0/2410664822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd369785d0 0x55cd36982d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 >> 172.21.15.52:0/2410664822 conn(0x55cd36941310 msgr2=0x55cd3697a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 shutdown_connections 2024-09-19T09:26:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 1 -- 172.21.15.52:0/2410664822 wait complete. 2024-09-19T09:26:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.147+0000 7fdbefa75740 20 client.17037 trim_cache size 0 max 16384 2024-09-19T09:26:15.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 Processor -- start 2024-09-19T09:26:15.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 -- start start 2024-09-19T09:26:15.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 0x55cd3697f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd3697b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81b0120 con 0x55cd369785d0 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81ad9f0 con 0x55cd36979b40 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbefa75740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81ab840 con 0x55cd36983370 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.160+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58146/0 (socket says 172.21.15.52:58146) 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/424047698 learned_addr learned my addr 172.21.15.52:0/424047698 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 0x55cd3697f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd3697b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/424047698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 msgr2=0x55cd3697b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd3697b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/424047698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 msgr2=0x55cd3697f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 0x55cd3697f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 -- 172.21.15.52:0/424047698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd36978be0 con 0x55cd369785d0 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 0x55cd3697f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8004c00 tx=0x7fdbd8098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475b8774f6c7569d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbccff9640 1 -- 172.21.15.52:0/424047698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd809bf00 con 0x55cd369785d0 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbccff9640 1 -- 172.21.15.52:0/424047698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbd809cac0 con 0x55cd369785d0 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.161+0000 7fdbccff9640 1 -- 172.21.15.52:0/424047698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd809bd20 con 0x55cd369785d0 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- 172.21.15.52:0/424047698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 msgr2=0x55cd3698f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8004c00 tx=0x7fdbd8098040 comp rx=0 tx=0).stop 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- 172.21.15.52:0/424047698 shutdown_connections 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd3697b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd36979b40 0x55cd3697f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 --2- 172.21.15.52:0/424047698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd369785d0 0x55cd3698f310 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- 172.21.15.52:0/424047698 >> 172.21.15.52:0/424047698 conn(0x55cd36941310 msgr2=0x55cd3697f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- 172.21.15.52:0/424047698 shutdown_connections 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- 172.21.15.52:0/424047698 wait complete. 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 -- start start 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.162+0000 7fdbefa75740 1 Processor -- start 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd3698b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36987220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81abeb0 con 0x55cd36979b40 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81ad320 con 0x55cd369785d0 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81ac580 con 0x55cd36983370 2024-09-19T09:26:15.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbefa75740 10 client.0 _ll_register_callbacks cb 0x7fdbd8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58162/0 (socket says 172.21.15.52:58162) 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 -- 172.21.15.52:0/1396901526 learned_addr learned my addr 172.21.15.52:0/1396901526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd3698b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36987220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 -- 172.21.15.52:0/1396901526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 msgr2=0x55cd36987220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36987220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 -- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 msgr2=0x55cd3698b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd3698b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 -- 172.21.15.52:0/1396901526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd36987810 con 0x55cd36979b40 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe77fe640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36987220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbe67fc640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0508f0 tx=0x7fdbdc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df473f0f7fe09e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:15.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.163+0000 7fdbcaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc035070 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd809cac0 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbdc050ae0 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbdc060050 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 10 client.17043 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cd369fda50 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbd809cac0 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbdc004750 con 0x55cd36979b40 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 10 client.17043 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 20 client.17043 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd369fe170 0x55cd36a00590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:15.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 4 client.17043 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd368e5d70 con 0x55cd369fe170 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.164+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd369fe170 0x55cd36a00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbe6ffd640 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd369fe170 0x55cd36a00590 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b14702d694fd5889 server_cookie=eb41c25ea77e5b8 in_seq=0 out_seq=0 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbcaff5640 10 client.17043 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbcaff5640 1 -- 172.21.15.52:0/1396901526 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd368e5d70 con 0x55cd369fe170 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbcaff5640 10 client.17043 handle_command_reply: tid=0 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 client.17043 shutdown 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 msgr2=0x55cd36986ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0508f0 tx=0x7fdbdc004610 comp rx=0 tx=0).stop 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 shutdown_connections 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cd369fe170 0x55cd36a00590 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cd36983370 0x55cd36987220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cd36979b40 0x55cd36986ce0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 --2- 172.21.15.52:0/1396901526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cd369785d0 0x55cd3698b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 >> 172.21.15.52:0/1396901526 conn(0x55cd36941310 msgr2=0x55cd369734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbcaff5640 0 client.17043 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 shutdown_connections 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 1 -- 172.21.15.52:0/1396901526 wait complete. 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.165+0000 7fdbefa75740 20 client.17043 trim_cache size 0 max 16384 2024-09-19T09:26:15.175 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 msgr2=0x7fdbd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 0x7fdbd00a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdbe001e000 tx=0x7fdbe0021000 comp rx=0 tx=0).stop 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 msgr2=0x7fdbe81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800e9f0 tx=0x7fdbd800edf0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 shutdown_connections 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbe810c170 0x7fdbe819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbd00a3240 0x7fdbd00a5700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe8103660 0x7fdbe8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 --2- 172.21.15.52:0/4172913050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe8102d40 0x7fdbe81984d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 >> 172.21.15.52:0/4172913050 conn(0x7fdbe80fc7a0 msgr2=0x7fdbe80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 shutdown_connections 2024-09-19T09:26:15.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:15.166+0000 7fdbed69c640 1 -- 172.21.15.52:0/4172913050 wait complete. 2024-09-19T09:26:16.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:16 smithi052 ceph-mon[30947]: pgmap v483: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:26:17.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:26:17.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:26:17.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:16 smithi086 ceph-mon[34813]: pgmap v483: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:26:17.023 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:16 smithi169 ceph-mon[35454]: pgmap v483: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:26:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 -- 172.21.15.52:0/1425695255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4101de0 msgr2=0x7fdda41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 --2- 172.21.15.52:0/1425695255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4101de0 0x7fdda41021c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda002a410 comp rx=0 tx=0).stop 2024-09-19T09:26:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 -- 172.21.15.52:0/1425695255 shutdown_connections 2024-09-19T09:26:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 --2- 172.21.15.52:0/1425695255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4106f10 0x7fdda410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 --2- 172.21.15.52:0/1425695255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 0x7fdda41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 --2- 172.21.15.52:0/1425695255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4101de0 0x7fdda41021c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 -- 172.21.15.52:0/1425695255 >> 172.21.15.52:0/1425695255 conn(0x7fdda40fd8c0 msgr2=0x7fdda40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 -- 172.21.15.52:0/1425695255 shutdown_connections 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.757+0000 7fddac7c9640 1 -- 172.21.15.52:0/1425695255 wait complete. 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 Processor -- start 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 -- start start 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4101de0 0x7fdda4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 0x7fdda4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4111f30 con 0x7fdda4106f10 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdda4111db0 con 0x7fdda4102790 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.758+0000 7fddac7c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41120b0 con 0x7fdda4101de0 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58182/0 (socket says 172.21.15.52:58182) 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 -- 172.21.15.52:0/4284217879 learned_addr learned my addr 172.21.15.52:0/4284217879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaa565640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4101de0 0x7fdda4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 0x7fdda4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 -- 172.21.15.52:0/4284217879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4101de0 msgr2=0x7fdda4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4101de0 0x7fdda4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 -- 172.21.15.52:0/4284217879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 msgr2=0x7fdda4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 0x7fdda4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 -- 172.21.15.52:0/4284217879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda419d4c0 con 0x7fdda4106f10 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddaad66640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00eaa0 tx=0x7fdd9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fdd9b7fe640 1 -- 172.21.15.52:0/4284217879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00cdb0 con 0x7fdda4106f10 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fdd9b7fe640 1 -- 172.21.15.52:0/4284217879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd9c005020 con 0x7fdda4106f10 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda419d7b0 con 0x7fdda4106f10 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fdd9b7fe640 1 -- 172.21.15.52:0/4284217879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0116b0 con 0x7fdda4106f10 2024-09-19T09:26:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.759+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda41a5090 con 0x7fdda4106f10 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.762+0000 7fdd9b7fe640 1 -- 172.21.15.52:0/4284217879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdd9c005560 con 0x7fdda4106f10 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.762+0000 7fddaeba2740 1 Processor -- start 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.762+0000 7fddaeba2740 1 -- start start 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f7ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f8ad40 0x557157f8d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557157ee5280 con 0x557157f80480 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557157e8cb10 con 0x557157f7fb60 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaeba2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557157ee1240 con 0x557157f8ad40 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58194/0 (socket says 172.21.15.52:58194) 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 -- 172.21.15.52:0/748942059 learned_addr learned my addr 172.21.15.52:0/748942059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fdda9d64640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f7ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fdd9b7fe640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 0x7fdd900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fdda9d64640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f8ad40 0x557157f8d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaad66640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 0x7fdd900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fdd9b7fe640 1 -- 172.21.15.52:0/4284217879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdd9c0cfb70 con 0x7fdda4106f10 2024-09-19T09:26:17.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 -- 172.21.15.52:0/748942059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f8ad40 msgr2=0x557157f8d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f8ad40 0x557157f8d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 -- 172.21.15.52:0/748942059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 msgr2=0x557157f7ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f7ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fddaa565640 1 -- 172.21.15.52:0/748942059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557157e991f0 con 0x557157f80480 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.763+0000 7fdda9d64640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.764+0000 7fddaa565640 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97bf2d08b17ad38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.764+0000 7fddaad66640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 0x7fdd900a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c098a80 tx=0x7fdd9c091590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.764+0000 7fdd98ff9640 1 -- 172.21.15.52:0/748942059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0040070 con 0x557157f80480 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.764+0000 7fdd98ff9640 1 -- 172.21.15.52:0/748942059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda00318f0 con 0x557157f80480 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.764+0000 7fdd98ff9640 1 -- 172.21.15.52:0/748942059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0035040 con 0x557157f80480 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- 172.21.15.52:0/748942059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 msgr2=0x557157f8a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda0005e00 comp rx=0 tx=0).stop 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- 172.21.15.52:0/748942059 shutdown_connections 2024-09-19T09:26:17.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f8ad40 0x557157f8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8a800 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- 172.21.15.52:0/748942059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- 172.21.15.52:0/748942059 >> 172.21.15.52:0/748942059 conn(0x557157f7c0f0 msgr2=0x557157f7c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- 172.21.15.52:0/748942059 shutdown_connections 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- 172.21.15.52:0/748942059 wait complete. 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- start start 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 Processor -- start 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f87b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f80480 0x557157f880b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557157f8d910 con 0x557157f8ad40 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557157e9ff10 con 0x557157f80480 2024-09-19T09:26:17.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.765+0000 7fddaeba2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557157f8da90 con 0x557157f7fb60 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fddaeba2740 10 client.0 _ll_register_callbacks cb 0x557157e68a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58206/0 (socket says 172.21.15.52:58206) 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 -- 172.21.15.52:0/4285644394 learned_addr learned my addr 172.21.15.52:0/4285644394 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f87b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fddaa565640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f80480 0x557157f880b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 -- 172.21.15.52:0/4285644394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 msgr2=0x557157f87b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f87b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 -- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f80480 msgr2=0x557157f880b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f80480 0x557157f880b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 -- 172.21.15.52:0/4285644394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557157c566a0 con 0x557157f8ad40 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdd94012d80 tx=0x7fdd94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b6e3c3156ceff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdd8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:17.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94004030 con 0x557157f8ad40 2024-09-19T09:26:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdd940041d0 con 0x557157f8ad40 2024-09-19T09:26:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.766+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda00318f0 con 0x557157f8ad40 2024-09-19T09:26:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdd940043d0 con 0x557157f8ad40 2024-09-19T09:26:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 10 client.17055 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:17.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557157f99460 con 0x557157f8ad40 2024-09-19T09:26:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdda00318f0 con 0x557157f8ad40 2024-09-19T09:26:17.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdd94021420 con 0x557157f8ad40 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 10 client.17055 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 20 client.17055 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557157f9a920 0x557157f9cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 4 client.17055 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557157ef27f0 con 0x557157f9a920 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.767+0000 7fddaa565640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557157f9a920 0x557157f9cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.768+0000 7fddaa565640 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557157f9a920 0x557157f9cd30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d36b6f651736326 server_cookie=54376917b2cd05ec in_seq=0 out_seq=0 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.768+0000 7fdd8dffb640 10 client.17055 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.768+0000 7fdd8dffb640 1 -- 172.21.15.52:0/4285644394 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557157ef27f0 con 0x557157f9a920 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.768+0000 7fdd8dffb640 10 client.17055 handle_command_reply: tid=0 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.768+0000 7fddaeba2740 1 client.17055 shutdown 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 msgr2=0x557157f885f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdd94012d80 tx=0x7fdd94004730 comp rx=0 tx=0).stop 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 shutdown_connections 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557157f9a920 0x557157f9cd30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157f885f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f80480 0x557157f880b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4285644394 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f87b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 >> 172.21.15.52:0/4285644394 conn(0x557157f7c0f0 msgr2=0x557157f7b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fdd8dffb640 0 client.17055 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 shutdown_connections 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 1 -- 172.21.15.52:0/4285644394 wait complete. 2024-09-19T09:26:17.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.769+0000 7fddaeba2740 20 client.17055 trim_cache size 0 max 16384 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 Processor -- start 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 -- start start 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f81cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f80480 0x557157fa2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41b0040 con 0x557157f8ad40 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ad910 con 0x557157f7fb60 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fddaeba2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ab760 con 0x557157f80480 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fdda9d64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fdda9d64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58216/0 (socket says 172.21.15.52:58216) 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fdda9d64640 1 -- 172.21.15.52:0/4026299827 learned_addr learned my addr 172.21.15.52:0/4026299827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:17.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.786+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f81cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 -- 172.21.15.52:0/4026299827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f80480 msgr2=0x557157fa2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f80480 0x557157fa2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 -- 172.21.15.52:0/4026299827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 msgr2=0x557157f81cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f81cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 -- 172.21.15.52:0/4026299827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557157f86b20 con 0x557157f8ad40 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdda9d64640 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009790 tx=0x7fdd94009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291775cf6211e9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdd8ffff640 1 -- 172.21.15.52:0/4026299827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94000e60 con 0x557157f8ad40 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdd8ffff640 1 -- 172.21.15.52:0/4026299827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd94021420 con 0x557157f8ad40 2024-09-19T09:26:17.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fdd8ffff640 1 -- 172.21.15.52:0/4026299827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd94003b80 con 0x557157f8ad40 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fddaeba2740 1 -- 172.21.15.52:0/4026299827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 msgr2=0x557157fa2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.787+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009790 tx=0x7fdd94009db0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- 172.21.15.52:0/4026299827 shutdown_connections 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f8ad40 0x557157fa2b40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f80480 0x557157fa2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- 172.21.15.52:0/4026299827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f7fb60 0x557157f81cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- 172.21.15.52:0/4026299827 >> 172.21.15.52:0/4026299827 conn(0x557157f7c0f0 msgr2=0x557157f815b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- 172.21.15.52:0/4026299827 shutdown_connections 2024-09-19T09:26:17.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- 172.21.15.52:0/4026299827 wait complete. 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- start start 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 Processor -- start 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f8ad40 0x5571580089e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41abdd0 con 0x557157f80480 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ad240 con 0x557157f8ad40 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdda41ac4a0 con 0x557157f7fb60 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaeba2740 10 client.0 _ll_register_callbacks cb 0x7fdd94009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaa565640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaa565640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58224/0 (socket says 172.21.15.52:58224) 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fddaa565640 1 -- 172.21.15.52:0/1599669790 learned_addr learned my addr 172.21.15.52:0/1599669790 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.788+0000 7fdda9d64640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fdda9d64640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f8ad40 0x5571580089e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 -- 172.21.15.52:0/1599669790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 msgr2=0x557157f8ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f8ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 -- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f8ad40 msgr2=0x5571580089e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f8ad40 0x5571580089e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 -- 172.21.15.52:0/1599669790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557157f802b0 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaa565640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda0005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676c22823aedfd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fdd8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0040040 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdda0004040 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd94021420 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdda0035040 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaeba2740 10 client.17061 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.789+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557158009f50 con 0x557157f80480 2024-09-19T09:26:17.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd94021420 con 0x557157f80480 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdda0003b60 con 0x557157f80480 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 10 client.17061 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 20 client.17061 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55715800a290 0x55715800c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 4 client.17061 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557157eecd00 con 0x55715800a290 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fdda9d64640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55715800a290 0x55715800c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fdda9d64640 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55715800a290 0x55715800c680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b9871eadc5e89aa server_cookie=becdf6c98cd5854d in_seq=0 out_seq=0 2024-09-19T09:26:17.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.790+0000 7fdd8dffb640 10 client.17061 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fdd8dffb640 1 -- 172.21.15.52:0/1599669790 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557157eecd00 con 0x55715800a290 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fdd8dffb640 10 client.17061 handle_command_reply: tid=0 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 client.17061 shutdown 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 msgr2=0x557157f8f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009900 tx=0x7fdda0005470 comp rx=0 tx=0).stop 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 shutdown_connections 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55715800a290 0x55715800c680 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557157f8ad40 0x5571580089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557157f80480 0x557157f8f390 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 --2- 172.21.15.52:0/1599669790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557157f7fb60 0x557157f8ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 >> 172.21.15.52:0/1599669790 conn(0x557157f7c0f0 msgr2=0x557157f81dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fdd8dffb640 0 client.17061 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 shutdown_connections 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 1 -- 172.21.15.52:0/1599669790 wait complete. 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.792+0000 7fddaeba2740 20 client.17061 trim_cache size 0 max 16384 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "953029e3-a4f1-4f3f-b07e-6070b9c260c6", 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:26:17.798 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 msgr2=0x7fdd900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 0x7fdd900a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c098a80 tx=0x7fdd9c091590 comp rx=0 tx=0).stop 2024-09-19T09:26:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 msgr2=0x7fdda419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:17.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00eaa0 tx=0x7fdd9c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 shutdown_connections 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdda4106f10 0x7fdda419cde0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdda4102790 0x7fdda4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdd900a32c0 0x7fdd900a5780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 --2- 172.21.15.52:0/4284217879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdda4101de0 0x7fdda4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 >> 172.21.15.52:0/4284217879 conn(0x7fdda40fd8c0 msgr2=0x7fdda40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 shutdown_connections 2024-09-19T09:26:17.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:17.793+0000 7fddac7c9640 1 -- 172.21.15.52:0/4284217879 wait complete. 2024-09-19T09:26:18.321 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:26:18.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:26:18.594 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: pgmap v484: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:26:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:26:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:18.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:18 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:26:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: pgmap v484: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:26:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:18.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:26:18.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:18.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:18 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: pgmap v484: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:18 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 -- 172.21.15.52:0/3080415067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0101de0 msgr2=0x7f2df01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 --2- 172.21.15.52:0/3080415067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0101de0 0x7f2df01021c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009900 tx=0x7f2de002a410 comp rx=0 tx=0).stop 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 -- 172.21.15.52:0/3080415067 shutdown_connections 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 --2- 172.21.15.52:0/3080415067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0106f10 0x7f2df010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 --2- 172.21.15.52:0/3080415067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 0x7f2df01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 --2- 172.21.15.52:0/3080415067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0101de0 0x7f2df01021c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 -- 172.21.15.52:0/3080415067 >> 172.21.15.52:0/3080415067 conn(0x7f2df00fd8c0 msgr2=0x7f2df00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:19.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 -- 172.21.15.52:0/3080415067 shutdown_connections 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.050+0000 7f2df67c4640 1 -- 172.21.15.52:0/3080415067 wait complete. 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 Processor -- start 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 -- start start 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0101de0 0x7f2df0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 0x7f2df0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0111f70 con 0x7f2df0106f10 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0111df0 con 0x7f2df0102790 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.051+0000 7f2df67c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01120f0 con 0x7f2df0101de0 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52978/0 (socket says 172.21.15.52:52978) 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 -- 172.21.15.52:0/1848747278 learned_addr learned my addr 172.21.15.52:0/1848747278 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:19.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2def7fe640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 0x7f2df0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2deffff640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0101de0 0x7f2df0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 -- 172.21.15.52:0/1848747278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0101de0 msgr2=0x7f2df0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0101de0 0x7f2df0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 -- 172.21.15.52:0/1848747278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 msgr2=0x7f2df0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 0x7f2df0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 -- 172.21.15.52:0/1848747278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df019d3e0 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df4d61640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2de800eaa0 tx=0x7f2de800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de800cdb0 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df019d6d0 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2de8005020 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80116d0 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.052+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01a4fb0 con 0x7f2df0106f10 2024-09-19T09:26:19.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.054+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df01021c0 con 0x7f2df0106f10 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.055+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2de80054d0 con 0x7f2df0106f10 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.055+0000 7f2ded7fa640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 0x7f2dd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.055+0000 7f2deffff640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 0x7f2dd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.056+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2de80cfae0 con 0x7f2df0106f10 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.056+0000 7f2deffff640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 0x7f2dd80a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009230 tx=0x7f2de00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:19.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.060+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2de8016030 con 0x7f2df0106f10 2024-09-19T09:26:19.142 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:19.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.280+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df0109b60 con 0x7f2df0106f10 2024-09-19T09:26:19.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.281+0000 7f2ded7fa640 1 -- 172.21.15.52:0/1848747278 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f2de809c130 con 0x7f2df0106f10 2024-09-19T09:26:19.282 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:26:19.282 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:26:19.283 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:26:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.283+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 msgr2=0x7f2dd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.283+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 0x7f2dd80a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009230 tx=0x7f2de00058d0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.283+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 msgr2=0x7f2df019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:19.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.283+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2de800eaa0 tx=0x7f2de800ef60 comp rx=0 tx=0).stop 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 shutdown_connections 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2df0106f10 0x7f2df019cd00 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2df0102790 0x7f2df0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2dd80a3240 0x7f2dd80a5700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 --2- 172.21.15.52:0/1848747278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2df0101de0 0x7f2df0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 >> 172.21.15.52:0/1848747278 conn(0x7f2df00fd8c0 msgr2=0x7f2df00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 shutdown_connections 2024-09-19T09:26:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.284+0000 7f2df67c4640 1 -- 172.21.15.52:0/1848747278 wait complete. 2024-09-19T09:26:19.860 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:19 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1848747278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:19.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:19 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1848747278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:20.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:19 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1848747278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:20.206 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 622b104a --release --await' 2024-09-19T09:26:20.206 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 622b104a --release --await 2024-09-19T09:26:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 -- 172.21.15.52:0/3065222151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 msgr2=0x7fed58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 --2- 172.21.15.52:0/3065222151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed58100ee0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fed48009930 tx=0x7fed4802a420 comp rx=0 tx=0).stop 2024-09-19T09:26:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 -- 172.21.15.52:0/3065222151 shutdown_connections 2024-09-19T09:26:20.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 --2- 172.21.15.52:0/3065222151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58101420 0x7fed5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 --2- 172.21.15.52:0/3065222151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed58100ee0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 --2- 172.21.15.52:0/3065222151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58106a80 0x7fed58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 -- 172.21.15.52:0/3065222151 >> 172.21.15.52:0/3065222151 conn(0x7fed580fc7a0 msgr2=0x7fed580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 -- 172.21.15.52:0/3065222151 shutdown_connections 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.940+0000 7fed600fa640 1 -- 172.21.15.52:0/3065222151 wait complete. 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 Processor -- start 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 -- start start 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 0x7fed5819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 0x7fed5819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed58110e80 con 0x7fed58100a80 2024-09-19T09:26:20.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed58110d00 con 0x7fed58106a80 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed600fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed58111000 con 0x7fed58101420 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed5de96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed5de96640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53000/0 (socket says 172.21.15.52:53000) 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed5de96640 1 -- 172.21.15.52:0/2111591697 learned_addr learned my addr 172.21.15.52:0/2111591697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed5d695640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 0x7fed5819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.941+0000 7fed5e697640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 0x7fed5819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 -- 172.21.15.52:0/2111591697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 msgr2=0x7fed5819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 0x7fed5819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 -- 172.21.15.52:0/2111591697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 msgr2=0x7fed5819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 0x7fed5819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 -- 172.21.15.52:0/2111591697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5819f5b0 con 0x7fed58100a80 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5e697640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 0x7fed5819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5d695640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 0x7fed5819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed5de96640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fed5400d770 tx=0x7fed5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed4effd640 1 -- 172.21.15.52:0/2111591697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54017070 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5819f8a0 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed4effd640 1 -- 172.21.15.52:0/2111591697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed54005500 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed4effd640 1 -- 172.21.15.52:0/2111591697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54004e00 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.942+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed581a7180 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.944+0000 7fed4effd640 1 -- 172.21.15.52:0/2111591697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fed54004fa0 con 0x7fed58100a80 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.944+0000 7fed624d3740 1 Processor -- start 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 -- start start 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bb4a0 0x556cc92bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bbdc0 0x556cc92c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556cc92212e0 con 0x556cc92c6680 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556cc91c8ce0 con 0x556cc92bb4a0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed624d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556cc921d2a0 con 0x556cc92bbdc0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed4effd640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 0x7fed440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53014/0 (socket says 172.21.15.52:53014) 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5d695640 1 -- 172.21.15.52:0/535568808 learned_addr learned my addr 172.21.15.52:0/535568808 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5e697640 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bb4a0 0x556cc92bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5e697640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 0x7fed440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed5de96640 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bbdc0 0x556cc92c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.945+0000 7fed4effd640 1 -- 172.21.15.52:0/2111591697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fed540cf400 con 0x7fed58100a80 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 -- 172.21.15.52:0/535568808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bbdc0 msgr2=0x556cc92c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bbdc0 0x556cc92c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 -- 172.21.15.52:0/535568808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bb4a0 msgr2=0x556cc92bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bb4a0 0x556cc92bb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 -- 172.21.15.52:0/535568808 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc91ad440 con 0x556cc92c6680 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5d695640 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fed48009930 tx=0x7fed48032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd02c30f2ca0721d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed5e697640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 0x7fed440a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fed50007310 tx=0x7fed500072a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed43fff640 1 -- 172.21.15.52:0/535568808 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4803f070 con 0x556cc92c6680 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed43fff640 1 -- 172.21.15.52:0/535568808 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed480317b0 con 0x556cc92c6680 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.946+0000 7fed43fff640 1 -- 172.21.15.52:0/535568808 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed48035070 con 0x556cc92c6680 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- 172.21.15.52:0/535568808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 msgr2=0x556cc92c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fed48009930 tx=0x7fed48032d60 comp rx=0 tx=0).stop 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- 172.21.15.52:0/535568808 shutdown_connections 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92c8a70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bbdc0 0x556cc92c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 --2- 172.21.15.52:0/535568808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bb4a0 0x556cc92bb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- 172.21.15.52:0/535568808 >> 172.21.15.52:0/535568808 conn(0x556cc92b7a30 msgr2=0x556cc92b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- 172.21.15.52:0/535568808 shutdown_connections 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- 172.21.15.52:0/535568808 wait complete. 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 -- start start 2024-09-19T09:26:20.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.947+0000 7fed624d3740 1 Processor -- start 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc92c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556cc92c9250 con 0x556cc92bbdc0 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556cc91dc050 con 0x556cc92c6680 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556cc92c93d0 con 0x556cc92bb4a0 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed624d3740 10 client.0 _ll_register_callbacks cb 0x556cc921c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53020/0 (socket says 172.21.15.52:53020) 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 -- 172.21.15.52:0/2513407710 learned_addr learned my addr 172.21.15.52:0/2513407710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:20.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5e697640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc92c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5de96640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 -- 172.21.15.52:0/2513407710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 msgr2=0x556cc92c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 -- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 msgr2=0x556cc92c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc92c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 -- 172.21.15.52:0/2513407710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc8f923c0 con 0x556cc92bbdc0 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5de96640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5e697640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc92c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed5d695640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fed4802a940 tx=0x7fed480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a304cf58995e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.948+0000 7fed417fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:20.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4804a020 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fed480035f0 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed480317b0 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed48055050 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 10 client.17079 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556cc92d4ba0 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed480317b0 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed48004c20 con 0x556cc92bbdc0 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 10 client.17079 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 10 client.17079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 20 client.17079 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc92d5ef0 0x556cc92d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 4 client.17079 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.949+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cc922e850 con 0x556cc92d5ef0 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.950+0000 7fed5de96640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc92d5ef0 0x556cc92d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.950+0000 7fed5de96640 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc92d5ef0 0x556cc92d82e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daeaf66d840b876 server_cookie=5bd6e1d601af2ea9 in_seq=0 out_seq=0 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.950+0000 7fed417fa640 10 client.17079 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed417fa640 1 -- 172.21.15.52:0/2513407710 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556cc922e850 con 0x556cc92d5ef0 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed417fa640 10 client.17079 handle_command_reply: tid=0 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 client.17079 shutdown 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 msgr2=0x556cc92c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fed4802a940 tx=0x7fed480045e0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 shutdown_connections 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc92d5ef0 0x556cc92d82e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc92c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92c31f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 --2- 172.21.15.52:0/2513407710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed417fa640 0 client.17079 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 >> 172.21.15.52:0/2513407710 conn(0x556cc92b7a30 msgr2=0x556cc92bd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 shutdown_connections 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 1 -- 172.21.15.52:0/2513407710 wait complete. 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.951+0000 7fed624d3740 20 client.17079 trim_cache size 0 max 16384 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 Processor -- start 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 -- start start 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 0x556cc92dda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed581b20e0 con 0x556cc92c6680 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed581af9b0 con 0x556cc92bbdc0 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.968+0000 7fed624d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed581ad800 con 0x556cc92bb4a0 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53032/0 (socket says 172.21.15.52:53032) 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 -- 172.21.15.52:0/499919981 learned_addr learned my addr 172.21.15.52:0/499919981 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5d695640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 0x556cc92dda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5de96640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 -- 172.21.15.52:0/499919981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 msgr2=0x556cc92d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 -- 172.21.15.52:0/499919981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 msgr2=0x556cc92dda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 0x556cc92dda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 -- 172.21.15.52:0/499919981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cc92c62b0 con 0x556cc92c6680 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5de96640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5d695640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 0x556cc92dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed5e697640 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fed500074f0 tx=0x7fed50007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a921559df2755459 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed437fe640 1 -- 172.21.15.52:0/499919981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5001fbd0 con 0x556cc92c6680 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed437fe640 1 -- 172.21.15.52:0/499919981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed5001fd70 con 0x556cc92c6680 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.969+0000 7fed437fe640 1 -- 172.21.15.52:0/499919981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50029670 con 0x556cc92c6680 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- 172.21.15.52:0/499919981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 msgr2=0x556cc92ddf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fed500074f0 tx=0x7fed50007680 comp rx=0 tx=0).stop 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- 172.21.15.52:0/499919981 shutdown_connections 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92c6680 0x556cc92ddf40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92bbdc0 0x556cc92dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 --2- 172.21.15.52:0/499919981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92d24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- 172.21.15.52:0/499919981 >> 172.21.15.52:0/499919981 conn(0x556cc92b7a30 msgr2=0x556cc92be870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- 172.21.15.52:0/499919981 shutdown_connections 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- 172.21.15.52:0/499919981 wait complete. 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 -- start start 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.970+0000 7fed624d3740 1 Processor -- start 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc933e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed581ade70 con 0x556cc92bbdc0 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fed581af2e0 con 0x556cc92c6680 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fed581ae540 con 0x556cc92bb4a0 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed624d3740 10 client.0 _ll_register_callbacks cb 0x7fed50007e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53040/0 (socket says 172.21.15.52:53040) 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 -- 172.21.15.52:0/3349289736 learned_addr learned my addr 172.21.15.52:0/3349289736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5e697640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc933e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5de96640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 -- 172.21.15.52:0/3349289736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 msgr2=0x556cc92c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 -- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 msgr2=0x556cc933e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc933e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.971+0000 7fed5d695640 1 -- 172.21.15.52:0/3349289736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cc933ef00 con 0x556cc92bbdc0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed5d695640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fed48005040 tx=0x7fed48032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfdd8920736e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4804a040 con 0x556cc92bbdc0 2024-09-19T09:26:20.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fed480048c0 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed5001fd70 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fed4803f070 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 10 client.17085 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556cc93401f0 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed5001fd70 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fed48064480 con 0x556cc92bbdc0 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 10 client.17085 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 10 client.17085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 20 client.17085 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc9340910 0x556cc9342d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 4 client.17085 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.972+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556cc9228d60 con 0x556cc9340910 2024-09-19T09:26:20.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed5de96640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc9340910 0x556cc9342d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed5de96640 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc9340910 0x556cc9342d30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=743f5e7e87adcb8d server_cookie=c9d5eb91cf64ec14 in_seq=0 out_seq=0 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed417fa640 10 client.17085 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed417fa640 1 -- 172.21.15.52:0/3349289736 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556cc9228d60 con 0x556cc9340910 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed417fa640 10 client.17085 handle_command_reply: tid=0 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed624d3740 1 client.17085 shutdown 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 msgr2=0x556cc92ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.973+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fed48005040 tx=0x7fed48032ed0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 shutdown_connections 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556cc9340910 0x556cc9342d30 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556cc92c6680 0x556cc933e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cc92bbdc0 0x556cc92ca110 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 --2- 172.21.15.52:0/3349289736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556cc92bb4a0 0x556cc92c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:26:20.339 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 >> 172.21.15.52:0/3349289736 conn(0x556cc92b7a30 msgr2=0x556cc92b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed417fa640 0 client.17085 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 shutdown_connections 2024-09-19T09:26:20.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 1 -- 172.21.15.52:0/3349289736 wait complete. 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed624d3740 20 client.17085 trim_cache size 0 max 16384 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 msgr2=0x7fed440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 0x7fed440a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fed50007310 tx=0x7fed500072a0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 msgr2=0x7fed5819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fed5400d770 tx=0x7fed5400dc30 comp rx=0 tx=0).stop 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 shutdown_connections 2024-09-19T09:26:20.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fed58106a80 0x7fed5819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fed440a3240 0x7fed440a5700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fed58101420 0x7fed5819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 --2- 172.21.15.52:0/2111591697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed58100a80 0x7fed5819a600 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 >> 172.21.15.52:0/2111591697 conn(0x7fed580fc7a0 msgr2=0x7fed5806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 shutdown_connections 2024-09-19T09:26:20.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:19.974+0000 7fed600fa640 1 -- 172.21.15.52:0/2111591697 wait complete. 2024-09-19T09:26:20.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:20 smithi052 ceph-mon[30947]: pgmap v485: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:20.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:20 smithi169 ceph-mon[35454]: pgmap v485: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:21.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:20 smithi086 ceph-mon[34813]: pgmap v485: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:21.084 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:26:21.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:26:21.208 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 -- 172.21.15.52:0/1317556854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 msgr2=0x7f1c5010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 --2- 172.21.15.52:0/1317556854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5010ec50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009cd0 tx=0x7f1c4802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 -- 172.21.15.52:0/1317556854 shutdown_connections 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 --2- 172.21.15.52:0/1317556854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5010ec50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 --2- 172.21.15.52:0/1317556854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50103760 0x7f1c50107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 --2- 172.21.15.52:0/1317556854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50102db0 0x7f1c50103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 -- 172.21.15.52:0/1317556854 >> 172.21.15.52:0/1317556854 conn(0x7f1c500fc7d0 msgr2=0x7f1c500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 -- 172.21.15.52:0/1317556854 shutdown_connections 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.700+0000 7f1c58771640 1 -- 172.21.15.52:0/1317556854 wait complete. 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 Processor -- start 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 -- start start 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50102db0 0x7f1c50198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 0x7f1c50198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501120b0 con 0x7f1c501082e0 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50111f30 con 0x7f1c50103760 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c58771640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50112230 con 0x7f1c50102db0 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53066/0 (socket says 172.21.15.52:53066) 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 -- 172.21.15.52:0/3577135908 learned_addr learned my addr 172.21.15.52:0/3577135908 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c5650d640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50102db0 0x7f1c50198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 0x7f1c50198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 -- 172.21.15.52:0/3577135908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50102db0 msgr2=0x7f1c50198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50102db0 0x7f1c50198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 -- 172.21.15.52:0/3577135908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 msgr2=0x7f1c50198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 0x7f1c50198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c56d0e640 1 -- 172.21.15.52:0/3577135908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5019d4c0 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.701+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 0x7f1c50198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c56d0e640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005e30 tx=0x7f1c48003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c477fe640 1 -- 172.21.15.52:0/3577135908 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48004040 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5019d750 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c477fe640 1 -- 172.21.15.52:0/3577135908 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c480046c0 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c477fe640 1 -- 172.21.15.52:0/3577135908 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48030ea0 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.702+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501a5090 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.704+0000 7f1c477fe640 1 -- 172.21.15.52:0/3577135908 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1c480305a0 con 0x7f1c501082e0 2024-09-19T09:26:21.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.704+0000 7f1c5ab4a740 1 Processor -- start 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 -- start start 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcaca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5578fca20620 con 0x5578fcabaf60 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5578fc9c7e50 con 0x5578fcaca650 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5578fca1c5e0 con 0x5578fcabb880 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c477fe640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53078/0 (socket says 172.21.15.52:53078) 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 -- 172.21.15.52:0/506504030 learned_addr learned my addr 172.21.15.52:0/506504030 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c5650d640 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcaca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c56d0e640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c477fe640 1 -- 172.21.15.52:0/3577135908 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1c4802e030 con 0x7f1c501082e0 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 -- 172.21.15.52:0/506504030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 msgr2=0x5578fcaca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcaca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 -- 172.21.15.52:0/506504030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 msgr2=0x5578fcacca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.705+0000 7f1c55d0c640 1 -- 172.21.15.52:0/506504030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fc9b8d40 con 0x5578fcabaf60 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.706+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000bfd0 tx=0x7f1c4000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4b3d6a042eb4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.706+0000 7f1c56d0e640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c48031040 tx=0x7f1c48030940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.706+0000 7f1c44ff9640 1 -- 172.21.15.52:0/506504030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40019030 con 0x5578fcabaf60 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.706+0000 7f1c44ff9640 1 -- 172.21.15.52:0/506504030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c40005500 con 0x5578fcabaf60 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.706+0000 7f1c44ff9640 1 -- 172.21.15.52:0/506504030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400114c0 con 0x5578fcabaf60 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/506504030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 msgr2=0x5578fcabb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000bfd0 tx=0x7f1c4000b650 comp rx=0 tx=0).stop 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/506504030 shutdown_connections 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcaca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/506504030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabaf60 0x5578fcabb340 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/506504030 >> 172.21.15.52:0/506504030 conn(0x5578fcab75f0 msgr2=0x5578fcab79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/506504030 shutdown_connections 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/506504030 wait complete. 2024-09-19T09:26:21.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 -- start start 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.707+0000 7f1c5ab4a740 1 Processor -- start 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcac7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcac7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5578fcacd280 con 0x5578fcaca650 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5578fc9a8f10 con 0x5578fcabaf60 2024-09-19T09:26:21.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5578fcacd400 con 0x5578fcabb880 2024-09-19T09:26:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 10 client.0 _ll_register_callbacks cb 0x5578fc9ccdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53094/0 (socket says 172.21.15.52:53094) 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2679202418 learned_addr learned my addr 172.21.15.52:0/2679202418 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcac7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcac7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2679202418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 msgr2=0x5578fcac7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcac7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 msgr2=0x5578fcac7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcac7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2679202418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fc72f580 con 0x5578fcaca650 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1c40004cb0 tx=0x7f1c4000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4cc683edc979e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:21.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40022070 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1c40005000 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.708+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c40005500 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c40034050 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 10 client.17097 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5578fc7f9960 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c40005500 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1c4001e460 con 0x5578fcaca650 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 10 client.17097 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 10 client.17097 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 20 client.17097 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcada0f0 0x5578fcadc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 4 client.17097 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578fca2db90 con 0x5578fcada0f0 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.709+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcada0f0 0x5578fcadc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.710+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcada0f0 0x5578fcadc4e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dffa8ae7f3a7b8d server_cookie=c1b561a2cf67b7a8 in_seq=0 out_seq=0 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.710+0000 7f1c39ffb640 10 client.17097 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.710+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2679202418 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578fca2db90 con 0x5578fcada0f0 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.710+0000 7f1c39ffb640 10 client.17097 handle_command_reply: tid=0 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 client.17097 shutdown 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 msgr2=0x5578fcac7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1c40004cb0 tx=0x7f1c4000b5b0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 shutdown_connections 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcada0f0 0x5578fcadc4e0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcac7fb0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcac7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2679202418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcac7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c39ffb640 0 client.17097 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 >> 172.21.15.52:0/2679202418 conn(0x5578fcab75f0 msgr2=0x5578fcabd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 shutdown_connections 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2679202418 wait complete. 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.711+0000 7f1c5ab4a740 20 client.17097 trim_cache size 0 max 16384 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 Processor -- start 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 -- start start 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcabd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcae1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501addf0 con 0x5578fcaca650 2024-09-19T09:26:21.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501ab6c0 con 0x5578fcabaf60 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501a9510 con 0x5578fcabb880 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c55d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53104/0 (socket says 172.21.15.52:53104) 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2076495458 learned_addr learned my addr 172.21.15.52:0/2076495458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.728+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcabd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcae1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2076495458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 msgr2=0x5578fcae1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcae1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2076495458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 msgr2=0x5578fcabd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcabd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 -- 172.21.15.52:0/2076495458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578fcacd3c0 con 0x5578fcaca650 2024-09-19T09:26:21.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001eb50 tx=0x7f1c40015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c126fc88c8822f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c3bfff640 1 -- 172.21.15.52:0/2076495458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40022070 con 0x5578fcaca650 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c3bfff640 1 -- 172.21.15.52:0/2076495458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c4000b3a0 con 0x5578fcaca650 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.729+0000 7f1c3bfff640 1 -- 172.21.15.52:0/2076495458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40019070 con 0x5578fcaca650 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2076495458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 msgr2=0x5578fcae20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1c4001eb50 tx=0x7f1c40015040 comp rx=0 tx=0).stop 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2076495458 shutdown_connections 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcaca650 0x5578fcae20b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabb880 0x5578fcae1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2076495458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcabaf60 0x5578fcabd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2076495458 >> 172.21.15.52:0/2076495458 conn(0x5578fcab75f0 msgr2=0x5578fcabca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2076495458 shutdown_connections 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2076495458 wait complete. 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- start start 2024-09-19T09:26:21.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 Processor -- start 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabaf60 0x5578fcace600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501a9b80 con 0x5578fcabb880 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501aaff0 con 0x5578fcaca650 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1c501aa250 con 0x5578fcabaf60 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5ab4a740 10 client.0 _ll_register_callbacks cb 0x7f1c400046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.730+0000 7f1c5650d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53118/0 (socket says 172.21.15.52:53118) 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 -- 172.21.15.52:0/2244079949 learned_addr learned my addr 172.21.15.52:0/2244079949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabaf60 0x5578fcace600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 -- 172.21.15.52:0/2244079949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabaf60 msgr2=0x5578fcace600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabaf60 0x5578fcace600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 -- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 msgr2=0x5578fcacf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 -- 172.21.15.52:0/2244079949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578fcb43d40 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5650d640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x5578fcac6dc0 tx=0x7f1c4c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22bc79a47ce340d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004bb0 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1c4c004d50 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c4000b3a0 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c02a030 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5ab4a740 10 client.17103 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.731+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5578fcb45080 con 0x5578fcabb880 2024-09-19T09:26:21.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c4000b3a0 con 0x5578fcabb880 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1c4c01caa0 con 0x5578fcabb880 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 10 client.17103 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 10 client.17103 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 20 client.17103 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcb45860 0x5578fcb47c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 4 client.17103 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "622b104a", "release": true, "await": true}] 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "622b104a", "release": true, "await": true}) -- 0x5578fca280a0 con 0x5578fcb45860 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcb45860 0x5578fcb47c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c39ffb640 10 client.17103 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.732+0000 7f1c55d0c640 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcb45860 0x5578fcb47c80 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1d54b46ed308fa9 server_cookie=c176d119b95bd4ce in_seq=0 out_seq=0 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.735+0000 7f1c39ffb640 1 -- 172.21.15.52:0/2244079949 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5578fca280a0 con 0x5578fcb45860 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.735+0000 7f1c39ffb640 10 client.17103 handle_command_reply: tid=0 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.735+0000 7f1c5ab4a740 1 client.17103 shutdown 2024-09-19T09:26:21.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 msgr2=0x5578fcaceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x5578fcac6dc0 tx=0x7f1c4c00afd0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 shutdown_connections 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5578fcb45860 0x5578fcb47c80 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5578fcaca650 0x5578fcacf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5578fcabb880 0x5578fcaceb40 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c39ffb640 0 client.17103 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 --2- 172.21.15.52:0/2244079949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5578fcabaf60 0x5578fcace600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 >> 172.21.15.52:0/2244079949 conn(0x5578fcab75f0 msgr2=0x5578fcac7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 shutdown_connections 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 1 -- 172.21.15.52:0/2244079949 wait complete. 2024-09-19T09:26:21.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.736+0000 7f1c5ab4a740 20 client.17103 trim_cache size 0 max 16384 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 24, 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "622b104a": { 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 24, 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:26:21.756 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.8, 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:21.757 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:21.758 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:21.758 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:21.758 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:21.758 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 msgr2=0x7f1c3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c48031040 tx=0x7f1c48030940 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 msgr2=0x7f1c5019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005e30 tx=0x7f1c48003970 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 shutdown_connections 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c501082e0 0x7f1c5019cde0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c50103760 0x7f1c50198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 --2- 172.21.15.52:0/3577135908 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1c50102db0 0x7f1c50198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 >> 172.21.15.52:0/3577135908 conn(0x7f1c500fc7d0 msgr2=0x7f1c500fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:21.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 shutdown_connections 2024-09-19T09:26:21.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:21.737+0000 7f1c58771640 1 -- 172.21.15.52:0/3577135908 wait complete. 2024-09-19T09:26:22.006 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:22.519 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '622b104a', total seconds elapsed: 34.0 2024-09-19T09:26:22.793 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:22 smithi052 ceph-mon[30947]: pgmap v486: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:22 smithi169 ceph-mon[35454]: pgmap v486: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 -- 172.21.15.52:0/2088860565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 msgr2=0x7f757c101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 --2- 172.21.15.52:0/2088860565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c101b40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f7574009ca0 tx=0x7f757402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 -- 172.21.15.52:0/2088860565 shutdown_connections 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 --2- 172.21.15.52:0/2088860565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c101b40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 --2- 172.21.15.52:0/2088860565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c100cf0 0x7f757c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 --2- 172.21.15.52:0/2088860565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c1003b0 0x7f757c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 -- 172.21.15.52:0/2088860565 >> 172.21.15.52:0/2088860565 conn(0x7f757c0fc1e0 msgr2=0x7f757c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 -- 172.21.15.52:0/2088860565 shutdown_connections 2024-09-19T09:26:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.005+0000 7f758399f640 1 -- 172.21.15.52:0/2088860565 wait complete. 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 Processor -- start 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 -- start start 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c1003b0 0x7f757c199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c100cf0 0x7f757c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f757c10f990 con 0x7f757c101690 2024-09-19T09:26:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f757c10f810 con 0x7f757c100cf0 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758399f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f757c10fb10 con 0x7f757c1003b0 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53138/0 (socket says 172.21.15.52:53138) 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 -- 172.21.15.52:0/4231634106 learned_addr learned my addr 172.21.15.52:0/4231634106 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7580f3a640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c100cf0 0x7f757c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f758173b640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c1003b0 0x7f757c199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 -- 172.21.15.52:0/4231634106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c1003b0 msgr2=0x7f757c199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c1003b0 0x7f757c199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 -- 172.21.15.52:0/4231634106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c100cf0 msgr2=0x7f757c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c100cf0 0x7f757c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.006+0000 7f7581f3c640 1 -- 172.21.15.52:0/4231634106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c1a1b80 con 0x7f757c101690 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f7581f3c640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7574005e30 tx=0x7f7574031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f75727fc640 1 -- 172.21.15.52:0/4231634106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574003c30 con 0x7f757c101690 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c1a1e10 con 0x7f757c101690 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f75727fc640 1 -- 172.21.15.52:0/4231634106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7574003dd0 con 0x7f757c101690 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f75727fc640 1 -- 172.21.15.52:0/4231634106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757402fde0 con 0x7f757c101690 2024-09-19T09:26:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.007+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c1a2320 con 0x7f757c101690 2024-09-19T09:26:23.012 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:22 smithi086 ceph-mon[34813]: pgmap v486: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T09:26:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.009+0000 7f75727fc640 1 -- 172.21.15.52:0/4231634106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7574004050 con 0x7f757c101690 2024-09-19T09:26:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 Processor -- start 2024-09-19T09:26:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 -- start start 2024-09-19T09:26:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c991da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c994830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f75727fc640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 0x7f75680a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f63c8f02f0 con 0x55f63c98c9a0 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f63c898270 con 0x55f63c98d2e0 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7586818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f63c8ec2b0 con 0x55f63c992370 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7581f3c640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 0x7f75680a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53152/0 (socket says 172.21.15.52:53152) 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f7580f3a640 1 -- 172.21.15.52:0/2347088655 learned_addr learned my addr 172.21.15.52:0/2347088655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f758173b640 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c991da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.010+0000 7f75727fc640 1 -- 172.21.15.52:0/4231634106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f75740f0db0 con 0x7f757c101690 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c994830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 -- 172.21.15.52:0/2347088655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 msgr2=0x55f63c994830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c994830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 -- 172.21.15.52:0/2347088655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 msgr2=0x55f63c991da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c991da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 -- 172.21.15.52:0/2347088655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63c897340 con 0x55f63c98c9a0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7581f3c640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 0x7f75680a57b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f75740ee880 tx=0x7f75740c1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f7580f3a640 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f756c012530 tx=0x7f756c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936c9090ab5e1e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f75677fe640 1 -- 172.21.15.52:0/2347088655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c005020 con 0x55f63c98c9a0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f75677fe640 1 -- 172.21.15.52:0/2347088655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756c0056a0 con 0x55f63c98c9a0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.011+0000 7f75677fe640 1 -- 172.21.15.52:0/2347088655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c010660 con 0x55f63c98c9a0 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- 172.21.15.52:0/2347088655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 msgr2=0x55f63c98cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f756c012530 tx=0x7f756c00b650 comp rx=0 tx=0).stop 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- 172.21.15.52:0/2347088655 shutdown_connections 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c994830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c991da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 --2- 172.21.15.52:0/2347088655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c98cda0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- 172.21.15.52:0/2347088655 >> 172.21.15.52:0/2347088655 conn(0x55f63c988010 msgr2=0x55f63c988410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- 172.21.15.52:0/2347088655 shutdown_connections 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- 172.21.15.52:0/2347088655 wait complete. 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 -- start start 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.012+0000 7f7586818740 1 Processor -- start 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c98c9a0 0x55f63c996bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c997100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 0x55f63c99e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f63c995340 con 0x55f63c992370 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f63c879290 con 0x55f63c98d2e0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f63c9954c0 con 0x55f63c98c9a0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7586818740 10 client.0 _ll_register_callbacks cb 0x55f63c8aa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 0x55f63c99e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c997100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 0x55f63c99e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53158/0 (socket says 172.21.15.52:53158) 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7580f3a640 1 -- 172.21.15.52:0/1869108664 learned_addr learned my addr 172.21.15.52:0/1869108664 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c98c9a0 0x55f63c996bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 -- 172.21.15.52:0/1869108664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c98c9a0 msgr2=0x55f63c996bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c98c9a0 0x55f63c996bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 -- 172.21.15.52:0/1869108664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 msgr2=0x55f63c99e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 0x55f63c99e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.013+0000 7f758173b640 1 -- 172.21.15.52:0/1869108664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f63c603210 con 0x55f63c98d2e0 2024-09-19T09:26:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f758173b640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c997100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55f63c98dd10 tx=0x7f7578012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab3c72e16e455685 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75780035f0 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f756c0056a0 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7578003790 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7578020020 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7586818740 10 client.26420 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f63c6cf620 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.014+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756c0056a0 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7578019020 con 0x55f63c98d2e0 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 10 client.26420 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 10 client.26420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 20 client.26420 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63c9a2890 0x55f63c9a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 4 client.26420 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f63c8fda20 con 0x55f63c9a2890 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63c9a2890 0x55f63c9a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7564ff9640 10 client.26420 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.015+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63c9a2890 0x55f63c9a4ca0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c960a690ab31c53 server_cookie=9133facc925f8519 in_seq=0 out_seq=0 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7564ff9640 1 -- 172.21.15.52:0/1869108664 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f63c8fda20 con 0x55f63c9a2890 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7564ff9640 10 client.26420 handle_command_reply: tid=0 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 client.26420 shutdown 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 msgr2=0x55f63c997100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c997100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55f63c98dd10 tx=0x7f7578012820 comp rx=0 tx=0).stop 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 shutdown_connections 2024-09-19T09:26:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63c9a2890 0x55f63c9a4ca0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c992370 0x55f63c99e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7564ff9640 0 client.26420 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c997100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 --2- 172.21.15.52:0/1869108664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c98c9a0 0x55f63c996bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 >> 172.21.15.52:0/1869108664 conn(0x55f63c988010 msgr2=0x55f63c989820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 shutdown_connections 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 1 -- 172.21.15.52:0/1869108664 wait complete. 2024-09-19T09:26:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.016+0000 7f7586818740 20 client.26420 trim_cache size 0 max 16384 2024-09-19T09:26:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 Processor -- start 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 -- start start 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c99e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c989400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1adcd0 con 0x55f63c98c9a0 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1ab5a0 con 0x55f63c98d2e0 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7586818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1a93f0 con 0x55f63c992370 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7580f3a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53162/0 (socket says 172.21.15.52:53162) 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f7580f3a640 1 -- 172.21.15.52:0/1504899832 learned_addr learned my addr 172.21.15.52:0/1504899832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.031+0000 7f758173b640 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c99e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 -- 172.21.15.52:0/1504899832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 msgr2=0x55f63c989400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c989400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 -- 172.21.15.52:0/1504899832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 msgr2=0x55f63c99e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c99e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 -- 172.21.15.52:0/1504899832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f63c98d7c0 con 0x55f63c98c9a0 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7580f3a640 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f756c012e80 tx=0x7f756c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38037fd47b6d6dae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7566ffd640 1 -- 172.21.15.52:0/1504899832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c027040 con 0x55f63c98c9a0 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7566ffd640 1 -- 172.21.15.52:0/1504899832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f756c0049e0 con 0x55f63c98c9a0 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.032+0000 7f7566ffd640 1 -- 172.21.15.52:0/1504899832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c003d50 con 0x55f63c98c9a0 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- 172.21.15.52:0/1504899832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 msgr2=0x55f63c9870b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f756c012e80 tx=0x7f756c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- 172.21.15.52:0/1504899832 shutdown_connections 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c989400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98d2e0 0x55f63c99e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 --2- 172.21.15.52:0/1504899832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98c9a0 0x55f63c9870b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- 172.21.15.52:0/1504899832 >> 172.21.15.52:0/1504899832 conn(0x55f63c988010 msgr2=0x55f63c9869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- 172.21.15.52:0/1504899832 shutdown_connections 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- 172.21.15.52:0/1504899832 wait complete. 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 -- start start 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.033+0000 7f7586818740 1 Processor -- start 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98c9a0 0x55f63c99bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c99d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1a9a60 con 0x55f63c98d2e0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1aaed0 con 0x55f63c98c9a0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1aa130 con 0x55f63c992370 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7586818740 10 client.0 _ll_register_callbacks cb 0x7f757800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53174/0 (socket says 172.21.15.52:53174) 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 -- 172.21.15.52:0/3174787996 learned_addr learned my addr 172.21.15.52:0/3174787996 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7580f3a640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98c9a0 0x55f63c99bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7580f3a640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c99d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 -- 172.21.15.52:0/3174787996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 msgr2=0x55f63c99d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c99d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 -- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98c9a0 msgr2=0x55f63c99bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98c9a0 0x55f63c99bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 -- 172.21.15.52:0/3174787996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f63c99d750 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f758173b640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7578010d20 tx=0x7f757800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f00dac26633325d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.034+0000 7f7564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757802b040 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7578010690 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f63c8f7d70 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7578035030 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 10 client.17121 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f63ca0d970 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f63c8f7d70 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f757802e020 con 0x55f63c98d2e0 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 10 client.17121 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 10 client.17121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 20 client.17121 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63ca0e350 0x55f63ca10770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 4 client.17121 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f63c874900 con 0x55f63ca0e350 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.035+0000 7f7580f3a640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63ca0e350 0x55f63ca10770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.036+0000 7f7564ff9640 10 client.17121 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.036+0000 7f7580f3a640 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63ca0e350 0x55f63ca10770 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25af7e09b264c88 server_cookie=21b99f3ebc25a975 in_seq=0 out_seq=0 2024-09-19T09:26:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7564ff9640 1 -- 172.21.15.52:0/3174787996 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f63c874900 con 0x55f63ca0e350 2024-09-19T09:26:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7564ff9640 10 client.17121 handle_command_reply: tid=0 2024-09-19T09:26:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 client.17121 shutdown 2024-09-19T09:26:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 msgr2=0x55f63c99c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7578010d20 tx=0x7f757800b9c0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 shutdown_connections 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f63ca0e350 0x55f63ca10770 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f63c992370 0x55f63c99d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f63c98d2e0 0x55f63c99c180 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 --2- 172.21.15.52:0/3174787996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f63c98c9a0 0x55f63c99bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7564ff9640 0 client.17121 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 >> 172.21.15.52:0/3174787996 conn(0x55f63c988010 msgr2=0x55f63c9871c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 shutdown_connections 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.044+0000 7f7586818740 1 -- 172.21.15.52:0/3174787996 wait complete. 2024-09-19T09:26:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f7586818740 20 client.17121 trim_cache size 0 max 16384 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 msgr2=0x7f75680a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 0x7f75680a57b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f75740ee880 tx=0x7f75740c1040 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 msgr2=0x7f757c1a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f7574005e30 tx=0x7f7574031ee0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 shutdown_connections 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f757c101690 0x7f757c1a1510 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f757c100cf0 0x7f757c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f75680a32f0 0x7f75680a57b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 --2- 172.21.15.52:0/4231634106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f757c1003b0 0x7f757c199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 >> 172.21.15.52:0/4231634106 conn(0x7f757c0fc1e0 msgr2=0x7f757c0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 shutdown_connections 2024-09-19T09:26:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:23.045+0000 7f758399f640 1 -- 172.21.15.52:0/4231634106 wait complete. 2024-09-19T09:26:23.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 -- 172.21.15.52:0/3271337731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d0101440 msgr2=0x7fe9d010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3271337731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d0101440 0x7fe9d010df30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009900 tx=0x7fe9c402a410 comp rx=0 tx=0).stop 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 -- 172.21.15.52:0/3271337731 shutdown_connections 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3271337731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d010e500 0x7fe9d0110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3271337731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d0101440 0x7fe9d010df30 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3271337731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0100b20 0x7fe9d0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 -- 172.21.15.52:0/3271337731 >> 172.21.15.52:0/3271337731 conn(0x7fe9d00fc7d0 msgr2=0x7fe9d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 -- 172.21.15.52:0/3271337731 shutdown_connections 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.046+0000 7fe9d643d640 1 -- 172.21.15.52:0/3271337731 wait complete. 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.047+0000 7fe9d643d640 1 Processor -- start 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.047+0000 7fe9d643d640 1 -- start start 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d0100b20 0x7fe9d019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0101440 0x7fe9d019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d0114250 con 0x7fe9d010e500 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d01140d0 con 0x7fe9d0101440 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d643d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d01143d0 con 0x7fe9d0100b20 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53188/0 (socket says 172.21.15.52:53188) 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 -- 172.21.15.52:0/3126725511 learned_addr learned my addr 172.21.15.52:0/3126725511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9cf7fe640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0101440 0x7fe9d019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9cffff640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d0100b20 0x7fe9d019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 -- 172.21.15.52:0/3126725511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d0100b20 msgr2=0x7fe9d019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d0100b20 0x7fe9d019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 -- 172.21.15.52:0/3126725511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0101440 msgr2=0x7fe9d019ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0101440 0x7fe9d019ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 -- 172.21.15.52:0/3126725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d019f700 con 0x7fe9d010e500 2024-09-19T09:26:23.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9d49da640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800eb40 tx=0x7fe9c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.048+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8004b20 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.049+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d019f9f0 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.049+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9c8004cc0 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.049+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8010850 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.049+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d01a72d0 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.050+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d0100f00 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.051+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe9c8005020 con 0x7fe9d010e500 2024-09-19T09:26:23.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.052+0000 7fe9cd7fa640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 0x7fe9b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:23.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.052+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe9c80d01d0 con 0x7fe9d010e500 2024-09-19T09:26:23.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.052+0000 7fe9cffff640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 0x7fe9b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:23.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.052+0000 7fe9cffff640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 0x7fe9b80a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009b60 tx=0x7fe9c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:23.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.057+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9c809ce70 con 0x7fe9d010e500 2024-09-19T09:26:23.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.269+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9d0109600 con 0x7fe9d010e500 2024-09-19T09:26:23.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.269+0000 7fe9cd7fa640 1 -- 172.21.15.52:0/3126725511 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe9c809c770 con 0x7fe9d010e500 2024-09-19T09:26:23.270 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:26:23.271 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:26:23.271 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 msgr2=0x7fe9b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 0x7fe9b80a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009b60 tx=0x7fe9c0005f90 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 msgr2=0x7fe9d019f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800eb40 tx=0x7fe9c800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 shutdown_connections 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe9d010e500 0x7fe9d019f020 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d0101440 0x7fe9d019ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.271+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe9b80a3240 0x7fe9b80a5700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.272+0000 7fe9d643d640 1 --2- 172.21.15.52:0/3126725511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d0100b20 0x7fe9d019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.272+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 >> 172.21.15.52:0/3126725511 conn(0x7fe9d00fc7d0 msgr2=0x7fe9d010f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.272+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 shutdown_connections 2024-09-19T09:26:23.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:23.272+0000 7fe9d643d640 1 -- 172.21.15.52:0/3126725511 wait complete. 2024-09-19T09:26:23.688 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:23 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3126725511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:23 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3126725511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:23 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3126725511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:26:24.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:26:24.273 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:24.648 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:24 smithi052 ceph-mon[30947]: pgmap v487: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:26:24.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 -- 172.21.15.52:0/1895468422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 msgr2=0x7f90fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 --2- 172.21.15.52:0/1895468422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc1021c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 -- 172.21.15.52:0/1895468422 shutdown_connections 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 --2- 172.21.15.52:0/1895468422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 0x7f90fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 --2- 172.21.15.52:0/1895468422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 0x7f90fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 --2- 172.21.15.52:0/1895468422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc1021c0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 -- 172.21.15.52:0/1895468422 >> 172.21.15.52:0/1895468422 conn(0x7f90fc0fd8c0 msgr2=0x7f90fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 -- 172.21.15.52:0/1895468422 shutdown_connections 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.726+0000 7f9102719640 1 -- 172.21.15.52:0/1895468422 wait complete. 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.727+0000 7f9102719640 1 Processor -- start 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.727+0000 7f9102719640 1 -- start start 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.727+0000 7f9102719640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.727+0000 7f9102719640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 0x7f90fc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9102719640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 0x7f90fc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9102719640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc111f70 con 0x7f90fc101de0 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9102719640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc111df0 con 0x7f90fc102790 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9102719640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1120f0 con 0x7f90fc106f10 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53208/0 (socket says 172.21.15.52:53208) 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 -- 172.21.15.52:0/3063565710 learned_addr learned my addr 172.21.15.52:0/3063565710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 0x7f90fc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9100cb6640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 0x7f90fc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 -- 172.21.15.52:0/3063565710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 msgr2=0x7f90fc19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 0x7f90fc19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 -- 172.21.15.52:0/3063565710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 msgr2=0x7f90fc19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 0x7f90fc19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 -- 172.21.15.52:0/3063565710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc19f680 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f90ec006010 tx=0x7f90ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90f97fa640 1 -- 172.21.15.52:0/3063565710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec03f030 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc19f910 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.728+0000 7f90f97fa640 1 -- 172.21.15.52:0/3063565710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ec003ce0 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.729+0000 7f90f97fa640 1 -- 172.21.15.52:0/3063565710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec035070 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.729+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc1a7250 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f90f97fa640 1 -- 172.21.15.52:0/3063565710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f90ec042030 con 0x7f90fc101de0 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 Processor -- start 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 -- start start 2024-09-19T09:26:24.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc55a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cbbb2f0 con 0x55ad5cc56b40 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cb62cf0 con 0x55ad5cc555d0 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.731+0000 7f9104af2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cbb72b0 con 0x55ad5cc60370 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53212/0 (socket says 172.21.15.52:53212) 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 -- 172.21.15.52:0/544551799 learned_addr learned my addr 172.21.15.52:0/544551799 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90fbfff640 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc55a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90f97fa640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 -- 172.21.15.52:0/544551799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 msgr2=0x55ad5cc62760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc62760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 -- 172.21.15.52:0/544551799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 msgr2=0x55ad5cc55a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc55a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 -- 172.21.15.52:0/544551799 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5cb473a0 con 0x55ad5cc56b40 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90f97fa640 1 -- 172.21.15.52:0/3063565710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90ec0f0050 con 0x7f90fc101de0 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f9100cb6640 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009fc0 tx=0x7f90f4010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd16790bc89f1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90e27fc640 1 -- 172.21.15.52:0/544551799 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f401c900 con 0x55ad5cc56b40 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90e27fc640 1 -- 172.21.15.52:0/544551799 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f401b3d0 con 0x55ad5cc56b40 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.732+0000 7f90e27fc640 1 -- 172.21.15.52:0/544551799 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4025620 con 0x55ad5cc56b40 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 -- 172.21.15.52:0/544551799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 msgr2=0x55ad5cc55090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9100cb6640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 0x7f90e40a5700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90f4020000 tx=0x7f90f401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009fc0 tx=0x7f90f4010800 comp rx=0 tx=0).stop 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 -- 172.21.15.52:0/544551799 shutdown_connections 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc62760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc55a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 --2- 172.21.15.52:0/544551799 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc55090 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 -- 172.21.15.52:0/544551799 >> 172.21.15.52:0/544551799 conn(0x55ad5cc1e310 msgr2=0x55ad5cc51c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 -- 172.21.15.52:0/544551799 shutdown_connections 2024-09-19T09:26:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.733+0000 7f9104af2740 1 -- 172.21.15.52:0/544551799 wait complete. 2024-09-19T09:26:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 -- start start 2024-09-19T09:26:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 Processor -- start 2024-09-19T09:26:24.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc5d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cc630c0 con 0x55ad5cc56b40 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cb76060 con 0x55ad5cc555d0 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad5cc63240 con 0x55ad5cc60370 2024-09-19T09:26:24.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9104af2740 10 client.0 _ll_register_callbacks cb 0x55ad5c8c98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53224/0 (socket says 172.21.15.52:53224) 2024-09-19T09:26:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2410154249 learned_addr learned my addr 172.21.15.52:0/2410154249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f90fbfff640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.734+0000 7f9100cb6640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc5d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 msgr2=0x55ad5cc5d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc5d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2410154249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 msgr2=0x55ad5cc5fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2410154249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad5c92c3c0 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f90f000b9f0 tx=0x7f90f000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b759963857c71f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f001b640 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90f001b7e0 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90f401b3d0 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90f0020020 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f9104af2740 10 client.17139 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ad5cc6eb80 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.735+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f401b3d0 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90f0019020 con 0x55ad5cc56b40 2024-09-19T09:26:24.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 10 client.17139 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 10 client.17139 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 20 client.17139 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5cc6ffe0 0x55ad5cc72440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 4 client.17139 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad5cbc8860 con 0x55ad5cc6ffe0 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f90fbfff640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5cc6ffe0 0x55ad5cc72440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f90fbfff640 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5cc6ffe0 0x55ad5cc72440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=274caa48974cfe11 server_cookie=55a92fbed657e8ad in_seq=0 out_seq=0 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.736+0000 7f90db7fe640 10 client.17139 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f90db7fe640 1 -- 172.21.15.52:0/2410154249 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f90ec0ade80 con 0x55ad5cc6ffe0 2024-09-19T09:26:24.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f90db7fe640 10 client.17139 handle_command_reply: tid=0 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 client.17139 shutdown 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 msgr2=0x55ad5cc5cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f90f000b9f0 tx=0x7f90f000beb0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 shutdown_connections 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5cc6ffe0 0x55ad5cc72440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc60370 0x55ad5cc5d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc5cfe0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 --2- 172.21.15.52:0/2410154249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f90db7fe640 0 client.17139 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.737+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 >> 172.21.15.52:0/2410154249 conn(0x55ad5cc1e310 msgr2=0x55ad5cc57960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.738+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 shutdown_connections 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.738+0000 7f9104af2740 1 -- 172.21.15.52:0/2410154249 wait complete. 2024-09-19T09:26:24.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.738+0000 7f9104af2740 20 client.17139 trim_cache size 0 max 16384 2024-09-19T09:26:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 Processor -- start 2024-09-19T09:26:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 -- start start 2024-09-19T09:26:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5cc58660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1b2280 con 0x55ad5cc56b40 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1afb50 con 0x55ad5cc60370 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f9104af2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1ad9a0 con 0x55ad5cc555d0 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53226/0 (socket says 172.21.15.52:53226) 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2886567418 learned_addr learned my addr 172.21.15.52:0/2886567418 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2886567418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 msgr2=0x55ad5cc5ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2886567418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 msgr2=0x55ad5cc58660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5cc58660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 -- 172.21.15.52:0/2886567418 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad5cc5bf90 con 0x55ad5cc56b40 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.751+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f90f0004480 tx=0x7f90f0003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937d4eb2c180bb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f90e1ffb640 1 -- 172.21.15.52:0/2886567418 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0011640 con 0x55ad5cc56b40 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f90e1ffb640 1 -- 172.21.15.52:0/2886567418 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f0005850 con 0x55ad5cc56b40 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f90e1ffb640 1 -- 172.21.15.52:0/2886567418 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0004b90 con 0x55ad5cc56b40 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 -- 172.21.15.52:0/2886567418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 msgr2=0x55ad5cc58120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f90f0004480 tx=0x7f90f0003f20 comp rx=0 tx=0).stop 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 -- 172.21.15.52:0/2886567418 shutdown_connections 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5cc58660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc58120 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 --2- 172.21.15.52:0/2886567418 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc5ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 -- 172.21.15.52:0/2886567418 >> 172.21.15.52:0/2886567418 conn(0x55ad5cc1e310 msgr2=0x55ad5cc5e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 -- 172.21.15.52:0/2886567418 shutdown_connections 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.752+0000 7f9104af2740 1 -- 172.21.15.52:0/2886567418 wait complete. 2024-09-19T09:26:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 -- start start 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 Processor -- start 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc64a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5ccd9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1ae010 con 0x55ad5cc56b40 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1af480 con 0x55ad5cc60370 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc1ae6e0 con 0x55ad5cc555d0 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f9104af2740 10 client.0 _ll_register_callbacks cb 0x7f90f0004140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f90fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53232/0 (socket says 172.21.15.52:53232) 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.753+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3969218282 learned_addr learned my addr 172.21.15.52:0/3969218282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc64a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f9100cb6640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5ccd9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 msgr2=0x55ad5cc64a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc64a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3969218282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 msgr2=0x55ad5ccd9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5ccd9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 -- 172.21.15.52:0/3969218282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad5ccda2d0 con 0x55ad5cc56b40 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f9100cb6640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5ccd9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90fb7fe640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f90f0011a70 tx=0x7f90f0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7f36c09fcbfd4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f001b850 con 0x55ad5cc56b40 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90f001b9f0 con 0x55ad5cc56b40 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90f0005850 con 0x55ad5cc56b40 2024-09-19T09:26:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90f003c020 con 0x55ad5cc56b40 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f9104af2740 10 client.17145 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.754+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ad5ccdb5b0 con 0x55ad5cc56b40 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f0005850 con 0x55ad5cc56b40 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90f0019040 con 0x55ad5cc56b40 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 10 client.17145 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 10 client.17145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 20 client.17145 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5ccdbc10 0x55ad5ccde030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 4 client.17145 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad5cbc2d70 con 0x55ad5ccdbc10 2024-09-19T09:26:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5ccdbc10 0x55ad5ccde030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f90fbfff640 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5ccdbc10 0x55ad5ccde030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7aa21eae6891effa server_cookie=86a15def7db90b5f in_seq=0 out_seq=0 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.755+0000 7f90db7fe640 10 client.17145 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f90db7fe640 1 -- 172.21.15.52:0/3969218282 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad5cbc2d70 con 0x55ad5ccdbc10 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f90db7fe640 10 client.17145 handle_command_reply: tid=0 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 client.17145 shutdown 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 msgr2=0x55ad5cc64f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f90f0011a70 tx=0x7f90f0011aa0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 shutdown_connections 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55ad5ccdbc10 0x55ad5ccde030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad5cc60370 0x55ad5ccd9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad5cc56b40 0x55ad5cc64f40 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 --2- 172.21.15.52:0/3969218282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad5cc555d0 0x55ad5cc64a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f90db7fe640 0 client.17145 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:26:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 >> 172.21.15.52:0/3969218282 conn(0x55ad5cc1e310 msgr2=0x55ad5cc50d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 shutdown_connections 2024-09-19T09:26:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 1 -- 172.21.15.52:0/3969218282 wait complete. 2024-09-19T09:26:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.756+0000 7f9104af2740 20 client.17145 trim_cache size 0 max 16384 2024-09-19T09:26:24.769 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 msgr2=0x7f90e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 0x7f90e40a5700 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90f4020000 tx=0x7f90f401d000 comp rx=0 tx=0).stop 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 msgr2=0x7f90fc19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f90ec006010 tx=0x7f90ec0042f0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 shutdown_connections 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90e40a3240 0x7f90e40a5700 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90fc106f10 0x7f90fc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90fc102790 0x7f90fc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 --2- 172.21.15.52:0/3063565710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90fc101de0 0x7f90fc19a6d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 >> 172.21.15.52:0/3063565710 conn(0x7f90fc0fd8c0 msgr2=0x7f90fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 shutdown_connections 2024-09-19T09:26:24.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:24.757+0000 7f9102719640 1 -- 172.21.15.52:0/3063565710 wait complete. 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:64/600: open fd = 3 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:65/600: open fd = 3 2024-09-19T09:26:24.776 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:66/600: open fd = 3 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:67/600: open fd = 3 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:68/600: open fd = 3 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.777 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:69/600: open fd = 3 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:70/600: open fd = 3 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:71/600: open fd = 3 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:72/600: open fd = 3 2024-09-19T09:26:24.778 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:73/600: open fd = 3 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:74/600: open fd = 3 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.779 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:75/600: open fd = 3 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:76/600: open fd = 3 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:77/600: open fd = 3 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.780 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:78/600: open fd = 3 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:79/600: open fd = 3 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:80/600: open fd = 3 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.781 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:81/600: open fd = 3 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:82/600: open fd = 3 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:83/600: open fd = 3 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.782 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:84/600: open fd = 3 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:85/600: open fd = 3 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:86/600: open fd = 3 2024-09-19T09:26:24.783 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:87/600: open fd = 3 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:88/600: open fd = 3 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:89/600: open fd = 3 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.784 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:90/600: open fd = 3 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:91/600: open fd = 3 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:92/600: open fd = 3 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.785 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:93/600: open fd = 3 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:94/600: open fd = 3 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:95/600: open fd = 3 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:96/600: open fd = 3 2024-09-19T09:26:24.786 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:97/600: open fd = 3 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:98/600: open fd = 3 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:99/600: open fd = 3 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.787 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:100/600: open fd = 3 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:101/600: open fd = 3 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:102/600: open fd = 3 2024-09-19T09:26:24.788 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:103/600: open fd = 3 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.789 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:104/600: open fd = 3 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:105/600: open fd = 3 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:106/600: open fd = 3 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.790 INFO:tasks.workunit.client.0.smithi052.stdout:107/600: open fd = 3 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:108/600: open fd = 3 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:109/600: open fd = 3 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:110/600: open fd = 3 2024-09-19T09:26:24.791 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:111/600: open fd = 3 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:112/600: open fd = 3 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.792 INFO:tasks.workunit.client.0.smithi052.stdout:113/600: open fd = 3 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:114/600: open fd = 3 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:115/600: open fd = 3 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:116/600: open fd = 3 2024-09-19T09:26:24.793 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:117/600: open fd = 3 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:118/600: open fd = 3 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:119/600: open fd = 3 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.794 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:120/600: open fd = 3 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:121/600: open fd = 3 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:122/600: open fd = 3 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.795 INFO:tasks.workunit.client.0.smithi052.stdout:123/600: open fd = 3 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:124/600: open fd = 3 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.796 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:125/600: open fd = 3 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:126/600: open fd = 3 2024-09-19T09:26:24.797 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:26:24.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:24 smithi169 ceph-mon[35454]: pgmap v487: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:26:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:24 smithi086 ceph-mon[34813]: pgmap v487: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:26:25.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:26:25.799 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 -- 172.21.15.52:0/2008447017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 msgr2=0x7fe0841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 --2- 172.21.15.52:0/2008447017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841067e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe074009900 tx=0x7fe07402a410 comp rx=0 tx=0).stop 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 -- 172.21.15.52:0/2008447017 shutdown_connections 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 --2- 172.21.15.52:0/2008447017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 0x7fe08410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 --2- 172.21.15.52:0/2008447017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841067e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 --2- 172.21.15.52:0/2008447017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 0x7fe0841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 -- 172.21.15.52:0/2008447017 >> 172.21.15.52:0/2008447017 conn(0x7fe0840fd8c0 msgr2=0x7fe0840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 -- 172.21.15.52:0/2008447017 shutdown_connections 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.292+0000 7fe08c6af640 1 -- 172.21.15.52:0/2008447017 wait complete. 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 Processor -- start 2024-09-19T09:26:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 -- start start 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 0x7fe084198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 0x7fe08419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe084111f70 con 0x7fe084102790 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe084111df0 con 0x7fe084101de0 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe08c6af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841120f0 con 0x7fe084106f10 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.293+0000 7fe089c4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53252/0 (socket says 172.21.15.52:53252) 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 -- 172.21.15.52:0/124250284 learned_addr learned my addr 172.21.15.52:0/124250284 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe08ac4c640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 0x7fe08419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe08a44b640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 0x7fe084198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 -- 172.21.15.52:0/124250284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 msgr2=0x7fe08419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 0x7fe08419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 -- 172.21.15.52:0/124250284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 msgr2=0x7fe084198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 0x7fe084198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 -- 172.21.15.52:0/124250284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08419d420 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe089c4a640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe074006010 tx=0x7fe0740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe07b7fe640 1 -- 172.21.15.52:0/124250284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07403f030 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08419d6b0 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe07b7fe640 1 -- 172.21.15.52:0/124250284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe074003ce0 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe07b7fe640 1 -- 172.21.15.52:0/124250284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074035070 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.294+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841a4ff0 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.297+0000 7fe08ea88740 1 Processor -- start 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.297+0000 7fe07b7fe640 1 -- 172.21.15.52:0/124250284 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe074042030 con 0x7fe084102790 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.297+0000 7fe08ea88740 1 -- start start 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 0x557aa406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4079760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557aa3fd22f0 con 0x557aa406db40 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557aa3f79cf0 con 0x557aa4077370 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ea88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557aa3fce2b0 con 0x557aa406c5d0 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53256/0 (socket says 172.21.15.52:53256) 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 -- 172.21.15.52:0/1670019330 learned_addr learned my addr 172.21.15.52:0/1670019330 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 0x557aa406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4079760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 -- 172.21.15.52:0/1670019330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 msgr2=0x557aa406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 0x557aa406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 -- 172.21.15.52:0/1670019330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 msgr2=0x557aa4079760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4079760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 -- 172.21.15.52:0/1670019330 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa3f5e3a0 con 0x557aa406db40 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 0x557aa406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe07b7fe640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 0x7fe0700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08a44b640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 0x7fe0700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe08ac4c640 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00ae10 tx=0x7fe07c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440be311c0a2e3f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.298+0000 7fe07b7fe640 1 -- 172.21.15.52:0/124250284 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe0740eff70 con 0x7fe084102790 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe078ff9640 1 -- 172.21.15.52:0/1670019330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c003b70 con 0x557aa406db40 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe078ff9640 1 -- 172.21.15.52:0/1670019330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe07c003d10 con 0x557aa406db40 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe078ff9640 1 -- 172.21.15.52:0/1670019330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c010a30 con 0x557aa406db40 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 -- 172.21.15.52:0/1670019330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 msgr2=0x557aa406c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08a44b640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 0x7fe0700a5700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x557aa4069ac0 tx=0x7fe080005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00ae10 tx=0x7fe07c00f790 comp rx=0 tx=0).stop 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 -- 172.21.15.52:0/1670019330 shutdown_connections 2024-09-19T09:26:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4079760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406c5d0 0x557aa406ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1670019330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406c090 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.299+0000 7fe08ea88740 1 -- 172.21.15.52:0/1670019330 >> 172.21.15.52:0/1670019330 conn(0x557aa4035310 msgr2=0x557aa4068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- 172.21.15.52:0/1670019330 shutdown_connections 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- 172.21.15.52:0/1670019330 wait complete. 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- start start 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 Processor -- start 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406db40 0x557aa4073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4074530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557aa407a070 con 0x557aa406c5d0 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557aa3f8d060 con 0x557aa4077370 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557aa407a1f0 con 0x557aa406db40 2024-09-19T09:26:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ea88740 10 client.0 _ll_register_callbacks cb 0x557aa3ce08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08a44b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08a44b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53260/0 (socket says 172.21.15.52:53260) 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08a44b640 1 -- 172.21.15.52:0/1395365207 learned_addr learned my addr 172.21.15.52:0/1395365207 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe08ac4c640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.300+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406db40 0x557aa4073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 -- 172.21.15.52:0/1395365207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406db40 msgr2=0x557aa4073fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406db40 0x557aa4073fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 -- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 msgr2=0x557aa4074530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4074530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 -- 172.21.15.52:0/1395365207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa3d433c0 con 0x557aa406c5d0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe0800095c0 tx=0x7fe0800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44994966c4dff817 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080011b50 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe080011cf0 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c003d10 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe08002d030 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08ea88740 10 client.17157 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.301+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557aa4085b00 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe07c003d10 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe080020420 con 0x557aa406c5d0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 10 client.17157 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 10 client.17157 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 20 client.17157 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa4086fc0 0x557aa40893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 4 client.17157 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557aa3fdf860 con 0x557aa4086fc0 2024-09-19T09:26:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa4086fc0 0x557aa40893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe06dffb640 10 client.17157 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.302+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa4086fc0 0x557aa40893b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b3a3dff748fd2980 server_cookie=f5e49b390f86d7d6 in_seq=0 out_seq=0 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe06dffb640 1 -- 172.21.15.52:0/1395365207 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557aa3fdf860 con 0x557aa4086fc0 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe06dffb640 10 client.17157 handle_command_reply: tid=0 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 client.17157 shutdown 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 msgr2=0x557aa4076d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe0800095c0 tx=0x7fe0800046c0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 shutdown_connections 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa4086fc0 0x557aa40893b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa4077370 0x557aa4074530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa406db40 0x557aa4073fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe06dffb640 0 client.17157 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1395365207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa4076d00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.303+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 >> 172.21.15.52:0/1395365207 conn(0x557aa4035310 msgr2=0x557aa406e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.304+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 shutdown_connections 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.304+0000 7fe08ea88740 1 -- 172.21.15.52:0/1395365207 wait complete. 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.304+0000 7fe08ea88740 20 client.17157 trim_cache size 0 max 16384 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 Processor -- start 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 -- start start 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 0x557aa4073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa406f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b00a0 con 0x557aa406db40 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ad970 con 0x557aa406c5d0 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08ea88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ab7c0 con 0x557aa4077370 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53276/0 (socket says 172.21.15.52:53276) 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 -- 172.21.15.52:0/4278013010 learned_addr learned my addr 172.21.15.52:0/4278013010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08a44b640 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 0x557aa4073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 -- 172.21.15.52:0/4278013010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 msgr2=0x557aa406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 -- 172.21.15.52:0/4278013010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 msgr2=0x557aa4073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 0x557aa4073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 -- 172.21.15.52:0/4278013010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aa4072f60 con 0x557aa406db40 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe08a44b640 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 0x557aa4073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.317+0000 7fe089c4a640 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe0740ed9f0 tx=0x7fe07402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfd9f2ed3c8745f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe06ffff640 1 -- 172.21.15.52:0/4278013010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074049040 con 0x557aa406db40 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe06ffff640 1 -- 172.21.15.52:0/4278013010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0740bccd0 con 0x557aa406db40 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe06ffff640 1 -- 172.21.15.52:0/4278013010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0740ba8d0 con 0x557aa406db40 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 -- 172.21.15.52:0/4278013010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 msgr2=0x557aa406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fe0740ed9f0 tx=0x7fe07402a410 comp rx=0 tx=0).stop 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 -- 172.21.15.52:0/4278013010 shutdown_connections 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406db40 0x557aa406f120 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 --2- 172.21.15.52:0/4278013010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406c5d0 0x557aa4073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 -- 172.21.15.52:0/4278013010 >> 172.21.15.52:0/4278013010 conn(0x557aa4035310 msgr2=0x557aa4067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 -- 172.21.15.52:0/4278013010 shutdown_connections 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.318+0000 7fe08ea88740 1 -- 172.21.15.52:0/4278013010 wait complete. 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 -- start start 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 Processor -- start 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406db40 0x557aa407bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa40eac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841abe30 con 0x557aa406c5d0 2024-09-19T09:26:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ad2a0 con 0x557aa406db40 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ac500 con 0x557aa4077370 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08ea88740 10 client.0 _ll_register_callbacks cb 0x7fe080009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53292/0 (socket says 172.21.15.52:53292) 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 -- 172.21.15.52:0/1092592312 learned_addr learned my addr 172.21.15.52:0/1092592312 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406db40 0x557aa407bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 -- 172.21.15.52:0/1092592312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 msgr2=0x557aa40eac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa40eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 -- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406db40 msgr2=0x557aa407bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406db40 0x557aa407bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.319+0000 7fe08a44b640 1 -- 172.21.15.52:0/1092592312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aa4077070 con 0x557aa406c5d0 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08a44b640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe080009660 tx=0x7fe080020650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b7bf1681e772a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080009e80 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0740bccd0 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe08002e070 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe080003e50 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 10 client.17163 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557aa40f24b0 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0740bccd0 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe080042030 con 0x557aa406c5d0 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 10 client.17163 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 10 client.17163 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 20 client.17163 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa40f2c50 0x557aa40f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 4 client.17163 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.320+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557aa3fd9d70 con 0x557aa40f2c50 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa40f2c50 0x557aa40f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe089c4a640 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa40f2c50 0x557aa40f50d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80092b68b3df5495 server_cookie=6a8f6349ad43054b in_seq=0 out_seq=0 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe06dffb640 10 client.17163 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe06dffb640 1 -- 172.21.15.52:0/1092592312 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557aa3fd9d70 con 0x557aa40f2c50 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe06dffb640 10 client.17163 handle_command_reply: tid=0 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.321+0000 7fe08ea88740 1 client.17163 shutdown 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 msgr2=0x557aa407ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fe080009660 tx=0x7fe080020650 comp rx=0 tx=0).stop 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 shutdown_connections 2024-09-19T09:26:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557aa4077370 0x557aa40eac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557aa40f2c50 0x557aa40f50d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557aa406db40 0x557aa407bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 --2- 172.21.15.52:0/1092592312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557aa406c5d0 0x557aa407ba90 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 >> 172.21.15.52:0/1092592312 conn(0x557aa4035310 msgr2=0x557aa4075810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe06dffb640 0 client.17163 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 shutdown_connections 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 1 -- 172.21.15.52:0/1092592312 wait complete. 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08ea88740 20 client.17163 trim_cache size 0 max 16384 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 msgr2=0x7fe0700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 0x7fe0700a5700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x557aa4069ac0 tx=0x7fe080005f90 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 msgr2=0x7fe0841989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe074006010 tx=0x7fe0740042f0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 shutdown_connections 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe0700a3240 0x7fe0700a5700 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe084106f10 0x7fe08419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe084102790 0x7fe0841989b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 --2- 172.21.15.52:0/124250284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe084101de0 0x7fe084198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 >> 172.21.15.52:0/124250284 conn(0x7fe0840fd8c0 msgr2=0x7fe0840fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:26.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.322+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 shutdown_connections 2024-09-19T09:26:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:26.323+0000 7fe08c6af640 1 -- 172.21.15.52:0/124250284 wait complete. 2024-09-19T09:26:26.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:26 smithi052 ceph-mon[30947]: pgmap v488: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-19T09:26:26.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:26 smithi169 ceph-mon[35454]: pgmap v488: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-19T09:26:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:26 smithi086 ceph-mon[34813]: pgmap v488: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-09-19T09:26:27.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:26:27.426 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 -- 172.21.15.52:0/69782770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074590 msgr2=0x7fd690074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 --2- 172.21.15.52:0/69782770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074590 0x7fd690074970 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd680009900 tx=0x7fd68002a480 comp rx=0 tx=0).stop 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 -- 172.21.15.52:0/69782770 shutdown_connections 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 --2- 172.21.15.52:0/69782770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690112b90 0x7fd690114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 --2- 172.21.15.52:0/69782770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690074eb0 0x7fd690112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 --2- 172.21.15.52:0/69782770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074590 0x7fd690074970 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 -- 172.21.15.52:0/69782770 >> 172.21.15.52:0/69782770 conn(0x7fd6900fd8c0 msgr2=0x7fd6900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 -- 172.21.15.52:0/69782770 shutdown_connections 2024-09-19T09:26:27.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.917+0000 7fd694a28640 1 -- 172.21.15.52:0/69782770 wait complete. 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.918+0000 7fd694a28640 1 Processor -- start 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.918+0000 7fd694a28640 1 -- start start 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690074590 0x7fd6901a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 0x7fd69019e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd690118570 con 0x7fd690074eb0 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901183f0 con 0x7fd690074590 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd694a28640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901186f0 con 0x7fd690112b90 2024-09-19T09:26:27.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53310/0 (socket says 172.21.15.52:53310) 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 -- 172.21.15.52:0/1404253695 learned_addr learned my addr 172.21.15.52:0/1404253695 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd68e59c640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690074590 0x7fd6901a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 0x7fd69019e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 -- 172.21.15.52:0/1404253695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 msgr2=0x7fd69019e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 0x7fd69019e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 -- 172.21.15.52:0/1404253695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690074590 msgr2=0x7fd6901a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690074590 0x7fd6901a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 -- 172.21.15.52:0/1404253695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69019f010 con 0x7fd690074eb0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 0x7fd69019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.919+0000 7fd685d9b640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d770 tx=0x7fd67800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.920+0000 7fd687fff640 1 -- 172.21.15.52:0/1404253695 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678017070 con 0x7fd690074eb0 2024-09-19T09:26:27.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.920+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69019f300 con 0x7fd690074eb0 2024-09-19T09:26:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.920+0000 7fd687fff640 1 -- 172.21.15.52:0/1404253695 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd678005500 con 0x7fd690074eb0 2024-09-19T09:26:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.920+0000 7fd687fff640 1 -- 172.21.15.52:0/1404253695 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678004e00 con 0x7fd690074eb0 2024-09-19T09:26:27.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.920+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901ab5f0 con 0x7fd690074eb0 2024-09-19T09:26:27.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.922+0000 7fd687fff640 1 -- 172.21.15.52:0/1404253695 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd678004fa0 con 0x7fd690074eb0 2024-09-19T09:26:27.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.922+0000 7fd696e01740 1 Processor -- start 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.922+0000 7fd696e01740 1 -- start start 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822120c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x55822120ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5582211722f0 con 0x558221217370 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558221119cf0 con 0x55822120db40 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd696e01740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55822116e2b0 con 0x55822120c5d0 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd687fff640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 0x7fd67c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53314/0 (socket says 172.21.15.52:53314) 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 -- 172.21.15.52:0/2293014201 learned_addr learned my addr 172.21.15.52:0/2293014201 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x55822120ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822120c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 0x7fd67c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd687fff640 1 -- 172.21.15.52:0/1404253695 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd6780cf470 con 0x7fd690074eb0 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 -- 172.21.15.52:0/2293014201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 msgr2=0x55822120ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x55822120ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 -- 172.21.15.52:0/2293014201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 msgr2=0x55822120c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822120c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 -- 172.21.15.52:0/2293014201 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582210fe3a0 con 0x558221217370 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.923+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd6780cce90 tx=0x7fd678009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ff2f15deddec93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 0x7fd67c0a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd688009370 tx=0x7fd688009240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd684d99640 1 -- 172.21.15.52:0/2293014201 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678020070 con 0x558221217370 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd684d99640 1 -- 172.21.15.52:0/2293014201 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6780046c0 con 0x558221217370 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd684d99640 1 -- 172.21.15.52:0/2293014201 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780ccfa0 con 0x558221217370 2024-09-19T09:26:27.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 -- 172.21.15.52:0/2293014201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 msgr2=0x558221219760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fd6780cce90 tx=0x7fd678009c30 comp rx=0 tx=0).stop 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 -- 172.21.15.52:0/2293014201 shutdown_connections 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558221217370 0x558221219760 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x55822120ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 --2- 172.21.15.52:0/2293014201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822120c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.924+0000 7fd696e01740 1 -- 172.21.15.52:0/2293014201 >> 172.21.15.52:0/2293014201 conn(0x5582211d5310 msgr2=0x558221208c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- 172.21.15.52:0/2293014201 shutdown_connections 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- 172.21.15.52:0/2293014201 wait complete. 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- start start 2024-09-19T09:26:27.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 Processor -- start 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x558221216dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221214810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558221219fb0 con 0x55822120db40 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55822112d060 con 0x558221217370 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55822121a130 con 0x55822120c5d0 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd696e01740 10 client.0 _ll_register_callbacks cb 0x558220e808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd685d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53316/0 (socket says 172.21.15.52:53316) 2024-09-19T09:26:27.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd685d9b640 1 -- 172.21.15.52:0/4032063156 learned_addr learned my addr 172.21.15.52:0/4032063156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.925+0000 7fd68e59c640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x558221216dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221214810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 -- 172.21.15.52:0/4032063156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 msgr2=0x558221216dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x558221216dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 -- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 msgr2=0x558221214810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221214810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 -- 172.21.15.52:0/4032063156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558220ee33c0 con 0x55822120db40 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221214810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd685d9b640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d740 tx=0x7fd67809fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484cd045b4c91559 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678020070 con 0x55822120db40 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd6780860b0 con 0x55822120db40 2024-09-19T09:26:27.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55822117f860 con 0x55822120db40 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd6780b9020 con 0x55822120db40 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd696e01740 10 client.17175 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.926+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558221225ad0 con 0x55822120db40 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55822117f860 con 0x55822120db40 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd67809cce0 con 0x55822120db40 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 10 client.17175 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 20 client.17175 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221226e20 0x558221229210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 4 client.17175 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558221179d70 con 0x558221226e20 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd68e59c640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221226e20 0x558221229210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd675ffb640 10 client.17175 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.927+0000 7fd68e59c640 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221226e20 0x558221229210 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1797d92006007d1a server_cookie=cd36c328d7b5c7d7 in_seq=0 out_seq=0 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd675ffb640 1 -- 172.21.15.52:0/4032063156 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558221179d70 con 0x558221226e20 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd675ffb640 10 client.17175 handle_command_reply: tid=0 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 client.17175 shutdown 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 msgr2=0x558221214080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d740 tx=0x7fd67809fe70 comp rx=0 tx=0).stop 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 shutdown_connections 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221226e20 0x558221229210 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221214810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120db40 0x558221214080 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd675ffb640 0 client.17175 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 --2- 172.21.15.52:0/4032063156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120c5d0 0x558221216dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 >> 172.21.15.52:0/4032063156 conn(0x5582211d5310 msgr2=0x55822120e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.928+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 shutdown_connections 2024-09-19T09:26:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.929+0000 7fd696e01740 1 -- 172.21.15.52:0/4032063156 wait complete. 2024-09-19T09:26:27.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.929+0000 7fd696e01740 20 client.17175 trim_cache size 0 max 16384 2024-09-19T09:26:27.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.941+0000 7fd696e01740 1 Processor -- start 2024-09-19T09:26:27.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.941+0000 7fd696e01740 1 -- start start 2024-09-19T09:26:27.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822122c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 0x55822122c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b6710 con 0x55822120c5d0 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b3fe0 con 0x55822120db40 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd696e01740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b1e30 con 0x558221217370 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53328/0 (socket says 172.21.15.52:53328) 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 -- 172.21.15.52:0/2218004125 learned_addr learned my addr 172.21.15.52:0/2218004125 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 0x55822122c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822122c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 -- 172.21.15.52:0/2218004125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 msgr2=0x55822122c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 0x55822122c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 -- 172.21.15.52:0/2218004125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 msgr2=0x55822122c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822122c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 -- 172.21.15.52:0/2218004125 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558221214b80 con 0x55822120c5d0 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 0x55822122c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822122c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd68002a9a0 tx=0x7fd680031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2774c953aac89868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd677fff640 1 -- 172.21.15.52:0/2218004125 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680035040 con 0x55822120c5d0 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd677fff640 1 -- 172.21.15.52:0/2218004125 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd680004240 con 0x55822120c5d0 2024-09-19T09:26:27.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.942+0000 7fd677fff640 1 -- 172.21.15.52:0/2218004125 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680048630 con 0x55822120c5d0 2024-09-19T09:26:27.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 -- 172.21.15.52:0/2218004125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 msgr2=0x558221213060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd68002a9a0 tx=0x7fd680031a20 comp rx=0 tx=0).stop 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 -- 172.21.15.52:0/2218004125 shutdown_connections 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558221217370 0x55822122c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55822120db40 0x55822122c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 --2- 172.21.15.52:0/2218004125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221213060 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 -- 172.21.15.52:0/2218004125 >> 172.21.15.52:0/2218004125 conn(0x5582211d5310 msgr2=0x558221212950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 -- 172.21.15.52:0/2218004125 shutdown_connections 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.943+0000 7fd696e01740 1 -- 172.21.15.52:0/2218004125 wait complete. 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 -- start start 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 Processor -- start 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 0x558221229e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221289720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b24a0 con 0x55822120c5d0 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b3910 con 0x558221217370 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b2b70 con 0x55822120db40 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd696e01740 10 client.0 _ll_register_callbacks cb 0x7fd688009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53336/0 (socket says 172.21.15.52:53336) 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 -- 172.21.15.52:0/2649397375 learned_addr learned my addr 172.21.15.52:0/2649397375 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68ed9d640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221289720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 0x558221229e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 -- 172.21.15.52:0/2649397375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 msgr2=0x558221229e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 0x558221229e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 -- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 msgr2=0x558221289720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221289720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd68e59c640 1 -- 172.21.15.52:0/2649397375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558221289dc0 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.944+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 0x558221229e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd68e59c640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd6800057c0 tx=0x7fd680031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c90287bc68ba8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680035040 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd6800037f0 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd680004240 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd68005e030 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 10 client.17181 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558221291120 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd680004240 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd680004890 con 0x55822120c5d0 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 10 client.17181 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:27.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 20 client.17181 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221291810 0x558221293c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.945+0000 7fd696e01740 4 client.17181 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582210f6170 con 0x558221291810 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221291810 0x558221293c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd685d9b640 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221291810 0x558221293c30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eca72425efe6624 server_cookie=1c77cc3808220f0a in_seq=0 out_seq=0 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd675ffb640 10 client.17181 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd675ffb640 1 -- 172.21.15.52:0/2649397375 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582210f6170 con 0x558221291810 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd675ffb640 10 client.17181 handle_command_reply: tid=0 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.946+0000 7fd696e01740 1 client.17181 shutdown 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 msgr2=0x558221229910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd6800057c0 tx=0x7fd680031400 comp rx=0 tx=0).stop 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 shutdown_connections 2024-09-19T09:26:27.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558221291810 0x558221293c30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558221217370 0x558221289720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55822120db40 0x558221229e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 --2- 172.21.15.52:0/2649397375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55822120c5d0 0x558221229910 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 >> 172.21.15.52:0/2649397375 conn(0x5582211d5310 msgr2=0x558221213170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd675ffb640 0 client.17181 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 shutdown_connections 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 1 -- 172.21.15.52:0/2649397375 wait complete. 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd696e01740 20 client.17181 trim_cache size 0 max 16384 2024-09-19T09:26:27.954 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 msgr2=0x7fd67c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 0x7fd67c0a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd688009370 tx=0x7fd688009240 comp rx=0 tx=0).stop 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 msgr2=0x7fd6901a4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d770 tx=0x7fd67800dc30 comp rx=0 tx=0).stop 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 shutdown_connections 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd67c0a3240 0x7fd67c0a5700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd690112b90 0x7fd69019e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd690074eb0 0x7fd6901a4c60 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 --2- 172.21.15.52:0/1404253695 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd690074590 0x7fd6901a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:27.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.947+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 >> 172.21.15.52:0/1404253695 conn(0x7fd6900fd8c0 msgr2=0x7fd6900ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:27.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.948+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 shutdown_connections 2024-09-19T09:26:27.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:27.948+0000 7fd694a28640 1 -- 172.21.15.52:0/1404253695 wait complete. 2024-09-19T09:26:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:28 smithi052 ceph-mon[30947]: pgmap v489: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T09:26:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:28 smithi169 ceph-mon[35454]: pgmap v489: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T09:26:29.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:28 smithi086 ceph-mon[34813]: pgmap v489: 97 pgs: 97 active+clean; 2.2 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.6 KiB/s wr, 10 op/s 2024-09-19T09:26:29.653 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:26:29.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:26:29.939 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:30.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1340139388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd4102dd0 msgr2=0x7fdbd41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1340139388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd4102dd0 0x7fdbd41031b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009900 tx=0x7fdbd002a480 comp rx=0 tx=0).stop 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1340139388 shutdown_connections 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1340139388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1340139388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd41036f0 0x7fdbd410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1340139388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd4102dd0 0x7fdbd41031b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.388+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1340139388 >> 172.21.15.52:0/1340139388 conn(0x7fdbd40fc790 msgr2=0x7fdbd40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.389+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1340139388 shutdown_connections 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.389+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1340139388 wait complete. 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.389+0000 7fdbdbc51640 1 Processor -- start 2024-09-19T09:26:30.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.389+0000 7fdbdbc51640 1 -- start start 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 0x7fdbd4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111f20 con 0x7fdbd41036f0 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd4111da0 con 0x7fdbd410c170 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbdbc51640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41120a0 con 0x7fdbd4102dd0 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55448/0 (socket says 172.21.15.52:55448) 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbd91ec640 1 -- 172.21.15.52:0/1073616042 learned_addr learned my addr 172.21.15.52:0/1073616042 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 0x7fdbd4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.390+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd91ec640 1 -- 172.21.15.52:0/1073616042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 msgr2=0x7fdbd4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 0x7fdbd4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd91ec640 1 -- 172.21.15.52:0/1073616042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 msgr2=0x7fdbd419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd91ec640 1 -- 172.21.15.52:0/1073616042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd419d3f0 con 0x7fdbd41036f0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 0x7fdbd4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.391+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e9f0 tx=0x7fdbc400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbcaffd640 1 -- 172.21.15.52:0/1073616042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400cd80 con 0x7fdbd41036f0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbcaffd640 1 -- 172.21.15.52:0/1073616042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc4010910 con 0x7fdbd41036f0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd419d6e0 con 0x7fdbd41036f0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbcaffd640 1 -- 172.21.15.52:0/1073616042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4018990 con 0x7fdbd41036f0 2024-09-19T09:26:30.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.392+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd41a4fc0 con 0x7fdbd41036f0 2024-09-19T09:26:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.395+0000 7fdbcaffd640 1 -- 172.21.15.52:0/1073616042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdbc4010ac0 con 0x7fdbd41036f0 2024-09-19T09:26:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.395+0000 7fdbde02a740 1 Processor -- start 2024-09-19T09:26:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.395+0000 7fdbde02a740 1 -- start start 2024-09-19T09:26:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b20e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0a86280 con 0x55c1a0b21340 2024-09-19T09:26:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbcaffd640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 0x7fdbc00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0a2db10 con 0x55c1a0b30150 2024-09-19T09:26:30.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbde02a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0a82240 con 0x55c1a0b20a20 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 0x7fdbc00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbd99ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbcaffd640 1 -- 172.21.15.52:0/1073616042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbc40cfdc0 con 0x7fdbd41036f0 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbd99ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55458/0 (socket says 172.21.15.52:55458) 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbd99ed640 1 -- 172.21.15.52:0/251677894 learned_addr learned my addr 172.21.15.52:0/251677894 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:30.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.396+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b20e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 -- 172.21.15.52:0/251677894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 msgr2=0x55c1a0b20e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b20e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 -- 172.21.15.52:0/251677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 msgr2=0x55c1a0b32540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b32540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 -- 172.21.15.52:0/251677894 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a0a3a1f0 con 0x55c1a0b21340 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 0x7fdbc00a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005fd0 tx=0x7fdbcc009db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0033000 tx=0x7fdbd0005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3dba1b4413e8f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbbffff640 1 -- 172.21.15.52:0/251677894 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003f070 con 0x55c1a0b21340 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbbffff640 1 -- 172.21.15.52:0/251677894 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbd0004030 con 0x55c1a0b21340 2024-09-19T09:26:30.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.397+0000 7fdbbffff640 1 -- 172.21.15.52:0/251677894 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0035070 con 0x55c1a0b21340 2024-09-19T09:26:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 -- 172.21.15.52:0/251677894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 msgr2=0x55c1a0b2fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0033000 tx=0x7fdbd0005e60 comp rx=0 tx=0).stop 2024-09-19T09:26:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 -- 172.21.15.52:0/251677894 shutdown_connections 2024-09-19T09:26:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b32540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2fc10 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 --2- 172.21.15.52:0/251677894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b20e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 -- 172.21.15.52:0/251677894 >> 172.21.15.52:0/251677894 conn(0x55c1a0b1d0f0 msgr2=0x55c1a0b1d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 -- 172.21.15.52:0/251677894 shutdown_connections 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.398+0000 7fdbde02a740 1 -- 172.21.15.52:0/251677894 wait complete. 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 -- start start 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 Processor -- start 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b2d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b2db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0b32cc0 con 0x55c1a0b21340 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0a40f10 con 0x55c1a0b30150 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1a0b32e40 con 0x55c1a0b20a20 2024-09-19T09:26:30.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbde02a740 10 client.0 _ll_register_callbacks cb 0x55c1a0a09a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55466/0 (socket says 172.21.15.52:55466) 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbd91ec640 1 -- 172.21.15.52:0/3594945141 learned_addr learned my addr 172.21.15.52:0/3594945141 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b2d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.399+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b2db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 -- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 msgr2=0x55c1a0b2db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b2db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 -- 172.21.15.52:0/3594945141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 msgr2=0x55c1a0b2d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 -- 172.21.15.52:0/3594945141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a07f76a0 con 0x55c1a0b20a20 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b2d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0032c30 tx=0x7fdbd0004550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997dd97944ac729c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:26:30.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0035070 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd0004030 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbd00315b0 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbd003f040 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbde02a740 10 client.26266 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c1a0b32cc0 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.400+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbd0004030 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbd00046c0 con 0x55c1a0b20a20 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 10 client.26266 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 10 client.26266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 20 client.26266 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0b3fb10 0x55c1a0b41f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 4 client.26266 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1a0a937f0 con 0x55c1a0b3fb10 2024-09-19T09:26:30.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0b3fb10 0x55c1a0b41f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbbd7fa640 10 client.26266 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:30.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.401+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0b3fb10 0x55c1a0b41f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1f24b6eeccb0a9 server_cookie=3fcd4b59fee79ac2 in_seq=0 out_seq=0 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/3594945141 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1a0a937f0 con 0x55c1a0b3fb10 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbbd7fa640 10 client.26266 handle_command_reply: tid=0 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 client.26266 shutdown 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 msgr2=0x55c1a0b2d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b2d0c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0032c30 tx=0x7fdbd0004550 comp rx=0 tx=0).stop 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 shutdown_connections 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0b3fb10 0x55c1a0b41f00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b30150 0x55c1a0b2db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b2d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 --2- 172.21.15.52:0/3594945141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b20a20 0x55c1a0b2d0c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 >> 172.21.15.52:0/3594945141 conn(0x55c1a0b1d0f0 msgr2=0x55c1a0b22e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.402+0000 7fdbbd7fa640 0 client.26266 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.403+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 shutdown_connections 2024-09-19T09:26:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.403+0000 7fdbde02a740 1 -- 172.21.15.52:0/3594945141 wait complete. 2024-09-19T09:26:30.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.403+0000 7fdbde02a740 20 client.26266 trim_cache size 0 max 16384 2024-09-19T09:26:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.420+0000 7fdbde02a740 1 Processor -- start 2024-09-19T09:26:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.420+0000 7fdbde02a740 1 -- start start 2024-09-19T09:26:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.420+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b28830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b47500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbde02a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ade00 con 0x55c1a0b21340 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbde02a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ab6d0 con 0x55c1a0b20a20 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbde02a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41a9520 con 0x55c1a0b30150 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55470/0 (socket says 172.21.15.52:55470) 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 -- 172.21.15.52:0/964411283 learned_addr learned my addr 172.21.15.52:0/964411283 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b28830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 -- 172.21.15.52:0/964411283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 msgr2=0x55c1a0b47500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b47500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b47500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 -- 172.21.15.52:0/964411283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 msgr2=0x55c1a0b28830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b28830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 -- 172.21.15.52:0/964411283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a0b2b610 con 0x55c1a0b21340 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b28830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b47500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdbc409c290 tx=0x7fdbc40cd6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70b26557dda9458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.421+0000 7fdbbf7fe640 1 -- 172.21.15.52:0/964411283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc409a600 con 0x55c1a0b21340 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbbf7fe640 1 -- 172.21.15.52:0/964411283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc40cd8f0 con 0x55c1a0b21340 2024-09-19T09:26:30.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbbf7fe640 1 -- 172.21.15.52:0/964411283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4018d90 con 0x55c1a0b21340 2024-09-19T09:26:30.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 -- 172.21.15.52:0/964411283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 msgr2=0x55c1a0b1c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdbc409c290 tx=0x7fdbc40cd6b0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 -- 172.21.15.52:0/964411283 shutdown_connections 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b47500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b1c160 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 --2- 172.21.15.52:0/964411283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b28830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 -- 172.21.15.52:0/964411283 >> 172.21.15.52:0/964411283 conn(0x55c1a0b1d0f0 msgr2=0x55c1a0b1ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 -- 172.21.15.52:0/964411283 shutdown_connections 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.422+0000 7fdbde02a740 1 -- 172.21.15.52:0/964411283 wait complete. 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 -- start start 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 Processor -- start 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b38910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b34280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41a9b90 con 0x55c1a0b21340 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41ab000 con 0x55c1a0b20a20 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd41aa260 con 0x55c1a0b30150 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbde02a740 10 client.0 _ll_register_callbacks cb 0x7fdbc4009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbd91ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55482/0 (socket says 172.21.15.52:55482) 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.423+0000 7fdbd91ec640 1 -- 172.21.15.52:0/996722441 learned_addr learned my addr 172.21.15.52:0/996722441 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b38910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbda1ee640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b34280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 -- 172.21.15.52:0/996722441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 msgr2=0x55c1a0b34280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b34280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 -- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 msgr2=0x55c1a0b38910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b38910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 -- 172.21.15.52:0/996722441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a0b34a80 con 0x55c1a0b21340 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b38910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbd91ec640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4012010 tx=0x7fdbc40a50f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1844e96a47b60e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40b6ad0 con 0x55c1a0b21340 2024-09-19T09:26:30.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdbc4018b30 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbc40cd8f0 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbc4018d30 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbde02a740 10 client.17199 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.424+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c1a0baa560 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbc40cd8f0 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdbc4010430 con 0x55c1a0b21340 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 10 client.17199 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 20 client.17199 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0baabd0 0x55c1a0bacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 4 client.17199 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:26:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c1a0a8dd00 con 0x55c1a0baabd0 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0baabd0 0x55c1a0bacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbbd7fa640 10 client.17199 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.425+0000 7fdbd99ed640 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0baabd0 0x55c1a0bacff0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b476a011de364181 server_cookie=31e88a4febffa19e in_seq=0 out_seq=0 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.426+0000 7fdbbd7fa640 1 -- 172.21.15.52:0/996722441 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c1a0a8dd00 con 0x55c1a0baabd0 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.426+0000 7fdbbd7fa640 10 client.17199 handle_command_reply: tid=0 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.426+0000 7fdbde02a740 1 client.17199 shutdown 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 msgr2=0x55c1a0b33c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4012010 tx=0x7fdbc40a50f0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 shutdown_connections 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c1a0baabd0 0x55c1a0bacff0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1a0b30150 0x55c1a0b34280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1a0b21340 0x55c1a0b33c90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 --2- 172.21.15.52:0/996722441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1a0b20a20 0x55c1a0b38910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbbd7fa640 0 client.17199 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 >> 172.21.15.52:0/996722441 conn(0x55c1a0b1d0f0 msgr2=0x55c1a0b1c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 shutdown_connections 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 1 -- 172.21.15.52:0/996722441 wait complete. 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbde02a740 20 client.17199 trim_cache size 0 max 16384 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "3f81b0e3-5584-4592-a513-83957d29aa1f", 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:26:30.434 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.427+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 msgr2=0x7fdbc00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 0x7fdbc00a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc005fd0 tx=0x7fdbcc009db0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 msgr2=0x7fdbd4198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e9f0 tx=0x7fdbc400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 shutdown_connections 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdbd410c170 0x7fdbd419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbd41036f0 0x7fdbd4198980 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdbc00a32c0 0x7fdbc00a5780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 --2- 172.21.15.52:0/1073616042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbd4102dd0 0x7fdbd4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 >> 172.21.15.52:0/1073616042 conn(0x7fdbd40fc790 msgr2=0x7fdbd40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 shutdown_connections 2024-09-19T09:26:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:30.428+0000 7fdbdbc51640 1 -- 172.21.15.52:0/1073616042 wait complete. 2024-09-19T09:26:30.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:30 smithi052 ceph-mon[30947]: pgmap v490: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:30.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:30.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:26:30.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:26:30.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:26:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:30 smithi169 ceph-mon[35454]: pgmap v490: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:26:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:26:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:26:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:30 smithi086 ceph-mon[34813]: pgmap v490: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:26:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:26:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:26:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:26:31.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:26:31.397 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:26:31.811 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:31 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:26:31.812 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:31 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:31.812 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:31 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:26:31.812 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:31 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 -- 172.21.15.52:0/2464488457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8102ef0 msgr2=0x7fbbb810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 --2- 172.21.15.52:0/2464488457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8102ef0 0x7fbbb810da40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009ca0 tx=0x7fbbb002a950 comp rx=0 tx=0).stop 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 -- 172.21.15.52:0/2464488457 shutdown_connections 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 --2- 172.21.15.52:0/2464488457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8102ef0 0x7fbbb810da40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 --2- 172.21.15.52:0/2464488457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102570 0x7fbbb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 --2- 172.21.15.52:0/2464488457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8100e20 0x7fbbb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 -- 172.21.15.52:0/2464488457 >> 172.21.15.52:0/2464488457 conn(0x7fbbb80fc7d0 msgr2=0x7fbbb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.809+0000 7fbbbf592640 1 -- 172.21.15.52:0/2464488457 shutdown_connections 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.810+0000 7fbbbf592640 1 -- 172.21.15.52:0/2464488457 wait complete. 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.810+0000 7fbbbf592640 1 Processor -- start 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.810+0000 7fbbbf592640 1 -- start start 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8102570 0x7fbbb8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102ef0 0x7fbbb819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8111020 con 0x7fbbb8100e20 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb8110ea0 con 0x7fbbb8102ef0 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81111a0 con 0x7fbbb8102570 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55508/0 (socket says 172.21.15.52:55508) 2024-09-19T09:26:31.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 -- 172.21.15.52:0/613679417 learned_addr learned my addr 172.21.15.52:0/613679417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102ef0 0x7fbbb819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8102570 0x7fbbb8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 -- 172.21.15.52:0/613679417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8102570 msgr2=0x7fbbb8198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8102570 0x7fbbb8198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 -- 172.21.15.52:0/613679417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102ef0 msgr2=0x7fbbb819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102ef0 0x7fbbb819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 -- 172.21.15.52:0/613679417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb819d590 con 0x7fbbb8100e20 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b4a0 tx=0x7fbbb400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbae7fc640 1 -- 172.21.15.52:0/613679417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4014070 con 0x7fbbb8100e20 2024-09-19T09:26:31.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbae7fc640 1 -- 172.21.15.52:0/613679417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb4010af0 con 0x7fbbb8100e20 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.811+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb819d880 con 0x7fbbb8100e20 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.812+0000 7fbbae7fc640 1 -- 172.21.15.52:0/613679417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4017d10 con 0x7fbbb8100e20 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.812+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb81a5160 con 0x7fbbb8100e20 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.814+0000 7fbbae7fc640 1 -- 172.21.15.52:0/613679417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbbb4017070 con 0x7fbbb8100e20 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.814+0000 7fbbc196b740 1 Processor -- start 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.814+0000 7fbbc196b740 1 -- start start 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 0x55a4ee546140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee548a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee4a12e0 con 0x55a4ee53b4a0 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee448ce0 con 0x55a4ee53bdc0 2024-09-19T09:26:31.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbc196b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee49d2a0 con 0x55a4ee546680 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbae7fc640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 0x7fbba40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55510/0 (socket says 172.21.15.52:55510) 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1930925285 learned_addr learned my addr 172.21.15.52:0/1930925285 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 0x7fbba40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee548a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbae7fc640 1 -- 172.21.15.52:0/613679417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbbb40ced60 con 0x7fbbb8100e20 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 0x55a4ee546140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1930925285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 msgr2=0x55a4ee548a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee548a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1930925285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 msgr2=0x55a4ee546140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 0x55a4ee546140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1930925285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ee42d440 con 0x55a4ee53b4a0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.815+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 0x55a4ee546140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.816+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009a60 tx=0x7fbbb002f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0936b86faa5ec56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.816+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 0x7fbba40a5700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005fe0 tx=0x7fbbb004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.816+0000 7fbba37fe640 1 -- 172.21.15.52:0/1930925285 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0034040 con 0x55a4ee53b4a0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.816+0000 7fbba37fe640 1 -- 172.21.15.52:0/1930925285 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb004e070 con 0x55a4ee53b4a0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.816+0000 7fbba37fe640 1 -- 172.21.15.52:0/1930925285 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004040 con 0x55a4ee53b4a0 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- 172.21.15.52:0/1930925285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 msgr2=0x55a4ee53b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009a60 tx=0x7fbbb002f760 comp rx=0 tx=0).stop 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- 172.21.15.52:0/1930925285 shutdown_connections 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee548a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53bdc0 0x55a4ee546140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1930925285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53b4a0 0x55a4ee53b880 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- 172.21.15.52:0/1930925285 >> 172.21.15.52:0/1930925285 conn(0x55a4ee537a30 msgr2=0x55a4ee537e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- 172.21.15.52:0/1930925285 shutdown_connections 2024-09-19T09:26:31.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- 172.21.15.52:0/1930925285 wait complete. 2024-09-19T09:26:31.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 -- start start 2024-09-19T09:26:31.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.817+0000 7fbbc196b740 1 Processor -- start 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee545fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee5437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee5491f0 con 0x55a4ee53bdc0 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee45c050 con 0x55a4ee53b4a0 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a4ee549370 con 0x55a4ee546680 2024-09-19T09:26:31.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbc196b740 10 client.0 _ll_register_callbacks cb 0x55a4ee49c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbbcb2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbbd32e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee545fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbbcb2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55526/0 (socket says 172.21.15.52:55526) 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/3951682147 learned_addr learned my addr 172.21.15.52:0/3951682147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.818+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee5437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/3951682147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 msgr2=0x55a4ee5437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee5437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 msgr2=0x55a4ee545fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee545fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/3951682147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ee2123c0 con 0x55a4ee53bdc0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbba8010500 tx=0x7fbba80109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ee7093448a7be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbba0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:31.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba801a020 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbba8016750 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb004e070 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbba8025050 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbc196b740 10 client.17211 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a4ee554c20 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.819+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb004e070 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbba8014b90 con 0x55a4ee53bdc0 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 10 client.17211 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 20 client.17211 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee556130 0x55a4ee558550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 4 client.17211 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:31.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4ee4ae850 con 0x55a4ee556130 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee556130 0x55a4ee558550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbba0ff9640 10 client.17211 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.820+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee556130 0x55a4ee558550 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbe20bf37bb4e52 server_cookie=b0a8b03b62f42619 in_seq=0 out_seq=0 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbba0ff9640 1 -- 172.21.15.52:0/3951682147 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4ee4ae850 con 0x55a4ee556130 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbba0ff9640 10 client.17211 handle_command_reply: tid=0 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 client.17211 shutdown 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 msgr2=0x55a4ee543290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbba8010500 tx=0x7fbba80109c0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 shutdown_connections 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee556130 0x55a4ee558550 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee546680 0x55a4ee5437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbba0ff9640 0 client.17211 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:31.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee543290 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 --2- 172.21.15.52:0/3951682147 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee545fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 >> 172.21.15.52:0/3951682147 conn(0x55a4ee537a30 msgr2=0x55a4ee536b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 shutdown_connections 2024-09-19T09:26:31.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.821+0000 7fbbc196b740 1 -- 172.21.15.52:0/3951682147 wait complete. 2024-09-19T09:26:31.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.822+0000 7fbbc196b740 20 client.17211 trim_cache size 0 max 16384 2024-09-19T09:26:31.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 Processor -- start 2024-09-19T09:26:31.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 -- start start 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee552450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 0x55a4ee55de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81adf80 con 0x55a4ee546680 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81ab850 con 0x55a4ee53b4a0 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbc196b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81a96a0 con 0x55a4ee53bdc0 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55538/0 (socket says 172.21.15.52:55538) 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1303647990 learned_addr learned my addr 172.21.15.52:0/1303647990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee552450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 0x55a4ee55de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1303647990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 msgr2=0x55a4ee55de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 0x55a4ee55de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1303647990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 msgr2=0x55a4ee552450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee552450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbdb2f640 1 -- 172.21.15.52:0/1303647990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ee543b60 con 0x55a4ee546680 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 0x55a4ee55de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.839+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee552450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbbb002f8d0 tx=0x7fbbb002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0bfd877e356727 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbba2ffd640 1 -- 172.21.15.52:0/1303647990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0060070 con 0x55a4ee546680 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbba2ffd640 1 -- 172.21.15.52:0/1303647990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb004e040 con 0x55a4ee546680 2024-09-19T09:26:31.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbba2ffd640 1 -- 172.21.15.52:0/1303647990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004660 con 0x55a4ee546680 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 -- 172.21.15.52:0/1303647990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 msgr2=0x55a4ee55e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fbbb002f8d0 tx=0x7fbbb002a950 comp rx=0 tx=0).stop 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 -- 172.21.15.52:0/1303647990 shutdown_connections 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee546680 0x55a4ee55e360 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53bdc0 0x55a4ee55de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 --2- 172.21.15.52:0/1303647990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee53b4a0 0x55a4ee552450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.840+0000 7fbbc196b740 1 -- 172.21.15.52:0/1303647990 >> 172.21.15.52:0/1303647990 conn(0x55a4ee537a30 msgr2=0x55a4ee53e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- 172.21.15.52:0/1303647990 shutdown_connections 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- 172.21.15.52:0/1303647990 wait complete. 2024-09-19T09:26:31.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- start start 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 Processor -- start 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53b4a0 0x55a4ee54ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee546680 0x55a4ee5b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81a9d10 con 0x55a4ee53bdc0 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81ab180 con 0x55a4ee546680 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb81aa3e0 con 0x55a4ee53b4a0 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbc196b740 10 client.0 _ll_register_callbacks cb 0x7fbba800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.841+0000 7fbbbcb2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55546/0 (socket says 172.21.15.52:55546) 2024-09-19T09:26:31.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/2151020159 learned_addr learned my addr 172.21.15.52:0/2151020159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53b4a0 0x55a4ee54ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbdb2f640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee546680 0x55a4ee5b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/2151020159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53b4a0 msgr2=0x55a4ee54ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53b4a0 0x55a4ee54ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee546680 msgr2=0x55a4ee5b9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee546680 0x55a4ee5b9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 -- 172.21.15.52:0/2151020159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ee5ba400 con 0x55a4ee53bdc0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbbcb2d640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbba8008010 tx=0x7fbba800baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4eeec106fdf64a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbba0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba802d020 con 0x55a4ee53bdc0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbba8012b40 con 0x55a4ee53bdc0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbb004e040 con 0x55a4ee53bdc0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbba8038050 con 0x55a4ee53bdc0 2024-09-19T09:26:31.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbc196b740 10 client.17217 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.842+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a4ee5c16f0 con 0x55a4ee53bdc0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbb004e040 con 0x55a4ee53bdc0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbba8016c30 con 0x55a4ee53bdc0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 10 client.17217 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 20 client.17217 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee5c1ef0 0x55a4ee5c4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 4 client.17217 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a4ee4a8d60 con 0x55a4ee5c1ef0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee5c1ef0 0x55a4ee5c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbba0ff9640 10 client.17217 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.843+0000 7fbbbd32e640 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee5c1ef0 0x55a4ee5c4310 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd0ea514a4b94cc8 server_cookie=e84893b74895184c in_seq=0 out_seq=0 2024-09-19T09:26:31.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbba0ff9640 1 -- 172.21.15.52:0/2151020159 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a4ee4a8d60 con 0x55a4ee5c1ef0 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbba0ff9640 10 client.17217 handle_command_reply: tid=0 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 client.17217 shutdown 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 msgr2=0x55a4ee54b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fbba8008010 tx=0x7fbba800baa0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 shutdown_connections 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a4ee5c1ef0 0x55a4ee5c4310 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a4ee546680 0x55a4ee5b9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a4ee53bdc0 0x55a4ee54b0c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 --2- 172.21.15.52:0/2151020159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a4ee53b4a0 0x55a4ee54ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 >> 172.21.15.52:0/2151020159 conn(0x55a4ee537a30 msgr2=0x55a4ee544af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbba0ff9640 0 client.17217 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 shutdown_connections 2024-09-19T09:26:31.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 1 -- 172.21.15.52:0/2151020159 wait complete. 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.844+0000 7fbbc196b740 20 client.17217 trim_cache size 0 max 16384 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "3f81b0e3-5584-4592-a513-83957d29aa1f": { 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "3f81b0e3-5584-4592-a513-83957d29aa1f", 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:26:31.852 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:31.853 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:26:31.853 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:26:31.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 msgr2=0x7fbba40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 0x7fbba40a5700 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005fe0 tx=0x7fbbb004d000 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 msgr2=0x7fbbb81985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b4a0 tx=0x7fbbb400b960 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 shutdown_connections 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb8102ef0 0x7fbbb819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbba40a3240 0x7fbba40a5700 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbb8102570 0x7fbbb8198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 --2- 172.21.15.52:0/613679417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbbb8100e20 0x7fbbb81985e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 >> 172.21.15.52:0/613679417 conn(0x7fbbb80fc7d0 msgr2=0x7fbbb806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 shutdown_connections 2024-09-19T09:26:31.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:26:31.845+0000 7fbbbf592640 1 -- 172.21.15.52:0/613679417 wait complete. 2024-09-19T09:26:31.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:31 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:26:31.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:31 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:31.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:31 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:26:31.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:31 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:31 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:26:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:31 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:31 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:26:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:31 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:26:32.535 INFO:tasks.cephfs.filesystem:scrub status for tag:3f81b0e3-5584-4592-a513-83957d29aa1f - {'path': '/', 'tag': '3f81b0e3-5584-4592-a513-83957d29aa1f', 'options': 'recursive,force'} 2024-09-19T09:26:32.936 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:32 smithi052 ceph-mon[30947]: pgmap v491: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:32.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:32 smithi169 ceph-mon[35454]: pgmap v491: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:33.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:32 smithi086 ceph-mon[34813]: pgmap v491: 97 pgs: 97 active+clean; 2.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T09:26:33.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:33 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:26:33.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:33 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:26:34.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:33 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:26:34.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:34 smithi052 ceph-mon[30947]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:26:34.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:34 smithi169 ceph-mon[35454]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:26:35.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:34 smithi086 ceph-mon[34813]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 -- 172.21.15.52:0/2784204468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef901016b0 msgr2=0x7fef90101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 --2- 172.21.15.52:0/2784204468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef901016b0 0x7fef90101b60 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fef88009900 tx=0x7fef8802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 -- 172.21.15.52:0/2784204468 shutdown_connections 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 --2- 172.21.15.52:0/2784204468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef901016b0 0x7fef90101b60 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 --2- 172.21.15.52:0/2784204468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef90100d10 0x7fef90101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 --2- 172.21.15.52:0/2784204468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901003d0 0x7fef901007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 -- 172.21.15.52:0/2784204468 >> 172.21.15.52:0/2784204468 conn(0x7fef900fc1e0 msgr2=0x7fef900fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 -- 172.21.15.52:0/2784204468 shutdown_connections 2024-09-19T09:26:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 -- 172.21.15.52:0/2784204468 wait complete. 2024-09-19T09:26:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.147+0000 7fef97911640 1 Processor -- start 2024-09-19T09:26:36.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 -- start start 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef901003d0 0x7fef90199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901016b0 0x7fef901a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef9010f9d0 con 0x7fef90100d10 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef9010f850 con 0x7fef901003d0 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef97911640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef9010fb50 con 0x7fef901016b0 2024-09-19T09:26:36.152 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef956ad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef901003d0 0x7fef90199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55566/0 (socket says 172.21.15.52:55566) 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 -- 172.21.15.52:0/1644781890 learned_addr learned my addr 172.21.15.52:0/1644781890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef95eae640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901016b0 0x7fef901a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 -- 172.21.15.52:0/1644781890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901016b0 msgr2=0x7fef901a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901016b0 0x7fef901a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 -- 172.21.15.52:0/1644781890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef901003d0 msgr2=0x7fef90199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef901003d0 0x7fef90199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.148+0000 7fef94eac640 1 -- 172.21.15.52:0/1644781890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef901a1bc0 con 0x7fef90100d10 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef94eac640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fef8000d950 tx=0x7fef8000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef867fc640 1 -- 172.21.15.52:0/1644781890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80017070 con 0x7fef90100d10 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef867fc640 1 -- 172.21.15.52:0/1644781890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80009c30 con 0x7fef90100d10 2024-09-19T09:26:36.153 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef901a1eb0 con 0x7fef90100d10 2024-09-19T09:26:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef867fc640 1 -- 172.21.15.52:0/1644781890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000f6b0 con 0x7fef90100d10 2024-09-19T09:26:36.154 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.149+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef901a2370 con 0x7fef90100d10 2024-09-19T09:26:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.151+0000 7fef867fc640 1 -- 172.21.15.52:0/1644781890 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef800109d0 con 0x7fef90100d10 2024-09-19T09:26:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 Processor -- start 2024-09-19T09:26:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 -- start start 2024-09-19T09:26:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ffb751b2f0 con 0x55ffb75b82e0 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ffb74c3270 con 0x55ffb75bd370 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ffb75172b0 con 0x55ffb75b79a0 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef956ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef956ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55582/0 (socket says 172.21.15.52:55582) 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef95eae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.152+0000 7fef956ad640 1 -- 172.21.15.52:0/514011588 learned_addr learned my addr 172.21.15.52:0/514011588 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef867fc640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 0x7fef7c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef94eac640 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef95eae640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 0x7fef7c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 -- 172.21.15.52:0/514011588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 msgr2=0x55ffb75b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef867fc640 1 -- 172.21.15.52:0/1644781890 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef800cf510 con 0x7fef90100d10 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 -- 172.21.15.52:0/514011588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 msgr2=0x55ffb75bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75bf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 -- 172.21.15.52:0/514011588 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb74c2340 con 0x55ffb75b82e0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef94eac640 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef956ad640 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0103f0 tx=0x7fef8c0108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99857811ad4e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef95eae640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 0x7fef7c0a57b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fef88006010 tx=0x7fef8802a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef7b7fe640 1 -- 172.21.15.52:0/514011588 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c016070 con 0x55ffb75b82e0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef7b7fe640 1 -- 172.21.15.52:0/514011588 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8c004d20 con 0x55ffb75b82e0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.153+0000 7fef7b7fe640 1 -- 172.21.15.52:0/514011588 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005400 con 0x55ffb75b82e0 2024-09-19T09:26:36.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 -- 172.21.15.52:0/514011588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 msgr2=0x55ffb75bcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0103f0 tx=0x7fef8c0108b0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 -- 172.21.15.52:0/514011588 shutdown_connections 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75bcda0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/514011588 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 -- 172.21.15.52:0/514011588 >> 172.21.15.52:0/514011588 conn(0x55ffb75b3010 msgr2=0x55ffb75b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 -- 172.21.15.52:0/514011588 shutdown_connections 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.154+0000 7fef9a6a7740 1 -- 172.21.15.52:0/514011588 wait complete. 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 -- start start 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 Processor -- start 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b82e0 0x55ffb75c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 0x55ffb75c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ffb75c0340 con 0x55ffb75b79a0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ffb74a4290 con 0x55ffb75b82e0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ffb75c04c0 con 0x55ffb75bd370 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef9a6a7740 10 client.0 _ll_register_callbacks cb 0x55ffb74d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef956ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef956ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55588/0 (socket says 172.21.15.52:55588) 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef956ad640 1 -- 172.21.15.52:0/3832601329 learned_addr learned my addr 172.21.15.52:0/3832601329 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef94eac640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b82e0 0x55ffb75c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.155+0000 7fef95eae640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 0x55ffb75c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 -- 172.21.15.52:0/3832601329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 msgr2=0x55ffb75c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 0x55ffb75c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 -- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b82e0 msgr2=0x55ffb75c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b82e0 0x55ffb75c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 -- 172.21.15.52:0/3832601329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb722e210 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef95eae640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 0x55ffb75c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef956ad640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fef8c004c70 tx=0x7fef8c004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd64e3089f66fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c029060 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef8c003d40 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8c004d20 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef8c016070 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef9a6a7740 10 client.17229 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ffb72fa620 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.156+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8c004d20 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef8c00f040 con 0x55ffb75b79a0 2024-09-19T09:26:36.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 10 client.17229 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 10 client.17229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 20 client.17229 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb75cd4a0 0x55ffb75cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 4 client.17229 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffb7528a20 con 0x55ffb75cd4a0 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef94eac640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb75cd4a0 0x55ffb75cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef78ff9640 10 client.17229 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.157+0000 7fef94eac640 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb75cd4a0 0x55ffb75cf890 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce9f903d611d620 server_cookie=240b21049d1d8112 in_seq=0 out_seq=0 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef78ff9640 1 -- 172.21.15.52:0/3832601329 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffb7528a20 con 0x55ffb75cd4a0 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef78ff9640 10 client.17229 handle_command_reply: tid=0 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 client.17229 shutdown 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 msgr2=0x55ffb75c1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fef8c004c70 tx=0x7fef8c004ca0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 shutdown_connections 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb75cd4a0 0x55ffb75cf890 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75bd370 0x55ffb75c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b82e0 0x55ffb75c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/3832601329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b79a0 0x55ffb75c1ba0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef78ff9640 0 client.17229 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.158+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 >> 172.21.15.52:0/3832601329 conn(0x55ffb75b3010 msgr2=0x55ffb75b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.159+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 shutdown_connections 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.159+0000 7fef9a6a7740 1 -- 172.21.15.52:0/3832601329 wait complete. 2024-09-19T09:26:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.159+0000 7fef9a6a7740 20 client.17229 trim_cache size 0 max 16384 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.173+0000 7fef9a6a7740 1 Processor -- start 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.173+0000 7fef9a6a7740 1 -- start start 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef901add20 con 0x55ffb75b82e0 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ab5f0 con 0x55ffb75bd370 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef901a9440 con 0x55ffb75b79a0 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55592/0 (socket says 172.21.15.52:55592) 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 -- 172.21.15.52:0/2097863208 learned_addr learned my addr 172.21.15.52:0/2097863208 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef956ad640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef95eae640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 -- 172.21.15.52:0/2097863208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 msgr2=0x55ffb75b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 -- 172.21.15.52:0/2097863208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 msgr2=0x55ffb75b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 -- 172.21.15.52:0/2097863208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffb75c0640 con 0x55ffb75b82e0 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef95eae640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef94eac640 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fef800cd300 tx=0x7fef8000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b468aa91b58cca73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef7affd640 1 -- 172.21.15.52:0/2097863208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80020040 con 0x55ffb75b82e0 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef7affd640 1 -- 172.21.15.52:0/2097863208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80099c00 con 0x55ffb75b82e0 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.174+0000 7fef7affd640 1 -- 172.21.15.52:0/2097863208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800cf0b0 con 0x55ffb75b82e0 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- 172.21.15.52:0/2097863208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 msgr2=0x55ffb75c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fef800cd300 tx=0x7fef8000bf60 comp rx=0 tx=0).stop 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- 172.21.15.52:0/2097863208 shutdown_connections 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75bd370 0x55ffb75b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75b82e0 0x55ffb75c9040 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/2097863208 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b79a0 0x55ffb75b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- 172.21.15.52:0/2097863208 >> 172.21.15.52:0/2097863208 conn(0x55ffb75b3010 msgr2=0x55ffb75b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- 172.21.15.52:0/2097863208 shutdown_connections 2024-09-19T09:26:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- 172.21.15.52:0/2097863208 wait complete. 2024-09-19T09:26:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.175+0000 7fef9a6a7740 1 -- start start 2024-09-19T09:26:36.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 Processor -- start 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 0x55ffb75c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b82e0 0x55ffb75c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef901a9ab0 con 0x55ffb75bd370 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef901aaf20 con 0x55ffb75b79a0 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef901aa180 con 0x55ffb75b82e0 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef9a6a7740 10 client.0 _ll_register_callbacks cb 0x7fef88005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef956ad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 0x55ffb75c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55602/0 (socket says 172.21.15.52:55602) 2024-09-19T09:26:36.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 -- 172.21.15.52:0/1911877775 learned_addr learned my addr 172.21.15.52:0/1911877775 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef94eac640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b82e0 0x55ffb75c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 -- 172.21.15.52:0/1911877775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b82e0 msgr2=0x55ffb75c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b82e0 0x55ffb75c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 -- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 msgr2=0x55ffb75c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 0x55ffb75c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef95eae640 1 -- 172.21.15.52:0/1911877775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffb75c82b0 con 0x55ffb75bd370 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.176+0000 7fef956ad640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 0x55ffb75c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef95eae640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fef88009230 tx=0x7fef88009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ed750a23884c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88044040 con 0x55ffb75bd370 2024-09-19T09:26:36.184 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef88005020 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef80099c00 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef88035040 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 10 client.17235 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ffb7638100 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80099c00 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef8805d070 con 0x55ffb75bd370 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 10 client.17235 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 10 client.17235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 20 client.17235 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.177+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb7638ab0 0x55ffb763aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.178+0000 7fef9a6a7740 4 client.17235 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:26:36.185 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.178+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffb7522d70 con 0x55ffb7638ab0 2024-09-19T09:26:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.178+0000 7fef956ad640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb7638ab0 0x55ffb763aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.178+0000 7fef78ff9640 10 client.17235 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:36.186 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.178+0000 7fef956ad640 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb7638ab0 0x55ffb763aed0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15fa613d7a5116 server_cookie=cdc940fc78716210 in_seq=0 out_seq=0 2024-09-19T09:26:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef78ff9640 1 -- 172.21.15.52:0/1911877775 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffb7522d70 con 0x55ffb7638ab0 2024-09-19T09:26:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef78ff9640 10 client.17235 handle_command_reply: tid=0 2024-09-19T09:26:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 client.17235 shutdown 2024-09-19T09:26:36.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 msgr2=0x55ffb75c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fef88009230 tx=0x7fef88009260 comp rx=0 tx=0).stop 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 shutdown_connections 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ffb7638ab0 0x55ffb763aed0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ffb75bd370 0x55ffb75c7ca0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ffb75b82e0 0x55ffb75c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef78ff9640 0 client.17235 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 --2- 172.21.15.52:0/1911877775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ffb75b79a0 0x55ffb75c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 >> 172.21.15.52:0/1911877775 conn(0x55ffb75b3010 msgr2=0x55ffb75b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 shutdown_connections 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.190+0000 7fef9a6a7740 1 -- 172.21.15.52:0/1911877775 wait complete. 2024-09-19T09:26:36.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef9a6a7740 20 client.17235 trim_cache size 0 max 16384 2024-09-19T09:26:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:26:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:26:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:26:36.194 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 msgr2=0x7fef7c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 0x7fef7c0a57b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fef88006010 tx=0x7fef8802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 msgr2=0x7fef9019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fef8000d950 tx=0x7fef8000de10 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 shutdown_connections 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef7c0a32f0 0x7fef7c0a57b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef901016b0 0x7fef901a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef90100d10 0x7fef9019a4e0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 --2- 172.21.15.52:0/1644781890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef901003d0 0x7fef90199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 >> 172.21.15.52:0/1644781890 conn(0x7fef900fc1e0 msgr2=0x7fef900fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 shutdown_connections 2024-09-19T09:26:36.195 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:36.191+0000 7fef97911640 1 -- 172.21.15.52:0/1644781890 wait complete. 2024-09-19T09:26:36.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:36 smithi052 ceph-mon[30947]: pgmap v493: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:36.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:36 smithi169 ceph-mon[35454]: pgmap v493: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:36 smithi086 ceph-mon[34813]: pgmap v493: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:38.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:38 smithi052 ceph-mon[30947]: pgmap v494: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:26:38.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:38 smithi169 ceph-mon[35454]: pgmap v494: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:26:39.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:38 smithi086 ceph-mon[34813]: pgmap v494: 97 pgs: 97 active+clean; 2.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:26:40.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:40 smithi052 ceph-mon[30947]: pgmap v495: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:40.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:40 smithi169 ceph-mon[35454]: pgmap v495: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:41.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:40 smithi086 ceph-mon[34813]: pgmap v495: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:42.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:42 smithi052 ceph-mon[30947]: pgmap v496: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:26:42.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:42 smithi169 ceph-mon[35454]: pgmap v496: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:26:43.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:42 smithi086 ceph-mon[34813]: pgmap v496: 97 pgs: 97 active+clean; 2.4 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:26:44.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:44 smithi052 ceph-mon[30947]: pgmap v497: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:44.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:44 smithi169 ceph-mon[35454]: pgmap v497: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:45.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:44 smithi086 ceph-mon[34813]: pgmap v497: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:26:46.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:46 smithi052 ceph-mon[30947]: pgmap v498: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:46.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:46 smithi169 ceph-mon[35454]: pgmap v498: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:47.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:46 smithi086 ceph-mon[34813]: pgmap v498: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:48.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:48 smithi052 ceph-mon[30947]: pgmap v499: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:48 smithi169 ceph-mon[35454]: pgmap v499: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:48 smithi086 ceph-mon[34813]: pgmap v499: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:26:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 -- 172.21.15.52:0/4256742725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0104ef0 msgr2=0x7fc4c01072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/4256742725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0104ef0 0x7fc4c01072e0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009900 tx=0x7fc4a802a410 comp rx=0 tx=0).stop 2024-09-19T09:26:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 -- 172.21.15.52:0/4256742725 shutdown_connections 2024-09-19T09:26:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/4256742725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0107820 0x7fc4c0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/4256742725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0104ef0 0x7fc4c01072e0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/4256742725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 0x7fc4c01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 -- 172.21.15.52:0/4256742725 >> 172.21.15.52:0/4256742725 conn(0x7fc4c00fc1e0 msgr2=0x7fc4c00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 -- 172.21.15.52:0/4256742725 shutdown_connections 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 -- 172.21.15.52:0/4256742725 wait complete. 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.294+0000 7fc4c52d7640 1 Processor -- start 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 -- start start 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 0x7fc4c0101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 0x7fc4c0100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d840 con 0x7fc4c0107820 2024-09-19T09:26:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d6c0 con 0x7fc4c0104ef0 2024-09-19T09:26:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4c52d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d9c0 con 0x7fc4c01025c0 2024-09-19T09:26:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34274/0 (socket says 172.21.15.52:34274) 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/2057660336 learned_addr learned my addr 172.21.15.52:0/2057660336 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 0x7fc4c0100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 0x7fc4c0101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/2057660336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 msgr2=0x7fc4c0101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 0x7fc4c0101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/2057660336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 msgr2=0x7fc4c0100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 0x7fc4c0100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/2057660336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c0101340 con 0x7fc4c0107820 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.295+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 0x7fc4c0100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c970 tx=0x7fc4b800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4b7fff640 1 -- 172.21.15.52:0/2057660336 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8007bb0 con 0x7fc4c0107820 2024-09-19T09:26:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4b7fff640 1 -- 172.21.15.52:0/2057660336 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b8007d50 con 0x7fc4c0107820 2024-09-19T09:26:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c01a1f20 con 0x7fc4c0107820 2024-09-19T09:26:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4b7fff640 1 -- 172.21.15.52:0/2057660336 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8018800 con 0x7fc4c0107820 2024-09-19T09:26:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.296+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01a2330 con 0x7fc4c0107820 2024-09-19T09:26:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4b7fff640 1 -- 172.21.15.52:0/2057660336 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc4b800f450 con 0x7fc4c0107820 2024-09-19T09:26:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 Processor -- start 2024-09-19T09:26:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 -- start start 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c2cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c2d370 0x5577c7c2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5577c7b8b2f0 con 0x5577c7c279a0 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5577c7b33270 con 0x5577c7c282e0 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.299+0000 7fc4c8072740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5577c7b872b0 con 0x5577c7c2d370 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34286/0 (socket says 172.21.15.52:34286) 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 -- 172.21.15.52:0/2099245928 learned_addr learned my addr 172.21.15.52:0/2099245928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c2cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c2d370 0x5577c7c2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 -- 172.21.15.52:0/2099245928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c2d370 msgr2=0x5577c7c2f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c2d370 0x5577c7c2f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 -- 172.21.15.52:0/2099245928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 msgr2=0x5577c7c2cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c2cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 -- 172.21.15.52:0/2099245928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7b32340 con 0x5577c7c279a0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4b7fff640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 0x7fc4ac0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 0x7fc4ac0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc4c006a400 tx=0x7fc4a8005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabc4249905a369a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.300+0000 7fc4b7fff640 1 -- 172.21.15.52:0/2057660336 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc4b80cfb20 con 0x7fc4c0107820 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4b57fa640 1 -- 172.21.15.52:0/2099245928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8043020 con 0x5577c7c279a0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4b57fa640 1 -- 172.21.15.52:0/2099245928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a8004ba0 con 0x5577c7c279a0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4b57fa640 1 -- 172.21.15.52:0/2099245928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8035070 con 0x5577c7c279a0 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4c8072740 1 -- 172.21.15.52:0/2099245928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 msgr2=0x5577c7c27da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc4c006a400 tx=0x7fc4a8005e50 comp rx=0 tx=0).stop 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.301+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 0x7fc4ac0a57b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x5577c7c28d10 tx=0x7fc4b00096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- 172.21.15.52:0/2099245928 shutdown_connections 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c2d370 0x5577c7c2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c2cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2099245928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c27da0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- 172.21.15.52:0/2099245928 >> 172.21.15.52:0/2099245928 conn(0x5577c7c23010 msgr2=0x5577c7c23410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- 172.21.15.52:0/2099245928 shutdown_connections 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- 172.21.15.52:0/2099245928 wait complete. 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- start start 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 Processor -- start 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 0x5577c7c31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5577c7c302e0 con 0x5577c7c2d370 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5577c7b14290 con 0x5577c7c282e0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5577c7c30460 con 0x5577c7c279a0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4c8072740 10 client.0 _ll_register_callbacks cb 0x5577c7b45140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.302+0000 7fc4bf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34296/0 (socket says 172.21.15.52:34296) 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/985634215 learned_addr learned my addr 172.21.15.52:0/985634215 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4beffd640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 0x5577c7c31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/985634215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 msgr2=0x5577c7c31b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 0x5577c7c31b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 msgr2=0x5577c7c320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c320d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 -- 172.21.15.52:0/985634215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c789e210 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4beffd640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 0x5577c7c31b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8098a30 tx=0x7fc4b809c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f9bef054e6a67f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80b5060 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc4b8016de0 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4a8004ba0 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4b80a4cd0 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4c8072740 10 client.17247 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5577c796a620 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.303+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4a8004ba0 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc4b8096bd0 con 0x5577c7c2d370 2024-09-19T09:26:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 10 client.17247 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 10 client.17247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 20 client.17247 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7c3d8b0 0x5577c7c3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 4 client.17247 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577c7b98a20 con 0x5577c7c3d8b0 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4beffd640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7c3d8b0 0x5577c7c3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4beffd640 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7c3d8b0 0x5577c7c3fd00 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcdff16d714a4534 server_cookie=8ad5d8a18fad9d23 in_seq=0 out_seq=0 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.304+0000 7fc4a67fc640 10 client.17247 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4a67fc640 1 -- 172.21.15.52:0/985634215 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577c7b98a20 con 0x5577c7c3d8b0 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4a67fc640 10 client.17247 handle_command_reply: tid=0 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 client.17247 shutdown 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 msgr2=0x5577c7c39110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8098a30 tx=0x7fc4b809c8a0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 shutdown_connections 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7c3d8b0 0x5577c7c3fd00 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c2d370 0x5577c7c39110 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c282e0 0x5577c7c320d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4a67fc640 0 client.17247 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 --2- 172.21.15.52:0/985634215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c279a0 0x5577c7c31b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.305+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 >> 172.21.15.52:0/985634215 conn(0x5577c7c23010 msgr2=0x5577c7c24820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.306+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 shutdown_connections 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.306+0000 7fc4c8072740 1 -- 172.21.15.52:0/985634215 wait complete. 2024-09-19T09:26:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.306+0000 7fc4c8072740 20 client.17247 trim_cache size 0 max 16384 2024-09-19T09:26:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.320+0000 7fc4c8072740 1 Processor -- start 2024-09-19T09:26:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.320+0000 7fc4c8072740 1 -- start start 2024-09-19T09:26:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c24400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01adac0 con 0x5577c7c279a0 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01ab390 con 0x5577c7c2d370 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4c8072740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01a91e0 con 0x5577c7c282e0 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34306/0 (socket says 172.21.15.52:34306) 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 -- 172.21.15.52:0/2596180994 learned_addr learned my addr 172.21.15.52:0/2596180994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c24400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 -- 172.21.15.52:0/2596180994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 msgr2=0x5577c7c390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 -- 172.21.15.52:0/2596180994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 msgr2=0x5577c7c24400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c24400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 -- 172.21.15.52:0/2596180994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7c40380 con 0x5577c7c279a0 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c24400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.321+0000 7fc4beffd640 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619bf3480493d72e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4b4ff9640 1 -- 172.21.15.52:0/2596180994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0020b00 con 0x5577c7c279a0 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4b4ff9640 1 -- 172.21.15.52:0/2596180994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0020ca0 con 0x5577c7c279a0 2024-09-19T09:26:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4b4ff9640 1 -- 172.21.15.52:0/2596180994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b001f710 con 0x5577c7c279a0 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 -- 172.21.15.52:0/2596180994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 msgr2=0x5577c7c23ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b0014000 comp rx=0 tx=0).stop 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 -- 172.21.15.52:0/2596180994 shutdown_connections 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c24400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 --2- 172.21.15.52:0/2596180994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c23ec0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 -- 172.21.15.52:0/2596180994 >> 172.21.15.52:0/2596180994 conn(0x5577c7c23010 msgr2=0x5577c7c31b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 -- 172.21.15.52:0/2596180994 shutdown_connections 2024-09-19T09:26:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.322+0000 7fc4c8072740 1 -- 172.21.15.52:0/2596180994 wait complete. 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 -- start start 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 Processor -- start 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c36b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c37b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01a9850 con 0x5577c7c279a0 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01aacc0 con 0x5577c7c2d370 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01a9f20 con 0x5577c7c282e0 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4c8072740 10 client.0 _ll_register_callbacks cb 0x7fc4b800a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34318/0 (socket says 172.21.15.52:34318) 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4beffd640 1 -- 172.21.15.52:0/4014757447 learned_addr learned my addr 172.21.15.52:0/4014757447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:26:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4bf7fe640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c37b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.323+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c36b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 -- 172.21.15.52:0/4014757447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 msgr2=0x5577c7c36b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c36b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 -- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 msgr2=0x5577c7c37b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c37b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 -- 172.21.15.52:0/4014757447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c7c38130 con 0x5577c7c279a0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4beffd640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0012780 tx=0x7fc4b0020990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be21da8c48a1e255 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0004e50 con 0x5577c7c279a0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc4b0029330 con 0x5577c7c279a0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4b0020ca0 con 0x5577c7c279a0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc4b0040020 con 0x5577c7c279a0 2024-09-19T09:26:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4c8072740 10 client.17253 fetch_fsmap learned FSMap version 24 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5577c7c393b0 con 0x5577c7c279a0 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b0020ca0 con 0x5577c7c279a0 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.324+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc4b0039020 con 0x5577c7c279a0 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 10 client.17253 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 10 client.17253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 20 client.17253 populate_metadata read hostname 'smithi052' 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7ca8be0 0x5577c7cab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 4 client.17253 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577c7b92d70 con 0x5577c7ca8be0 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7ca8be0 0x5577c7cab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4a67fc640 10 client.17253 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.325+0000 7fc4be7fc640 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7ca8be0 0x5577c7cab000 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7468b80b3ca718a server_cookie=83ae1b8ba86eab70 in_seq=0 out_seq=0 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4a67fc640 1 -- 172.21.15.52:0/4014757447 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577c7b92d70 con 0x5577c7ca8be0 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4a67fc640 10 client.17253 handle_command_reply: tid=0 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 client.17253 shutdown 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 msgr2=0x5577c7c36620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0012780 tx=0x7fc4b0020990 comp rx=0 tx=0).stop 2024-09-19T09:26:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 shutdown_connections 2024-09-19T09:26:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5577c7ca8be0 0x5577c7cab000 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5577c7c2d370 0x5577c7c37b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5577c7c282e0 0x5577c7c36b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 --2- 172.21.15.52:0/4014757447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5577c7c279a0 0x5577c7c36620 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 >> 172.21.15.52:0/4014757447 conn(0x5577c7c23010 msgr2=0x5577c7c219a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.338+0000 7fc4a67fc640 0 client.17253 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 shutdown_connections 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c8072740 1 -- 172.21.15.52:0/4014757447 wait complete. 2024-09-19T09:26:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c8072740 20 client.17253 trim_cache size 0 max 16384 2024-09-19T09:26:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:26:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:26:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:26:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 msgr2=0x7fc4ac0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 0x7fc4ac0a57b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x5577c7c28d10 tx=0x7fc4b00096a0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 msgr2=0x7fc4c0100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c970 tx=0x7fc4b800ce30 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 shutdown_connections 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4c0107820 0x7fc4c0100ab0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4c0104ef0 0x7fc4c0100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4ac0a32f0 0x7fc4ac0a57b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 --2- 172.21.15.52:0/2057660336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4c01025c0 0x7fc4c0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 >> 172.21.15.52:0/2057660336 conn(0x7fc4c00fc1e0 msgr2=0x7fc4c0102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:26:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.339+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 shutdown_connections 2024-09-19T09:26:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:26:49.340+0000 7fc4c52d7640 1 -- 172.21.15.52:0/2057660336 wait complete. 2024-09-19T09:26:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:50 smithi052 ceph-mon[30947]: pgmap v500: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:26:50.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:50 smithi169 ceph-mon[35454]: pgmap v500: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:26:51.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:50 smithi086 ceph-mon[34813]: pgmap v500: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:26:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:52 smithi052 ceph-mon[30947]: pgmap v501: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:52.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:52 smithi169 ceph-mon[35454]: pgmap v501: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:52 smithi086 ceph-mon[34813]: pgmap v501: 97 pgs: 97 active+clean; 2.5 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:26:54.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:54 smithi052 ceph-mon[30947]: pgmap v502: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:26:54.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:54 smithi169 ceph-mon[35454]: pgmap v502: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:26:55.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:54 smithi086 ceph-mon[34813]: pgmap v502: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:26:56.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:56 smithi052 ceph-mon[30947]: pgmap v503: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:26:56.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:56 smithi169 ceph-mon[35454]: pgmap v503: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:26:57.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:56 smithi086 ceph-mon[34813]: pgmap v503: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:26:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:26:58 smithi052 ceph-mon[30947]: pgmap v504: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:26:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:26:58 smithi169 ceph-mon[35454]: pgmap v504: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:26:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:26:58 smithi086 ceph-mon[34813]: pgmap v504: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:00.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:00 smithi052 ceph-mon[30947]: pgmap v505: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:00 smithi169 ceph-mon[35454]: pgmap v505: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:01.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:00 smithi086 ceph-mon[34813]: pgmap v505: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 -- 172.21.15.52:0/1034787728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108102610 msgr2=0x7fd108108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 --2- 172.21.15.52:0/1034787728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108102610 0x7fd108108ea0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd100009ca0 tx=0x7fd10002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 -- 172.21.15.52:0/1034787728 shutdown_connections 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 --2- 172.21.15.52:0/1034787728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108102610 0x7fd108108ea0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 --2- 172.21.15.52:0/1034787728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108101c50 0x7fd1081020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 --2- 172.21.15.52:0/1034787728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108100a60 0x7fd108100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 -- 172.21.15.52:0/1034787728 >> 172.21.15.52:0/1034787728 conn(0x7fd1080fc1e0 msgr2=0x7fd1080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 -- 172.21.15.52:0/1034787728 shutdown_connections 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 -- 172.21.15.52:0/1034787728 wait complete. 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.442+0000 7fd10e731640 1 Processor -- start 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 -- start start 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 0x7fd10806ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108102610 0x7fd1081a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd10810c6c0 con 0x7fd108101c50 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd10810c540 con 0x7fd108100a60 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10e731640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd10810c840 con 0x7fd108102610 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38882/0 (socket says 172.21.15.52:38882) 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd1077fe640 1 -- 172.21.15.52:0/2855442760 learned_addr learned my addr 172.21.15.52:0/2855442760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd107fff640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 0x7fd10806ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.443+0000 7fd10ccce640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108102610 0x7fd1081a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 -- 172.21.15.52:0/2855442760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108102610 msgr2=0x7fd1081a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108102610 0x7fd1081a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 -- 172.21.15.52:0/2855442760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 msgr2=0x7fd10806ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 0x7fd10806ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 -- 172.21.15.52:0/2855442760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1081a1b80 con 0x7fd108101c50 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd107fff640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 0x7fd10806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1077fe640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c920 tx=0x7fd0fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1057fa640 1 -- 172.21.15.52:0/2855442760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc007c70 con 0x7fd108101c50 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1057fa640 1 -- 172.21.15.52:0/2855442760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0fc007e10 con 0x7fd108101c50 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1081a1e10 con 0x7fd108101c50 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd1057fa640 1 -- 172.21.15.52:0/2855442760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc018890 con 0x7fd108101c50 2024-09-19T09:27:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.444+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1081a22d0 con 0x7fd108101c50 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 Processor -- start 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1057fa640 1 -- 172.21.15.52:0/2855442760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd0fc018af0 con 0x7fd108101c50 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 -- start start 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a65e0152f0 con 0x55a65e0b7370 2024-09-19T09:27:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a65dfbd270 con 0x55a65e0b19a0 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1114cb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a65e0112b0 con 0x55a65e0b22e0 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38886/0 (socket says 172.21.15.52:38886) 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 -- 172.21.15.52:0/1027148788 learned_addr learned my addr 172.21.15.52:0/1027148788 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd107fff640 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd10ccce640 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 -- 172.21.15.52:0/1027148788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 msgr2=0x55a65e0b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 -- 172.21.15.52:0/1027148788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 msgr2=0x55a65e0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1077fe640 1 -- 172.21.15.52:0/1027148788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65dfbc340 con 0x55a65e0b7370 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.447+0000 7fd1057fa640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 0x7fd0f00a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd10ccce640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 0x7fd0f00a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd1077fe640 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0d5bf0 tx=0x7fd0fc0d5ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5389eb853964c161 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd1057fa640 1 -- 172.21.15.52:0/2855442760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd0fc0cf9f0 con 0x7fd108101c50 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd0ee7fc640 1 -- 172.21.15.52:0/1027148788 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc098230 con 0x55a65e0b7370 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd0ee7fc640 1 -- 172.21.15.52:0/1027148788 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0fc09c690 con 0x55a65e0b7370 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.448+0000 7fd0ee7fc640 1 -- 172.21.15.52:0/1027148788 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc09b8f0 con 0x55a65e0b7370 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- 172.21.15.52:0/1027148788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 msgr2=0x55a65e0b9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0d5bf0 tx=0x7fd0fc0d5ce0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd10ccce640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 0x7fd0f00a57e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd100009430 tx=0x7fd10003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- 172.21.15.52:0/1027148788 shutdown_connections 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0b9830 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 --2- 172.21.15.52:0/1027148788 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- 172.21.15.52:0/1027148788 >> 172.21.15.52:0/1027148788 conn(0x55a65e0ad010 msgr2=0x55a65e0ad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- 172.21.15.52:0/1027148788 shutdown_connections 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- 172.21.15.52:0/1027148788 wait complete. 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 -- start start 2024-09-19T09:27:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.449+0000 7fd1114cb740 1 Processor -- start 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 0x55a65e0bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 0x55a65e0bc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a65e0ba340 con 0x55a65e0b7370 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a65df9e290 con 0x55a65e0b22e0 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a65e0ba4c0 con 0x55a65e0b19a0 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1114cb740 10 client.0 _ll_register_callbacks cb 0x55a65dfcf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38892/0 (socket says 172.21.15.52:38892) 2024-09-19T09:27:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 -- 172.21.15.52:0/832723802 learned_addr learned my addr 172.21.15.52:0/832723802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd107fff640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 0x55a65e0bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1077fe640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 0x55a65e0bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 -- 172.21.15.52:0/832723802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 msgr2=0x55a65e0bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 0x55a65e0bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 -- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 msgr2=0x55a65e0bc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 0x55a65e0bc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 -- 172.21.15.52:0/832723802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65dd28210 con 0x55a65e0b7370 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd1077fe640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 0x55a65e0bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd107fff640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 0x55a65e0bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd10ccce640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd100035000 tx=0x7fd10002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d190d1ba2f323537 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.450+0000 7fd0e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100055060 con 0x55a65e0b7370 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd1000307d0 con 0x55a65e0b7370 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0fc09c690 con 0x55a65e0b7370 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd100003970 con 0x55a65e0b7370 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 10 client.17265 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a65ddf4620 con 0x55a65e0b7370 2024-09-19T09:27:02.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0fc09c690 con 0x55a65e0b7370 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd100004380 con 0x55a65e0b7370 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 10 client.17265 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 10 client.17265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 20 client.17265 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e0c78d0 0x55a65e0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 4 client.17265 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.451+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a65e022a20 con 0x55a65e0c78d0 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.452+0000 7fd107fff640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e0c78d0 0x55a65e0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.452+0000 7fd107fff640 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e0c78d0 0x55a65e0c9d00 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6631f3511a2804e server_cookie=9ca3dbaca0c9733a in_seq=0 out_seq=0 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.452+0000 7fd0e77fe640 10 client.17265 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:02.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd0e77fe640 1 -- 172.21.15.52:0/832723802 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a65e022a20 con 0x55a65e0c78d0 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd0e77fe640 10 client.17265 handle_command_reply: tid=0 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 client.17265 shutdown 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 msgr2=0x55a65e0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd100035000 tx=0x7fd10002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 shutdown_connections 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e0c78d0 0x55a65e0c9d00 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0c3170 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b22e0 0x55a65e0bc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd0e77fe640 0 client.17265 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 --2- 172.21.15.52:0/832723802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b19a0 0x55a65e0bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 >> 172.21.15.52:0/832723802 conn(0x55a65e0ad010 msgr2=0x55a65e0ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 shutdown_connections 2024-09-19T09:27:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 1 -- 172.21.15.52:0/832723802 wait complete. 2024-09-19T09:27:02.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.453+0000 7fd1114cb740 20 client.17265 trim_cache size 0 max 16384 2024-09-19T09:27:02.470 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 Processor -- start 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 -- start start 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081adc00 con 0x55a65e0b7370 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081ab4d0 con 0x55a65e0b19a0 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd1114cb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081a9320 con 0x55a65e0b22e0 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38896/0 (socket says 172.21.15.52:38896) 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 -- 172.21.15.52:0/902900492 learned_addr learned my addr 172.21.15.52:0/902900492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:02.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd107fff640 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 -- 172.21.15.52:0/902900492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 msgr2=0x55a65e0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 -- 172.21.15.52:0/902900492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 msgr2=0x55a65e0ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd10ccce640 1 -- 172.21.15.52:0/902900492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65e0ca380 con 0x55a65e0b7370 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.468+0000 7fd107fff640 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd10ccce640 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd100009bf0 tx=0x7fd100050570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2f1ce18b665eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd0edffb640 1 -- 172.21.15.52:0/902900492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100055040 con 0x55a65e0b7370 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd0edffb640 1 -- 172.21.15.52:0/902900492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd100036040 con 0x55a65e0b7370 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd0edffb640 1 -- 172.21.15.52:0/902900492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100050d80 con 0x55a65e0b7370 2024-09-19T09:27:02.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 -- 172.21.15.52:0/902900492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 msgr2=0x55a65e0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd100009bf0 tx=0x7fd100050570 comp rx=0 tx=0).stop 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 -- 172.21.15.52:0/902900492 shutdown_connections 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b7370 0x55a65e0ce600 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b22e0 0x55a65e0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 --2- 172.21.15.52:0/902900492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 -- 172.21.15.52:0/902900492 >> 172.21.15.52:0/902900492 conn(0x55a65e0ad010 msgr2=0x55a65e0ab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 -- 172.21.15.52:0/902900492 shutdown_connections 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.469+0000 7fd1114cb740 1 -- 172.21.15.52:0/902900492 wait complete. 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 -- start start 2024-09-19T09:27:02.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 Processor -- start 2024-09-19T09:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b7370 0x55a65e0c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081a9990 con 0x55a65e0b22e0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081aae00 con 0x55a65e0b19a0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.470+0000 7fd1114cb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1081aa060 con 0x55a65e0b7370 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1114cb740 10 client.0 _ll_register_callbacks cb 0x7fd10002f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38904/0 (socket says 172.21.15.52:38904) 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 -- 172.21.15.52:0/3151187612 learned_addr learned my addr 172.21.15.52:0/3151187612 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd107fff640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd10ccce640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b7370 0x55a65e0c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 -- 172.21.15.52:0/3151187612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b7370 msgr2=0x55a65e0c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b7370 0x55a65e0c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 -- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 msgr2=0x55a65e0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 -- 172.21.15.52:0/3151187612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65e0c25e0 con 0x55a65e0b22e0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd107fff640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1077fe640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0d7670 tx=0x7fd0fc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc909a1100acf71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd0e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc09bad0 con 0x55a65e0b22e0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd0fc0d5730 con 0x55a65e0b22e0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd100036040 con 0x55a65e0b22e0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0fc09bd60 con 0x55a65e0b22e0 2024-09-19T09:27:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1114cb740 10 client.17271 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.471+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a65e1327f0 con 0x55a65e0b22e0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd100036040 con 0x55a65e0b22e0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0fc098600 con 0x55a65e0b22e0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 10 client.17271 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 20 client.17271 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e132cc0 0x55a65e1350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 4 client.17271 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a65e01cd70 con 0x55a65e132cc0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd107fff640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e132cc0 0x55a65e1350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd107fff640 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e132cc0 0x55a65e1350b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b5d752f5bfce49b server_cookie=5006f92933855989 in_seq=0 out_seq=0 2024-09-19T09:27:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.472+0000 7fd0e77fe640 10 client.17271 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3151187612 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a65e01cd70 con 0x55a65e132cc0 2024-09-19T09:27:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd0e77fe640 10 client.17271 handle_command_reply: tid=0 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 client.17271 shutdown 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 msgr2=0x55a65e0c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0d7670 tx=0x7fd0fc00cf10 comp rx=0 tx=0).stop 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 shutdown_connections 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a65e132cc0 0x55a65e1350b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a65e0b7370 0x55a65e0c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a65e0b22e0 0x55a65e0c0fc0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd0e77fe640 0 client.17271 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 --2- 172.21.15.52:0/3151187612 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a65e0b19a0 0x55a65e0c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 >> 172.21.15.52:0/3151187612 conn(0x55a65e0ad010 msgr2=0x55a65e0ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 shutdown_connections 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 1 -- 172.21.15.52:0/3151187612 wait complete. 2024-09-19T09:27:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.486+0000 7fd1114cb740 20 client.17271 trim_cache size 0 max 16384 2024-09-19T09:27:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:27:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:27:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:27:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:27:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 msgr2=0x7fd0f00a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 0x7fd0f00a57e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd100009430 tx=0x7fd10003d040 comp rx=0 tx=0).stop 2024-09-19T09:27:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 msgr2=0x7fd10819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c920 tx=0x7fd0fc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 shutdown_connections 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd0f00a3320 0x7fd0f00a57e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd108102610 0x7fd1081a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd108101c50 0x7fd10819ee40 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 --2- 172.21.15.52:0/2855442760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd108100a60 0x7fd10806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 >> 172.21.15.52:0/2855442760 conn(0x7fd1080fc1e0 msgr2=0x7fd108104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 shutdown_connections 2024-09-19T09:27:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:02.487+0000 7fd10e731640 1 -- 172.21.15.52:0/2855442760 wait complete. 2024-09-19T09:27:02.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:02.799 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:02.922 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:02 smithi052 ceph-mon[30947]: pgmap v506: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:27:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:02 smithi169 ceph-mon[35454]: pgmap v506: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:27:03.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:02 smithi086 ceph-mon[34813]: pgmap v506: 97 pgs: 97 active+clean; 2.6 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:27:03.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- 172.21.15.52:0/1738824726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160100a80 msgr2=0x7f1160100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 --2- 172.21.15.52:0/1738824726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160100a80 0x7f1160100ee0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1154009930 tx=0x7f115402a420 comp rx=0 tx=0).stop 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- 172.21.15.52:0/1738824726 shutdown_connections 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 --2- 172.21.15.52:0/1738824726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 0x7f116010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 --2- 172.21.15.52:0/1738824726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160100a80 0x7f1160100ee0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 --2- 172.21.15.52:0/1738824726 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160106a80 0x7f1160106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- 172.21.15.52:0/1738824726 >> 172.21.15.52:0/1738824726 conn(0x7f11600fc7a0 msgr2=0x7f11600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- 172.21.15.52:0/1738824726 shutdown_connections 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- 172.21.15.52:0/1738824726 wait complete. 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 Processor -- start 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.285+0000 7f1164e73640 1 -- start start 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 0x7f1160199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 0x7f1160199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1160110ea0 con 0x7f1160106a80 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1160110d20 con 0x7f1160101420 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f1164e73640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1160111020 con 0x7f1160100a80 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38928/0 (socket says 172.21.15.52:38928) 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 -- 172.21.15.52:0/1324270059 learned_addr learned my addr 172.21.15.52:0/1324270059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115dd9b640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 0x7f1160199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115e59c640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 0x7f1160199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 -- 172.21.15.52:0/1324270059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 msgr2=0x7f1160199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 0x7f1160199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 -- 172.21.15.52:0/1324270059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 msgr2=0x7f1160199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 0x7f1160199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 -- 172.21.15.52:0/1324270059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11601a4910 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115e59c640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 0x7f1160199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.286+0000 7f115ed9d640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f115800eaa0 tx=0x7f115800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.287+0000 7f114f7fe640 1 -- 172.21.15.52:0/1324270059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115800cdb0 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.287+0000 7f114f7fe640 1 -- 172.21.15.52:0/1324270059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1158005020 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.287+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11601a4ae0 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.287+0000 7f114f7fe640 1 -- 172.21.15.52:0/1324270059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11580116b0 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.287+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11601a4fa0 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.289+0000 7f114f7fe640 1 -- 172.21.15.52:0/1324270059 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1158005560 con 0x7f1160106a80 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.289+0000 7f116724c740 1 Processor -- start 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.289+0000 7f116724c740 1 -- start start 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae318b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 0x561ae3198a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561ae30f12e0 con 0x561ae318bdc0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561ae3098ce0 con 0x561ae3196680 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f116724c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561ae30ed2a0 con 0x561ae318b4a0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f114f7fe640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38936/0 (socket says 172.21.15.52:38936) 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 -- 172.21.15.52:0/1711216182 learned_addr learned my addr 172.21.15.52:0/1711216182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115ed9d640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115dd9b640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae318b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115dd9b640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 0x561ae3198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 -- 172.21.15.52:0/1711216182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 msgr2=0x561ae318b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f114f7fe640 1 -- 172.21.15.52:0/1324270059 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f11580cfbe0 con 0x7f1160106a80 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae318b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 -- 172.21.15.52:0/1711216182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 msgr2=0x561ae3198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 0x561ae3198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 -- 172.21.15.52:0/1711216182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ae307d440 con 0x561ae318bdc0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115dd9b640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 0x561ae3198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115ed9d640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 0x7f11480a5700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f115809c110 tx=0x7f11580c6f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.290+0000 7f115e59c640 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f11500078d0 tx=0x7f1150007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97c15f29d4e7e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.291+0000 7f114cff9640 1 -- 172.21.15.52:0/1711216182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000d940 con 0x561ae318bdc0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.291+0000 7f114cff9640 1 -- 172.21.15.52:0/1711216182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500125e0 con 0x561ae318bdc0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.291+0000 7f114cff9640 1 -- 172.21.15.52:0/1711216182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115001a630 con 0x561ae318bdc0 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.291+0000 7f116724c740 1 -- 172.21.15.52:0/1711216182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 msgr2=0x561ae3196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.291+0000 7f116724c740 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f11500078d0 tx=0x7f1150007d90 comp rx=0 tx=0).stop 2024-09-19T09:27:03.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- 172.21.15.52:0/1711216182 shutdown_connections 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3196680 0x561ae3198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae3196140 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- 172.21.15.52:0/1711216182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae318b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- 172.21.15.52:0/1711216182 >> 172.21.15.52:0/1711216182 conn(0x561ae3187a30 msgr2=0x561ae3187e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- 172.21.15.52:0/1711216182 shutdown_connections 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- 172.21.15.52:0/1711216182 wait complete. 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- start start 2024-09-19T09:27:03.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 Processor -- start 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae3195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae31931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561ae3199250 con 0x561ae3196680 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561ae30ac050 con 0x561ae318bdc0 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561ae31993d0 con 0x561ae318b4a0 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.292+0000 7f116724c740 10 client.0 _ll_register_callbacks cb 0x561ae30ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38938/0 (socket says 172.21.15.52:38938) 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 -- 172.21.15.52:0/3093232120 learned_addr learned my addr 172.21.15.52:0/3093232120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:03.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae3195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115e59c640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae31931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 -- 172.21.15.52:0/3093232120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 msgr2=0x561ae3195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae3195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 -- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 msgr2=0x561ae31931a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae31931a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 -- 172.21.15.52:0/3093232120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ae2e623c0 con 0x561ae3196680 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1154005c40 tx=0x7f11540058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72def9654e4c2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f1145ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035070 con 0x561ae3196680 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11500125e0 con 0x561ae3196680 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.293+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1154004030 con 0x561ae3196680 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1154004230 con 0x561ae3196680 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 10 client.17283 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:03.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ae31a4b00 con 0x561ae3196680 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11500125e0 con 0x561ae3196680 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1154053070 con 0x561ae3196680 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 10 client.17283 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 10 client.17283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 20 client.17283 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae31a5f10 0x561ae31a8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 4 client.17283 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ae30fe850 con 0x561ae31a5f10 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.294+0000 7f115e59c640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae31a5f10 0x561ae31a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.295+0000 7f115e59c640 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae31a5f10 0x561ae31a8300 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0a8e57bfe750a7 server_cookie=ff872a5507bfd576 in_seq=0 out_seq=0 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.295+0000 7f1145ffb640 10 client.17283 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.295+0000 7f1145ffb640 1 -- 172.21.15.52:0/3093232120 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561ae30fe850 con 0x561ae31a5f10 2024-09-19T09:27:03.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.295+0000 7f1145ffb640 10 client.17283 handle_command_reply: tid=0 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.295+0000 7f116724c740 1 client.17283 shutdown 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 msgr2=0x561ae31936e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f1154005c40 tx=0x7f11540058d0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 shutdown_connections 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae31a5f10 0x561ae31a8300 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3196680 0x561ae31936e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae31931a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f1145ffb640 0 client.17283 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 --2- 172.21.15.52:0/3093232120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae3195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 >> 172.21.15.52:0/3093232120 conn(0x561ae3187a30 msgr2=0x561ae318d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 shutdown_connections 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 1 -- 172.21.15.52:0/3093232120 wait complete. 2024-09-19T09:27:03.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.296+0000 7f116724c740 20 client.17283 trim_cache size 0 max 16384 2024-09-19T09:27:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 Processor -- start 2024-09-19T09:27:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 -- start start 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3187a30 0x561ae3195110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae31adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11601ade60 con 0x561ae318bdc0 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f11601ab730 con 0x561ae3187a30 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f116724c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11601a9580 con 0x561ae318b4a0 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38946/0 (socket says 172.21.15.52:38946) 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 -- 172.21.15.52:0/837109994 learned_addr learned my addr 172.21.15.52:0/837109994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3187a30 0x561ae3195110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 -- 172.21.15.52:0/837109994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 msgr2=0x561ae31adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae31adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 -- 172.21.15.52:0/837109994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3187a30 msgr2=0x561ae3195110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3187a30 0x561ae3195110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.313+0000 7f115dd9b640 1 -- 172.21.15.52:0/837109994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ae3187860 con 0x561ae318bdc0 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f115dd9b640 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1154031740 tx=0x7f115404d410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c310a2c9e6411b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f1147fff640 1 -- 172.21.15.52:0/837109994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035070 con 0x561ae318bdc0 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f1147fff640 1 -- 172.21.15.52:0/837109994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1154050070 con 0x561ae318bdc0 2024-09-19T09:27:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f1147fff640 1 -- 172.21.15.52:0/837109994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115404d630 con 0x561ae318bdc0 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 -- 172.21.15.52:0/837109994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 msgr2=0x561ae31ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f1154031740 tx=0x7f115404d410 comp rx=0 tx=0).stop 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 -- 172.21.15.52:0/837109994 shutdown_connections 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae318bdc0 0x561ae31ae070 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae31adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 --2- 172.21.15.52:0/837109994 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae3187a30 0x561ae3195110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 -- 172.21.15.52:0/837109994 >> 172.21.15.52:0/837109994 conn(0x561ae3193840 msgr2=0x561ae3194a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.314+0000 7f116724c740 1 -- 172.21.15.52:0/837109994 shutdown_connections 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 -- 172.21.15.52:0/837109994 wait complete. 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 -- start start 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 Processor -- start 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae319c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae319ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f11601a9bf0 con 0x561ae3187a30 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f11601ab060 con 0x561ae318bdc0 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f11601aa2c0 con 0x561ae318b4a0 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f116724c740 10 client.0 _ll_register_callbacks cb 0x7f1154009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f115dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38956/0 (socket says 172.21.15.52:38956) 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.315+0000 7f115dd9b640 1 -- 172.21.15.52:0/3140128688 learned_addr learned my addr 172.21.15.52:0/3140128688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115e59c640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae319c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 -- 172.21.15.52:0/3140128688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 msgr2=0x561ae319c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae319c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 -- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 msgr2=0x561ae319ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae319ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 -- 172.21.15.52:0/3140128688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ae320fbc0 con 0x561ae3187a30 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f115dd9b640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f115402a460 tx=0x7f1154003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1f9923808127f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035040 con 0x561ae3187a30 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f11540035f0 con 0x561ae3187a30 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1154050070 con 0x561ae3187a30 2024-09-19T09:27:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f11540037f0 con 0x561ae3187a30 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f116724c740 10 client.17289 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561ae3210e90 con 0x561ae3187a30 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1154050070 con 0x561ae3187a30 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.316+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1154053040 con 0x561ae3187a30 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 10 client.17289 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 20 client.17289 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae3196680 0x561ae3213590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 4 client.17289 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ae30f8d60 con 0x561ae3196680 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f115e59c640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae3196680 0x561ae3213590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f115e59c640 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae3196680 0x561ae3213590 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82955d4c2e24d33 server_cookie=d229172f46c16a4b in_seq=0 out_seq=0 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.317+0000 7f1145ffb640 10 client.17289 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1145ffb640 1 -- 172.21.15.52:0/3140128688 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561ae30f8d60 con 0x561ae3196680 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1145ffb640 10 client.17289 handle_command_reply: tid=0 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 client.17289 shutdown 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 msgr2=0x561ae319c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f115402a460 tx=0x7f1154003e50 comp rx=0 tx=0).stop 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 shutdown_connections 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561ae3196680 0x561ae3213590 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561ae318bdc0 0x561ae319ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561ae318b4a0 0x561ae319c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1145ffb640 0 client.17289 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 --2- 172.21.15.52:0/3140128688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561ae3187a30 0x561ae319c430 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 >> 172.21.15.52:0/3140128688 conn(0x561ae3193840 msgr2=0x561ae3191640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 shutdown_connections 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 1 -- 172.21.15.52:0/3140128688 wait complete. 2024-09-19T09:27:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f116724c740 20 client.17289 trim_cache size 0 max 16384 2024-09-19T09:27:03.324 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:03.324 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:27:03.324 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:27:03.324 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 msgr2=0x7f11480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 0x7f11480a5700 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f115809c110 tx=0x7f11580c6f50 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 msgr2=0x7f11601a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f115800eaa0 tx=0x7f115800ef60 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.318+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 shutdown_connections 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1160106a80 0x7f11601a43d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1160101420 0x7f1160199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f11480a3240 0x7f11480a5700 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 --2- 172.21.15.52:0/1324270059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1160100a80 0x7f1160199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:03.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 >> 172.21.15.52:0/1324270059 conn(0x7f11600fc7a0 msgr2=0x7f11600fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:03.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 shutdown_connections 2024-09-19T09:27:03.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:03.319+0000 7f1164e73640 1 -- 172.21.15.52:0/1324270059 wait complete. 2024-09-19T09:27:04.276 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:27:04.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:27:04.540 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:04.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:04 smithi052 ceph-mon[30947]: pgmap v507: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:27:04.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:04 smithi169 ceph-mon[35454]: pgmap v507: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:27:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:04 smithi086 ceph-mon[34813]: pgmap v507: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3259814229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 msgr2=0x7f1ebc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3259814229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc100ee0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009930 tx=0x7f1eb002a420 comp rx=0 tx=0).stop 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3259814229 shutdown_connections 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3259814229 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 0x7f1ebc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3259814229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc100ee0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3259814229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 0x7f1ebc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3259814229 >> 172.21.15.52:0/3259814229 conn(0x7f1ebc0fc7a0 msgr2=0x7f1ebc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3259814229 shutdown_connections 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.167+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3259814229 wait complete. 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 Processor -- start 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 -- start start 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 0x7f1ebc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 0x7f1ebc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc110e80 con 0x7f1ebc100a80 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc110d00 con 0x7f1ebc106a80 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec2a4c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ebc111000 con 0x7f1ebc101420 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ebbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38962/0 (socket says 172.21.15.52:38962) 2024-09-19T09:27:05.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ebbfff640 1 -- 172.21.15.52:0/3768095618 learned_addr learned my addr 172.21.15.52:0/3768095618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ec0fe9640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 0x7f1ebc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.168+0000 7f1ebb7fe640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 0x7f1ebc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 -- 172.21.15.52:0/3768095618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 msgr2=0x7f1ebc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 0x7f1ebc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 -- 172.21.15.52:0/3768095618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 msgr2=0x7f1ebc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 0x7f1ebc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 -- 172.21.15.52:0/3768095618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc19d400 con 0x7f1ebc100a80 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ebbfff640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d950 tx=0x7f1eac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac017070 con 0x7f1ebc100a80 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc19d6f0 con 0x7f1ebc100a80 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eac009c30 con 0x7f1ebc100a80 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac00f6b0 con 0x7f1ebc100a80 2024-09-19T09:27:05.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.169+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ebc1a4fd0 con 0x7f1ebc100a80 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.170+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ebc100ee0 con 0x7f1ebc100a80 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.171+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1eac0109d0 con 0x7f1ebc100a80 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.172+0000 7f1eb97fa640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 0x7f1ea40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.172+0000 7f1ebb7fe640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 0x7f1ea40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.172+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1eac0cf470 con 0x7f1ebc100a80 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.172+0000 7f1ebb7fe640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 0x7f1ea40a5700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009900 tx=0x7f1eb00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:05.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.176+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1eac009de0 con 0x7f1ebc100a80 2024-09-19T09:27:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.387+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ebc1a51a0 con 0x7f1ebc100a80 2024-09-19T09:27:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.388+0000 7f1eb97fa640 1 -- 172.21.15.52:0/3768095618 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f1eac09bac0 con 0x7f1ebc100a80 2024-09-19T09:27:05.389 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:27:05.389 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:27:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 msgr2=0x7f1ea40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 0x7f1ea40a5700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009900 tx=0x7f1eb00058d0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 msgr2=0x7f1ebc198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d950 tx=0x7f1eac00de10 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 shutdown_connections 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ebc106a80 0x7f1ebc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ea40a3240 0x7f1ea40a5700 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ebc101420 0x7f1ebc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 --2- 172.21.15.52:0/3768095618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ebc100a80 0x7f1ebc198450 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 >> 172.21.15.52:0/3768095618 conn(0x7f1ebc0fc7a0 msgr2=0x7f1ebc104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 shutdown_connections 2024-09-19T09:27:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:05.390+0000 7f1ec2a4c640 1 -- 172.21.15.52:0/3768095618 wait complete. 2024-09-19T09:27:05.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:05 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3768095618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:05.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:05 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3768095618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:05.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:27:06.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:05 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3768095618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:06.231 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3461447782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 msgr2=0x7f9ec81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3461447782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec81067f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009900 tx=0x7f9eb402a410 comp rx=0 tx=0).stop 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3461447782 shutdown_connections 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3461447782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 0x7f9ec810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3461447782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec81067f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3461447782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 0x7f9ec81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3461447782 >> 172.21.15.52:0/3461447782 conn(0x7f9ec80fd8f0 msgr2=0x7f9ec80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3461447782 shutdown_connections 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3461447782 wait complete. 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 Processor -- start 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.717+0000 7f9ecf0c3640 1 -- start start 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 0x7f9ec80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 0x7f9ec8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8111fa0 con 0x7f9ec81027a0 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8111e20 con 0x7f9ec8106f20 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecf0c3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8112120 con 0x7f9ec8101df0 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38972/0 (socket says 172.21.15.52:38972) 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 -- 172.21.15.52:0/3295422244 learned_addr learned my addr 172.21.15.52:0/3295422244 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:06.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecd660640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 0x7f9ec8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 0x7f9ec80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 -- 172.21.15.52:0/3295422244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 msgr2=0x7f9ec80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 0x7f9ec80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 -- 172.21.15.52:0/3295422244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 msgr2=0x7f9ec8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 0x7f9ec8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 -- 172.21.15.52:0/3295422244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec81a69e0 con 0x7f9ec81027a0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.718+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4006010 tx=0x7f9eb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.719+0000 7f9ec5ffb640 1 -- 172.21.15.52:0/3295422244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb403f030 con 0x7f9ec81027a0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.719+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec81a6c70 con 0x7f9ec81027a0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.719+0000 7f9ec5ffb640 1 -- 172.21.15.52:0/3295422244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb4003ce0 con 0x7f9ec81027a0 2024-09-19T09:27:06.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.719+0000 7f9ec5ffb640 1 -- 172.21.15.52:0/3295422244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4035070 con 0x7f9ec81027a0 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.719+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec81a71a0 con 0x7f9ec81027a0 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.721+0000 7f9ec5ffb640 1 -- 172.21.15.52:0/3295422244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9eb4042030 con 0x7f9ec81027a0 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.721+0000 7f9ed149c740 1 Processor -- start 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.721+0000 7f9ed149c740 1 -- start start 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555c3394c2f0 con 0x555c339e7b40 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555c338f3cf0 con 0x555c339f1370 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ed149c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c339482b0 con 0x555c339e65d0 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38976/0 (socket says 172.21.15.52:38976) 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 -- 172.21.15.52:0/783674819 learned_addr learned my addr 172.21.15.52:0/783674819 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ec5ffb640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 0x7f9eb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 -- 172.21.15.52:0/783674819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 msgr2=0x555c339e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 -- 172.21.15.52:0/783674819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 msgr2=0x555c339f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 -- 172.21.15.52:0/783674819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c338d83a0 con 0x555c339e7b40 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ec5ffb640 1 -- 172.21.15.52:0/3295422244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9eb40efd30 con 0x7f9ec81027a0 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.722+0000 7f9ecd660640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 0x7f9eb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ecd660640 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0010510 tx=0x7f9ec0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccede7657a313689 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9eb2ffd640 1 -- 172.21.15.52:0/783674819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec001d400 con 0x555c339e7b40 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9eb2ffd640 1 -- 172.21.15.52:0/783674819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec001da80 con 0x555c339e7b40 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9eb2ffd640 1 -- 172.21.15.52:0/783674819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec001c7c0 con 0x555c339e7b40 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 -- 172.21.15.52:0/783674819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 msgr2=0x555c339e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ecd660640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 0x7f9eb80a5700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0021000 tx=0x7f9ec001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0010510 tx=0x7f9ec0009f90 comp rx=0 tx=0).stop 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 -- 172.21.15.52:0/783674819 shutdown_connections 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 --2- 172.21.15.52:0/783674819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339e6090 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 -- 172.21.15.52:0/783674819 >> 172.21.15.52:0/783674819 conn(0x555c339af310 msgr2=0x555c339e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 -- 172.21.15.52:0/783674819 shutdown_connections 2024-09-19T09:27:06.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.723+0000 7f9ed149c740 1 -- 172.21.15.52:0/783674819 wait complete. 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 -- start start 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 Processor -- start 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 0x555c339f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339f1370 0x555c339ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555c339f4070 con 0x555c339e7b40 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555c33907060 con 0x555c339e65d0 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555c339f41f0 con 0x555c339f1370 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ed149c740 10 client.0 _ll_register_callbacks cb 0x555c3365a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38984/0 (socket says 172.21.15.52:38984) 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.724+0000 7f9ec7fff640 1 -- 172.21.15.52:0/1182353234 learned_addr learned my addr 172.21.15.52:0/1182353234 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:06.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 0x555c339f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 -- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339f1370 msgr2=0x555c339ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339f1370 0x555c339ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 -- 172.21.15.52:0/1182353234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 msgr2=0x555c339f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 0x555c339f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 -- 172.21.15.52:0/1182353234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c336bd3c0 con 0x555c339e7b40 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 0x555c339f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40bc260 tx=0x7f9eb4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727dca4f76e7fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ea7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4049070 con 0x555c339e7b40 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9eb403bc40 con 0x555c339e7b40 2024-09-19T09:27:06.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ec001da80 con 0x555c339e7b40 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9eb40bc0a0 con 0x555c339e7b40 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ed149c740 10 client.17307 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c339ffab0 con 0x555c339e7b40 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.725+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec001da80 con 0x555c339e7b40 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb40bc530 con 0x555c339e7b40 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 10 client.17307 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 10 client.17307 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 20 client.17307 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a00f10 0x555c33a03340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 4 client.17307 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c33959860 con 0x555c33a00f10 2024-09-19T09:27:06.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a00f10 0x555c33a03340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ea7fff640 10 client.17307 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.726+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a00f10 0x555c33a03340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=763578e788552aea server_cookie=78571defdd823b0f in_seq=0 out_seq=0 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ea7fff640 1 -- 172.21.15.52:0/1182353234 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c33959860 con 0x555c33a00f10 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ea7fff640 10 client.17307 handle_command_reply: tid=0 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 client.17307 shutdown 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 msgr2=0x555c339edf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40bc260 tx=0x7f9eb4005c90 comp rx=0 tx=0).stop 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 shutdown_connections 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a00f10 0x555c33a03340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339f1370 0x555c339ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339edf80 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ea7fff640 0 client.17307 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:06.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1182353234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e65d0 0x555c339f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.727+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 >> 172.21.15.52:0/1182353234 conn(0x555c339af310 msgr2=0x555c339e8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.728+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 shutdown_connections 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.728+0000 7f9ed149c740 1 -- 172.21.15.52:0/1182353234 wait complete. 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.728+0000 7f9ed149c740 20 client.17307 trim_cache size 0 max 16384 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 Processor -- start 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 -- start start 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 0x555c339fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81b2260 con 0x555c339f1370 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81afb30 con 0x555c339e7b40 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ed149c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81ad980 con 0x555c339e65d0 2024-09-19T09:27:06.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38990/0 (socket says 172.21.15.52:38990) 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 -- 172.21.15.52:0/1126272743 learned_addr learned my addr 172.21.15.52:0/1126272743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 0x555c339fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 -- 172.21.15.52:0/1126272743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 msgr2=0x555c339e2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 -- 172.21.15.52:0/1126272743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 msgr2=0x555c339fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 0x555c339fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ecd660640 1 -- 172.21.15.52:0/1126272743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c339f1040 con 0x555c339f1370 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.741+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 0x555c339fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ecd660640 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0010f40 tx=0x7f9ec0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04b803a9873c26f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9eb27fc640 1 -- 172.21.15.52:0/1126272743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0036070 con 0x555c339f1370 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9eb27fc640 1 -- 172.21.15.52:0/1126272743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec001c3a0 con 0x555c339f1370 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9eb27fc640 1 -- 172.21.15.52:0/1126272743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0003c50 con 0x555c339f1370 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 -- 172.21.15.52:0/1126272743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 msgr2=0x555c33a08c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0010f40 tx=0x7f9ec0009bb0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 -- 172.21.15.52:0/1126272743 shutdown_connections 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339f1370 0x555c33a08c50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339e7b40 0x555c339fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 --2- 172.21.15.52:0/1126272743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339e2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 -- 172.21.15.52:0/1126272743 >> 172.21.15.52:0/1126272743 conn(0x555c339af310 msgr2=0x555c339e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 -- 172.21.15.52:0/1126272743 shutdown_connections 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.742+0000 7f9ed149c740 1 -- 172.21.15.52:0/1126272743 wait complete. 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 -- start start 2024-09-19T09:27:06.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 Processor -- start 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81adff0 con 0x555c339e7b40 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81af460 con 0x555c339f1370 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81ae6c0 con 0x555c339e65d0 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.743+0000 7f9ed149c740 10 client.0 _ll_register_callbacks cb 0x7f9eb40314b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38992/0 (socket says 172.21.15.52:38992) 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 -- 172.21.15.52:0/2358782150 learned_addr learned my addr 172.21.15.52:0/2358782150 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ecd660640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 -- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 msgr2=0x555c339f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 -- 172.21.15.52:0/2358782150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 msgr2=0x555c339f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 -- 172.21.15.52:0/2358782150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c33a6ae70 con 0x555c339e7b40 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ec7fff640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40c5030 tx=0x7f9eb4005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507b6aa6eb41a26d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ea7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb40da060 con 0x555c339e7b40 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9eb40ba5d0 con 0x555c339e7b40 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ec001c3a0 con 0x555c339e7b40 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9eb40a1050 con 0x555c339e7b40 2024-09-19T09:27:06.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ed149c740 10 client.17313 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.744+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c33a6c0a0 con 0x555c339e7b40 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec001c3a0 con 0x555c339e7b40 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb40c0180 con 0x555c339e7b40 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 10 client.17313 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 10 client.17313 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 20 client.17313 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a6c5d0 0x555c33a6e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 4 client.17313 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c33953d70 con 0x555c33a6c5d0 2024-09-19T09:27:06.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.745+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a6c5d0 0x555c33a6e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ecce5f640 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a6c5d0 0x555c33a6e9c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a1bc1cf6033e2f9 server_cookie=3d3ed6115bb597ae in_seq=0 out_seq=0 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ea7fff640 10 client.17313 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ea7fff640 1 -- 172.21.15.52:0/2358782150 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c33953d70 con 0x555c33a6c5d0 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ea7fff640 10 client.17313 handle_command_reply: tid=0 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 client.17313 shutdown 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 msgr2=0x555c339f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40c5030 tx=0x7f9eb4005900 comp rx=0 tx=0).stop 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 shutdown_connections 2024-09-19T09:27:06.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555c33a6c5d0 0x555c33a6e9c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555c339f1370 0x555c339f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555c339e7b40 0x555c339f5980 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 --2- 172.21.15.52:0/2358782150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555c339e65d0 0x555c339f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ea7fff640 0 client.17313 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 >> 172.21.15.52:0/2358782150 conn(0x555c339af310 msgr2=0x555c339f0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 shutdown_connections 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 1 -- 172.21.15.52:0/2358782150 wait complete. 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.746+0000 7f9ed149c740 20 client.17313 trim_cache size 0 max 16384 2024-09-19T09:27:06.764 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 msgr2=0x7f9eb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 0x7f9eb80a5700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0021000 tx=0x7f9ec001e000 comp rx=0 tx=0).stop 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 msgr2=0x7f9ec8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4006010 tx=0x7f9eb40042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 shutdown_connections 2024-09-19T09:27:06.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ec8106f20 0x7f9ec8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ec81027a0 0x7f9ec8074a30 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9eb80a3240 0x7f9eb80a5700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 --2- 172.21.15.52:0/3295422244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ec8101df0 0x7f9ec80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 >> 172.21.15.52:0/3295422244 conn(0x7f9ec80fd8f0 msgr2=0x7f9ec80fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 shutdown_connections 2024-09-19T09:27:06.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:06.747+0000 7f9ecf0c3640 1 -- 172.21.15.52:0/3295422244 wait complete. 2024-09-19T09:27:06.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:06 smithi052 ceph-mon[30947]: pgmap v508: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:06 smithi169 ceph-mon[35454]: pgmap v508: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:06 smithi086 ceph-mon[34813]: pgmap v508: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:07.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:27:07.642 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.174+0000 7fece64a1640 1 -- 172.21.15.52:0/2654798305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0101de0 msgr2=0x7fece01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.174+0000 7fece64a1640 1 --2- 172.21.15.52:0/2654798305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0101de0 0x7fece01021c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009900 tx=0x7fecd002a410 comp rx=0 tx=0).stop 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- 172.21.15.52:0/2654798305 shutdown_connections 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- 172.21.15.52:0/2654798305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0106f10 0x7fece010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- 172.21.15.52:0/2654798305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 0x7fece01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- 172.21.15.52:0/2654798305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0101de0 0x7fece01021c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- 172.21.15.52:0/2654798305 >> 172.21.15.52:0/2654798305 conn(0x7fece00fd8c0 msgr2=0x7fece00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- 172.21.15.52:0/2654798305 shutdown_connections 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- 172.21.15.52:0/2654798305 wait complete. 2024-09-19T09:27:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 Processor -- start 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- start start 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0101de0 0x7fece0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 0x7fece0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fece0111fb0 con 0x7fece0106f10 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fece0111e30 con 0x7fece0102790 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.175+0000 7fece64a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fece0112130 con 0x7fece0101de0 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54526/0 (socket says 172.21.15.52:54526) 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 -- 172.21.15.52:0/521962491 learned_addr learned my addr 172.21.15.52:0/521962491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fecd7fff640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 0x7fece0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fecdffff640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0101de0 0x7fece0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 -- 172.21.15.52:0/521962491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0101de0 msgr2=0x7fece0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0101de0 0x7fece0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 -- 172.21.15.52:0/521962491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 msgr2=0x7fece0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 0x7fece0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 -- 172.21.15.52:0/521962491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece019d4c0 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece4a3e640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fecd800eaa0 tx=0x7fecd800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fecddffb640 1 -- 172.21.15.52:0/521962491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8004d20 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fecddffb640 1 -- 172.21.15.52:0/521962491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd8005020 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece019d7b0 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fecddffb640 1 -- 172.21.15.52:0/521962491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd80116d0 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.176+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece01a5090 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fecddffb640 1 -- 172.21.15.52:0/521962491 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fecd80051d0 con 0x7fece0106f10 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 Processor -- start 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 -- start start 2024-09-19T09:27:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240c1b40 0x5645240c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645240262f0 con 0x5645240cb370 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564523fcdcf0 con 0x5645240c05d0 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.179+0000 7fece887a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5645240222b0 con 0x5645240c1b40 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54542/0 (socket says 172.21.15.52:54542) 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 -- 172.21.15.52:0/2470712749 learned_addr learned my addr 172.21.15.52:0/2470712749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecddffb640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 0x7feccc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240c1b40 0x5645240c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecdffff640 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fece4a3e640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 0x7feccc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 -- 172.21.15.52:0/2470712749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240c1b40 msgr2=0x5645240c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240c1b40 0x5645240c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 -- 172.21.15.52:0/2470712749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 msgr2=0x5645240c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 -- 172.21.15.52:0/2470712749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564523fb23a0 con 0x5645240cb370 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecddffb640 1 -- 172.21.15.52:0/521962491 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fecd80cfb20 con 0x7fece0106f10 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd7fff640 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fecc8006aa0 tx=0x7fecc80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45e7433f8c7ffd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fece4a3e640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 0x7feccc0a5700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009270 tx=0x7fecd80bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd67fc640 1 -- 172.21.15.52:0/2470712749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8010650 con 0x5645240cb370 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd67fc640 1 -- 172.21.15.52:0/2470712749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc801d070 con 0x5645240cb370 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.180+0000 7fecd67fc640 1 -- 172.21.15.52:0/2470712749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8018a10 con 0x5645240cb370 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 -- 172.21.15.52:0/2470712749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 msgr2=0x5645240cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fecc8006aa0 tx=0x7fecc80095c0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 -- 172.21.15.52:0/2470712749 shutdown_connections 2024-09-19T09:27:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240cb370 0x5645240cd760 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 --2- 172.21.15.52:0/2470712749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240c1b40 0x5645240c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 -- 172.21.15.52:0/2470712749 >> 172.21.15.52:0/2470712749 conn(0x564524089310 msgr2=0x5645240bcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 -- 172.21.15.52:0/2470712749 shutdown_connections 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.181+0000 7fece887a740 1 -- 172.21.15.52:0/2470712749 wait complete. 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 -- start start 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 Processor -- start 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645240ce010 con 0x5645240c1b40 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564523fe1060 con 0x5645240c05d0 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5645240ce190 con 0x5645240cb370 2024-09-19T09:27:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fece887a740 10 client.0 _ll_register_callbacks cb 0x564523d348c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fecdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fecdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54544/0 (socket says 172.21.15.52:54544) 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fecdffff640 1 -- 172.21.15.52:0/1009927221 learned_addr learned my addr 172.21.15.52:0/1009927221 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.182+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 -- 172.21.15.52:0/1009927221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 msgr2=0x5645240c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 -- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 msgr2=0x5645240cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 -- 172.21.15.52:0/1009927221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564523d973c0 con 0x5645240c1b40 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecdffff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009900 tx=0x7fecd0031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ae2c47d9068c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0035040 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fecd0004240 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecc801d070 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fecd004b030 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fece887a740 10 client.17325 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5645240d9a80 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.183+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecc801d070 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fecd0004b80 con 0x5645240c1b40 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 10 client.17325 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 10 client.17325 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 20 client.17325 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5645240daf40 0x5645240dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 4 client.17325 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564524033860 con 0x5645240daf40 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5645240daf40 0x5645240dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fecbf7fe640 10 client.17325 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.184+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5645240daf40 0x5645240dd380 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=919e8370b516f0ee server_cookie=b61aaec54b285d93 in_seq=0 out_seq=0 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1009927221 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564524033860 con 0x5645240daf40 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fecbf7fe640 10 client.17325 handle_command_reply: tid=0 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 client.17325 shutdown 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 msgr2=0x5645240c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009900 tx=0x7fecd0031920 comp rx=0 tx=0).stop 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 shutdown_connections 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240c7ff0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5645240daf40 0x5645240dd380 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 --2- 172.21.15.52:0/1009927221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fecbf7fe640 0 client.17325 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.185+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 >> 172.21.15.52:0/1009927221 conn(0x564524089310 msgr2=0x5645240c2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.186+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 shutdown_connections 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.186+0000 7fece887a740 1 -- 172.21.15.52:0/1009927221 wait complete. 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.186+0000 7fece887a740 20 client.17325 trim_cache size 0 max 16384 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 Processor -- start 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 -- start start 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fece01b00a0 con 0x5645240c1b40 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fece01ad970 con 0x5645240c05d0 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fece887a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fece01ab7c0 con 0x5645240cb370 2024-09-19T09:27:08.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54546/0 (socket says 172.21.15.52:54546) 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 -- 172.21.15.52:0/1371737429 learned_addr learned my addr 172.21.15.52:0/1371737429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 -- 172.21.15.52:0/1371737429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 msgr2=0x5645240e2c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240e2c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 -- 172.21.15.52:0/1371737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 msgr2=0x5645240c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.199+0000 7fecdffff640 1 -- 172.21.15.52:0/1371737429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645240ca960 con 0x5645240c1b40 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fecdffff640 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005940 tx=0x7fecd002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115f85f167279fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fecd5ffb640 1 -- 172.21.15.52:0/1371737429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0035030 con 0x5645240c1b40 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fecd5ffb640 1 -- 172.21.15.52:0/1371737429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd00054b0 con 0x5645240c1b40 2024-09-19T09:27:08.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fecd5ffb640 1 -- 172.21.15.52:0/1371737429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004b90 con 0x5645240c1b40 2024-09-19T09:27:08.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 -- 172.21.15.52:0/1371737429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 msgr2=0x5645240d72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fecd0005940 tx=0x7fecd002a410 comp rx=0 tx=0).stop 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 -- 172.21.15.52:0/1371737429 shutdown_connections 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240e2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c1b40 0x5645240d72b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 --2- 172.21.15.52:0/1371737429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c05d0 0x5645240c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.200+0000 7fece887a740 1 -- 172.21.15.52:0/1371737429 >> 172.21.15.52:0/1371737429 conn(0x564524089310 msgr2=0x5645240c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 -- 172.21.15.52:0/1371737429 shutdown_connections 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 -- 172.21.15.52:0/1371737429 wait complete. 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 -- start start 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 Processor -- start 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 0x5645240d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240d3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.201+0000 7fece887a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fece01abe30 con 0x5645240c05d0 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fece01ad2a0 con 0x5645240c1b40 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fece01ac500 con 0x5645240cb370 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 10 client.0 _ll_register_callbacks cb 0x7fecd00315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54562/0 (socket says 172.21.15.52:54562) 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 -- 172.21.15.52:0/1063693480 learned_addr learned my addr 172.21.15.52:0/1063693480 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecdffff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 0x5645240d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 -- 172.21.15.52:0/1063693480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 msgr2=0x5645240d3960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240d3960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 -- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 msgr2=0x5645240d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:08.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 0x5645240d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 -- 172.21.15.52:0/1063693480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645240c4f70 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecdffff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 0x5645240d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecd7fff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fecc8011010 tx=0x7fecc8010fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfb5004109a8ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8018b30 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fecc8018cd0 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecd00054b0 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fecc8010620 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 10 client.17331 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.202+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56452414a1b0 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecd00054b0 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fecc802d760 con 0x5645240c05d0 2024-09-19T09:27:08.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 10 client.17331 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 10 client.17331 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 20 client.17331 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56452414a5a0 0x56452414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 4 client.17331 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56452402dd70 con 0x56452414a5a0 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fecdffff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56452414a5a0 0x56452414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fecbf7fe640 10 client.17331 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.203+0000 7fecdffff640 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56452414a5a0 0x56452414c9e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b515b49973b387cf server_cookie=15b15df388591aca in_seq=0 out_seq=0 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fecbf7fe640 1 -- 172.21.15.52:0/1063693480 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56452402dd70 con 0x56452414a5a0 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fecbf7fe640 10 client.17331 handle_command_reply: tid=0 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 client.17331 shutdown 2024-09-19T09:27:08.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 msgr2=0x564524141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fecc8011010 tx=0x7fecc8010fa0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 shutdown_connections 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645240cb370 0x5645240d3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56452414a5a0 0x56452414c9e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645240c1b40 0x5645240d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 --2- 172.21.15.52:0/1063693480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645240c05d0 0x564524141510 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 >> 172.21.15.52:0/1063693480 conn(0x564524089310 msgr2=0x5645240c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fecbf7fe640 0 client.17331 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 shutdown_connections 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 1 -- 172.21.15.52:0/1063693480 wait complete. 2024-09-19T09:27:08.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.204+0000 7fece887a740 20 client.17331 trim_cache size 0 max 16384 2024-09-19T09:27:08.220 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 msgr2=0x7feccc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 0x7feccc0a5700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009270 tx=0x7fecd80bc040 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 msgr2=0x7fece019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fecd800eaa0 tx=0x7fecd800eea0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 shutdown_connections 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece0106f10 0x7fece019cde0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fece0102790 0x7fece0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feccc0a3240 0x7feccc0a5700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 --2- 172.21.15.52:0/521962491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fece0101de0 0x7fece0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 >> 172.21.15.52:0/521962491 conn(0x7fece00fd8c0 msgr2=0x7fece00febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 shutdown_connections 2024-09-19T09:27:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:08.205+0000 7fece64a1640 1 -- 172.21.15.52:0/521962491 wait complete. 2024-09-19T09:27:08.870 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:08 smithi052 ceph-mon[30947]: pgmap v509: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:08.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:27:08.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:08 smithi169 ceph-mon[35454]: pgmap v509: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:08 smithi086 ceph-mon[34813]: pgmap v509: 97 pgs: 97 active+clean; 2.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:09.165 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.606+0000 7fc8546d0640 1 -- 172.21.15.52:0/2944052740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c100a80 msgr2=0x7fc84c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.606+0000 7fc8546d0640 1 --2- 172.21.15.52:0/2944052740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c100a80 0x7fc84c100ee0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009930 tx=0x7fc83c02a420 comp rx=0 tx=0).stop 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 -- 172.21.15.52:0/2944052740 shutdown_connections 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 --2- 172.21.15.52:0/2944052740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c101420 0x7fc84c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 --2- 172.21.15.52:0/2944052740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c100a80 0x7fc84c100ee0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 --2- 172.21.15.52:0/2944052740 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 0x7fc84c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 -- 172.21.15.52:0/2944052740 >> 172.21.15.52:0/2944052740 conn(0x7fc84c0fc7a0 msgr2=0x7fc84c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 -- 172.21.15.52:0/2944052740 shutdown_connections 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 -- 172.21.15.52:0/2944052740 wait complete. 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 Processor -- start 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.607+0000 7fc8546d0640 1 -- start start 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c100a80 0x7fc84c0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 0x7fc84c0fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c110e80 con 0x7fc84c101420 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c110d00 con 0x7fc84c106a80 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8546d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c111000 con 0x7fc84c100a80 2024-09-19T09:27:09.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54576/0 (socket says 172.21.15.52:54576) 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 -- 172.21.15.52:0/3459203531 learned_addr learned my addr 172.21.15.52:0/3459203531 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 0x7fc84c0fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc85246c640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c100a80 0x7fc84c0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 -- 172.21.15.52:0/3459203531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c100a80 msgr2=0x7fc84c0fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c100a80 0x7fc84c0fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 -- 172.21.15.52:0/3459203531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 msgr2=0x7fc84c0fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 0x7fc84c0fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 -- 172.21.15.52:0/3459203531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c1a68a0 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009230 tx=0x7fc83c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.608+0000 7fc8437fe640 1 -- 172.21.15.52:0/3459203531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c03f030 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.609+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c1a6b30 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.609+0000 7fc8437fe640 1 -- 172.21.15.52:0/3459203531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc83c003ad0 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.609+0000 7fc8437fe640 1 -- 172.21.15.52:0/3459203531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c035070 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.609+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c1a7060 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc8437fe640 1 -- 172.21.15.52:0/3459203531 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc83c042030 con 0x7fc84c101420 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc856aa9740 1 Processor -- start 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc856aa9740 1 -- start start 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 0x5558f6a6e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.611+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc856aa9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558f69d42f0 con 0x5558f6a79370 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc856aa9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5558f697bcf0 con 0x5558f6a6fb40 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc856aa9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558f69d02b0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:36116/0 (socket says 172.21.15.52:36116) 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 -- 172.21.15.52:0/2022227170 learned_addr learned my addr 172.21.15.52:0/2022227170 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54584/0 (socket says 172.21.15.52:54584) 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc852c6d640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 0x5558f6a6e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 -- 172.21.15.52:0/2022227170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 msgr2=0x5558f6a6e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 0x5558f6a6e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 -- 172.21.15.52:0/2022227170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 msgr2=0x5558f6a7b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 -- 172.21.15.52:0/2022227170 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f69603a0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc852c6d640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 0x5558f6a6e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc851c6b640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc8437fe640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 0x7fc8380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc85246c640 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc84800ac90 tx=0x7fc84800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d432c9d3561a6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 0x7fc8380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.612+0000 7fc8437fe640 1 -- 172.21.15.52:0/3459203531 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc83c0efda0 con 0x7fc84c101420 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc840ff9640 1 -- 172.21.15.52:0/2022227170 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84801d070 con 0x5558f6a6e5d0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc840ff9640 1 -- 172.21.15.52:0/2022227170 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc848018b20 con 0x5558f6a6e5d0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc840ff9640 1 -- 172.21.15.52:0/2022227170 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848010b40 con 0x5558f6a6e5d0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 -- 172.21.15.52:0/2022227170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 msgr2=0x5558f6a6ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 0x7fc8380a5700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc844005fd0 tx=0x7fc844009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc84800ac90 tx=0x7fc84800f790 comp rx=0 tx=0).stop 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 -- 172.21.15.52:0/2022227170 shutdown_connections 2024-09-19T09:27:09.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a7b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ea10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2022227170 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6fb40 0x5558f6a6e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 -- 172.21.15.52:0/2022227170 >> 172.21.15.52:0/2022227170 conn(0x5558f6a37310 msgr2=0x5558f6a6ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 -- 172.21.15.52:0/2022227170 shutdown_connections 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.613+0000 7fc856aa9740 1 -- 172.21.15.52:0/2022227170 wait complete. 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 -- start start 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 Processor -- start 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a78d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a76530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5558f6a7c070 con 0x5558f6a6fb40 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5558f698f060 con 0x5558f6a79370 2024-09-19T09:27:09.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5558f6a7c1f0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc856aa9740 10 client.0 _ll_register_callbacks cb 0x5558f66e28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc851c6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54586/0 (socket says 172.21.15.52:54586) 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc851c6b640 1 -- 172.21.15.52:0/3877857898 learned_addr learned my addr 172.21.15.52:0/3877857898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.614+0000 7fc85246c640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a78d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a76530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 -- 172.21.15.52:0/3877857898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 msgr2=0x5558f6a78d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a78d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 -- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 msgr2=0x5558f6a76530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a76530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 -- 172.21.15.52:0/3877857898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f67453c0 con 0x5558f6a6fb40 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc85246c640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a78d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:09.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a76530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0bc2d0 tx=0x7fc83c005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8aad2a6cb32bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc835ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83c049050 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc83c0b89b0 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc848018b20 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc83c0bc110 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc856aa9740 10 client.17343 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5558f6a87ad0 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.615+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc848018b20 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc83c0edce0 con 0x5558f6a6fb40 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 10 client.17343 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 20 client.17343 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:09.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6a8b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 4 client.17343 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558f69e1860 con 0x5558f6a88ee0 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.616+0000 7fc85246c640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6a8b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc85246c640 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6a8b2d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f5cd71492e85a15 server_cookie=e5bfd56c93adf4aa in_seq=0 out_seq=0 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc835ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc835ffb640 1 -- 172.21.15.52:0/3877857898 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558f69e1860 con 0x5558f6a88ee0 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc835ffb640 10 client.17343 handle_command_reply: tid=0 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc856aa9740 1 client.17343 shutdown 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 msgr2=0x5558f6a75fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.617+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0bc2d0 tx=0x7fc83c005a60 comp rx=0 tx=0).stop 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 shutdown_connections 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6a8b2d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc835ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a76530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6fb40 0x5558f6a75fb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3877857898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6e5d0 0x5558f6a78d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 >> 172.21.15.52:0/3877857898 conn(0x5558f6a37310 msgr2=0x5558f6a70960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 shutdown_connections 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 1 -- 172.21.15.52:0/3877857898 wait complete. 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.618+0000 7fc856aa9740 20 client.17343 trim_cache size 0 max 16384 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 Processor -- start 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 -- start start 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a85340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1b2140 con 0x5558f6a79370 2024-09-19T09:27:09.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1afa10 con 0x5558f6a6e5d0 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc856aa9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1ad860 con 0x5558f6a6fb40 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc852c6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc852c6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54588/0 (socket says 172.21.15.52:54588) 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc852c6d640 1 -- 172.21.15.52:0/3006480803 learned_addr learned my addr 172.21.15.52:0/3006480803 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc85246c640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.631+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a85340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 -- 172.21.15.52:0/3006480803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 msgr2=0x5558f6a85340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a85340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 -- 172.21.15.52:0/3006480803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 msgr2=0x5558f6a6ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 -- 172.21.15.52:0/3006480803 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f6a74500 con 0x5558f6a79370 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc851c6b640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a85340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:09.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc85246c640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc852c6d640 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc844005c00 tx=0x7fc844015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeea8e9936fb1ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc837fff640 1 -- 172.21.15.52:0/3006480803 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84402c070 con 0x5558f6a79370 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc837fff640 1 -- 172.21.15.52:0/3006480803 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc84401cae0 con 0x5558f6a79370 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.632+0000 7fc837fff640 1 -- 172.21.15.52:0/3006480803 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844027c70 con 0x5558f6a79370 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- 172.21.15.52:0/3006480803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 msgr2=0x5558f6a90be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc844005c00 tx=0x7fc844015000 comp rx=0 tx=0).stop 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- 172.21.15.52:0/3006480803 shutdown_connections 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a79370 0x5558f6a90be0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a85340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 --2- 172.21.15.52:0/3006480803 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a6e5d0 0x5558f6a6ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- 172.21.15.52:0/3006480803 >> 172.21.15.52:0/3006480803 conn(0x5558f6a37310 msgr2=0x5558f6a6a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- 172.21.15.52:0/3006480803 shutdown_connections 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- 172.21.15.52:0/3006480803 wait complete. 2024-09-19T09:27:09.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.633+0000 7fc856aa9740 1 -- start start 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 Processor -- start 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a7d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a7dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1aded0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1af340 con 0x5558f6a79370 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c1ae5a0 con 0x5558f6a6fb40 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc856aa9740 10 client.0 _ll_register_callbacks cb 0x7fc83c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54592/0 (socket says 172.21.15.52:54592) 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 -- 172.21.15.52:0/2771038361 learned_addr learned my addr 172.21.15.52:0/2771038361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc852c6d640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a7dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 -- 172.21.15.52:0/2771038361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 msgr2=0x5558f6a7d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc851c6b640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a7d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a7d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 -- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 msgr2=0x5558f6a7dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a7dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc85246c640 1 -- 172.21.15.52:0/2771038361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f6af2cb0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc851c6b640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a7d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.634+0000 7fc852c6d640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a7dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc85246c640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc848010730 tx=0x7fc848010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88eeecd5d87aef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc835ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc848032020 con 0x5558f6a6e5d0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc848010870 con 0x5558f6a6e5d0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc84401cae0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc84803d050 con 0x5558f6a6e5d0 2024-09-19T09:27:09.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc856aa9740 10 client.17349 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5558f6af3f90 con 0x5558f6a6e5d0 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.635+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc84401cae0 con 0x5558f6a6e5d0 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc848018660 con 0x5558f6a6e5d0 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 10 client.17349 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 20 client.17349 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6af63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 4 client.17349 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558f69dbd70 con 0x5558f6a88ee0 2024-09-19T09:27:09.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc851c6b640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6af63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc851c6b640 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6af63e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437234c5f0059d5e server_cookie=e51c14341878302d in_seq=0 out_seq=0 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.636+0000 7fc835ffb640 10 client.17349 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc835ffb640 1 -- 172.21.15.52:0/2771038361 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558f69dbd70 con 0x5558f6a88ee0 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc835ffb640 10 client.17349 handle_command_reply: tid=0 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 client.17349 shutdown 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 msgr2=0x5558f6a7d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fc848010730 tx=0x7fc848010760 comp rx=0 tx=0).stop 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 shutdown_connections 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5558f6a88ee0 0x5558f6af63e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5558f6a79370 0x5558f6a7dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5558f6a6fb40 0x5558f6a7d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 --2- 172.21.15.52:0/2771038361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5558f6a6e5d0 0x5558f6a7d360 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 >> 172.21.15.52:0/2771038361 conn(0x5558f6a37310 msgr2=0x5558f6a77810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc835ffb640 0 client.17349 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 shutdown_connections 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 1 -- 172.21.15.52:0/2771038361 wait complete. 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.637+0000 7fc856aa9740 20 client.17349 trim_cache size 0 max 16384 2024-09-19T09:27:09.655 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 msgr2=0x7fc8380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 0x7fc8380a5700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc844005fd0 tx=0x7fc844009600 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 msgr2=0x7fc84c0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009230 tx=0x7fc83c004270 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 shutdown_connections 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c106a80 0x7fc84c0fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc84c101420 0x7fc84c0fd250 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8380a3240 0x7fc8380a5700 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 --2- 172.21.15.52:0/3459203531 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc84c100a80 0x7fc84c0fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 >> 172.21.15.52:0/3459203531 conn(0x7fc84c0fc7a0 msgr2=0x7fc84c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 shutdown_connections 2024-09-19T09:27:09.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:09.638+0000 7fc8546d0640 1 -- 172.21.15.52:0/3459203531 wait complete. 2024-09-19T09:27:10.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:10 smithi052 ceph-mon[30947]: pgmap v510: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:10.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:10 smithi169 ceph-mon[35454]: pgmap v510: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:10 smithi086 ceph-mon[34813]: pgmap v510: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:27:11.311 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:27:11.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:27:11.584 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 -- 172.21.15.52:0/3311701449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 msgr2=0x7efeec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 --2- 172.21.15.52:0/3311701449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec100ee0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7efedc009930 tx=0x7efedc02a420 comp rx=0 tx=0).stop 2024-09-19T09:27:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 -- 172.21.15.52:0/3311701449 shutdown_connections 2024-09-19T09:27:12.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 --2- 172.21.15.52:0/3311701449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec101420 0x7efeec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 --2- 172.21.15.52:0/3311701449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec100ee0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 --2- 172.21.15.52:0/3311701449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec106a80 0x7efeec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 -- 172.21.15.52:0/3311701449 >> 172.21.15.52:0/3311701449 conn(0x7efeec0fc7a0 msgr2=0x7efeec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 -- 172.21.15.52:0/3311701449 shutdown_connections 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.998+0000 7efef41f8640 1 -- 172.21.15.52:0/3311701449 wait complete. 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.999+0000 7efef41f8640 1 Processor -- start 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:11.999+0000 7efef41f8640 1 -- start start 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 0x7efeec197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec106a80 0x7efeec19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efeec110e80 con 0x7efeec100a80 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efeec110d00 con 0x7efeec101420 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efeec111000 con 0x7efeec106a80 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54614/0 (socket says 172.21.15.52:54614) 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 -- 172.21.15.52:0/2830683101 learned_addr learned my addr 172.21.15.52:0/2830683101 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef2795640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec106a80 0x7efeec19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1793640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 0x7efeec197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 -- 172.21.15.52:0/2830683101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec106a80 msgr2=0x7efeec19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec106a80 0x7efeec19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 -- 172.21.15.52:0/2830683101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 msgr2=0x7efeec197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 0x7efeec197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 -- 172.21.15.52:0/2830683101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec19c2e0 con 0x7efeec100a80 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1793640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 0x7efeec197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef1f94640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7efee800c890 tx=0x7efee800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efee2ffd640 1 -- 172.21.15.52:0/2830683101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8004220 con 0x7efeec100a80 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec19c5d0 con 0x7efeec100a80 2024-09-19T09:27:12.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efee2ffd640 1 -- 172.21.15.52:0/2830683101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efee80043c0 con 0x7efeec100a80 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.000+0000 7efee2ffd640 1 -- 172.21.15.52:0/2830683101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee8004a00 con 0x7efeec100a80 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.001+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1a3eb0 con 0x7efeec100a80 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.003+0000 7efee2ffd640 1 -- 172.21.15.52:0/2830683101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efee80079b0 con 0x7efeec100a80 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.003+0000 7efef65d1740 1 Processor -- start 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.003+0000 7efef65d1740 1 -- start start 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.003+0000 7efef65d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5646a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef65d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5647410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef65d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef65d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645a55ac280 con 0x5645a5655e00 2024-09-19T09:27:12.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef65d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5645a5553b10 con 0x5645a5648200 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef65d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5645a55a8240 con 0x5645a5646fd0 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efee2ffd640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 0x7efed80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54626/0 (socket says 172.21.15.52:54626) 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 -- 172.21.15.52:0/109159148 learned_addr learned my addr 172.21.15.52:0/109159148 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef2795640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 0x7efed80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efee2ffd640 1 -- 172.21.15.52:0/2830683101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efee80cf680 con 0x7efeec100a80 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1f94640 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5647410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 -- 172.21.15.52:0/109159148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 msgr2=0x5645a5647410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5647410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 -- 172.21.15.52:0/109159148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 msgr2=0x5645a5646a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5646a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 -- 172.21.15.52:0/109159148 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a55601f0 con 0x5645a5655e00 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.004+0000 7efef1793640 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7efedc006010 tx=0x7efedc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e119bb043c26d430 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef2795640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 0x7efed80a5700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efee4005fd0 tx=0x7efee4009b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efed7fff640 1 -- 172.21.15.52:0/109159148 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc03f070 con 0x5645a5655e00 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efed7fff640 1 -- 172.21.15.52:0/109159148 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efedc0317b0 con 0x5645a5655e00 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efed7fff640 1 -- 172.21.15.52:0/109159148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc035070 con 0x5645a5655e00 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 -- 172.21.15.52:0/109159148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 msgr2=0x5645a56581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7efedc006010 tx=0x7efedc009680 comp rx=0 tx=0).stop 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 -- 172.21.15.52:0/109159148 shutdown_connections 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a56581f0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5647410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 --2- 172.21.15.52:0/109159148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5646a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.005+0000 7efef65d1740 1 -- 172.21.15.52:0/109159148 >> 172.21.15.52:0/109159148 conn(0x5645a56430f0 msgr2=0x5645a56434d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- 172.21.15.52:0/109159148 shutdown_connections 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- 172.21.15.52:0/109159148 wait complete. 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- start start 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 Processor -- start 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5652da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a56532e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5645a5658c90 con 0x5645a5655e00 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5645a5566f10 con 0x5645a5648200 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5645a5658e10 con 0x5645a5646fd0 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef65d1740 10 client.0 _ll_register_callbacks cb 0x5645a552fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.006+0000 7efef2795640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54632/0 (socket says 172.21.15.52:54632) 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 -- 172.21.15.52:0/3567922512 learned_addr learned my addr 172.21.15.52:0/3567922512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef1793640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a56532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef1f94640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5652da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 -- 172.21.15.52:0/3567922512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 msgr2=0x5645a5652da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5652da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 -- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 msgr2=0x5645a56532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a56532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 -- 172.21.15.52:0/3567922512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a531d6a0 con 0x5645a5655e00 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef2795640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7efee4005040 tx=0x7efee4009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d813d37d1af78743 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efed57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee401d990 con 0x5645a5655e00 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efedc0317b0 con 0x5645a5655e00 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efee401db30 con 0x5645a5655e00 2024-09-19T09:27:12.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efee402b030 con 0x5645a5655e00 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef65d1740 10 client.17361 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.007+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5645a56649f0 con 0x5645a5655e00 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efedc0317b0 con 0x5645a5655e00 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efee4019030 con 0x5645a5655e00 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 10 client.17361 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 20 client.17361 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a5665eb0 0x5645a56682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 4 client.17361 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645a55b97f0 con 0x5645a5665eb0 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef1f94640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a5665eb0 0x5645a56682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efed57fa640 10 client.17361 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:12.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.008+0000 7efef1f94640 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a5665eb0 0x5645a56682e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51dbf9e4ba77c5c3 server_cookie=c49c196ab6243272 in_seq=0 out_seq=0 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efed57fa640 1 -- 172.21.15.52:0/3567922512 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645a55b97f0 con 0x5645a5665eb0 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efed57fa640 10 client.17361 handle_command_reply: tid=0 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 client.17361 shutdown 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 msgr2=0x5645a5653820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7efee4005040 tx=0x7efee4009600 comp rx=0 tx=0).stop 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 shutdown_connections 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a5665eb0 0x5645a56682e0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.009+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5653820 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a56532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 1 --2- 172.21.15.52:0/3567922512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5652da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 >> 172.21.15.52:0/3567922512 conn(0x5645a56430f0 msgr2=0x5645a5648e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efed57fa640 0 client.17361 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:12.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 shutdown_connections 2024-09-19T09:27:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 1 -- 172.21.15.52:0/3567922512 wait complete. 2024-09-19T09:27:12.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.010+0000 7efef65d1740 20 client.17361 trim_cache size 0 max 16384 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.027+0000 7efef65d1740 1 Processor -- start 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.027+0000 7efef65d1740 1 -- start start 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5651670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5651bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1adf20 con 0x5645a5655e00 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1ab7f0 con 0x5645a5648200 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef65d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1a9640 con 0x5645a5646fd0 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54640/0 (socket says 172.21.15.52:54640) 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 -- 172.21.15.52:0/1959777427 learned_addr learned my addr 172.21.15.52:0/1959777427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:12.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef1793640 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5651bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 -- 172.21.15.52:0/1959777427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 msgr2=0x5645a5651670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5651670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 -- 172.21.15.52:0/1959777427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 msgr2=0x5645a5651bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5651bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 -- 172.21.15.52:0/1959777427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645a5646d40 con 0x5645a5655e00 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef1793640 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5651bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efef2795640 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7efee4009d50 tx=0x7efee4009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815636ec8109362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.028+0000 7efed77fe640 1 -- 172.21.15.52:0/1959777427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee40058d0 con 0x5645a5655e00 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efed77fe640 1 -- 172.21.15.52:0/1959777427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efee4021070 con 0x5645a5655e00 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efed77fe640 1 -- 172.21.15.52:0/1959777427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee401d9f0 con 0x5645a5655e00 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 -- 172.21.15.52:0/1959777427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 msgr2=0x5645a5657a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7efee4009d50 tx=0x7efee4009670 comp rx=0 tx=0).stop 2024-09-19T09:27:12.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 -- 172.21.15.52:0/1959777427 shutdown_connections 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5655e00 0x5645a5657a50 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5648200 0x5645a5651bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 --2- 172.21.15.52:0/1959777427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5646fd0 0x5645a5651670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 -- 172.21.15.52:0/1959777427 >> 172.21.15.52:0/1959777427 conn(0x5645a56430f0 msgr2=0x5645a564acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 -- 172.21.15.52:0/1959777427 shutdown_connections 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.029+0000 7efef65d1740 1 -- 172.21.15.52:0/1959777427 wait complete. 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 -- start start 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 Processor -- start 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5646fd0 0x5645a5660fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5655e00 0x5645a5661a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1a9cb0 con 0x5645a5648200 2024-09-19T09:27:12.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1ab120 con 0x5645a5646fd0 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1aa380 con 0x5645a5655e00 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef65d1740 10 client.0 _ll_register_callbacks cb 0x7efee4009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef1793640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef1793640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54650/0 (socket says 172.21.15.52:54650) 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef1793640 1 -- 172.21.15.52:0/3918746151 learned_addr learned my addr 172.21.15.52:0/3918746151 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.030+0000 7efef1f94640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5646fd0 0x5645a5660fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef2795640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5655e00 0x5645a5661a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 -- 172.21.15.52:0/3918746151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5655e00 msgr2=0x5645a5661a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5655e00 0x5645a5661a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 -- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5646fd0 msgr2=0x5645a5660fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5646fd0 0x5645a5660fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 -- 172.21.15.52:0/3918746151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645a56cfbb0 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef1793640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efedc004650 tx=0x7efedc005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f947fce7e9073e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efed57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc052060 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efedc0317c0 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efee4021070 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efedc035040 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef65d1740 10 client.17367 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.031+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5645a56d0e50 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efee4021070 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efedc04c070 con 0x5645a5648200 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 10 client.17367 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:12.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 20 client.17367 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a56d11e0 0x5645a56d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 4 client.17367 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5645a55b3d00 con 0x5645a56d11e0 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.032+0000 7efef1f94640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a56d11e0 0x5645a56d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.033+0000 7efef1f94640 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a56d11e0 0x5645a56d35d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f80073556b29e7bd server_cookie=1cac2d42e4eebd6e in_seq=0 out_seq=0 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.033+0000 7efed57fa640 10 client.17367 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efed57fa640 1 -- 172.21.15.52:0/3918746151 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5645a55b3d00 con 0x5645a56d11e0 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efed57fa640 10 client.17367 handle_command_reply: tid=0 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 client.17367 shutdown 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 msgr2=0x5645a5661500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efedc004650 tx=0x7efedc005360 comp rx=0 tx=0).stop 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 shutdown_connections 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5645a56d11e0 0x5645a56d35d0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5645a5655e00 0x5645a5661a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5645a5648200 0x5645a5661500 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 --2- 172.21.15.52:0/3918746151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5645a5646fd0 0x5645a5660fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 >> 172.21.15.52:0/3918746151 conn(0x5645a56430f0 msgr2=0x5645a5651630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efed57fa640 0 client.17367 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 shutdown_connections 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 1 -- 172.21.15.52:0/3918746151 wait complete. 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.034+0000 7efef65d1740 20 client.17367 trim_cache size 0 max 16384 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:12.044 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:27:12.045 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "327eb359-d50f-4d16-a6b8-8bf992674de5", 2024-09-19T09:27:12.045 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:27:12.045 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 msgr2=0x7efed80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 0x7efed80a5700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efee4005fd0 tx=0x7efee4009b50 comp rx=0 tx=0).stop 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 msgr2=0x7efeec197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7efee800c890 tx=0x7efee800cd50 comp rx=0 tx=0).stop 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 shutdown_connections 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efed80a3240 0x7efed80a5700 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efeec106a80 0x7efeec19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efeec101420 0x7efeec197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 --2- 172.21.15.52:0/2830683101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efeec100a80 0x7efeec197330 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:12.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 >> 172.21.15.52:0/2830683101 conn(0x7efeec0fc7a0 msgr2=0x7efeec0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:12.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 shutdown_connections 2024-09-19T09:27:12.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:12.035+0000 7efef41f8640 1 -- 172.21.15.52:0/2830683101 wait complete. 2024-09-19T09:27:12.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:12.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:12 smithi052 ceph-mon[30947]: pgmap v511: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:12 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:27:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:12 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:27:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:12.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:12 smithi169 ceph-mon[35454]: pgmap v511: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:12.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:12 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:27:12.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:12.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:12 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:27:12.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:12.956 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:12 smithi086 ceph-mon[34813]: pgmap v511: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:12 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:27:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:12 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:27:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 -- 172.21.15.52:0/3508383360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 msgr2=0x7f1b3c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/3508383360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1021d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009ca0 tx=0x7f1b2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 -- 172.21.15.52:0/3508383360 shutdown_connections 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/3508383360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/3508383360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/3508383360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1021d0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 -- 172.21.15.52:0/3508383360 >> 172.21.15.52:0/3508383360 conn(0x7f1b3c0fd8b0 msgr2=0x7f1b3c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 -- 172.21.15.52:0/3508383360 shutdown_connections 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.413+0000 7f1b43e5e640 1 -- 172.21.15.52:0/3508383360 wait complete. 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 Processor -- start 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 -- start start 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c111fa0 con 0x7f1b3c101df0 2024-09-19T09:27:13.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c111e20 con 0x7f1b3c106f20 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b43e5e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c112120 con 0x7f1b3c1027a0 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54660/0 (socket says 172.21.15.52:54660) 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 -- 172.21.15.52:0/202017998 learned_addr learned my addr 172.21.15.52:0/202017998 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b423fb640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 -- 172.21.15.52:0/202017998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 msgr2=0x7f1b3c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b413f9640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 -- 172.21.15.52:0/202017998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 msgr2=0x7f1b3c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b41bfa640 1 -- 172.21.15.52:0/202017998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3c19d470 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.414+0000 7f1b423fb640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b413f9640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c02ade0 tx=0x7f1b2c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b32ffd640 1 -- 172.21.15.52:0/202017998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c02fa20 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b32ffd640 1 -- 172.21.15.52:0/202017998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c02fbc0 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3c19d700 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b32ffd640 1 -- 172.21.15.52:0/202017998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0466e0 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.415+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3c1a5040 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.417+0000 7f1b32ffd640 1 -- 172.21.15.52:0/202017998 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1b2c046940 con 0x7f1b3c101df0 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 Processor -- start 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 -- start start 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b32ffd640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 0x7f1b240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e43550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e45e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d60d9a2e0 con 0x562d60e343a0 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d60d41ce0 con 0x562d60e43a90 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b46237740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562d60d962a0 con 0x562d60e34cc0 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b423fb640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 0x7f1b240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b32ffd640 1 -- 172.21.15.52:0/202017998 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1b2c0f0ee0 con 0x7f1b3c101df0 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54674/0 (socket says 172.21.15.52:54674) 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b41bfa640 1 -- 172.21.15.52:0/1172540179 learned_addr learned my addr 172.21.15.52:0/1172540179 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:13.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b413f9640 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e43550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.418+0000 7f1b423fb640 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e45e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 -- 172.21.15.52:0/1172540179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 msgr2=0x562d60e43550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e43550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 -- 172.21.15.52:0/1172540179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 msgr2=0x562d60e45e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e45e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 -- 172.21.15.52:0/1172540179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d60d26440 con 0x562d60e343a0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b423fb640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 0x7f1b240a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1b34013400 tx=0x7f1b34013800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c005e30 tx=0x7f1b2c041c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29da2d8b3e5ff968 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b23fff640 1 -- 172.21.15.52:0/1172540179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0d0320 con 0x562d60e343a0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b23fff640 1 -- 172.21.15.52:0/1172540179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c036070 con 0x562d60e343a0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.419+0000 7f1b23fff640 1 -- 172.21.15.52:0/1172540179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0cff60 con 0x562d60e343a0 2024-09-19T09:27:13.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- 172.21.15.52:0/1172540179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 msgr2=0x562d60e34780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c005e30 tx=0x7f1b2c041c00 comp rx=0 tx=0).stop 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- 172.21.15.52:0/1172540179 shutdown_connections 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e45e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e43550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 --2- 172.21.15.52:0/1172540179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e34780 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- 172.21.15.52:0/1172540179 >> 172.21.15.52:0/1172540179 conn(0x562d60e30a30 msgr2=0x562d60e30e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- 172.21.15.52:0/1172540179 shutdown_connections 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- 172.21.15.52:0/1172540179 wait complete. 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 -- start start 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.420+0000 7f1b46237740 1 Processor -- start 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e40d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d60d9a2e0 con 0x562d60e343a0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d60d55050 con 0x562d60e43a90 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562d60e46480 con 0x562d60e34cc0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 10 client.0 _ll_register_callbacks cb 0x562d60d95160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54686/0 (socket says 172.21.15.52:54686) 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 -- 172.21.15.52:0/2638626677 learned_addr learned my addr 172.21.15.52:0/2638626677 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b423fb640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e40d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 -- 172.21.15.52:0/2638626677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 msgr2=0x562d60e40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e40720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 -- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 msgr2=0x562d60e40d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e40d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 -- 172.21.15.52:0/2638626677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d60b0b3c0 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b423fb640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e40d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0bcec0 tx=0x7f1b2c0d0360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8971b72af175b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0d0140 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1b2c0bb720 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.421+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b2c036070 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b2c0453e0 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 10 client.17379 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d60e51c60 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c036070 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1b2c04e030 con 0x562d60e343a0 2024-09-19T09:27:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 10 client.17379 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 20 client.17379 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60e53070 0x562d60e554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 4 client.17379 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d60da7850 con 0x562d60e53070 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.422+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60e53070 0x562d60e554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.423+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60e53070 0x562d60e554a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c0120fa8c361310 server_cookie=7d467f074963576a in_seq=0 out_seq=0 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.423+0000 7f1b217fa640 10 client.17379 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b217fa640 1 -- 172.21.15.52:0/2638626677 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d60da7850 con 0x562d60e53070 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b217fa640 10 client.17379 handle_command_reply: tid=0 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 client.17379 shutdown 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 msgr2=0x562d60e43420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0bcec0 tx=0x7f1b2c0d0360 comp rx=0 tx=0).stop 2024-09-19T09:27:13.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 shutdown_connections 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60e53070 0x562d60e554a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e43a90 0x562d60e40d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b217fa640 0 client.17379 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e34cc0 0x562d60e40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 --2- 172.21.15.52:0/2638626677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e343a0 0x562d60e43420 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 >> 172.21.15.52:0/2638626677 conn(0x562d60e30a30 msgr2=0x562d60e36790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 shutdown_connections 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 1 -- 172.21.15.52:0/2638626677 wait complete. 2024-09-19T09:27:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.424+0000 7f1b46237740 20 client.17379 trim_cache size 0 max 16384 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 Processor -- start 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 -- start start 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 0x562d60e4f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 0x562d60e5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1ade60 con 0x562d60e34cc0 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1ab730 con 0x562d60e343a0 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b46237740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1a9580 con 0x562d60e43a90 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54696/0 (socket says 172.21.15.52:54696) 2024-09-19T09:27:13.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 -- 172.21.15.52:0/2347017174 learned_addr learned my addr 172.21.15.52:0/2347017174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b423fb640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 0x562d60e5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 0x562d60e4f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 -- 172.21.15.52:0/2347017174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 msgr2=0x562d60e5b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 0x562d60e5b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 -- 172.21.15.52:0/2347017174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 msgr2=0x562d60e4f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 0x562d60e4f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 -- 172.21.15.52:0/2347017174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d60e34af0 con 0x562d60e34cc0 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b423fb640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 0x562d60e5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 0x562d60e4f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:13.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.442+0000 7f1b413f9640 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800aa40 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a988f11d14fa4479 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b237fe640 1 -- 172.21.15.52:0/2347017174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38020070 con 0x562d60e34cc0 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b237fe640 1 -- 172.21.15.52:0/2347017174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b3801c930 con 0x562d60e34cc0 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b237fe640 1 -- 172.21.15.52:0/2347017174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38014b30 con 0x562d60e34cc0 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 -- 172.21.15.52:0/2347017174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 msgr2=0x562d60e5ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800aa40 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 -- 172.21.15.52:0/2347017174 shutdown_connections 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e43a90 0x562d60e5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e34cc0 0x562d60e5ad20 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 --2- 172.21.15.52:0/2347017174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e343a0 0x562d60e4f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.443+0000 7f1b46237740 1 -- 172.21.15.52:0/2347017174 >> 172.21.15.52:0/2347017174 conn(0x562d60e30a30 msgr2=0x562d60e3bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- 172.21.15.52:0/2347017174 shutdown_connections 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- 172.21.15.52:0/2347017174 wait complete. 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- start start 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 Processor -- start 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 0x562d60e4baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 0x562d60e46e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1a9bf0 con 0x562d60e43a90 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1ab060 con 0x562d60e34cc0 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3c1aa2c0 con 0x562d60e343a0 2024-09-19T09:27:13.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b46237740 10 client.0 _ll_register_callbacks cb 0x7f1b3800a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b423fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b423fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54710/0 (socket says 172.21.15.52:54710) 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.444+0000 7f1b423fb640 1 -- 172.21.15.52:0/4155649465 learned_addr learned my addr 172.21.15.52:0/4155649465 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 0x562d60e4baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b413f9640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 0x562d60e46e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 -- 172.21.15.52:0/4155649465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 msgr2=0x562d60e4baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 0x562d60e4baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 -- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 msgr2=0x562d60e46e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 0x562d60e46e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 -- 172.21.15.52:0/4155649465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d60e478d0 con 0x562d60e43a90 2024-09-19T09:27:13.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 0x562d60e4baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b413f9640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 0x562d60e46e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b423fb640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400fc40 tx=0x7f1b34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df04cdbbecae2198 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b217fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b34010950 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1b34010af0 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b3801c930 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b34010cf0 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b46237740 10 client.17385 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.445+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d60ebd9d0 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b3801c930 con 0x562d60e43a90 2024-09-19T09:27:13.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1b3401f070 con 0x562d60e43a90 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 10 client.17385 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 20 client.17385 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60ebe120 0x562d60ec0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 4 client.17385 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d60da1d60 con 0x562d60ebe120 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.446+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60ebe120 0x562d60ec0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b41bfa640 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60ebe120 0x562d60ec0540 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaab13ece0a9cc5b server_cookie=3ceb0ab5626cbac0 in_seq=0 out_seq=0 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b217fa640 10 client.17385 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b217fa640 1 -- 172.21.15.52:0/4155649465 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562d60da1d60 con 0x562d60ebe120 2024-09-19T09:27:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b217fa640 10 client.17385 handle_command_reply: tid=0 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 client.17385 shutdown 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 msgr2=0x562d60e47360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400fc40 tx=0x7f1b34004730 comp rx=0 tx=0).stop 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 shutdown_connections 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562d60ebe120 0x562d60ec0540 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d60e43a90 0x562d60e47360 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d60e34cc0 0x562d60e46e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b217fa640 0 client.17385 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 --2- 172.21.15.52:0/4155649465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d60e343a0 0x562d60e4baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 >> 172.21.15.52:0/4155649465 conn(0x562d60e30a30 msgr2=0x562d60e35f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 shutdown_connections 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 1 -- 172.21.15.52:0/4155649465 wait complete. 2024-09-19T09:27:13.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.447+0000 7f1b46237740 20 client.17385 trim_cache size 0 max 16384 2024-09-19T09:27:13.464 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:13.464 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:27:13.464 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:27:13.464 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 msgr2=0x7f1b240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 0x7f1b240a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1b34013400 tx=0x7f1b34013800 comp rx=0 tx=0).stop 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 msgr2=0x7f1b3c1984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c02ade0 tx=0x7f1b2c0319f0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 shutdown_connections 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b3c106f20 0x7f1b3c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1b240a3240 0x7f1b240a5700 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c1027a0 0x7f1b3c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 --2- 172.21.15.52:0/202017998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b3c101df0 0x7f1b3c1984c0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 >> 172.21.15.52:0/202017998 conn(0x7f1b3c0fd8b0 msgr2=0x7f1b3c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 shutdown_connections 2024-09-19T09:27:13.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:13.448+0000 7f1b43e5e640 1 -- 172.21.15.52:0/202017998 wait complete. 2024-09-19T09:27:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:13 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:27:13.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:13 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:27:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:13 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:27:14.213 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:27:14.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:27:14.469 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:14.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:14 smithi169 ceph-mon[35454]: pgmap v512: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:27:14.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 -- 172.21.15.52:0/1320476608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 msgr2=0x7f6e5c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:14.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 --2- 172.21.15.52:0/1320476608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c1021c0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009900 tx=0x7f6e4c02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 -- 172.21.15.52:0/1320476608 shutdown_connections 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 --2- 172.21.15.52:0/1320476608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 --2- 172.21.15.52:0/1320476608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 --2- 172.21.15.52:0/1320476608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c1021c0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 -- 172.21.15.52:0/1320476608 >> 172.21.15.52:0/1320476608 conn(0x7f6e5c0fd8c0 msgr2=0x7f6e5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 -- 172.21.15.52:0/1320476608 shutdown_connections 2024-09-19T09:27:14.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.996+0000 7f6e625fe640 1 -- 172.21.15.52:0/1320476608 wait complete. 2024-09-19T09:27:14.998 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:14 smithi052 ceph-mon[30947]: pgmap v512: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:27:15.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 Processor -- start 2024-09-19T09:27:15.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 -- start start 2024-09-19T09:27:15.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c112010 con 0x7f6e5c101de0 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c111e90 con 0x7f6e5c102790 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e625fe640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e5c112190 con 0x7f6e5c106f10 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54718/0 (socket says 172.21.15.52:54718) 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e5bfff640 1 -- 172.21.15.52:0/2181790564 learned_addr learned my addr 172.21.15.52:0/2181790564 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.997+0000 7f6e5b7fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 -- 172.21.15.52:0/2181790564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 msgr2=0x7f6e5c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e60b9b640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 -- 172.21.15.52:0/2181790564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 msgr2=0x7f6e5c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 -- 172.21.15.52:0/2181790564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e5c1a6a70 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5b7fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e60b9b640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e5bfff640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005ab0 tx=0x7f6e4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c03f030 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e5c1a6d00 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e4c003ce0 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c035070 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.998+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e5c1a71d0 con 0x7f6e5c101de0 2024-09-19T09:27:15.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:14.999+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c102240 con 0x7f6e5c101de0 2024-09-19T09:27:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.000+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e4c042030 con 0x7f6e5c101de0 2024-09-19T09:27:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.001+0000 7f6e597fa640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 0x7f6e440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.001+0000 7f6e5b7fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 0x7f6e440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.001+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e4c0f0350 con 0x7f6e5c101de0 2024-09-19T09:27:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.002+0000 7f6e5b7fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 0x7f6e440a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.005+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e4c0bcf90 con 0x7f6e5c101de0 2024-09-19T09:27:15.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:14 smithi086 ceph-mon[34813]: pgmap v512: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:27:15.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.217+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5c10a0f0 con 0x7f6e5c101de0 2024-09-19T09:27:15.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.217+0000 7f6e597fa640 1 -- 172.21.15.52:0/2181790564 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f6e4c0bc890 con 0x7f6e5c101de0 2024-09-19T09:27:15.219 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:27:15.219 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:27:15.219 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:27:15.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 msgr2=0x7f6e440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 0x7f6e440a5700 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e50006fd0 tx=0x7f6e50008040 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 msgr2=0x7f6e5c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c005ab0 tx=0x7f6e4c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 shutdown_connections 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e440a3240 0x7f6e440a5700 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.219+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e5c106f10 0x7f6e5c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.220+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e5c102790 0x7f6e5c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.220+0000 7f6e625fe640 1 --2- 172.21.15.52:0/2181790564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e5c101de0 0x7f6e5c0744f0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.220+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 >> 172.21.15.52:0/2181790564 conn(0x7f6e5c0fd8c0 msgr2=0x7f6e5c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.220+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 shutdown_connections 2024-09-19T09:27:15.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:15.220+0000 7f6e625fe640 1 -- 172.21.15.52:0/2181790564 wait complete. 2024-09-19T09:27:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 -- 172.21.15.52:0/223147468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 msgr2=0x7fc9ac100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 --2- 172.21.15.52:0/223147468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac100e40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009900 tx=0x7fc99c02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 -- 172.21.15.52:0/223147468 shutdown_connections 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 --2- 172.21.15.52:0/223147468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 --2- 172.21.15.52:0/223147468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 0x7fc9ac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 --2- 172.21.15.52:0/223147468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac100e40 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 -- 172.21.15.52:0/223147468 >> 172.21.15.52:0/223147468 conn(0x7fc9ac0fc1e0 msgr2=0x7fc9ac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 -- 172.21.15.52:0/223147468 shutdown_connections 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.579+0000 7fc9b236f640 1 -- 172.21.15.52:0/223147468 wait complete. 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 Processor -- start 2024-09-19T09:27:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 -- start start 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 0x7fc9ac1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10c720 con 0x7fc9ac100a40 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10c5a0 con 0x7fc9ac101c30 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b236f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac10c8a0 con 0x7fc9ac1025f0 2024-09-19T09:27:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54742/0 (socket says 172.21.15.52:54742) 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9abfff640 1 -- 172.21.15.52:0/1978936106 learned_addr learned my addr 172.21.15.52:0/1978936106 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 0x7fc9ac1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.580+0000 7fc9b090c640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 -- 172.21.15.52:0/1978936106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 msgr2=0x7fc9ac19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 -- 172.21.15.52:0/1978936106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 msgr2=0x7fc9ac1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 0x7fc9ac1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 -- 172.21.15.52:0/1978936106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac19fa90 con 0x7fc9ac100a40 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9b090c640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc99c031610 tx=0x7fc99c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9a97fa640 1 -- 172.21.15.52:0/1978936106 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c03f030 con 0x7fc9ac100a40 2024-09-19T09:27:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac19fd20 con 0x7fc9ac100a40 2024-09-19T09:27:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9a97fa640 1 -- 172.21.15.52:0/1978936106 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99c003ce0 con 0x7fc9ac100a40 2024-09-19T09:27:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9a97fa640 1 -- 172.21.15.52:0/1978936106 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c035070 con 0x7fc9ac100a40 2024-09-19T09:27:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.581+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1a01b0 con 0x7fc9ac100a40 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.584+0000 7fc9a97fa640 1 -- 172.21.15.52:0/1978936106 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc99c042030 con 0x7fc9ac100a40 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.584+0000 7fc9a97fa640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 0x7fc9940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.584+0000 7fc9a97fa640 1 -- 172.21.15.52:0/1978936106 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc99c0eff30 con 0x7fc9ac100a40 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.584+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 0x7fc9940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 Processor -- start 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 -- start start 2024-09-19T09:27:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 0x7fc9940a57b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac199380 tx=0x7fc9a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669cf2e0 0x55d2669d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d2669322f0 con 0x55d2669d4370 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d2668da270 con 0x55d2669cf2e0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d26692e2b0 con 0x55d2669ce9a0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54754/0 (socket says 172.21.15.52:54754) 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 -- 172.21.15.52:0/389291158 learned_addr learned my addr 172.21.15.52:0/389291158 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9abfff640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669cf2e0 0x55d2669d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 -- 172.21.15.52:0/389291158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 msgr2=0x55d2669ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 -- 172.21.15.52:0/389291158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669cf2e0 msgr2=0x55d2669d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.585+0000 7fc9b090c640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669cf2e0 0x55d2669d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9b090c640 1 -- 172.21.15.52:0/389291158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2668d9340 con 0x55d2669d4370 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9abfff640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9b090c640 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c450 tx=0x7fc9a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651edfed8784f31f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9927fc640 1 -- 172.21.15.52:0/389291158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4007430 con 0x55d2669d4370 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9927fc640 1 -- 172.21.15.52:0/389291158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a4007ab0 con 0x55d2669d4370 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.586+0000 7fc9927fc640 1 -- 172.21.15.52:0/389291158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a400ab00 con 0x55d2669d4370 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- 172.21.15.52:0/389291158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 msgr2=0x55d2669d6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400c450 tx=0x7fc9a400c910 comp rx=0 tx=0).stop 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- 172.21.15.52:0/389291158 shutdown_connections 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669d6830 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669cf2e0 0x55d2669d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/389291158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- 172.21.15.52:0/389291158 >> 172.21.15.52:0/389291158 conn(0x55d2669ca010 msgr2=0x55d2669ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- 172.21.15.52:0/389291158 shutdown_connections 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- 172.21.15.52:0/389291158 wait complete. 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 -- start start 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.587+0000 7fc9b51e1740 1 Processor -- start 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 0x55d2669d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669cf2e0 0x55d2669d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d2669d7340 con 0x55d2669d4370 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d2668bb290 con 0x55d2669ce9a0 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d2669d74c0 con 0x55d2669cf2e0 2024-09-19T09:27:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54760/0 (socket says 172.21.15.52:54760) 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 -- 172.21.15.52:0/2769809551 learned_addr learned my addr 172.21.15.52:0/2769809551 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b51e1740 10 client.0 _ll_register_callbacks cb 0x55d2668ec140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669cf2e0 0x55d2669d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9abfff640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 0x55d2669d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 -- 172.21.15.52:0/2769809551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669cf2e0 msgr2=0x55d2669d90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669cf2e0 0x55d2669d90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 -- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 msgr2=0x55d2669d8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 0x55d2669d8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 -- 172.21.15.52:0/2769809551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d266645210 con 0x55d2669d4370 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9abfff640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 0x55d2669d8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc9b090c640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4004b90 tx=0x7fc9a40076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0d62544130bad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.588+0000 7fc98b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a40078d0 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc9a4012040 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a4007ab0 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9a4009c30 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 10 client.17403 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d266711620 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a4007ab0 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9a4016a20 con 0x55d2669d4370 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 10 client.17403 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 10 client.17403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 20 client.17403 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d2669e44a0 0x55d2669e6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 4 client.17403 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.589+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d26693fa20 con 0x55d2669e44a0 2024-09-19T09:27:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.590+0000 7fc9abfff640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d2669e44a0 0x55d2669e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.590+0000 7fc9abfff640 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d2669e44a0 0x55d2669e6890 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a17f3f8ccca2cc server_cookie=1b66ed2d171f356a in_seq=0 out_seq=0 2024-09-19T09:27:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.590+0000 7fc98b7fe640 10 client.17403 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc98b7fe640 1 -- 172.21.15.52:0/2769809551 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d26693fa20 con 0x55d2669e44a0 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc98b7fe640 10 client.17403 handle_command_reply: tid=0 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 client.17403 shutdown 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 msgr2=0x55d2669e00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4004b90 tx=0x7fc9a40076e0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 shutdown_connections 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d2669e44a0 0x55d2669e6890 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669d4370 0x55d2669e00e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc98b7fe640 0 client.17403 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669cf2e0 0x55d2669d90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/2769809551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669ce9a0 0x55d2669d8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 >> 172.21.15.52:0/2769809551 conn(0x55d2669ca010 msgr2=0x55d2669cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 shutdown_connections 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 1 -- 172.21.15.52:0/2769809551 wait complete. 2024-09-19T09:27:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.591+0000 7fc9b51e1740 20 client.17403 trim_cache size 0 max 16384 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 Processor -- start 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 -- start start 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1abbd0 con 0x55d2669cf2e0 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1a94a0 con 0x55d2669d4370 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1a72f0 con 0x55d2669ce9a0 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54768/0 (socket says 172.21.15.52:54768) 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/538812203 learned_addr learned my addr 172.21.15.52:0/538812203 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.606+0000 7fc9b090c640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9abfff640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/538812203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 msgr2=0x55d2669cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/538812203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 msgr2=0x55d2669cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/538812203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2669d6ba0 con 0x55d2669cf2e0 2024-09-19T09:27:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9b090c640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0011470 tx=0x7fc9a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf59503ea3e492be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc991ffb640 1 -- 172.21.15.52:0/538812203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0005020 con 0x55d2669cf2e0 2024-09-19T09:27:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc991ffb640 1 -- 172.21.15.52:0/538812203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a00047a0 con 0x55d2669cf2e0 2024-09-19T09:27:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.607+0000 7fc991ffb640 1 -- 172.21.15.52:0/538812203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00297c0 con 0x55d2669cf2e0 2024-09-19T09:27:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- 172.21.15.52:0/538812203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 msgr2=0x55d2669e00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0011470 tx=0x7fc9a0013000 comp rx=0 tx=0).stop 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- 172.21.15.52:0/538812203 shutdown_connections 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669e00a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/538812203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- 172.21.15.52:0/538812203 >> 172.21.15.52:0/538812203 conn(0x55d2669ca010 msgr2=0x55d2669c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- 172.21.15.52:0/538812203 shutdown_connections 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- 172.21.15.52:0/538812203 wait complete. 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.608+0000 7fc9b51e1740 1 -- start start 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 Processor -- start 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ddd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1a7960 con 0x55d2669cf2e0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1a8dd0 con 0x55d2669d4370 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac1a8030 con 0x55d2669ce9a0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b51e1740 10 client.0 _ll_register_callbacks cb 0x7fc9a4009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54784/0 (socket says 172.21.15.52:54784) 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/1014479951 learned_addr learned my addr 172.21.15.52:0/1014479951 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.609+0000 7fc9b090c640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/1014479951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 msgr2=0x55d2669ddd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ddd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 msgr2=0x55d2669df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 -- 172.21.15.52:0/1014479951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2669df8b0 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9ab7fe640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005890 tx=0x7fc9a0004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1bd3dd677865b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00051b0 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc9a0025040 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9a00047a0 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc9a0005350 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9b51e1740 10 client.17409 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d266a4f5f0 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9a00047a0 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc9a003e480 con 0x55d2669cf2e0 2024-09-19T09:27:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9b51e1740 10 client.17409 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.610+0000 7fc9b51e1740 10 client.17409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9b51e1740 20 client.17409 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d266a4ff80 0x55d266a523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9b51e1740 4 client.17409 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d266939d70 con 0x55d266a4ff80 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d266a4ff80 0x55d266a523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc9abfff640 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d266a4ff80 0x55d266a523a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8581c42bfee78d35 server_cookie=23078086f6f0e35 in_seq=0 out_seq=0 2024-09-19T09:27:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.611+0000 7fc98b7fe640 10 client.17409 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc98b7fe640 1 -- 172.21.15.52:0/1014479951 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d266939d70 con 0x55d266a4ff80 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc98b7fe640 10 client.17409 handle_command_reply: tid=0 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 client.17409 shutdown 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 msgr2=0x55d2669de290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0005890 tx=0x7fc9a0004b80 comp rx=0 tx=0).stop 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 shutdown_connections 2024-09-19T09:27:15.624 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d266a4ff80 0x55d266a523a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d2669d4370 0x55d2669df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d2669cf2e0 0x55d2669de290 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc98b7fe640 0 client.17409 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 --2- 172.21.15.52:0/1014479951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d2669ce9a0 0x55d2669ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 >> 172.21.15.52:0/1014479951 conn(0x55d2669ca010 msgr2=0x55d2669c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 shutdown_connections 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 1 -- 172.21.15.52:0/1014479951 wait complete. 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.623+0000 7fc9b51e1740 20 client.17409 trim_cache size 0 max 16384 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:27:15.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:27:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:27:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:27:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 msgr2=0x7fc9940a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 0x7fc9940a57b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac199380 tx=0x7fc9a000b390 comp rx=0 tx=0).stop 2024-09-19T09:27:15.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 msgr2=0x7fc9ac197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc99c031610 tx=0x7fc99c0043b0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 shutdown_connections 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9940a32f0 0x7fc9940a57b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9ac1025f0 0x7fc9ac19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9ac101c30 0x7fc9ac1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 --2- 172.21.15.52:0/1978936106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9ac100a40 0x7fc9ac197e70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 >> 172.21.15.52:0/1978936106 conn(0x7fc9ac0fc1e0 msgr2=0x7fc9ac0fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 shutdown_connections 2024-09-19T09:27:15.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:15.624+0000 7fc9b236f640 1 -- 172.21.15.52:0/1978936106 wait complete. 2024-09-19T09:27:15.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:15 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2181790564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:15.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:15 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2181790564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:15.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:27:16.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:15 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2181790564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:16.261 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 -- 172.21.15.52:0/1423513797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc10c170 msgr2=0x7f1bfc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 --2- 172.21.15.52:0/1423513797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc10c170 0x7f1bfc10e610 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009900 tx=0x7f1bf402a480 comp rx=0 tx=0).stop 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 -- 172.21.15.52:0/1423513797 shutdown_connections 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 --2- 172.21.15.52:0/1423513797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc10c170 0x7f1bfc10e610 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 --2- 172.21.15.52:0/1423513797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc103660 0x7f1bfc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 --2- 172.21.15.52:0/1423513797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 -- 172.21.15.52:0/1423513797 >> 172.21.15.52:0/1423513797 conn(0x7f1bfc0fc7a0 msgr2=0x7f1bfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 -- 172.21.15.52:0/1423513797 shutdown_connections 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.779+0000 7f1c017df640 1 -- 172.21.15.52:0/1423513797 wait complete. 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 Processor -- start 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 -- start start 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc10c170 0x7f1bfc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc112000 con 0x7f1bfc103660 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc111e80 con 0x7f1bfc102d40 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1c017df640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc112180 con 0x7f1bfc10c170 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1bfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54808/0 (socket says 172.21.15.52:54808) 2024-09-19T09:27:16.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.780+0000 7f1bfa7fc640 1 -- 172.21.15.52:0/2022978712 learned_addr learned my addr 172.21.15.52:0/2022978712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc10c170 0x7f1bfc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 -- 172.21.15.52:0/2022978712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc10c170 msgr2=0x7f1bfc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc10c170 0x7f1bfc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 -- 172.21.15.52:0/2022978712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 msgr2=0x7f1bfc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 -- 172.21.15.52:0/2022978712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc19d3e0 con 0x7f1bfc103660 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1bfa7fc640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b9e0 tx=0x7f1bf000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1be3fff640 1 -- 172.21.15.52:0/2022978712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0019070 con 0x7f1bfc103660 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1be3fff640 1 -- 172.21.15.52:0/2022978712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf0014440 con 0x7f1bfc103660 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc19d6d0 con 0x7f1bfc103660 2024-09-19T09:27:16.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1be3fff640 1 -- 172.21.15.52:0/2022978712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf0007610 con 0x7f1bfc103660 2024-09-19T09:27:16.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.781+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc1a4fb0 con 0x7f1bfc103660 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.783+0000 7f1be3fff640 1 -- 172.21.15.52:0/2022978712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1bf001c070 con 0x7f1bfc103660 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 Processor -- start 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 -- start start 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcc5d0 0x55d350bcca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1be3fff640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 0x7f1be40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d350b322f0 con 0x55d350bcdb40 2024-09-19T09:27:16.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d350ad9cf0 con 0x55d350bd7370 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d350b2e2b0 con 0x55d350bcc5d0 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54812/0 (socket says 172.21.15.52:54812) 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/2674123286 learned_addr learned my addr 172.21.15.52:0/2674123286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1be3fff640 1 -- 172.21.15.52:0/2022978712 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bf00cf090 con 0x7f1bfc103660 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.784+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcc5d0 0x55d350bcca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfa7fc640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 0x7f1be40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/2674123286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcc5d0 msgr2=0x55d350bcca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcc5d0 0x55d350bcca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/2674123286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 msgr2=0x55d350bd9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/2674123286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d350abe3a0 con 0x55d350bcdb40 2024-09-19T09:27:16.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009900 tx=0x7f1bf4004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dc6560b9996d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1bfa7fc640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 0x7f1be40a5700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1bf009b5c0 tx=0x7f1bf0004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1be17fa640 1 -- 172.21.15.52:0/2674123286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4041020 con 0x55d350bcdb40 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1be17fa640 1 -- 172.21.15.52:0/2674123286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf4005520 con 0x55d350bcdb40 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.785+0000 7f1be17fa640 1 -- 172.21.15.52:0/2674123286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4035070 con 0x55d350bcdb40 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- 172.21.15.52:0/2674123286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 msgr2=0x55d350bcc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009900 tx=0x7f1bf4004180 comp rx=0 tx=0).stop 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- 172.21.15.52:0/2674123286 shutdown_connections 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcc5d0 0x55d350bcca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/2674123286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcdb40 0x55d350bcc090 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- 172.21.15.52:0/2674123286 >> 172.21.15.52:0/2674123286 conn(0x55d350b95310 msgr2=0x55d350bc8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- 172.21.15.52:0/2674123286 shutdown_connections 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- 172.21.15.52:0/2674123286 wait complete. 2024-09-19T09:27:16.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 -- start start 2024-09-19T09:27:16.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.786+0000 7f1c03bb8740 1 Processor -- start 2024-09-19T09:27:16.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bd3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d350bda010 con 0x55d350bcc5d0 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d350aed060 con 0x55d350bd7370 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d350bda190 con 0x55d350bcdb40 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1c03bb8740 10 client.0 _ll_register_callbacks cb 0x55d3508408c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54828/0 (socket says 172.21.15.52:54828) 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1183731136 learned_addr learned my addr 172.21.15.52:0/1183731136 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bd3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 msgr2=0x55d350bd3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bd3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1183731136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 msgr2=0x55d350bd45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1183731136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3508a33c0 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006010 tx=0x7f1bf4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d40991443027f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.787+0000 7f1bdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4041070 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bf40315b0 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf4005520 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bf4035040 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 10 client.17421 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d350be5a70 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf4005520 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1bf4003a30 con 0x55d350bcc5d0 2024-09-19T09:27:16.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 10 client.17421 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 10 client.17421 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 20 client.17421 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350be6dc0 0x55d350be91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 4 client.17421 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.788+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d350b3f860 con 0x55d350be6dc0 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.789+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350be6dc0 0x55d350be91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.789+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350be6dc0 0x55d350be91b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fad60711077f9158 server_cookie=79866c6aea59252 in_seq=0 out_seq=0 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.789+0000 7f1bdeff5640 10 client.17421 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1bdeff5640 1 -- 172.21.15.52:0/1183731136 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d350b3f860 con 0x55d350be6dc0 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1bdeff5640 10 client.17421 handle_command_reply: tid=0 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 client.17421 shutdown 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 msgr2=0x55d350bd6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006010 tx=0x7f1bf4004d10 comp rx=0 tx=0).stop 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 shutdown_connections 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350be6dc0 0x55d350be91b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bd45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bd3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1183731136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bd6d30 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 >> 172.21.15.52:0/1183731136 conn(0x55d350b95310 msgr2=0x55d350bce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1bdeff5640 0 client.17421 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 shutdown_connections 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1183731136 wait complete. 2024-09-19T09:27:16.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.790+0000 7f1c03bb8740 20 client.17421 trim_cache size 0 max 16384 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 Processor -- start 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 -- start start 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1aff90 con 0x55d350bcc5d0 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ad860 con 0x55d350bd7370 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.803+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ab6b0 con 0x55d350bcdb40 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54842/0 (socket says 172.21.15.52:54842) 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1404384249 learned_addr learned my addr 172.21.15.52:0/1404384249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1404384249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 msgr2=0x55d350bec1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bec1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1404384249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 msgr2=0x55d350bec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/1404384249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d350bcf120 con 0x55d350bcc5d0 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1bf402a9a0 tx=0x7f1bf4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabe50fa9e774a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1be0ff9640 1 -- 172.21.15.52:0/1404384249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4059070 con 0x55d350bcc5d0 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1be0ff9640 1 -- 172.21.15.52:0/1404384249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf40046c0 con 0x55d350bcc5d0 2024-09-19T09:27:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.804+0000 7f1be0ff9640 1 -- 172.21.15.52:0/1404384249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4041040 con 0x55d350bcc5d0 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1404384249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 msgr2=0x55d350bc7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1bf402a9a0 tx=0x7f1bf4009800 comp rx=0 tx=0).stop 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1404384249 shutdown_connections 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bd7370 0x55d350bec720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350bec1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/1404384249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bcc5d0 0x55d350bc7c10 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1404384249 >> 172.21.15.52:0/1404384249 conn(0x55d350b95310 msgr2=0x55d350bc7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1404384249 shutdown_connections 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- 172.21.15.52:0/1404384249 wait complete. 2024-09-19T09:27:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 -- start start 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.805+0000 7f1c03bb8740 1 Processor -- start 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bcc5d0 0x55d350c48860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350c48da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1abd20 con 0x55d350bd7370 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ad190 con 0x55d350bcc5d0 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc1ac3f0 con 0x55d350bcdb40 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1c03bb8740 10 client.0 _ll_register_callbacks cb 0x7f1bec00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54854/0 (socket says 172.21.15.52:54854) 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/323898240 learned_addr learned my addr 172.21.15.52:0/323898240 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bcc5d0 0x55d350c48860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350c48da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 msgr2=0x55d350c48da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350c48da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/323898240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bcc5d0 msgr2=0x55d350c48860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bcc5d0 0x55d350c48860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 -- 172.21.15.52:0/323898240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d350c4d510 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4040040 tx=0x7f1bf4004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2845a77e48d89107 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.806+0000 7f1bdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4059030 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bf40046c0 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1bf40315b0 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1bf4041040 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 10 client.17427 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d350c55aa0 con 0x55d350bd7370 2024-09-19T09:27:16.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bf40046c0 con 0x55d350bd7370 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1bf4031ab0 con 0x55d350bd7370 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 10 client.17427 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 10 client.17427 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 20 client.17427 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350c560b0 0x55d350c584a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 4 client.17427 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.807+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d350b39d70 con 0x55d350c560b0 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350c560b0 0x55d350c584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bfaffd640 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350c560b0 0x55d350c584a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7703f6116e11d7e2 server_cookie=333b05e78315e344 in_seq=0 out_seq=0 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bdeff5640 10 client.17427 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bdeff5640 1 -- 172.21.15.52:0/323898240 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d350b39d70 con 0x55d350c560b0 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bdeff5640 10 client.17427 handle_command_reply: tid=0 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 client.17427 shutdown 2024-09-19T09:27:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 msgr2=0x55d350c4ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4040040 tx=0x7f1bf4004150 comp rx=0 tx=0).stop 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 shutdown_connections 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d350c560b0 0x55d350c584a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d350bd7370 0x55d350c4ce70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d350bcdb40 0x55d350c48da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 --2- 172.21.15.52:0/323898240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d350bcc5d0 0x55d350c48860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 >> 172.21.15.52:0/323898240 conn(0x55d350b95310 msgr2=0x55d350bd2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1bdeff5640 0 client.17427 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 shutdown_connections 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.808+0000 7f1c03bb8740 1 -- 172.21.15.52:0/323898240 wait complete. 2024-09-19T09:27:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c03bb8740 20 client.17427 trim_cache size 0 max 16384 2024-09-19T09:27:16.815 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 msgr2=0x7f1be40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 0x7f1be40a5700 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1bf009b5c0 tx=0x7f1bf0004b50 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 msgr2=0x7f1bfc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000b9e0 tx=0x7f1bf000bea0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 shutdown_connections 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1be40a3240 0x7f1be40a5700 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1bfc10c170 0x7f1bfc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc103660 0x7f1bfc198970 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 --2- 172.21.15.52:0/2022978712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1bfc102d40 0x7f1bfc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 >> 172.21.15.52:0/2022978712 conn(0x7f1bfc0fc7a0 msgr2=0x7f1bfc0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 shutdown_connections 2024-09-19T09:27:16.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:16.809+0000 7f1c017df640 1 -- 172.21.15.52:0/2022978712 wait complete. 2024-09-19T09:27:16.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:16 smithi169 ceph-mon[35454]: pgmap v513: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:27:17.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:16 smithi086 ceph-mon[34813]: pgmap v513: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:27:17.150 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:16 smithi052 ceph-mon[30947]: pgmap v513: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:27:17.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:27:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- 172.21.15.52:0/2805965671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411410c170 msgr2=0x7f411410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 --2- 172.21.15.52:0/2805965671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411410c170 0x7f411410e610 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f410c009ca0 tx=0x7f410c02a950 comp rx=0 tx=0).stop 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- 172.21.15.52:0/2805965671 shutdown_connections 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 --2- 172.21.15.52:0/2805965671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f411410c170 0x7f411410e610 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 --2- 172.21.15.52:0/2805965671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f411410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 --2- 172.21.15.52:0/2805965671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4114102d40 0x7f4114103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- 172.21.15.52:0/2805965671 >> 172.21.15.52:0/2805965671 conn(0x7f41140fc7a0 msgr2=0x7f41140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- 172.21.15.52:0/2805965671 shutdown_connections 2024-09-19T09:27:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- 172.21.15.52:0/2805965671 wait complete. 2024-09-19T09:27:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 Processor -- start 2024-09-19T09:27:18.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.339+0000 7f411c362640 1 -- start start 2024-09-19T09:27:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f41141988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f411410c170 0x7f411419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4114111f70 con 0x7f4114102d40 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4114111df0 con 0x7f4114103660 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411c362640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41141120f0 con 0x7f411410c170 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45602/0 (socket says 172.21.15.52:45602) 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 -- 172.21.15.52:0/1368680753 learned_addr learned my addr 172.21.15.52:0/1368680753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a8ff640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f411410c170 0x7f411419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f41198fd640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f41141988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 -- 172.21.15.52:0/1368680753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f411410c170 msgr2=0x7f411419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f411410c170 0x7f411419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 -- 172.21.15.52:0/1368680753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 msgr2=0x7f41141988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f41141988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 -- 172.21.15.52:0/1368680753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411419d320 con 0x7f4114102d40 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f41198fd640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f41141988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f411a0fe640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f411000c920 tx=0x7f411000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.340+0000 7f410b7fe640 1 -- 172.21.15.52:0/1368680753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110007c70 con 0x7f4114102d40 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.341+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411419d610 con 0x7f4114102d40 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.341+0000 7f410b7fe640 1 -- 172.21.15.52:0/1368680753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4110007e10 con 0x7f4114102d40 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.341+0000 7f410b7fe640 1 -- 172.21.15.52:0/1368680753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110018890 con 0x7f4114102d40 2024-09-19T09:27:18.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.341+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41141a4ef0 con 0x7f4114102d40 2024-09-19T09:27:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.343+0000 7f410b7fe640 1 -- 172.21.15.52:0/1368680753 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4110018a50 con 0x7f4114102d40 2024-09-19T09:27:18.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.343+0000 7f411e73b740 1 Processor -- start 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 -- start start 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c518090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c518a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f410b7fe640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 0x7f41000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56511c47e2f0 con 0x56511c523370 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56511c425cf0 con 0x56511c519b40 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411e73b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56511c47a2b0 con 0x56511c5185d0 2024-09-19T09:27:18.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411a8ff640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 0x7f41000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f41198fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f41198fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45616/0 (socket says 172.21.15.52:45616) 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f41198fd640 1 -- 172.21.15.52:0/3404852421 learned_addr learned my addr 172.21.15.52:0/3404852421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f410b7fe640 1 -- 172.21.15.52:0/1368680753 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f41100cfb70 con 0x7f4114102d40 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411a8ff640 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c518090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.344+0000 7f411a0fe640 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c518a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 -- 172.21.15.52:0/3404852421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 msgr2=0x56511c518a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c518a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 -- 172.21.15.52:0/3404852421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 msgr2=0x56511c518090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c518090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 -- 172.21.15.52:0/3404852421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511c40a3a0 con 0x56511c523370 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f41198fd640 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f410400bb70 tx=0x7f410400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac1e33833556b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f411a8ff640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 0x7f41000a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fa0 tx=0x7f410c0098d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f4108dea640 1 -- 172.21.15.52:0/3404852421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104017620 con 0x56511c523370 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f4108dea640 1 -- 172.21.15.52:0/3404852421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104017ca0 con 0x56511c523370 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.345+0000 7f4108dea640 1 -- 172.21.15.52:0/3404852421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410400fbd0 con 0x56511c523370 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- 172.21.15.52:0/3404852421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 msgr2=0x56511c525760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f410400bb70 tx=0x7f410400d710 comp rx=0 tx=0).stop 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- 172.21.15.52:0/3404852421 shutdown_connections 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c525760 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c518a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 --2- 172.21.15.52:0/3404852421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c518090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- 172.21.15.52:0/3404852421 >> 172.21.15.52:0/3404852421 conn(0x56511c4e1310 msgr2=0x56511c514c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- 172.21.15.52:0/3404852421 shutdown_connections 2024-09-19T09:27:18.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- 172.21.15.52:0/3404852421 wait complete. 2024-09-19T09:27:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 -- start start 2024-09-19T09:27:18.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.346+0000 7f411e73b740 1 Processor -- start 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c51ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c5204e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56511c526070 con 0x56511c5185d0 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56511c439060 con 0x56511c519b40 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56511c5261f0 con 0x56511c523370 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 10 client.0 _ll_register_callbacks cb 0x56511c18c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45620/0 (socket says 172.21.15.52:45620) 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 -- 172.21.15.52:0/865297376 learned_addr learned my addr 172.21.15.52:0/865297376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f41198fd640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c51ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 -- 172.21.15.52:0/865297376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 msgr2=0x56511c5204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c5204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 -- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 msgr2=0x56511c51ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c51ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 -- 172.21.15.52:0/865297376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511c1ef3c0 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411a0fe640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f41100cd590 tx=0x7f411009c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc3d6007d1ede3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f40fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100a4d20 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4110018d40 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.347+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4104017ca0 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f411000fb30 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 10 client.17439 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56511c531a80 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104017ca0 con 0x56511c5185d0 2024-09-19T09:27:18.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f41100b01d0 con 0x56511c5185d0 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 10 client.17439 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 10 client.17439 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 20 client.17439 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c532e90 0x56511c535300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 4 client.17439 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56511c48b860 con 0x56511c532e90 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.348+0000 7f41198fd640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c532e90 0x56511c535300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.349+0000 7f40fdffb640 10 client.17439 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.349+0000 7f41198fd640 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c532e90 0x56511c535300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac5d1de9793bdffd server_cookie=c848bb241ccce256 in_seq=0 out_seq=0 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.349+0000 7f40fdffb640 1 -- 172.21.15.52:0/865297376 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56511c48b860 con 0x56511c532e90 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.349+0000 7f40fdffb640 10 client.17439 handle_command_reply: tid=0 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 client.17439 shutdown 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 msgr2=0x56511c522cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f41100cd590 tx=0x7f411009c7b0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 shutdown_connections 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c5204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c532e90 0x56511c535300 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c51ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 --2- 172.21.15.52:0/865297376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c5185d0 0x56511c522cd0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f40fdffb640 0 client.17439 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 >> 172.21.15.52:0/865297376 conn(0x56511c4e1310 msgr2=0x56511c51a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 shutdown_connections 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 1 -- 172.21.15.52:0/865297376 wait complete. 2024-09-19T09:27:18.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.350+0000 7f411e73b740 20 client.17439 trim_cache size 0 max 16384 2024-09-19T09:27:18.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 Processor -- start 2024-09-19T09:27:18.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 -- start start 2024-09-19T09:27:18.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 0x56511c52f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c524ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41141aff50 con 0x56511c519b40 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ad820 con 0x56511c5185d0 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411e73b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ab670 con 0x56511c523370 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45632/0 (socket says 172.21.15.52:45632) 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 -- 172.21.15.52:0/2165785156 learned_addr learned my addr 172.21.15.52:0/2165785156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 -- 172.21.15.52:0/2165785156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 msgr2=0x56511c524ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c524ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411a0fe640 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 0x56511c52f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 -- 172.21.15.52:0/2165785156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 msgr2=0x56511c52f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 0x56511c52f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f41198fd640 1 -- 172.21.15.52:0/2165785156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511c525ba0 con 0x56511c519b40 2024-09-19T09:27:18.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.363+0000 7f411a0fe640 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 0x56511c52f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:18.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f41198fd640 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f410400bb70 tx=0x7f4104005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a3a10e9abc54d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f40fffff640 1 -- 172.21.15.52:0/2165785156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410400f520 con 0x56511c519b40 2024-09-19T09:27:18.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f40fffff640 1 -- 172.21.15.52:0/2165785156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f410400fdc0 con 0x56511c519b40 2024-09-19T09:27:18.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f40fffff640 1 -- 172.21.15.52:0/2165785156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41040054b0 con 0x56511c519b40 2024-09-19T09:27:18.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 -- 172.21.15.52:0/2165785156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 msgr2=0x56511c524760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f410400bb70 tx=0x7f4104005f30 comp rx=0 tx=0).stop 2024-09-19T09:27:18.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 -- 172.21.15.52:0/2165785156 shutdown_connections 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c523370 0x56511c524ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c519b40 0x56511c524760 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 --2- 172.21.15.52:0/2165785156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c5185d0 0x56511c52f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 -- 172.21.15.52:0/2165785156 >> 172.21.15.52:0/2165785156 conn(0x56511c4e1310 msgr2=0x56511c51e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 -- 172.21.15.52:0/2165785156 shutdown_connections 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.364+0000 7f411e73b740 1 -- 172.21.15.52:0/2165785156 wait complete. 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 -- start start 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 Processor -- start 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c53a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c53ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41141abce0 con 0x56511c523370 2024-09-19T09:27:18.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ad150 con 0x56511c519b40 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41141ac3b0 con 0x56511c5185d0 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411e73b740 10 client.0 _ll_register_callbacks cb 0x7f411000c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411a8ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411a8ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45648/0 (socket says 172.21.15.52:45648) 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411a8ff640 1 -- 172.21.15.52:0/2824720636 learned_addr learned my addr 172.21.15.52:0/2824720636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411a0fe640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c53a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f41198fd640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c53ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.365+0000 7f411a8ff640 1 -- 172.21.15.52:0/2824720636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 msgr2=0x56511c53a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411a8ff640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c53a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411a8ff640 1 -- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 msgr2=0x56511c53ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411a8ff640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c53ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411a8ff640 1 -- 172.21.15.52:0/2824720636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511c529950 con 0x56511c523370 2024-09-19T09:27:18.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411a8ff640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f410c006010 tx=0x7f410c003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb075e1ad54c553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f40fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c034040 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f410c004490 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f410400fdc0 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f410c057020 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411e73b740 10 client.17445 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56511c59dd50 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.366+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f410400fdc0 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f410c049c90 con 0x56511c523370 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 10 client.17445 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 10 client.17445 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 20 client.17445 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:18.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c59e450 0x56511c5a0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 4 client.17445 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56511c485d70 con 0x56511c59e450 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411a0fe640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c59e450 0x56511c5a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411a0fe640 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c59e450 0x56511c5a0870 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=705b824dce23500b server_cookie=a50b248ce8ef2c98 in_seq=0 out_seq=0 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f40fdffb640 10 client.17445 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f40fdffb640 1 -- 172.21.15.52:0/2824720636 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56511c485d70 con 0x56511c59e450 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f40fdffb640 10 client.17445 handle_command_reply: tid=0 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.367+0000 7f411e73b740 1 client.17445 shutdown 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 msgr2=0x56511c53b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f410c006010 tx=0x7f410c003e40 comp rx=0 tx=0).stop 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 shutdown_connections 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56511c523370 0x56511c53b160 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56511c59e450 0x56511c5a0870 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56511c519b40 0x56511c53ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 --2- 172.21.15.52:0/2824720636 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56511c5185d0 0x56511c53a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 >> 172.21.15.52:0/2824720636 conn(0x56511c4e1310 msgr2=0x56511c513d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f40fdffb640 0 client.17445 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 shutdown_connections 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 1 -- 172.21.15.52:0/2824720636 wait complete. 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411e73b740 20 client.17445 trim_cache size 0 max 16384 2024-09-19T09:27:18.374 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 msgr2=0x7f41000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 0x7f41000a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f410c005fa0 tx=0x7f410c0098d0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 msgr2=0x7f4114198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f411000c920 tx=0x7f411000cde0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 shutdown_connections 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41000a32c0 0x7f41000a5780 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f411410c170 0x7f411419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4114103660 0x7f41141988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 --2- 172.21.15.52:0/1368680753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4114102d40 0x7f4114198370 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.368+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 >> 172.21.15.52:0/1368680753 conn(0x7f41140fc7a0 msgr2=0x7f41140fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.369+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 shutdown_connections 2024-09-19T09:27:18.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:18.369+0000 7f411c362640 1 -- 172.21.15.52:0/1368680753 wait complete. 2024-09-19T09:27:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:18 smithi169 ceph-mon[35454]: pgmap v514: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:27:18.981 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:18 smithi052 ceph-mon[30947]: pgmap v514: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:27:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:18 smithi086 ceph-mon[34813]: pgmap v514: 97 pgs: 97 active+clean; 2.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:27:19.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:27:19.387 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 -- 172.21.15.52:0/1341218334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 msgr2=0x7f8ec4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1341218334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4103110 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4009cd0 tx=0x7f8eb402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 -- 172.21.15.52:0/1341218334 shutdown_connections 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1341218334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41082a0 0x7f8ec410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1341218334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41036e0 0x7f8ec4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1341218334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4103110 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 -- 172.21.15.52:0/1341218334 >> 172.21.15.52:0/1341218334 conn(0x7f8ec40fc7d0 msgr2=0x7f8ec40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 -- 172.21.15.52:0/1341218334 shutdown_connections 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.863+0000 7f8ec881a640 1 -- 172.21.15.52:0/1341218334 wait complete. 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 Processor -- start 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 -- start start 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41036e0 0x7f8ec4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41082a0 0x7f8ec4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4112100 con 0x7f8ec4102d30 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4111f80 con 0x7f8ec41036e0 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec881a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec4112280 con 0x7f8ec41082a0 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45672/0 (socket says 172.21.15.52:45672) 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 -- 172.21.15.52:0/1326992598 learned_addr learned my addr 172.21.15.52:0/1326992598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:19.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41036e0 0x7f8ec4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41082a0 0x7f8ec4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 -- 172.21.15.52:0/1326992598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41082a0 msgr2=0x7f8ec4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41082a0 0x7f8ec4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 -- 172.21.15.52:0/1326992598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41036e0 msgr2=0x7f8ec4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41036e0 0x7f8ec4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.864+0000 7f8ec259c640 1 -- 172.21.15.52:0/1326992598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec41a6a30 con 0x7f8ec4102d30 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8ec259c640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8eb402ae00 tx=0x7f8eb4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8eb37fe640 1 -- 172.21.15.52:0/1326992598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4004240 con 0x7f8ec4102d30 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec41a6cc0 con 0x7f8ec4102d30 2024-09-19T09:27:19.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8eb37fe640 1 -- 172.21.15.52:0/1326992598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb40305a0 con 0x7f8ec4102d30 2024-09-19T09:27:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8eb37fe640 1 -- 172.21.15.52:0/1326992598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb403a660 con 0x7f8ec4102d30 2024-09-19T09:27:19.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.865+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec41a71a0 con 0x7f8ec4102d30 2024-09-19T09:27:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.867+0000 7f8eb37fe640 1 -- 172.21.15.52:0/1326992598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8eb4030ac0 con 0x7f8ec4102d30 2024-09-19T09:27:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.867+0000 7f8ecabf3740 1 Processor -- start 2024-09-19T09:27:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 -- start start 2024-09-19T09:27:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4d5d0 0x56328fd4da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd5a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56328fcb32f0 con 0x56328fd4eb40 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56328fc5acf0 con 0x56328fd4d5d0 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56328fcaf2b0 con 0x56328fd58370 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45680/0 (socket says 172.21.15.52:45680) 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/3608115903 learned_addr learned my addr 172.21.15.52:0/3608115903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8eb37fe640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 0x7f8eac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec259c640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4d5d0 0x56328fd4da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 0x7f8eac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd5a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/3608115903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 msgr2=0x56328fd5a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd5a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/3608115903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4d5d0 msgr2=0x56328fd4da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4d5d0 0x56328fd4da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.868+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/3608115903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328fc3f3a0 con 0x56328fd4eb40 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8eb37fe640 1 -- 172.21.15.52:0/1326992598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8eb402e030 con 0x7f8ec4102d30 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd5a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc015450 tx=0x7f8ebc015850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ae6c688fe89ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8eb0ff9640 1 -- 172.21.15.52:0/3608115903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc01c070 con 0x56328fd4eb40 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8eb0ff9640 1 -- 172.21.15.52:0/3608115903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ebc018b60 con 0x56328fd4eb40 2024-09-19T09:27:19.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.869+0000 7f8eb0ff9640 1 -- 172.21.15.52:0/3608115903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc021760 con 0x56328fd4eb40 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- 172.21.15.52:0/3608115903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 msgr2=0x56328fd4d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 0x7f8eac0a5700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc020000 tx=0x7f8ebc01c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc015450 tx=0x7f8ebc015850 comp rx=0 tx=0).stop 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- 172.21.15.52:0/3608115903 shutdown_connections 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd5a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4d5d0 0x56328fd4da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/3608115903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd4d090 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- 172.21.15.52:0/3608115903 >> 172.21.15.52:0/3608115903 conn(0x56328fd16310 msgr2=0x56328fd49c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- 172.21.15.52:0/3608115903 shutdown_connections 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- 172.21.15.52:0/3608115903 wait complete. 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 -- start start 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.870+0000 7f8ecabf3740 1 Processor -- start 2024-09-19T09:27:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd57d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd58370 0x56328fd555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56328fd5b070 con 0x56328fd4eb40 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56328fc6e060 con 0x56328fd58370 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56328fd5b1f0 con 0x56328fd4d5d0 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 10 client.0 _ll_register_callbacks cb 0x56328f9c18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45690/0 (socket says 172.21.15.52:45690) 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 -- 172.21.15.52:0/818012961 learned_addr learned my addr 172.21.15.52:0/818012961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec259c640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd57d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd58370 0x56328fd555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 -- 172.21.15.52:0/818012961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 msgr2=0x56328fd57d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd57d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 -- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd58370 msgr2=0x56328fd555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd58370 0x56328fd555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 -- 172.21.15.52:0/818012961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328fa243c0 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec259c640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80116d0 tx=0x7f8eb8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbf8e4cbf330706 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb801f060 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8eb800fb40 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.871+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ebc018b60 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8eb800fd40 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 10 client.17457 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56328fd66b20 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ebc018b60 con 0x56328fd4eb40 2024-09-19T09:27:19.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8eb8018610 con 0x56328fd4eb40 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 10 client.17457 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 20 client.17457 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fd68080 0x56328fd6a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 4 client.17457 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.872+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56328fcc0860 con 0x56328fd68080 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.873+0000 7f8ec259c640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fd68080 0x56328fd6a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.873+0000 7f8ec259c640 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fd68080 0x56328fd6a4a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d89c2c6887e40d4 server_cookie=eb7673742d557f31 in_seq=0 out_seq=0 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.873+0000 7f8ea9ffb640 10 client.17457 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/818012961 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56328fcc0860 con 0x56328fd68080 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ea9ffb640 10 client.17457 handle_command_reply: tid=0 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 client.17457 shutdown 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 msgr2=0x56328fd55000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80116d0 tx=0x7f8eb8011b90 comp rx=0 tx=0).stop 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 shutdown_connections 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fd68080 0x56328fd6a4a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd58370 0x56328fd555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4eb40 0x56328fd55000 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/818012961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd57d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ea9ffb640 0 client.17457 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 >> 172.21.15.52:0/818012961 conn(0x56328fd16310 msgr2=0x56328fd4f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 shutdown_connections 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 1 -- 172.21.15.52:0/818012961 wait complete. 2024-09-19T09:27:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.874+0000 7f8ecabf3740 20 client.17457 trim_cache size 0 max 16384 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 Processor -- start 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 -- start start 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd56f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd6fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41b2220 con 0x56328fd4d5d0 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41afaf0 con 0x56328fd4eb40 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41ad940 con 0x56328fd58370 2024-09-19T09:27:19.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ec259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45692/0 (socket says 172.21.15.52:45692) 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ec259c640 1 -- 172.21.15.52:0/907282244 learned_addr learned my addr 172.21.15.52:0/907282244 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd6fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.887+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd56f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 -- 172.21.15.52:0/907282244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 msgr2=0x56328fd6fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd6fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 -- 172.21.15.52:0/907282244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 msgr2=0x56328fd56f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd56f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 -- 172.21.15.52:0/907282244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328fd50120 con 0x56328fd4d5d0 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd6fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd56f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:19.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8ec259c640 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b9580 tx=0x7f8eb4030a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9f58fda49d8abd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8eabfff640 1 -- 172.21.15.52:0/907282244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40c5d90 con 0x56328fd4d5d0 2024-09-19T09:27:19.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8eabfff640 1 -- 172.21.15.52:0/907282244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb4036070 con 0x56328fd4d5d0 2024-09-19T09:27:19.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.888+0000 7f8eabfff640 1 -- 172.21.15.52:0/907282244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40dd0c0 con 0x56328fd4d5d0 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- 172.21.15.52:0/907282244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 msgr2=0x56328fd64370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8eb40b9580 tx=0x7f8eb4030a30 comp rx=0 tx=0).stop 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- 172.21.15.52:0/907282244 shutdown_connections 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd58370 0x56328fd6fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd56f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/907282244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd4d5d0 0x56328fd64370 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- 172.21.15.52:0/907282244 >> 172.21.15.52:0/907282244 conn(0x56328fd16310 msgr2=0x56328fd56860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- 172.21.15.52:0/907282244 shutdown_connections 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- 172.21.15.52:0/907282244 wait complete. 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- start start 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 Processor -- start 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd60960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41adfb0 con 0x56328fd58370 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41af420 con 0x56328fd4eb40 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec41ae680 con 0x56328fd4d5d0 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ecabf3740 10 client.0 _ll_register_callbacks cb 0x7f8eb8005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.889+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45706/0 (socket says 172.21.15.52:45706) 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/70086972 learned_addr learned my addr 172.21.15.52:0/70086972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec259c640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd60960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec1d9b640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/70086972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 msgr2=0x56328fd60960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd60960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 msgr2=0x56328fd5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 -- 172.21.15.52:0/70086972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328fd5c710 con 0x56328fd58370 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ec2d9d640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc021c60 tx=0x7f8ebc021c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c931bf719d5bca2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc02f070 con 0x56328fd58370 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8ebc009460 con 0x56328fd58370 2024-09-19T09:27:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eb4036070 con 0x56328fd58370 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.890+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ebc03b050 con 0x56328fd58370 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 10 client.17463 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56328fdd29e0 con 0x56328fd58370 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eb4036070 con 0x56328fd58370 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8ebc015040 con 0x56328fd58370 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 10 client.17463 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 20 client.17463 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fdd2dd0 0x56328fdd51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 4 client.17463 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56328fcbad70 con 0x56328fdd2dd0 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.891+0000 7f8ec259c640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fdd2dd0 0x56328fdd51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ec259c640 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fdd2dd0 0x56328fdd51c0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76379dbb21cc0a8f server_cookie=1c66607618f4e48a in_seq=0 out_seq=0 2024-09-19T09:27:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ea9ffb640 10 client.17463 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ea9ffb640 1 -- 172.21.15.52:0/70086972 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56328fcbad70 con 0x56328fdd2dd0 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ea9ffb640 10 client.17463 handle_command_reply: tid=0 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 client.17463 shutdown 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 msgr2=0x56328fd5c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc021c60 tx=0x7f8ebc021c90 comp rx=0 tx=0).stop 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 shutdown_connections 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56328fdd2dd0 0x56328fdd51c0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ea9ffb640 0 client.17463 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56328fd58370 0x56328fd5c1d0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56328fd4eb40 0x56328fd5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 --2- 172.21.15.52:0/70086972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56328fd4d5d0 0x56328fd60960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 >> 172.21.15.52:0/70086972 conn(0x56328fd16310 msgr2=0x56328fd4f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 shutdown_connections 2024-09-19T09:27:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 1 -- 172.21.15.52:0/70086972 wait complete. 2024-09-19T09:27:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.892+0000 7f8ecabf3740 20 client.17463 trim_cache size 0 max 16384 2024-09-19T09:27:19.900 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 msgr2=0x7f8eac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 0x7f8eac0a5700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc020000 tx=0x7f8ebc01c000 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 msgr2=0x7f8ec4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8eb402ae00 tx=0x7f8eb4003ba0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 shutdown_connections 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8eac0a3240 0x7f8eac0a5700 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8ec41082a0 0x7f8ec4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ec41036e0 0x7f8ec4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 --2- 172.21.15.52:0/1326992598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ec4102d30 0x7f8ec4100990 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 >> 172.21.15.52:0/1326992598 conn(0x7f8ec40fc7d0 msgr2=0x7f8ec4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 shutdown_connections 2024-09-19T09:27:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:19.893+0000 7f8ec881a640 1 -- 172.21.15.52:0/1326992598 wait complete. 2024-09-19T09:27:21.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:20 smithi086 ceph-mon[34813]: pgmap v515: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-19T09:27:21.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:20 smithi052 ceph-mon[30947]: pgmap v515: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-19T09:27:21.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:20 smithi169 ceph-mon[35454]: pgmap v515: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-19T09:27:21.734 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:27:21.734 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:27:22.006 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:22.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 -- 172.21.15.52:0/3767897766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 msgr2=0x7fc86410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 --2- 172.21.15.52:0/3767897766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86410ea90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009ca0 tx=0x7fc85c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 -- 172.21.15.52:0/3767897766 shutdown_connections 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 --2- 172.21.15.52:0/3767897766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86410ea90 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 --2- 172.21.15.52:0/3767897766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864102790 0x7fc8641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 --2- 172.21.15.52:0/3767897766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864101de0 0x7fc8641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 -- 172.21.15.52:0/3767897766 >> 172.21.15.52:0/3767897766 conn(0x7fc8640fd8c0 msgr2=0x7fc8640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 -- 172.21.15.52:0/3767897766 shutdown_connections 2024-09-19T09:27:22.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.500+0000 7fc86bec5640 1 -- 172.21.15.52:0/3767897766 wait complete. 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 Processor -- start 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 -- start start 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864101de0 0x7fc864198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864102790 0x7fc8641989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc864111f90 con 0x7fc864106f10 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc864111e10 con 0x7fc864102790 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86bec5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc864112110 con 0x7fc864101de0 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86a462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86a462640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45724/0 (socket says 172.21.15.52:45724) 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.501+0000 7fc86a462640 1 -- 172.21.15.52:0/1928228593 learned_addr learned my addr 172.21.15.52:0/1928228593 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc869460640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864102790 0x7fc8641989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc869c61640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864101de0 0x7fc864198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 -- 172.21.15.52:0/1928228593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864101de0 msgr2=0x7fc864198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864101de0 0x7fc864198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 -- 172.21.15.52:0/1928228593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864102790 msgr2=0x7fc8641989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864102790 0x7fc8641989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 -- 172.21.15.52:0/1928228593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86419d420 con 0x7fc864106f10 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86a462640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc85c031a20 tx=0x7fc85c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc85affd640 1 -- 172.21.15.52:0/1928228593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c003b70 con 0x7fc864106f10 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86419d6b0 con 0x7fc864106f10 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc85affd640 1 -- 172.21.15.52:0/1928228593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85c003d10 con 0x7fc864106f10 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc85affd640 1 -- 172.21.15.52:0/1928228593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c02fc80 con 0x7fc864106f10 2024-09-19T09:27:22.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.502+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8641a4ff0 con 0x7fc864106f10 2024-09-19T09:27:22.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.505+0000 7fc85affd640 1 -- 172.21.15.52:0/1928228593 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc85c0046a0 con 0x7fc864106f10 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.505+0000 7fc86e29e740 1 Processor -- start 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.505+0000 7fc86e29e740 1 -- start start 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.505+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbbff70 0x559b0fbc0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 0x559b0fbcac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86e29e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559b0fb21280 con 0x559b0fbcb150 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86e29e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559b0fac8b10 con 0x559b0fbbff70 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86e29e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b0fb1d240 con 0x559b0fbc0890 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45728/0 (socket says 172.21.15.52:45728) 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 -- 172.21.15.52:0/534925397 learned_addr learned my addr 172.21.15.52:0/534925397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869c61640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 0x559b0fbcac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbbff70 0x559b0fbc0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc85affd640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 -- 172.21.15.52:0/534925397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 msgr2=0x559b0fbcac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 0x559b0fbcac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 -- 172.21.15.52:0/534925397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbbff70 msgr2=0x559b0fbc0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbbff70 0x559b0fbc0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc85affd640 1 -- 172.21.15.52:0/1928228593 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc85c0f0c70 con 0x7fc864106f10 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 -- 172.21.15.52:0/534925397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0fad51f0 con 0x559b0fbcb150 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc86a462640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869c61640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 0x559b0fbcac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.506+0000 7fc869460640 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fc854006aa0 tx=0x7fc854009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8974ab0070f308 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc84ffff640 1 -- 172.21.15.52:0/534925397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854015760 con 0x559b0fbcb150 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86a462640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 0x7fc8500a5780 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b9c70 tx=0x7fc85c02f690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc84ffff640 1 -- 172.21.15.52:0/534925397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc84ffff640 1 -- 172.21.15.52:0/534925397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854018ae0 con 0x559b0fbcb150 2024-09-19T09:27:22.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 -- 172.21.15.52:0/534925397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 msgr2=0x559b0fbcd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fc854006aa0 tx=0x7fc854009510 comp rx=0 tx=0).stop 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 -- 172.21.15.52:0/534925397 shutdown_connections 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbcd540 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbc0890 0x559b0fbcac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 --2- 172.21.15.52:0/534925397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbbff70 0x559b0fbc0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.507+0000 7fc86e29e740 1 -- 172.21.15.52:0/534925397 >> 172.21.15.52:0/534925397 conn(0x559b0fbbc500 msgr2=0x559b0fbbc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- 172.21.15.52:0/534925397 shutdown_connections 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- 172.21.15.52:0/534925397 wait complete. 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- start start 2024-09-19T09:27:22.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 Processor -- start 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbc85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559b0fbcdd20 con 0x559b0fbcb150 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559b0fadbf10 con 0x559b0fbc0890 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559b0fbcdea0 con 0x559b0fbbff70 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.508+0000 7fc86e29e740 10 client.0 _ll_register_callbacks cb 0x559b0faa4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45732/0 (socket says 172.21.15.52:45732) 2024-09-19T09:27:22.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 -- 172.21.15.52:0/3090831168 learned_addr learned my addr 172.21.15.52:0/3090831168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869c61640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbc85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 -- 172.21.15.52:0/3090831168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 msgr2=0x559b0fbc8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 -- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 msgr2=0x559b0fbc85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbc85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 -- 172.21.15.52:0/3090831168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0f8926a0 con 0x559b0fbcb150 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc869460640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc854001eb0 tx=0x7fc854008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4f3fdf669a3199 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc84d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854015930 con 0x559b0fbcb150 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc854015ad0 con 0x559b0fbcb150 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.509+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc854015cd0 con 0x559b0fbcb150 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 10 client.17475 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b0fbd9960 con 0x559b0fbcb150 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc8540163d0 con 0x559b0fbcb150 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 10 client.17475 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 20 client.17475 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fbdad10 0x559b0fbdd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 4 client.17475 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b0fb2e7f0 con 0x559b0fbdad10 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.510+0000 7fc869c61640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fbdad10 0x559b0fbdd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc869c61640 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fbdad10 0x559b0fbdd100 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c0a230f4b242a server_cookie=61e41efc07ce5a8 in_seq=0 out_seq=0 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc84d7fa640 10 client.17475 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:22.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc84d7fa640 1 -- 172.21.15.52:0/3090831168 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559b0fb2e7f0 con 0x559b0fbdad10 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc84d7fa640 10 client.17475 handle_command_reply: tid=0 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc86e29e740 1 client.17475 shutdown 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 msgr2=0x559b0fbc8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.511+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc854001eb0 tx=0x7fc854008040 comp rx=0 tx=0).stop 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 shutdown_connections 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fbdad10 0x559b0fbdd100 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbc8b00 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbc85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 --2- 172.21.15.52:0/3090831168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc84d7fa640 0 client.17475 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 >> 172.21.15.52:0/3090831168 conn(0x559b0fbbc500 msgr2=0x559b0fbb7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 shutdown_connections 2024-09-19T09:27:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 1 -- 172.21.15.52:0/3090831168 wait complete. 2024-09-19T09:27:22.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.512+0000 7fc86e29e740 20 client.17475 trim_cache size 0 max 16384 2024-09-19T09:27:22.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 Processor -- start 2024-09-19T09:27:22.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 -- start start 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbe27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ade50 con 0x559b0fbcb150 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ab720 con 0x559b0fbc0890 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc86e29e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641a9570 con 0x559b0fbbff70 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45736/0 (socket says 172.21.15.52:45736) 2024-09-19T09:27:22.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc869460640 1 -- 172.21.15.52:0/505587091 learned_addr learned my addr 172.21.15.52:0/505587091 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.529+0000 7fc869460640 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869c61640 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbe27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 -- 172.21.15.52:0/505587091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 msgr2=0x559b0fbc6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 -- 172.21.15.52:0/505587091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 msgr2=0x559b0fbe27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbe27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 -- 172.21.15.52:0/505587091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0fbbc330 con 0x559b0fbcb150 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc869460640 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc8540186b0 tx=0x7fc854009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd77f706685a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc84f7fe640 1 -- 172.21.15.52:0/505587091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854034030 con 0x559b0fbcb150 2024-09-19T09:27:22.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc84f7fe640 1 -- 172.21.15.52:0/505587091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.530+0000 7fc84f7fe640 1 -- 172.21.15.52:0/505587091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854009860 con 0x559b0fbcb150 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- 172.21.15.52:0/505587091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 msgr2=0x559b0fbe2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc8540186b0 tx=0x7fc854009ea0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- 172.21.15.52:0/505587091 shutdown_connections 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fbe2cf0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbe27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- 172.21.15.52:0/505587091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbc6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- 172.21.15.52:0/505587091 >> 172.21.15.52:0/505587091 conn(0x559b0fbbc500 msgr2=0x559b0fbc6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- 172.21.15.52:0/505587091 shutdown_connections 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- 172.21.15.52:0/505587091 wait complete. 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 -- start start 2024-09-19T09:27:22.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 Processor -- start 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbcf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbcf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.531+0000 7fc86e29e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc86e29e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641a9be0 con 0x559b0fbcb150 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc86e29e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641ab050 con 0x559b0fbc0890 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc86e29e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641aa2b0 con 0x559b0fbbff70 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc86e29e740 10 client.0 _ll_register_callbacks cb 0x7fc854009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45738/0 (socket says 172.21.15.52:45738) 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 -- 172.21.15.52:0/460055584 learned_addr learned my addr 172.21.15.52:0/460055584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869c61640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbcf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbcf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 -- 172.21.15.52:0/460055584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 msgr2=0x559b0fbcf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbcf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 -- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 msgr2=0x559b0fbcf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbcf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 -- 172.21.15.52:0/460055584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0fbc0e00 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc869460640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc8540046c0 tx=0x7fc854016840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894ba5296597195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc84d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854034040 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc8540093a0 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.532+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc8540163d0 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 10 client.17481 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559b0fc45cf0 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85401d070 con 0x559b0fbcb150 2024-09-19T09:27:22.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc8540227c0 con 0x559b0fbcb150 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 10 client.17481 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 20 client.17481 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fc46350 0x559b0fc48770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 4 client.17481 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b0fb28d00 con 0x559b0fc46350 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.533+0000 7fc869c61640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fc46350 0x559b0fc48770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.534+0000 7fc84d7fa640 10 client.17481 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:22.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.534+0000 7fc869c61640 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fc46350 0x559b0fc48770 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fcde13e2bc790d9 server_cookie=deb27f3b36b7ae9f in_seq=0 out_seq=0 2024-09-19T09:27:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.534+0000 7fc84d7fa640 1 -- 172.21.15.52:0/460055584 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b0fb28d00 con 0x559b0fc46350 2024-09-19T09:27:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.534+0000 7fc84d7fa640 10 client.17481 handle_command_reply: tid=0 2024-09-19T09:27:22.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 client.17481 shutdown 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 msgr2=0x559b0fc44780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc8540046c0 tx=0x7fc854016840 comp rx=0 tx=0).stop 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 shutdown_connections 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559b0fc46350 0x559b0fc48770 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559b0fbcb150 0x559b0fc44780 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559b0fbc0890 0x559b0fbcf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 --2- 172.21.15.52:0/460055584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559b0fbbff70 0x559b0fbcf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc84d7fa640 0 client.17481 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 >> 172.21.15.52:0/460055584 conn(0x559b0fbbc500 msgr2=0x559b0fbc7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 shutdown_connections 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 1 -- 172.21.15.52:0/460055584 wait complete. 2024-09-19T09:27:22.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.535+0000 7fc86e29e740 20 client.17481 trim_cache size 0 max 16384 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "8c951906-8ed3-4887-a528-b9bd8a2373fc", 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:22.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 msgr2=0x7fc8500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 0x7fc8500a5780 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b9c70 tx=0x7fc85c02f690 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 msgr2=0x7fc86419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fc85c031a20 tx=0x7fc85c031a50 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 shutdown_connections 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc864106f10 0x7fc86419cd40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc864102790 0x7fc8641989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 --2- 172.21.15.52:0/1928228593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc864101de0 0x7fc864198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 >> 172.21.15.52:0/1928228593 conn(0x7fc8640fd8c0 msgr2=0x7fc8640fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 shutdown_connections 2024-09-19T09:27:22.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:22.536+0000 7fc86bec5640 1 -- 172.21.15.52:0/1928228593 wait complete. 2024-09-19T09:27:23.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:22 smithi086 ceph-mon[34813]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:23.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:22 smithi052 ceph-mon[30947]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:23.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:22 smithi169 ceph-mon[35454]: pgmap v516: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:23.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:23.496 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:23 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:27:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:23 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:23 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:27:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:23 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:23 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:27:23.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 -- 172.21.15.52:0/74513081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c106f10 msgr2=0x7fca9c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 --2- 172.21.15.52:0/74513081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c106f10 0x7fca9c10ea90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ca0 tx=0x7fca8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 -- 172.21.15.52:0/74513081 shutdown_connections 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 --2- 172.21.15.52:0/74513081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c106f10 0x7fca9c10ea90 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 --2- 172.21.15.52:0/74513081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c102790 0x7fca9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 --2- 172.21.15.52:0/74513081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 0x7fca9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 -- 172.21.15.52:0/74513081 >> 172.21.15.52:0/74513081 conn(0x7fca9c0fd8c0 msgr2=0x7fca9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 -- 172.21.15.52:0/74513081 shutdown_connections 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 -- 172.21.15.52:0/74513081 wait complete. 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.939+0000 7fcaa1929640 1 Processor -- start 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 -- start start 2024-09-19T09:27:23.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 0x7fca9c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 0x7fca9c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c111f70 con 0x7fca9c102790 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c111df0 con 0x7fca9c101de0 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fcaa1929640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1120f0 con 0x7fca9c106f10 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45758/0 (socket says 172.21.15.52:45758) 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 -- 172.21.15.52:0/3910877586 learned_addr learned my addr 172.21.15.52:0/3910877586 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9affd640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 0x7fca9c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 0x7fca9c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 -- 172.21.15.52:0/3910877586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 msgr2=0x7fca9c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 0x7fca9c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 -- 172.21.15.52:0/3910877586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 msgr2=0x7fca9c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 0x7fca9c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9a7fc640 1 -- 172.21.15.52:0/3910877586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c1a68d0 con 0x7fca9c102790 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.940+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 0x7fca9c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fca8400e9f0 tx=0x7fca8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fcaa0927640 1 -- 172.21.15.52:0/3910877586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8400cd80 con 0x7fca9c102790 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fcaa0927640 1 -- 172.21.15.52:0/3910877586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca84005500 con 0x7fca9c102790 2024-09-19T09:27:23.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c1a6bc0 con 0x7fca9c102790 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fcaa0927640 1 -- 172.21.15.52:0/3910877586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84010690 con 0x7fca9c102790 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.941+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1a70b0 con 0x7fca9c102790 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa0927640 1 -- 172.21.15.52:0/3910877586 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca840046c0 con 0x7fca9c102790 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 Processor -- start 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 -- start start 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 0x564839c00140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839c00680 0x564839c02a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564839b5b2e0 con 0x564839bf54a0 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564839b02ce0 con 0x564839bf5dc0 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564839b572a0 con 0x564839c00680 2024-09-19T09:27:23.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45764/0 (socket says 172.21.15.52:45764) 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fca9b7fe640 1 -- 172.21.15.52:0/3561380059 learned_addr learned my addr 172.21.15.52:0/3561380059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.944+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839c00680 0x564839c02a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9affd640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 0x564839c00140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 -- 172.21.15.52:0/3561380059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839c00680 msgr2=0x564839c02a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839c00680 0x564839c02a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 -- 172.21.15.52:0/3561380059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 msgr2=0x564839c00140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 0x564839c00140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 -- 172.21.15.52:0/3561380059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564839ae7440 con 0x564839bf54a0 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9affd640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 0x564839c00140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fcaa0927640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 0x7fca880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005f60 tx=0x7fca8c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf9473c0f8509f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca9affd640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 0x7fca880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fcaa0927640 1 -- 172.21.15.52:0/3910877586 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca840cfdf0 con 0x7fca9c102790 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca91ffb640 1 -- 172.21.15.52:0/3561380059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c031db0 con 0x564839bf54a0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca91ffb640 1 -- 172.21.15.52:0/3561380059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c036070 con 0x564839bf54a0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.945+0000 7fca91ffb640 1 -- 172.21.15.52:0/3561380059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c004250 con 0x564839bf54a0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- 172.21.15.52:0/3561380059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 msgr2=0x564839bf5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fca9affd640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 0x7fca880a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x564839bf2890 tx=0x7fca9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fca8c005f60 tx=0x7fca8c005f90 comp rx=0 tx=0).stop 2024-09-19T09:27:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- 172.21.15.52:0/3561380059 shutdown_connections 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839c00680 0x564839c02a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf5dc0 0x564839c00140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/3561380059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839bf54a0 0x564839bf5880 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- 172.21.15.52:0/3561380059 >> 172.21.15.52:0/3561380059 conn(0x564839bf1a30 msgr2=0x564839bf1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- 172.21.15.52:0/3561380059 shutdown_connections 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- 172.21.15.52:0/3561380059 wait complete. 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.946+0000 7fcaa3d02740 1 -- start start 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 Processor -- start 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839bfff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bfd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564839c030d0 con 0x564839c00680 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564839b16050 con 0x564839bf54a0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564839c03250 con 0x564839bf5dc0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fcaa3d02740 10 client.0 _ll_register_callbacks cb 0x564839b56160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45768/0 (socket says 172.21.15.52:45768) 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839bfff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 -- 172.21.15.52:0/1969758249 learned_addr learned my addr 172.21.15.52:0/1969758249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bfd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 -- 172.21.15.52:0/1969758249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 msgr2=0x564839bfd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bfd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 -- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 msgr2=0x564839bfff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839bfff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9b7fe640 1 -- 172.21.15.52:0/1969758249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648398cc3c0 con 0x564839c00680 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bfd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.947+0000 7fca9affd640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839bfff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02ade0 tx=0x7fca8c031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785013fec163085e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c04b030 con 0x564839c00680 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca8c003b80 con 0x564839c00680 2024-09-19T09:27:23.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c036070 con 0x564839c00680 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca8c055050 con 0x564839c00680 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fcaa3d02740 10 client.17493 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564839c030d0 con 0x564839c00680 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c036070 con 0x564839c00680 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.948+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca8c042020 con 0x564839c00680 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 10 client.17493 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 20 client.17493 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c0fc00 0x564839c11ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 4 client.17493 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564839b68850 con 0x564839c0fc00 2024-09-19T09:27:23.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fca9affd640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c0fc00 0x564839c11ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fca9affd640 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c0fc00 0x564839c11ff0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b46f907d44030 server_cookie=822e23053d43ff85 in_seq=0 out_seq=0 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.949+0000 7fca7affd640 10 client.17493 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fca7affd640 1 -- 172.21.15.52:0/1969758249 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564839b68850 con 0x564839c0fc00 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fca7affd640 10 client.17493 handle_command_reply: tid=0 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 client.17493 shutdown 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 msgr2=0x564839bfd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02ade0 tx=0x7fca8c031e60 comp rx=0 tx=0).stop 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 shutdown_connections 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c0fc00 0x564839c11ff0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839bfd730 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bfd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/1969758249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839bfff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 >> 172.21.15.52:0/1969758249 conn(0x564839bf1a30 msgr2=0x564839bf0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fca7affd640 0 client.17493 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 shutdown_connections 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 1 -- 172.21.15.52:0/1969758249 wait complete. 2024-09-19T09:27:23.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.950+0000 7fcaa3d02740 20 client.17493 trim_cache size 0 max 16384 2024-09-19T09:27:23.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 Processor -- start 2024-09-19T09:27:23.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 -- start start 2024-09-19T09:27:23.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c0c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1b21e0 con 0x564839c00680 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1afab0 con 0x564839bf54a0 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.967+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1ad900 con 0x564839bf5dc0 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45782/0 (socket says 172.21.15.52:45782) 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2250325904 learned_addr learned my addr 172.21.15.52:0/2250325904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2250325904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 msgr2=0x564839bff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9affd640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c0c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2250325904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 msgr2=0x564839c0c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c0c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2250325904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564839bf2ae0 con 0x564839c00680 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9affd640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c0c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fca8c004af0 tx=0x7fca8c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf9ddee92cce971 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca917fa640 1 -- 172.21.15.52:0/2250325904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c04b030 con 0x564839c00680 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca917fa640 1 -- 172.21.15.52:0/2250325904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c036070 con 0x564839c00680 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.968+0000 7fca917fa640 1 -- 172.21.15.52:0/2250325904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c030d00 con 0x564839c00680 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2250325904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 msgr2=0x564839c17850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fca8c004af0 tx=0x7fca8c005ef0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2250325904 shutdown_connections 2024-09-19T09:27:23.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c17850 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839bff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2250325904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c0c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2250325904 >> 172.21.15.52:0/2250325904 conn(0x564839bf1a30 msgr2=0x564839bfc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2250325904 shutdown_connections 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2250325904 wait complete. 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.969+0000 7fcaa3d02740 1 -- start start 2024-09-19T09:27:23.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 Processor -- start 2024-09-19T09:27:23.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839c03ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1adf70 con 0x564839c00680 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1af3e0 con 0x564839bf54a0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1ae640 con 0x564839bf5dc0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fcaa3d02740 10 client.0 _ll_register_callbacks cb 0x7fca840d37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45786/0 (socket says 172.21.15.52:45786) 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2533378286 learned_addr learned my addr 172.21.15.52:0/2533378286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9affd640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9a7fc640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839c03ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2533378286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 msgr2=0x564839c03ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839c03ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 msgr2=0x564839c089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 -- 172.21.15.52:0/2533378286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564839c04790 con 0x564839c00680 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca9b7fe640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ca0 tx=0x7fca8c031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97f0f13437473aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.970+0000 7fca7affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c04b040 con 0x564839c00680 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca8c02fa60 con 0x564839c00680 2024-09-19T09:27:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c036070 con 0x564839c00680 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca8c0305c0 con 0x564839c00680 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 10 client.17499 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564839c7a500 con 0x564839c00680 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c036070 con 0x564839c00680 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca8c042070 con 0x564839c00680 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 10 client.17499 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 20 client.17499 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c7aab0 0x564839c7cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 4 client.17499 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.971+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564839b62d60 con 0x564839c7aab0 2024-09-19T09:27:23.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca9affd640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c7aab0 0x564839c7cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca9affd640 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c7aab0 0x564839c7cea0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6b3165e7442952 server_cookie=b61650370d821cdd in_seq=0 out_seq=0 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca7affd640 10 client.17499 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca7affd640 1 -- 172.21.15.52:0/2533378286 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564839b62d60 con 0x564839c7aab0 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca7affd640 10 client.17499 handle_command_reply: tid=0 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 client.17499 shutdown 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 msgr2=0x564839c04220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009ca0 tx=0x7fca8c031870 comp rx=0 tx=0).stop 2024-09-19T09:27:23.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 shutdown_connections 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564839c7aab0 0x564839c7cea0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564839c00680 0x564839c04220 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564839bf5dc0 0x564839c03ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 --2- 172.21.15.52:0/2533378286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564839bf54a0 0x564839c089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fca7affd640 0 client.17499 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:23.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 >> 172.21.15.52:0/2533378286 conn(0x564839bf1a30 msgr2=0x564839bfb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 shutdown_connections 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.972+0000 7fcaa3d02740 1 -- 172.21.15.52:0/2533378286 wait complete. 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa3d02740 20 client.17499 trim_cache size 0 max 16384 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:27:23.982 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 msgr2=0x7fca880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 0x7fca880a5700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x564839bf2890 tx=0x7fca9400b390 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 msgr2=0x7fca9c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fca8400e9f0 tx=0x7fca8400edf0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 shutdown_connections 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca880a3240 0x7fca880a5700 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca9c106f10 0x7fca9c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca9c102790 0x7fca9c074a30 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 --2- 172.21.15.52:0/3910877586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca9c101de0 0x7fca9c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:23.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 >> 172.21.15.52:0/3910877586 conn(0x7fca9c0fd8c0 msgr2=0x7fca9c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 shutdown_connections 2024-09-19T09:27:23.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:23.973+0000 7fcaa1929640 1 -- 172.21.15.52:0/3910877586 wait complete. 2024-09-19T09:27:24.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:23 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:27:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:23 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:23 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:27:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:23 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:23 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:27:24.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:23 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:27:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:23 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:23 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:27:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:23 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:24.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:23 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:27:24.846 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:27:24.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:27:24.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:24 smithi052 ceph-mon[30947]: pgmap v517: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:25.007 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:24 smithi086 ceph-mon[34813]: pgmap v517: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:25.112 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:25.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:24 smithi169 ceph-mon[35454]: pgmap v517: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3442741309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4101270 msgr2=0x7fe1a410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3442741309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4101270 0x7fe1a410d7a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009cd0 tx=0x7fe19c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3442741309 shutdown_connections 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3442741309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a4101270 0x7fe1a410d7a0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3442741309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a41008d0 0x7fe1a4100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3442741309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 0x7fe1a4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3442741309 >> 172.21.15.52:0/3442741309 conn(0x7fe1a40fc630 msgr2=0x7fe1a40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3442741309 shutdown_connections 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.553+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3442741309 wait complete. 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 Processor -- start 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 -- start start 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a4101270 0x7fe1a41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 0x7fe1a41a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4110d10 con 0x7fe1a41008d0 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4110b90 con 0x7fe1a41068d0 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a9b9d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4110e90 con 0x7fe1a4101270 2024-09-19T09:27:25.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45800/0 (socket says 172.21.15.52:45800) 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 -- 172.21.15.52:0/3135853608 learned_addr learned my addr 172.21.15.52:0/3135853608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a3fff640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a4101270 0x7fe1a41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a939c640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 0x7fe1a41a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 -- 172.21.15.52:0/3135853608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a4101270 msgr2=0x7fe1a41996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a4101270 0x7fe1a41996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 -- 172.21.15.52:0/3135853608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 msgr2=0x7fe1a41a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.554+0000 7fe1a8b9b640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 0x7fe1a41a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a8b9b640 1 -- 172.21.15.52:0/3135853608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a41a4740 con 0x7fe1a41008d0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a8b9b640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe19400b4a0 tx=0x7fe19400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194014070 con 0x7fe1a41008d0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe194010af0 con 0x7fe1a41008d0 2024-09-19T09:27:25.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a41a4910 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194017d10 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.555+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a41a4e50 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.556+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a4100d30 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.557+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe194017070 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.558+0000 7fe1a1ffb640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 0x7fe1900a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.558+0000 7fe1a3fff640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 0x7fe1900a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.558+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe1940cec80 con 0x7fe1a41008d0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.558+0000 7fe1a3fff640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 0x7fe1900a5780 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe1a406b2e0 tx=0x7fe18c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:25.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.562+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe19409b920 con 0x7fe1a41008d0 2024-09-19T09:27:25.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.776+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1a4108e60 con 0x7fe1a41008d0 2024-09-19T09:27:25.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.777+0000 7fe1a1ffb640 1 -- 172.21.15.52:0/3135853608 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe19409b220 con 0x7fe1a41008d0 2024-09-19T09:27:25.778 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:27:25.778 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:27:25.778 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 msgr2=0x7fe1900a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 0x7fe1900a5780 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe1a406b2e0 tx=0x7fe18c00a250 comp rx=0 tx=0).stop 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 msgr2=0x7fe1a4199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe19400b4a0 tx=0x7fe19400b960 comp rx=0 tx=0).stop 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 shutdown_connections 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a41068d0 0x7fe1a41a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1900a32c0 0x7fe1900a5780 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1a4101270 0x7fe1a41996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 --2- 172.21.15.52:0/3135853608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe1a41008d0 0x7fe1a4199180 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:25.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 >> 172.21.15.52:0/3135853608 conn(0x7fe1a40fc630 msgr2=0x7fe1a40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:25.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 shutdown_connections 2024-09-19T09:27:25.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:25.779+0000 7fe1a9b9d640 1 -- 172.21.15.52:0/3135853608 wait complete. 2024-09-19T09:27:26.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:27:26.666 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:26.896 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:26 smithi052 ceph-mon[30947]: pgmap v518: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:26.896 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3135853608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:26 smithi086 ceph-mon[34813]: pgmap v518: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3135853608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:27.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 -- 172.21.15.52:0/2501633422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c102790 msgr2=0x7fd84c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 --2- 172.21.15.52:0/2501633422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c102790 0x7fd84c1067e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fd840009900 tx=0x7fd84002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 -- 172.21.15.52:0/2501633422 shutdown_connections 2024-09-19T09:27:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 --2- 172.21.15.52:0/2501633422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c106f10 0x7fd84c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 --2- 172.21.15.52:0/2501633422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c102790 0x7fd84c1067e0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 --2- 172.21.15.52:0/2501633422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 0x7fd84c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 -- 172.21.15.52:0/2501633422 >> 172.21.15.52:0/2501633422 conn(0x7fd84c0fd8c0 msgr2=0x7fd84c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 -- 172.21.15.52:0/2501633422 shutdown_connections 2024-09-19T09:27:27.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.114+0000 7fd852f1f640 1 -- 172.21.15.52:0/2501633422 wait complete. 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 Processor -- start 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 -- start start 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 0x7fd84c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 0x7fd84c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c111f30 con 0x7fd84c106f10 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c111db0 con 0x7fd84c102790 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd852f1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1120b0 con 0x7fd84c101de0 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45812/0 (socket says 172.21.15.52:45812) 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 0x7fd84c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 -- 172.21.15.52:0/1143567215 learned_addr learned my addr 172.21.15.52:0/1143567215 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:27.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 0x7fd84c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 -- 172.21.15.52:0/1143567215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 msgr2=0x7fd84c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 0x7fd84c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.115+0000 7fd8514bc640 1 -- 172.21.15.52:0/1143567215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 msgr2=0x7fd84c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd8514bc640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 0x7fd84c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd8514bc640 1 -- 172.21.15.52:0/1143567215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84c1a6840 con 0x7fd84c106f10 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 0x7fd84c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd8514bc640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b5b0 tx=0x7fd84400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd849ffb640 1 -- 172.21.15.52:0/1143567215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844004b20 con 0x7fd84c106f10 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84c198140 con 0x7fd84c106f10 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd849ffb640 1 -- 172.21.15.52:0/1143567215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd844004cc0 con 0x7fd84c106f10 2024-09-19T09:27:27.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd849ffb640 1 -- 172.21.15.52:0/1143567215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844005580 con 0x7fd84c106f10 2024-09-19T09:27:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.116+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd84c198600 con 0x7fd84c106f10 2024-09-19T09:27:27.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.118+0000 7fd849ffb640 1 -- 172.21.15.52:0/1143567215 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd84400ac80 con 0x7fd84c106f10 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 Processor -- start 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 -- start start 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229b1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d42290a2f0 con 0x55d4229a45d0 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4228b1cf0 con 0x55d4229af370 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8552f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4229062b0 con 0x55d4229a5b40 2024-09-19T09:27:27.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd849ffb640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 0x7fd8340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd850cbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd850cbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45822/0 (socket says 172.21.15.52:45822) 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd8514bc640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 0x7fd8340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.119+0000 7fd850cbb640 1 -- 172.21.15.52:0/3083134560 learned_addr learned my addr 172.21.15.52:0/3083134560 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd849ffb640 1 -- 172.21.15.52:0/1143567215 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd8440d7a10 con 0x7fd84c106f10 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 -- 172.21.15.52:0/3083134560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 msgr2=0x55d4229a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 -- 172.21.15.52:0/3083134560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 msgr2=0x55d4229a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 -- 172.21.15.52:0/3083134560 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4228963a0 con 0x55d4229af370 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd850cbb640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd8514bc640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 0x7fd8340a5700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd84400afd0 tx=0x7fd8440182d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd84bfff640 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229b1760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd840005940 tx=0x7fd8400314e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5465709e4e20e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd832ffd640 1 -- 172.21.15.52:0/3083134560 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840035070 con 0x55d4229af370 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd832ffd640 1 -- 172.21.15.52:0/3083134560 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd840005500 con 0x55d4229af370 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.120+0000 7fd832ffd640 1 -- 172.21.15.52:0/3083134560 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840004c30 con 0x55d4229af370 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 -- 172.21.15.52:0/3083134560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 msgr2=0x55d4229b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229b1760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd840005940 tx=0x7fd8400314e0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 -- 172.21.15.52:0/3083134560 shutdown_connections 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229b1760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 --2- 172.21.15.52:0/3083134560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 -- 172.21.15.52:0/3083134560 >> 172.21.15.52:0/3083134560 conn(0x55d42296d310 msgr2=0x55d4229a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 -- 172.21.15.52:0/3083134560 shutdown_connections 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.121+0000 7fd8552f8740 1 -- 172.21.15.52:0/3083134560 wait complete. 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 -- start start 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 Processor -- start 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229ac650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4229b2010 con 0x55d4229a45d0 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4228c5060 con 0x55d4229af370 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4229b2190 con 0x55d4229a5b40 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd8552f8740 10 client.0 _ll_register_callbacks cb 0x55d4226188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45824/0 (socket says 172.21.15.52:45824) 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd84bfff640 1 -- 172.21.15.52:0/575060608 learned_addr learned my addr 172.21.15.52:0/575060608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd84bfff640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.122+0000 7fd850cbb640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 -- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 msgr2=0x55d4229ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 -- 172.21.15.52:0/575060608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 msgr2=0x55d4229ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 -- 172.21.15.52:0/575060608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42267b3c0 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd84bfff640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd840031490 tx=0x7fd840031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1b071a9274a96e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd82bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840056060 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd840005500 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd8400042f0 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd840035030 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd8552f8740 10 client.17517 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4229bdae0 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.123+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd840005500 con 0x55d4229a45d0 2024-09-19T09:27:27.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd8400039d0 con 0x55d4229a45d0 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 10 client.17517 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 10 client.17517 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 20 client.17517 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d4229c1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 4 client.17517 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d422917860 con 0x55d4229bee30 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.124+0000 7fd850cbb640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d4229c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.125+0000 7fd850cbb640 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d4229c1220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8df96fd8ae587b41 server_cookie=64e98010a8092606 in_seq=0 out_seq=0 2024-09-19T09:27:27.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.125+0000 7fd82bfff640 10 client.17517 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd82bfff640 1 -- 172.21.15.52:0/575060608 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d422917860 con 0x55d4229bee30 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd82bfff640 10 client.17517 handle_command_reply: tid=0 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 client.17517 shutdown 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 msgr2=0x55d4229aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd840031490 tx=0x7fd840031740 comp rx=0 tx=0).stop 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 shutdown_connections 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d4229c1220 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd82bfff640 0 client.17517 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 --2- 172.21.15.52:0/575060608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229aed90 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 >> 172.21.15.52:0/575060608 conn(0x55d42296d310 msgr2=0x55d4229a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 shutdown_connections 2024-09-19T09:27:27.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 1 -- 172.21.15.52:0/575060608 wait complete. 2024-09-19T09:27:27.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.126+0000 7fd8552f8740 20 client.17517 trim_cache size 0 max 16384 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 Processor -- start 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 -- start start 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a45d0 0x55d4229bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229a5b40 0x55d4229c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1add20 con 0x55d4229af370 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1ab5f0 con 0x55d4229a5b40 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd8552f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1a9440 con 0x55d4229a45d0 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45826/0 (socket says 172.21.15.52:45826) 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd84bfff640 1 -- 172.21.15.52:0/1447011511 learned_addr learned my addr 172.21.15.52:0/1447011511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a45d0 0x55d4229bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.139+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229a5b40 0x55d4229c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 -- 172.21.15.52:0/1447011511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a45d0 msgr2=0x55d4229bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a45d0 0x55d4229bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 -- 172.21.15.52:0/1447011511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229a5b40 msgr2=0x55d4229c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229a5b40 0x55d4229c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 -- 172.21.15.52:0/1447011511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4229acfe0 con 0x55d4229af370 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd840004720 tx=0x7fd84002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b2661ce7d3b5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd8327fc640 1 -- 172.21.15.52:0/1447011511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84003d450 con 0x55d4229af370 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd8327fc640 1 -- 172.21.15.52:0/1447011511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd840041070 con 0x55d4229af370 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd8327fc640 1 -- 172.21.15.52:0/1447011511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8400047c0 con 0x55d4229af370 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.140+0000 7fd8552f8740 1 -- 172.21.15.52:0/1447011511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 msgr2=0x55d4229c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd840004720 tx=0x7fd84002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- 172.21.15.52:0/1447011511 shutdown_connections 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229af370 0x55d4229c4780 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229a5b40 0x55d4229c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1447011511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a45d0 0x55d4229bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- 172.21.15.52:0/1447011511 >> 172.21.15.52:0/1447011511 conn(0x55d42296d310 msgr2=0x55d4229ab130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- 172.21.15.52:0/1447011511 shutdown_connections 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- 172.21.15.52:0/1447011511 wait complete. 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- start start 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 Processor -- start 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1a9ab0 con 0x55d4229a45d0 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1aaf20 con 0x55d4229af370 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.141+0000 7fd8552f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c1aa180 con 0x55d4229a5b40 2024-09-19T09:27:27.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd8552f8740 10 client.0 _ll_register_callbacks cb 0x7fd83c00c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45834/0 (socket says 172.21.15.52:45834) 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 -- 172.21.15.52:0/1551043486 learned_addr learned my addr 172.21.15.52:0/1551043486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 -- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 msgr2=0x55d4229c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 -- 172.21.15.52:0/1551043486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 msgr2=0x55d4229c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 -- 172.21.15.52:0/1551043486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4229c2c30 con 0x55d4229a45d0 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:27.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd84bfff640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd840032c00 tx=0x7fd8400038e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc975e627932584 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd82bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840070060 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd8400041e0 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.142+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd840041070 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd8400036f0 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 10 client.17523 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d422a29880 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd840041070 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd8400049c0 con 0x55d4229a45d0 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 10 client.17523 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 10 client.17523 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 20 client.17523 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d422a2bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:27.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 4 client.17523 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d422911d70 con 0x55d4229bee30 2024-09-19T09:27:27.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.143+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d422a2bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd850cbb640 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d422a2bd60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc60ba26933ae4c2 server_cookie=2e86dcbe75f1fd97 in_seq=0 out_seq=0 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd82bfff640 10 client.17523 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd82bfff640 1 -- 172.21.15.52:0/1551043486 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d422911d70 con 0x55d4229bee30 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd82bfff640 10 client.17523 handle_command_reply: tid=0 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 client.17523 shutdown 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 msgr2=0x55d4229c4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd840032c00 tx=0x7fd8400038e0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 shutdown_connections 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55d4229bee30 0x55d422a2bd60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4229af370 0x55d4229c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4229a5b40 0x55d4229c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd82bfff640 0 client.17523 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 --2- 172.21.15.52:0/1551043486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4229a45d0 0x55d4229c4ac0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 >> 172.21.15.52:0/1551043486 conn(0x55d42296d310 msgr2=0x55d42299f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 shutdown_connections 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.144+0000 7fd8552f8740 1 -- 172.21.15.52:0/1551043486 wait complete. 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd8552f8740 20 client.17523 trim_cache size 0 max 16384 2024-09-19T09:27:27.152 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 msgr2=0x7fd8340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 0x7fd8340a5700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd84400afd0 tx=0x7fd8440182d0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 msgr2=0x7fd84c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd84400b5b0 tx=0x7fd84400ba70 comp rx=0 tx=0).stop 2024-09-19T09:27:27.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 shutdown_connections 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd84c106f10 0x7fd84c074f70 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd84c102790 0x7fd84c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8340a3240 0x7fd8340a5700 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 --2- 172.21.15.52:0/1143567215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd84c101de0 0x7fd84c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 >> 172.21.15.52:0/1143567215 conn(0x7fd84c0fd8c0 msgr2=0x7fd84c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 shutdown_connections 2024-09-19T09:27:27.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:27.145+0000 7fd852f1f640 1 -- 172.21.15.52:0/1143567215 wait complete. 2024-09-19T09:27:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:26 smithi169 ceph-mon[35454]: pgmap v518: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:27:27.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3135853608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:27.244 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.244 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.244 INFO:tasks.workunit.client.0.smithi052.stdout:127/600: open fd = 3 2024-09-19T09:27:27.244 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:128/600: open fd = 3 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:129/600: open fd = 3 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:130/600: open fd = 3 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.245 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:131/600: open fd = 3 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:132/600: open fd = 3 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:133/600: open fd = 3 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.246 INFO:tasks.workunit.client.0.smithi052.stdout:134/600: open fd = 3 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:135/600: open fd = 3 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:136/600: open fd = 3 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:137/600: open fd = 3 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.247 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:138/600: open fd = 3 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:139/600: open fd = 3 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:140/600: open fd = 3 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.248 INFO:tasks.workunit.client.0.smithi052.stdout:141/600: open fd = 3 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:142/600: open fd = 3 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:143/600: open fd = 3 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:144/600: open fd = 3 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.249 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:145/600: open fd = 3 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:146/600: open fd = 3 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:147/600: open fd = 3 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.250 INFO:tasks.workunit.client.0.smithi052.stdout:148/600: open fd = 3 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:149/600: open fd = 3 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:150/600: open fd = 3 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:151/600: open fd = 3 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.251 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:152/600: open fd = 3 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:153/600: open fd = 3 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.252 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:154/600: open fd = 3 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:155/600: open fd = 3 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:156/600: open fd = 3 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.253 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:157/600: open fd = 3 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:158/600: open fd = 3 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:159/600: open fd = 3 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:160/600: open fd = 3 2024-09-19T09:27:27.254 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.255 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:161/600: open fd = 3 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:162/600: open fd = 3 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:163/600: open fd = 3 2024-09-19T09:27:27.256 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:164/600: open fd = 3 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:165/600: open fd = 3 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:166/600: open fd = 3 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.257 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:167/600: open fd = 3 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:168/600: open fd = 3 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:169/600: open fd = 3 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:170/600: open fd = 3 2024-09-19T09:27:27.258 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:171/600: open fd = 3 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:172/600: open fd = 3 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:173/600: open fd = 3 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.259 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:174/600: open fd = 3 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:175/600: open fd = 3 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:176/600: open fd = 3 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.260 INFO:tasks.workunit.client.0.smithi052.stdout:177/600: open fd = 3 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:178/600: open fd = 3 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:179/600: open fd = 3 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:180/600: open fd = 3 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.261 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:181/600: open fd = 3 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:182/600: open fd = 3 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:183/600: open fd = 3 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:184/600: open fd = 3 2024-09-19T09:27:27.262 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:185/600: open fd = 3 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:186/600: open fd = 3 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:187/600: open fd = 3 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.263 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:27:27.264 INFO:tasks.workunit.client.0.smithi052.stdout:188/600: open fd = 3 2024-09-19T09:27:27.264 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.264 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:27:27.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:27:28.082 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 -- 172.21.15.52:0/1191878130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 msgr2=0x7f460810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1191878130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f460810bb50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009900 tx=0x7f45f402a480 comp rx=0 tx=0).stop 2024-09-19T09:27:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 -- 172.21.15.52:0/1191878130 shutdown_connections 2024-09-19T09:27:28.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1191878130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 0x7f460810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1191878130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f460810bb50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1191878130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f4608103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 -- 172.21.15.52:0/1191878130 >> 172.21.15.52:0/1191878130 conn(0x7f46080fc7a0 msgr2=0x7f46080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 -- 172.21.15.52:0/1191878130 shutdown_connections 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.572+0000 7f460f1e5640 1 -- 172.21.15.52:0/1191878130 wait complete. 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 Processor -- start 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 -- start start 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f46081984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 0x7f460819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111f70 con 0x7f4608103660 2024-09-19T09:27:28.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4608111df0 con 0x7f460810c170 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460f1e5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46081120f0 con 0x7f4608102d40 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43832/0 (socket says 172.21.15.52:43832) 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 -- 172.21.15.52:0/1889378616 learned_addr learned my addr 172.21.15.52:0/1889378616 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460d782640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 0x7f460819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460cf81640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f46081984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 -- 172.21.15.52:0/1889378616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 msgr2=0x7f46081984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f46081984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 -- 172.21.15.52:0/1889378616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 msgr2=0x7f460819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 0x7f460819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f4607fff640 1 -- 172.21.15.52:0/1889378616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460819d480 con 0x7f4608103660 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.573+0000 7f460cf81640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f46081984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f4607fff640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006010 tx=0x7f45f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f4605ffb640 1 -- 172.21.15.52:0/1889378616 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f403f030 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f4605ffb640 1 -- 172.21.15.52:0/1889378616 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f4003ce0 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460819d710 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f4605ffb640 1 -- 172.21.15.52:0/1889378616 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4035070 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.574+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46081a5050 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.576+0000 7f4605ffb640 1 -- 172.21.15.52:0/1889378616 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f45f4042030 con 0x7f4608103660 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 Processor -- start 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 -- start start 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e40a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e4d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5654c3da62f0 con 0x5654c3e41b40 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5654c3d4dcf0 con 0x5654c3e405d0 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f46115be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5654c3da22b0 con 0x5654c3e4b370 2024-09-19T09:27:28.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f4605ffb640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 0x7f45f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460d782640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460d782640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43840/0 (socket says 172.21.15.52:43840) 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460d782640 1 -- 172.21.15.52:0/2820329535 learned_addr learned my addr 172.21.15.52:0/2820329535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e40a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f4605ffb640 1 -- 172.21.15.52:0/1889378616 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45f40efef0 con 0x7f4608103660 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460d782640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 0x7f45f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f4607fff640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e4d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 -- 172.21.15.52:0/2820329535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 msgr2=0x5654c3e4d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e4d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 -- 172.21.15.52:0/2820329535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 msgr2=0x5654c3e40090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.577+0000 7f460cf81640 1 -- 172.21.15.52:0/2820329535 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c3d323a0 con 0x5654c3e405d0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f4607fff640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e4d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f460d782640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f460cf81640 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e40a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00bab0 tx=0x7f45fc00bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ffe6754ce6cbcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f460d782640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 0x7f45f80a5780 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f46000098b0 tx=0x7f4600009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f45f2ffd640 1 -- 172.21.15.52:0/2820329535 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc017420 con 0x5654c3e405d0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f45f2ffd640 1 -- 172.21.15.52:0/2820329535 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc017aa0 con 0x5654c3e405d0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.578+0000 7f45f2ffd640 1 -- 172.21.15.52:0/2820329535 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00fa10 con 0x5654c3e405d0 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- 172.21.15.52:0/2820329535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 msgr2=0x5654c3e40a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e40a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00bab0 tx=0x7f45fc00bf70 comp rx=0 tx=0).stop 2024-09-19T09:27:28.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- 172.21.15.52:0/2820329535 shutdown_connections 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e4d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e40a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 --2- 172.21.15.52:0/2820329535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- 172.21.15.52:0/2820329535 >> 172.21.15.52:0/2820329535 conn(0x5654c3e09310 msgr2=0x5654c3e3cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- 172.21.15.52:0/2820329535 shutdown_connections 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- 172.21.15.52:0/2820329535 wait complete. 2024-09-19T09:27:28.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 -- start start 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.579+0000 7f46115be740 1 Processor -- start 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e4ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e48530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5654c3e4e070 con 0x5654c3e41b40 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5654c3d61060 con 0x5654c3e405d0 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5654c3e4e1f0 con 0x5654c3e4b370 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 10 client.0 _ll_register_callbacks cb 0x5654c3ab48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43850/0 (socket says 172.21.15.52:43850) 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 -- 172.21.15.52:0/1063340495 learned_addr learned my addr 172.21.15.52:0/1063340495 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f460d782640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e48530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f460cf81640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e4ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 -- 172.21.15.52:0/1063340495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 msgr2=0x5654c3e48530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e48530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 -- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 msgr2=0x5654c3e4ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e4ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 -- 172.21.15.52:0/1063340495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c3b173c0 con 0x5654c3e41b40 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f460cf81640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e4ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f4607fff640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f45f40b89b0 tx=0x7f45f40bc320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8356f9c979808d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f45e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4049070 con 0x5654c3e41b40 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45f40c4d30 con 0x5654c3e41b40 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.580+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45fc017aa0 con 0x5654c3e41b40 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45f40bbeb0 con 0x5654c3e41b40 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 10 client.17535 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:28.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654c3e59a10 con 0x5654c3e41b40 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc017aa0 con 0x5654c3e41b40 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45f403bbb0 con 0x5654c3e41b40 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 10 client.17535 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 10 client.17535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 20 client.17535 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3e5aec0 0x5654c3e5d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 4 client.17535 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c3db3860 con 0x5654c3e5aec0 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.581+0000 7f460cf81640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3e5aec0 0x5654c3e5d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.582+0000 7f45e7fff640 10 client.17535 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.582+0000 7f460cf81640 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3e5aec0 0x5654c3e5d2f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f925fda9f5cd22d7 server_cookie=7303c4b3acc0749b in_seq=0 out_seq=0 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.582+0000 7f45e7fff640 1 -- 172.21.15.52:0/1063340495 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654c3db3860 con 0x5654c3e5aec0 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.582+0000 7f45e7fff640 10 client.17535 handle_command_reply: tid=0 2024-09-19T09:27:28.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.582+0000 7f46115be740 1 client.17535 shutdown 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 msgr2=0x5654c3e47fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f45f40b89b0 tx=0x7f45f40bc320 comp rx=0 tx=0).stop 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 shutdown_connections 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e4b370 0x5654c3e48530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e47fb0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3e5aec0 0x5654c3e5d2f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 --2- 172.21.15.52:0/1063340495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e405d0 0x5654c3e4ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f45e7fff640 0 client.17535 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 >> 172.21.15.52:0/1063340495 conn(0x5654c3e09310 msgr2=0x5654c3e42960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 shutdown_connections 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 1 -- 172.21.15.52:0/1063340495 wait complete. 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.583+0000 7f46115be740 20 client.17535 trim_cache size 0 max 16384 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 Processor -- start 2024-09-19T09:27:28.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 -- start start 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e49f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 0x5654c3e43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46081affa0 con 0x5654c3e4b370 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ad870 con 0x5654c3e41b40 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f46115be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ab6c0 con 0x5654c3e405d0 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f460d782640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f460d782640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43860/0 (socket says 172.21.15.52:43860) 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f460d782640 1 -- 172.21.15.52:0/3756006046 learned_addr learned my addr 172.21.15.52:0/3756006046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f460cf81640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e49f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.596+0000 7f4607fff640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 0x5654c3e43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 -- 172.21.15.52:0/3756006046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 msgr2=0x5654c3e49f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e49f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 -- 172.21.15.52:0/3756006046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 msgr2=0x5654c3e43120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 0x5654c3e43120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 -- 172.21.15.52:0/3756006046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c3e46520 con 0x5654c3e4b370 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460cf81640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e49f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f4607fff640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 0x5654c3e43120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f460d782640 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4600012930 tx=0x7f460000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8976f9071dd4e992 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f45f27fc640 1 -- 172.21.15.52:0/3756006046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600012d70 con 0x5654c3e4b370 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f45f27fc640 1 -- 172.21.15.52:0/3756006046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f460001e970 con 0x5654c3e4b370 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.597+0000 7f45f27fc640 1 -- 172.21.15.52:0/3756006046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600005320 con 0x5654c3e4b370 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- 172.21.15.52:0/3756006046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 msgr2=0x5654c3e43660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4600012930 tx=0x7f460000c000 comp rx=0 tx=0).stop 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- 172.21.15.52:0/3756006046 shutdown_connections 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e4b370 0x5654c3e43660 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e41b40 0x5654c3e43120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- 172.21.15.52:0/3756006046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e49f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- 172.21.15.52:0/3756006046 >> 172.21.15.52:0/3756006046 conn(0x5654c3e09310 msgr2=0x5654c3e49810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- 172.21.15.52:0/3756006046 shutdown_connections 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- 172.21.15.52:0/3756006046 wait complete. 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- start start 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 Processor -- start 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e53480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 0x5654c3e50450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46081abd30 con 0x5654c3e41b40 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ad1a0 con 0x5654c3e4b370 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46081ac400 con 0x5654c3e405d0 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.598+0000 7f46115be740 10 client.0 _ll_register_callbacks cb 0x7f45f4005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43872/0 (socket says 172.21.15.52:43872) 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 -- 172.21.15.52:0/1221246221 learned_addr learned my addr 172.21.15.52:0/1221246221 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f460cf81640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e53480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f460d782640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 0x5654c3e50450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 -- 172.21.15.52:0/1221246221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 msgr2=0x5654c3e53480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e53480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 -- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 msgr2=0x5654c3e50450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 0x5654c3e50450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 -- 172.21.15.52:0/1221246221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c3e50990 con 0x5654c3e41b40 2024-09-19T09:27:28.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f460d782640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 0x5654c3e50450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f4607fff640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f45f40bc250 tx=0x7f45f4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1013544209b47338 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f45e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4049070 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45f4003800 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f460001e970 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45f40044e0 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f46115be740 10 client.17541 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.599+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654c3e50990 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f460001e970 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45f40b82a0 con 0x5654c3e41b40 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 10 client.17541 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:28.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 10 client.17541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 20 client.17541 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3ec6700 0x5654c3ec8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 4 client.17541 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:28.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654c3dadd70 con 0x5654c3ec6700 2024-09-19T09:27:28.621 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f460cf81640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3ec6700 0x5654c3ec8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f45e7fff640 10 client.17541 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.600+0000 7f460cf81640 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3ec6700 0x5654c3ec8b20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a604b37e655d015 server_cookie=3b5de480b512d07c in_seq=0 out_seq=0 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f45e7fff640 1 -- 172.21.15.52:0/1221246221 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654c3dadd70 con 0x5654c3ec6700 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f45e7fff640 10 client.17541 handle_command_reply: tid=0 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 client.17541 shutdown 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 msgr2=0x5654c3e539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f45f40bc250 tx=0x7f45f4005c00 comp rx=0 tx=0).stop 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 shutdown_connections 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5654c3ec6700 0x5654c3ec8b20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654c3e4b370 0x5654c3e50450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654c3e41b40 0x5654c3e539c0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f45e7fff640 0 client.17541 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 --2- 172.21.15.52:0/1221246221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654c3e405d0 0x5654c3e53480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 >> 172.21.15.52:0/1221246221 conn(0x5654c3e09310 msgr2=0x5654c3e4a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 shutdown_connections 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 1 -- 172.21.15.52:0/1221246221 wait complete. 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f46115be740 20 client.17541 trim_cache size 0 max 16384 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 msgr2=0x7f45f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 0x7f45f80a5780 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f46000098b0 tx=0x7f4600009600 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 msgr2=0x7f4608198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.601+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f45f4006010 tx=0x7f45f40042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 shutdown_connections 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f460810c170 0x7f460819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608103660 0x7f4608198a10 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45f80a32c0 0x7f45f80a5780 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 --2- 172.21.15.52:0/1889378616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4608102d40 0x7f46081984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 >> 172.21.15.52:0/1889378616 conn(0x7f46080fc7a0 msgr2=0x7f46080fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 shutdown_connections 2024-09-19T09:27:28.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:28.602+0000 7f460f1e5640 1 -- 172.21.15.52:0/1889378616 wait complete. 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 -- 172.21.15.52:0/3742684934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38104f10 msgr2=0x7fad38107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/3742684934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38104f10 0x7fad38107300 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009900 tx=0x7fad2c02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 -- 172.21.15.52:0/3742684934 shutdown_connections 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/3742684934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad38107840 0x7fad38109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/3742684934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38104f10 0x7fad38107300 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/3742684934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad381025e0 0x7fad381049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 -- 172.21.15.52:0/3742684934 >> 172.21.15.52:0/3742684934 conn(0x7fad380fc1c0 msgr2=0x7fad380fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 -- 172.21.15.52:0/3742684934 shutdown_connections 2024-09-19T09:27:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.714+0000 7fad3c9e4640 1 -- 172.21.15.52:0/3742684934 wait complete. 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 Processor -- start 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 -- start start 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad381025e0 0x7fad38197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad38104f10 0x7fad38198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810d870 con 0x7fad38107840 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810d6f0 con 0x7fad38104f10 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3c9e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad3810d9f0 con 0x7fad381025e0 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43900/0 (socket says 172.21.15.52:43900) 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 -- 172.21.15.52:0/414518423 learned_addr learned my addr 172.21.15.52:0/414518423 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad35d9b640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad38104f10 0x7fad38198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad3659c640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad381025e0 0x7fad38197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 -- 172.21.15.52:0/414518423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad381025e0 msgr2=0x7fad38197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad381025e0 0x7fad38197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 -- 172.21.15.52:0/414518423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad38104f10 msgr2=0x7fad38198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad38104f10 0x7fad38198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 -- 172.21.15.52:0/414518423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3819fa50 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.715+0000 7fad36d9d640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fad3000eb40 tx=0x7fad3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.716+0000 7fad277fe640 1 -- 172.21.15.52:0/414518423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30004b20 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.716+0000 7fad277fe640 1 -- 172.21.15.52:0/414518423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad30004cc0 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.716+0000 7fad277fe640 1 -- 172.21.15.52:0/414518423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad30010850 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.716+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3819fd40 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.716+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad381a0250 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.718+0000 7fad277fe640 1 -- 172.21.15.52:0/414518423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fad30005020 con 0x7fad38107840 2024-09-19T09:27:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.718+0000 7fad3f856740 1 Processor -- start 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 -- start start 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 0x56388fd7d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56388fcd72f0 con 0x56388fd7d780 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56388fc7f270 con 0x56388fd77db0 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3f856740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56388fcd32b0 con 0x56388fd786f0 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43910/0 (socket says 172.21.15.52:43910) 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 -- 172.21.15.52:0/1113676089 learned_addr learned my addr 172.21.15.52:0/1113676089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3659c640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 0x56388fd7d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad277fe640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 0x7fad200a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 -- 172.21.15.52:0/1113676089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 msgr2=0x56388fd7d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 0x56388fd7d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad36d9d640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 0x7fad200a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 -- 172.21.15.52:0/1113676089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 msgr2=0x56388fd781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad35d9b640 1 -- 172.21.15.52:0/1113676089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388fc7e340 con 0x56388fd7d780 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad3659c640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 0x56388fd7d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.719+0000 7fad277fe640 1 -- 172.21.15.52:0/414518423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fad300d00a0 con 0x7fad38107840 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad35d9b640 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000c00 tx=0x7fad2c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aacfa543a26c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad24ff9640 1 -- 172.21.15.52:0/1113676089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c035070 con 0x56388fd7d780 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad36d9d640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 0x7fad200a5830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad30017000 tx=0x7fad30091b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad24ff9640 1 -- 172.21.15.52:0/1113676089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad2c003ad0 con 0x56388fd7d780 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad24ff9640 1 -- 172.21.15.52:0/1113676089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c03da60 con 0x56388fd7d780 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad3f856740 1 -- 172.21.15.52:0/1113676089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 msgr2=0x56388fd7fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.720+0000 7fad3f856740 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fad2c000c00 tx=0x7fad2c005780 comp rx=0 tx=0).stop 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- 172.21.15.52:0/1113676089 shutdown_connections 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd7fc40 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd786f0 0x56388fd7d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- 172.21.15.52:0/1113676089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- 172.21.15.52:0/1113676089 >> 172.21.15.52:0/1113676089 conn(0x56388fd6f010 msgr2=0x56388fd6f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- 172.21.15.52:0/1113676089 shutdown_connections 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- 172.21.15.52:0/1113676089 wait complete. 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- start start 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 Processor -- start 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd81f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd824b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56388fd806f0 con 0x56388fd7d780 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56388fc60290 con 0x56388fd786f0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56388fd80870 con 0x56388fd77db0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad3f856740 10 client.0 _ll_register_callbacks cb 0x56388fc91140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.721+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43926/0 (socket says 172.21.15.52:43926) 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 -- 172.21.15.52:0/3159538993 learned_addr learned my addr 172.21.15.52:0/3159538993 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad3659c640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd824b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd81f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 -- 172.21.15.52:0/3159538993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 msgr2=0x56388fd81f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd81f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 -- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 msgr2=0x56388fd824b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd824b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 -- 172.21.15.52:0/3159538993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388f9ea210 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0096c0 tx=0x7fad2c04b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996f04aa297d01b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c035030 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fad2c045070 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad2c003ad0 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad2c0035f0 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad3f856740 10 client.17553 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.722+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56388fab6620 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad2c003ad0 con 0x56388fd7d780 2024-09-19T09:27:28.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad2c031a70 con 0x56388fd7d780 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 10 client.17553 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 20 client.17553 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd8d7f0 0x56388fd8fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 4 client.17553 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388fce4a20 con 0x56388fd8d7f0 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3659c640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd8d7f0 0x56388fd8fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad1dffb640 10 client.17553 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.723+0000 7fad3659c640 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd8d7f0 0x56388fd8fbe0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f83126fc652c4b35 server_cookie=5a94abf6c2fa7de9 in_seq=0 out_seq=0 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad1dffb640 1 -- 172.21.15.52:0/3159538993 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56388fce4a20 con 0x56388fd8d7f0 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad1dffb640 10 client.17553 handle_command_reply: tid=0 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 client.17553 shutdown 2024-09-19T09:27:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 msgr2=0x56388fd894f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0096c0 tx=0x7fad2c04b040 comp rx=0 tx=0).stop 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 shutdown_connections 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd8d7f0 0x56388fd8fbe0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd7d780 0x56388fd894f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd824b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad1dffb640 0 client.17553 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 --2- 172.21.15.52:0/3159538993 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd81f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 >> 172.21.15.52:0/3159538993 conn(0x56388fd6f010 msgr2=0x56388fd70820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 shutdown_connections 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.724+0000 7fad3f856740 1 -- 172.21.15.52:0/3159538993 wait complete. 2024-09-19T09:27:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.725+0000 7fad3f856740 20 client.17553 trim_cache size 0 max 16384 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 Processor -- start 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 -- start start 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd6f010 0x56388fd6e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd89410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a9820 con 0x56388fd786f0 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a70f0 con 0x56388fd77db0 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3f856740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a4f40 con 0x56388fd6f010 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43936/0 (socket says 172.21.15.52:43936) 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 -- 172.21.15.52:0/725625589 learned_addr learned my addr 172.21.15.52:0/725625589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3659c640 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd89410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 -- 172.21.15.52:0/725625589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd6f010 msgr2=0x56388fd6e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd6f010 0x56388fd6e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 -- 172.21.15.52:0/725625589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 msgr2=0x56388fd89410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd89410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad35d9b640 1 -- 172.21.15.52:0/725625589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388fd809b0 con 0x56388fd786f0 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.739+0000 7fad3659c640 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd89410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad35d9b640 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fad2c031610 tx=0x7fad2c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5358f2141b9791df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad1ffff640 1 -- 172.21.15.52:0/725625589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c035040 con 0x56388fd786f0 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad1ffff640 1 -- 172.21.15.52:0/725625589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad2c03cdc0 con 0x56388fd786f0 2024-09-19T09:27:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad1ffff640 1 -- 172.21.15.52:0/725625589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c031790 con 0x56388fd786f0 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 -- 172.21.15.52:0/725625589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 msgr2=0x56388fd943b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fad2c031610 tx=0x7fad2c031400 comp rx=0 tx=0).stop 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 -- 172.21.15.52:0/725625589 shutdown_connections 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd786f0 0x56388fd943b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd77db0 0x56388fd89410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 --2- 172.21.15.52:0/725625589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd6f010 0x56388fd6e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 -- 172.21.15.52:0/725625589 >> 172.21.15.52:0/725625589 conn(0x56388fd7d2a0 msgr2=0x56388fd6d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 -- 172.21.15.52:0/725625589 shutdown_connections 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.740+0000 7fad3f856740 1 -- 172.21.15.52:0/725625589 wait complete. 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 -- start start 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 Processor -- start 2024-09-19T09:27:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd87340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd88300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a55b0 con 0x56388fd6f010 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a6a20 con 0x56388fd786f0 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fad381a5c80 con 0x56388fd77db0 2024-09-19T09:27:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3f856740 10 client.0 _ll_register_callbacks cb 0x7fad2800d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43946/0 (socket says 172.21.15.52:43946) 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 -- 172.21.15.52:0/3034936722 learned_addr learned my addr 172.21.15.52:0/3034936722 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3659c640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd87340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd88300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 -- 172.21.15.52:0/3034936722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 msgr2=0x56388fd87340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd87340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 -- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 msgr2=0x56388fd88300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd88300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad35d9b640 1 -- 172.21.15.52:0/3034936722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388fd88910 con 0x56388fd6f010 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.741+0000 7fad3659c640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd87340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad35d9b640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fad2c03d010 tx=0x7fad2c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267c8c5cdbd5db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2c035070 con 0x56388fd6f010 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fad2c04f040 con 0x56388fd6f010 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad2c03cdc0 con 0x56388fd6f010 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad2c03d450 con 0x56388fd6f010 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 10 client.17559 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56388fdf8660 con 0x56388fd6f010 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad2c03cdc0 con 0x56388fd6f010 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fad2c0553f0 con 0x56388fd6f010 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 10 client.17559 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 10 client.17559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 20 client.17559 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd7d780 0x56388fdfaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:28.753 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 4 client.17559 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:27:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.742+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56388fcded70 con 0x56388fd7d780 2024-09-19T09:27:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.743+0000 7fad3659c640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd7d780 0x56388fdfaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.743+0000 7fad1dffb640 10 client.17559 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:28.754 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.743+0000 7fad3659c640 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd7d780 0x56388fdfaf00 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d66b5ce8edf4b6 server_cookie=7f018de802128795 in_seq=0 out_seq=0 2024-09-19T09:27:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.757+0000 7fad1dffb640 1 -- 172.21.15.52:0/3034936722 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56388fcded70 con 0x56388fd7d780 2024-09-19T09:27:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.757+0000 7fad1dffb640 10 client.17559 handle_command_reply: tid=0 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 client.17559 shutdown 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 msgr2=0x56388fd86e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fad2c03d010 tx=0x7fad2c005c00 comp rx=0 tx=0).stop 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 shutdown_connections 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56388fd7d780 0x56388fdfaf00 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56388fd786f0 0x56388fd88300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56388fd77db0 0x56388fd87340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.760 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad1dffb640 0 client.17559 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 --2- 172.21.15.52:0/3034936722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56388fd6f010 0x56388fd86e00 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 >> 172.21.15.52:0/3034936722 conn(0x56388fd7d2a0 msgr2=0x56388fd6e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 shutdown_connections 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 1 -- 172.21.15.52:0/3034936722 wait complete. 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3f856740 20 client.17559 trim_cache size 0 max 16384 2024-09-19T09:27:28.761 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:27:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:27:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:27:28.762 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:27:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 msgr2=0x7fad200a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 0x7fad200a5830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fad30017000 tx=0x7fad30091b20 comp rx=0 tx=0).stop 2024-09-19T09:27:28.763 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 msgr2=0x7fad3819f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fad3000eb40 tx=0x7fad3000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 shutdown_connections 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad38107840 0x7fad3819f3e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.758+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad38104f10 0x7fad38198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.759+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fad200a3370 0x7fad200a5830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.759+0000 7fad3c9e4640 1 --2- 172.21.15.52:0/414518423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad381025e0 0x7fad38197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:28.764 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.759+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 >> 172.21.15.52:0/414518423 conn(0x7fad380fc1c0 msgr2=0x7fad38102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.759+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 shutdown_connections 2024-09-19T09:27:28.765 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:28.759+0000 7fad3c9e4640 1 -- 172.21.15.52:0/414518423 wait complete. 2024-09-19T09:27:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:28 smithi052 ceph-mon[30947]: pgmap v519: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-19T09:27:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:28 smithi086 ceph-mon[34813]: pgmap v519: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-19T09:27:29.193 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:28 smithi169 ceph-mon[35454]: pgmap v519: 97 pgs: 97 active+clean; 2.9 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-19T09:27:29.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:27:29.645 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:30.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 -- 172.21.15.52:0/1034375655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f538010c170 msgr2=0x7f538010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 --2- 172.21.15.52:0/1034375655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f538010c170 0x7f538010e610 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5378009ca0 tx=0x7f537802a950 comp rx=0 tx=0).stop 2024-09-19T09:27:30.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 -- 172.21.15.52:0/1034375655 shutdown_connections 2024-09-19T09:27:30.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 --2- 172.21.15.52:0/1034375655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f538010c170 0x7f538010e610 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 --2- 172.21.15.52:0/1034375655 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5380103660 0x7f538010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 --2- 172.21.15.52:0/1034375655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 0x7f5380103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 -- 172.21.15.52:0/1034375655 >> 172.21.15.52:0/1034375655 conn(0x7f53800fc7a0 msgr2=0x7f53800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 -- 172.21.15.52:0/1034375655 shutdown_connections 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.131+0000 7f5384f13640 1 -- 172.21.15.52:0/1034375655 wait complete. 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 Processor -- start 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 -- start start 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 0x7f5380198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f538010c170 0x7f538019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5380111f50 con 0x7f5380103660 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5380111dd0 con 0x7f5380102d40 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f5384f13640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f53801120d0 con 0x7f538010c170 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43964/0 (socket says 172.21.15.52:43964) 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 -- 172.21.15.52:0/1670175947 learned_addr learned my addr 172.21.15.52:0/1670175947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537e59c640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 0x7f5380198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537ed9d640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f538010c170 0x7f538019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 -- 172.21.15.52:0/1670175947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f538010c170 msgr2=0x7f538019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f538010c170 0x7f538019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 -- 172.21.15.52:0/1670175947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 msgr2=0x7f5380198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 0x7f5380198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.132+0000 7f537dd9b640 1 -- 172.21.15.52:0/1670175947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538019d320 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f537dd9b640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f537000d750 tx=0x7f537000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f536f7fe640 1 -- 172.21.15.52:0/1670175947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370017070 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538019d610 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f536f7fe640 1 -- 172.21.15.52:0/1670175947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5370009820 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f536f7fe640 1 -- 172.21.15.52:0/1670175947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370004c60 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.133+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53801a4ef0 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.135+0000 7f536f7fe640 1 -- 172.21.15.52:0/1670175947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5370005220 con 0x7f5380103660 2024-09-19T09:27:30.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.135+0000 7f53872ec740 1 Processor -- start 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 -- start start 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc963090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc970760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc8c92f0 con 0x55d4fc9635d0 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc870cf0 con 0x55d4fc964b40 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f53872ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc8c52b0 con 0x55d4fc96e370 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43974/0 (socket says 172.21.15.52:43974) 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 -- 172.21.15.52:0/509564764 learned_addr learned my addr 172.21.15.52:0/509564764 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537ed9d640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc963090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f536f7fe640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 0x7f53680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537dd9b640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc970760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 -- 172.21.15.52:0/509564764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 msgr2=0x55d4fc970760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc970760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 -- 172.21.15.52:0/509564764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 msgr2=0x55d4fc963090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.136+0000 7f537e59c640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc963090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537e59c640 1 -- 172.21.15.52:0/509564764 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fc8553a0 con 0x55d4fc9635d0 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537ed9d640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc963090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537dd9b640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc970760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537ed9d640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 0x7f53680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f536f7fe640 1 -- 172.21.15.52:0/1670175947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f53700cf200 con 0x7f5380103660 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537e59c640 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f537400ad00 tx=0x7f537400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560e5cf039b74de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f536cff9640 1 -- 172.21.15.52:0/509564764 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537401d070 con 0x55d4fc9635d0 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f536cff9640 1 -- 172.21.15.52:0/509564764 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5374018b20 con 0x55d4fc9635d0 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f536cff9640 1 -- 172.21.15.52:0/509564764 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374010bc0 con 0x55d4fc9635d0 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.137+0000 7f537ed9d640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 0x7f53680a5700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5378005e30 tx=0x7f53780095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- 172.21.15.52:0/509564764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 msgr2=0x55d4fc963a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f537400ad00 tx=0x7f537400f790 comp rx=0 tx=0).stop 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- 172.21.15.52:0/509564764 shutdown_connections 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc970760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc963a10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 --2- 172.21.15.52:0/509564764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc963090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- 172.21.15.52:0/509564764 >> 172.21.15.52:0/509564764 conn(0x55d4fc92c310 msgr2=0x55d4fc95fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- 172.21.15.52:0/509564764 shutdown_connections 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- 172.21.15.52:0/509564764 wait complete. 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 -- start start 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.138+0000 7f53872ec740 1 Processor -- start 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc96b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc96b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc971070 con 0x55d4fc9635d0 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc884060 con 0x55d4fc964b40 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d4fc9711f0 con 0x55d4fc96e370 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 10 client.0 _ll_register_callbacks cb 0x55d4fc5d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43988/0 (socket says 172.21.15.52:43988) 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 -- 172.21.15.52:0/141941679 learned_addr learned my addr 172.21.15.52:0/141941679 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537dd9b640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc96b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 -- 172.21.15.52:0/141941679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 msgr2=0x55d4fc96b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc96b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 -- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 msgr2=0x55d4fc96b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc96b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 -- 172.21.15.52:0/141941679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4fc63a3c0 con 0x55d4fc9635d0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537dd9b640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc96b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f537e59c640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f537400a550 tx=0x7f53740186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce5de86bb5436fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f5365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537401d040 con 0x55d4fc9635d0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5374018b20 con 0x55d4fc9635d0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.139+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f53740108e0 con 0x55d4fc9635d0 2024-09-19T09:27:30.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5374010ae0 con 0x55d4fc9635d0 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 10 client.17571 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4fc97cab0 con 0x55d4fc9635d0 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5374018b20 con 0x55d4fc9635d0 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5374020030 con 0x55d4fc9635d0 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 10 client.17571 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 20 client.17571 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 4 client.17571 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:30.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4fc8d6860 con 0x55d4fc97de00 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.140+0000 7f537dd9b640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.141+0000 7f537dd9b640 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9801f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f161d238d4e9c6b server_cookie=3643c3efdcdb2e56 in_seq=0 out_seq=0 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.141+0000 7f5365ffb640 10 client.17571 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.141+0000 7f5365ffb640 1 -- 172.21.15.52:0/141941679 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4fc8d6860 con 0x55d4fc97de00 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.141+0000 7f5365ffb640 10 client.17571 handle_command_reply: tid=0 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.141+0000 7f53872ec740 1 client.17571 shutdown 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 msgr2=0x55d4fc96dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f537400a550 tx=0x7f53740186f0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 shutdown_connections 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9801f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f5365ffb640 0 client.17571 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc96b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc964b40 0x55d4fc96b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 --2- 172.21.15.52:0/141941679 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc96dd90 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 >> 172.21.15.52:0/141941679 conn(0x55d4fc92c310 msgr2=0x55d4fc965930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 shutdown_connections 2024-09-19T09:27:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 1 -- 172.21.15.52:0/141941679 wait complete. 2024-09-19T09:27:30.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.142+0000 7f53872ec740 20 client.17571 trim_cache size 0 max 16384 2024-09-19T09:27:30.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.155+0000 7f53872ec740 1 Processor -- start 2024-09-19T09:27:30.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.155+0000 7f53872ec740 1 -- start start 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.155+0000 7f53872ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f53872ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc964b40 0x55d4fc96a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f53872ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc96e370 0x55d4fc96f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f53872ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53801afff0 con 0x55d4fc9635d0 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f53872ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53801ad8c0 con 0x55d4fc96e370 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f53872ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f53801ab710 con 0x55d4fc964b40 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43994/0 (socket says 172.21.15.52:43994) 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 -- 172.21.15.52:0/1140586742 learned_addr learned my addr 172.21.15.52:0/1140586742 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:30.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537ed9d640 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc96e370 0x55d4fc96f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537dd9b640 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc964b40 0x55d4fc96a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 -- 172.21.15.52:0/1140586742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc964b40 msgr2=0x55d4fc96a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc964b40 0x55d4fc96a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 -- 172.21.15.52:0/1140586742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc96e370 msgr2=0x55d4fc96f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc96e370 0x55d4fc96f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 -- 172.21.15.52:0/1140586742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fc95e310 con 0x55d4fc9635d0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f537e59c640 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f537400fc90 tx=0x7f537400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579246f12a99c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f5367fff640 1 -- 172.21.15.52:0/1140586742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537403a070 con 0x55d4fc9635d0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f5367fff640 1 -- 172.21.15.52:0/1140586742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5374028070 con 0x55d4fc9635d0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.156+0000 7f5367fff640 1 -- 172.21.15.52:0/1140586742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537401d040 con 0x55d4fc9635d0 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- 172.21.15.52:0/1140586742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 msgr2=0x55d4fc97a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f537400fc90 tx=0x7f537400fdc0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- 172.21.15.52:0/1140586742 shutdown_connections 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc96e370 0x55d4fc96f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc964b40 0x55d4fc96a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 --2- 172.21.15.52:0/1140586742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc9635d0 0x55d4fc97a310 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- 172.21.15.52:0/1140586742 >> 172.21.15.52:0/1140586742 conn(0x55d4fc92c310 msgr2=0x55d4fc969910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- 172.21.15.52:0/1140586742 shutdown_connections 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- 172.21.15.52:0/1140586742 wait complete. 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.157+0000 7f53872ec740 1 -- start start 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 Processor -- start 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 0x55d4fc976cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc9858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f53801abd80 con 0x55d4fc964b40 2024-09-19T09:27:30.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53801ad1f0 con 0x55d4fc9635d0 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f53801ac450 con 0x55d4fc96e370 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f53872ec740 10 client.0 _ll_register_callbacks cb 0x7f537401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43998/0 (socket says 172.21.15.52:43998) 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 -- 172.21.15.52:0/2987269976 learned_addr learned my addr 172.21.15.52:0/2987269976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537e59c640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 0x55d4fc976cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537ed9d640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc9858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 -- 172.21.15.52:0/2987269976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 msgr2=0x55d4fc9858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc9858f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 -- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 msgr2=0x55d4fc976cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 0x55d4fc976cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537dd9b640 1 -- 172.21.15.52:0/2987269976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4fc9747d0 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.158+0000 7f537e59c640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 0x55d4fc976cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f537dd9b640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f53700ccc80 tx=0x7f537006a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c67e20c7edcf27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370020040 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5370099aa0 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5374028070 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f537009bea0 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 10 client.17577 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4fc9e8a00 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5374028070 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5374019ce0 con 0x55d4fc964b40 2024-09-19T09:27:30.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 10 client.17577 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 20 client.17577 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 4 client.17577 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.159+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4fc8d0d70 con 0x55d4fc97de00 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f537e59c640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f5365ffb640 10 client.17577 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f537e59c640 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9eb120 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80eec1c0722b914b server_cookie=615eb4641bb0fd07 in_seq=0 out_seq=0 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f5365ffb640 1 -- 172.21.15.52:0/2987269976 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4fc8d0d70 con 0x55d4fc97de00 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f5365ffb640 10 client.17577 handle_command_reply: tid=0 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 client.17577 shutdown 2024-09-19T09:27:30.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 msgr2=0x55d4fc985270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f53700ccc80 tx=0x7f537006a4e0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 shutdown_connections 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d4fc97de00 0x55d4fc9eb120 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d4fc96e370 0x55d4fc9858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d4fc964b40 0x55d4fc985270 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f5365ffb640 0 client.17577 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 --2- 172.21.15.52:0/2987269976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d4fc9635d0 0x55d4fc976cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.160+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 >> 172.21.15.52:0/2987269976 conn(0x55d4fc92c310 msgr2=0x55d4fc95e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 shutdown_connections 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f53872ec740 1 -- 172.21.15.52:0/2987269976 wait complete. 2024-09-19T09:27:30.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f53872ec740 20 client.17577 trim_cache size 0 max 16384 2024-09-19T09:27:30.171 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 msgr2=0x7f53680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 0x7f53680a5700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5378005e30 tx=0x7f53780095c0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 msgr2=0x7f53801988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f537000d750 tx=0x7f537000db50 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 shutdown_connections 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53680a3240 0x7f53680a5700 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f538010c170 0x7f538019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5380103660 0x7f53801988b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 --2- 172.21.15.52:0/1670175947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5380102d40 0x7f5380198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 >> 172.21.15.52:0/1670175947 conn(0x7f53800fc7a0 msgr2=0x7f53800fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 shutdown_connections 2024-09-19T09:27:30.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:30.161+0000 7f5384f13640 1 -- 172.21.15.52:0/1670175947 wait complete. 2024-09-19T09:27:30.835 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:30 smithi052 ceph-mon[30947]: pgmap v520: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:30.835 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:30 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:27:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:30 smithi086 ceph-mon[34813]: pgmap v520: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:30 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:27:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:30 smithi169 ceph-mon[35454]: pgmap v520: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:27:31.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:30 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:27:31.865 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:27:31.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:27:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:27:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:27:32.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:31 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:27:32.134 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:32.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:27:32.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:27:32.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:31 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:27:32.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:27:32.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:27:32.192 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:31 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 -- 172.21.15.52:0/3074012623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 msgr2=0x7f81101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 --2- 172.21.15.52:0/3074012623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f81101067e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8104009900 tx=0x7f810402a410 comp rx=0 tx=0).stop 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 -- 172.21.15.52:0/3074012623 shutdown_connections 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 --2- 172.21.15.52:0/3074012623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 0x7f811010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 --2- 172.21.15.52:0/3074012623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f81101067e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 --2- 172.21.15.52:0/3074012623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 0x7f81101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 -- 172.21.15.52:0/3074012623 >> 172.21.15.52:0/3074012623 conn(0x7f81100fd8c0 msgr2=0x7f81100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 -- 172.21.15.52:0/3074012623 shutdown_connections 2024-09-19T09:27:32.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.591+0000 7f8115112640 1 -- 172.21.15.52:0/3074012623 wait complete. 2024-09-19T09:27:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.592+0000 7f8115112640 1 Processor -- start 2024-09-19T09:27:32.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.592+0000 7f8115112640 1 -- start start 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 0x7f811019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 0x7f811019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8110111f70 con 0x7f8110102790 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8110111df0 con 0x7f8110101de0 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f8115112640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81101120f0 con 0x7f8110106f10 2024-09-19T09:27:32.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44016/0 (socket says 172.21.15.52:44016) 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 -- 172.21.15.52:0/3674696489 learned_addr learned my addr 172.21.15.52:0/3674696489 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810f59e640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 0x7f811019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 0x7f811019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 -- 172.21.15.52:0/3674696489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 msgr2=0x7f811019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 0x7f811019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 -- 172.21.15.52:0/3674696489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 msgr2=0x7f811019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 0x7f811019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 -- 172.21.15.52:0/3674696489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811019f5c0 con 0x7f8110102790 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.593+0000 7f810e59c640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8104006010 tx=0x7f81040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.594+0000 7f80f7fff640 1 -- 172.21.15.52:0/3674696489 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810403f030 con 0x7f8110102790 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.594+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811019f850 con 0x7f8110102790 2024-09-19T09:27:32.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.594+0000 7f80f7fff640 1 -- 172.21.15.52:0/3674696489 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8104003ce0 con 0x7f8110102790 2024-09-19T09:27:32.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.594+0000 7f80f7fff640 1 -- 172.21.15.52:0/3674696489 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104035070 con 0x7f8110102790 2024-09-19T09:27:32.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.594+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101a7190 con 0x7f8110102790 2024-09-19T09:27:32.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.596+0000 7f80f7fff640 1 -- 172.21.15.52:0/3674696489 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8104042030 con 0x7f8110102790 2024-09-19T09:27:32.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.596+0000 7f81174eb740 1 Processor -- start 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.596+0000 7f81174eb740 1 -- start start 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdddb60 0x5654efdddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f80f7fff640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdde480 0x5654efde8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5654efd43280 con 0x5654efde8d40 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5654efceab10 con 0x5654efdddb60 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f81174eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5654efd3f240 con 0x5654efdde480 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44032/0 (socket says 172.21.15.52:44032) 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 -- 172.21.15.52:0/3538241167 learned_addr learned my addr 172.21.15.52:0/3538241167 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:32.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f80f7fff640 1 -- 172.21.15.52:0/3674696489 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f81040eff10 con 0x7f8110102790 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810e59c640 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdde480 0x5654efde8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdddb60 0x5654efdddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 -- 172.21.15.52:0/3538241167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdde480 msgr2=0x5654efde8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdde480 0x5654efde8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 -- 172.21.15.52:0/3538241167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdddb60 msgr2=0x5654efdddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdddb60 0x5654efdddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 -- 172.21.15.52:0/3538241167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654efcf71f0 con 0x5654efde8d40 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810f59e640 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f8108012510 tx=0x7f810800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ed726c9a324695 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.597+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 0x7f80f80a5700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8100005fd0 tx=0x7f8100009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f80f57fa640 1 -- 172.21.15.52:0/3538241167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108005220 con 0x5654efde8d40 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f80f57fa640 1 -- 172.21.15.52:0/3538241167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8108004c80 con 0x5654efde8d40 2024-09-19T09:27:32.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f80f57fa640 1 -- 172.21.15.52:0/3538241167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080109c0 con 0x5654efde8d40 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 -- 172.21.15.52:0/3538241167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 msgr2=0x5654efdeb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f8108012510 tx=0x7f810800b780 comp rx=0 tx=0).stop 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 -- 172.21.15.52:0/3538241167 shutdown_connections 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efde8d40 0x5654efdeb130 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdde480 0x5654efde8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 --2- 172.21.15.52:0/3538241167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdddb60 0x5654efdddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 -- 172.21.15.52:0/3538241167 >> 172.21.15.52:0/3538241167 conn(0x5654efdda0f0 msgr2=0x5654efdda4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.598+0000 7f81174eb740 1 -- 172.21.15.52:0/3538241167 shutdown_connections 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 -- 172.21.15.52:0/3538241167 wait complete. 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 -- start start 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 Processor -- start 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efde6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5654efdeb910 con 0x5654efdde480 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5654efcfdf10 con 0x5654efde8d40 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5654efdeba90 con 0x5654efdddb60 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f81174eb740 10 client.0 _ll_register_callbacks cb 0x5654efcc6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:32.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44040/0 (socket says 172.21.15.52:44040) 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f810e59c640 1 -- 172.21.15.52:0/1418811388 learned_addr learned my addr 172.21.15.52:0/1418811388 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.599+0000 7f810f59e640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efde6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 -- 172.21.15.52:0/1418811388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 msgr2=0x5654efde5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 -- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 msgr2=0x5654efde6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efde6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 -- 172.21.15.52:0/1418811388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654efab46a0 con 0x5654efdde480 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f810e59c640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f81040b8a80 tx=0x7f81040095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c64af027aa99f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81040da060 con 0x5654efdde480 2024-09-19T09:27:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f81040b8c90 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8108004c80 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8104078050 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f81174eb740 10 client.17589 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654efdf7570 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8108004c80 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f81040bc880 con 0x5654efdde480 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f81174eb740 10 client.17589 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.600+0000 7f81174eb740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f81174eb740 20 client.17589 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efdf8910 0x5654efdfad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f81174eb740 4 client.17589 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654efd507f0 con 0x5654efdf8910 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efdf8910 0x5654efdfad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efdf8910 0x5654efdfad60 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e229590a8887d6a8 server_cookie=9954090d52eeef39 in_seq=0 out_seq=0 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.601+0000 7f80f2ff5640 10 client.17589 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f80f2ff5640 1 -- 172.21.15.52:0/1418811388 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654efd507f0 con 0x5654efdf8910 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f80f2ff5640 10 client.17589 handle_command_reply: tid=0 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 client.17589 shutdown 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 msgr2=0x5654efde61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f81040b8a80 tx=0x7f81040095d0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 shutdown_connections 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efdf8910 0x5654efdfad60 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efde6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efde61c0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 --2- 172.21.15.52:0/1418811388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f80f2ff5640 0 client.17589 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 >> 172.21.15.52:0/1418811388 conn(0x5654efdda0f0 msgr2=0x5654efddfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 shutdown_connections 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 1 -- 172.21.15.52:0/1418811388 wait complete. 2024-09-19T09:27:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.602+0000 7f81174eb740 20 client.17589 trim_cache size 0 max 16384 2024-09-19T09:27:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 Processor -- start 2024-09-19T09:27:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 -- start start 2024-09-19T09:27:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efe00bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81101b2290 con 0x5654efdde480 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81101afb60 con 0x5654efde8d40 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f81174eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81101ad9b0 con 0x5654efdddb60 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44054/0 (socket says 172.21.15.52:44054) 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 -- 172.21.15.52:0/1856101651 learned_addr learned my addr 172.21.15.52:0/1856101651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 -- 172.21.15.52:0/1856101651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 msgr2=0x5654efde7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 -- 172.21.15.52:0/1856101651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 msgr2=0x5654efe00bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efe00bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 -- 172.21.15.52:0/1856101651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654efde4c30 con 0x5654efdde480 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810ed9d640 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.620+0000 7f810e59c640 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f81040bc320 tx=0x7f81040bab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2dfb6498f0bd4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f80f4ff9640 1 -- 172.21.15.52:0/1856101651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81040da070 con 0x5654efdde480 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f80f4ff9640 1 -- 172.21.15.52:0/1856101651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81040ede50 con 0x5654efdde480 2024-09-19T09:27:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f80f4ff9640 1 -- 172.21.15.52:0/1856101651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104049040 con 0x5654efdde480 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- 172.21.15.52:0/1856101651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 msgr2=0x5654efe00670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f81040bc320 tx=0x7f81040bab30 comp rx=0 tx=0).stop 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- 172.21.15.52:0/1856101651 shutdown_connections 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efde8d40 0x5654efe00bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdde480 0x5654efe00670 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 --2- 172.21.15.52:0/1856101651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efdddb60 0x5654efde7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- 172.21.15.52:0/1856101651 >> 172.21.15.52:0/1856101651 conn(0x5654efdda0f0 msgr2=0x5654efde73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- 172.21.15.52:0/1856101651 shutdown_connections 2024-09-19T09:27:32.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- 172.21.15.52:0/1856101651 wait complete. 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.621+0000 7f81174eb740 1 -- start start 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 Processor -- start 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdde480 0x5654efdecef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efde8d40 0x5654efded430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81101ae020 con 0x5654efdddb60 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f81101af490 con 0x5654efdde480 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81101ae6f0 con 0x5654efde8d40 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f81174eb740 10 client.0 _ll_register_callbacks cb 0x7f8104003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44062/0 (socket says 172.21.15.52:44062) 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 -- 172.21.15.52:0/3118390230 learned_addr learned my addr 172.21.15.52:0/3118390230 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810e59c640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdde480 0x5654efdecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810f59e640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efde8d40 0x5654efded430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 -- 172.21.15.52:0/3118390230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efde8d40 msgr2=0x5654efded430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efde8d40 0x5654efded430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 -- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdde480 msgr2=0x5654efdecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdde480 0x5654efdecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 -- 172.21.15.52:0/3118390230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654efe62640 con 0x5654efdddb60 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f810ed9d640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f81000047b0 tx=0x7f8100004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0a5c749c521d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.622+0000 7f80f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100012650 con 0x5654efdddb60 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f81000127f0 con 0x5654efdddb60 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81040ede50 con 0x5654efdddb60 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8100035050 con 0x5654efdddb60 2024-09-19T09:27:32.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 10 client.17595 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5654efe638b0 con 0x5654efdddb60 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81040ede50 con 0x5654efdddb60 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f810000f040 con 0x5654efdddb60 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 10 client.17595 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 20 client.17595 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efe64080 0x5654efe664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 4 client.17595 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.623+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5654efd4ad00 con 0x5654efe64080 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.624+0000 7f810e59c640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efe64080 0x5654efe664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.624+0000 7f810e59c640 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efe64080 0x5654efe664a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d15162c32a9754 server_cookie=bd552762cdc7db04 in_seq=0 out_seq=0 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.624+0000 7f80f2ff5640 10 client.17595 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:32.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f80f2ff5640 1 -- 172.21.15.52:0/3118390230 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5654efd4ad00 con 0x5654efe64080 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f80f2ff5640 10 client.17595 handle_command_reply: tid=0 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 client.17595 shutdown 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 msgr2=0x5654efdec9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f81000047b0 tx=0x7f8100004ab0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 shutdown_connections 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5654efe64080 0x5654efe664a0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5654efde8d40 0x5654efded430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5654efdde480 0x5654efdecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 --2- 172.21.15.52:0/3118390230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5654efdddb60 0x5654efdec9b0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f80f2ff5640 0 client.17595 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 >> 172.21.15.52:0/3118390230 conn(0x5654efdda0f0 msgr2=0x5654efddfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 shutdown_connections 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.625+0000 7f81174eb740 1 -- 172.21.15.52:0/3118390230 wait complete. 2024-09-19T09:27:32.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f81174eb740 20 client.17595 trim_cache size 0 max 16384 2024-09-19T09:27:32.632 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:32.632 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:27:32.632 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "a5d7ac61-3857-438b-94df-b698001021ac", 2024-09-19T09:27:32.632 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:27:32.632 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 msgr2=0x7f80f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 0x7f80f80a5700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8100005fd0 tx=0x7f8100009680 comp rx=0 tx=0).stop 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 msgr2=0x7f811019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f8104006010 tx=0x7f81040042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 shutdown_connections 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f80f80a3240 0x7f80f80a5700 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8110106f10 0x7f811019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8110102790 0x7f811019ab50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 --2- 172.21.15.52:0/3674696489 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8110101de0 0x7f811019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:32.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 >> 172.21.15.52:0/3674696489 conn(0x7f81100fd8c0 msgr2=0x7f81100feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:32.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 shutdown_connections 2024-09-19T09:27:32.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:32.626+0000 7f8115112640 1 -- 172.21.15.52:0/3674696489 wait complete. 2024-09-19T09:27:33.283 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:33 smithi052 ceph-mon[30947]: pgmap v521: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:27:33.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:33 smithi169 ceph-mon[35454]: pgmap v521: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:27:33.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:33 smithi086 ceph-mon[34813]: pgmap v521: 97 pgs: 97 active+clean; 3.0 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:27:33.764 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:34.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:34 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:27:34.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:34 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:34 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:27:34.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:34 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:34 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:27:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 -- 172.21.15.52:0/2837283756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660106f10 msgr2=0x7fd66010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 --2- 172.21.15.52:0/2837283756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660106f10 0x7fd66010ea90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd658009ca0 tx=0x7fd65802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 -- 172.21.15.52:0/2837283756 shutdown_connections 2024-09-19T09:27:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 --2- 172.21.15.52:0/2837283756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660106f10 0x7fd66010ea90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 --2- 172.21.15.52:0/2837283756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 --2- 172.21.15.52:0/2837283756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660101de0 0x7fd6601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 -- 172.21.15.52:0/2837283756 >> 172.21.15.52:0/2837283756 conn(0x7fd6600fd8c0 msgr2=0x7fd6600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 -- 172.21.15.52:0/2837283756 shutdown_connections 2024-09-19T09:27:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.212+0000 7fd667752640 1 -- 172.21.15.52:0/2837283756 wait complete. 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 Processor -- start 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 -- start start 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660106f10 0x7fd66019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd660111f70 con 0x7fd660101de0 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd660111df0 con 0x7fd660102790 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd667752640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601120f0 con 0x7fd660106f10 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44082/0 (socket says 172.21.15.52:44082) 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd6654ee640 1 -- 172.21.15.52:0/2667045380 learned_addr learned my addr 172.21.15.52:0/2667045380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.213+0000 7fd664ced640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd665cef640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660106f10 0x7fd66019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 -- 172.21.15.52:0/2667045380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660106f10 msgr2=0x7fd66019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660106f10 0x7fd66019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 -- 172.21.15.52:0/2667045380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 msgr2=0x7fd6601988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 -- 172.21.15.52:0/2667045380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66019d360 con 0x7fd660101de0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd664ced640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d950 tx=0x7fd65c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6567fc640 1 -- 172.21.15.52:0/2667045380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c017070 con 0x7fd660101de0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66019d650 con 0x7fd660101de0 2024-09-19T09:27:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6567fc640 1 -- 172.21.15.52:0/2667045380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd65c009c30 con 0x7fd660101de0 2024-09-19T09:27:34.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd6567fc640 1 -- 172.21.15.52:0/2667045380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00f6b0 con 0x7fd660101de0 2024-09-19T09:27:34.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.214+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6601a4f30 con 0x7fd660101de0 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.217+0000 7fd6567fc640 1 -- 172.21.15.52:0/2667045380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd65c0109d0 con 0x7fd660101de0 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.217+0000 7fd669b2b740 1 Processor -- start 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.217+0000 7fd669b2b740 1 -- start start 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca615e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591ca56a2e0 con 0x5591ca604ce0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591ca511ce0 con 0x5591ca613a90 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd669b2b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5591ca5662a0 con 0x5591ca6043c0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd6567fc640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 0x7fd64c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd664ced640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca615e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44090/0 (socket says 172.21.15.52:44090) 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd6654ee640 1 -- 172.21.15.52:0/1332391308 learned_addr learned my addr 172.21.15.52:0/1332391308 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd665cef640 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd665cef640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 0x7fd64c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd6567fc640 1 -- 172.21.15.52:0/2667045380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd65c0cf890 con 0x7fd660101de0 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd664ced640 1 -- 172.21.15.52:0/1332391308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 msgr2=0x5591ca6047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.218+0000 7fd664ced640 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd664ced640 1 -- 172.21.15.52:0/1332391308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 msgr2=0x5591ca613550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd664ced640 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd664ced640 1 -- 172.21.15.52:0/1332391308 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ca4f6440 con 0x5591ca613a90 2024-09-19T09:27:34.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd6654ee640 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd664ced640 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca615e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd650009f20 tx=0x7fd6500118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37e55a2b85710fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd665cef640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 0x7fd64c0a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd658004af0 tx=0x7fd658004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd64b7fe640 1 -- 172.21.15.52:0/1332391308 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650004030 con 0x5591ca613a90 2024-09-19T09:27:34.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd64b7fe640 1 -- 172.21.15.52:0/1332391308 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd650005500 con 0x5591ca613a90 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.219+0000 7fd64b7fe640 1 -- 172.21.15.52:0/1332391308 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650004e10 con 0x5591ca613a90 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- 172.21.15.52:0/1332391308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 msgr2=0x5591ca615e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca615e80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd650009f20 tx=0x7fd6500118d0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- 172.21.15.52:0/1332391308 shutdown_connections 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca615e80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca613550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 --2- 172.21.15.52:0/1332391308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- 172.21.15.52:0/1332391308 >> 172.21.15.52:0/1332391308 conn(0x5591ca600a30 msgr2=0x5591ca600e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- 172.21.15.52:0/1332391308 shutdown_connections 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- 172.21.15.52:0/1332391308 wait complete. 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.220+0000 7fd669b2b740 1 -- start start 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 Processor -- start 2024-09-19T09:27:34.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6133e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca610690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5591ca616600 con 0x5591ca604ce0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5591ca525050 con 0x5591ca613a90 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5591ca616780 con 0x5591ca6043c0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd669b2b740 10 client.0 _ll_register_callbacks cb 0x5591ca565160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd665cef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd664ced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca610690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd665cef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:57398/0 (socket says 172.21.15.52:57398) 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd665cef640 1 -- 172.21.15.52:0/2180014871 learned_addr learned my addr 172.21.15.52:0/2180014871 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.221+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 -- 172.21.15.52:0/2180014871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 msgr2=0x5591ca6133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6133e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 -- 172.21.15.52:0/2180014871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 msgr2=0x5591ca610690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca610690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 -- 172.21.15.52:0/2180014871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ca2db3c0 con 0x5591ca613a90 2024-09-19T09:27:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd664ced640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca610690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd665cef640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd658035000 tx=0x7fd6580095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63676ee0a9df97c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd648ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6580309d0 con 0x5591ca613a90 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd650005500 con 0x5591ca613a90 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd658030b70 con 0x5591ca613a90 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd65805a030 con 0x5591ca613a90 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd669b2b740 10 client.26789 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.222+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5591ca622010 con 0x5591ca613a90 2024-09-19T09:27:34.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd650005500 con 0x5591ca613a90 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd658048040 con 0x5591ca613a90 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 10 client.26789 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 10 client.26789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 20 client.26789 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca623400 0x5591ca625880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 4 client.26789 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:34.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591ca577850 con 0x5591ca623400 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca623400 0x5591ca625880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd6654ee640 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca623400 0x5591ca625880 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=469855b25be42a76 server_cookie=d5827467794bd38 in_seq=0 out_seq=0 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.223+0000 7fd648ff9640 10 client.26789 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd648ff9640 1 -- 172.21.15.52:0/2180014871 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591ca577850 con 0x5591ca623400 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd648ff9640 10 client.26789 handle_command_reply: tid=0 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 client.26789 shutdown 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 msgr2=0x5591ca610bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd658035000 tx=0x7fd6580095c0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 shutdown_connections 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca623400 0x5591ca625880 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca610bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca610690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd648ff9640 0 client.26789 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 --2- 172.21.15.52:0/2180014871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca6043c0 0x5591ca6133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.224+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 >> 172.21.15.52:0/2180014871 conn(0x5591ca600a30 msgr2=0x5591ca5ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.225+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 shutdown_connections 2024-09-19T09:27:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.225+0000 7fd669b2b740 1 -- 172.21.15.52:0/2180014871 wait complete. 2024-09-19T09:27:34.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.225+0000 7fd669b2b740 20 client.26789 trim_cache size 0 max 16384 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 Processor -- start 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 -- start start 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca6043c0 0x5591ca61f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca613a90 0x5591ca6065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601aded0 con 0x5591ca604ce0 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601ab7a0 con 0x5591ca6043c0 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd669b2b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601a95f0 con 0x5591ca613a90 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd664ced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd664ced640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44108/0 (socket says 172.21.15.52:44108) 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd664ced640 1 -- 172.21.15.52:0/3179796548 learned_addr learned my addr 172.21.15.52:0/3179796548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd6654ee640 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca6043c0 0x5591ca61f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.242+0000 7fd665cef640 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca613a90 0x5591ca6065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 -- 172.21.15.52:0/3179796548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca613a90 msgr2=0x5591ca6065b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca613a90 0x5591ca6065b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 -- 172.21.15.52:0/3179796548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca6043c0 msgr2=0x5591ca61f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca6043c0 0x5591ca61f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 -- 172.21.15.52:0/3179796548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ca60f640 con 0x5591ca604ce0 2024-09-19T09:27:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd664ced640 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd650004940 tx=0x7fd650004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dca8fc6e42116cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd64affd640 1 -- 172.21.15.52:0/3179796548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650004040 con 0x5591ca604ce0 2024-09-19T09:27:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd64affd640 1 -- 172.21.15.52:0/3179796548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6500046c0 con 0x5591ca604ce0 2024-09-19T09:27:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.243+0000 7fd64affd640 1 -- 172.21.15.52:0/3179796548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6500035f0 con 0x5591ca604ce0 2024-09-19T09:27:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- 172.21.15.52:0/3179796548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 msgr2=0x5591ca60ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd650004940 tx=0x7fd650004970 comp rx=0 tx=0).stop 2024-09-19T09:27:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- 172.21.15.52:0/3179796548 shutdown_connections 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca613a90 0x5591ca6065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca604ce0 0x5591ca60ef60 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 --2- 172.21.15.52:0/3179796548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca6043c0 0x5591ca61f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- 172.21.15.52:0/3179796548 >> 172.21.15.52:0/3179796548 conn(0x5591ca600a30 msgr2=0x5591ca605ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- 172.21.15.52:0/3179796548 shutdown_connections 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- 172.21.15.52:0/3179796548 wait complete. 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 -- start start 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.244+0000 7fd669b2b740 1 Processor -- start 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca604ce0 0x5591ca617fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca68d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601a9c60 con 0x5591ca6043c0 2024-09-19T09:27:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601ab0d0 con 0x5591ca613a90 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6601aa330 con 0x5591ca604ce0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd669b2b740 10 client.0 _ll_register_callbacks cb 0x7fd6580318b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44118/0 (socket says 172.21.15.52:44118) 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 -- 172.21.15.52:0/4078884214 learned_addr learned my addr 172.21.15.52:0/4078884214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd664ced640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca604ce0 0x5591ca617fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd665cef640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca68d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 -- 172.21.15.52:0/4078884214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca604ce0 msgr2=0x5591ca617fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca604ce0 0x5591ca617fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 -- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 msgr2=0x5591ca68d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca68d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.245+0000 7fd6654ee640 1 -- 172.21.15.52:0/4078884214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ca618860 con 0x5591ca6043c0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd6654ee640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0cd360 tx=0x7fd65c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e08a0041894390 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c020040 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd65c098550 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6500046c0 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd65c0a4aa0 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 10 client.17613 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5591ca68e7e0 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6500046c0 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd65c097c30 con 0x5591ca6043c0 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 10 client.17613 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 20 client.17613 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca68eeb0 0x5591ca6912a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 4 client.17613 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.246+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591ca571d60 con 0x5591ca68eeb0 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd664ced640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca68eeb0 0x5591ca6912a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd664ced640 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca68eeb0 0x5591ca6912a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b526120ed854a66 server_cookie=47f342af477223fc in_seq=0 out_seq=0 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd648ff9640 10 client.17613 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd648ff9640 1 -- 172.21.15.52:0/4078884214 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5591ca571d60 con 0x5591ca68eeb0 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd648ff9640 10 client.17613 handle_command_reply: tid=0 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd669b2b740 1 client.17613 shutdown 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 msgr2=0x5591ca617a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd65c0cd360 tx=0x7fd65c01e000 comp rx=0 tx=0).stop 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.247+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 shutdown_connections 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5591ca68eeb0 0x5591ca6912a0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5591ca613a90 0x5591ca68d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5591ca604ce0 0x5591ca617fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 --2- 172.21.15.52:0/4078884214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5591ca6043c0 0x5591ca617a90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 >> 172.21.15.52:0/4078884214 conn(0x5591ca600a30 msgr2=0x5591ca611ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd648ff9640 0 client.17613 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 shutdown_connections 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 1 -- 172.21.15.52:0/4078884214 wait complete. 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd669b2b740 20 client.17613 trim_cache size 0 max 16384 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:27:34.254 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 msgr2=0x7fd64c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 0x7fd64c0a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd658004af0 tx=0x7fd658004a80 comp rx=0 tx=0).stop 2024-09-19T09:27:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 msgr2=0x7fd6601983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d950 tx=0x7fd65c00de10 comp rx=0 tx=0).stop 2024-09-19T09:27:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 shutdown_connections 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd64c0a3240 0x7fd64c0a5700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd660106f10 0x7fd66019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd660102790 0x7fd6601988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 --2- 172.21.15.52:0/2667045380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd660101de0 0x7fd6601983b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.248+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 >> 172.21.15.52:0/2667045380 conn(0x7fd6600fd8c0 msgr2=0x7fd6600febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.249+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 shutdown_connections 2024-09-19T09:27:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:34.249+0000 7fd667752640 1 -- 172.21.15.52:0/2667045380 wait complete. 2024-09-19T09:27:34.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:34 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:27:34.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:34 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:34 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:27:34.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:34 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:34 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:27:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:34 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:27:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:34 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:34 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:27:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:34 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:34 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:27:34.943 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:27:34.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:27:35.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:35 smithi052 ceph-mon[30947]: pgmap v522: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:35.204 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:35 smithi169 ceph-mon[35454]: pgmap v522: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:35 smithi086 ceph-mon[34813]: pgmap v522: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 -- 172.21.15.52:0/975526183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 msgr2=0x7f91c810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 --2- 172.21.15.52:0/975526183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c810da40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009ca0 tx=0x7f91c002a950 comp rx=0 tx=0).stop 2024-09-19T09:27:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 -- 172.21.15.52:0/975526183 shutdown_connections 2024-09-19T09:27:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 --2- 172.21.15.52:0/975526183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c810da40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 --2- 172.21.15.52:0/975526183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8102570 0x7f91c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 --2- 172.21.15.52:0/975526183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8100e20 0x7f91c8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.668+0000 7f91cfccd640 1 -- 172.21.15.52:0/975526183 >> 172.21.15.52:0/975526183 conn(0x7f91c80fc7d0 msgr2=0x7f91c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- 172.21.15.52:0/975526183 shutdown_connections 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- 172.21.15.52:0/975526183 wait complete. 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 Processor -- start 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- start start 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100e20 0x7f91c819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8102570 0x7f91c819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8110f80 con 0x7f91c8102ef0 2024-09-19T09:27:35.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8110e00 con 0x7f91c8100e20 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91cfccd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8111100 con 0x7f91c8102570 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.669+0000 7f91ce26a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44138/0 (socket says 172.21.15.52:44138) 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 -- 172.21.15.52:0/508806392 learned_addr learned my addr 172.21.15.52:0/508806392 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91cd268640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8102570 0x7f91c819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91cda69640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100e20 0x7f91c819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 -- 172.21.15.52:0/508806392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8102570 msgr2=0x7f91c819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8102570 0x7f91c819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 -- 172.21.15.52:0/508806392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100e20 msgr2=0x7f91c819a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100e20 0x7f91c819a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 -- 172.21.15.52:0/508806392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c819f610 con 0x7f91c8102ef0 2024-09-19T09:27:35.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91ce26a640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f91c002ae70 tx=0x7f91c002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0034040 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c0030920 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c819f8a0 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c00047f0 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.670+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81a71e0 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.671+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c81021b0 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.672+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91c0037020 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.673+0000 7f91beffd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.674+0000 7f91cda69640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.674+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f91c00f0900 con 0x7f91c8102ef0 2024-09-19T09:27:35.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.674+0000 7f91cda69640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 0x7f91b40a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:35.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.677+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91c00bd540 con 0x7f91c8102ef0 2024-09-19T09:27:35.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.889+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c81a73b0 con 0x7f91c8102ef0 2024-09-19T09:27:35.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.890+0000 7f91beffd640 1 -- 172.21.15.52:0/508806392 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f91c00bce40 con 0x7f91c8102ef0 2024-09-19T09:27:35.891 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:27:35.891 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:27:35.891 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 msgr2=0x7f91b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 0x7f91b40a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005fd0 tx=0x7f91c400b390 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 msgr2=0x7f91c819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f91c002ae70 tx=0x7f91c002f5d0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 shutdown_connections 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8102ef0 0x7f91c819ef30 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b40a3240 0x7f91b40a5700 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c8102570 0x7f91c819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 --2- 172.21.15.52:0/508806392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100e20 0x7f91c819a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:35.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 >> 172.21.15.52:0/508806392 conn(0x7f91c80fc7d0 msgr2=0x7f91c806a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:35.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 shutdown_connections 2024-09-19T09:27:35.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:35.892+0000 7f91cfccd640 1 -- 172.21.15.52:0/508806392 wait complete. 2024-09-19T09:27:36.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:36 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/508806392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:36.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:36 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/508806392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:36.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:36 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/508806392' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:36.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:27:36.903 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:37.293 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:37 smithi052 ceph-mon[30947]: pgmap v523: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:37.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.376+0000 7f68a9d59640 1 -- 172.21.15.52:0/1875654613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4102d40 msgr2=0x7f68a4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.376+0000 7f68a9d59640 1 --2- 172.21.15.52:0/1875654613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4102d40 0x7f68a4103120 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f6894009900 tx=0x7f689402a480 comp rx=0 tx=0).stop 2024-09-19T09:27:37.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.376+0000 7f68a9d59640 1 -- 172.21.15.52:0/1875654613 shutdown_connections 2024-09-19T09:27:37.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.376+0000 7f68a9d59640 1 --2- 172.21.15.52:0/1875654613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a410c170 0x7f68a410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.376+0000 7f68a9d59640 1 --2- 172.21.15.52:0/1875654613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a4103660 0x7f68a410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 --2- 172.21.15.52:0/1875654613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4102d40 0x7f68a4103120 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 -- 172.21.15.52:0/1875654613 >> 172.21.15.52:0/1875654613 conn(0x7f68a40fc7a0 msgr2=0x7f68a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 -- 172.21.15.52:0/1875654613 shutdown_connections 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 -- 172.21.15.52:0/1875654613 wait complete. 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 Processor -- start 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 -- start start 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.377+0000 7f68a9d59640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a4102d40 0x7f68a41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a410c170 0x7f68a4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68a4111f70 con 0x7f68a4103660 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68a4111df0 con 0x7f68a4102d40 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41120f0 con 0x7f68a410c170 2024-09-19T09:27:37.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44156/0 (socket says 172.21.15.52:44156) 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 -- 172.21.15.52:0/3444544123 learned_addr learned my addr 172.21.15.52:0/3444544123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a37fe640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a4102d40 0x7f68a41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a3fff640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a410c170 0x7f68a4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 -- 172.21.15.52:0/3444544123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a410c170 msgr2=0x7f68a4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a410c170 0x7f68a4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 -- 172.21.15.52:0/3444544123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a4102d40 msgr2=0x7f68a41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a4102d40 0x7f68a41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 -- 172.21.15.52:0/3444544123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a41aae20 con 0x7f68a4103660 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f689800d750 tx=0x7f689800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a0ff9640 1 -- 172.21.15.52:0/3444544123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898017070 con 0x7f68a4103660 2024-09-19T09:27:37.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a0ff9640 1 -- 172.21.15.52:0/3444544123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6898005020 con 0x7f68a4103660 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a41aaff0 con 0x7f68a4103660 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.378+0000 7f68a0ff9640 1 -- 172.21.15.52:0/3444544123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898004d00 con 0x7f68a4103660 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.379+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41ab450 con 0x7f68a4103660 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68a0ff9640 1 -- 172.21.15.52:0/3444544123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6898009a30 con 0x7f68a4103660 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 Processor -- start 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 -- start start 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04cb40 0x5620ac04b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac058760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5620abfb12f0 con 0x5620ac04b5d0 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5620abf58cf0 con 0x5620ac056370 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68ac132740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5620abfad2b0 con 0x5620ac04cb40 2024-09-19T09:27:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44164/0 (socket says 172.21.15.52:44164) 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.381+0000 7f68a37fe640 1 -- 172.21.15.52:0/4015842422 learned_addr learned my addr 172.21.15.52:0/4015842422 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a3fff640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04cb40 0x5620ac04b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac058760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 -- 172.21.15.52:0/4015842422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04cb40 msgr2=0x5620ac04b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04cb40 0x5620ac04b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 -- 172.21.15.52:0/4015842422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 msgr2=0x5620ac058760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac058760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 -- 172.21.15.52:0/4015842422 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620abf3d3a0 con 0x5620ac04b5d0 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac058760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a0ff9640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 0x7f688c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a3fff640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 0x7f688c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6894009900 tx=0x7f6894005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d35d07b5b50bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f68a0ff9640 1 -- 172.21.15.52:0/3444544123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68980cf310 con 0x7f68a4103660 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f6889ffb640 1 -- 172.21.15.52:0/4015842422 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894040070 con 0x5620ac04b5d0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f6889ffb640 1 -- 172.21.15.52:0/4015842422 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68940319f0 con 0x5620ac04b5d0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.382+0000 7f6889ffb640 1 -- 172.21.15.52:0/4015842422 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894035040 con 0x5620ac04b5d0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- 172.21.15.52:0/4015842422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 msgr2=0x5620ac04ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68a3fff640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 0x7f688c0a5700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f689c005fd0 tx=0x7f689c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f6894009900 tx=0x7f6894005e80 comp rx=0 tx=0).stop 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- 172.21.15.52:0/4015842422 shutdown_connections 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac058760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac04ba10 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 --2- 172.21.15.52:0/4015842422 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04cb40 0x5620ac04b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- 172.21.15.52:0/4015842422 >> 172.21.15.52:0/4015842422 conn(0x5620ac014310 msgr2=0x5620ac047c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- 172.21.15.52:0/4015842422 shutdown_connections 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- 172.21.15.52:0/4015842422 wait complete. 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.383+0000 7f68ac132740 1 -- start start 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 Processor -- start 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04b5d0 0x5620ac055cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac0534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5620ac059010 con 0x5620ac04cb40 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5620abf6c060 con 0x5620ac056370 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5620ac059190 con 0x5620ac04b5d0 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68ac132740 10 client.0 _ll_register_callbacks cb 0x5620abcbf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44170/0 (socket says 172.21.15.52:44170) 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 -- 172.21.15.52:0/1296520428 learned_addr learned my addr 172.21.15.52:0/1296520428 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a3fff640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac0534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a37fe640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04b5d0 0x5620ac055cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 -- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04b5d0 msgr2=0x5620ac055cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04b5d0 0x5620ac055cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 -- 172.21.15.52:0/1296520428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 msgr2=0x5620ac0534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac0534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.384+0000 7f68a2ffd640 1 -- 172.21.15.52:0/1296520428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620abd223c0 con 0x5620ac04cb40 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6898009610 tx=0x7f689809b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e67c02b61542fea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898020070 con 0x5620ac04cb40 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68980860b0 con 0x5620ac04cb40 2024-09-19T09:27:37.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68940319f0 con 0x5620ac04cb40 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6898099c60 con 0x5620ac04cb40 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 10 client.17631 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620ac0649c0 con 0x5620ac04cb40 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68940319f0 con 0x5620ac04cb40 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f689809ae40 con 0x5620ac04cb40 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 10 client.17631 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 10 client.17631 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 20 client.17631 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac065dd0 0x5620ac068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 4 client.17631 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:37.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.385+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620abfbe860 con 0x5620ac065dd0 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.386+0000 7f68a37fe640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac065dd0 0x5620ac068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.386+0000 7f68a37fe640 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac065dd0 0x5620ac068200 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=467dc5593c58e5a1 server_cookie=8cae31824db27312 in_seq=0 out_seq=0 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.386+0000 7f6882ffd640 10 client.17631 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f6882ffd640 1 -- 172.21.15.52:0/1296520428 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620abfbe860 con 0x5620ac065dd0 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f6882ffd640 10 client.17631 handle_command_reply: tid=0 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 client.17631 shutdown 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 msgr2=0x5620ac052f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6898009610 tx=0x7f689809b380 comp rx=0 tx=0).stop 2024-09-19T09:27:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 shutdown_connections 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac065dd0 0x5620ac068200 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac056370 0x5620ac0534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04cb40 0x5620ac052f70 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f6882ffd640 0 client.17631 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 --2- 172.21.15.52:0/1296520428 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac04b5d0 0x5620ac055cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 >> 172.21.15.52:0/1296520428 conn(0x5620ac014310 msgr2=0x5620ac04d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 shutdown_connections 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 1 -- 172.21.15.52:0/1296520428 wait complete. 2024-09-19T09:27:37.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.387+0000 7f68ac132740 20 client.17631 trim_cache size 0 max 16384 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 Processor -- start 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 -- start start 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac04e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac04e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b66d0 con 0x5620ac04b5d0 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b3fa0 con 0x5620ac04cb40 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68ac132740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b1df0 con 0x5620ac056370 2024-09-19T09:27:37.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44178/0 (socket says 172.21.15.52:44178) 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 -- 172.21.15.52:0/2047315928 learned_addr learned my addr 172.21.15.52:0/2047315928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac04e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a3fff640 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac04e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 -- 172.21.15.52:0/2047315928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 msgr2=0x5620ac04e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac04e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 -- 172.21.15.52:0/2047315928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 msgr2=0x5620ac04e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac04e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.401+0000 7f68a37fe640 1 -- 172.21.15.52:0/2047315928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ac04eba0 con 0x5620ac04b5d0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68a37fe640 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c00 tx=0x7f689402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2f6a53bd20ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68897fa640 1 -- 172.21.15.52:0/2047315928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894040050 con 0x5620ac04b5d0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68897fa640 1 -- 172.21.15.52:0/2047315928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6894005520 con 0x5620ac04b5d0 2024-09-19T09:27:37.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68897fa640 1 -- 172.21.15.52:0/2047315928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894035040 con 0x5620ac04b5d0 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 -- 172.21.15.52:0/2047315928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 msgr2=0x5620ac054ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6894000c00 tx=0x7f689402a480 comp rx=0 tx=0).stop 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 -- 172.21.15.52:0/2047315928 shutdown_connections 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac04e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac04e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 --2- 172.21.15.52:0/2047315928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac054ee0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.402+0000 7f68ac132740 1 -- 172.21.15.52:0/2047315928 >> 172.21.15.52:0/2047315928 conn(0x5620ac014310 msgr2=0x5620ac0547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- 172.21.15.52:0/2047315928 shutdown_connections 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- 172.21.15.52:0/2047315928 wait complete. 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- start start 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 Processor -- start 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac05eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac05b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b2460 con 0x5620ac04b5d0 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b38d0 con 0x5620ac04cb40 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68a41b2b30 con 0x5620ac056370 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68ac132740 10 client.0 _ll_register_callbacks cb 0x7f68980046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.403+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac05eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44186/0 (socket says 172.21.15.52:44186) 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 -- 172.21.15.52:0/4032612486 learned_addr learned my addr 172.21.15.52:0/4032612486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a3fff640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac05b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 -- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 msgr2=0x5620ac05b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac05b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 -- 172.21.15.52:0/4032612486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 msgr2=0x5620ac05eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:37.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac05eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 -- 172.21.15.52:0/4032612486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620ac05bc20 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68a37fe640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6894006010 tx=0x7f68940056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b5200aabc0f96d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f6882ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894060060 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6894004760 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6894005520 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6894035040 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68ac132740 10 client.17637 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.404+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5620ac0d1530 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6894005520 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f689405a030 con 0x5620ac04b5d0 2024-09-19T09:27:37.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 10 client.17637 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 10 client.17637 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 20 client.17637 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac0d1700 0x5620ac0d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 4 client.17637 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620abfb8d70 con 0x5620ac0d1700 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac0d1700 0x5620ac0d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f68a2ffd640 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac0d1700 0x5620ac0d3af0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47dad8d042366c6d server_cookie=93751eb60e946568 in_seq=0 out_seq=0 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.405+0000 7f6882ffd640 10 client.17637 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f6882ffd640 1 -- 172.21.15.52:0/4032612486 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620abfb8d70 con 0x5620ac0d1700 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f6882ffd640 10 client.17637 handle_command_reply: tid=0 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 client.17637 shutdown 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 msgr2=0x5620ac05e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6894006010 tx=0x7f68940056d0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 shutdown_connections 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5620ac0d1700 0x5620ac0d3af0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5620ac056370 0x5620ac05b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5620ac04cb40 0x5620ac05eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f6882ffd640 0 client.17637 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 --2- 172.21.15.52:0/4032612486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5620ac04b5d0 0x5620ac05e630 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 >> 172.21.15.52:0/4032612486 conn(0x5620ac014310 msgr2=0x5620ac054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 shutdown_connections 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 1 -- 172.21.15.52:0/4032612486 wait complete. 2024-09-19T09:27:37.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.406+0000 7f68ac132740 20 client.17637 trim_cache size 0 max 16384 2024-09-19T09:27:37.416 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:37.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 msgr2=0x7f688c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 0x7f688c0a5700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f689c005fd0 tx=0x7f689c009600 comp rx=0 tx=0).stop 2024-09-19T09:27:37.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 msgr2=0x7f68a4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f689800d750 tx=0x7f689800dc10 comp rx=0 tx=0).stop 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 shutdown_connections 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f688c0a3240 0x7f688c0a5700 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68a410c170 0x7f68a4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68a4103660 0x7f68a4100ee0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 --2- 172.21.15.52:0/3444544123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a4102d40 0x7f68a41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 >> 172.21.15.52:0/3444544123 conn(0x7f68a40fc7a0 msgr2=0x7f68a40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 shutdown_connections 2024-09-19T09:27:37.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:37.407+0000 7f68a9d59640 1 -- 172.21.15.52:0/3444544123 wait complete. 2024-09-19T09:27:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:37 smithi169 ceph-mon[35454]: pgmap v523: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:37 smithi086 ceph-mon[34813]: pgmap v523: 97 pgs: 97 active+clean; 3.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:38.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:27:38.460 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 -- 172.21.15.52:0/2664899271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 msgr2=0x7f2e7c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 --2- 172.21.15.52:0/2664899271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c103180 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009900 tx=0x7f2e7802a480 comp rx=0 tx=0).stop 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 -- 172.21.15.52:0/2664899271 shutdown_connections 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 --2- 172.21.15.52:0/2664899271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c10c180 0x7f2e7c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 --2- 172.21.15.52:0/2664899271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c1036c0 0x7f2e7c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 --2- 172.21.15.52:0/2664899271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c103180 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 -- 172.21.15.52:0/2664899271 >> 172.21.15.52:0/2664899271 conn(0x7f2e7c0fc7a0 msgr2=0x7f2e7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 -- 172.21.15.52:0/2664899271 shutdown_connections 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.901+0000 7f2e84529640 1 -- 172.21.15.52:0/2664899271 wait complete. 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 Processor -- start 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 -- start start 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c1036c0 0x7f2e7c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 0x7f2e7c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c111f60 con 0x7f2e7c102da0 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c111de0 con 0x7f2e7c10c180 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e84529640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1120e0 con 0x7f2e7c1036c0 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39686/0 (socket says 172.21.15.52:39686) 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 -- 172.21.15.52:0/2856659602 learned_addr learned my addr 172.21.15.52:0/2856659602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:38.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c1036c0 0x7f2e7c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 0x7f2e7c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 -- 172.21.15.52:0/2856659602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c1036c0 msgr2=0x7f2e7c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c1036c0 0x7f2e7c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 -- 172.21.15.52:0/2856659602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 msgr2=0x7f2e7c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 0x7f2e7c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e822c5640 1 -- 172.21.15.52:0/2856659602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c1a69a0 con 0x7f2e7c102da0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.902+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 0x7f2e7c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006010 tx=0x7f2e780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e737fe640 1 -- 172.21.15.52:0/2856659602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7803f030 con 0x7f2e7c102da0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c1a6c30 con 0x7f2e7c102da0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e737fe640 1 -- 172.21.15.52:0/2856659602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e78003ce0 con 0x7f2e7c102da0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e737fe640 1 -- 172.21.15.52:0/2856659602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78035070 con 0x7f2e7c102da0 2024-09-19T09:27:38.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.903+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c1a7160 con 0x7f2e7c102da0 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e737fe640 1 -- 172.21.15.52:0/2856659602 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2e78042030 con 0x7f2e7c102da0 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 Processor -- start 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 -- start start 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 0x5619ff9ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9ae5d0 0x5619ff9aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5619ff9142f0 con 0x5619ff9b9370 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5619ff8bbcf0 con 0x5619ff9ae5d0 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.906+0000 7f2e86902740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5619ff9102b0 con 0x5619ff9afb40 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39688/0 (socket says 172.21.15.52:39688) 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 -- 172.21.15.52:0/1510794685 learned_addr learned my addr 172.21.15.52:0/1510794685 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:38.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e822c5640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9ae5d0 0x5619ff9aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 0x5619ff9ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e737fe640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 0x7f2e680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 -- 172.21.15.52:0/1510794685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 msgr2=0x5619ff9ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 0x5619ff9ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 -- 172.21.15.52:0/1510794685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9ae5d0 msgr2=0x5619ff9aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9ae5d0 0x5619ff9aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 -- 172.21.15.52:0/1510794685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ff8a03a0 con 0x5619ff9b9370 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 0x5619ff9ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e737fe640 1 -- 172.21.15.52:0/2856659602 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2e780effe0 con 0x7f2e7c102da0 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 0x7f2e680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00bc80 tx=0x7f2e6c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e726ace09ba899a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.907+0000 7f2e70ff9640 1 -- 172.21.15.52:0/1510794685 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c015070 con 0x5619ff9b9370 2024-09-19T09:27:38.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e70ff9640 1 -- 172.21.15.52:0/1510794685 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e6c011920 con 0x5619ff9b9370 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e70ff9640 1 -- 172.21.15.52:0/1510794685 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0108b0 con 0x5619ff9b9370 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 -- 172.21.15.52:0/1510794685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 msgr2=0x5619ff9bb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00bc80 tx=0x7f2e6c00f730 comp rx=0 tx=0).stop 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 0x7f2e680a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2e74005fd0 tx=0x7f2e74004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 -- 172.21.15.52:0/1510794685 shutdown_connections 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9bb760 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9ae5d0 0x5619ff9aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 --2- 172.21.15.52:0/1510794685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9afb40 0x5619ff9ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 -- 172.21.15.52:0/1510794685 >> 172.21.15.52:0/1510794685 conn(0x5619ff977310 msgr2=0x5619ff9aac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 -- 172.21.15.52:0/1510794685 shutdown_connections 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.908+0000 7f2e86902740 1 -- 172.21.15.52:0/1510794685 wait complete. 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 -- start start 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 Processor -- start 2024-09-19T09:27:38.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5619ff9bc070 con 0x5619ff9afb40 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5619ff8cf060 con 0x5619ff9b9370 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5619ff9bc1f0 con 0x5619ff9ae5d0 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e86902740 10 client.0 _ll_register_callbacks cb 0x5619ff6228c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39694/0 (socket says 172.21.15.52:39694) 2024-09-19T09:27:38.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e81ac4640 1 -- 172.21.15.52:0/4191763801 learned_addr learned my addr 172.21.15.52:0/4191763801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e822c5640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.909+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 -- 172.21.15.52:0/4191763801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 msgr2=0x5619ff9b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 -- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 msgr2=0x5619ff9b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 -- 172.21.15.52:0/4191763801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619ff6853c0 con 0x5619ff9afb40 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c010410 tx=0x7f2e6c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed73c66261ff85ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c015070 con 0x5619ff9afb40 2024-09-19T09:27:38.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2e6c0116d0 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e6c011920 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e6c011ad0 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e86902740 10 client.17649 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5619ff9c7b20 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.910+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e6c011920 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2e6c005480 con 0x5619ff9afb40 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 10 client.17649 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 10 client.17649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 20 client.17649 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ff9cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 4 client.17649 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619ff921860 con 0x5619ff9c8e70 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e822c5640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ff9cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e822c5640 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ff9cb260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ed74c5e7652cce1 server_cookie=6de7a5f7cee59aab in_seq=0 out_seq=0 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.911+0000 7f2e65ffb640 10 client.17649 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e65ffb640 1 -- 172.21.15.52:0/4191763801 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619ff921860 con 0x5619ff9c8e70 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e65ffb640 10 client.17649 handle_command_reply: tid=0 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 client.17649 shutdown 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 msgr2=0x5619ff9b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c010410 tx=0x7f2e6c00bf80 comp rx=0 tx=0).stop 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 shutdown_connections 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ff9cb260 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e65ffb640 0 client.17649 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9b6000 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 --2- 172.21.15.52:0/4191763801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 >> 172.21.15.52:0/4191763801 conn(0x5619ff977310 msgr2=0x5619ff9b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 shutdown_connections 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 1 -- 172.21.15.52:0/4191763801 wait complete. 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.912+0000 7f2e86902740 20 client.17649 trim_cache size 0 max 16384 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.925+0000 7f2e86902740 1 Processor -- start 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 -- start start 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9c5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9afb40 0x5619ff9d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1b2320 con 0x5619ff9b9370 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1afbf0 con 0x5619ff9afb40 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e86902740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1ada40 con 0x5619ff9ae5d0 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39700/0 (socket says 172.21.15.52:39700) 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 -- 172.21.15.52:0/1807338635 learned_addr learned my addr 172.21.15.52:0/1807338635 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e822c5640 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9afb40 0x5619ff9d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 -- 172.21.15.52:0/1807338635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 msgr2=0x5619ff9c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 -- 172.21.15.52:0/1807338635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9afb40 msgr2=0x5619ff9d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9afb40 0x5619ff9d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 -- 172.21.15.52:0/1807338635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619ff9ab730 con 0x5619ff9b9370 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.926+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f2e740087e0 tx=0x7f2e74012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99b15cf4300ec2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e67fff640 1 -- 172.21.15.52:0/1807338635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7401c7c0 con 0x5619ff9b9370 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e67fff640 1 -- 172.21.15.52:0/1807338635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e7401ce40 con 0x5619ff9b9370 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e67fff640 1 -- 172.21.15.52:0/1807338635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e740103d0 con 0x5619ff9b9370 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- 172.21.15.52:0/1807338635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 msgr2=0x5619ff9d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f2e740087e0 tx=0x7f2e74012000 comp rx=0 tx=0).stop 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- 172.21.15.52:0/1807338635 shutdown_connections 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9b9370 0x5619ff9d0da0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9afb40 0x5619ff9d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 --2- 172.21.15.52:0/1807338635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- 172.21.15.52:0/1807338635 >> 172.21.15.52:0/1807338635 conn(0x5619ff977310 msgr2=0x5619ff9b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- 172.21.15.52:0/1807338635 shutdown_connections 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- 172.21.15.52:0/1807338635 wait complete. 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.927+0000 7f2e86902740 1 -- start start 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 Processor -- start 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1ae0b0 con 0x5619ff9afb40 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1af520 con 0x5619ff9b9370 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c1ae780 con 0x5619ff9ae5d0 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e86902740 10 client.0 _ll_register_callbacks cb 0x7f2e780f38f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39702/0 (socket says 172.21.15.52:39702) 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 -- 172.21.15.52:0/2321590089 learned_addr learned my addr 172.21.15.52:0/2321590089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e82ac6640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 -- 172.21.15.52:0/2321590089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 msgr2=0x5619ff9bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9bd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 -- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 msgr2=0x5619ff9bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 -- 172.21.15.52:0/2321590089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619ffa32830 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e81ac4640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006010 tx=0x7f2e6c004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7133021bd311f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.928+0000 7f2e65ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c015050 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2e6c004020 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619ff91bd70 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2e6c00bb00 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 10 client.17655 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5619ffa33ae0 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5619ff91bd70 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2e6c034070 con 0x5619ff9afb40 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 10 client.17655 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 10 client.17655 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 20 client.17655 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:38.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ffa36260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 4 client.17655 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619ff898170 con 0x5619ff9c8e70 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.929+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ffa36260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e65ffb640 10 client.17655 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e822c5640 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ffa36260 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90d1df7e420ab629 server_cookie=f5fcf1648aa80302 in_seq=0 out_seq=0 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e65ffb640 1 -- 172.21.15.52:0/2321590089 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619ff898170 con 0x5619ff9c8e70 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e65ffb640 10 client.17655 handle_command_reply: tid=0 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 client.17655 shutdown 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 msgr2=0x5619ff9bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c006010 tx=0x7f2e6c004ca0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 shutdown_connections 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5619ff9c8e70 0x5619ffa36260 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5619ff9b9370 0x5619ff9bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5619ff9afb40 0x5619ff9bd720 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 --2- 172.21.15.52:0/2321590089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5619ff9ae5d0 0x5619ff9bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 >> 172.21.15.52:0/2321590089 conn(0x5619ff977310 msgr2=0x5619ff9b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e65ffb640 0 client.17655 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 shutdown_connections 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 1 -- 172.21.15.52:0/2321590089 wait complete. 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.930+0000 7f2e86902740 20 client.17655 trim_cache size 0 max 16384 2024-09-19T09:27:38.950 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 msgr2=0x7f2e680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 0x7f2e680a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2e74005fd0 tx=0x7f2e74004a40 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 msgr2=0x7f2e7c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006010 tx=0x7f2e780042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 shutdown_connections 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2e7c10c180 0x7f2e7c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2e680a3240 0x7f2e680a5700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e7c1036c0 0x7f2e7c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 --2- 172.21.15.52:0/2856659602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e7c102da0 0x7f2e7c100a00 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 >> 172.21.15.52:0/2856659602 conn(0x7f2e7c0fc7a0 msgr2=0x7f2e7c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 shutdown_connections 2024-09-19T09:27:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:38.931+0000 7f2e84529640 1 -- 172.21.15.52:0/2856659602 wait complete. 2024-09-19T09:27:39.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:39 smithi052 ceph-mon[30947]: pgmap v524: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:39 smithi169 ceph-mon[35454]: pgmap v524: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:39 smithi086 ceph-mon[34813]: pgmap v524: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:39.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:27:39.884 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 -- 172.21.15.52:0/4174196847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 msgr2=0x7fbe1c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/4174196847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c10d950 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009cd0 tx=0x7fbe1402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 -- 172.21.15.52:0/4174196847 shutdown_connections 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/4174196847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c10d950 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/4174196847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c100a80 0x7fbe1c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/4174196847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c106a80 0x7fbe1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 -- 172.21.15.52:0/4174196847 >> 172.21.15.52:0/4174196847 conn(0x7fbe1c0fc7a0 msgr2=0x7fbe1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 -- 172.21.15.52:0/4174196847 shutdown_connections 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.343+0000 7fbe23eb3640 1 -- 172.21.15.52:0/4174196847 wait complete. 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 Processor -- start 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 -- start start 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c100a80 0x7fbe1c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 0x7fbe1c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c110e80 con 0x7fbe1c101420 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c110d00 con 0x7fbe1c106a80 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe23eb3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c111000 con 0x7fbe1c100a80 2024-09-19T09:27:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe2144e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe2144e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39720/0 (socket says 172.21.15.52:39720) 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe2144e640 1 -- 172.21.15.52:0/415945174 learned_addr learned my addr 172.21.15.52:0/415945174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.344+0000 7fbe22450640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 0x7fbe1c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c100a80 0x7fbe1c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 -- 172.21.15.52:0/415945174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c100a80 msgr2=0x7fbe1c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c100a80 0x7fbe1c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 -- 172.21.15.52:0/415945174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 msgr2=0x7fbe1c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 0x7fbe1c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 -- 172.21.15.52:0/415945174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c19d3d0 con 0x7fbe1c101420 2024-09-19T09:27:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe22450640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 0x7fbe1c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe2144e640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00e9f0 tx=0x7fbe0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe12ffd640 1 -- 172.21.15.52:0/415945174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00cd80 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe12ffd640 1 -- 172.21.15.52:0/415945174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0c010910 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c19d6c0 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe12ffd640 1 -- 172.21.15.52:0/415945174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c018990 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.345+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c1a4fa0 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe12ffd640 1 -- 172.21.15.52:0/415945174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe0c010ac0 con 0x7fbe1c101420 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 Processor -- start 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 -- start start 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dc2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc25d0 0x564962dc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564962d282f0 con 0x564962dd1780 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564962ccfcf0 con 0x564962dc3b40 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2628c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564962d242b0 con 0x564962dc25d0 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2144e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe22450640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dc2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2144e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39732/0 (socket says 172.21.15.52:39732) 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.348+0000 7fbe2144e640 1 -- 172.21.15.52:0/2732375130 learned_addr learned my addr 172.21.15.52:0/2732375130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc25d0 0x564962dc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe12ffd640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 0x7fbe080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 -- 172.21.15.52:0/2732375130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc25d0 msgr2=0x564962dc2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc25d0 0x564962dc2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 -- 172.21.15.52:0/2732375130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 msgr2=0x564962dc2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dc2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 -- 172.21.15.52:0/2732375130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564962cb43a0 con 0x564962dd1780 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe22450640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 0x7fbe080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe12ffd640 1 -- 172.21.15.52:0/415945174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe0c0cfd60 con 0x7fbe1c101420 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe2144e640 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c086130 tx=0x7fbe0c066d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd2080744d2e954 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe07fff640 1 -- 172.21.15.52:0/2732375130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c09c0d0 con 0x564962dd1780 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.349+0000 7fbe07fff640 1 -- 172.21.15.52:0/2732375130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0c083800 con 0x564962dd1780 2024-09-19T09:27:40.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe07fff640 1 -- 172.21.15.52:0/2732375130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c09bc60 con 0x564962dd1780 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 -- 172.21.15.52:0/2732375130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 msgr2=0x564962dd3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe22450640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 0x7fbe080a5780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009430 tx=0x7fbe1403f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c086130 tx=0x7fbe0c066d50 comp rx=0 tx=0).stop 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 -- 172.21.15.52:0/2732375130 shutdown_connections 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dd1780 0x564962dd3b70 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc25d0 0x564962dc2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 --2- 172.21.15.52:0/2732375130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dc2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.350+0000 7fbe2628c740 1 -- 172.21.15.52:0/2732375130 >> 172.21.15.52:0/2732375130 conn(0x564962d8b310 msgr2=0x564962dbec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.351+0000 7fbe2628c740 1 -- 172.21.15.52:0/2732375130 shutdown_connections 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.351+0000 7fbe2628c740 1 -- 172.21.15.52:0/2732375130 wait complete. 2024-09-19T09:27:40.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.351+0000 7fbe2628c740 1 -- start start 2024-09-19T09:27:40.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.351+0000 7fbe2628c740 1 Processor -- start 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962dce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564962dd4420 con 0x564962dc25d0 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564962ce3060 con 0x564962dd1780 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564962dd45a0 con 0x564962dc3b40 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2628c740 10 client.0 _ll_register_callbacks cb 0x564962a368c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:40.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe22450640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe2144e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962dce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe22450640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:33570/0 (socket says 172.21.15.52:33570) 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe22450640 1 -- 172.21.15.52:0/3119752133 learned_addr learned my addr 172.21.15.52:0/3119752133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39742/0 (socket says 172.21.15.52:39742) 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 -- 172.21.15.52:0/3119752133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 msgr2=0x564962dce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962dce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 -- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 msgr2=0x564962dce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 -- 172.21.15.52:0/3119752133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564962a993c0 con 0x564962dc25d0 2024-09-19T09:27:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe22450640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005fd0 tx=0x7fbe180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d607c033d59b13d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe057fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18012860 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.352+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe18012a00 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564962d35860 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe18009e30 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 10 client.17667 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564962ddfef0 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564962d35860 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe1800f040 con 0x564962dc25d0 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 10 client.17667 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:40.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 20 client.17667 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962de13b0 0x564962de3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 4 client.17667 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564962d2fd70 con 0x564962de13b0 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.353+0000 7fbe2144e640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962de13b0 0x564962de3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.354+0000 7fbe2144e640 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962de13b0 0x564962de3810 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c239a9772666391d server_cookie=f0e724f8eabfe438 in_seq=0 out_seq=0 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.354+0000 7fbe057fa640 10 client.17667 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.354+0000 7fbe057fa640 1 -- 172.21.15.52:0/3119752133 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564962d2fd70 con 0x564962de13b0 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.354+0000 7fbe057fa640 10 client.17667 handle_command_reply: tid=0 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.354+0000 7fbe2628c740 1 client.17667 shutdown 2024-09-19T09:27:40.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 msgr2=0x564962dd1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005fd0 tx=0x7fbe180117b0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 shutdown_connections 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962de13b0 0x564962de3810 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962dce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe057fa640 0 client.17667 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 --2- 172.21.15.52:0/3119752133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd1150 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 >> 172.21.15.52:0/3119752133 conn(0x564962d8b310 msgr2=0x564962dc4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 shutdown_connections 2024-09-19T09:27:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 1 -- 172.21.15.52:0/3119752133 wait complete. 2024-09-19T09:27:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.355+0000 7fbe2628c740 20 client.17667 trim_cache size 0 max 16384 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 Processor -- start 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 -- start start 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962ddd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dbe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1adf10 con 0x564962dc25d0 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ab7e0 con 0x564962dd1780 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2628c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1a9630 con 0x564962dc3b40 2024-09-19T09:27:40.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe21c4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe21c4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39750/0 (socket says 172.21.15.52:39750) 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe21c4f640 1 -- 172.21.15.52:0/682091843 learned_addr learned my addr 172.21.15.52:0/682091843 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe22450640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dbe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.368+0000 7fbe2144e640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962ddd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 -- 172.21.15.52:0/682091843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 msgr2=0x564962ddd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962ddd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 -- 172.21.15.52:0/682091843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 msgr2=0x564962dbe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dbe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 -- 172.21.15.52:0/682091843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564962dd0d70 con 0x564962dc25d0 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe2144e640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962ddd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:40.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbe18004a80 tx=0x7fbe18005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f4d6df20ba5f5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe077fe640 1 -- 172.21.15.52:0/682091843 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18031070 con 0x564962dc25d0 2024-09-19T09:27:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe077fe640 1 -- 172.21.15.52:0/682091843 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe18004820 con 0x564962dc25d0 2024-09-19T09:27:40.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.369+0000 7fbe077fe640 1 -- 172.21.15.52:0/682091843 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18028040 con 0x564962dc25d0 2024-09-19T09:27:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- 172.21.15.52:0/682091843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 msgr2=0x564962dc3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbe18004a80 tx=0x7fbe18005bd0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- 172.21.15.52:0/682091843 shutdown_connections 2024-09-19T09:27:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dd1780 0x564962dbe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dc3b40 0x564962ddd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- 172.21.15.52:0/682091843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dc3350 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- 172.21.15.52:0/682091843 >> 172.21.15.52:0/682091843 conn(0x564962d8b310 msgr2=0x564962db9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- 172.21.15.52:0/682091843 shutdown_connections 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- 172.21.15.52:0/682091843 wait complete. 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 -- start start 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 Processor -- start 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.370+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dda0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dd1780 0x564962dcaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1a9ca0 con 0x564962dc25d0 2024-09-19T09:27:40.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1ab110 con 0x564962dc3b40 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c1aa370 con 0x564962dd1780 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 10 client.0 _ll_register_callbacks cb 0x7fbe18009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39760/0 (socket says 172.21.15.52:39760) 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 -- 172.21.15.52:0/612909832 learned_addr learned my addr 172.21.15.52:0/612909832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2144e640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dda0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe22450640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dd1780 0x564962dcaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 -- 172.21.15.52:0/612909832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dd1780 msgr2=0x564962dcaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dd1780 0x564962dcaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 -- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 msgr2=0x564962dda0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:40.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dda0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 -- 172.21.15.52:0/612909832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564962dcb7c0 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2144e640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dda0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe21c4f640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbe180117f0 tx=0x7fbe1801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b934ddd516cee9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe057fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18039020 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe1801ad90 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.371+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe18004820 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe18028050 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 10 client.17673 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564962e4bd60 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe18004820 con 0x564962dc25d0 2024-09-19T09:27:40.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe18034070 con 0x564962dc25d0 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 10 client.17673 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 20 client.17673 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962e4c410 0x564962e4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 4 client.17673 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564962cac170 con 0x564962e4c410 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.372+0000 7fbe2144e640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962e4c410 0x564962e4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2144e640 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962e4c410 0x564962e4e800 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db25edea41b93691 server_cookie=98bde53bd3345f90 in_seq=0 out_seq=0 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe057fa640 10 client.17673 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe057fa640 1 -- 172.21.15.52:0/612909832 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564962cac170 con 0x564962e4c410 2024-09-19T09:27:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe057fa640 10 client.17673 handle_command_reply: tid=0 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 client.17673 shutdown 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 msgr2=0x564962dd9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbe180117f0 tx=0x7fbe1801ac20 comp rx=0 tx=0).stop 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 shutdown_connections 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564962e4c410 0x564962e4e800 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564962dd1780 0x564962dcaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564962dc3b40 0x564962dda0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 --2- 172.21.15.52:0/612909832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564962dc25d0 0x564962dd9ba0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe057fa640 0 client.17673 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:40.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 >> 172.21.15.52:0/612909832 conn(0x564962d8b310 msgr2=0x564962dbe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 shutdown_connections 2024-09-19T09:27:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 1 -- 172.21.15.52:0/612909832 wait complete. 2024-09-19T09:27:40.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.373+0000 7fbe2628c740 20 client.17673 trim_cache size 0 max 16384 2024-09-19T09:27:40.381 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 msgr2=0x7fbe080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 0x7fbe080a5780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009430 tx=0x7fbe1403f040 comp rx=0 tx=0).stop 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 msgr2=0x7fbe1c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c00e9f0 tx=0x7fbe0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 shutdown_connections 2024-09-19T09:27:40.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe1c106a80 0x7fbe1c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe1c101420 0x7fbe1c198960 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe080a32c0 0x7fbe080a5780 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 --2- 172.21.15.52:0/415945174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe1c100a80 0x7fbe1c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 >> 172.21.15.52:0/415945174 conn(0x7fbe1c0fc7a0 msgr2=0x7fbe1c104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 shutdown_connections 2024-09-19T09:27:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:40.374+0000 7fbe23eb3640 1 -- 172.21.15.52:0/415945174 wait complete. 2024-09-19T09:27:41.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:41 smithi052 ceph-mon[30947]: pgmap v525: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:41.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:41 smithi169 ceph-mon[35454]: pgmap v525: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:41 smithi086 ceph-mon[34813]: pgmap v525: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 -- 172.21.15.52:0/4002395982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0100a60 msgr2=0x7fa2d0100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 --2- 172.21.15.52:0/4002395982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0100a60 0x7fa2d0100e60 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009900 tx=0x7fa2c002a410 comp rx=0 tx=0).stop 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 -- 172.21.15.52:0/4002395982 shutdown_connections 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 --2- 172.21.15.52:0/4002395982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 0x7fa2d0108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 --2- 172.21.15.52:0/4002395982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0101c50 0x7fa2d01020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 --2- 172.21.15.52:0/4002395982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0100a60 0x7fa2d0100e60 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 -- 172.21.15.52:0/4002395982 >> 172.21.15.52:0/4002395982 conn(0x7fa2d00fc1e0 msgr2=0x7fa2d00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 -- 172.21.15.52:0/4002395982 shutdown_connections 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.861+0000 7fa2d608d640 1 -- 172.21.15.52:0/4002395982 wait complete. 2024-09-19T09:27:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 Processor -- start 2024-09-19T09:27:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 -- start start 2024-09-19T09:27:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0100a60 0x7fa2d006aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 0x7fa2d019f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c6c0 con 0x7fa2d0101c50 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.862+0000 7fa2d608d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c540 con 0x7fa2d0102610 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2d608d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010c840 con 0x7fa2d0100a60 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39790/0 (socket says 172.21.15.52:39790) 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 -- 172.21.15.52:0/567795640 learned_addr learned my addr 172.21.15.52:0/567795640 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0100a60 0x7fa2d006aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2cffff640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 0x7fa2d019f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 -- 172.21.15.52:0/567795640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0100a60 msgr2=0x7fa2d006aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0100a60 0x7fa2d006aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 -- 172.21.15.52:0/567795640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 msgr2=0x7fa2d019f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 0x7fa2d019f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 -- 172.21.15.52:0/567795640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d019fa30 con 0x7fa2d0101c50 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d950 tx=0x7fa2c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ccff9640 1 -- 172.21.15.52:0/567795640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4017030 con 0x7fa2d0101c50 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ccff9640 1 -- 172.21.15.52:0/567795640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c4004020 con 0x7fa2d0101c50 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d019fd20 con 0x7fa2d0101c50 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2ccff9640 1 -- 172.21.15.52:0/567795640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40047a0 con 0x7fa2d0101c50 2024-09-19T09:27:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.863+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d01a0210 con 0x7fa2d0101c50 2024-09-19T09:27:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2ccff9640 1 -- 172.21.15.52:0/567795640 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa2c40041d0 con 0x7fa2d0101c50 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 Processor -- start 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 -- start start 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 0x55e9331151b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e93311cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e9330742f0 con 0x55e9331156f0 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e93301c270 con 0x55e93311a780 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e9330702b0 con 0x55e933114db0 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2ccff9640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 0x7fa2b80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.866+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39802/0 (socket says 172.21.15.52:39802) 2024-09-19T09:27:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/383635303 learned_addr learned my addr 172.21.15.52:0/383635303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e93311cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cffff640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 0x55e9331151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cffff640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 0x7fa2b80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/383635303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 msgr2=0x55e9331151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 0x55e9331151b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/383635303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 msgr2=0x55e93311cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e93311cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2ccff9640 1 -- 172.21.15.52:0/567795640 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa2c40cf400 con 0x7fa2d0101c50 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/383635303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e93301b340 con 0x55e9331156f0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cffff640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 0x55e9331151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0031610 tx=0x7fa2c0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8b380e89ef5539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2cffff640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 0x7fa2b80a57b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009fd0 tx=0x7fa2c8005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2b5ffb640 1 -- 172.21.15.52:0/383635303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0040070 con 0x55e9331156f0 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2b5ffb640 1 -- 172.21.15.52:0/383635303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c00318b0 con 0x55e9331156f0 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.867+0000 7fa2b5ffb640 1 -- 172.21.15.52:0/383635303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0035040 con 0x55e9331156f0 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- 172.21.15.52:0/383635303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 msgr2=0x55e93311a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0031610 tx=0x7fa2c0005c00 comp rx=0 tx=0).stop 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- 172.21.15.52:0/383635303 shutdown_connections 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e93311cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e93311a1b0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/383635303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e933114db0 0x55e9331151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- 172.21.15.52:0/383635303 >> 172.21.15.52:0/383635303 conn(0x55e93310c010 msgr2=0x55e93310c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- 172.21.15.52:0/383635303 shutdown_connections 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- 172.21.15.52:0/383635303 wait complete. 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.868+0000 7fa2d8e26740 1 -- start start 2024-09-19T09:27:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 Processor -- start 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93311ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e93311f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e93311d6f0 con 0x55e93311a780 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e932ffd290 con 0x55e933114db0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e93311d870 con 0x55e9331156f0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2d8e26740 10 client.0 _ll_register_callbacks cb 0x55e93302e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2cffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2cffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39816/0 (socket says 172.21.15.52:39816) 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2cffff640 1 -- 172.21.15.52:0/3225249569 learned_addr learned my addr 172.21.15.52:0/3225249569 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93311ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.869+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e93311f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 -- 172.21.15.52:0/3225249569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 msgr2=0x55e93311f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e93311f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 -- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 msgr2=0x55e93311ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93311ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 -- 172.21.15.52:0/3225249569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e932d87210 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2cffff640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009b40 tx=0x7fa2c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26149b578d7730f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800fb50 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa2c800fcf0 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c00318b0 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa2c802c030 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2d8e26740 10 client.17685 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e932e53620 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.870+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c00318b0 con 0x55e93311a780 2024-09-19T09:27:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c8027490 con 0x55e93311a780 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 10 client.17685 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 10 client.17685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 20 client.17685 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e93312ac20 0x55e93312d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 4 client.17685 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e933081a20 con 0x55e93312ac20 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e93312ac20 0x55e93312d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.871+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e93312ac20 0x55e93312d010 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e3c702b8ae005ec server_cookie=2ed1ef0b7602af26 in_seq=0 out_seq=0 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2aeffd640 10 client.17685 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2aeffd640 1 -- 172.21.15.52:0/3225249569 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e933081a20 con 0x55e93312ac20 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2aeffd640 10 client.17685 handle_command_reply: tid=0 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2d8e26740 1 client.17685 shutdown 2024-09-19T09:27:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 msgr2=0x55e9331264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.872+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009b40 tx=0x7fa2c8004a40 comp rx=0 tx=0).stop 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 shutdown_connections 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e93312ac20 0x55e93312d010 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e93311a780 0x55e9331264d0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e93311f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/3225249569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93311ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2aeffd640 0 client.17685 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 >> 172.21.15.52:0/3225249569 conn(0x55e93310c010 msgr2=0x55e93310d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 shutdown_connections 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 1 -- 172.21.15.52:0/3225249569 wait complete. 2024-09-19T09:27:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.873+0000 7fa2d8e26740 20 client.17685 trim_cache size 0 max 16384 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.887+0000 7fa2d8e26740 1 Processor -- start 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.887+0000 7fa2d8e26740 1 -- start start 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.887+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93310cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.887+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e93311a780 0x55e93310d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a9940 con 0x55e9331156f0 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a7210 con 0x55e933114db0 2024-09-19T09:27:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a5060 con 0x55e93311a780 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39822/0 (socket says 172.21.15.52:39822) 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 -- 172.21.15.52:0/2383477686 learned_addr learned my addr 172.21.15.52:0/2383477686 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2cffff640 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e93311a780 0x55e93310d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93310cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 -- 172.21.15.52:0/2383477686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e93311a780 msgr2=0x55e93310d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e93311a780 0x55e93310d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 -- 172.21.15.52:0/2383477686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 msgr2=0x55e93310cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93310cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 -- 172.21.15.52:0/2383477686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e933129590 con 0x55e9331156f0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa2c409b6a0 tx=0x7fa2c401af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6975fd39dcb19530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2b57fa640 1 -- 172.21.15.52:0/2383477686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40b4070 con 0x55e9331156f0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2b57fa640 1 -- 172.21.15.52:0/2383477686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c409c0a0 con 0x55e9331156f0 2024-09-19T09:27:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.888+0000 7fa2b57fa640 1 -- 172.21.15.52:0/2383477686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4099d30 con 0x55e9331156f0 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- 172.21.15.52:0/2383477686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 msgr2=0x55e933126490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa2c409b6a0 tx=0x7fa2c401af90 comp rx=0 tx=0).stop 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- 172.21.15.52:0/2383477686 shutdown_connections 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e93311a780 0x55e93310d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e9331156f0 0x55e933126490 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/2383477686 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e933114db0 0x55e93310cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- 172.21.15.52:0/2383477686 >> 172.21.15.52:0/2383477686 conn(0x55e93310c010 msgr2=0x55e93311ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- 172.21.15.52:0/2383477686 shutdown_connections 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- 172.21.15.52:0/2383477686 wait complete. 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.889+0000 7fa2d8e26740 1 -- start start 2024-09-19T09:27:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 Processor -- start 2024-09-19T09:27:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e9331244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e933125470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a56d0 con 0x55e933114db0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a6b40 con 0x55e93311a780 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d01a5da0 con 0x55e9331156f0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2d8e26740 10 client.0 _ll_register_callbacks cb 0x7fa2c8009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39824/0 (socket says 172.21.15.52:39824) 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/1257276488 learned_addr learned my addr 172.21.15.52:0/1257276488 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cffff640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e933125470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e9331244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/1257276488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 msgr2=0x55e9331244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e9331244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 msgr2=0x55e933125470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e933125470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 -- 172.21.15.52:0/1257276488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e933125a80 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cffff640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e933125470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2cf7fe640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa2c002a930 tx=0x7fa2c002a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f0cb9e11d00e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.890+0000 7fa2aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0054070 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa2c0004240 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2c409c0a0 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa2c0035040 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 10 client.17691 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e933195c90 con 0x55e933114db0 2024-09-19T09:27:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c409c0a0 con 0x55e933114db0 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa2c0057030 con 0x55e933114db0 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 10 client.17691 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 10 client.17691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 20 client.17691 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e9331962c0 0x55e9331986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 4 client.17691 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e93307bd70 con 0x55e9331962c0 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.891+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e9331962c0 0x55e9331986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.892+0000 7fa2ceffd640 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e9331962c0 0x55e9331986b0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3117a14e486081d9 server_cookie=31e02a3e206aa661 in_seq=0 out_seq=0 2024-09-19T09:27:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.892+0000 7fa2aeffd640 10 client.17691 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.904+0000 7fa2aeffd640 1 -- 172.21.15.52:0/1257276488 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e93307bd70 con 0x55e9331962c0 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.904+0000 7fa2aeffd640 10 client.17691 handle_command_reply: tid=0 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.904+0000 7fa2d8e26740 1 client.17691 shutdown 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 msgr2=0x55e933123f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fa2c002a930 tx=0x7fa2c002a9b0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 shutdown_connections 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e9331962c0 0x55e9331986b0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e93311a780 0x55e933125470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e9331156f0 0x55e9331244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2aeffd640 0 client.17691 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 --2- 172.21.15.52:0/1257276488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e933114db0 0x55e933123f90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 >> 172.21.15.52:0/1257276488 conn(0x55e93310c010 msgr2=0x55e93310a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 shutdown_connections 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 1 -- 172.21.15.52:0/1257276488 wait complete. 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d8e26740 20 client.17691 trim_cache size 0 max 16384 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:27:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 msgr2=0x7fa2b80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 0x7fa2b80a57b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009fd0 tx=0x7fa2c8005bd0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 msgr2=0x7fa2d019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400d950 tx=0x7fa2c400de10 comp rx=0 tx=0).stop 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 shutdown_connections 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa2d0102610 0x7fa2d019f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2d0101c50 0x7fa2d019cb20 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa2b80a32f0 0x7fa2b80a57b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 --2- 172.21.15.52:0/567795640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2d0100a60 0x7fa2d006aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.905+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 >> 172.21.15.52:0/567795640 conn(0x7fa2d00fc1e0 msgr2=0x7fa2d0105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.906+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 shutdown_connections 2024-09-19T09:27:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:41.906+0000 7fa2d608d640 1 -- 172.21.15.52:0/567795640 wait complete. 2024-09-19T09:27:42.240 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:27:42.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:27:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 -- 172.21.15.52:0/3392166848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074f40 msgr2=0x7fd41410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3392166848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074f40 0x7fd41410de80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd408009900 tx=0x7fd40802a480 comp rx=0 tx=0).stop 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 -- 172.21.15.52:0/3392166848 shutdown_connections 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3392166848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd414110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3392166848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074f40 0x7fd41410de80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3392166848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074620 0x7fd414074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.955+0000 7fd41bf74640 1 -- 172.21.15.52:0/3392166848 >> 172.21.15.52:0/3392166848 conn(0x7fd4140fd8c0 msgr2=0x7fd4140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- 172.21.15.52:0/3392166848 shutdown_connections 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- 172.21.15.52:0/3392166848 wait complete. 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 Processor -- start 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- start start 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074f40 0x7fd41419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd41419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd414114160 con 0x7fd414074620 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd414113fe0 con 0x7fd41410e3c0 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd41bf74640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141142e0 con 0x7fd414074f40 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd419d10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd419d10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39848/0 (socket says 172.21.15.52:39848) 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.956+0000 7fd419d10640 1 -- 172.21.15.52:0/3888430955 learned_addr learned my addr 172.21.15.52:0/3888430955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd41950f640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074f40 0x7fd41419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd41a511640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd41419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 -- 172.21.15.52:0/3888430955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074f40 msgr2=0x7fd41419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074f40 0x7fd41419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 -- 172.21.15.52:0/3888430955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 msgr2=0x7fd41419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd41419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 -- 172.21.15.52:0/3888430955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41419f650 con 0x7fd414074620 2024-09-19T09:27:42.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd41a511640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd41419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd419d10640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d770 tx=0x7fd41000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd406ffd640 1 -- 172.21.15.52:0/3888430955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410017070 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd406ffd640 1 -- 172.21.15.52:0/3888430955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd410005500 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41419f940 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd406ffd640 1 -- 172.21.15.52:0/3888430955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410004e00 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.957+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4141a7220 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.960+0000 7fd406ffd640 1 -- 172.21.15.52:0/3888430955 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd410004fa0 con 0x7fd414074620 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.960+0000 7fd41e34d740 1 Processor -- start 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.960+0000 7fd41e34d740 1 -- start start 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55baffb6a280 con 0x55baffc05480 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55baffb11b10 con 0x55baffc0fd40 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41e34d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55baffb66240 con 0x55baffc04b60 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39856/0 (socket says 172.21.15.52:39856) 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 -- 172.21.15.52:0/2851851583 learned_addr learned my addr 172.21.15.52:0/2851851583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41a511640 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41950f640 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd406ffd640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 0x7fd4000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 -- 172.21.15.52:0/2851851583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 msgr2=0x55baffc04f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc04f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 -- 172.21.15.52:0/2851851583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 msgr2=0x55baffc12130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc12130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd419d10640 1 -- 172.21.15.52:0/2851851583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baffb1e1f0 con 0x55baffc05480 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.961+0000 7fd41a511640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 0x7fd4000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd406ffd640 1 -- 172.21.15.52:0/3888430955 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd4100cf410 con 0x7fd414074620 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd419d10640 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd4100b3900 tx=0x7fd4100afb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0beba06b07a87a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd3fffff640 1 -- 172.21.15.52:0/2851851583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410020030 con 0x55baffc05480 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd3fffff640 1 -- 172.21.15.52:0/2851851583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4100b07d0 con 0x55baffc05480 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd3fffff640 1 -- 172.21.15.52:0/2851851583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41009b4f0 con 0x55baffc05480 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd41a511640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 0x7fd4000a5700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd40c005fd0 tx=0x7fd40c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.962+0000 7fd41e34d740 1 -- 172.21.15.52:0/2851851583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 msgr2=0x55baffc0f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fd4100b3900 tx=0x7fd4100afb10 comp rx=0 tx=0).stop 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 -- 172.21.15.52:0/2851851583 shutdown_connections 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc12130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc0f800 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- 172.21.15.52:0/2851851583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc04f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 -- 172.21.15.52:0/2851851583 >> 172.21.15.52:0/2851851583 conn(0x55baffc010f0 msgr2=0x55baffc014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 -- 172.21.15.52:0/2851851583 shutdown_connections 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 -- 172.21.15.52:0/2851851583 wait complete. 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 -- start start 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 Processor -- start 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.963+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc0d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55baffc12910 con 0x55baffc0fd40 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55baffb24f10 con 0x55baffc05480 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55baffc12a90 con 0x55baffc04b60 2024-09-19T09:27:42.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 10 client.0 _ll_register_callbacks cb 0x55baffaeda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39868/0 (socket says 172.21.15.52:39868) 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 -- 172.21.15.52:0/4061000493 learned_addr learned my addr 172.21.15.52:0/4061000493 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd419d10640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41950f640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc0d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 -- 172.21.15.52:0/4061000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 msgr2=0x55baffc0cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 -- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 msgr2=0x55baffc0d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc0d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 -- 172.21.15.52:0/4061000493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baff8db6a0 con 0x55baffc0fd40 2024-09-19T09:27:42.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41a511640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0138b0 tx=0x7fd40c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb772fda0e25a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd3fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c004d20 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd40c01eaf0 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.964+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55baffb777f0 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd40c02c020 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 10 client.17703 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55baffc1e520 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55baffb777f0 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd40c00f040 con 0x55baffc0fd40 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 10 client.17703 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 10 client.17703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 20 client.17703 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:42.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc1f9e0 0x55baffc21e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 4 client.17703 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baffb71d00 con 0x55baffc1f9e0 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.965+0000 7fd419d10640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc1f9e0 0x55baffc21e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.966+0000 7fd3fd7fa640 10 client.17703 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.966+0000 7fd419d10640 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc1f9e0 0x55baffc21e10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7e734ec58f853d server_cookie=1c1ed4ebe7deaeb7 in_seq=0 out_seq=0 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.966+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/4061000493 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baffb71d00 con 0x55baffc1f9e0 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.966+0000 7fd3fd7fa640 10 client.17703 handle_command_reply: tid=0 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 client.17703 shutdown 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 msgr2=0x55baffc0d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0138b0 tx=0x7fd40c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 shutdown_connections 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc1f9e0 0x55baffc21e10 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc0d650 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc0d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 --2- 172.21.15.52:0/4061000493 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd3fd7fa640 0 client.17703 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 >> 172.21.15.52:0/4061000493 conn(0x55baffc010f0 msgr2=0x55baffc06dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 shutdown_connections 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 1 -- 172.21.15.52:0/4061000493 wait complete. 2024-09-19T09:27:42.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.967+0000 7fd41e34d740 20 client.17703 trim_cache size 0 max 16384 2024-09-19T09:27:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 Processor -- start 2024-09-19T09:27:42.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 -- start start 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc27c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141b22f0 con 0x55baffc05480 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141afbc0 con 0x55baffc0fd40 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.984+0000 7fd41e34d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ada10 con 0x55baffc04b60 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39878/0 (socket says 172.21.15.52:39878) 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 -- 172.21.15.52:0/3989527753 learned_addr learned my addr 172.21.15.52:0/3989527753 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41a511640 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc27c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 -- 172.21.15.52:0/3989527753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 msgr2=0x55baffc0bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 -- 172.21.15.52:0/3989527753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 msgr2=0x55baffc27c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc27c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 -- 172.21.15.52:0/3989527753 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baffc052b0 con 0x55baffc05480 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd41950f640 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd40802a9a0 tx=0x7fd408031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538368cbe29e0b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd3ff7fe640 1 -- 172.21.15.52:0/3989527753 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408035040 con 0x55baffc05480 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd3ff7fe640 1 -- 172.21.15.52:0/3989527753 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408005020 con 0x55baffc05480 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.985+0000 7fd3ff7fe640 1 -- 172.21.15.52:0/3989527753 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408004b90 con 0x55baffc05480 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- 172.21.15.52:0/3989527753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 msgr2=0x55baffc276e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd40802a9a0 tx=0x7fd408031880 comp rx=0 tx=0).stop 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- 172.21.15.52:0/3989527753 shutdown_connections 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc0fd40 0x55baffc27c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc05480 0x55baffc276e0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 --2- 172.21.15.52:0/3989527753 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc0bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- 172.21.15.52:0/3989527753 >> 172.21.15.52:0/3989527753 conn(0x55baffc010f0 msgr2=0x55baffc0eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- 172.21.15.52:0/3989527753 shutdown_connections 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- 172.21.15.52:0/3989527753 wait complete. 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 -- start start 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.986+0000 7fd41e34d740 1 Processor -- start 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc17ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc18220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ae080 con 0x55baffc0fd40 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141af4f0 con 0x55baffc05480 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4141ae750 con 0x55baffc04b60 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41e34d740 10 client.0 _ll_register_callbacks cb 0x7fd40c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39886/0 (socket says 172.21.15.52:39886) 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 -- 172.21.15.52:0/261792825 learned_addr learned my addr 172.21.15.52:0/261792825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41950f640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc18220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd419d10640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc17ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 -- 172.21.15.52:0/261792825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 msgr2=0x55baffc17ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc17ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 -- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 msgr2=0x55baffc18220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc18220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.987+0000 7fd41a511640 1 -- 172.21.15.52:0/261792825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baffc0aae0 con 0x55baffc0fd40 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41a511640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0098d0 tx=0x7fd40c01f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95337d75fa180ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40c01fbe0 con 0x55baffc0fd40 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd40c01fd80 con 0x55baffc0fd40 2024-09-19T09:27:42.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd408005020 con 0x55baffc0fd40 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd40c0326a0 con 0x55baffc0fd40 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 10 client.17709 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55baffc8abc0 con 0x55baffc0fd40 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd408005020 con 0x55baffc0fd40 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd40c03a060 con 0x55baffc0fd40 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 10 client.17709 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 20 client.17709 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc8b270 0x55baffc8d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 4 client.17709 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:27:42.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.988+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55baffaee110 con 0x55baffc8b270 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.989+0000 7fd419d10640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc8b270 0x55baffc8d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.989+0000 7fd419d10640 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc8b270 0x55baffc8d690 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc120272b478ae69 server_cookie=89100118cf3232b7 in_seq=0 out_seq=0 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.989+0000 7fd3fd7fa640 10 client.17709 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd3fd7fa640 1 -- 172.21.15.52:0/261792825 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55baffaee110 con 0x55baffc8b270 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd3fd7fa640 10 client.17709 handle_command_reply: tid=0 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 client.17709 shutdown 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 msgr2=0x55baffc14cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0098d0 tx=0x7fd40c01f7f0 comp rx=0 tx=0).stop 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 shutdown_connections 2024-09-19T09:27:42.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baffc8b270 0x55baffc8d690 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baffc0fd40 0x55baffc14cb0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baffc05480 0x55baffc18220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 --2- 172.21.15.52:0/261792825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baffc04b60 0x55baffc17ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd3fd7fa640 0 client.17709 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 >> 172.21.15.52:0/261792825 conn(0x55baffc010f0 msgr2=0x55baffc065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 shutdown_connections 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 1 -- 172.21.15.52:0/261792825 wait complete. 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.990+0000 7fd41e34d740 20 client.17709 trim_cache size 0 max 16384 2024-09-19T09:27:43.000 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:43.001 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:27:43.001 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "bafe9c7c-40a1-4ba2-a469-e033cce59321", 2024-09-19T09:27:43.001 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:27:43.001 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 msgr2=0x7fd4000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 0x7fd4000a5700 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd40c005fd0 tx=0x7fd40c004a40 comp rx=0 tx=0).stop 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 msgr2=0x7fd41419a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fd41000d770 tx=0x7fd41000dc30 comp rx=0 tx=0).stop 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 shutdown_connections 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd41410e3c0 0x7fd41419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4000a3240 0x7fd4000a5700 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd414074f40 0x7fd41419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 --2- 172.21.15.52:0/3888430955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd414074620 0x7fd41419a6a0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 >> 172.21.15.52:0/3888430955 conn(0x7fd4140fd8c0 msgr2=0x7fd4140fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 shutdown_connections 2024-09-19T09:27:43.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:42.991+0000 7fd41bf74640 1 -- 172.21.15.52:0/3888430955 wait complete. 2024-09-19T09:27:43.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:43 smithi052 ceph-mon[30947]: pgmap v526: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:43 smithi169 ceph-mon[35454]: pgmap v526: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:43 smithi086 ceph-mon[34813]: pgmap v526: 97 pgs: 97 active+clean; 3.1 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:27:43.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:44.063 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:44.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:44 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:27:44.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:44 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:44 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:27:44.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:44 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.302 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:44 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:27:44.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:44 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:27:44.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:44 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:44 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:27:44.344 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:44 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.345 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:44 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:27:44.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:44 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:27:44.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:44 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:44 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:27:44.409 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:44 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:44.410 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:44 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:27:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 -- 172.21.15.52:0/2348708980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 msgr2=0x7f9b0410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 --2- 172.21.15.52:0/2348708980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b0410de80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009900 tx=0x7f9af802a480 comp rx=0 tx=0).stop 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 -- 172.21.15.52:0/2348708980 shutdown_connections 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 --2- 172.21.15.52:0/2348708980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 0x7f9b04110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 --2- 172.21.15.52:0/2348708980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b0410de80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 --2- 172.21.15.52:0/2348708980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 0x7f9b04074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 -- 172.21.15.52:0/2348708980 >> 172.21.15.52:0/2348708980 conn(0x7f9b040fd8c0 msgr2=0x7f9b040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 -- 172.21.15.52:0/2348708980 shutdown_connections 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.503+0000 7f9b08c62640 1 -- 172.21.15.52:0/2348708980 wait complete. 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 Processor -- start 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 -- start start 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 0x7f9b041a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 0x7f9b0419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04114230 con 0x7f9b04074f40 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041140b0 con 0x7f9b04074620 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b08c62640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041143b0 con 0x7f9b0410e3c0 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39892/0 (socket says 172.21.15.52:39892) 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 -- 172.21.15.52:0/1068622043 learned_addr learned my addr 172.21.15.52:0/1068622043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b0259c640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 0x7f9b041a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 0x7f9b0419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 -- 172.21.15.52:0/1068622043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 msgr2=0x7f9b0419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 0x7f9b0419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 -- 172.21.15.52:0/1068622043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 msgr2=0x7f9b041a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 0x7f9b041a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.504+0000 7f9b01d9b640 1 -- 172.21.15.52:0/1068622043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0419ad10 con 0x7f9b04074f40 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9af8005ab0 tx=0x7f9af80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9af37fe640 1 -- 172.21.15.52:0/1068622043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af803f030 con 0x7f9b04074f40 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9af37fe640 1 -- 172.21.15.52:0/1068622043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9af8003ce0 con 0x7f9b04074f40 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0419afa0 con 0x7f9b04074f40 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9af37fe640 1 -- 172.21.15.52:0/1068622043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8035070 con 0x7f9b04074f40 2024-09-19T09:27:44.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.505+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b041a72f0 con 0x7f9b04074f40 2024-09-19T09:27:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.507+0000 7f9af37fe640 1 -- 172.21.15.52:0/1068622043 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9af8042030 con 0x7f9b04074f40 2024-09-19T09:27:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.507+0000 7f9b0b03b740 1 Processor -- start 2024-09-19T09:27:44.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 -- start start 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 0x55ca86fc4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca86f1d2e0 con 0x55ca86fb74a0 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ca86ec4ce0 con 0x55ca86fb7dc0 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ca86f192a0 con 0x55ca86fc2680 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9af37fe640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 0x7f9aec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39894/0 (socket says 172.21.15.52:39894) 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 -- 172.21.15.52:0/1397328045 learned_addr learned my addr 172.21.15.52:0/1397328045 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b0259c640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9af37fe640 1 -- 172.21.15.52:0/1068622043 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9af80f0310 con 0x7f9b04074f40 2024-09-19T09:27:44.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 0x7f9aec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 0x55ca86fc4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 -- 172.21.15.52:0/1397328045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 msgr2=0x55ca86fc4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 0x55ca86fc4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 -- 172.21.15.52:0/1397328045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 msgr2=0x55ca86fc2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.508+0000 7f9b02d9d640 1 -- 172.21.15.52:0/1397328045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca86ea9440 con 0x55ca86fb74a0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 0x55ca86fc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00cb20 tx=0x7f9afc0072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9570b4d85f2174ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9af0ff9640 1 -- 172.21.15.52:0/1397328045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc015070 con 0x55ca86fb74a0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9af0ff9640 1 -- 172.21.15.52:0/1397328045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9afc016040 con 0x55ca86fb74a0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9af0ff9640 1 -- 172.21.15.52:0/1397328045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01e020 con 0x55ca86fb74a0 2024-09-19T09:27:44.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.509+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 0x7f9aec0a5700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01f000 tx=0x7f9afc01b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- 172.21.15.52:0/1397328045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 msgr2=0x55ca86fb7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00cb20 tx=0x7f9afc0072b0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- 172.21.15.52:0/1397328045 shutdown_connections 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fc2680 0x55ca86fc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/1397328045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb74a0 0x55ca86fb7880 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- 172.21.15.52:0/1397328045 >> 172.21.15.52:0/1397328045 conn(0x55ca86fb3a30 msgr2=0x55ca86fb3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- 172.21.15.52:0/1397328045 shutdown_connections 2024-09-19T09:27:44.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- 172.21.15.52:0/1397328045 wait complete. 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 -- start start 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.510+0000 7f9b0b03b740 1 Processor -- start 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb74a0 0x55ca86fc1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 0x55ca86fbf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ca86fc5250 con 0x55ca86fc2680 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ca86ed8050 con 0x55ca86fb74a0 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ca86fc53d0 con 0x55ca86fb7dc0 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0b03b740 10 client.0 _ll_register_callbacks cb 0x55ca86f18160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39906/0 (socket says 172.21.15.52:39906) 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3580760302 learned_addr learned my addr 172.21.15.52:0/3580760302 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:44.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb74a0 0x55ca86fc1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 0x55ca86fbf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3580760302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 msgr2=0x55ca86fbf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 0x55ca86fbf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb74a0 msgr2=0x55ca86fc1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb74a0 0x55ca86fc1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3580760302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca86c8e3c0 con 0x55ca86fc2680 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 0x55ca86fbf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0070b0 tx=0x7f9afc01af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526e4f17c65d8017 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.511+0000 7f9ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01e050 con 0x55ca86fc2680 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9afc022420 con 0x55ca86fc2680 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9afc016040 con 0x55ca86fc2680 2024-09-19T09:27:44.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9afc015040 con 0x55ca86fc2680 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 10 client.17721 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ca86fd0b90 con 0x55ca86fc2680 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9afc016040 con 0x55ca86fc2680 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9afc02a070 con 0x55ca86fc2680 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 10 client.17721 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 10 client.17721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 20 client.17721 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca86fd1fa0 0x55ca86fd4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 4 client.17721 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.512+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca86f2a850 con 0x55ca86fd1fa0 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.513+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca86fd1fa0 0x55ca86fd4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.513+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca86fd1fa0 0x55ca86fd4390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43290b156a8a3e8e server_cookie=e1e46f82311b7b6c in_seq=0 out_seq=0 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.513+0000 7f9ae9ffb640 10 client.17721 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:44.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3580760302 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca86f2a850 con 0x55ca86fd1fa0 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9ae9ffb640 10 client.17721 handle_command_reply: tid=0 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 client.17721 shutdown 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 msgr2=0x55ca86fbf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0070b0 tx=0x7f9afc01af10 comp rx=0 tx=0).stop 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 shutdown_connections 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca86fd1fa0 0x55ca86fd4390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fbf7e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb7dc0 0x55ca86fbf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9ae9ffb640 0 client.17721 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3580760302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb74a0 0x55ca86fc1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 >> 172.21.15.52:0/3580760302 conn(0x55ca86fb3a30 msgr2=0x55ca86fb9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 shutdown_connections 2024-09-19T09:27:44.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3580760302 wait complete. 2024-09-19T09:27:44.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.514+0000 7f9b0b03b740 20 client.17721 trim_cache size 0 max 16384 2024-09-19T09:27:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 Processor -- start 2024-09-19T09:27:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 -- start start 2024-09-19T09:27:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fc2680 0x55ca86fd9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041b23c0 con 0x55ca86fb7dc0 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041afc90 con 0x55ca86fc2680 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.531+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041adae0 con 0x55ca86fb74a0 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39922/0 (socket says 172.21.15.52:39922) 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 -- 172.21.15.52:0/874947028 learned_addr learned my addr 172.21.15.52:0/874947028 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:44.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fc2680 0x55ca86fd9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b0259c640 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 -- 172.21.15.52:0/874947028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 msgr2=0x55ca86fce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 -- 172.21.15.52:0/874947028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fc2680 msgr2=0x55ca86fd9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fc2680 0x55ca86fd9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 -- 172.21.15.52:0/874947028 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca86fbfb50 con 0x55ca86fb7dc0 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9af80b8d10 tx=0x7f9af802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365b9c231761c62c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9aebfff640 1 -- 172.21.15.52:0/874947028 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af80d5070 con 0x55ca86fb7dc0 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9aebfff640 1 -- 172.21.15.52:0/874947028 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9af80bcfb0 con 0x55ca86fb7dc0 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.532+0000 7f9aebfff640 1 -- 172.21.15.52:0/874947028 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8049070 con 0x55ca86fb7dc0 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- 172.21.15.52:0/874947028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 msgr2=0x55ca86fc11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9af80b8d10 tx=0x7f9af802a480 comp rx=0 tx=0).stop 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- 172.21.15.52:0/874947028 shutdown_connections 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fc2680 0x55ca86fd9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc11f0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/874947028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- 172.21.15.52:0/874947028 >> 172.21.15.52:0/874947028 conn(0x55ca86fb3a30 msgr2=0x55ca86fc0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- 172.21.15.52:0/874947028 shutdown_connections 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- 172.21.15.52:0/874947028 wait complete. 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 -- start start 2024-09-19T09:27:44.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.533+0000 7f9b0b03b740 1 Processor -- start 2024-09-19T09:27:44.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fc6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041ae150 con 0x55ca86fc2680 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041af5c0 con 0x55ca86fb7dc0 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041ae820 con 0x55ca86fb74a0 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 10 client.0 _ll_register_callbacks cb 0x7f9af40093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b01d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39934/0 (socket says 172.21.15.52:39934) 2024-09-19T09:27:44.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3712378159 learned_addr learned my addr 172.21.15.52:0/3712378159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fc6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3712378159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 msgr2=0x55ca86fc6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fc6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 msgr2=0x55ca86fc6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 -- 172.21.15.52:0/3712378159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca8703bd70 con 0x55ca86fc2680 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b01d9b640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b02d9d640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9afc004b90 tx=0x7f9afc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1132c8b3f7f5c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9ae9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc01e040 con 0x55ca86fc2680 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9afc0223b0 con 0x55ca86fc2680 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.534+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9af80bcfb0 con 0x55ca86fc2680 2024-09-19T09:27:44.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9afc0077b0 con 0x55ca86fc2680 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 10 client.17727 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ca8703d060 con 0x55ca86fc2680 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9af80bcfb0 con 0x55ca86fc2680 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9afc02a070 con 0x55ca86fc2680 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 10 client.17727 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 10 client.17727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 20 client.17727 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca8703d780 0x55ca8703fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 4 client.17727 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca86f24d60 con 0x55ca8703d780 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.535+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca8703d780 0x55ca8703fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0259c640 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca8703d780 0x55ca8703fba0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c0d31a63c49c88 server_cookie=b3e1478bc6be182c in_seq=0 out_seq=0 2024-09-19T09:27:44.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9ae9ffb640 10 client.17727 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9ae9ffb640 1 -- 172.21.15.52:0/3712378159 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ca86f24d60 con 0x55ca8703d780 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9ae9ffb640 10 client.17727 handle_command_reply: tid=0 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 client.17727 shutdown 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 msgr2=0x55ca86fc70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9afc004b90 tx=0x7f9afc00c9a0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 shutdown_connections 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ca8703d780 0x55ca8703fba0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ca86fc2680 0x55ca86fc70a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ca86fb7dc0 0x55ca86fc6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 --2- 172.21.15.52:0/3712378159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ca86fb74a0 0x55ca86fc6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 >> 172.21.15.52:0/3712378159 conn(0x55ca86fb3a30 msgr2=0x55ca86fc1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9ae9ffb640 0 client.17727 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:44.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 shutdown_connections 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 1 -- 172.21.15.52:0/3712378159 wait complete. 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.536+0000 7f9b0b03b740 20 client.17727 trim_cache size 0 max 16384 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:27:44.546 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 msgr2=0x7f9aec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 0x7f9aec0a5700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9afc01f000 tx=0x7f9afc01b000 comp rx=0 tx=0).stop 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 msgr2=0x7f9b041a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f9af8005ab0 tx=0x7f9af80042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 shutdown_connections 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9aec0a3240 0x7f9aec0a5700 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b0410e3c0 0x7f9b0419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b04074f40 0x7f9b041a0960 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 --2- 172.21.15.52:0/1068622043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b04074620 0x7f9b041a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 >> 172.21.15.52:0/1068622043 conn(0x7f9b040fd8c0 msgr2=0x7f9b040ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 shutdown_connections 2024-09-19T09:27:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:44.537+0000 7f9b08c62640 1 -- 172.21.15.52:0/1068622043 wait complete. 2024-09-19T09:27:45.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:45 smithi052 ceph-mon[30947]: pgmap v527: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:27:45.345 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:27:45.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:27:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:45 smithi169 ceph-mon[35454]: pgmap v527: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:27:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:45 smithi086 ceph-mon[34813]: pgmap v527: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:27:45.620 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.137+0000 7f5ed92c4640 1 -- 172.21.15.52:0/2821112828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 msgr2=0x7f5ed4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.137+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/2821112828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed4106e60 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009930 tx=0x7f5ec402a420 comp rx=0 tx=0).stop 2024-09-19T09:27:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 -- 172.21.15.52:0/2821112828 shutdown_connections 2024-09-19T09:27:46.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/2821112828 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4101420 0x7f5ed410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/2821112828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4100a80 0x7f5ed4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/2821112828 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed4106e60 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 -- 172.21.15.52:0/2821112828 >> 172.21.15.52:0/2821112828 conn(0x7f5ed40fc7a0 msgr2=0x7f5ed40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 -- 172.21.15.52:0/2821112828 shutdown_connections 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 -- 172.21.15.52:0/2821112828 wait complete. 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.138+0000 7f5ed92c4640 1 Processor -- start 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 -- start start 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4100a80 0x7f5ed40fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101420 0x7f5ed40fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:46.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4110e90 con 0x7f5ed4106a80 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4110d10 con 0x7f5ed4101420 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed92c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4111010 con 0x7f5ed4100a80 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39954/0 (socket says 172.21.15.52:39954) 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 -- 172.21.15.52:0/702356145 learned_addr learned my addr 172.21.15.52:0/702356145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed27fc640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101420 0x7f5ed40fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed2ffd640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4100a80 0x7f5ed40fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 -- 172.21.15.52:0/702356145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4100a80 msgr2=0x7f5ed40fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4100a80 0x7f5ed40fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 -- 172.21.15.52:0/702356145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101420 msgr2=0x7f5ed40fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101420 0x7f5ed40fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.139+0000 7f5ed37fe640 1 -- 172.21.15.52:0/702356145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed41a6840 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ed37fe640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00cce0 tx=0x7f5ecc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00f450 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed41a6b30 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a7070 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ecc00fad0 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.140+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc018b60 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.141+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4100ee0 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.143+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5ecc00fc80 con 0x7f5ed4106a80 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.144+0000 7f5ebbfff640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 0x7f5ebc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:46.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.144+0000 7f5ed2ffd640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 0x7f5ebc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:46.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.144+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5ecc0d00b0 con 0x7f5ed4106a80 2024-09-19T09:27:46.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.144+0000 7f5ed2ffd640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 0x7f5ebc0a5780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4006010 tx=0x7f5ec4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:46.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.147+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ecc014030 con 0x7f5ed4106a80 2024-09-19T09:27:46.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.357+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ed40fe220 con 0x7f5ed4106a80 2024-09-19T09:27:46.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.358+0000 7f5ebbfff640 1 -- 172.21.15.52:0/702356145 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f5ecc09cdd0 con 0x7f5ed4106a80 2024-09-19T09:27:46.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:27:46.360 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:27:46.360 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 msgr2=0x7f5ebc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 0x7f5ebc0a5780 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4006010 tx=0x7f5ec4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 msgr2=0x7f5ed40fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00cce0 tx=0x7f5ecc00a620 comp rx=0 tx=0).stop 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 shutdown_connections 2024-09-19T09:27:46.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ed4106a80 0x7f5ed40fd770 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101420 0x7f5ed40fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5ebc0a32c0 0x7f5ebc0a5780 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 --2- 172.21.15.52:0/702356145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ed4100a80 0x7f5ed40fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.360+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 >> 172.21.15.52:0/702356145 conn(0x7f5ed40fc7a0 msgr2=0x7f5ed406a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.361+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 shutdown_connections 2024-09-19T09:27:46.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:46.361+0000 7f5ed92c4640 1 -- 172.21.15.52:0/702356145 wait complete. 2024-09-19T09:27:47.100 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:27:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:47 smithi052 ceph-mon[30947]: pgmap v528: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/702356145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:47 smithi169 ceph-mon[35454]: pgmap v528: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/702356145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:47 smithi086 ceph-mon[34813]: pgmap v528: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/702356145' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:27:47.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 -- 172.21.15.52:0/1297151677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750101de0 msgr2=0x7fa7501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 --2- 172.21.15.52:0/1297151677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750101de0 0x7fa7501021c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa740009900 tx=0x7fa74002a410 comp rx=0 tx=0).stop 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 -- 172.21.15.52:0/1297151677 shutdown_connections 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 --2- 172.21.15.52:0/1297151677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750106f10 0x7fa75010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 --2- 172.21.15.52:0/1297151677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 0x7fa7501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 --2- 172.21.15.52:0/1297151677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750101de0 0x7fa7501021c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 -- 172.21.15.52:0/1297151677 >> 172.21.15.52:0/1297151677 conn(0x7fa7500fd8c0 msgr2=0x7fa7500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 -- 172.21.15.52:0/1297151677 shutdown_connections 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.845+0000 7fa755a88640 1 -- 172.21.15.52:0/1297151677 wait complete. 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 Processor -- start 2024-09-19T09:27:47.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 -- start start 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 0x7fa750198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 0x7fa750198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111f70 con 0x7fa750106f10 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111df0 con 0x7fa750101de0 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa755a88640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501120f0 con 0x7fa750102790 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39968/0 (socket says 172.21.15.52:39968) 2024-09-19T09:27:47.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa74ffff640 1 -- 172.21.15.52:0/3320386438 learned_addr learned my addr 172.21.15.52:0/3320386438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.846+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 0x7fa750198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74effd640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 0x7fa750198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 -- 172.21.15.52:0/3320386438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 msgr2=0x7fa750198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 0x7fa750198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 -- 172.21.15.52:0/3320386438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 msgr2=0x7fa750198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 0x7fa750198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 -- 172.21.15.52:0/3320386438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75019d3e0 con 0x7fa750106f10 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 0x7fa750198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74ffff640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa74800cad0 tx=0x7fa74800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74cff9640 1 -- 172.21.15.52:0/3320386438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800ae20 con 0x7fa750106f10 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75019d6d0 con 0x7fa750106f10 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74cff9640 1 -- 172.21.15.52:0/3320386438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa748005020 con 0x7fa750106f10 2024-09-19T09:27:47.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa74cff9640 1 -- 172.21.15.52:0/3320386438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74800f6b0 con 0x7fa750106f10 2024-09-19T09:27:47.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.847+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa750074420 con 0x7fa750106f10 2024-09-19T09:27:47.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.849+0000 7fa74cff9640 1 -- 172.21.15.52:0/3320386438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa7480051d0 con 0x7fa750106f10 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 Processor -- start 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 -- start start 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fb5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fb5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555b94f1b2f0 con 0x555b94fc0370 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555b94ec2cf0 con 0x555b94fb6b40 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa757e61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b94f172b0 con 0x555b94fb55d0 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39980/0 (socket says 172.21.15.52:39980) 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74effd640 1 -- 172.21.15.52:0/916473933 learned_addr learned my addr 172.21.15.52:0/916473933 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:47.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74cff9640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 0x7fa7380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74effd640 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fb5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.850+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fb5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74ffff640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 0x7fa7380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 -- 172.21.15.52:0/916473933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 msgr2=0x555b94fb5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fb5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 -- 172.21.15.52:0/916473933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 msgr2=0x555b94fb5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fb5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 -- 172.21.15.52:0/916473933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b94ea73a0 con 0x555b94fc0370 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74cff9640 1 -- 172.21.15.52:0/3320386438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa7480cfd80 con 0x7fa750106f10 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa74effd640 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa7440149c0 tx=0x7fa74400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ff3b2eb91194bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa735ffb640 1 -- 172.21.15.52:0/916473933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440142d0 con 0x555b94fc0370 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa735ffb640 1 -- 172.21.15.52:0/916473933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744005500 con 0x555b94fc0370 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.851+0000 7fa735ffb640 1 -- 172.21.15.52:0/916473933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400f960 con 0x555b94fc0370 2024-09-19T09:27:47.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- 172.21.15.52:0/916473933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 msgr2=0x555b94fc2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa74ffff640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 0x7fa7380a5700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa748098c90 tx=0x7fa748066c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa7440149c0 tx=0x7fa74400c4d0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- 172.21.15.52:0/916473933 shutdown_connections 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc2760 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fb5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 --2- 172.21.15.52:0/916473933 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fb5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- 172.21.15.52:0/916473933 >> 172.21.15.52:0/916473933 conn(0x555b94f7e310 msgr2=0x555b94fb1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- 172.21.15.52:0/916473933 shutdown_connections 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- 172.21.15.52:0/916473933 wait complete. 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 -- start start 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.852+0000 7fa757e61740 1 Processor -- start 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fbfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 0x555b94fbd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555b94fc3070 con 0x555b94fb6b40 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555b94ed6060 con 0x555b94fc0370 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555b94fc31f0 con 0x555b94fb55d0 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa757e61740 10 client.0 _ll_register_callbacks cb 0x555b94c298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39990/0 (socket says 172.21.15.52:39990) 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 -- 172.21.15.52:0/3494742728 learned_addr learned my addr 172.21.15.52:0/3494742728 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74effd640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fbfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74effd640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 0x555b94fbd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 -- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 msgr2=0x555b94fbfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fbfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 -- 172.21.15.52:0/3494742728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 msgr2=0x555b94fbd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 0x555b94fbd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 -- 172.21.15.52:0/3494742728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b94c8c3c0 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74effd640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 0x555b94fbd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa740031550 tx=0x7fa7400319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fbd862468a6e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.853+0000 7fa72effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740035070 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa740004240 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa744005500 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa740049030 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 10 client.17745 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555b94fceb10 con 0x555b94fb6b40 2024-09-19T09:27:47.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744005500 con 0x555b94fb6b40 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa740004a60 con 0x555b94fb6b40 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 10 client.17745 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 10 client.17745 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 20 client.17745 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b94fcffd0 0x555b94fd23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 4 client.17745 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.854+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b94f28860 con 0x555b94fcffd0 2024-09-19T09:27:47.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.855+0000 7fa74effd640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b94fcffd0 0x555b94fd23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.855+0000 7fa74effd640 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b94fcffd0 0x555b94fd23f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a11a66c7145b87 server_cookie=d081333c62942b5a in_seq=0 out_seq=0 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.855+0000 7fa72effd640 10 client.17745 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa72effd640 1 -- 172.21.15.52:0/3494742728 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b94f28860 con 0x555b94fcffd0 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa72effd640 10 client.17745 handle_command_reply: tid=0 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 client.17745 shutdown 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 msgr2=0x555b94fbd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa740031550 tx=0x7fa7400319a0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 shutdown_connections 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b94fcffd0 0x555b94fd23f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fc0370 0x555b94fbd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fb6b40 0x555b94fbd020 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 --2- 172.21.15.52:0/3494742728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fbfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa72effd640 0 client.17745 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.856+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 >> 172.21.15.52:0/3494742728 conn(0x555b94f7e310 msgr2=0x555b94fb7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.857+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 shutdown_connections 2024-09-19T09:27:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.857+0000 7fa757e61740 1 -- 172.21.15.52:0/3494742728 wait complete. 2024-09-19T09:27:47.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.857+0000 7fa757e61740 20 client.17745 trim_cache size 0 max 16384 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.869+0000 7fa757e61740 1 Processor -- start 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 -- start start 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb55d0 0x555b94fcc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb6b40 0x555b94fd7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501b22e0 con 0x555b94fc0370 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501afbb0 con 0x555b94fb55d0 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa757e61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501ada00 con 0x555b94fb6b40 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39996/0 (socket says 172.21.15.52:39996) 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 -- 172.21.15.52:0/3629144541 learned_addr learned my addr 172.21.15.52:0/3629144541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb55d0 0x555b94fcc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 -- 172.21.15.52:0/3629144541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb6b40 msgr2=0x555b94fd7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb6b40 0x555b94fd7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 -- 172.21.15.52:0/3629144541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb55d0 msgr2=0x555b94fcc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb55d0 0x555b94fcc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 -- 172.21.15.52:0/3629144541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b94fb2960 con 0x555b94fc0370 2024-09-19T09:27:47.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.870+0000 7fa74effd640 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa744014990 tx=0x7fa744004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c5d3ae1e85046e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa7357fa640 1 -- 172.21.15.52:0/3629144541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744004640 con 0x555b94fc0370 2024-09-19T09:27:47.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa7357fa640 1 -- 172.21.15.52:0/3629144541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74400fc10 con 0x555b94fc0370 2024-09-19T09:27:47.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa7357fa640 1 -- 172.21.15.52:0/3629144541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744004fe0 con 0x555b94fc0370 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- 172.21.15.52:0/3629144541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 msgr2=0x555b94fd8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa744014990 tx=0x7fa744004c50 comp rx=0 tx=0).stop 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- 172.21.15.52:0/3629144541 shutdown_connections 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fd8200 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb6b40 0x555b94fd7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 --2- 172.21.15.52:0/3629144541 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb55d0 0x555b94fcc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- 172.21.15.52:0/3629144541 >> 172.21.15.52:0/3629144541 conn(0x555b94f7e310 msgr2=0x555b94fbc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- 172.21.15.52:0/3629144541 shutdown_connections 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- 172.21.15.52:0/3629144541 wait complete. 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.871+0000 7fa757e61740 1 -- start start 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 Processor -- start 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fc8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fc8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501ae070 con 0x555b94fc0370 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501af4e0 con 0x555b94fb6b40 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501ae740 con 0x555b94fb55d0 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa757e61740 10 client.0 _ll_register_callbacks cb 0x7fa740009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39998/0 (socket says 172.21.15.52:39998) 2024-09-19T09:27:47.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 -- 172.21.15.52:0/1759398071 learned_addr learned my addr 172.21.15.52:0/1759398071 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fc8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fc8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 -- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 msgr2=0x555b94fc8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fc8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 -- 172.21.15.52:0/1759398071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 msgr2=0x555b94fc8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fc8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.872+0000 7fa74effd640 1 -- 172.21.15.52:0/1759398071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b94fb8120 con 0x555b94fc0370 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa74effd640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa7440149c0 tx=0x7fa74400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d40755fb0eed1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440140c0 con 0x555b94fc0370 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa74400f730 con 0x555b94fc0370 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa74400fc10 con 0x555b94fc0370 2024-09-19T09:27:47.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa74400f930 con 0x555b94fc0370 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 10 client.17751 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555b9503b5a0 con 0x555b94fc0370 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74400fc10 con 0x555b94fc0370 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa74402f070 con 0x555b94fc0370 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 10 client.17751 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 10 client.17751 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 20 client.17751 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b9503b9d0 0x555b9503ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 4 client.17751 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.873+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b94f22d70 con 0x555b9503b9d0 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b9503b9d0 0x555b9503ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa74f7fe640 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b9503b9d0 0x555b9503ddc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e42081ef93e6d9de server_cookie=9d530d3979c8ac0a in_seq=0 out_seq=0 2024-09-19T09:27:47.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa72effd640 10 client.17751 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa72effd640 1 -- 172.21.15.52:0/1759398071 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b94f22d70 con 0x555b9503b9d0 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa72effd640 10 client.17751 handle_command_reply: tid=0 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa757e61740 1 client.17751 shutdown 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 msgr2=0x555b94fc5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.874+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa7440149c0 tx=0x7fa74400c990 comp rx=0 tx=0).stop 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 shutdown_connections 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555b9503b9d0 0x555b9503ddc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555b94fc0370 0x555b94fc5420 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555b94fb6b40 0x555b94fc8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa72effd640 0 client.17751 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 --2- 172.21.15.52:0/1759398071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555b94fb55d0 0x555b94fc8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 >> 172.21.15.52:0/1759398071 conn(0x555b94f7e310 msgr2=0x555b94fbe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 shutdown_connections 2024-09-19T09:27:47.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 1 -- 172.21.15.52:0/1759398071 wait complete. 2024-09-19T09:27:47.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa757e61740 20 client.17751 trim_cache size 0 max 16384 2024-09-19T09:27:47.882 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:47.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 msgr2=0x7fa7380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 0x7fa7380a5700 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa748098c90 tx=0x7fa748066c50 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 msgr2=0x7fa75019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa74800cad0 tx=0x7fa74800cf90 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 shutdown_connections 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa750106f10 0x7fa75019cd00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7380a3240 0x7fa7380a5700 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa750102790 0x7fa750198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 --2- 172.21.15.52:0/3320386438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa750101de0 0x7fa750198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.875+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 >> 172.21.15.52:0/3320386438 conn(0x7fa7500fd8c0 msgr2=0x7fa7500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:47.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.876+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 shutdown_connections 2024-09-19T09:27:47.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:47.876+0000 7fa755a88640 1 -- 172.21.15.52:0/3320386438 wait complete. 2024-09-19T09:27:48.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:27:48.957 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:49.371 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:49 smithi052 ceph-mon[30947]: pgmap v529: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:49 smithi169 ceph-mon[35454]: pgmap v529: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:49.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 -- 172.21.15.52:0/2850395389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094101420 msgr2=0x7f709410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 --2- 172.21.15.52:0/2850395389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094101420 0x7f709410d950 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f708c009cd0 tx=0x7f708c02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 -- 172.21.15.52:0/2850395389 shutdown_connections 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 --2- 172.21.15.52:0/2850395389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094101420 0x7f709410d950 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 --2- 172.21.15.52:0/2850395389 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 0x7f7094100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 --2- 172.21.15.52:0/2850395389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094106a80 0x7f7094106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 -- 172.21.15.52:0/2850395389 >> 172.21.15.52:0/2850395389 conn(0x7f70940fc7a0 msgr2=0x7f70940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 -- 172.21.15.52:0/2850395389 shutdown_connections 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 -- 172.21.15.52:0/2850395389 wait complete. 2024-09-19T09:27:49.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.455+0000 7f709c10e640 1 Processor -- start 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 -- start start 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 0x7f7094198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094101420 0x7f70941988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7094110e80 con 0x7f7094106a80 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7094110d00 con 0x7f7094101420 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709c10e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7094111000 con 0x7f7094100a80 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46742/0 (socket says 172.21.15.52:46742) 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 -- 172.21.15.52:0/4245410958 learned_addr learned my addr 172.21.15.52:0/4245410958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f7099eaa640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 0x7f7094198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f70996a9640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094101420 0x7f70941988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 -- 172.21.15.52:0/4245410958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 msgr2=0x7f7094198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 0x7f7094198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 -- 172.21.15.52:0/4245410958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094101420 msgr2=0x7f70941988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094101420 0x7f70941988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.456+0000 7f709a6ab640 1 -- 172.21.15.52:0/4245410958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709419d320 con 0x7f7094106a80 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f709a6ab640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f708c009ca0 tx=0x7f708c030ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f708affd640 1 -- 172.21.15.52:0/4245410958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c003e00 con 0x7f7094106a80 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709419d5b0 con 0x7f7094106a80 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f708affd640 1 -- 172.21.15.52:0/4245410958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c040070 con 0x7f7094106a80 2024-09-19T09:27:49.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f708affd640 1 -- 172.21.15.52:0/4245410958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c045b00 con 0x7f7094106a80 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.457+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a4ef0 con 0x7f7094106a80 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.459+0000 7f708affd640 1 -- 172.21.15.52:0/4245410958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f708c004040 con 0x7f7094106a80 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.459+0000 7f709e4e7740 1 Processor -- start 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 -- start start 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841682a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x56384168f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5638415e82f0 con 0x563841683b40 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56384158fcf0 con 0x5638416825d0 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f709e4e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638415e42b0 con 0x56384168d370 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46754/0 (socket says 172.21.15.52:46754) 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f70996a9640 1 -- 172.21.15.52:0/3636068945 learned_addr learned my addr 172.21.15.52:0/3636068945 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841682a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f708affd640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 0x7f70800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.460+0000 7f70996a9640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x56384168f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f709a6ab640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 0x7f70800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f708affd640 1 -- 172.21.15.52:0/4245410958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f708c0f0ea0 con 0x7f7094106a80 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 -- 172.21.15.52:0/3636068945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 msgr2=0x56384168f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x56384168f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 -- 172.21.15.52:0/3636068945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 msgr2=0x563841682090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 -- 172.21.15.52:0/3636068945 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638415743a0 con 0x5638416825d0 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f70996a9640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:49.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841682a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f709000ab70 tx=0x7f709000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a10e6cc2efebf99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f709a6ab640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 0x7f70800a5700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f708c03bfd0 tx=0x7f708c0b28c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f707ffff640 1 -- 172.21.15.52:0/3636068945 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090005220 con 0x5638416825d0 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f707ffff640 1 -- 172.21.15.52:0/3636068945 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7090004c80 con 0x5638416825d0 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.461+0000 7f707ffff640 1 -- 172.21.15.52:0/3636068945 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900187a0 con 0x5638416825d0 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- 172.21.15.52:0/3636068945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 msgr2=0x563841682a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841682a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f709000ab70 tx=0x7f709000f790 comp rx=0 tx=0).stop 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- 172.21.15.52:0/3636068945 shutdown_connections 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x56384168f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841682a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3636068945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841682090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- 172.21.15.52:0/3636068945 >> 172.21.15.52:0/3636068945 conn(0x56384164b310 msgr2=0x56384167ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- 172.21.15.52:0/3636068945 shutdown_connections 2024-09-19T09:27:49.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- 172.21.15.52:0/3636068945 wait complete. 2024-09-19T09:27:49.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.462+0000 7f709e4e7740 1 -- start start 2024-09-19T09:27:49.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 Processor -- start 2024-09-19T09:27:49.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x56384168ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563841683b40 0x563841689f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563841690070 con 0x56384168d370 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5638415a3060 con 0x5638416825d0 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638416901f0 con 0x563841683b40 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f709e4e7740 10 client.0 _ll_register_callbacks cb 0x5638412f68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46756/0 (socket says 172.21.15.52:46756) 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f70996a9640 1 -- 172.21.15.52:0/3051235600 learned_addr learned my addr 172.21.15.52:0/3051235600 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f70996a9640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x56384168ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.463+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563841683b40 0x563841689f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 -- 172.21.15.52:0/3051235600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563841683b40 msgr2=0x563841689f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563841683b40 0x563841689f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 -- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 msgr2=0x56384168ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x56384168ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 -- 172.21.15.52:0/3051235600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638413593c0 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f70996a9640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f70840037b0 tx=0x7f708400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff7e3f0974d9fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f707d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70840107d0 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7090004c80 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7084010970 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7084010b70 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f709e4e7740 10 client.17763 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56384169bb30 con 0x56384168d370 2024-09-19T09:27:49.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.464+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7090004c80 con 0x56384168d370 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f708402bc60 con 0x56384168d370 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 10 client.17763 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 10 client.17763 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 20 client.17763 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56384169cf40 0x56384169f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 4 client.17763 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638415f5860 con 0x56384169cf40 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.465+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56384169cf40 0x56384169f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.466+0000 7f7099eaa640 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56384169cf40 0x56384169f350 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=144faf8d25de3c3e server_cookie=c2408bb2ae2810d7 in_seq=0 out_seq=0 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.466+0000 7f707d7fa640 10 client.17763 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.466+0000 7f707d7fa640 1 -- 172.21.15.52:0/3051235600 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638415f5860 con 0x56384169cf40 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.466+0000 7f707d7fa640 10 client.17763 handle_command_reply: tid=0 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.466+0000 7f709e4e7740 1 client.17763 shutdown 2024-09-19T09:27:49.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 msgr2=0x56384168a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f70840037b0 tx=0x7f708400b390 comp rx=0 tx=0).stop 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 shutdown_connections 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168a4d0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563841683b40 0x563841689f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56384169cf40 0x56384169f350 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 --2- 172.21.15.52:0/3051235600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x56384168ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f707d7fa640 0 client.17763 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 >> 172.21.15.52:0/3051235600 conn(0x56384164b310 msgr2=0x563841684930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 shutdown_connections 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 1 -- 172.21.15.52:0/3051235600 wait complete. 2024-09-19T09:27:49.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.467+0000 7f709e4e7740 20 client.17763 trim_cache size 0 max 16384 2024-09-19T09:27:49.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 Processor -- start 2024-09-19T09:27:49.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 -- start start 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638416825d0 0x563841699310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 0x56384168e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70941afec0 con 0x56384168d370 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70941ad790 con 0x563841683b40 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f709e4e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70941ab5e0 con 0x5638416825d0 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46760/0 (socket says 172.21.15.52:46760) 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 -- 172.21.15.52:0/209000835 learned_addr learned my addr 172.21.15.52:0/209000835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f7099eaa640 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 0x56384168e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 -- 172.21.15.52:0/209000835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638416825d0 msgr2=0x563841699310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638416825d0 0x563841699310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 -- 172.21.15.52:0/209000835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 msgr2=0x56384168e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 0x56384168e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f70996a9640 1 -- 172.21.15.52:0/209000835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56384167eed0 con 0x56384168d370 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.480+0000 7f7099eaa640 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 0x56384168e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f70996a9640 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7084011440 tx=0x7f7084005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527c61597dc64b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f707f7fe640 1 -- 172.21.15.52:0/209000835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084030030 con 0x56384168d370 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f707f7fe640 1 -- 172.21.15.52:0/209000835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7084004250 con 0x56384168d370 2024-09-19T09:27:49.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f707f7fe640 1 -- 172.21.15.52:0/209000835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70840107a0 con 0x56384168d370 2024-09-19T09:27:49.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 -- 172.21.15.52:0/209000835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 msgr2=0x56384168eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f7084011440 tx=0x7f7084005f90 comp rx=0 tx=0).stop 2024-09-19T09:27:49.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 -- 172.21.15.52:0/209000835 shutdown_connections 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56384168d370 0x56384168eca0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563841683b40 0x56384168e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 --2- 172.21.15.52:0/209000835 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638416825d0 0x563841699310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 -- 172.21.15.52:0/209000835 >> 172.21.15.52:0/209000835 conn(0x56384164b310 msgr2=0x563841688840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 -- 172.21.15.52:0/209000835 shutdown_connections 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.481+0000 7f709e4e7740 1 -- 172.21.15.52:0/209000835 wait complete. 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 -- start start 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 Processor -- start 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841695770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x5638416a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70941abc50 con 0x563841683b40 2024-09-19T09:27:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70941ad0c0 con 0x5638416825d0 2024-09-19T09:27:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70941ac320 con 0x56384168d370 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f709e4e7740 10 client.0 _ll_register_callbacks cb 0x7f70840035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f7099eaa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f7099eaa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46768/0 (socket says 172.21.15.52:46768) 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.482+0000 7f7099eaa640 1 -- 172.21.15.52:0/1330037553 learned_addr learned my addr 172.21.15.52:0/1330037553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f70996a9640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841695770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f70996a9640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x5638416a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 -- 172.21.15.52:0/1330037553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 msgr2=0x5638416a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x5638416a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 -- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 msgr2=0x563841695770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841695770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 -- 172.21.15.52:0/1330037553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638416a4b20 con 0x563841683b40 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f7099eaa640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f709000a330 tx=0x7f709000ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15832a65d69ccb34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f707d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900049b0 con 0x563841683b40 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7090004b50 con 0x563841683b40 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7084004250 con 0x563841683b40 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7090038030 con 0x563841683b40 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f709e4e7740 10 client.17769 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.483+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563841695080 con 0x563841683b40 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7084004250 con 0x563841683b40 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7090018710 con 0x563841683b40 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 10 client.17769 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 10 client.17769 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 20 client.17769 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563841707da0 0x56384170a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 4 client.17769 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638415efd70 con 0x563841707da0 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f70996a9640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563841707da0 0x56384170a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f707d7fa640 10 client.17769 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.484+0000 7f70996a9640 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563841707da0 0x56384170a1c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2ad7aa30bea344c server_cookie=89895fe98dcc8e9e in_seq=0 out_seq=0 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f707d7fa640 1 -- 172.21.15.52:0/1330037553 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638415efd70 con 0x563841707da0 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f707d7fa640 10 client.17769 handle_command_reply: tid=0 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 client.17769 shutdown 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 msgr2=0x563841695cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f709000a330 tx=0x7f709000ab00 comp rx=0 tx=0).stop 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 shutdown_connections 2024-09-19T09:27:49.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56384168d370 0x5638416a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563841683b40 0x563841695cb0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563841707da0 0x56384170a1c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 --2- 172.21.15.52:0/1330037553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638416825d0 0x563841695770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 >> 172.21.15.52:0/1330037553 conn(0x56384164b310 msgr2=0x56384168bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f707d7fa640 0 client.17769 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 shutdown_connections 2024-09-19T09:27:49.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 1 -- 172.21.15.52:0/1330037553 wait complete. 2024-09-19T09:27:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.485+0000 7f709e4e7740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T09:27:49.496 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 msgr2=0x7f70800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 0x7f70800a5700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f708c03bfd0 tx=0x7f708c0b28c0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 msgr2=0x7f709419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f708c009ca0 tx=0x7f708c030ee0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 shutdown_connections 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7094106a80 0x7f709419cc40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7094101420 0x7f70941988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70800a3240 0x7f70800a5700 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 --2- 172.21.15.52:0/4245410958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7094100a80 0x7f7094198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 >> 172.21.15.52:0/4245410958 conn(0x7f70940fc7a0 msgr2=0x7f7094104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 shutdown_connections 2024-09-19T09:27:49.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:49.486+0000 7f709c10e640 1 -- 172.21.15.52:0/4245410958 wait complete. 2024-09-19T09:27:49.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:49 smithi086 ceph-mon[34813]: pgmap v529: 97 pgs: 97 active+clean; 3.2 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:27:50.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:27:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:51.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1146834413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 msgr2=0x7f7d58106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1146834413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58106810 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009900 tx=0x7f7d4002a410 comp rx=0 tx=0).stop 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1146834413 shutdown_connections 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1146834413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d5810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1146834413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58106810 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1146834413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 0x7f7d581021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1146834413 >> 172.21.15.52:0/1146834413 conn(0x7f7d580fd8d0 msgr2=0x7f7d580ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1146834413 shutdown_connections 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.020+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1146834413 wait complete. 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 Processor -- start 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 -- start start 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 0x7f7d580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58111fa0 con 0x7f7d581027c0 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58111e20 con 0x7f7d58106f40 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5ce5b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58112120 con 0x7f7d58101e10 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46794/0 (socket says 172.21.15.52:46794) 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 -- 172.21.15.52:0/1729018478 learned_addr learned my addr 172.21.15.52:0/1729018478 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d5659c640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 0x7f7d580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 -- 172.21.15.52:0/1729018478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 msgr2=0x7f7d580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 0x7f7d580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 -- 172.21.15.52:0/1729018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 msgr2=0x7f7d58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d55d9b640 1 -- 172.21.15.52:0/1729018478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d581a68f0 con 0x7f7d581027c0 2024-09-19T09:27:51.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.021+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006010 tx=0x7f7d400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d4f7fe640 1 -- 172.21.15.52:0/1729018478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4003f030 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d4f7fe640 1 -- 172.21.15.52:0/1729018478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d40003ce0 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d581a6b80 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d4f7fe640 1 -- 172.21.15.52:0/1729018478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40035070 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.022+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581a7060 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.024+0000 7f7d4f7fe640 1 -- 172.21.15.52:0/1729018478 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7d40042030 con 0x7f7d581027c0 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.024+0000 7f7d5f234740 1 Processor -- start 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 -- start start 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cf3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559618c4c2f0 con 0x559618ce7b40 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559618bf3cf0 con 0x559618cf1370 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5f234740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559618c482b0 con 0x559618ce65d0 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46804/0 (socket says 172.21.15.52:46804) 2024-09-19T09:27:51.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3056406841 learned_addr learned my addr 172.21.15.52:0/3056406841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d5659c640 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.025+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cf3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3056406841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 msgr2=0x559618ce6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3056406841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 msgr2=0x559618cf3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cf3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3056406841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559618bd83a0 con 0x559618ce7b40 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d4f7fe640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 0x7f7d440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000bca0 tx=0x7f7d5000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7231977862dcc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d5659c640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 0x7f7d440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d4f7fe640 1 -- 172.21.15.52:0/1729018478 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7d400f0080 con 0x7f7d581027c0 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d4cff9640 1 -- 172.21.15.52:0/3056406841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50015070 con 0x559618ce7b40 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d4cff9640 1 -- 172.21.15.52:0/3056406841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d50005500 con 0x559618ce7b40 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.026+0000 7f7d4cff9640 1 -- 172.21.15.52:0/3056406841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50011640 con 0x559618ce7b40 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- 172.21.15.52:0/3056406841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 msgr2=0x559618ce6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5659c640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 0x7f7d440a5700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559618ce3ac0 tx=0x7f7d48009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000bca0 tx=0x7f7d5000f730 comp rx=0 tx=0).stop 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- 172.21.15.52:0/3056406841 shutdown_connections 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cf3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3056406841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618ce6090 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- 172.21.15.52:0/3056406841 >> 172.21.15.52:0/3056406841 conn(0x559618caf310 msgr2=0x559618ce2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- 172.21.15.52:0/3056406841 shutdown_connections 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- 172.21.15.52:0/3056406841 wait complete. 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 -- start start 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.027+0000 7f7d5f234740 1 Processor -- start 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618cf0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559618cf4070 con 0x559618ce7b40 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559618c07060 con 0x559618cf1370 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559618cf41f0 con 0x559618ce65d0 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 10 client.0 _ll_register_callbacks cb 0x55961895a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46818/0 (socket says 172.21.15.52:46818) 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 -- 172.21.15.52:0/2833125268 learned_addr learned my addr 172.21.15.52:0/2833125268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5659c640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618cf0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 -- 172.21.15.52:0/2833125268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 msgr2=0x559618cf0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618cf0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 -- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 msgr2=0x559618cee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 -- 172.21.15.52:0/2833125268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596189bd3c0 con 0x559618ce7b40 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7d400c4dc0 tx=0x7f7d40005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23feb8c9c0312ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d40049070 con 0x559618ce7b40 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7d400f20d0 con 0x559618ce7b40 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.028+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d50005500 con 0x559618ce7b40 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7d400b8920 con 0x559618ce7b40 2024-09-19T09:27:51.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 10 client.17781 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559618cffb40 con 0x559618ce7b40 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d50005500 con 0x559618ce7b40 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7d400f3c30 con 0x559618ce7b40 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 10 client.17781 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 10 client.17781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 20 client.17781 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:51.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d03340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 4 client.17781 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559618c59860 con 0x559618d00f50 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.029+0000 7f7d5659c640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d03340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.030+0000 7f7d3dffb640 10 client.17781 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.030+0000 7f7d5659c640 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d03340 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6df9a3ea8b7f5b server_cookie=5e57db8a3ac0888 in_seq=0 out_seq=0 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.030+0000 7f7d3dffb640 1 -- 172.21.15.52:0/2833125268 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559618c59860 con 0x559618d00f50 2024-09-19T09:27:51.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.030+0000 7f7d3dffb640 10 client.17781 handle_command_reply: tid=0 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.030+0000 7f7d5f234740 1 client.17781 shutdown 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 msgr2=0x559618cee020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f7d400c4dc0 tx=0x7f7d40005b50 comp rx=0 tx=0).stop 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 shutdown_connections 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d03340 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618cf1370 0x559618cee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce7b40 0x559618cee020 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d3dffb640 0 client.17781 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 --2- 172.21.15.52:0/2833125268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618cf0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 >> 172.21.15.52:0/2833125268 conn(0x559618caf310 msgr2=0x559618ce8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 shutdown_connections 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 1 -- 172.21.15.52:0/2833125268 wait complete. 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.031+0000 7f7d5f234740 20 client.17781 trim_cache size 0 max 16384 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 Processor -- start 2024-09-19T09:27:51.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 -- start start 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cfd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b2200 con 0x559618cf1370 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581afad0 con 0x559618ce7b40 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d5f234740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581ad920 con 0x559618ce65d0 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46834/0 (socket says 172.21.15.52:46834) 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3821424184 learned_addr learned my addr 172.21.15.52:0/3821424184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3821424184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 msgr2=0x559618ce2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3821424184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 msgr2=0x559618cfd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cfd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.044+0000 7f7d56d9d640 1 -- 172.21.15.52:0/3821424184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559618ce9120 con 0x559618cf1370 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7d50018000 tx=0x7f7d5000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de8d7836b984f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d3ffff640 1 -- 172.21.15.52:0/3821424184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50028070 con 0x559618cf1370 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d3ffff640 1 -- 172.21.15.52:0/3821424184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d5000b7e0 con 0x559618cf1370 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d3ffff640 1 -- 172.21.15.52:0/3821424184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50015070 con 0x559618cf1370 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 -- 172.21.15.52:0/3821424184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 msgr2=0x559618d08c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7d50018000 tx=0x7f7d5000bf20 comp rx=0 tx=0).stop 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 -- 172.21.15.52:0/3821424184 shutdown_connections 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618cf1370 0x559618d08c10 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cfd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3821424184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618ce65d0 0x559618ce2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.045+0000 7f7d5f234740 1 -- 172.21.15.52:0/3821424184 >> 172.21.15.52:0/3821424184 conn(0x559618caf310 msgr2=0x559618ce2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- 172.21.15.52:0/3821424184 shutdown_connections 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- 172.21.15.52:0/3821424184 wait complete. 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- start start 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 Processor -- start 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cf5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618cf1370 0x559618d6abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581adf90 con 0x559618ce65d0 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581af400 con 0x559618ce7b40 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581ae660 con 0x559618cf1370 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5f234740 10 client.0 _ll_register_callbacks cb 0x7f7d400f37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46840/0 (socket says 172.21.15.52:46840) 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d5659c640 1 -- 172.21.15.52:0/3234056013 learned_addr learned my addr 172.21.15.52:0/3234056013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cf5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.046+0000 7f7d56d9d640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618cf1370 0x559618d6abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 -- 172.21.15.52:0/3234056013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618cf1370 msgr2=0x559618d6abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618cf1370 0x559618d6abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 -- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 msgr2=0x559618cf5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cf5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 -- 172.21.15.52:0/3234056013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559618d6b120 con 0x559618ce65d0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cf5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5659c640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005fd0 tx=0x7f7d48005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4101905a99cf0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4802a420 con 0x559618ce65d0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7d4802a5c0 con 0x559618ce65d0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d5000b7e0 con 0x559618ce65d0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7d48039050 con 0x559618ce65d0 2024-09-19T09:27:51.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5f234740 10 client.17787 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559618d6c3e0 con 0x559618ce65d0 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.047+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d5000b7e0 con 0x559618ce65d0 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7d48032060 con 0x559618ce65d0 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 10 client.17787 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 20 client.17787 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d6eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 4 client.17787 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559618c53d70 con 0x559618d00f50 2024-09-19T09:27:51.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d6eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:51.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d3dffb640 10 client.17787 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:51.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.048+0000 7f7d55d9b640 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d6eb70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ce84188f4b12a7 server_cookie=2f64c0a641b5d94 in_seq=0 out_seq=0 2024-09-19T09:27:51.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d3dffb640 1 -- 172.21.15.52:0/3234056013 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559618c53d70 con 0x559618d00f50 2024-09-19T09:27:51.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d3dffb640 10 client.17787 handle_command_reply: tid=0 2024-09-19T09:27:51.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 client.17787 shutdown 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 msgr2=0x559618cf58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005fd0 tx=0x7f7d48005c80 comp rx=0 tx=0).stop 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 shutdown_connections 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559618d00f50 0x559618d6eb70 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559618cf1370 0x559618d6abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559618ce7b40 0x559618cf5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 --2- 172.21.15.52:0/3234056013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559618ce65d0 0x559618cf58c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d3dffb640 0 client.17787 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 >> 172.21.15.52:0/3234056013 conn(0x559618caf310 msgr2=0x559618ce14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 shutdown_connections 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 1 -- 172.21.15.52:0/3234056013 wait complete. 2024-09-19T09:27:51.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5f234740 20 client.17787 trim_cache size 0 max 16384 2024-09-19T09:27:51.072 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 msgr2=0x7f7d440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 0x7f7d440a5700 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559618ce3ac0 tx=0x7f7d48009500 comp rx=0 tx=0).stop 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 msgr2=0x7f7d58074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.049+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006010 tx=0x7f7d400042f0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 shutdown_connections 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d58106f40 0x7f7d58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d581027c0 0x7f7d58074a30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7d440a3240 0x7f7d440a5700 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 --2- 172.21.15.52:0/1729018478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d58101e10 0x7f7d580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 >> 172.21.15.52:0/1729018478 conn(0x7f7d580fd8d0 msgr2=0x7f7d580feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 shutdown_connections 2024-09-19T09:27:51.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:51.050+0000 7f7d5ce5b640 1 -- 172.21.15.52:0/1729018478 wait complete. 2024-09-19T09:27:51.418 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:51 smithi052 ceph-mon[30947]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:51 smithi169 ceph-mon[35454]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:51 smithi086 ceph-mon[34813]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:52.945 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:27:52.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:27:53.218 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:53.338 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:53 smithi052 ceph-mon[30947]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:53.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:53 smithi169 ceph-mon[35454]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:53.507 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:53 smithi086 ceph-mon[34813]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:27:53.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 -- 172.21.15.52:0/3549126888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc0745a0 msgr2=0x7f1dfc074980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3549126888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc074980 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009900 tx=0x7f1dec02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 -- 172.21.15.52:0/3549126888 shutdown_connections 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3549126888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc10e470 0x7f1dfc1108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3549126888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc074f50 0x7f1dfc10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3549126888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc074980 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.690+0000 7f1e016b1640 1 -- 172.21.15.52:0/3549126888 >> 172.21.15.52:0/3549126888 conn(0x7f1dfc0fd8d0 msgr2=0x7f1dfc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- 172.21.15.52:0/3549126888 shutdown_connections 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- 172.21.15.52:0/3549126888 wait complete. 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 Processor -- start 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- start start 2024-09-19T09:27:53.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc074f50 0x7f1dfc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc114200 con 0x7f1dfc10e470 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc114080 con 0x7f1dfc0745a0 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.691+0000 7f1e016b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc114380 con 0x7f1dfc074f50 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46846/0 (socket says 172.21.15.52:46846) 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 -- 172.21.15.52:0/3188089181 learned_addr learned my addr 172.21.15.52:0/3188089181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc074f50 0x7f1dfc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 -- 172.21.15.52:0/3188089181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc074f50 msgr2=0x7f1dfc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc074f50 0x7f1dfc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 -- 172.21.15.52:0/3188089181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc0745a0 msgr2=0x7f1dfc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 -- 172.21.15.52:0/3188089181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc19f620 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1dfb7fe640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cad0 tx=0x7f1df400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1de3fff640 1 -- 172.21.15.52:0/3188089181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400ae20 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc19f910 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1de3fff640 1 -- 172.21.15.52:0/3188089181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df4005020 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1de3fff640 1 -- 172.21.15.52:0/3188089181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400f6b0 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.692+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc1a71f0 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.695+0000 7f1de3fff640 1 -- 172.21.15.52:0/3188089181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1df40051d0 con 0x7f1dfc10e470 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.695+0000 7f1e03a8a740 1 Processor -- start 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.695+0000 7f1e03a8a740 1 -- start start 2024-09-19T09:27:53.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c092f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c09d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56168bff8280 con 0x56168c09dd40 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56168bf9fb10 con 0x56168c092b60 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56168bff4240 con 0x56168c093480 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1de3fff640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 0x7f1de40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46856/0 (socket says 172.21.15.52:46856) 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/414537188 learned_addr learned my addr 172.21.15.52:0/414537188 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c09d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfb7fe640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 0x7f1de40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/414537188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 msgr2=0x56168c09d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1de3fff640 1 -- 172.21.15.52:0/3188089181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1df40cfce0 con 0x7f1dfc10e470 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c09d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/414537188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 msgr2=0x56168c092f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c092f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.696+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/414537188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168bfac1f0 con 0x56168c09dd40 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013930 tx=0x7f1df000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6200405e750461f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1dfb7fe640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 0x7f1de40a5700 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1df40a4960 tx=0x7f1df4086b60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1de17fa640 1 -- 172.21.15.52:0/414537188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df000e950 con 0x56168c09dd40 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1de17fa640 1 -- 172.21.15.52:0/414537188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0011440 con 0x56168c09dd40 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1de17fa640 1 -- 172.21.15.52:0/414537188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0010630 con 0x56168c09dd40 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 -- 172.21.15.52:0/414537188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 msgr2=0x56168c0a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013930 tx=0x7f1df000b460 comp rx=0 tx=0).stop 2024-09-19T09:27:53.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 -- 172.21.15.52:0/414537188 shutdown_connections 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a0130 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c09d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/414537188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c092f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.697+0000 7f1e03a8a740 1 -- 172.21.15.52:0/414537188 >> 172.21.15.52:0/414537188 conn(0x56168c08f0f0 msgr2=0x56168c08f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- 172.21.15.52:0/414537188 shutdown_connections 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- 172.21.15.52:0/414537188 wait complete. 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- start start 2024-09-19T09:27:53.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 Processor -- start 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c09b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c09dd40 0x56168c09b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56168c0a0910 con 0x56168c092b60 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56168bfb2f10 con 0x56168c093480 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56168c0a0a90 con 0x56168c09dd40 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1e03a8a740 10 client.0 _ll_register_callbacks cb 0x56168bf7ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46864/0 (socket says 172.21.15.52:46864) 2024-09-19T09:27:53.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/2140241699 learned_addr learned my addr 172.21.15.52:0/2140241699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c09b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.698+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c09dd40 0x56168c09b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/2140241699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c09dd40 msgr2=0x56168c09b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c09dd40 0x56168c09b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 msgr2=0x56168c09b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c09b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/2140241699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168bd696a0 con 0x56168c092b60 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1df0011df0 tx=0x7f1df0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825d4b95eca7aafa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1ddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:53.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0011a30 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1df0005050 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df0011440 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1df0033050 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1e03a8a740 10 client.17799 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56168c0ac540 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.699+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0011440 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1df000ec70 con 0x56168c092b60 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 10 client.17799 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 10 client.17799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 20 client.17799 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c0ad890 0x56168c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 4 client.17799 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56168c0057f0 con 0x56168c0ad890 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c0ad890 0x56168c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1ddeff5640 10 client.17799 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.700+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c0ad890 0x56168c0afc80 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988a6714eac3f315 server_cookie=4b9bfc0cad129544 in_seq=0 out_seq=0 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1ddeff5640 1 -- 172.21.15.52:0/2140241699 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56168c0057f0 con 0x56168c0ad890 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1ddeff5640 10 client.17799 handle_command_reply: tid=0 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 client.17799 shutdown 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 msgr2=0x56168c09ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1df0011df0 tx=0x7f1df0005850 comp rx=0 tx=0).stop 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 shutdown_connections 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c0ad890 0x56168c0afc80 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c09dd40 0x56168c09b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c09b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/2140241699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c092b60 0x56168c09ac40 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 >> 172.21.15.52:0/2140241699 conn(0x56168c08f0f0 msgr2=0x56168c094dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1ddeff5640 0 client.17799 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 shutdown_connections 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 1 -- 172.21.15.52:0/2140241699 wait complete. 2024-09-19T09:27:53.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.701+0000 7f1e03a8a740 20 client.17799 trim_cache size 0 max 16384 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 Processor -- start 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 -- start start 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1b2360 con 0x56168c09dd40 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1afc30 con 0x56168c092b60 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1ada80 con 0x56168c093480 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46870/0 (socket says 172.21.15.52:46870) 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.719+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/555990107 learned_addr learned my addr 172.21.15.52:0/555990107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:53.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/555990107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 msgr2=0x56168c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/555990107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 msgr2=0x56168c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c0b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/555990107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168c0932b0 con 0x56168c09dd40 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c010 tx=0x7f1df0005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2964bd4283f86a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1de0ff9640 1 -- 172.21.15.52:0/555990107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0011440 con 0x56168c09dd40 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1de0ff9640 1 -- 172.21.15.52:0/555990107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0004510 con 0x56168c09dd40 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.720+0000 7f1de0ff9640 1 -- 172.21.15.52:0/555990107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df000e960 con 0x56168c09dd40 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- 172.21.15.52:0/555990107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 msgr2=0x56168c0945b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c010 tx=0x7f1df0005b10 comp rx=0 tx=0).stop 2024-09-19T09:27:53.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- 172.21.15.52:0/555990107 shutdown_connections 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0945b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c093480 0x56168c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/555990107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c092b60 0x56168c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- 172.21.15.52:0/555990107 >> 172.21.15.52:0/555990107 conn(0x56168c08f0f0 msgr2=0x56168c09cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- 172.21.15.52:0/555990107 shutdown_connections 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- 172.21.15.52:0/555990107 wait complete. 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- start start 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 Processor -- start 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c092b60 0x56168c0a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c0a2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1ae0f0 con 0x56168c09dd40 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1af560 con 0x56168c093480 2024-09-19T09:27:53.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.721+0000 7f1e03a8a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc1ae7c0 con 0x56168c092b60 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1e03a8a740 10 client.0 _ll_register_callbacks cb 0x7f1df000bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46874/0 (socket says 172.21.15.52:46874) 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/3061829264 learned_addr learned my addr 172.21.15.52:0/3061829264 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c092b60 0x56168c0a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c0a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/3061829264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c092b60 msgr2=0x56168c0a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c092b60 0x56168c0a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 msgr2=0x56168c0a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c0a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 -- 172.21.15.52:0/3061829264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168c1173c0 con 0x56168c09dd40 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1dfa7fc640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1df0011c90 tx=0x7f1df0023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73166914bc41dd5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1ddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:53.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df003e030 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df0004510 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1df000e930 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1df0011440 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1e03a8a740 10 client.17805 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.722+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56168c118630 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df0004510 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1df0005140 con 0x56168c09dd40 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 10 client.17805 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 10 client.17805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 20 client.17805 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c118cf0 0x56168c11b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 4 client.17805 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:27:53.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56168bfffd00 con 0x56168c118cf0 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.723+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c118cf0 0x56168c11b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.724+0000 7f1dfaffd640 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c118cf0 0x56168c11b0e0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=205c0af2f435e616 server_cookie=fc11626a4266c6fb in_seq=0 out_seq=0 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.724+0000 7f1ddeff5640 10 client.17805 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.724+0000 7f1ddeff5640 1 -- 172.21.15.52:0/3061829264 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56168bfffd00 con 0x56168c118cf0 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.724+0000 7f1ddeff5640 10 client.17805 handle_command_reply: tid=0 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.724+0000 7f1e03a8a740 1 client.17805 shutdown 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 msgr2=0x56168c0a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f1df0011c90 tx=0x7f1df0023040 comp rx=0 tx=0).stop 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 shutdown_connections 2024-09-19T09:27:53.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56168c118cf0 0x56168c11b0e0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56168c09dd40 0x56168c0a2640 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56168c093480 0x56168c0a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 --2- 172.21.15.52:0/3061829264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56168c092b60 0x56168c0a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1ddeff5640 0 client.17805 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 >> 172.21.15.52:0/3061829264 conn(0x56168c08f0f0 msgr2=0x56168c08da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 shutdown_connections 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 1 -- 172.21.15.52:0/3061829264 wait complete. 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e03a8a740 20 client.17805 trim_cache size 0 max 16384 2024-09-19T09:27:53.737 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:53.738 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:27:53.738 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "9f18fa2c-5d31-4679-ac15-9bb69992975c", 2024-09-19T09:27:53.738 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:27:53.738 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:53.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 msgr2=0x7f1de40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 0x7f1de40a5700 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1df40a4960 tx=0x7f1df4086b60 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 msgr2=0x7f1dfc19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f1df400cad0 tx=0x7f1df400cf90 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 shutdown_connections 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1dfc10e470 0x7f1dfc19ef40 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1de40a3240 0x7f1de40a5700 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1dfc074f50 0x7f1dfc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 --2- 172.21.15.52:0/3188089181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1dfc0745a0 0x7f1dfc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.725+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 >> 172.21.15.52:0/3188089181 conn(0x7f1dfc0fd8d0 msgr2=0x7f1dfc0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.726+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 shutdown_connections 2024-09-19T09:27:53.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:53.726+0000 7f1e016b1640 1 -- 172.21.15.52:0/3188089181 wait complete. 2024-09-19T09:27:54.491 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:27:54.754 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:27:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1600773914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8102d50 msgr2=0x7f43f81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1600773914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8102d50 0x7f43f81031d0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009900 tx=0x7f43ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1600773914 shutdown_connections 2024-09-19T09:27:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1600773914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8103710 0x7f43f8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1600773914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8102d50 0x7f43f81031d0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1600773914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8101b60 0x7f43f8101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1600773914 >> 172.21.15.52:0/1600773914 conn(0x7f43f80fd2e0 msgr2=0x7f43f80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1600773914 shutdown_connections 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.997+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1600773914 wait complete. 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 Processor -- start 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 -- start start 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8101b60 0x7f43f8199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8102d50 0x7f43f819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810d830 con 0x7f43f8103710 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810d6b0 con 0x7f43f8101b60 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fe5a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810d9b0 con 0x7f43f8102d50 2024-09-19T09:27:55.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fcb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fcb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46888/0 (socket says 172.21.15.52:46888) 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43fcb43640 1 -- 172.21.15.52:0/1059399190 learned_addr learned my addr 172.21.15.52:0/1059399190 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.998+0000 7f43f77fe640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8102d50 0x7f43f819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 -- 172.21.15.52:0/1059399190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8102d50 msgr2=0x7f43f819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8102d50 0x7f43f819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 -- 172.21.15.52:0/1059399190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8101b60 msgr2=0x7f43f8199f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8101b60 0x7f43f8199f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 -- 172.21.15.52:0/1059399190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f81a1b70 con 0x7f43f8103710 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fcb43640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f43f000eaa0 tx=0x7f43f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43f57fa640 1 -- 172.21.15.52:0/1059399190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f000cdb0 con 0x7f43f8103710 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f81a1e60 con 0x7f43f8103710 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43f57fa640 1 -- 172.21.15.52:0/1059399190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43f0005020 con 0x7f43f8103710 2024-09-19T09:27:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43f57fa640 1 -- 172.21.15.52:0/1059399190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f00116d0 con 0x7f43f8103710 2024-09-19T09:27:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:54.999+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f81a2370 con 0x7f43f8103710 2024-09-19T09:27:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.002+0000 7f440141e740 1 Processor -- start 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.002+0000 7f43f57fa640 1 -- 172.21.15.52:0/1059399190 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f43f00054d0 con 0x7f43f8103710 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.002+0000 7f440141e740 1 -- start start 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad959da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad95eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad8bd2f0 con 0x55b8ad95f370 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad865270 con 0x55b8ad95a2e0 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f440141e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad8b92b0 con 0x55b8ad9599a0 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46890/0 (socket says 172.21.15.52:46890) 2024-09-19T09:27:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 -- 172.21.15.52:0/3738898656 learned_addr learned my addr 172.21.15.52:0/3738898656 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad959da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f7fff640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad95eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 -- 172.21.15.52:0/3738898656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 msgr2=0x55b8ad959da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad959da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 -- 172.21.15.52:0/3738898656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 msgr2=0x55b8ad95eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad95eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 -- 172.21.15.52:0/3738898656 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ad864340 con 0x55b8ad95f370 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f7fff640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad95eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f57fa640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 0x7f43e00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f77fe640 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0057c0 tx=0x7f43ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784378554a164cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f7fff640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 0x7f43e00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.003+0000 7f43f57fa640 1 -- 172.21.15.52:0/1059399190 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f43f00cfc60 con 0x7f43f8103710 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f43de7fc640 1 -- 172.21.15.52:0/3738898656 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec035040 con 0x55b8ad95f370 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f43de7fc640 1 -- 172.21.15.52:0/3738898656 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec032b90 con 0x55b8ad95f370 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f43de7fc640 1 -- 172.21.15.52:0/3738898656 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec03d6e0 con 0x55b8ad95f370 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 -- 172.21.15.52:0/3738898656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 msgr2=0x55b8ad961830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f43f7fff640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 0x7f43e00a57b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b8ad95ad10 tx=0x7f43e8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0057c0 tx=0x7f43ec000bc0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 -- 172.21.15.52:0/3738898656 shutdown_connections 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad961830 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad95eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 --2- 172.21.15.52:0/3738898656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad959da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 -- 172.21.15.52:0/3738898656 >> 172.21.15.52:0/3738898656 conn(0x55b8ad955010 msgr2=0x55b8ad955410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 -- 172.21.15.52:0/3738898656 shutdown_connections 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.004+0000 7f440141e740 1 -- 172.21.15.52:0/3738898656 wait complete. 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 -- start start 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 Processor -- start 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad95a2e0 0x55b8ad9641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad96b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad9622e0 con 0x55b8ad9599a0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad846290 con 0x55b8ad95f370 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad962460 con 0x55b8ad95a2e0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f440141e740 10 client.0 _ll_register_callbacks cb 0x55b8ad877140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46902/0 (socket says 172.21.15.52:46902) 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.005+0000 7f43f7fff640 1 -- 172.21.15.52:0/713435845 learned_addr learned my addr 172.21.15.52:0/713435845 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f77fe640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad95a2e0 0x55b8ad9641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43fcb43640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad96b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 -- 172.21.15.52:0/713435845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad95a2e0 msgr2=0x55b8ad9641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad95a2e0 0x55b8ad9641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 -- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 msgr2=0x55b8ad96b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad96b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 -- 172.21.15.52:0/713435845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ad5d0210 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43f7fff640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f43e800f9d0 tx=0x7f43e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e511ba1049622c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8020070 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f43e800ecc0 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec032b90 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43e802b050 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f440141e740 10 client.17817 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.006+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8ad69c620 con 0x55b8ad9599a0 2024-09-19T09:27:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec032b90 con 0x55b8ad9599a0 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f43e801b3b0 con 0x55b8ad9599a0 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 10 client.17817 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 10 client.17817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 20 client.17817 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad96f910 0x55b8ad971d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 4 client.17817 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8ad8caa20 con 0x55b8ad96f910 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.007+0000 7f43f77fe640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad96f910 0x55b8ad971d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f43d77fe640 10 client.17817 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f43f77fe640 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad96f910 0x55b8ad971d90 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d34fb024dfd8ce server_cookie=f5666ffb5aeddf0e in_seq=0 out_seq=0 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f43d77fe640 1 -- 172.21.15.52:0/713435845 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8ad8caa20 con 0x55b8ad96f910 2024-09-19T09:27:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f43d77fe640 10 client.17817 handle_command_reply: tid=0 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 client.17817 shutdown 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 msgr2=0x55b8ad963cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f43e800f9d0 tx=0x7f43e80046c0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 shutdown_connections 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad96f910 0x55b8ad971d90 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad96b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad95a2e0 0x55b8ad9641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 --2- 172.21.15.52:0/713435845 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad9599a0 0x55b8ad963cb0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.008+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 >> 172.21.15.52:0/713435845 conn(0x55b8ad955010 msgr2=0x55b8ad956820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.009+0000 7f43d77fe640 0 client.17817 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.009+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 shutdown_connections 2024-09-19T09:27:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.009+0000 7f440141e740 1 -- 172.21.15.52:0/713435845 wait complete. 2024-09-19T09:27:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.009+0000 7f440141e740 20 client.17817 trim_cache size 0 max 16384 2024-09-19T09:27:55.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 Processor -- start 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 -- start start 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad964170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad9553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81add20 con 0x55b8ad95a2e0 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81ab5f0 con 0x55b8ad95f370 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f440141e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81a9440 con 0x55b8ad9599a0 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f43f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46910/0 (socket says 172.21.15.52:46910) 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.023+0000 7f43f77fe640 1 -- 172.21.15.52:0/4000886560 learned_addr learned my addr 172.21.15.52:0/4000886560 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43fcb43640 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad9553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f7fff640 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad964170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 -- 172.21.15.52:0/4000886560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 msgr2=0x55b8ad964170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad964170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 -- 172.21.15.52:0/4000886560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 msgr2=0x55b8ad9553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad9553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 -- 172.21.15.52:0/4000886560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ad954e30 con 0x55b8ad95a2e0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43f77fe640 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f43ec031440 tx=0x7f43ec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d532c3431a9b258b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43ddffb640 1 -- 172.21.15.52:0/4000886560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec035040 con 0x55b8ad95a2e0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43ddffb640 1 -- 172.21.15.52:0/4000886560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec004490 con 0x55b8ad95a2e0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.024+0000 7f43ddffb640 1 -- 172.21.15.52:0/4000886560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec032310 con 0x55b8ad95a2e0 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- 172.21.15.52:0/4000886560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 msgr2=0x55b8ad96b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f43ec031440 tx=0x7f43ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- 172.21.15.52:0/4000886560 shutdown_connections 2024-09-19T09:27:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95f370 0x55b8ad9553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95a2e0 0x55b8ad96b1c0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 --2- 172.21.15.52:0/4000886560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad964170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- 172.21.15.52:0/4000886560 >> 172.21.15.52:0/4000886560 conn(0x55b8ad955010 msgr2=0x55b8ad963a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- 172.21.15.52:0/4000886560 shutdown_connections 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- 172.21.15.52:0/4000886560 wait complete. 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 -- start start 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.025+0000 7f440141e740 1 Processor -- start 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad967f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad968470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81a9ab0 con 0x55b8ad95f370 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81aaf20 con 0x55b8ad95a2e0 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43f81aa180 con 0x55b8ad9599a0 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 10 client.0 _ll_register_callbacks cb 0x7f43e8013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46926/0 (socket says 172.21.15.52:46926) 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 -- 172.21.15.52:0/4177587739 learned_addr learned my addr 172.21.15.52:0/4177587739 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43f7fff640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad967f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 -- 172.21.15.52:0/4177587739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 msgr2=0x55b8ad967f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad967f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 -- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 msgr2=0x55b8ad968470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad968470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 -- 172.21.15.52:0/4177587739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ad9d8ba0 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43f7fff640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad967f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43fcb43640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f43f0098660 tx=0x7f43f009ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2b6d00a9561652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f00b5060 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f43f00a0170 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.026+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ec004490 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43f001f040 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 10 client.17823 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8ad9d9df0 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ec004490 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f43f000f040 con 0x55b8ad95f370 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 10 client.17823 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 10 client.17823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 20 client.17823 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad9da7a0 0x55b8ad9dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 4 client.17823 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:27:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8ad8c4d70 con 0x55b8ad9da7a0 2024-09-19T09:27:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.027+0000 7f43f7fff640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad9da7a0 0x55b8ad9dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.028+0000 7f43d77fe640 10 client.17823 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.028+0000 7f43f7fff640 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad9da7a0 0x55b8ad9dcbc0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1358527bc9bf6cf server_cookie=13994b0d1bb8f6d in_seq=0 out_seq=0 2024-09-19T09:27:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.040+0000 7f43d77fe640 1 -- 172.21.15.52:0/4177587739 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8ad8c4d70 con 0x55b8ad9da7a0 2024-09-19T09:27:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.040+0000 7f43d77fe640 10 client.17823 handle_command_reply: tid=0 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.040+0000 7f440141e740 1 client.17823 shutdown 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 msgr2=0x55b8ad9d8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f43f0098660 tx=0x7f43f009ca40 comp rx=0 tx=0).stop 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 shutdown_connections 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8ad9da7a0 0x55b8ad9dcbc0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8ad95f370 0x55b8ad9d8660 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f43d77fe640 0 client.17823 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8ad95a2e0 0x55b8ad968470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 --2- 172.21.15.52:0/4177587739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8ad9599a0 0x55b8ad967f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 >> 172.21.15.52:0/4177587739 conn(0x55b8ad955010 msgr2=0x55b8ad9539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 shutdown_connections 2024-09-19T09:27:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 1 -- 172.21.15.52:0/4177587739 wait complete. 2024-09-19T09:27:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f440141e740 20 client.17823 trim_cache size 0 max 16384 2024-09-19T09:27:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:27:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:27:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:27:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 msgr2=0x7f43e00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 0x7f43e00a57b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x55b8ad95ad10 tx=0x7f43e8005d50 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 msgr2=0x7f43f81a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.041+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f43f000eaa0 tx=0x7f43f000ef60 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 shutdown_connections 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8103710 0x7f43f81a1500 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f43e00a32f0 0x7f43e00a57b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43f8102d50 0x7f43f819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 --2- 172.21.15.52:0/1059399190 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43f8101b60 0x7f43f8199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 >> 172.21.15.52:0/1059399190 conn(0x7f43f80fd2e0 msgr2=0x7f43f8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 shutdown_connections 2024-09-19T09:27:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:27:55.042+0000 7f43fe5a6640 1 -- 172.21.15.52:0/1059399190 wait complete. 2024-09-19T09:27:55.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:55 smithi052 ceph-mon[30947]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:55.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:55 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:27:55.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:55 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:55 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:27:55.132 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:55 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 -- 172.21.15.52:0/57075684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01008c0 msgr2=0x7f69c0100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 --2- 172.21.15.52:0/57075684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01008c0 0x7f69c0100ca0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009900 tx=0x7f69bc02a410 comp rx=0 tx=0).stop 2024-09-19T09:27:55.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 -- 172.21.15.52:0/57075684 shutdown_connections 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 --2- 172.21.15.52:0/57075684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c0105ec0 0x7f69c0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 --2- 172.21.15.52:0/57075684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c01011e0 0x7f69c0105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 --2- 172.21.15.52:0/57075684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01008c0 0x7f69c0100ca0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 -- 172.21.15.52:0/57075684 >> 172.21.15.52:0/57075684 conn(0x7f69c00fc7d0 msgr2=0x7f69c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 -- 172.21.15.52:0/57075684 shutdown_connections 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.214+0000 7f69c8164640 1 -- 172.21.15.52:0/57075684 wait complete. 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 Processor -- start 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 -- start start 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c01008c0 0x7f69c019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c0105ec0 0x7f69c01a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0118690 con 0x7f69c01011e0 2024-09-19T09:27:55.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0118510 con 0x7f69c0105ec0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c8164640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c0118810 con 0x7f69c01008c0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46942/0 (socket says 172.21.15.52:46942) 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.215+0000 7f69c56ff640 1 -- 172.21.15.52:0/3909054378 learned_addr learned my addr 172.21.15.52:0/3909054378 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c5f00640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c01008c0 0x7f69c019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c6701640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c0105ec0 0x7f69c01a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 -- 172.21.15.52:0/3909054378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c01008c0 msgr2=0x7f69c019ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c01008c0 0x7f69c019ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 -- 172.21.15.52:0/3909054378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c0105ec0 msgr2=0x7f69c01a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c0105ec0 0x7f69c01a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 -- 172.21.15.52:0/3909054378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c01a3bc0 con 0x7f69c01011e0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c56ff640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b4a0 tx=0x7f69b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69b6ffd640 1 -- 172.21.15.52:0/3909054378 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0014070 con 0x7f69c01011e0 2024-09-19T09:27:55.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c01a3eb0 con 0x7f69c01011e0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69b6ffd640 1 -- 172.21.15.52:0/3909054378 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b0010af0 con 0x7f69c01011e0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69b6ffd640 1 -- 172.21.15.52:0/3909054378 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0017d10 con 0x7f69c01011e0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.216+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c01ab740 con 0x7f69c01011e0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.218+0000 7f69b6ffd640 1 -- 172.21.15.52:0/3909054378 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f69b0017070 con 0x7f69c01011e0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 Processor -- start 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 -- start start 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fe5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba4ff0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cba4f4b2e0 con 0x55cba4ff0680 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cba4ef2ce0 con 0x55cba4fe54a0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69ca53d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cba4f472a0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69b6ffd640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 0x7f69ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.219+0000 7f69c6701640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 0x7f69ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46944/0 (socket says 172.21.15.52:46944) 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 -- 172.21.15.52:0/409902038 learned_addr learned my addr 172.21.15.52:0/409902038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69b6ffd640 1 -- 172.21.15.52:0/3909054378 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69b00ced60 con 0x7f69c01011e0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c6701640 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fe5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c5f00640 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba4ff0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 -- 172.21.15.52:0/409902038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 msgr2=0x55cba4ff0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba4ff0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 -- 172.21.15.52:0/409902038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 msgr2=0x55cba4fe5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fe5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 -- 172.21.15.52:0/409902038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba4ed7440 con 0x55cba4ff0680 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c6701640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 0x7f69ac0a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69b8012720 tx=0x7f69b8007970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69c56ff640 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b470 tx=0x7f69b006a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4b99101d307e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69abfff640 1 -- 172.21.15.52:0/409902038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b001e070 con 0x55cba4ff0680 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69abfff640 1 -- 172.21.15.52:0/409902038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b009ba00 con 0x55cba4ff0680 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.220+0000 7f69abfff640 1 -- 172.21.15.52:0/409902038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b00a3f70 con 0x55cba4ff0680 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- 172.21.15.52:0/409902038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 msgr2=0x55cba4ff2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b470 tx=0x7f69b006a040 comp rx=0 tx=0).stop 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- 172.21.15.52:0/409902038 shutdown_connections 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba4ff2a70 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba4ff0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 --2- 172.21.15.52:0/409902038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fe5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- 172.21.15.52:0/409902038 >> 172.21.15.52:0/409902038 conn(0x55cba4fe1a30 msgr2=0x55cba4fe1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- 172.21.15.52:0/409902038 shutdown_connections 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- 172.21.15.52:0/409902038 wait complete. 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.221+0000 7f69ca53d740 1 -- start start 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 Processor -- start 2024-09-19T09:27:55.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fefeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba4fed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cba4ff3250 con 0x55cba4fe5dc0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cba4f06050 con 0x55cba4fe54a0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cba4ff33d0 con 0x55cba4ff0680 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69ca53d740 10 client.0 _ll_register_callbacks cb 0x55cba4f46160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46960/0 (socket says 172.21.15.52:46960) 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 -- 172.21.15.52:0/337822631 learned_addr learned my addr 172.21.15.52:0/337822631 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c5f00640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fefeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c6701640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba4fed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 -- 172.21.15.52:0/337822631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 msgr2=0x55cba4fed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba4fed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 -- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 msgr2=0x55cba4fefeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fefeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c56ff640 1 -- 172.21.15.52:0/337822631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba4cbc3c0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.222+0000 7f69c6701640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba4fed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69c56ff640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f69b00cc830 tx=0x7f69b00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8dd3a1fe4c68fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b001e030 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69b0010ca0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b009ba00 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f69b00a3f70 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 10 client.17835 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cba4ffeb00 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b009ba00 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f69b00a3ae0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 10 client.17835 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:55.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 10 client.17835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 20 client.17835 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba4fffe50 0x55cba5002240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 4 client.17835 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.223+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cba4f58850 con 0x55cba4fffe50 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.224+0000 7f69c5f00640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba4fffe50 0x55cba5002240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.224+0000 7f69c5f00640 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba4fffe50 0x55cba5002240 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=605beeea65d678b9 server_cookie=6529e784af9769d0 in_seq=0 out_seq=0 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.224+0000 7f69a97fa640 10 client.17835 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69a97fa640 1 -- 172.21.15.52:0/337822631 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cba4f58850 con 0x55cba4fffe50 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69a97fa640 10 client.17835 handle_command_reply: tid=0 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 client.17835 shutdown 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 msgr2=0x55cba4fed160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f69b00cc830 tx=0x7f69b00047d0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 shutdown_connections 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba4fffe50 0x55cba5002240 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba4fed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba4fed160 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69a97fa640 0 client.17835 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 --2- 172.21.15.52:0/337822631 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4fefeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 >> 172.21.15.52:0/337822631 conn(0x55cba4fe1a30 msgr2=0x55cba4fe7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 shutdown_connections 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 1 -- 172.21.15.52:0/337822631 wait complete. 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.225+0000 7f69ca53d740 20 client.17835 trim_cache size 0 max 16384 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 Processor -- start 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 -- start start 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4feba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba5005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.242+0000 7f69ca53d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b6630 con 0x55cba4ff0680 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69ca53d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b3f00 con 0x55cba4fe54a0 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69ca53d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b1d50 con 0x55cba4fe5dc0 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46976/0 (socket says 172.21.15.52:46976) 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 -- 172.21.15.52:0/3071584907 learned_addr learned my addr 172.21.15.52:0/3071584907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c56ff640 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba5005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c5f00640 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4feba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 -- 172.21.15.52:0/3071584907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 msgr2=0x55cba5005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba5005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 -- 172.21.15.52:0/3071584907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 msgr2=0x55cba4feba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4feba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 -- 172.21.15.52:0/3071584907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cba4fe1860 con 0x55cba4ff0680 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69c6701640 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f69b8010a40 tx=0x7f69b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4927d96689c59cc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69ab7fe640 1 -- 172.21.15.52:0/3071584907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8024070 con 0x55cba4ff0680 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69ab7fe640 1 -- 172.21.15.52:0/3071584907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b800eb40 con 0x55cba4ff0680 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.243+0000 7f69ab7fe640 1 -- 172.21.15.52:0/3071584907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b80206a0 con 0x55cba4ff0680 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- 172.21.15.52:0/3071584907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 msgr2=0x55cba50057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f69b8010a40 tx=0x7f69b8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- 172.21.15.52:0/3071584907 shutdown_connections 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4ff0680 0x55cba50057a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4fe5dc0 0x55cba5005260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 --2- 172.21.15.52:0/3071584907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba4feba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- 172.21.15.52:0/3071584907 >> 172.21.15.52:0/3071584907 conn(0x55cba4fe1a30 msgr2=0x55cba4fe0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- 172.21.15.52:0/3071584907 shutdown_connections 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- 172.21.15.52:0/3071584907 wait complete. 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 -- start start 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.244+0000 7f69ca53d740 1 Processor -- start 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba5005830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba50030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b23c0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b3830 con 0x55cba4fe54a0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c01b2a90 con 0x55cba4ff0680 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 10 client.0 _ll_register_callbacks cb 0x7f69b009f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46984/0 (socket says 172.21.15.52:46984) 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 -- 172.21.15.52:0/4228516290 learned_addr learned my addr 172.21.15.52:0/4228516290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c6701640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba50030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c5f00640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba5005830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 -- 172.21.15.52:0/4228516290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 msgr2=0x55cba50030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba50030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 -- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 msgr2=0x55cba5005830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba5005830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 -- 172.21.15.52:0/4228516290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cba5003730 con 0x55cba4fe5dc0 2024-09-19T09:27:55.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69c56ff640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f69b000be60 tx=0x7f69b00c93c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13da2d9fe26a6644 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b001e070 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69b00a3ae0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.245+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b800eb40 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f69b00b4120 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 10 client.17841 fetch_fsmap learned FSMap version 24 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cba506a610 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b800eb40 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f69b00c8ff0 con 0x55cba4fe5dc0 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 10 client.17841 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 20 client.17841 populate_metadata read hostname 'smithi052' 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba506ab10 0x55cba506cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:27:55.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 4 client.17841 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cba4f52d60 con 0x55cba506ab10 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.246+0000 7f69c5f00640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba506ab10 0x55cba506cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69c5f00640 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba506ab10 0x55cba506cf30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765325354014e395 server_cookie=16058d98b5109178 in_seq=0 out_seq=0 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69a97fa640 10 client.17841 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69a97fa640 1 -- 172.21.15.52:0/4228516290 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cba4f52d60 con 0x55cba506ab10 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69a97fa640 10 client.17841 handle_command_reply: tid=0 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 client.17841 shutdown 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 msgr2=0x55cba5002b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f69b000be60 tx=0x7f69b00c93c0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 shutdown_connections 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cba506ab10 0x55cba506cf30 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cba4ff0680 0x55cba50030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cba4fe5dc0 0x55cba5002b80 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 --2- 172.21.15.52:0/4228516290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cba4fe54a0 0x55cba5005830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 >> 172.21.15.52:0/4228516290 conn(0x55cba4fe1a30 msgr2=0x55cba4feca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.247+0000 7f69a97fa640 0 client.17841 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 shutdown_connections 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69ca53d740 1 -- 172.21.15.52:0/4228516290 wait complete. 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69ca53d740 20 client.17841 trim_cache size 0 max 16384 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:27:55.266 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: "9f18fa2c-5d31-4679-ac15-9bb69992975c": { 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "9f18fa2c-5d31-4679-ac15-9bb69992975c", 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:27:55.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 msgr2=0x7f69ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 0x7f69ac0a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69b8012720 tx=0x7f69b8007970 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 msgr2=0x7f69c019f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f69b000b4a0 tx=0x7f69b000b960 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 shutdown_connections 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c0105ec0 0x7f69c01a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c01011e0 0x7f69c019f120 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69ac0a3240 0x7f69ac0a5700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 --2- 172.21.15.52:0/3909054378 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c01008c0 0x7f69c019ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 >> 172.21.15.52:0/3909054378 conn(0x7f69c00fc7d0 msgr2=0x7f69c010f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.248+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 shutdown_connections 2024-09-19T09:27:55.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:27:55.249+0000 7f69c8164640 1 -- 172.21.15.52:0/3909054378 wait complete. 2024-09-19T09:27:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:55 smithi169 ceph-mon[35454]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:55 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:27:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:55 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:55 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:27:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:55 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:55 smithi086 ceph-mon[34813]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:27:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:55 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:27:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:55 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:55 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:27:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:55 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:27:55.948 INFO:tasks.cephfs.filesystem:scrub status for tag:9f18fa2c-5d31-4679-ac15-9bb69992975c - {'path': '/', 'tag': '9f18fa2c-5d31-4679-ac15-9bb69992975c', 'options': 'recursive,force'} 2024-09-19T09:27:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:57 smithi052 ceph-mon[30947]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:57 smithi169 ceph-mon[35454]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:57 smithi086 ceph-mon[34813]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:59 smithi052 ceph-mon[30947]: pgmap v534: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:27:59 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:27:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:59 smithi169 ceph-mon[35454]: pgmap v534: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:27:59 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:27:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:59 smithi086 ceph-mon[34813]: pgmap v534: 97 pgs: 97 active+clean; 3.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:27:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:27:59 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:28:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:01 smithi052 ceph-mon[30947]: pgmap v535: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:28:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:01 smithi169 ceph-mon[35454]: pgmap v535: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:28:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:01 smithi086 ceph-mon[34813]: pgmap v535: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:28:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:03 smithi052 ceph-mon[30947]: pgmap v536: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:03 smithi169 ceph-mon[35454]: pgmap v536: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:03 smithi086 ceph-mon[34813]: pgmap v536: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:05.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:05 smithi052 ceph-mon[30947]: pgmap v537: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:28:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:05 smithi169 ceph-mon[35454]: pgmap v537: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:28:05.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:05 smithi086 ceph-mon[34813]: pgmap v537: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:28:07.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:07 smithi052 ceph-mon[30947]: pgmap v538: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:07 smithi169 ceph-mon[35454]: pgmap v538: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:07 smithi086 ceph-mon[34813]: pgmap v538: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 -- 172.21.15.52:0/42225851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 msgr2=0x7fcadc107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 --2- 172.21.15.52:0/42225851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc107300 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009ca0 tx=0x7fcacc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 -- 172.21.15.52:0/42225851 shutdown_connections 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 --2- 172.21.15.52:0/42225851 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 0x7fcadc109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 --2- 172.21.15.52:0/42225851 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc107300 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 --2- 172.21.15.52:0/42225851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 0x7fcadc1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 -- 172.21.15.52:0/42225851 >> 172.21.15.52:0/42225851 conn(0x7fcadc0fc1e0 msgr2=0x7fcadc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 -- 172.21.15.52:0/42225851 shutdown_connections 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.143+0000 7fcae31c4640 1 -- 172.21.15.52:0/42225851 wait complete. 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 Processor -- start 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 -- start start 2024-09-19T09:28:08.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 0x7fcadc197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 0x7fcadc19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc10d810 con 0x7fcadc104f10 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc10d690 con 0x7fcadc107840 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae31c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc10d990 con 0x7fcadc1025e0 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52006/0 (socket says 172.21.15.52:52006) 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcadbfff640 1 -- 172.21.15.52:0/2038749182 learned_addr learned my addr 172.21.15.52:0/2038749182 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae1761640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 0x7fcadc19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcae0f60640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 0x7fcadc197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.144+0000 7fcadbfff640 1 -- 172.21.15.52:0/2038749182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 msgr2=0x7fcadc197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcadbfff640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 0x7fcadc197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcadbfff640 1 -- 172.21.15.52:0/2038749182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 msgr2=0x7fcadc19f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcadbfff640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 0x7fcadc19f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcadbfff640 1 -- 172.21.15.52:0/2038749182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc19fab0 con 0x7fcadc104f10 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcadbfff640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009430 tx=0x7fcacc02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcad9ffb640 1 -- 172.21.15.52:0/2038749182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc02fe40 con 0x7fcadc104f10 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcad9ffb640 1 -- 172.21.15.52:0/2038749182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcacc030aa0 con 0x7fcadc104f10 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc19fd40 con 0x7fcadc104f10 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcad9ffb640 1 -- 172.21.15.52:0/2038749182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc046ab0 con 0x7fcadc104f10 2024-09-19T09:28:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.145+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc1a0230 con 0x7fcadc104f10 2024-09-19T09:28:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcad9ffb640 1 -- 172.21.15.52:0/2038749182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcacc030c50 con 0x7fcadc104f10 2024-09-19T09:28:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 Processor -- start 2024-09-19T09:28:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 -- start start 2024-09-19T09:28:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c14fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5612c14592f0 con 0x5612c14fb370 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612c1401270 con 0x5612c14f62e0 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae6038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612c14552b0 con 0x5612c14f59a0 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52016/0 (socket says 172.21.15.52:52016) 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcadbfff640 1 -- 172.21.15.52:0/969475558 learned_addr learned my addr 172.21.15.52:0/969475558 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcad9ffb640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 0x7fcac80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae0f60640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c14fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.148+0000 7fcae1761640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae1761640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 0x7fcac80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcad9ffb640 1 -- 172.21.15.52:0/2038749182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcacc0f1040 con 0x7fcadc104f10 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 -- 172.21.15.52:0/969475558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 msgr2=0x5612c14f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 -- 172.21.15.52:0/969475558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 msgr2=0x5612c14fd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 -- 172.21.15.52:0/969475558 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c1400340 con 0x5612c14f62e0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcadbfff640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae0f60640 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c14fada0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cb10 tx=0x7fcac400e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517ba01350a79a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcae1761640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 0x7fcac80a57b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005fd0 tx=0x7fcad4005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcad2ffd640 1 -- 172.21.15.52:0/969475558 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4004020 con 0x5612c14f62e0 2024-09-19T09:28:08.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcad2ffd640 1 -- 172.21.15.52:0/969475558 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40041c0 con 0x5612c14f62e0 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.149+0000 7fcad2ffd640 1 -- 172.21.15.52:0/969475558 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4010720 con 0x5612c14f62e0 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- 172.21.15.52:0/969475558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 msgr2=0x5612c14fada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c14fada0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cb10 tx=0x7fcac400e350 comp rx=0 tx=0).stop 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- 172.21.15.52:0/969475558 shutdown_connections 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c14fada0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 --2- 172.21.15.52:0/969475558 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- 172.21.15.52:0/969475558 >> 172.21.15.52:0/969475558 conn(0x5612c14f1010 msgr2=0x5612c14f1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- 172.21.15.52:0/969475558 shutdown_connections 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- 172.21.15.52:0/969475558 wait complete. 2024-09-19T09:28:08.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 -- start start 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.150+0000 7fcae6038740 1 Processor -- start 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1507100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5612c14fe340 con 0x5612c14f62e0 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5612c13e2290 con 0x5612c14fb370 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5612c14fe4c0 con 0x5612c14f59a0 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae6038740 10 client.0 _ll_register_callbacks cb 0x5612c1413140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52024/0 (socket says 172.21.15.52:52024) 2024-09-19T09:28:08.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 -- 172.21.15.52:0/1240553649 learned_addr learned my addr 172.21.15.52:0/1240553649 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae1761640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1507100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 -- 172.21.15.52:0/1240553649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 msgr2=0x5612c14ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 -- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 msgr2=0x5612c1507100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1507100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcadbfff640 1 -- 172.21.15.52:0/1240553649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c116c210 con 0x5612c14f62e0 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.151+0000 7fcae1761640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1507100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009bf0 tx=0x7fcacc02ffe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2a42f7c47eaf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:08.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0bd3b0 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcacc0b9c50 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac40041c0 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcacc0bcf40 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 10 client.17853 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5612c1238620 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac40041c0 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcacc04e030 con 0x5612c14f62e0 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 10 client.17853 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 20 client.17853 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c150b890 0x5612c150dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 4 client.17853 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.152+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612c1466a20 con 0x5612c150b890 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.153+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c150b890 0x5612c150dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.153+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c150b890 0x5612c150dcf0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de49490a4192f109 server_cookie=5327a35c520eea22 in_seq=0 out_seq=0 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.153+0000 7fcabbfff640 10 client.17853 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcabbfff640 1 -- 172.21.15.52:0/1240553649 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612c1466a20 con 0x5612c150b890 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcabbfff640 10 client.17853 handle_command_reply: tid=0 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 client.17853 shutdown 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 msgr2=0x5612c1500130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009bf0 tx=0x7fcacc02ffe0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 shutdown_connections 2024-09-19T09:28:08.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c150b890 0x5612c150dcf0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1507100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f62e0 0x5612c1500130 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcabbfff640 0 client.17853 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 --2- 172.21.15.52:0/1240553649 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 >> 172.21.15.52:0/1240553649 conn(0x5612c14f1010 msgr2=0x5612c14f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 shutdown_connections 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 1 -- 172.21.15.52:0/1240553649 wait complete. 2024-09-19T09:28:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.154+0000 7fcae6038740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T09:28:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 Processor -- start 2024-09-19T09:28:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 -- start start 2024-09-19T09:28:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c15070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1aba90 con 0x5612c14fb370 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a9360 con 0x5612c14f62e0 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae6038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a71b0 con 0x5612c14f59a0 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae1761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae1761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52026/0 (socket says 172.21.15.52:52026) 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae1761640 1 -- 172.21.15.52:0/2403543651 learned_addr learned my addr 172.21.15.52:0/2403543651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcadbfff640 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c15070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.169+0000 7fcae0f60640 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 -- 172.21.15.52:0/2403543651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 msgr2=0x5612c14f1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 -- 172.21.15.52:0/2403543651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 msgr2=0x5612c15070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c15070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 -- 172.21.15.52:0/2403543651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c14f1ca0 con 0x5612c14fb370 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcae1761640 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcad4011f20 tx=0x7fcad4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1614498fc3824bed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcad27fc640 1 -- 172.21.15.52:0/2403543651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad400fbb0 con 0x5612c14fb370 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcad27fc640 1 -- 172.21.15.52:0/2403543651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad400fd50 con 0x5612c14fb370 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.170+0000 7fcad27fc640 1 -- 172.21.15.52:0/2403543651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4005700 con 0x5612c14fb370 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- 172.21.15.52:0/2403543651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 msgr2=0x5612c14f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcad4011f20 tx=0x7fcad4016000 comp rx=0 tx=0).stop 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- 172.21.15.52:0/2403543651 shutdown_connections 2024-09-19T09:28:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14fb370 0x5612c14f2400 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14f62e0 0x5612c15070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 --2- 172.21.15.52:0/2403543651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f59a0 0x5612c14f1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- 172.21.15.52:0/2403543651 >> 172.21.15.52:0/2403543651 conn(0x5612c14f1010 msgr2=0x5612c14ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- 172.21.15.52:0/2403543651 shutdown_connections 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- 172.21.15.52:0/2403543651 wait complete. 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 -- start start 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 Processor -- start 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.171+0000 7fcae6038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f62e0 0x5612c1504d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1505d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a7820 con 0x5612c14f59a0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a8c90 con 0x5612c14fb370 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc1a7ef0 con 0x5612c14f62e0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 10 client.0 _ll_register_callbacks cb 0x7fcacc0b7fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52042/0 (socket says 172.21.15.52:52042) 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 -- 172.21.15.52:0/1321038804 learned_addr learned my addr 172.21.15.52:0/1321038804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae1761640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1505d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f62e0 0x5612c1504d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 -- 172.21.15.52:0/1321038804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f62e0 msgr2=0x5612c1504d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f62e0 0x5612c1504d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 -- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 msgr2=0x5612c1505d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1505d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 -- 172.21.15.52:0/1321038804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c1506320 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae1761640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1505d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae0f60640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cb10 tx=0x7fcac400c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a813673e838cf06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcabbfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4004370 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcac4005040 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.172+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad400fd50 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcac4035020 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 10 client.17859 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5612c15766c0 con 0x5612c14f59a0 2024-09-19T09:28:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad400fd50 con 0x5612c14f59a0 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcac402e020 con 0x5612c14f59a0 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 10 client.17859 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 10 client.17859 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 20 client.17859 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c1576cf0 0x5612c15790e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 4 client.17859 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612c1460d70 con 0x5612c1576cf0 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.173+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c1576cf0 0x5612c15790e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.174+0000 7fcadbfff640 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c1576cf0 0x5612c15790e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c046a1d1393c0f21 server_cookie=15bf8696cb3c849c in_seq=0 out_seq=0 2024-09-19T09:28:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.174+0000 7fcabbfff640 10 client.17859 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.187+0000 7fcabbfff640 1 -- 172.21.15.52:0/1321038804 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612c1460d70 con 0x5612c1576cf0 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.187+0000 7fcabbfff640 10 client.17859 handle_command_reply: tid=0 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.187+0000 7fcae6038740 1 client.17859 shutdown 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.187+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 msgr2=0x5612c15047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.187+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cb10 tx=0x7fcac400c310 comp rx=0 tx=0).stop 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 shutdown_connections 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5612c1576cf0 0x5612c15790e0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5612c14fb370 0x5612c1505d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcabbfff640 0 client.17859 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5612c14f62e0 0x5612c1504d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.190 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 --2- 172.21.15.52:0/1321038804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5612c14f59a0 0x5612c15047c0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 >> 172.21.15.52:0/1321038804 conn(0x5612c14f1010 msgr2=0x5612c14ef9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 shutdown_connections 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 1 -- 172.21.15.52:0/1321038804 wait complete. 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae6038740 20 client.17859 trim_cache size 0 max 16384 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:28:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:28:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 msgr2=0x7fcac80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 0x7fcac80a57b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcad4005fd0 tx=0x7fcad4005f60 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 msgr2=0x7fcadc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009430 tx=0x7fcacc02f840 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 shutdown_connections 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcadc107840 0x7fcadc19f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcadc104f10 0x7fcadc1983d0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac80a32f0 0x7fcac80a57b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 --2- 172.21.15.52:0/2038749182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcadc1025e0 0x7fcadc197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.188+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 >> 172.21.15.52:0/2038749182 conn(0x7fcadc0fc1e0 msgr2=0x7fcadc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.189+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 shutdown_connections 2024-09-19T09:28:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:08.189+0000 7fcae31c4640 1 -- 172.21.15.52:0/2038749182 wait complete. 2024-09-19T09:28:09.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:09 smithi052 ceph-mon[30947]: pgmap v539: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:09 smithi169 ceph-mon[35454]: pgmap v539: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:09 smithi086 ceph-mon[34813]: pgmap v539: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:28:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:11 smithi052 ceph-mon[30947]: pgmap v540: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:28:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:11 smithi169 ceph-mon[35454]: pgmap v540: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:28:11.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:11 smithi086 ceph-mon[34813]: pgmap v540: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:28:13.206 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:28:13.207 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:28:13.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:28:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:13 smithi052 ceph-mon[30947]: pgmap v541: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:13 smithi169 ceph-mon[35454]: pgmap v541: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:13.480 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:13 smithi086 ceph-mon[34813]: pgmap v541: 97 pgs: 97 active+clean; 3.5 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 -- 172.21.15.52:0/1995935899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c1027a0 msgr2=0x7f633c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 --2- 172.21.15.52:0/1995935899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c1027a0 0x7f633c1067f0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c02a410 comp rx=0 tx=0).stop 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 -- 172.21.15.52:0/1995935899 shutdown_connections 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 --2- 172.21.15.52:0/1995935899 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c106f20 0x7f633c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 --2- 172.21.15.52:0/1995935899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c1027a0 0x7f633c1067f0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 --2- 172.21.15.52:0/1995935899 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 0x7f633c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 -- 172.21.15.52:0/1995935899 >> 172.21.15.52:0/1995935899 conn(0x7f633c0fd8f0 msgr2=0x7f633c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 -- 172.21.15.52:0/1995935899 shutdown_connections 2024-09-19T09:28:13.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.930+0000 7f6343da0640 1 -- 172.21.15.52:0/1995935899 wait complete. 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.931+0000 7f6343da0640 1 Processor -- start 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.931+0000 7f6343da0640 1 -- start start 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 0x7f633c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c1027a0 0x7f633c198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f633c111f80 con 0x7f633c106f20 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f633c111e00 con 0x7f633c101df0 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6343da0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f633c112100 con 0x7f633c1027a0 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52058/0 (socket says 172.21.15.52:52058) 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 -- 172.21.15.52:0/3817608163 learned_addr learned my addr 172.21.15.52:0/3817608163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:13.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634133b640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c1027a0 0x7f633c198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6341b3c640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 0x7f633c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 -- 172.21.15.52:0/3817608163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c1027a0 msgr2=0x7f633c198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c1027a0 0x7f633c198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 -- 172.21.15.52:0/3817608163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 msgr2=0x7f633c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 0x7f633c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 -- 172.21.15.52:0/3817608163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c19d390 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f634233d640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f633400cce0 tx=0x7f633400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.932+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633400f450 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.933+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f633400fad0 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.933+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c19d680 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.933+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334018c10 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.933+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c1a4f60 con 0x7f633c106f20 2024-09-19T09:28:13.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.934+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c1021d0 con 0x7f633c106f20 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.935+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f633400f5f0 con 0x7f633c106f20 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.936+0000 7f6332ffd640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 0x7f63280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.936+0000 7f6341b3c640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 0x7f63280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.936+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f63340cff40 con 0x7f633c106f20 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.937+0000 7f6341b3c640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 0x7f63280a5780 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6338009bd0 tx=0x7f6338005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:13.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:13.939+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6334014030 con 0x7f633c106f20 2024-09-19T09:28:14.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.154+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f633c199740 con 0x7f633c106f20 2024-09-19T09:28:14.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.155+0000 7f6332ffd640 1 -- 172.21.15.52:0/3817608163 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f633c199740 con 0x7f633c106f20 2024-09-19T09:28:14.157 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:28:14.158 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:28:14.158 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:28:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 msgr2=0x7f63280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:14.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 0x7f63280a5780 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6338009bd0 tx=0x7f6338005f90 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 msgr2=0x7f633c19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f633400cce0 tx=0x7f633400a620 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 shutdown_connections 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f633c106f20 0x7f633c19ccb0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f63280a32c0 0x7f63280a5780 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f633c1027a0 0x7f633c198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 --2- 172.21.15.52:0/3817608163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f633c101df0 0x7f633c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.157+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 >> 172.21.15.52:0/3817608163 conn(0x7f633c0fd8f0 msgr2=0x7f633c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.158+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 shutdown_connections 2024-09-19T09:28:14.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:14.158+0000 7f6343da0640 1 -- 172.21.15.52:0/3817608163 wait complete. 2024-09-19T09:28:14.932 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:28:14.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:28:15.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:15 smithi052 ceph-mon[30947]: pgmap v542: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:28:15.160 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:15 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3817608163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:15.200 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:15 smithi169 ceph-mon[35454]: pgmap v542: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:28:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:15 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3817608163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:15 smithi086 ceph-mon[34813]: pgmap v542: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:28:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:15 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3817608163' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.657+0000 7f06d3ec2640 1 -- 172.21.15.52:0/580353475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc106f10 msgr2=0x7f06cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.657+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/580353475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc106f10 0x7f06cc10ea90 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ca0 tx=0x7f06c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 -- 172.21.15.52:0/580353475 shutdown_connections 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/580353475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc106f10 0x7f06cc10ea90 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/580353475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc102790 0x7f06cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/580353475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 0x7f06cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 -- 172.21.15.52:0/580353475 >> 172.21.15.52:0/580353475 conn(0x7f06cc0fd8c0 msgr2=0x7f06cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 -- 172.21.15.52:0/580353475 shutdown_connections 2024-09-19T09:28:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 -- 172.21.15.52:0/580353475 wait complete. 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.658+0000 7f06d3ec2640 1 Processor -- start 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 -- start start 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 0x7f06cc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 0x7f06cc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc111f70 con 0x7f06cc102790 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc111df0 con 0x7f06cc106f10 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d3ec2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1120f0 con 0x7f06cc101de0 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52080/0 (socket says 172.21.15.52:52080) 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 -- 172.21.15.52:0/1473937333 learned_addr learned my addr 172.21.15.52:0/1473937333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 0x7f06cc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d245f640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 0x7f06cc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 -- 172.21.15.52:0/1473937333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 msgr2=0x7f06cc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 0x7f06cc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 -- 172.21.15.52:0/1473937333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 msgr2=0x7f06cc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 0x7f06cc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d145d640 1 -- 172.21.15.52:0/1473937333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc1a68b0 con 0x7f06cc102790 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.659+0000 7f06d245f640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 0x7f06cc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06d145d640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c890 tx=0x7f06bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06c2ffd640 1 -- 172.21.15.52:0/1473937333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc004220 con 0x7f06cc102790 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06c2ffd640 1 -- 172.21.15.52:0/1473937333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06bc0043c0 con 0x7f06cc102790 2024-09-19T09:28:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc1a6ba0 con 0x7f06cc102790 2024-09-19T09:28:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06c2ffd640 1 -- 172.21.15.52:0/1473937333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc0049e0 con 0x7f06cc102790 2024-09-19T09:28:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.660+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc1a70e0 con 0x7f06cc102790 2024-09-19T09:28:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.662+0000 7f06c2ffd640 1 -- 172.21.15.52:0/1473937333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06bc0079b0 con 0x7f06cc102790 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.662+0000 7f06d629b740 1 Processor -- start 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.662+0000 7f06d629b740 1 -- start start 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8ce850 0x5626de8cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 0x5626de8dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5626de833160 con 0x5626de8cf170 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5626de7da720 con 0x5626de8ce850 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d629b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5626de82f120 con 0x5626de8d9a30 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52088/0 (socket says 172.21.15.52:52088) 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 -- 172.21.15.52:0/895490882 learned_addr learned my addr 172.21.15.52:0/895490882 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06c2ffd640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 0x7f06b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d245f640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8ce850 0x5626de8cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d245f640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 0x7f06b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06c2ffd640 1 -- 172.21.15.52:0/1473937333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f06bc0cfa80 con 0x7f06cc102790 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 -- 172.21.15.52:0/895490882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 msgr2=0x5626de8dbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d145d640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 0x5626de8dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 0x5626de8dbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 -- 172.21.15.52:0/895490882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8ce850 msgr2=0x5626de8cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8ce850 0x5626de8cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d1c5e640 1 -- 172.21.15.52:0/895490882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626de5a4ba0 con 0x5626de8cf170 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.663+0000 7f06d145d640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 0x5626de8dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.664+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f06c800cbe0 tx=0x7f06c800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47296fbc4628cfef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.664+0000 7f06b7fff640 1 -- 172.21.15.52:0/895490882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8010630 con 0x5626de8cf170 2024-09-19T09:28:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.664+0000 7f06b7fff640 1 -- 172.21.15.52:0/895490882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c8010cb0 con 0x5626de8cf170 2024-09-19T09:28:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.664+0000 7f06d245f640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 0x7f06b80a5700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009bf0 tx=0x7f06c40095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.664+0000 7f06b7fff640 1 -- 172.21.15.52:0/895490882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c801ac80 con 0x5626de8cf170 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- 172.21.15.52:0/895490882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 msgr2=0x5626de8d94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f06c800cbe0 tx=0x7f06c800e720 comp rx=0 tx=0).stop 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- 172.21.15.52:0/895490882 shutdown_connections 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8d9a30 0x5626de8dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8cf170 0x5626de8d94f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 --2- 172.21.15.52:0/895490882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8ce850 0x5626de8cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- 172.21.15.52:0/895490882 >> 172.21.15.52:0/895490882 conn(0x5626de8cade0 msgr2=0x5626de8cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- 172.21.15.52:0/895490882 shutdown_connections 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- 172.21.15.52:0/895490882 wait complete. 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 -- start start 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.665+0000 7f06d629b740 1 Processor -- start 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8d6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8d7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5626de8dc6a0 con 0x5626de8ce850 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5626de7bb900 con 0x5626de8d9a30 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5626de8dc820 con 0x5626de8cf170 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 10 client.0 _ll_register_callbacks cb 0x5626de7b9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:15.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52102/0 (socket says 172.21.15.52:52102) 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 -- 172.21.15.52:0/4043051461 learned_addr learned my addr 172.21.15.52:0/4043051461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d145d640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8d6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d245f640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8d7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 -- 172.21.15.52:0/4043051461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 msgr2=0x5626de8d6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8d6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 -- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 msgr2=0x5626de8d7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8d7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 -- 172.21.15.52:0/4043051461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626de7fbc50 con 0x5626de8ce850 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d145d640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8d6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d245f640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8d7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005ef0 tx=0x7f06c800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94fb9417cdb706b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8010e60 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f06c801ac10 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.666+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c8010cb0 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06c801ae10 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 10 client.17877 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5626de8e82a0 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c8010cb0 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f06c8003680 con 0x5626de8ce850 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 10 client.17877 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 10 client.17877 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 20 client.17877 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de8e9700 0x5626de8ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 4 client.17877 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626de840890 con 0x5626de8e9700 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.667+0000 7f06d145d640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de8e9700 0x5626de8ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.668+0000 7f06b57fa640 10 client.17877 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.668+0000 7f06d145d640 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de8e9700 0x5626de8ebaf0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b72b33ca0e271a1 server_cookie=b4823a88519b8b4e in_seq=0 out_seq=0 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.668+0000 7f06b57fa640 1 -- 172.21.15.52:0/4043051461 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626de840890 con 0x5626de8e9700 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.668+0000 7f06b57fa640 10 client.17877 handle_command_reply: tid=0 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 client.17877 shutdown 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 msgr2=0x5626de8d68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005ef0 tx=0x7f06c800c920 comp rx=0 tx=0).stop 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 shutdown_connections 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de8e9700 0x5626de8ebaf0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8d7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8d6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 --2- 172.21.15.52:0/4043051461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d68a0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 >> 172.21.15.52:0/4043051461 conn(0x5626de8cade0 msgr2=0x5626de8d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06b57fa640 0 client.17877 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 shutdown_connections 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 1 -- 172.21.15.52:0/4043051461 wait complete. 2024-09-19T09:28:15.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.669+0000 7f06d629b740 20 client.17877 trim_cache size 0 max 16384 2024-09-19T09:28:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 Processor -- start 2024-09-19T09:28:15.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 -- start start 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8f10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1b22e0 con 0x5626de8ce850 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1afbb0 con 0x5626de8d9a30 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d629b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ada00 con 0x5626de8cf170 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52114/0 (socket says 172.21.15.52:52114) 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 -- 172.21.15.52:0/1230913687 learned_addr learned my addr 172.21.15.52:0/1230913687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d245f640 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8f10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 -- 172.21.15.52:0/1230913687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 msgr2=0x5626de8ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 -- 172.21.15.52:0/1230913687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 msgr2=0x5626de8f10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8f10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.686+0000 7f06d1c5e640 1 -- 172.21.15.52:0/1230913687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626de8cac10 con 0x5626de8ce850 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f06c8003a50 tx=0x7f06c800c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be57974257bb9128 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06b77fe640 1 -- 172.21.15.52:0/1230913687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8031020 con 0x5626de8ce850 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06b77fe640 1 -- 172.21.15.52:0/1230913687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c801ac10 con 0x5626de8ce850 2024-09-19T09:28:15.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06b77fe640 1 -- 172.21.15.52:0/1230913687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80040e0 con 0x5626de8ce850 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06d629b740 1 -- 172.21.15.52:0/1230913687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 msgr2=0x5626de8d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06d629b740 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f06c8003a50 tx=0x7f06c800c3b0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.687+0000 7f06d629b740 1 -- 172.21.15.52:0/1230913687 shutdown_connections 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8d9a30 0x5626de8f10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8cf170 0x5626de8ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- 172.21.15.52:0/1230913687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8ce850 0x5626de8d12d0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- 172.21.15.52:0/1230913687 >> 172.21.15.52:0/1230913687 conn(0x5626de8cade0 msgr2=0x5626de8d5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- 172.21.15.52:0/1230913687 shutdown_connections 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- 172.21.15.52:0/1230913687 wait complete. 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- start start 2024-09-19T09:28:15.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 Processor -- start 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8ce850 0x5626de8e2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8cf170 0x5626de8dd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ae070 con 0x5626de8d9a30 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1af4e0 con 0x5626de8cf170 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ae740 con 0x5626de8ce850 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.688+0000 7f06d629b740 10 client.0 _ll_register_callbacks cb 0x7f06c8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52124/0 (socket says 172.21.15.52:52124) 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 -- 172.21.15.52:0/3277659956 learned_addr learned my addr 172.21.15.52:0/3277659956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8ce850 0x5626de8e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d145d640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8cf170 0x5626de8dd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 -- 172.21.15.52:0/3277659956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8ce850 msgr2=0x5626de8e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8ce850 0x5626de8e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 -- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8cf170 msgr2=0x5626de8dd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8cf170 0x5626de8dd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 -- 172.21.15.52:0/3277659956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626de8c63f0 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d245f640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f06c4003fd0 tx=0x7f06c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b1ddf30c013be9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4042040 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f06c4004460 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.689+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c801ac10 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f06c4059020 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 10 client.17883 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5626de953e30 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06c801ac10 con 0x5626de8d9a30 2024-09-19T09:28:15.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f06c4048070 con 0x5626de8d9a30 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 10 client.17883 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 10 client.17883 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 20 client.17883 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de9545d0 0x5626de9569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 4 client.17883 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5626de83abe0 con 0x5626de9545d0 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.690+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de9545d0 0x5626de9569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.691+0000 7f06d1c5e640 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de9545d0 0x5626de9569f0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718183a495cef7b9 server_cookie=148e38f2b84125fb in_seq=0 out_seq=0 2024-09-19T09:28:15.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.691+0000 7f06b57fa640 10 client.17883 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06b57fa640 1 -- 172.21.15.52:0/3277659956 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5626de83abe0 con 0x5626de9545d0 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06b57fa640 10 client.17883 handle_command_reply: tid=0 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 client.17883 shutdown 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 msgr2=0x5626de8dd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f06c4003fd0 tx=0x7f06c402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 shutdown_connections 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626de9545d0 0x5626de9569f0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626de8d9a30 0x5626de8dd9e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626de8cf170 0x5626de8dd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06b57fa640 0 client.17883 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 --2- 172.21.15.52:0/3277659956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626de8ce850 0x5626de8e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 >> 172.21.15.52:0/3277659956 conn(0x5626de8cade0 msgr2=0x5626de8e4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 shutdown_connections 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 1 -- 172.21.15.52:0/3277659956 wait complete. 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.700+0000 7f06d629b740 20 client.17883 trim_cache size 0 max 16384 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:15.703 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 26, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "8a0a447": { 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 26, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 145.8, 2024-09-19T09:28:15.704 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:15.705 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 msgr2=0x7f06b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 0x7f06b80a5700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009bf0 tx=0x7f06c40095c0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 msgr2=0x7f06cc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c890 tx=0x7f06bc00cd50 comp rx=0 tx=0).stop 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 shutdown_connections 2024-09-19T09:28:15.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06cc106f10 0x7f06cc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102790 0x7f06cc074a30 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06b80a3240 0x7f06b80a5700 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 --2- 172.21.15.52:0/1473937333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06cc101de0 0x7f06cc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 >> 172.21.15.52:0/1473937333 conn(0x7f06cc0fd8c0 msgr2=0x7f06cc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 shutdown_connections 2024-09-19T09:28:15.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:15.701+0000 7f06d3ec2640 1 -- 172.21.15.52:0/1473937333 wait complete. 2024-09-19T09:28:16.570 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8a0a447', quiesce took 3.4 seconds. Will release after: 22.35 2024-09-19T09:28:17.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:17 smithi052 ceph-mon[30947]: pgmap v543: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:17.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:17 smithi169 ceph-mon[35454]: pgmap v543: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:17 smithi086 ceph-mon[34813]: pgmap v543: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:19 smithi052 ceph-mon[30947]: pgmap v544: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:19.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:19 smithi169 ceph-mon[35454]: pgmap v544: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:19 smithi086 ceph-mon[34813]: pgmap v544: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:28:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 -- 172.21.15.52:0/2417107549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf01016b0 msgr2=0x7fbdf0101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 --2- 172.21.15.52:0/2417107549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf01016b0 0x7fbdf0101b60 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009ca0 tx=0x7fbde802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 -- 172.21.15.52:0/2417107549 shutdown_connections 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 --2- 172.21.15.52:0/2417107549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf01016b0 0x7fbdf0101b60 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 --2- 172.21.15.52:0/2417107549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf0100d10 0x7fbdf0101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 --2- 172.21.15.52:0/2417107549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01003d0 0x7fbdf01007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 -- 172.21.15.52:0/2417107549 >> 172.21.15.52:0/2417107549 conn(0x7fbdf00fc1e0 msgr2=0x7fbdf00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 -- 172.21.15.52:0/2417107549 shutdown_connections 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.291+0000 7fbdf7674640 1 -- 172.21.15.52:0/2417107549 wait complete. 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 Processor -- start 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 -- start start 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01003d0 0x7fbdf0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01016b0 0x7fbdf01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010f9b0 con 0x7fbdf0100d10 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010f830 con 0x7fbdf01016b0 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf7674640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf010fb30 con 0x7fbdf01003d0 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58652/0 (socket says 172.21.15.52:58652) 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.292+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4187782364 learned_addr learned my addr 172.21.15.52:0/4187782364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01016b0 0x7fbdf01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf5410640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01003d0 0x7fbdf0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4187782364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01003d0 msgr2=0x7fbdf0199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01003d0 0x7fbdf0199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4187782364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01016b0 msgr2=0x7fbdf01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01016b0 0x7fbdf01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4187782364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf01a1b90 con 0x7fbdf0100d10 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fbde000d950 tx=0x7fbde000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbde67fc640 1 -- 172.21.15.52:0/4187782364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0017070 con 0x7fbdf0100d10 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbde67fc640 1 -- 172.21.15.52:0/4187782364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde0009c30 con 0x7fbdf0100d10 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbde67fc640 1 -- 172.21.15.52:0/4187782364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde000f6b0 con 0x7fbdf0100d10 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf01a1e80 con 0x7fbdf0100d10 2024-09-19T09:28:21.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.293+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf01a2390 con 0x7fbdf0100d10 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 Processor -- start 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 -- start start 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbde67fc640 1 -- 172.21.15.52:0/4187782364 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbde00109d0 con 0x7fbdf0100d10 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.299 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566e92232f0 con 0x5566e92bf9a0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566e91cb270 con 0x5566e92c5370 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdfa415740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566e921f2b0 con 0x5566e92c02e0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdf5c11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdf5c11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58656/0 (socket says 172.21.15.52:58656) 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdf5c11640 1 -- 172.21.15.52:0/1153500163 learned_addr learned my addr 172.21.15.52:0/1153500163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdf5410640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.297+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 -- 172.21.15.52:0/1153500163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 msgr2=0x5566e92c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 -- 172.21.15.52:0/1153500163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 msgr2=0x5566e92c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 -- 172.21.15.52:0/1153500163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e91ca340 con 0x5566e92bf9a0 2024-09-19T09:28:21.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbde67fc640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 0x7fbddc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fbde8005e30 tx=0x7fbde8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed5867ccd8c912 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbdf5410640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 0x7fbddc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbddb7fe640 1 -- 172.21.15.52:0/1153500163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8031cb0 con 0x5566e92bf9a0 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbde67fc640 1 -- 172.21.15.52:0/4187782364 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbde00cf480 con 0x7fbdf0100d10 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbddb7fe640 1 -- 172.21.15.52:0/1153500163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde8036040 con 0x5566e92bf9a0 2024-09-19T09:28:21.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.298+0000 7fbddb7fe640 1 -- 172.21.15.52:0/1153500163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8004320 con 0x5566e92bf9a0 2024-09-19T09:28:21.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdf5410640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 0x7fbddc0a5830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x5566e92c0d10 tx=0x7fbdec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- 172.21.15.52:0/1153500163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 msgr2=0x5566e92bfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fbde8005e30 tx=0x7fbde8005ef0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- 172.21.15.52:0/1153500163 shutdown_connections 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 --2- 172.21.15.52:0/1153500163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92bfda0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- 172.21.15.52:0/1153500163 >> 172.21.15.52:0/1153500163 conn(0x5566e92bb010 msgr2=0x5566e92bb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- 172.21.15.52:0/1153500163 shutdown_connections 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- 172.21.15.52:0/1153500163 wait complete. 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.299+0000 7fbdfa415740 1 -- start start 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 Processor -- start 2024-09-19T09:28:21.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5566e92c8100 con 0x5566e92bf9a0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5566e91ac290 con 0x5566e92c5370 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5566e92c8280 con 0x5566e92c02e0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdfa415740 10 client.0 _ll_register_callbacks cb 0x5566e91dd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58660/0 (socket says 172.21.15.52:58660) 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 -- 172.21.15.52:0/3778680294 learned_addr learned my addr 172.21.15.52:0/3778680294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 -- 172.21.15.52:0/3778680294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 msgr2=0x5566e92c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 -- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 msgr2=0x5566e92d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.300+0000 7fbdf5410640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdf5410640 1 -- 172.21.15.52:0/3778680294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e8f36210 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdf5410640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004130 tx=0x7fbdec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1139451b4925d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec02c060 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbdec017030 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbde8036040 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbdec031410 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdfa415740 10 client.17895 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5566e9002620 con 0x5566e92bf9a0 2024-09-19T09:28:21.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.301+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde8036040 con 0x5566e92bf9a0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbdec01c3f0 con 0x5566e92bf9a0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 10 client.17895 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 10 client.17895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 20 client.17895 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e92d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 4 client.17895 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566e9230a20 con 0x5566e92d55c0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e92d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e92d7a50 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5636ff099068f447 server_cookie=d06a8a2ec38564dc in_seq=0 out_seq=0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.302+0000 7fbdd8ff9640 10 client.17895 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/3778680294 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566e9230a20 con 0x5566e92d55c0 2024-09-19T09:28:21.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdd8ff9640 10 client.17895 handle_command_reply: tid=0 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 client.17895 shutdown 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 msgr2=0x5566e92c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004130 tx=0x7fbdec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 shutdown_connections 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e92d7a50 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdd8ff9640 0 client.17895 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c02e0 0x5566e92c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 --2- 172.21.15.52:0/3778680294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92bf9a0 0x5566e92c9960 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 >> 172.21.15.52:0/3778680294 conn(0x5566e92bb010 msgr2=0x5566e92bc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 shutdown_connections 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.303+0000 7fbdfa415740 1 -- 172.21.15.52:0/3778680294 wait complete. 2024-09-19T09:28:21.310 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.304+0000 7fbdfa415740 20 client.17895 trim_cache size 0 max 16384 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.318+0000 7fbdfa415740 1 Processor -- start 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.318+0000 7fbdfa415740 1 -- start start 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 0x5566e92ba0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92bc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01adce0 con 0x5566e92c02e0 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01ab5b0 con 0x5566e92c5370 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdfa415740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01a9400 con 0x5566e92bf9a0 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58676/0 (socket says 172.21.15.52:58676) 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4145089540 learned_addr learned my addr 172.21.15.52:0/4145089540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf5410640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 0x5566e92ba0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4145089540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 msgr2=0x5566e92ba0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 0x5566e92ba0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4145089540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 msgr2=0x5566e92bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/4145089540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566e92c8310 con 0x5566e92c02e0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf5410640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 0x5566e92ba0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbde0097f30 tx=0x7fbde0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4cb1b10b1c033a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbddaffd640 1 -- 172.21.15.52:0/4145089540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0020040 con 0x5566e92c02e0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbddaffd640 1 -- 172.21.15.52:0/4145089540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde009bad0 con 0x5566e92c02e0 2024-09-19T09:28:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.319+0000 7fbddaffd640 1 -- 172.21.15.52:0/4145089540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00a4200 con 0x5566e92c02e0 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- 172.21.15.52:0/4145089540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 msgr2=0x5566e92d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbde0097f30 tx=0x7fbde0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- 172.21.15.52:0/4145089540 shutdown_connections 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92c5370 0x5566e92bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92d0ea0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 --2- 172.21.15.52:0/4145089540 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92bf9a0 0x5566e92ba0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- 172.21.15.52:0/4145089540 >> 172.21.15.52:0/4145089540 conn(0x5566e92bb010 msgr2=0x5566e92b99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- 172.21.15.52:0/4145089540 shutdown_connections 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- 172.21.15.52:0/4145089540 wait complete. 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 -- start start 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.320+0000 7fbdfa415740 1 Processor -- start 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92bf9a0 0x5566e92ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c5370 0x5566e92cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01a9a70 con 0x5566e92c02e0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01aaee0 con 0x5566e92bf9a0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01aa140 con 0x5566e92c5370 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdfa415740 10 client.0 _ll_register_callbacks cb 0x7fbdec004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58686/0 (socket says 172.21.15.52:58686) 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/139333548 learned_addr learned my addr 172.21.15.52:0/139333548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf5410640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92bf9a0 0x5566e92ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/139333548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c5370 msgr2=0x5566e92cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf5c11640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c5370 0x5566e92cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c5370 0x5566e92cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92bf9a0 msgr2=0x5566e92ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92bf9a0 0x5566e92ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.321+0000 7fbdf4c0f640 1 -- 172.21.15.52:0/139333548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566e92d0420 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdf4c0f640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbde00a4160 tx=0x7fbde00d2b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666cb77dbd53f415 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b3070 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbde00a4400 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbde009bad0 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbde0020050 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 10 client.17901 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5566e9340510 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde009bad0 con 0x5566e92c02e0 2024-09-19T09:28:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbde00b6ce0 con 0x5566e92c02e0 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 10 client.17901 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 10 client.17901 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 20 client.17901 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e9342eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 4 client.17901 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.322+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566e922ad70 con 0x5566e92d55c0 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.323+0000 7fbdf5410640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e9342eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.323+0000 7fbdf5410640 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e9342eb0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a0b9f8b3a09747 server_cookie=71e2e7660801d28c in_seq=0 out_seq=0 2024-09-19T09:28:21.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.323+0000 7fbdd8ff9640 10 client.17901 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.335+0000 7fbdd8ff9640 1 -- 172.21.15.52:0/139333548 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5566e922ad70 con 0x5566e92d55c0 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.335+0000 7fbdd8ff9640 10 client.17901 handle_command_reply: tid=0 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.335+0000 7fbdfa415740 1 client.17901 shutdown 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 msgr2=0x5566e92cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbde00a4160 tx=0x7fbde00d2b90 comp rx=0 tx=0).stop 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 shutdown_connections 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5566e92d55c0 0x5566e9342eb0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5566e92c5370 0x5566e92cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566e92c02e0 0x5566e92cee00 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.337 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdd8ff9640 0 client.17901 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 --2- 172.21.15.52:0/139333548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5566e92bf9a0 0x5566e92ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 >> 172.21.15.52:0/139333548 conn(0x5566e92bb010 msgr2=0x5566e92ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 shutdown_connections 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 1 -- 172.21.15.52:0/139333548 wait complete. 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdfa415740 20 client.17901 trim_cache size 0 max 16384 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:28:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:28:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 msgr2=0x7fbddc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 0x7fbddc0a5830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x5566e92c0d10 tx=0x7fbdec00b390 comp rx=0 tx=0).stop 2024-09-19T09:28:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 msgr2=0x7fbdf019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fbde000d950 tx=0x7fbde000de10 comp rx=0 tx=0).stop 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 shutdown_connections 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdf01016b0 0x7fbdf01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.336+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdf0100d10 0x7fbdf019a4b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.337+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbddc0a3370 0x7fbddc0a5830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.337+0000 7fbdf7674640 1 --2- 172.21.15.52:0/4187782364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdf01003d0 0x7fbdf0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.337+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 >> 172.21.15.52:0/4187782364 conn(0x7fbdf00fc1e0 msgr2=0x7fbdf00fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.337+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 shutdown_connections 2024-09-19T09:28:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:21.337+0000 7fbdf7674640 1 -- 172.21.15.52:0/4187782364 wait complete. 2024-09-19T09:28:21.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:21 smithi052 ceph-mon[30947]: pgmap v545: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:28:21.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:21 smithi169 ceph-mon[35454]: pgmap v545: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:28:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:21 smithi086 ceph-mon[34813]: pgmap v545: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:28:23.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:23 smithi052 ceph-mon[30947]: pgmap v546: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:28:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:23 smithi169 ceph-mon[35454]: pgmap v546: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:28:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:23 smithi086 ceph-mon[34813]: pgmap v546: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:28:25.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:25 smithi052 ceph-mon[30947]: pgmap v547: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:25.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:25 smithi169 ceph-mon[35454]: pgmap v547: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:25 smithi086 ceph-mon[34813]: pgmap v547: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:28:25.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:28:26.221 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 -- 172.21.15.52:0/3220567790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff41036c0 msgr2=0x7efff410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 --2- 172.21.15.52:0/3220567790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff41036c0 0x7efff410bbb0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7effe4009ca0 tx=0x7effe402a950 comp rx=0 tx=0).stop 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 -- 172.21.15.52:0/3220567790 shutdown_connections 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 --2- 172.21.15.52:0/3220567790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff410c180 0x7efff410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 --2- 172.21.15.52:0/3220567790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff41036c0 0x7efff410bbb0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 --2- 172.21.15.52:0/3220567790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff4102da0 0x7efff4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 -- 172.21.15.52:0/3220567790 >> 172.21.15.52:0/3220567790 conn(0x7efff40fc7a0 msgr2=0x7efff40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 -- 172.21.15.52:0/3220567790 shutdown_connections 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.706+0000 7efffb066640 1 -- 172.21.15.52:0/3220567790 wait complete. 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 Processor -- start 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 -- start start 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff41036c0 0x7efff4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efff4111f60 con 0x7efff410c180 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff4111de0 con 0x7efff4102da0 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efffb066640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efff41120e0 con 0x7efff41036c0 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff8e02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff9603640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff8e02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:58402/0 (socket says 172.21.15.52:58402) 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff8e02640 1 -- 172.21.15.52:0/76067317 learned_addr learned my addr 172.21.15.52:0/76067317 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff9603640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58708/0 (socket says 172.21.15.52:58708) 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.707+0000 7efff3fff640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff41036c0 0x7efff4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 -- 172.21.15.52:0/76067317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff41036c0 msgr2=0x7efff4198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff41036c0 0x7efff4198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 -- 172.21.15.52:0/76067317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 msgr2=0x7efff41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 -- 172.21.15.52:0/76067317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff419d390 con 0x7efff410c180 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff8e02640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff9603640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7effec00c970 tx=0x7effec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff1ffb640 1 -- 172.21.15.52:0/76067317 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec007bb0 con 0x7efff410c180 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff419d680 con 0x7efff410c180 2024-09-19T09:28:26.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff1ffb640 1 -- 172.21.15.52:0/76067317 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effec007d50 con 0x7efff410c180 2024-09-19T09:28:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efff1ffb640 1 -- 172.21.15.52:0/76067317 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec018770 con 0x7efff410c180 2024-09-19T09:28:26.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.708+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff41a4f60 con 0x7efff410c180 2024-09-19T09:28:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.711+0000 7efff1ffb640 1 -- 172.21.15.52:0/76067317 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7effec00f450 con 0x7efff410c180 2024-09-19T09:28:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.711+0000 7efffd43f740 1 Processor -- start 2024-09-19T09:28:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.711+0000 7efffd43f740 1 -- start start 2024-09-19T09:28:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.711+0000 7efffd43f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ecf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efffd43f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7eda140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efffd43f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efffd43f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7e352e0 con 0x55d5a7eda680 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efffd43f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7ddcce0 con 0x55d5a7ecf4a0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efffd43f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7e312a0 con 0x55d5a7ecfdc0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff1ffb640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 0x7effe00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58722/0 (socket says 172.21.15.52:58722) 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 -- 172.21.15.52:0/2660383413 learned_addr learned my addr 172.21.15.52:0/2660383413 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ecf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff9603640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 0x7effe00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff8e02640 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7eda140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff1ffb640 1 -- 172.21.15.52:0/76067317 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7effec0cf8c0 con 0x7efff410c180 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 -- 172.21.15.52:0/2660383413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 msgr2=0x55d5a7eda140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7eda140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 -- 172.21.15.52:0/2660383413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 msgr2=0x55d5a7ecf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ecf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 -- 172.21.15.52:0/2660383413 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a7dc1440 con 0x55d5a7eda680 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff3fff640 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7effe4009a60 tx=0x7effe4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85873078c71e78b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.712+0000 7efff9603640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 0x7effe00a5700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7effec066810 tx=0x7effec06dbd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7effeaffd640 1 -- 172.21.15.52:0/2660383413 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4034040 con 0x55d5a7eda680 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7effeaffd640 1 -- 172.21.15.52:0/2660383413 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe4003e50 con 0x55d5a7eda680 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7effeaffd640 1 -- 172.21.15.52:0/2660383413 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe40045c0 con 0x55d5a7eda680 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 -- 172.21.15.52:0/2660383413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 msgr2=0x55d5a7edca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7effe4009a60 tx=0x7effe4005f10 comp rx=0 tx=0).stop 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 -- 172.21.15.52:0/2660383413 shutdown_connections 2024-09-19T09:28:26.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7edca70 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7eda140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 --2- 172.21.15.52:0/2660383413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ecf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 -- 172.21.15.52:0/2660383413 >> 172.21.15.52:0/2660383413 conn(0x55d5a7ecba30 msgr2=0x55d5a7ecbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 -- 172.21.15.52:0/2660383413 shutdown_connections 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.713+0000 7efffd43f740 1 -- 172.21.15.52:0/2660383413 wait complete. 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 -- start start 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 Processor -- start 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7eda0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ed7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7edd250 con 0x55d5a7eda680 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7df0050 con 0x55d5a7ecf4a0 2024-09-19T09:28:26.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d5a7edd3d0 con 0x55d5a7ecfdc0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efffd43f740 10 client.0 _ll_register_callbacks cb 0x55d5a7e30160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.714+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58736/0 (socket says 172.21.15.52:58736) 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 -- 172.21.15.52:0/3024849293 learned_addr learned my addr 172.21.15.52:0/3024849293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff8e02640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ed7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7eda0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 -- 172.21.15.52:0/3024849293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 msgr2=0x55d5a7ed7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ed7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 -- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 msgr2=0x55d5a7eda0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7eda0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 -- 172.21.15.52:0/3024849293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a7ba63c0 con 0x55d5a7eda680 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efff3fff640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7effe403d040 tx=0x7effe402fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ca8a3caf4b014 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7effd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:26.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4034030 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7effe4004340 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe4003e50 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7effe4004540 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efffd43f740 10 client.17913 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.715+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5a7edd250 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe4003e50 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7effe4030bf0 con 0x55d5a7eda680 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 10 client.17913 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 10 client.17913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 20 client.17913 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7ee9e60 0x55d5a7eec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 4 client.17913 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5a7e42850 con 0x55d5a7ee9e60 2024-09-19T09:28:26.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.716+0000 7efff8e02640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7ee9e60 0x55d5a7eec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7efff8e02640 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7ee9e60 0x55d5a7eec250 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cfa2dd425feacc server_cookie=ee91774ce61caa1b in_seq=0 out_seq=0 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7effd3fff640 10 client.17913 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7effd3fff640 1 -- 172.21.15.52:0/3024849293 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5a7e42850 con 0x55d5a7ee9e60 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7effd3fff640 10 client.17913 handle_command_reply: tid=0 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7efffd43f740 1 client.17913 shutdown 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 msgr2=0x55d5a7ed7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.717+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7effe403d040 tx=0x7effe402fa00 comp rx=0 tx=0).stop 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 shutdown_connections 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7ee9e60 0x55d5a7eec250 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ed7960 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ed7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7effd3fff640 0 client.17913 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:26.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 --2- 172.21.15.52:0/3024849293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7eda0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 >> 172.21.15.52:0/3024849293 conn(0x55d5a7ecba30 msgr2=0x55d5a7ed1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 shutdown_connections 2024-09-19T09:28:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 1 -- 172.21.15.52:0/3024849293 wait complete. 2024-09-19T09:28:26.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.718+0000 7efffd43f740 20 client.17913 trim_cache size 0 max 16384 2024-09-19T09:28:26.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 Processor -- start 2024-09-19T09:28:26.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 -- start start 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ee64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ecab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efff41afff0 con 0x55d5a7eda680 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff41ad8c0 con 0x55d5a7ecfdc0 2024-09-19T09:28:26.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efffd43f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efff41ab710 con 0x55d5a7ecf4a0 2024-09-19T09:28:26.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58740/0 (socket says 172.21.15.52:58740) 2024-09-19T09:28:26.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 -- 172.21.15.52:0/2399754624 learned_addr learned my addr 172.21.15.52:0/2399754624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:26.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ee64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 -- 172.21.15.52:0/2399754624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 msgr2=0x55d5a7ee64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ee64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 -- 172.21.15.52:0/2399754624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 msgr2=0x55d5a7ecab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ecab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.735+0000 7efff3fff640 1 -- 172.21.15.52:0/2399754624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a7ecc6c0 con 0x55d5a7eda680 2024-09-19T09:28:26.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efff3fff640 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7effe4002230 tx=0x7effe402fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da41e274cdf0c530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7effea7fc640 1 -- 172.21.15.52:0/2399754624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4034040 con 0x55d5a7eda680 2024-09-19T09:28:26.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7effea7fc640 1 -- 172.21.15.52:0/2399754624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe4009540 con 0x55d5a7eda680 2024-09-19T09:28:26.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7effea7fc640 1 -- 172.21.15.52:0/2399754624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe403aa40 con 0x55d5a7eda680 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 -- 172.21.15.52:0/2399754624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 msgr2=0x55d5a7ef18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7effe4002230 tx=0x7effe402fc60 comp rx=0 tx=0).stop 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 -- 172.21.15.52:0/2399754624 shutdown_connections 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7ef18e0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7ecab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 --2- 172.21.15.52:0/2399754624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ee64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 -- 172.21.15.52:0/2399754624 >> 172.21.15.52:0/2399754624 conn(0x55d5a7ecba30 msgr2=0x55d5a7ed9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 -- 172.21.15.52:0/2399754624 shutdown_connections 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.736+0000 7efffd43f740 1 -- 172.21.15.52:0/2399754624 wait complete. 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 -- start start 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 Processor -- start 2024-09-19T09:28:26.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ede9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7edef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efff41abd80 con 0x55d5a7eda680 2024-09-19T09:28:26.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efff41ad1f0 con 0x55d5a7ecfdc0 2024-09-19T09:28:26.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efff41ac450 con 0x55d5a7ecf4a0 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efffd43f740 10 client.0 _ll_register_callbacks cb 0x7effe403d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efff3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58754/0 (socket says 172.21.15.52:58754) 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.737+0000 7efff3fff640 1 -- 172.21.15.52:0/1121976421 learned_addr learned my addr 172.21.15.52:0/1121976421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ede9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff8e02640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7edef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 -- 172.21.15.52:0/1121976421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 msgr2=0x55d5a7ede9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ede9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 -- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 msgr2=0x55d5a7edef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:26.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7edef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 -- 172.21.15.52:0/1121976421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a7ed82a0 con 0x55d5a7eda680 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efff3fff640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7effe403a6a0 tx=0x7effe405a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1ce1f6d3ffb09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7effd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe4034040 con 0x55d5a7eda680 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7effe4003d00 con 0x55d5a7eda680 2024-09-19T09:28:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe4009540 con 0x55d5a7eda680 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7effe4009800 con 0x55d5a7eda680 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efffd43f740 10 client.17919 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.738+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5a7f54e40 con 0x55d5a7eda680 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effe4009540 con 0x55d5a7eda680 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7effe4060030 con 0x55d5a7eda680 2024-09-19T09:28:26.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 10 client.17919 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:26.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:26.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 20 client.17919 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:26.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7f55220 0x55d5a7f57610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:26.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 4 client.17919 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:28:26.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d5a7e3cd60 con 0x55d5a7f55220 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efff8e02640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7f55220 0x55d5a7f57610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7effd3fff640 10 client.17919 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.739+0000 7efff8e02640 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7f55220 0x55d5a7f57610 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bb78d98b0c0b9e server_cookie=65b6828b4b908dc1 in_seq=0 out_seq=0 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7effd3fff640 1 -- 172.21.15.52:0/1121976421 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d5a7e3cd60 con 0x55d5a7f55220 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7effd3fff640 10 client.17919 handle_command_reply: tid=0 2024-09-19T09:28:26.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 client.17919 shutdown 2024-09-19T09:28:26.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 msgr2=0x55d5a7f538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7effe403a6a0 tx=0x7effe405a040 comp rx=0 tx=0).stop 2024-09-19T09:28:26.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 shutdown_connections 2024-09-19T09:28:26.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d5a7f55220 0x55d5a7f57610 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5a7eda680 0x55d5a7f538b0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d5a7ecfdc0 0x55d5a7edef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 --2- 172.21.15.52:0/1121976421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d5a7ecf4a0 0x55d5a7ede9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 >> 172.21.15.52:0/1121976421 conn(0x55d5a7ecba30 msgr2=0x55d5a7ed1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7effd3fff640 0 client.17919 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 shutdown_connections 2024-09-19T09:28:26.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 1 -- 172.21.15.52:0/1121976421 wait complete. 2024-09-19T09:28:26.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.740+0000 7efffd43f740 20 client.17919 trim_cache size 0 max 16384 2024-09-19T09:28:26.761 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:26.761 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:28:26.762 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:28:26.762 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 msgr2=0x7effe00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 0x7effe00a5700 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7effec066810 tx=0x7effec06dbd0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 msgr2=0x7efff419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7effec00c970 tx=0x7effec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 shutdown_connections 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efff410c180 0x7efff419ccb0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effe00a3240 0x7effe00a5700 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff41036c0 0x7efff4198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 --2- 172.21.15.52:0/76067317 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efff4102da0 0x7efff41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 >> 172.21.15.52:0/76067317 conn(0x7efff40fc7a0 msgr2=0x7efff40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 shutdown_connections 2024-09-19T09:28:26.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:26.741+0000 7efffb066640 1 -- 172.21.15.52:0/76067317 wait complete. 2024-09-19T09:28:27.368 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:27 smithi052 ceph-mon[30947]: pgmap v548: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:28:27.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:27 smithi169 ceph-mon[35454]: pgmap v548: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:28:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:27 smithi086 ceph-mon[34813]: pgmap v548: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:28:27.764 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:28:27.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:28:28.027 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.638+0000 7fab1994a640 1 -- 172.21.15.52:0/3478599832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 msgr2=0x7fab14074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.638+0000 7fab1994a640 1 --2- 172.21.15.52:0/3478599832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab14074970 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fab04009900 tx=0x7fab0402a480 comp rx=0 tx=0).stop 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.638+0000 7fab1994a640 1 -- 172.21.15.52:0/3478599832 shutdown_connections 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.638+0000 7fab1994a640 1 --2- 172.21.15.52:0/3478599832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14112b80 0x7fab14114f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 --2- 172.21.15.52:0/3478599832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14074eb0 0x7fab14112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 --2- 172.21.15.52:0/3478599832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab14074970 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 -- 172.21.15.52:0/3478599832 >> 172.21.15.52:0/3478599832 conn(0x7fab140fd8b0 msgr2=0x7fab140ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 -- 172.21.15.52:0/3478599832 shutdown_connections 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 -- 172.21.15.52:0/3478599832 wait complete. 2024-09-19T09:28:28.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 Processor -- start 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.639+0000 7fab1994a640 1 -- start start 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 0x7fab141a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 0x7fab1419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab141185b0 con 0x7fab14074590 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab14118430 con 0x7fab14112b80 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab1994a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab14118730 con 0x7fab14074eb0 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46738/0 (socket says 172.21.15.52:46738) 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 -- 172.21.15.52:0/574395935 learned_addr learned my addr 172.21.15.52:0/574395935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab127fc640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 0x7fab141a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab137fe640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 0x7fab1419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:28.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 -- 172.21.15.52:0/574395935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 msgr2=0x7fab141a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 0x7fab141a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 -- 172.21.15.52:0/574395935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 msgr2=0x7fab1419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 0x7fab1419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 -- 172.21.15.52:0/574395935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1419f010 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab127fc640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 0x7fab141a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab137fe640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 0x7fab1419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab12ffd640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fab04005ab0 tx=0x7fab040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.640+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0403f030 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.641+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1419f2a0 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.641+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab04003ce0 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.641+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04035070 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.641+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab141ab5f0 con 0x7fab14074590 2024-09-19T09:28:28.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.641+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab14074970 con 0x7fab14074590 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.643+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fab04042030 con 0x7fab14074590 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.644+0000 7fab18948640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 0x7fab000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.644+0000 7fab127fc640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 0x7fab000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.644+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fab040f06d0 con 0x7fab14074590 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.645+0000 7fab127fc640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 0x7fab000a5700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab14114c50 tx=0x7faafc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:28.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.648+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab040bd310 con 0x7fab14074590 2024-09-19T09:28:28.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.862+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab141ab820 con 0x7fab14074590 2024-09-19T09:28:28.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.863+0000 7fab18948640 1 -- 172.21.15.52:0/574395935 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fab040bcc10 con 0x7fab14074590 2024-09-19T09:28:28.864 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:28:28.864 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:28:28.864 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 msgr2=0x7fab000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 0x7fab000a5700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fab14114c50 tx=0x7faafc008040 comp rx=0 tx=0).stop 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 msgr2=0x7fab141a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fab04005ab0 tx=0x7fab040042f0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 shutdown_connections 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab14112b80 0x7fab1419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fab000a3240 0x7fab000a5700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab14074eb0 0x7fab141a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 --2- 172.21.15.52:0/574395935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab14074590 0x7fab141a4720 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:28.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 >> 172.21.15.52:0/574395935 conn(0x7fab140fd8b0 msgr2=0x7fab140ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:28.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 shutdown_connections 2024-09-19T09:28:28.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:28.865+0000 7fab1994a640 1 -- 172.21.15.52:0/574395935 wait complete. 2024-09-19T09:28:29.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:29 smithi052 ceph-mon[30947]: pgmap v549: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:29 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/574395935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:29 smithi169 ceph-mon[35454]: pgmap v549: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:29.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:29 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/574395935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:29 smithi086 ceph-mon[34813]: pgmap v549: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:29 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/574395935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:29.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:28:29.808 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 -- 172.21.15.52:0/2717683393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 msgr2=0x7f44781021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 --2- 172.21.15.52:0/2717683393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f44781021c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f4468009900 tx=0x7f446802a410 comp rx=0 tx=0).stop 2024-09-19T09:28:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 -- 172.21.15.52:0/2717683393 shutdown_connections 2024-09-19T09:28:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 --2- 172.21.15.52:0/2717683393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 0x7f447810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 --2- 172.21.15.52:0/2717683393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 0x7f44781067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 --2- 172.21.15.52:0/2717683393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f44781021c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 -- 172.21.15.52:0/2717683393 >> 172.21.15.52:0/2717683393 conn(0x7f44780fd8c0 msgr2=0x7f44780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 -- 172.21.15.52:0/2717683393 shutdown_connections 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.426+0000 7f447d80d640 1 -- 172.21.15.52:0/2717683393 wait complete. 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 Processor -- start 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 -- start start 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 0x7f44781988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 0x7f447819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4478111f30 con 0x7f4478101de0 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4478111db0 con 0x7f4478106f10 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.427+0000 7f447d80d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44781120b0 con 0x7f4478102790 2024-09-19T09:28:30.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46764/0 (socket says 172.21.15.52:46764) 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 -- 172.21.15.52:0/1265084717 learned_addr learned my addr 172.21.15.52:0/1265084717 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f44777fe640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 0x7f447819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f446e7fc640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 0x7f44781988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 -- 172.21.15.52:0/1265084717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 msgr2=0x7f44781988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 0x7f44781988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 -- 172.21.15.52:0/1265084717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 msgr2=0x7f447819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 0x7f447819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 -- 172.21.15.52:0/1265084717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447819d340 con 0x7f4478101de0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f4476ffd640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4468006010 tx=0x7f44680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f447c80b640 1 -- 172.21.15.52:0/1265084717 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446803f030 con 0x7f4478101de0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447819d5d0 con 0x7f4478101de0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f447c80b640 1 -- 172.21.15.52:0/1265084717 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4468003ce0 con 0x7f4478101de0 2024-09-19T09:28:30.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f447c80b640 1 -- 172.21.15.52:0/1265084717 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468035070 con 0x7f4478101de0 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.428+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781a4f10 con 0x7f4478101de0 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.431+0000 7f447c80b640 1 -- 172.21.15.52:0/1265084717 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4468042030 con 0x7f4478101de0 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.431+0000 7f447fbe6740 1 Processor -- start 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.431+0000 7f447fbe6740 1 -- start start 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.431+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.431+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 0x55add6d9a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447fbe6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55add6cf32f0 con 0x55add6d98370 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447fbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55add6c9acf0 con 0x55add6d8eb40 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447fbe6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55add6cef2b0 con 0x55add6d8d5d0 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447c80b640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 0x55add6d9a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:44200/0 (socket says 172.21.15.52:44200) 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 0x55add6d9a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46770/0 (socket says 172.21.15.52:46770) 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 -- 172.21.15.52:0/3643823860 learned_addr learned my addr 172.21.15.52:0/3643823860 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f447c80b640 1 -- 172.21.15.52:0/1265084717 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f44680efd50 con 0x7f4478101de0 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 -- 172.21.15.52:0/3643823860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 msgr2=0x55add6d8da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d8da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 -- 172.21.15.52:0/3643823860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 msgr2=0x55add6d9a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 0x55add6d9a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 -- 172.21.15.52:0/3643823860 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add6c7f3a0 con 0x55add6d8eb40 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 0x7f44640a5700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f447000fc30 tx=0x7f4470017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.432+0000 7f44777fe640 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4470012d10 tx=0x7f447000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd300c80c64d7622 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f446dffb640 1 -- 172.21.15.52:0/3643823860 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470012800 con 0x55add6d8eb40 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f446dffb640 1 -- 172.21.15.52:0/3643823860 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4470003e50 con 0x55add6d8eb40 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f446dffb640 1 -- 172.21.15.52:0/3643823860 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470004230 con 0x55add6d8eb40 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 -- 172.21.15.52:0/3643823860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 msgr2=0x55add6d8d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4470012d10 tx=0x7f447000f730 comp rx=0 tx=0).stop 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 -- 172.21.15.52:0/3643823860 shutdown_connections 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d98370 0x55add6d9a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d8da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 --2- 172.21.15.52:0/3643823860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6d8d090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 -- 172.21.15.52:0/3643823860 >> 172.21.15.52:0/3643823860 conn(0x55add6d56310 msgr2=0x55add6d89c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 -- 172.21.15.52:0/3643823860 shutdown_connections 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.433+0000 7f447fbe6740 1 -- 172.21.15.52:0/3643823860 wait complete. 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 -- start start 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 Processor -- start 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d97c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d98370 0x55add6d95480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55add6d9b010 con 0x55add6d8eb40 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55add6cae060 con 0x55add6d98370 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55add6d9b190 con 0x55add6d8d5d0 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f447fbe6740 10 client.0 _ll_register_callbacks cb 0x55add6a018c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46776/0 (socket says 172.21.15.52:46776) 2024-09-19T09:28:30.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.434+0000 7f446e7fc640 1 -- 172.21.15.52:0/2627699045 learned_addr learned my addr 172.21.15.52:0/2627699045 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f4476ffd640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d97c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f44777fe640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d98370 0x55add6d95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 -- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 msgr2=0x55add6d97c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d97c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 -- 172.21.15.52:0/2627699045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d98370 msgr2=0x55add6d95480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d98370 0x55add6d95480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 -- 172.21.15.52:0/2627699045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add6a643c0 con 0x55add6d8eb40 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4460010820 tx=0x7f4460010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85188c7608fb502d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446000fb90 con 0x55add6d8eb40 2024-09-19T09:28:30.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f446000fd30 con 0x55add6d8eb40 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4470003e50 con 0x55add6d8eb40 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4460005020 con 0x55add6d8eb40 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f447fbe6740 10 client.17937 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.435+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55add6da6a30 con 0x55add6d8eb40 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4470003e50 con 0x55add6d8eb40 2024-09-19T09:28:30.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4460023410 con 0x55add6d8eb40 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 10 client.17937 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 10 client.17937 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 20 client.17937 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6da7f90 0x55add6daa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 4 client.17937 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55add6d00860 con 0x55add6da7f90 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.436+0000 7f4476ffd640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6da7f90 0x55add6daa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f4476ffd640 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6da7f90 0x55add6daa3b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=465920bbf184f91a server_cookie=b5c63fcd7df7618c in_seq=0 out_seq=0 2024-09-19T09:28:30.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f4456ffd640 10 client.17937 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:28:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f4456ffd640 1 -- 172.21.15.52:0/2627699045 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55add6d00860 con 0x55add6da7f90 2024-09-19T09:28:30.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f4456ffd640 10 client.17937 handle_command_reply: tid=0 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f447fbe6740 1 client.17937 shutdown 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 msgr2=0x55add6d94f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.437+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f4460010820 tx=0x7f4460010ce0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 shutdown_connections 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6da7f90 0x55add6daa3b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d98370 0x55add6d95480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6d94f40 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2627699045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d8d5d0 0x55add6d97c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 >> 172.21.15.52:0/2627699045 conn(0x55add6d56310 msgr2=0x55add6d8f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f4456ffd640 0 client.17937 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:28:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 shutdown_connections 2024-09-19T09:28:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 1 -- 172.21.15.52:0/2627699045 wait complete. 2024-09-19T09:28:30.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.438+0000 7f447fbe6740 20 client.17937 trim_cache size 0 max 16384 2024-09-19T09:28:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 Processor -- start 2024-09-19T09:28:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 -- start start 2024-09-19T09:28:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8d5d0 0x55add6da42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6da0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44781aff30 con 0x55add6d8eb40 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f44781ad800 con 0x55add6d8d5d0 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f447fbe6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44781ab650 con 0x55add6d98370 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f446e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46784/0 (socket says 172.21.15.52:46784) 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.452+0000 7f446e7fc640 1 -- 172.21.15.52:0/2069608967 learned_addr learned my addr 172.21.15.52:0/2069608967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f4476ffd640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8d5d0 0x55add6da42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f44777fe640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6da0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 -- 172.21.15.52:0/2069608967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 msgr2=0x55add6da0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6da0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 -- 172.21.15.52:0/2069608967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8d5d0 msgr2=0x55add6da42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8d5d0 0x55add6da42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 -- 172.21.15.52:0/2069608967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add6d90120 con 0x55add6d8eb40 2024-09-19T09:28:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f44777fe640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6da0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446e7fc640 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4460023a40 tx=0x7f4460023e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cab5483d5dde08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446d7fa640 1 -- 172.21.15.52:0/2069608967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460023410 con 0x55add6d8eb40 2024-09-19T09:28:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446d7fa640 1 -- 172.21.15.52:0/2069608967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44600235b0 con 0x55add6d8eb40 2024-09-19T09:28:30.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.453+0000 7f446d7fa640 1 -- 172.21.15.52:0/2069608967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460004950 con 0x55add6d8eb40 2024-09-19T09:28:30.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- 172.21.15.52:0/2069608967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 msgr2=0x55add6da0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f4460023a40 tx=0x7f4460023e00 comp rx=0 tx=0).stop 2024-09-19T09:28:30.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- 172.21.15.52:0/2069608967 shutdown_connections 2024-09-19T09:28:30.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6da0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8eb40 0x55add6da0800 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 --2- 172.21.15.52:0/2069608967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8d5d0 0x55add6da42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- 172.21.15.52:0/2069608967 >> 172.21.15.52:0/2069608967 conn(0x55add6d56310 msgr2=0x55add6d94030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- 172.21.15.52:0/2069608967 shutdown_connections 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- 172.21.15.52:0/2069608967 wait complete. 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.454+0000 7f447fbe6740 1 -- start start 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 Processor -- start 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6e0b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6e0b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f44781abcc0 con 0x55add6d8d5d0 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f44781ad130 con 0x55add6d8eb40 2024-09-19T09:28:30.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f44781ac390 con 0x55add6d98370 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f447fbe6740 10 client.0 _ll_register_callbacks cb 0x7f4460010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46798/0 (socket says 172.21.15.52:46798) 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 -- 172.21.15.52:0/34588116 learned_addr learned my addr 172.21.15.52:0/34588116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f446e7fc640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6e0b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f44777fe640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6e0b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 -- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 msgr2=0x55add6e0b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6e0b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 -- 172.21.15.52:0/34588116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 msgr2=0x55add6e0b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6e0b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 -- 172.21.15.52:0/34588116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add6e15d90 con 0x55add6d8d5d0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4476ffd640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f4468031550 tx=0x7f446808b030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9aaca8291021cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.455+0000 7f4456ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468049040 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f44680ba5f0 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44600235b0 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f44680b6e60 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 10 client.17943 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55add6e170f0 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44600235b0 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f446803bc40 con 0x55add6d8d5d0 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 10 client.17943 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 10 client.17943 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 20 client.17943 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6e17810 0x55add6e19c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 4 client.17943 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.456+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55add6cfad70 con 0x55add6e17810 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f446e7fc640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6e17810 0x55add6e19c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f446e7fc640 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6e17810 0x55add6e19c30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0f770c926402767 server_cookie=4008e1570de1f06e in_seq=0 out_seq=0 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f4456ffd640 10 client.17943 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f4456ffd640 1 -- 172.21.15.52:0/34588116 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55add6cfad70 con 0x55add6e17810 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f4456ffd640 10 client.17943 handle_command_reply: tid=0 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f447fbe6740 1 client.17943 shutdown 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 msgr2=0x55add6e0ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f4468031550 tx=0x7f446808b030 comp rx=0 tx=0).stop 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.457+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 shutdown_connections 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55add6e17810 0x55add6e19c30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55add6d98370 0x55add6e0b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55add6d8eb40 0x55add6e0b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 --2- 172.21.15.52:0/34588116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55add6d8d5d0 0x55add6e0ac10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 >> 172.21.15.52:0/34588116 conn(0x55add6d56310 msgr2=0x55add6d967a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f4456ffd640 0 client.17943 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 shutdown_connections 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 1 -- 172.21.15.52:0/34588116 wait complete. 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447fbe6740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T09:28:30.465 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 msgr2=0x7f44640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 0x7f44640a5700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f447000fc30 tx=0x7f4470017000 comp rx=0 tx=0).stop 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 msgr2=0x7f4478198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f4468006010 tx=0x7f44680042f0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 shutdown_connections 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4478106f10 0x7f447819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4478102790 0x7f44781988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 --2- 172.21.15.52:0/1265084717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4478101de0 0x7f4478198390 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 >> 172.21.15.52:0/1265084717 conn(0x7f44780fd8c0 msgr2=0x7f44780fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 shutdown_connections 2024-09-19T09:28:30.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:30.458+0000 7f447d80d640 1 -- 172.21.15.52:0/1265084717 wait complete. 2024-09-19T09:28:31.254 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:31 smithi052 ceph-mon[30947]: pgmap v550: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:31.284 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:28:31.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:31 smithi169 ceph-mon[35454]: pgmap v550: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:31.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:31 smithi086 ceph-mon[34813]: pgmap v550: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:28:31.560 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:32.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- 172.21.15.52:0/3472348948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f8102e00 msgr2=0x7f77f81031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/3472348948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f8102e00 0x7f77f81031e0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f77e8009900 tx=0x7f77e802a480 comp rx=0 tx=0).stop 2024-09-19T09:28:32.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- 172.21.15.52:0/3472348948 shutdown_connections 2024-09-19T09:28:32.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/3472348948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f810c1a0 0x7f77f810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/3472348948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8103720 0x7f77f810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/3472348948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f8102e00 0x7f77f81031e0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- 172.21.15.52:0/3472348948 >> 172.21.15.52:0/3472348948 conn(0x7f77f80fc7a0 msgr2=0x7f77f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- 172.21.15.52:0/3472348948 shutdown_connections 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- 172.21.15.52:0/3472348948 wait complete. 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 Processor -- start 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.033+0000 7f77fe8c9640 1 -- start start 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8102e00 0x7f77f8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 0x7f77f8100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8111fb0 con 0x7f77f810c1a0 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8111e30 con 0x7f77f8103720 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fe8c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77f8112130 con 0x7f77f8102e00 2024-09-19T09:28:32.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46814/0 (socket says 172.21.15.52:46814) 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 -- 172.21.15.52:0/1298590651 learned_addr learned my addr 172.21.15.52:0/1298590651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77f7fff640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8102e00 0x7f77f8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77f77fe640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 0x7f77f8100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 -- 172.21.15.52:0/1298590651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8102e00 msgr2=0x7f77f8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8102e00 0x7f77f8100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 -- 172.21.15.52:0/1298590651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 msgr2=0x7f77f8100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 0x7f77f8100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 -- 172.21.15.52:0/1298590651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f81a6950 con 0x7f77f810c1a0 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77f77fe640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 0x7f77f8100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.034+0000 7f77fce66640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f77f000b970 tx=0x7f77f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.035+0000 7f77f57fa640 1 -- 172.21.15.52:0/1298590651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0019070 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.035+0000 7f77f57fa640 1 -- 172.21.15.52:0/1298590651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f000cb40 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.035+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f81a6c40 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.035+0000 7f77f57fa640 1 -- 172.21.15.52:0/1298590651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0007650 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.035+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f81a7130 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f77f57fa640 1 -- 172.21.15.52:0/1298590651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f77f001c070 con 0x7f77f810c1a0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 Processor -- start 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 -- start start 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e621090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e621a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e6e5872f0 con 0x564e6e62c370 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564e6e52ecf0 con 0x564e6e6215d0 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.037+0000 7f7800ca2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564e6e5832b0 con 0x564e6e622b40 2024-09-19T09:28:32.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46824/0 (socket says 172.21.15.52:46824) 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 -- 172.21.15.52:0/544074374 learned_addr learned my addr 172.21.15.52:0/544074374 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f7fff640 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e621a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e621090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f57fa640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 0x7f77e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 -- 172.21.15.52:0/544074374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 msgr2=0x564e6e621090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e621090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 -- 172.21.15.52:0/544074374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 msgr2=0x564e6e621a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e621a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 -- 172.21.15.52:0/544074374 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6e5133a0 con 0x564e6e62c370 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77fce66640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 0x7f77e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f57fa640 1 -- 172.21.15.52:0/1298590651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f77f00cef70 con 0x7f77f810c1a0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77f77fe640 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0058c0 tx=0x7f77ec00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f1e647e2c6e217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77de7fc640 1 -- 172.21.15.52:0/544074374 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec004030 con 0x564e6e62c370 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77de7fc640 1 -- 172.21.15.52:0/544074374 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec011c60 con 0x564e6e62c370 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.038+0000 7f77de7fc640 1 -- 172.21.15.52:0/544074374 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec003850 con 0x564e6e62c370 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 -- 172.21.15.52:0/544074374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 msgr2=0x564e6e62e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0058c0 tx=0x7f77ec00b730 comp rx=0 tx=0).stop 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f77fce66640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 0x7f77e00a5700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77f009b2c0 tx=0x7f77f0009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 -- 172.21.15.52:0/544074374 shutdown_connections 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e62e760 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e621a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 --2- 172.21.15.52:0/544074374 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e621090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 -- 172.21.15.52:0/544074374 >> 172.21.15.52:0/544074374 conn(0x564e6e5ea310 msgr2=0x564e6e61dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 -- 172.21.15.52:0/544074374 shutdown_connections 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.039+0000 7f7800ca2740 1 -- 172.21.15.52:0/544074374 wait complete. 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 -- start start 2024-09-19T09:28:32.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 Processor -- start 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e62bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e628fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e629560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e6e62f010 con 0x564e6e62c370 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564e6e542060 con 0x564e6e6215d0 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564e6e62f190 con 0x564e6e622b40 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f7800ca2740 10 client.0 _ll_register_callbacks cb 0x564e6e2958c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e629560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e629560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46828/0 (socket says 172.21.15.52:46828) 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f77f77fe640 1 -- 172.21.15.52:0/2331859075 learned_addr learned my addr 172.21.15.52:0/2331859075 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f77f7fff640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e628fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.040+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e62bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 -- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 msgr2=0x564e6e62bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e62bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 -- 172.21.15.52:0/2331859075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 msgr2=0x564e6e629560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e629560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 -- 172.21.15.52:0/2331859075 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6e2f83c0 con 0x564e6e622b40 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e62bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77f7fff640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e628fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77e8005940 tx=0x7f77e8031920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f288c0b81642880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8035040 con 0x564e6e622b40 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77ec011c60 con 0x564e6e622b40 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.041+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f77e8004240 con 0x564e6e622b40 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f77e804b020 con 0x564e6e622b40 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 10 client.26821 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:32.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e6e63aae0 con 0x564e6e622b40 2024-09-19T09:28:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec011c60 con 0x564e6e622b40 2024-09-19T09:28:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f77e80466e0 con 0x564e6e622b40 2024-09-19T09:28:32.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 10 client.26821 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 10 client.26821 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 20 client.26821 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e63bef0 0x564e6e63e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 4 client.26821 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e6e594860 con 0x564e6e63bef0 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.042+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e63bef0 0x564e6e63e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.043+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e63bef0 0x564e6e63e2e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce988fbfc9ac31e8 server_cookie=fc3ceff098698389 in_seq=0 out_seq=0 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.043+0000 7f77d77fe640 10 client.26821 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.043+0000 7f77d77fe640 1 -- 172.21.15.52:0/2331859075 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e6e594860 con 0x564e6e63bef0 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.043+0000 7f77d77fe640 10 client.26821 handle_command_reply: tid=0 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.043+0000 7f7800ca2740 1 client.26821 shutdown 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 msgr2=0x564e6e628fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e628fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77e8005940 tx=0x7f77e8031920 comp rx=0 tx=0).stop 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 shutdown_connections 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e62c370 0x564e6e629560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e622b40 0x564e6e628fc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e63bef0 0x564e6e63e2e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2331859075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e6215d0 0x564e6e62bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f77d77fe640 0 client.26821 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 >> 172.21.15.52:0/2331859075 conn(0x564e6e5ea310 msgr2=0x564e6e623960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 shutdown_connections 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 1 -- 172.21.15.52:0/2331859075 wait complete. 2024-09-19T09:28:32.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.044+0000 7f7800ca2740 20 client.26821 trim_cache size 0 max 16384 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 Processor -- start 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 -- start start 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e627fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e643b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81b2280 con 0x564e6e6215d0 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81afb50 con 0x564e6e622b40 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f7800ca2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81ad9a0 con 0x564e6e62c370 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46844/0 (socket says 172.21.15.52:46844) 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 -- 172.21.15.52:0/2507351456 learned_addr learned my addr 172.21.15.52:0/2507351456 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f7fff640 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e627fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 -- 172.21.15.52:0/2507351456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 msgr2=0x564e6e643b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e643b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 -- 172.21.15.52:0/2507351456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 msgr2=0x564e6e627fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.057+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e627fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f77f77fe640 1 -- 172.21.15.52:0/2507351456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6e621d50 con 0x564e6e6215d0 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f77f77fe640 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f77ec013830 tx=0x7f77ec004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede5c019d5ba9bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f77ddffb640 1 -- 172.21.15.52:0/2507351456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec032030 con 0x564e6e6215d0 2024-09-19T09:28:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f77ddffb640 1 -- 172.21.15.52:0/2507351456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec00b4a0 con 0x564e6e6215d0 2024-09-19T09:28:32.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f77ddffb640 1 -- 172.21.15.52:0/2507351456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec011c60 con 0x564e6e6215d0 2024-09-19T09:28:32.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f7800ca2740 1 -- 172.21.15.52:0/2507351456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 msgr2=0x564e6e6382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.058+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f77ec013830 tx=0x7f77ec004350 comp rx=0 tx=0).stop 2024-09-19T09:28:32.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- 172.21.15.52:0/2507351456 shutdown_connections 2024-09-19T09:28:32.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e643b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e627fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- 172.21.15.52:0/2507351456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e6382e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- 172.21.15.52:0/2507351456 >> 172.21.15.52:0/2507351456 conn(0x564e6e5ea310 msgr2=0x564e6e627890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- 172.21.15.52:0/2507351456 shutdown_connections 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- 172.21.15.52:0/2507351456 wait complete. 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- start start 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 Processor -- start 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e625c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e626170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81ae010 con 0x564e6e6215d0 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81af480 con 0x564e6e622b40 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.059+0000 7f7800ca2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f77f81ae6e0 con 0x564e6e62c370 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f7800ca2740 10 client.0 _ll_register_callbacks cb 0x7f77e80315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46858/0 (socket says 172.21.15.52:46858) 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 -- 172.21.15.52:0/549444503 learned_addr learned my addr 172.21.15.52:0/549444503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e626170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f7fff640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e625c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 -- 172.21.15.52:0/549444503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 msgr2=0x564e6e626170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e626170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 -- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 msgr2=0x564e6e625c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e625c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 -- 172.21.15.52:0/549444503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6e6268b0 con 0x564e6e6215d0 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f7fff640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e625c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77f77fe640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f77ec011a80 tx=0x7f77ec00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25b6732f4498e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec03d060 con 0x564e6e6215d0 2024-09-19T09:28:32.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f77ec0110b0 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.060+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e6e58ed70 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f77ec032040 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 10 client.17961 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e6e6a6a60 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564e6e58ed70 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f77ec01e070 con 0x564e6e6215d0 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 10 client.17961 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:32.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 10 client.17961 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 20 client.17961 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e6a6f30 0x564e6e6a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 4 client.17961 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e6e50b170 con 0x564e6e6a6f30 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.061+0000 7f77f7fff640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e6a6f30 0x564e6e6a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f77d77fe640 10 client.17961 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f77f7fff640 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e6a6f30 0x564e6e6a9320 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c58f009148a3b80c server_cookie=b8ae2da403b6e808 in_seq=0 out_seq=0 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f77d77fe640 1 -- 172.21.15.52:0/549444503 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e6e50b170 con 0x564e6e6a6f30 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f77d77fe640 10 client.17961 handle_command_reply: tid=0 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 client.17961 shutdown 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 msgr2=0x564e6e634a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f77ec011a80 tx=0x7f77ec00b7b0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 shutdown_connections 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564e6e62c370 0x564e6e626170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564e6e6a6f30 0x564e6e6a9320 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564e6e622b40 0x564e6e625c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 --2- 172.21.15.52:0/549444503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e6e6215d0 0x564e6e634a90 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 >> 172.21.15.52:0/549444503 conn(0x564e6e5ea310 msgr2=0x564e6e6280b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f77d77fe640 0 client.17961 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 shutdown_connections 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 1 -- 172.21.15.52:0/549444503 wait complete. 2024-09-19T09:28:32.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.062+0000 7f7800ca2740 20 client.17961 trim_cache size 0 max 16384 2024-09-19T09:28:32.074 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:28:32.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 msgr2=0x7f77e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 0x7f77e00a5700 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f77f009b2c0 tx=0x7f77f0009970 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 msgr2=0x7f77f81014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f77f000b970 tx=0x7f77f000be30 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 shutdown_connections 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77f810c1a0 0x7f77f81014e0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77f8103720 0x7f77f8100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f77e00a3240 0x7f77e00a5700 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 --2- 172.21.15.52:0/1298590651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f77f8102e00 0x7f77f8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 >> 172.21.15.52:0/1298590651 conn(0x7f77f80fc7a0 msgr2=0x7f77f80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 shutdown_connections 2024-09-19T09:28:32.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:32.063+0000 7f77fe8c9640 1 -- 172.21.15.52:0/1298590651 wait complete. 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:28:32.388 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:28:32.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:32.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:28:32.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:28:32.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.510 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:28:32.511 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:32.511 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:28:32.511 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:28:32.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:28:33.044 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: pgmap v551: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:28:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:33 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: pgmap v551: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:28:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:33 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: pgmap v551: 97 pgs: 97 active+clean; 3.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:28:33.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:33 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:28:33.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 -- 172.21.15.52:0/1887460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c102d40 msgr2=0x7f449c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 --2- 172.21.15.52:0/1887460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c102d40 0x7f449c103120 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f448c009900 tx=0x7f448c02a480 comp rx=0 tx=0).stop 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 -- 172.21.15.52:0/1887460757 shutdown_connections 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 --2- 172.21.15.52:0/1887460757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c10c170 0x7f449c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 --2- 172.21.15.52:0/1887460757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c103660 0x7f449c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 --2- 172.21.15.52:0/1887460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c102d40 0x7f449c103120 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.677+0000 7f44a161f640 1 -- 172.21.15.52:0/1887460757 >> 172.21.15.52:0/1887460757 conn(0x7f449c0fc7a0 msgr2=0x7f449c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- 172.21.15.52:0/1887460757 shutdown_connections 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- 172.21.15.52:0/1887460757 wait complete. 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 Processor -- start 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- start start 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c102d40 0x7f449c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c10c170 0x7f449c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f449c111f70 con 0x7f449c103660 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f449c111df0 con 0x7f449c10c170 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.678+0000 7f44a161f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1120f0 con 0x7f449c102d40 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f449affd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c102d40 0x7f449c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46876/0 (socket says 172.21.15.52:46876) 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 -- 172.21.15.52:0/1862755450 learned_addr learned my addr 172.21.15.52:0/1862755450 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f449b7fe640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c10c170 0x7f449c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 -- 172.21.15.52:0/1862755450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c102d40 msgr2=0x7f449c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c102d40 0x7f449c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 -- 172.21.15.52:0/1862755450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c10c170 msgr2=0x7f449c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c10c170 0x7f449c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 -- 172.21.15.52:0/1862755450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c19d400 con 0x7f449c103660 2024-09-19T09:28:33.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4493fff640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f448400d740 tx=0x7f448400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4498ff9640 1 -- 172.21.15.52:0/1862755450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484017070 con 0x7f449c103660 2024-09-19T09:28:33.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f4498ff9640 1 -- 172.21.15.52:0/1862755450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f448400de50 con 0x7f449c103660 2024-09-19T09:28:33.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.679+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c19d6f0 con 0x7f449c103660 2024-09-19T09:28:33.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.680+0000 7f4498ff9640 1 -- 172.21.15.52:0/1862755450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448400f620 con 0x7f449c103660 2024-09-19T09:28:33.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.680+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c1a4fd0 con 0x7f449c103660 2024-09-19T09:28:33.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.682+0000 7f4498ff9640 1 -- 172.21.15.52:0/1862755450 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4484009c30 con 0x7f449c103660 2024-09-19T09:28:33.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.682+0000 7f44a39f8740 1 Processor -- start 2024-09-19T09:28:33.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.682+0000 7f44a39f8740 1 -- start start 2024-09-19T09:28:33.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.682+0000 7f4498ff9640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 0x7f44880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.682+0000 7f449b7fe640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 0x7f44880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f4498ff9640 1 -- 172.21.15.52:0/1862755450 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f44840cf500 con 0x7f449c103660 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f43ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 0x55784f44cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55784f3a12f0 con 0x55784f43cb40 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55784f348cf0 con 0x55784f43b5d0 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f44a39f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55784f39d2b0 con 0x55784f44a780 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46892/0 (socket says 172.21.15.52:46892) 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 -- 172.21.15.52:0/3606074789 learned_addr learned my addr 172.21.15.52:0/3606074789 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449b7fe640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 0x55784f44cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449b7fe640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 0x7f44880a5700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4494005fd0 tx=0x7f4494009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f4493fff640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f43ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 -- 172.21.15.52:0/3606074789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 msgr2=0x55784f44cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 0x55784f44cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 -- 172.21.15.52:0/3606074789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 msgr2=0x55784f43ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f43ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 -- 172.21.15.52:0/3606074789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784f32d3a0 con 0x55784f43cb40 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449b7fe640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 0x55784f44cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f4493fff640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f43ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.683+0000 7f449affd640 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f448c009900 tx=0x7f448c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15308e7978f1b302 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44917fa640 1 -- 172.21.15.52:0/3606074789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c040070 con 0x55784f43cb40 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44917fa640 1 -- 172.21.15.52:0/3606074789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f448c0319f0 con 0x55784f43cb40 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44917fa640 1 -- 172.21.15.52:0/3606074789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c035040 con 0x55784f43cb40 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 -- 172.21.15.52:0/3606074789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 msgr2=0x55784f43b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f448c009900 tx=0x7f448c005e80 comp rx=0 tx=0).stop 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 -- 172.21.15.52:0/3606074789 shutdown_connections 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f44a780 0x55784f44cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f43ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3606074789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f43b090 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 -- 172.21.15.52:0/3606074789 >> 172.21.15.52:0/3606074789 conn(0x55784f404310 msgr2=0x55784f437c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.684+0000 7f44a39f8740 1 -- 172.21.15.52:0/3606074789 shutdown_connections 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 -- 172.21.15.52:0/3606074789 wait complete. 2024-09-19T09:28:33.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 -- start start 2024-09-19T09:28:33.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 Processor -- start 2024-09-19T09:28:33.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f4473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f447940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55784f44d420 con 0x55784f43b5d0 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55784f35c060 con 0x55784f44a780 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55784f44d5a0 con 0x55784f43cb40 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f44a39f8740 10 client.0 _ll_register_callbacks cb 0x55784f0af8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f449affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f449affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46908/0 (socket says 172.21.15.52:46908) 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.685+0000 7f449affd640 1 -- 172.21.15.52:0/3676591457 learned_addr learned my addr 172.21.15.52:0/3676591457 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449b7fe640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f447940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f4493fff640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f4473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 -- 172.21.15.52:0/3676591457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 msgr2=0x55784f4473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f4473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 -- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 msgr2=0x55784f447940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f447940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 -- 172.21.15.52:0/3676591457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784f1123c0 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f4493fff640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f4473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f449affd640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f448c02a9a0 tx=0x7f448c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac2f4f27fb6567b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44827fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c04c020 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f448c004950 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c0319f0 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f448c057050 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44a39f8740 10 client.17973 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.686+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55784f458dc0 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f448c0319f0 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f448c044400 con 0x55784f43b5d0 2024-09-19T09:28:33.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 10 client.17973 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 10 client.17973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 20 client.17973 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f45a110 0x55784f45c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 4 client.17973 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55784f3ae860 con 0x55784f45a110 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f4493fff640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f45a110 0x55784f45c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f44827fc640 10 client.17973 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.687+0000 7f4493fff640 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f45a110 0x55784f45c500 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=253901a1ee51084f server_cookie=876d121ff5cff3b5 in_seq=0 out_seq=0 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44827fc640 1 -- 172.21.15.52:0/3676591457 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55784f3ae860 con 0x55784f45a110 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44827fc640 10 client.17973 handle_command_reply: tid=0 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 client.17973 shutdown 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 msgr2=0x55784f44a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f448c02a9a0 tx=0x7f448c005250 comp rx=0 tx=0).stop 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 shutdown_connections 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f45a110 0x55784f45c500 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f447940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f4473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 --2- 172.21.15.52:0/3676591457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43b5d0 0x55784f44a110 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 >> 172.21.15.52:0/3676591457 conn(0x55784f404310 msgr2=0x55784f43d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.688+0000 7f44827fc640 0 client.17973 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.689+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 shutdown_connections 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.689+0000 7f44a39f8740 1 -- 172.21.15.52:0/3676591457 wait complete. 2024-09-19T09:28:33.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.689+0000 7f44a39f8740 20 client.17973 trim_cache size 0 max 16384 2024-09-19T09:28:33.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.701+0000 7f44a39f8740 1 Processor -- start 2024-09-19T09:28:33.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.701+0000 7f44a39f8740 1 -- start start 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43b5d0 0x55784f45f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f444620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1adf30 con 0x55784f43cb40 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1ab800 con 0x55784f44a780 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f44a39f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1a9650 con 0x55784f43b5d0 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46914/0 (socket says 172.21.15.52:46914) 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 -- 172.21.15.52:0/1672100637 learned_addr learned my addr 172.21.15.52:0/1672100637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f449affd640 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43b5d0 0x55784f45f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 -- 172.21.15.52:0/1672100637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43b5d0 msgr2=0x55784f45f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43b5d0 0x55784f45f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f449b7fe640 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f444620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 -- 172.21.15.52:0/1672100637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 msgr2=0x55784f444620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f444620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 -- 172.21.15.52:0/1672100637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55784f436310 con 0x55784f43cb40 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.702+0000 7f4493fff640 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4484005c40 tx=0x7f44840cce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e68bfcae47fac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f4490ff9640 1 -- 172.21.15.52:0/1672100637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4484020040 con 0x55784f43cb40 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f4490ff9640 1 -- 172.21.15.52:0/1672100637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44840981c0 con 0x55784f43cb40 2024-09-19T09:28:33.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f4490ff9640 1 -- 172.21.15.52:0/1672100637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448409afa0 con 0x55784f43cb40 2024-09-19T09:28:33.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 -- 172.21.15.52:0/1672100637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 msgr2=0x55784f45f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4484005c40 tx=0x7f44840cce50 comp rx=0 tx=0).stop 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 -- 172.21.15.52:0/1672100637 shutdown_connections 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f44a780 0x55784f444620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f43cb40 0x55784f45f680 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 --2- 172.21.15.52:0/1672100637 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43b5d0 0x55784f45f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 -- 172.21.15.52:0/1672100637 >> 172.21.15.52:0/1672100637 conn(0x55784f404310 msgr2=0x55784f442720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 -- 172.21.15.52:0/1672100637 shutdown_connections 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.703+0000 7f44a39f8740 1 -- 172.21.15.52:0/1672100637 wait complete. 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 -- start start 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 Processor -- start 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f45f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f45f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1a9cc0 con 0x55784f44a780 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1ab130 con 0x55784f43b5d0 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1aa390 con 0x55784f43cb40 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f44a39f8740 10 client.0 _ll_register_callbacks cb 0x7f448c005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f449b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f449b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46928/0 (socket says 172.21.15.52:46928) 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f449b7fe640 1 -- 172.21.15.52:0/62864081 learned_addr learned my addr 172.21.15.52:0/62864081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f4493fff640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f45f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.704+0000 7f449affd640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f45f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 -- 172.21.15.52:0/62864081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 msgr2=0x55784f45f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f45f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 -- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 msgr2=0x55784f45f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f45f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 -- 172.21.15.52:0/62864081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784f45cec0 con 0x55784f44a780 2024-09-19T09:28:33.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f449b7fe640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4494012c70 tx=0x7f4494004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f7c8bbfd5ba235 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44827fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4494022450 con 0x55784f44a780 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f44940225f0 con 0x55784f44a780 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44840981c0 con 0x55784f44a780 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f44940227f0 con 0x55784f44a780 2024-09-19T09:28:33.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44a39f8740 10 client.17979 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55784f4c4550 con 0x55784f44a780 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.705+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44840981c0 con 0x55784f44a780 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f449400f040 con 0x55784f44a780 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 10 client.17979 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 10 client.17979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 20 client.17979 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f4c4d20 0x55784f4c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 4 client.17979 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55784f3a8d70 con 0x55784f4c4d20 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f449affd640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f4c4d20 0x55784f4c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f44827fc640 10 client.17979 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.706+0000 7f449affd640 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f4c4d20 0x55784f4c7140 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f3af840d42936e server_cookie=c158dc7cdc86c84d in_seq=0 out_seq=0 2024-09-19T09:28:33.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44827fc640 1 -- 172.21.15.52:0/62864081 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55784f3a8d70 con 0x55784f4c4d20 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44827fc640 10 client.17979 handle_command_reply: tid=0 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 client.17979 shutdown 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 msgr2=0x55784f45c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4494012c70 tx=0x7f4494004a40 comp rx=0 tx=0).stop 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 shutdown_connections 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55784f4c4d20 0x55784f4c7140 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55784f44a780 0x55784f45c690 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55784f43cb40 0x55784f45f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 --2- 172.21.15.52:0/62864081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55784f43b5d0 0x55784f45f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 >> 172.21.15.52:0/62864081 conn(0x55784f404310 msgr2=0x55784f445c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44827fc640 0 client.17979 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 shutdown_connections 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 1 -- 172.21.15.52:0/62864081 wait complete. 2024-09-19T09:28:33.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a39f8740 20 client.17979 trim_cache size 0 max 16384 2024-09-19T09:28:33.715 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:28:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 msgr2=0x7f44880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.707+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 0x7f44880a5700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4494005fd0 tx=0x7f4494009600 comp rx=0 tx=0).stop 2024-09-19T09:28:33.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 msgr2=0x7f449c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f448400d740 tx=0x7f448400dc00 comp rx=0 tx=0).stop 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 shutdown_connections 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f449c10c170 0x7f449c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f449c103660 0x7f449c198990 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f44880a3240 0x7f44880a5700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 --2- 172.21.15.52:0/1862755450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f449c102d40 0x7f449c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 >> 172.21.15.52:0/1862755450 conn(0x7f449c0fc7a0 msgr2=0x7f449c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 shutdown_connections 2024-09-19T09:28:33.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:33.708+0000 7f44a161f640 1 -- 172.21.15.52:0/1862755450 wait complete. 2024-09-19T09:28:34.428 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 -- 172.21.15.52:0/3860390898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc102e00 msgr2=0x7f26bc103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/3860390898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc102e00 0x7f26bc103280 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009900 tx=0x7f26b002a410 comp rx=0 tx=0).stop 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 -- 172.21.15.52:0/3860390898 shutdown_connections 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/3860390898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc1037c0 0x7f26bc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/3860390898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc102e00 0x7f26bc103280 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/3860390898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc0ffe30 0x7f26bc100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.427+0000 7f26c1d5b640 1 -- 172.21.15.52:0/3860390898 >> 172.21.15.52:0/3860390898 conn(0x7f26bc0fb970 msgr2=0x7f26bc0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.428+0000 7f26c1d5b640 1 -- 172.21.15.52:0/3860390898 shutdown_connections 2024-09-19T09:28:34.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.428+0000 7f26c1d5b640 1 -- 172.21.15.52:0/3860390898 wait complete. 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.428+0000 7f26c1d5b640 1 Processor -- start 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 -- start start 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc102e00 0x7f26bc100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 0x7f26bc1012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc10d800 con 0x7f26bc0ffe30 2024-09-19T09:28:34.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc10d680 con 0x7f26bc102e00 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26c1d5b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc10d980 con 0x7f26bc1037c0 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46946/0 (socket says 172.21.15.52:46946) 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 -- 172.21.15.52:0/4279562100 learned_addr learned my addr 172.21.15.52:0/4279562100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26baffd640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc102e00 0x7f26bc100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bbfff640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 0x7f26bc1012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 -- 172.21.15.52:0/4279562100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 msgr2=0x7f26bc1012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 0x7f26bc1012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 -- 172.21.15.52:0/4279562100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc102e00 msgr2=0x7f26bc100db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc102e00 0x7f26bc100db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 -- 172.21.15.52:0/4279562100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc101b80 con 0x7f26bc0ffe30 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bbfff640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 0x7f26bc1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:34.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.429+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00e9c0 tx=0x7f26ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.430+0000 7f26b8ff9640 1 -- 172.21.15.52:0/4279562100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00cd80 con 0x7f26bc0ffe30 2024-09-19T09:28:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.430+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc1a1f20 con 0x7f26bc0ffe30 2024-09-19T09:28:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.430+0000 7f26b8ff9640 1 -- 172.21.15.52:0/4279562100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26ac0035f0 con 0x7f26bc0ffe30 2024-09-19T09:28:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.430+0000 7f26b8ff9640 1 -- 172.21.15.52:0/4279562100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac010690 con 0x7f26bc0ffe30 2024-09-19T09:28:34.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.430+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc1a22d0 con 0x7f26bc0ffe30 2024-09-19T09:28:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26b8ff9640 1 -- 172.21.15.52:0/4279562100 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f26ac010830 con 0x7f26bc0ffe30 2024-09-19T09:28:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 Processor -- start 2024-09-19T09:28:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 -- start start 2024-09-19T09:28:34.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e0ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e0fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e12830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bb88d6e2f0 con 0x55bb88e10370 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb88d16270 con 0x55bb88e0a9a0 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.433+0000 7f26c4bce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bb88d6a2b0 con 0x55bb88e0b2e0 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e12830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e0ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e0ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:44358/0 (socket says 172.21.15.52:44358) 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26bb7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e0fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26bbfff640 1 -- 172.21.15.52:0/3067716651 learned_addr learned my addr 172.21.15.52:0/3067716651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 -- 172.21.15.52:0/3067716651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 msgr2=0x55bb88e0fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e0fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 -- 172.21.15.52:0/3067716651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 msgr2=0x55bb88e0ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e0ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 -- 172.21.15.52:0/3067716651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb88d15340 con 0x55bb88e10370 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26b8ff9640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 0x7f26a40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26bbfff640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 0x7f26a40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26baffd640 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e12830 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f26b0005ab0 tx=0x7f26b0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5c16b67e40c09a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26b8ff9640 1 -- 172.21.15.52:0/4279562100 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26ac0cfda0 con 0x7f26bc0ffe30 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26a1ffb640 1 -- 172.21.15.52:0/3067716651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0040070 con 0x55bb88e10370 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26a1ffb640 1 -- 172.21.15.52:0/3067716651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b0031e20 con 0x55bb88e10370 2024-09-19T09:28:34.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.434+0000 7f26a1ffb640 1 -- 172.21.15.52:0/3067716651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0035040 con 0x55bb88e10370 2024-09-19T09:28:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 -- 172.21.15.52:0/3067716651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 msgr2=0x55bb88e12830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26bbfff640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 0x7f26a40a57b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f26b4011550 tx=0x7f26b4007830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e12830 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f26b0005ab0 tx=0x7f26b0005e80 comp rx=0 tx=0).stop 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 -- 172.21.15.52:0/3067716651 shutdown_connections 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e12830 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e0fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3067716651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e0ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 -- 172.21.15.52:0/3067716651 >> 172.21.15.52:0/3067716651 conn(0x55bb88e06010 msgr2=0x55bb88e06410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 -- 172.21.15.52:0/3067716651 shutdown_connections 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.435+0000 7f26c4bce740 1 -- 172.21.15.52:0/3067716651 wait complete. 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 -- start start 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 Processor -- start 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e14b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bb88e132e0 con 0x55bb88e10370 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bb88cf7290 con 0x55bb88e0a9a0 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bb88e13460 con 0x55bb88e0b2e0 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26c4bce740 10 client.0 _ll_register_callbacks cb 0x55bb88d28140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46952/0 (socket says 172.21.15.52:46952) 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26bbfff640 1 -- 172.21.15.52:0/2513124433 learned_addr learned my addr 172.21.15.52:0/2513124433 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.436+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.443 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26baffd640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 -- 172.21.15.52:0/2513124433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 msgr2=0x55bb88e15040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e15040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 -- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 msgr2=0x55bb88e14b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e14b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 -- 172.21.15.52:0/2513124433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb88a81210 con 0x55bb88e10370 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f26b4007800 tx=0x7f26b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7105321b54264aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f269affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b401cdc0 con 0x55bb88e10370 2024-09-19T09:28:34.444 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26b4004b20 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b0031e20 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26b402c030 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26c4bce740 10 client.17991 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bb88b4d620 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.437+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b0031e20 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26b4031450 con 0x55bb88e10370 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 10 client.17991 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 10 client.17991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 20 client.17991 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e207d0 0x55bb88e22c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 4 client.17991 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb88d7ba20 con 0x55bb88e207d0 2024-09-19T09:28:34.445 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e207d0 0x55bb88e22c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.438+0000 7f269affd640 10 client.17991 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.439+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e207d0 0x55bb88e22c20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6c17b691617d420 server_cookie=db24834387bced49 in_seq=0 out_seq=0 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.439+0000 7f269affd640 1 -- 172.21.15.52:0/2513124433 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb88d7ba20 con 0x55bb88e207d0 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.439+0000 7f269affd640 10 client.17991 handle_command_reply: tid=0 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.439+0000 7f26c4bce740 1 client.17991 shutdown 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 msgr2=0x55bb88e1c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f26b4007800 tx=0x7f26b4004a40 comp rx=0 tx=0).stop 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 shutdown_connections 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e207d0 0x55bb88e22c20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1c080 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0b2e0 0x55bb88e15040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f269affd640 0 client.17991 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:34.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2513124433 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0a9a0 0x55bb88e14b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 >> 172.21.15.52:0/2513124433 conn(0x55bb88e06010 msgr2=0x55bb88e07820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 shutdown_connections 2024-09-19T09:28:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 1 -- 172.21.15.52:0/2513124433 wait complete. 2024-09-19T09:28:34.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.440+0000 7f26c4bce740 20 client.17991 trim_cache size 0 max 16384 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.454+0000 7f26c4bce740 1 Processor -- start 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.454+0000 7f26c4bce740 1 -- start start 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e06ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e1c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1adcc0 con 0x55bb88e10370 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1ab590 con 0x55bb88e0b2e0 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26c4bce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1a93e0 con 0x55bb88e0a9a0 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46968/0 (socket says 172.21.15.52:46968) 2024-09-19T09:28:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 -- 172.21.15.52:0/2962546600 learned_addr learned my addr 172.21.15.52:0/2962546600 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e06ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26baffd640 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e1c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 -- 172.21.15.52:0/2962546600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 msgr2=0x55bb88e06ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e06ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 -- 172.21.15.52:0/2962546600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 msgr2=0x55bb88e1c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e1c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 -- 172.21.15.52:0/2962546600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb88e05e30 con 0x55bb88e10370 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26bbfff640 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f26b4007310 tx=0x7f26b4011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62fe3cc4b6c98bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26a17fa640 1 -- 172.21.15.52:0/2962546600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4031430 con 0x55bb88e10370 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26a17fa640 1 -- 172.21.15.52:0/2962546600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b40315d0 con 0x55bb88e10370 2024-09-19T09:28:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.455+0000 7f26a17fa640 1 -- 172.21.15.52:0/2962546600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40052a0 con 0x55bb88e10370 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 -- 172.21.15.52:0/2962546600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 msgr2=0x55bb88e07400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f26b4007310 tx=0x7f26b4011ec0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 -- 172.21.15.52:0/2962546600 shutdown_connections 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e07400 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e1c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 --2- 172.21.15.52:0/2962546600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e06ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.456+0000 7f26c4bce740 1 -- 172.21.15.52:0/2962546600 >> 172.21.15.52:0/2962546600 conn(0x55bb88e06010 msgr2=0x55bb88e14b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- 172.21.15.52:0/2962546600 shutdown_connections 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- 172.21.15.52:0/2962546600 wait complete. 2024-09-19T09:28:34.462 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- start start 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 Processor -- start 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e19520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e19a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1a9a50 con 0x55bb88e10370 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1aaec0 con 0x55bb88e0b2e0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc1aa120 con 0x55bb88e0a9a0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26c4bce740 10 client.0 _ll_register_callbacks cb 0x7f26b4007a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46974/0 (socket says 172.21.15.52:46974) 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.457+0000 7f26bbfff640 1 -- 172.21.15.52:0/3414952774 learned_addr learned my addr 172.21.15.52:0/3414952774 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26baffd640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e19a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e19520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 -- 172.21.15.52:0/3414952774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 msgr2=0x55bb88e19520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e19520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 -- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 msgr2=0x55bb88e19a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e19a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 -- 172.21.15.52:0/3414952774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb88e1b080 con 0x55bb88e10370 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26baffd640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e19a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26bbfff640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f26b4031840 tx=0x7f26b4004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb50c146787cfc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f269affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004e60 con 0x55bb88e10370 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26b4003970 con 0x55bb88e10370 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b40315d0 con 0x55bb88e10370 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26b4049050 con 0x55bb88e10370 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26c4bce740 10 client.17997 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.458+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bb88e1c390 con 0x55bb88e10370 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26b40315d0 con 0x55bb88e10370 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26b4004020 con 0x55bb88e10370 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 10 client.17997 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 10 client.17997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 20 client.17997 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e8bbf0 0x55bb88e8e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 4 client.17997 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb88d75d70 con 0x55bb88e8bbf0 2024-09-19T09:28:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e8bbf0 0x55bb88e8e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f269affd640 10 client.17997 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.459+0000 7f26bb7fe640 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e8bbf0 0x55bb88e8e010 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5dded0c02776764 server_cookie=7a04823413f0046f in_seq=0 out_seq=0 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f269affd640 1 -- 172.21.15.52:0/3414952774 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb88d75d70 con 0x55bb88e8bbf0 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f269affd640 10 client.17997 handle_command_reply: tid=0 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 client.17997 shutdown 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 msgr2=0x55bb88e1aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f26b4031840 tx=0x7f26b4004c70 comp rx=0 tx=0).stop 2024-09-19T09:28:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 shutdown_connections 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bb88e8bbf0 0x55bb88e8e010 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bb88e10370 0x55bb88e1aa70 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f269affd640 0 client.17997 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bb88e0b2e0 0x55bb88e19a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 --2- 172.21.15.52:0/3414952774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bb88e0a9a0 0x55bb88e19520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 >> 172.21.15.52:0/3414952774 conn(0x55bb88e06010 msgr2=0x55bb88e049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 shutdown_connections 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 1 -- 172.21.15.52:0/3414952774 wait complete. 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.469+0000 7f26c4bce740 20 client.17997 trim_cache size 0 max 16384 2024-09-19T09:28:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:28:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:28:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:28:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:28:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 msgr2=0x7f26a40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 0x7f26a40a57b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f26b4011550 tx=0x7f26b4007830 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 msgr2=0x7f26bc102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00e9c0 tx=0x7f26ac00ee80 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 shutdown_connections 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26a40a32f0 0x7f26a40a57b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26bc1037c0 0x7f26bc1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26bc102e00 0x7f26bc100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 --2- 172.21.15.52:0/4279562100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc0ffe30 0x7f26bc102770 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 >> 172.21.15.52:0/4279562100 conn(0x7f26bc0fb970 msgr2=0x7f26bc106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 shutdown_connections 2024-09-19T09:28:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:34.470+0000 7f26c1d5b640 1 -- 172.21.15.52:0/4279562100 wait complete. 2024-09-19T09:28:35.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:35 smithi052 ceph-mon[30947]: pgmap v552: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:28:35.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:35 smithi169 ceph-mon[35454]: pgmap v552: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:28:35.468 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:28:35.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:28:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:35 smithi086 ceph-mon[34813]: pgmap v552: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:28:35.739 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 -- 172.21.15.52:0/3749842154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 msgr2=0x7f3474106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 --2- 172.21.15.52:0/3749842154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f3474106e40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3464009930 tx=0x7f346402a440 comp rx=0 tx=0).stop 2024-09-19T09:28:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 -- 172.21.15.52:0/3749842154 shutdown_connections 2024-09-19T09:28:36.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 --2- 172.21.15.52:0/3749842154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 0x7f347410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 --2- 172.21.15.52:0/3749842154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 0x7f3474100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 --2- 172.21.15.52:0/3749842154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f3474106e40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 -- 172.21.15.52:0/3749842154 >> 172.21.15.52:0/3749842154 conn(0x7f34740fc780 msgr2=0x7f34740feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 -- 172.21.15.52:0/3749842154 shutdown_connections 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.203+0000 7f347a93e640 1 -- 172.21.15.52:0/3749842154 wait complete. 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 Processor -- start 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 -- start start 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 0x7f34740fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 0x7f34740fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3474110e20 con 0x7f3474106a60 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3474110ca0 con 0x7f3474100a60 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f347a93e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3474110fa0 con 0x7f3474101400 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f3478edb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f3478edb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46994/0 (socket says 172.21.15.52:46994) 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f3478edb640 1 -- 172.21.15.52:0/2701187407 learned_addr learned my addr 172.21.15.52:0/2701187407 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f3473fff640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 0x7f34740fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.204+0000 7f34737fe640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 0x7f34740fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 -- 172.21.15.52:0/2701187407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 msgr2=0x7f34740fd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 0x7f34740fd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 -- 172.21.15.52:0/2701187407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 msgr2=0x7f34740fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 0x7f34740fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 -- 172.21.15.52:0/2701187407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34741a6850 con 0x7f3474106a60 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f3478edb640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f346c00cce0 tx=0x7f346c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f34717fa640 1 -- 172.21.15.52:0/2701187407 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c00f450 con 0x7f3474106a60 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f34717fa640 1 -- 172.21.15.52:0/2701187407 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346c00fad0 con 0x7f3474106a60 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f34717fa640 1 -- 172.21.15.52:0/2701187407 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c018c10 con 0x7f3474106a60 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34741a6b40 con 0x7f3474106a60 2024-09-19T09:28:36.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.205+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34741a7030 con 0x7f3474106a60 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.207+0000 7f34717fa640 1 -- 172.21.15.52:0/2701187407 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f346c00f5f0 con 0x7f3474106a60 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 Processor -- start 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 -- start start 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde94b60 0x562adde94f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f34717fa640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 0x7f345c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 0x562addea2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562adddfa280 con 0x562adde9fd40 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562addda1b10 con 0x562adde94b60 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f347cd17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562adddf6240 con 0x562adde95480 2024-09-19T09:28:36.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f3478edb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 0x562addea2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f34737fe640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 0x7f345c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f3473fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f3473fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:53930/0 (socket says 172.21.15.52:53930) 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f3473fff640 1 -- 172.21.15.52:0/1892362518 learned_addr learned my addr 172.21.15.52:0/1892362518 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f34717fa640 1 -- 172.21.15.52:0/2701187407 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f346c0d0070 con 0x7f3474106a60 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.208+0000 7f34737fe640 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde94b60 0x562adde94f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 -- 172.21.15.52:0/1892362518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 msgr2=0x562adde9f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 -- 172.21.15.52:0/1892362518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde94b60 msgr2=0x562adde94f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde94b60 0x562adde94f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 -- 172.21.15.52:0/1892362518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adddae1f0 con 0x562adde9fd40 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3473fff640 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:36.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f34737fe640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 0x7f345c0a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f34740fe7b0 tx=0x7f346800b770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f3478edb640 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 0x562addea2130 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f346c01f000 tx=0x7f346c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc5bd2560f432b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f345a7fc640 1 -- 172.21.15.52:0/1892362518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0b5990 con 0x562adde9fd40 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f345a7fc640 1 -- 172.21.15.52:0/1892362518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346c09ccb0 con 0x562adde9fd40 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.209+0000 7f345a7fc640 1 -- 172.21.15.52:0/1892362518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c0b57b0 con 0x562adde9fd40 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- 172.21.15.52:0/1892362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 msgr2=0x562addea2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 0x562addea2130 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f346c01f000 tx=0x7f346c01baf0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- 172.21.15.52:0/1892362518 shutdown_connections 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde9fd40 0x562addea2130 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde95480 0x562adde9f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 --2- 172.21.15.52:0/1892362518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde94b60 0x562adde94f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- 172.21.15.52:0/1892362518 >> 172.21.15.52:0/1892362518 conn(0x562adde910f0 msgr2=0x562adde914d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- 172.21.15.52:0/1892362518 shutdown_connections 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- 172.21.15.52:0/1892362518 wait complete. 2024-09-19T09:28:36.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 -- start start 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.210+0000 7f347cd17740 1 Processor -- start 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562adde9cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562adde9d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562addea2910 con 0x562adde95480 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562adddb4f10 con 0x562adde9fd40 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562addea2a90 con 0x562adde94b60 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f347cd17740 10 client.0 _ll_register_callbacks cb 0x562addd7da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f34737fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f34737fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47006/0 (socket says 172.21.15.52:47006) 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562adde9cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f34737fe640 1 -- 172.21.15.52:0/1839058617 learned_addr learned my addr 172.21.15.52:0/1839058617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3478edb640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562adde9d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 -- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 msgr2=0x562adde9d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562adde9d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 -- 172.21.15.52:0/1839058617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 msgr2=0x562adde9d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3473fff640 1 -- 172.21.15.52:0/1839058617 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562addb6b6a0 con 0x562adde94b60 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f34737fe640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.211+0000 7f3478edb640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562adde9d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f3473fff640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562adde9cc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x562adde91f50 tx=0x7f3464031990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1fe68fea351592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464035040 con 0x562adde94b60 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f346c09ccb0 con 0x562adde94b60 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3464004240 con 0x562adde94b60 2024-09-19T09:28:36.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f346404b020 con 0x562adde94b60 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 10 client.26863 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562addeae590 con 0x562adde94b60 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f346c09ccb0 con 0x562adde94b60 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f34640466c0 con 0x562adde94b60 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 10 client.26863 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 10 client.26863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 20 client.26863 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addeafd80 0x562addeb2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 4 client.26863 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.212+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562adde077f0 con 0x562addeafd80 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.213+0000 7f34737fe640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addeafd80 0x562addeb2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.213+0000 7f34737fe640 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addeafd80 0x562addeb2200 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa309eb9934989e2 server_cookie=96cf5efdb58fd5a9 in_seq=0 out_seq=0 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.213+0000 7f34537fe640 10 client.26863 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:36.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f34537fe640 1 -- 172.21.15.52:0/1839058617 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562adde077f0 con 0x562addeafd80 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f34537fe640 10 client.26863 handle_command_reply: tid=0 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 client.26863 shutdown 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 msgr2=0x562adde9cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562adde9cc40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x562adde91f50 tx=0x7f3464031990 comp rx=0 tx=0).stop 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 shutdown_connections 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addeafd80 0x562addeb2200 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562adde9d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562adde9d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 --2- 172.21.15.52:0/1839058617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562adde9cc40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f34537fe640 0 client.26863 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 >> 172.21.15.52:0/1839058617 conn(0x562adde910f0 msgr2=0x562adde96e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 shutdown_connections 2024-09-19T09:28:36.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 1 -- 172.21.15.52:0/1839058617 wait complete. 2024-09-19T09:28:36.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.214+0000 7f347cd17740 20 client.26863 trim_cache size 0 max 16384 2024-09-19T09:28:36.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 Processor -- start 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 -- start start 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 0x562addeb8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde9fd40 0x562adde8fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34741b2130 con 0x562adde94b60 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f34741afa00 con 0x562adde95480 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f347cd17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ad850 con 0x562adde9fd40 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47008/0 (socket says 172.21.15.52:47008) 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 -- 172.21.15.52:0/1121370158 learned_addr learned my addr 172.21.15.52:0/1121370158 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 -- 172.21.15.52:0/1121370158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde9fd40 msgr2=0x562adde8fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde9fd40 0x562adde8fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f34737fe640 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 0x562addeb8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 -- 172.21.15.52:0/1121370158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 msgr2=0x562addeb8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 0x562addeb8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f3473fff640 1 -- 172.21.15.52:0/1121370158 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562adde91d80 con 0x562adde94b60 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.232+0000 7f34737fe640 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 0x562addeb8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f3473fff640 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f346402a960 tx=0x7f3464000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5a08d17a8b255c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f3459ffb640 1 -- 172.21.15.52:0/1121370158 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464035070 con 0x562adde94b60 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f3459ffb640 1 -- 172.21.15.52:0/1121370158 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3464057030 con 0x562adde94b60 2024-09-19T09:28:36.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f3459ffb640 1 -- 172.21.15.52:0/1121370158 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34640035f0 con 0x562adde94b60 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 -- 172.21.15.52:0/1121370158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 msgr2=0x562addeb7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f346402a960 tx=0x7f3464000bc0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 -- 172.21.15.52:0/1121370158 shutdown_connections 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde9fd40 0x562adde8fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde95480 0x562addeb8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 --2- 172.21.15.52:0/1121370158 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde94b60 0x562addeb7b10 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.233+0000 7f347cd17740 1 -- 172.21.15.52:0/1121370158 >> 172.21.15.52:0/1121370158 conn(0x562adde910f0 msgr2=0x562adde9b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- 172.21.15.52:0/1121370158 shutdown_connections 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- 172.21.15.52:0/1121370158 wait complete. 2024-09-19T09:28:36.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- start start 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 Processor -- start 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562addea8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562addea39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34741adec0 con 0x562adde95480 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f34741af330 con 0x562adde9fd40 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f34741ae590 con 0x562adde94b60 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f347cd17740 10 client.0 _ll_register_callbacks cb 0x7f3464009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.234+0000 7f34737fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47014/0 (socket says 172.21.15.52:47014) 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 -- 172.21.15.52:0/2103314421 learned_addr learned my addr 172.21.15.52:0/2103314421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:36.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f3473fff640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562addea8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f3478edb640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562addea39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 -- 172.21.15.52:0/2103314421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 msgr2=0x562addea8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562addea8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 -- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 msgr2=0x562addea39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562addea39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 -- 172.21.15.52:0/2103314421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562addea3ee0 con 0x562adde95480 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f3478edb640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562addea39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34737fe640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f3468012d70 tx=0x7f3468018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34de22f07417e48c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34537fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:36.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468004050 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f34680041f0 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3464057030 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.235+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f34680043f0 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 10 client.18015 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562addf1a7b0 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3464057030 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3468003980 con 0x562adde95480 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 10 client.18015 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 20 client.18015 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addf1af10 0x562addf1d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 4 client.18015 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:28:36.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562adde01d00 con 0x562addf1af10 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.236+0000 7f3473fff640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addf1af10 0x562addf1d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.237+0000 7f3473fff640 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addf1af10 0x562addf1d330 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d0968381528c94 server_cookie=15a2f9a726dcf71e in_seq=0 out_seq=0 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.237+0000 7f34537fe640 10 client.18015 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.237+0000 7f34537fe640 1 -- 172.21.15.52:0/2103314421 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562adde01d00 con 0x562addf1af10 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.237+0000 7f34537fe640 10 client.18015 handle_command_reply: tid=0 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.237+0000 7f347cd17740 1 client.18015 shutdown 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 msgr2=0x562addea3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f3468012d70 tx=0x7f3468018000 comp rx=0 tx=0).stop 2024-09-19T09:28:36.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 shutdown_connections 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562addf1af10 0x562addf1d330 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562adde9fd40 0x562addea39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f34537fe640 0 client.18015 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562adde95480 0x562addea3460 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 --2- 172.21.15.52:0/2103314421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562adde94b60 0x562addea8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 >> 172.21.15.52:0/2103314421 conn(0x562adde910f0 msgr2=0x562adde96dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 shutdown_connections 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 1 -- 172.21.15.52:0/2103314421 wait complete. 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.238+0000 7f347cd17740 20 client.18015 trim_cache size 0 max 16384 2024-09-19T09:28:36.244 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:36.245 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:28:36.245 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "01a2be0a-8f96-4758-8b46-241de3c9956c", 2024-09-19T09:28:36.245 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:28:36.245 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 msgr2=0x7f345c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 0x7f345c0a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f34740fe7b0 tx=0x7f346800b770 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 msgr2=0x7f34740fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f346c00cce0 tx=0x7f346c00a620 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 shutdown_connections 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3474106a60 0x7f34740fd7a0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f345c0a3240 0x7f345c0a5700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3474101400 0x7f34740fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 --2- 172.21.15.52:0/2701187407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3474100a60 0x7f34740fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 >> 172.21.15.52:0/2701187407 conn(0x7f34740fc780 msgr2=0x7f347406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 shutdown_connections 2024-09-19T09:28:36.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:36.239+0000 7f347a93e640 1 -- 172.21.15.52:0/2701187407 wait complete. 2024-09-19T09:28:36.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:28:37.203 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:37 smithi052 ceph-mon[30947]: pgmap v553: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:28:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:37 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:28:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:37 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:37 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:28:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:37 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:37 smithi169 ceph-mon[35454]: pgmap v553: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:28:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:37 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:28:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:37 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:37 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:28:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:37 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:37 smithi086 ceph-mon[34813]: pgmap v553: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-19T09:28:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:37 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:28:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:37 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:37 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:28:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:37 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:28:37.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 -- 172.21.15.52:0/4122920516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d8102d30 msgr2=0x7fd4d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/4122920516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d8102d30 0x7fd4d8103110 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009930 tx=0x7fd4d402a420 comp rx=0 tx=0).stop 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 -- 172.21.15.52:0/4122920516 shutdown_connections 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/4122920516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 0x7fd4d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/4122920516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81036e0 0x7fd4d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/4122920516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d8102d30 0x7fd4d8103110 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 -- 172.21.15.52:0/4122920516 >> 172.21.15.52:0/4122920516 conn(0x7fd4d80fc7d0 msgr2=0x7fd4d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 -- 172.21.15.52:0/4122920516 shutdown_connections 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.691+0000 7fd4dfa45640 1 -- 172.21.15.52:0/4122920516 wait complete. 2024-09-19T09:28:37.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 Processor -- start 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 -- start start 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 0x7fd4d81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 0x7fd4d819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81120f0 con 0x7fd4d81036e0 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8111f70 con 0x7fd4d8102d30 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dfa45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8112270 con 0x7fd4d81082a0 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47036/0 (socket says 172.21.15.52:47036) 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/3409034497 learned_addr learned my addr 172.21.15.52:0/3409034497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 0x7fd4d81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 0x7fd4d819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/3409034497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 msgr2=0x7fd4d819cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 0x7fd4d819cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/3409034497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 msgr2=0x7fd4d81985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 0x7fd4d81985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/3409034497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d819d580 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.692+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 0x7fd4d81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800e9f0 tx=0x7fd4c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4ce7fc640 1 -- 172.21.15.52:0/3409034497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800ccc0 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d819d870 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4ce7fc640 1 -- 172.21.15.52:0/3409034497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4c8010910 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4ce7fc640 1 -- 172.21.15.52:0/3409034497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8018920 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.693+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d81a5150 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.695+0000 7fd4ce7fc640 1 -- 172.21.15.52:0/3409034497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd4c8010ac0 con 0x7fd4d81036e0 2024-09-19T09:28:37.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 Processor -- start 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 -- start start 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562baceb0ca0 0x562bacebf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bacebfa90 0x562bacec1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bace162e0 con 0x562baceb0380 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bacdbdce0 con 0x562baceb0ca0 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562bace122a0 con 0x562bacebfa90 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ce7fc640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 0x7fd4c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ddfe2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ddfe2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47050/0 (socket says 172.21.15.52:47050) 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ddfe2640 1 -- 172.21.15.52:0/3884899925 learned_addr learned my addr 172.21.15.52:0/3884899925 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562baceb0ca0 0x562bacebf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ce7fc640 1 -- 172.21.15.52:0/3409034497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd4c80cfd80 con 0x7fd4d81036e0 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 0x7fd4c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.696+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bacebfa90 0x562bacec1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 -- 172.21.15.52:0/3884899925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bacebfa90 msgr2=0x562bacec1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bacebfa90 0x562bacec1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 -- 172.21.15.52:0/3884899925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562baceb0ca0 msgr2=0x562bacebf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562baceb0ca0 0x562bacebf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 -- 172.21.15.52:0/3884899925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bacda2440 con 0x562baceb0380 2024-09-19T09:28:37.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0012810 tx=0x7fd4d0012cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c65c95c2ba4bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4c37fe640 1 -- 172.21.15.52:0/3884899925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0003d40 con 0x562baceb0380 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4c37fe640 1 -- 172.21.15.52:0/3884899925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d0012030 con 0x562baceb0380 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.697+0000 7fd4c37fe640 1 -- 172.21.15.52:0/3884899925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001c3f0 con 0x562baceb0380 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/3884899925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 msgr2=0x562baceb0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 0x7fd4c40a5700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001f000 tx=0x7fd4d001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0012810 tx=0x7fd4d0012cd0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/3884899925 shutdown_connections 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bacebfa90 0x562bacec1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562baceb0ca0 0x562bacebf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/3884899925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562baceb0760 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/3884899925 >> 172.21.15.52:0/3884899925 conn(0x562baceaca30 msgr2=0x562baceace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/3884899925 shutdown_connections 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/3884899925 wait complete. 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 -- start start 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.698+0000 7fd4e1e1e740 1 Processor -- start 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0ca0 0x562bacebc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562bacebcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bacec2660 con 0x562baceb0380 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bacdd1050 con 0x562bacebfa90 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562bacec27e0 con 0x562baceb0ca0 2024-09-19T09:28:37.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 10 client.0 _ll_register_callbacks cb 0x562bace11160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "01a2be0a-8f96-4758-8b46-241de3c9956c": { 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "01a2be0a-8f96-4758-8b46-241de3c9956c", 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:37.751 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47064/0 (socket says 172.21.15.52:47064) 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 -- 172.21.15.52:0/1146594038 learned_addr learned my addr 172.21.15.52:0/1146594038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562bacebcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0ca0 0x562bacebc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 -- 172.21.15.52:0/1146594038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0ca0 msgr2=0x562bacebc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0ca0 0x562bacebc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 -- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 msgr2=0x562bacebcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562bacebcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 -- 172.21.15.52:0/1146594038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bacb873c0 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402aa10 tx=0x7fd4d4005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb36c80da63b20c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4035040 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd4d40048c0 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.699+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d0012030 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd4d404a020 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 10 client.18027 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562bacece070 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d0012030 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd4d4003cb0 con 0x562baceb0380 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 10 client.18027 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:37.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 20 client.18027 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacecf480 0x562baced1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 4 client.18027 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bace23850 con 0x562bacecf480 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.700+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacecf480 0x562baced1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.701+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacecf480 0x562baced1870 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6ab8be3d6352ce server_cookie=cfcfff9201eafbdb in_seq=0 out_seq=0 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.701+0000 7fd4c0ff9640 10 client.18027 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.701+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1146594038 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562bace23850 con 0x562bacecf480 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.701+0000 7fd4c0ff9640 10 client.18027 handle_command_reply: tid=0 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 client.18027 shutdown 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 msgr2=0x562bacebf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402aa10 tx=0x7fd4d4005250 comp rx=0 tx=0).stop 2024-09-19T09:28:37.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 shutdown_connections 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacecf480 0x562baced1870 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562bacebcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0ca0 0x562bacebc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4c0ff9640 0 client.18027 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1146594038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0380 0x562bacebf400 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 >> 172.21.15.52:0/1146594038 conn(0x562baceaca30 msgr2=0x562baceb2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 shutdown_connections 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1146594038 wait complete. 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.702+0000 7fd4e1e1e740 20 client.18027 trim_cache size 0 max 16384 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 Processor -- start 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 -- start start 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562bacecb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baced7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81adf30 con 0x562baceb0ca0 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ab800 con 0x562bacebfa90 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81a9650 con 0x562baceb0380 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47076/0 (socket says 172.21.15.52:47076) 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/2000208499 learned_addr learned my addr 172.21.15.52:0/2000208499 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baced7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.719+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562bacecb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/2000208499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 msgr2=0x562bacecb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562bacecb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/2000208499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 msgr2=0x562baced7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baced7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/2000208499 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bacebb660 con 0x562baceb0ca0 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cd850 tx=0x7fd4c80cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1ec2423c4c904c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4c2ffd640 1 -- 172.21.15.52:0/2000208499 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80b4070 con 0x562baceb0ca0 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4c2ffd640 1 -- 172.21.15.52:0/2000208499 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4c809a3c0 con 0x562baceb0ca0 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.720+0000 7fd4c2ffd640 1 -- 172.21.15.52:0/2000208499 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c809b9d0 con 0x562baceb0ca0 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/2000208499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 msgr2=0x562bacebaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cd850 tx=0x7fd4c80cf040 comp rx=0 tx=0).stop 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/2000208499 shutdown_connections 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baced7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562bacebaf80 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/2000208499 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562bacecb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/2000208499 >> 172.21.15.52:0/2000208499 conn(0x562baceaca30 msgr2=0x562baceb7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/2000208499 shutdown_connections 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/2000208499 wait complete. 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- start start 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 Processor -- start 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562baceb9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baceba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81a9cc0 con 0x562baceb0ca0 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ab130 con 0x562bacebfa90 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81aa390 con 0x562baceb0380 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.721+0000 7fd4e1e1e740 10 client.0 _ll_register_callbacks cb 0x7fd4d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:37.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47090/0 (socket says 172.21.15.52:47090) 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/1167567315 learned_addr learned my addr 172.21.15.52:0/1167567315 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baceba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562baceb9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/1167567315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 msgr2=0x562baceb9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562baceb9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 msgr2=0x562baceba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baceba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 -- 172.21.15.52:0/1167567315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bacf392f0 con 0x562baceb0ca0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4ddfe2640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baceba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4dcfe0640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8098780 tx=0x7fd4c80985c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d73775b998dd46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:37.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80b4070 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd4c8098990 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4c809a3c0 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd4c809c320 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4e1e1e740 10 client.18033 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562bacf3a580 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.722+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4c809a3c0 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c80bc0b0 con 0x562baceb0ca0 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 10 client.18033 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 20 client.18033 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacf3ad50 0x562bacf3d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:37.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 4 client.18033 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562bace1dd60 con 0x562bacf3ad50 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacf3ad50 0x562bacf3d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4dd7e1640 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacf3ad50 0x562bacf3d170 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ed4971652c5e9ef server_cookie=adf2f3001a95fd9e in_seq=0 out_seq=0 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4c0ff9640 10 client.18033 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4c0ff9640 1 -- 172.21.15.52:0/1167567315 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562bace1dd60 con 0x562bacf3ad50 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.723+0000 7fd4c0ff9640 10 client.18033 handle_command_reply: tid=0 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 client.18033 shutdown 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 msgr2=0x562baceb9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8098780 tx=0x7fd4c80985c0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 shutdown_connections 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bacf3ad50 0x562bacf3d170 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bacebfa90 0x562baceba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562baceb0ca0 0x562baceb9da0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4c0ff9640 0 client.18033 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 --2- 172.21.15.52:0/1167567315 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562baceb0380 0x562baceb9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 >> 172.21.15.52:0/1167567315 conn(0x562baceaca30 msgr2=0x562baceb7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 shutdown_connections 2024-09-19T09:28:37.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 1 -- 172.21.15.52:0/1167567315 wait complete. 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4e1e1e740 20 client.18033 trim_cache size 0 max 16384 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 msgr2=0x7fd4c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 0x7fd4c40a5700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd4d001f000 tx=0x7fd4d001e000 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 msgr2=0x7fd4d8198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.724+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800e9f0 tx=0x7fd4c800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 shutdown_connections 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4c40a3240 0x7fd4c40a5700 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4d81082a0 0x7fd4d819cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4d81036e0 0x7fd4d8198b10 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 --2- 172.21.15.52:0/3409034497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d8102d30 0x7fd4d81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 >> 172.21.15.52:0/3409034497 conn(0x7fd4d80fc7d0 msgr2=0x7fd4d8106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 shutdown_connections 2024-09-19T09:28:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:37.725+0000 7fd4dfa45640 1 -- 172.21.15.52:0/3409034497 wait complete. 2024-09-19T09:28:38.522 INFO:tasks.cephfs.filesystem:scrub status for tag:01a2be0a-8f96-4758-8b46-241de3c9956c - {'path': '/', 'tag': '01a2be0a-8f96-4758-8b46-241de3c9956c', 'options': 'recursive,force'} 2024-09-19T09:28:38.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:28:39.193 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:39.314 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:39 smithi052 ceph-mon[30947]: pgmap v554: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:28:39.314 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:39 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:28:39.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:39 smithi169 ceph-mon[35454]: pgmap v554: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:28:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:39 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:28:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:39 smithi086 ceph-mon[34813]: pgmap v554: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:28:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:39 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:28:39.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 -- 172.21.15.52:0/963767934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8101420 msgr2=0x7ffba810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/963767934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8101420 0x7ffba810d950 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009930 tx=0x7ffba002a420 comp rx=0 tx=0).stop 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 -- 172.21.15.52:0/963767934 shutdown_connections 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/963767934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8101420 0x7ffba810d950 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/963767934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8100a80 0x7ffba8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/963767934 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8106a80 0x7ffba8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 -- 172.21.15.52:0/963767934 >> 172.21.15.52:0/963767934 conn(0x7ffba80fc7a0 msgr2=0x7ffba80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 -- 172.21.15.52:0/963767934 shutdown_connections 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 -- 172.21.15.52:0/963767934 wait complete. 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.692+0000 7ffbad9c5640 1 Processor -- start 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 -- start start 2024-09-19T09:28:39.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 0x7ffba8197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8106a80 0x7ffba819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8110ea0 con 0x7ffba8100a80 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8110d20 con 0x7ffba8106a80 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffbad9c5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffba8111020 con 0x7ffba8101420 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39858/0 (socket says 172.21.15.52:39858) 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 -- 172.21.15.52:0/1054121600 learned_addr learned my addr 172.21.15.52:0/1054121600 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba77fe640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8106a80 0x7ffba819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba67fc640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 0x7ffba8197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 -- 172.21.15.52:0/1054121600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 msgr2=0x7ffba8197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 0x7ffba8197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 -- 172.21.15.52:0/1054121600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8106a80 msgr2=0x7ffba819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8106a80 0x7ffba819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba6ffd640 1 -- 172.21.15.52:0/1054121600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba819c270 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.693+0000 7ffba67fc640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 0x7ffba8197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffba6ffd640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800ba50 tx=0x7ffb9800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb98019070 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb9800cbe0 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba819c560 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb980076e0 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.694+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba81a3e40 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.695+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba8100ee0 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.696+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffb9801c070 con 0x7ffba8100a80 2024-09-19T09:28:39.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.697+0000 7ffbac9c3640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 0x7ffb900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.697+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffb980cf5b0 con 0x7ffba8100a80 2024-09-19T09:28:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.697+0000 7ffba67fc640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 0x7ffb900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.697+0000 7ffba67fc640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 0x7ffb900a5700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffba80fec80 tx=0x7ffb9c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:39.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.700+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb9809c1f0 con 0x7ffba8100a80 2024-09-19T09:28:39.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.916+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffba8198620 con 0x7ffba8100a80 2024-09-19T09:28:39.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.917+0000 7ffbac9c3640 1 -- 172.21.15.52:0/1054121600 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ffba8198620 con 0x7ffba8100a80 2024-09-19T09:28:39.918 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:28:39.918 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:28:39.919 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.919+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 msgr2=0x7ffb900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.919+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 0x7ffb900a5700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ffba80fec80 tx=0x7ffb9c005d90 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.919+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 msgr2=0x7ffba81972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.919+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ffb9800ba50 tx=0x7ffb9800bf10 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 shutdown_connections 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffba8106a80 0x7ffba819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffb900a3240 0x7ffb900a5700 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffba8101420 0x7ffba8197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 --2- 172.21.15.52:0/1054121600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba8100a80 0x7ffba81972c0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 >> 172.21.15.52:0/1054121600 conn(0x7ffba80fc7a0 msgr2=0x7ffba80fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 shutdown_connections 2024-09-19T09:28:39.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:39.920+0000 7ffbad9c5640 1 -- 172.21.15.52:0/1054121600 wait complete. 2024-09-19T09:28:40.179 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:40 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1054121600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:40.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:40 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1054121600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:40.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:40 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1054121600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:40.546 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 8a0a447 --release --await' 2024-09-19T09:28:40.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 8a0a447 --release --await 2024-09-19T09:28:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:41.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:41 smithi052 ceph-mon[30947]: pgmap v555: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:28:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 -- 172.21.15.52:0/2241430309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 msgr2=0x7fa748100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/2241430309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa748100090 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa744009ca0 tx=0x7fa74402a8b0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 -- 172.21.15.52:0/2241430309 shutdown_connections 2024-09-19T09:28:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/2241430309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 0x7fa748110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/2241430309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa748102fc0 0x7fa7481005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/2241430309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa748100090 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 -- 172.21.15.52:0/2241430309 >> 172.21.15.52:0/2241430309 conn(0x7fa748077210 msgr2=0x7fa7480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 -- 172.21.15.52:0/2241430309 shutdown_connections 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 -- 172.21.15.52:0/2241430309 wait complete. 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.315+0000 7fa74f3c3640 1 Processor -- start 2024-09-19T09:28:41.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 -- start start 2024-09-19T09:28:41.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 0x7fa74819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 0x7fa74819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481141e0 con 0x7fa748102b50 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa748114060 con 0x7fa74810e810 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74f3c3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa748114360 con 0x7fa74819ef50 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39866/0 (socket says 172.21.15.52:39866) 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 -- 172.21.15.52:0/640910581 learned_addr learned my addr 172.21.15.52:0/640910581 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74c95e640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 0x7fa74819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d960640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 0x7fa74819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 -- 172.21.15.52:0/640910581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 msgr2=0x7fa74819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 0x7fa74819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 -- 172.21.15.52:0/640910581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 msgr2=0x7fa74819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 0x7fa74819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d15f640 1 -- 172.21.15.52:0/640910581 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74819fa10 con 0x7fa748102b50 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.316+0000 7fa74d960640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 0x7fa74819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa74d15f640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa74402add0 tx=0x7fa744030ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa73e7fc640 1 -- 172.21.15.52:0/640910581 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744004040 con 0x7fa748102b50 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa73e7fc640 1 -- 172.21.15.52:0/640910581 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa744040070 con 0x7fa748102b50 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74819fca0 con 0x7fa748102b50 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa73e7fc640 1 -- 172.21.15.52:0/640910581 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744045cb0 con 0x7fa748102b50 2024-09-19T09:28:41.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.317+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7481a74e0 con 0x7fa748102b50 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.319+0000 7fa73e7fc640 1 -- 172.21.15.52:0/640910581 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa744045470 con 0x7fa748102b50 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 Processor -- start 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 -- start start 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63980 0x55d48bf6dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf70630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d48bec8620 con 0x55d48bf63060 2024-09-19T09:28:41.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d48be6fe50 con 0x55d48bf6e240 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa75179c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d48bec45e0 con 0x55d48bf63980 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa73e7fc640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 0x7fa7340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa74d960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa74d960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39880/0 (socket says 172.21.15.52:39880) 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa74d960640 1 -- 172.21.15.52:0/3444808019 learned_addr learned my addr 172.21.15.52:0/3444808019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.320+0000 7fa74d15f640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63980 0x55d48bf6dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 0x7fa7340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf70630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa73e7fc640 1 -- 172.21.15.52:0/640910581 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa7440f0d10 con 0x7fa748102b50 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 -- 172.21.15.52:0/3444808019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63980 msgr2=0x55d48bf6dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63980 0x55d48bf6dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 -- 172.21.15.52:0/3444808019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 msgr2=0x55d48bf70630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf70630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 -- 172.21.15.52:0/3444808019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48be60d40 con 0x55d48bf63060 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf70630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa740014cf0 tx=0x7fa7400117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3ce30651c651ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa74d960640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 0x7fa7340a5780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa740011cb0 tx=0x7fa740016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa7337fe640 1 -- 172.21.15.52:0/3444808019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740009b40 con 0x55d48bf63060 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa7337fe640 1 -- 172.21.15.52:0/3444808019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74000ca60 con 0x55d48bf63060 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.321+0000 7fa7337fe640 1 -- 172.21.15.52:0/3444808019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7400047a0 con 0x55d48bf63060 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- 172.21.15.52:0/3444808019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 msgr2=0x55d48bf63440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa740014cf0 tx=0x7fa7400117b0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- 172.21.15.52:0/3444808019 shutdown_connections 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf70630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63980 0x55d48bf6dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 --2- 172.21.15.52:0/3444808019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63060 0x55d48bf63440 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- 172.21.15.52:0/3444808019 >> 172.21.15.52:0/3444808019 conn(0x55d48bf5f5f0 msgr2=0x55d48bf5f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- 172.21.15.52:0/3444808019 shutdown_connections 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- 172.21.15.52:0/3444808019 wait complete. 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.322+0000 7fa75179c740 1 -- start start 2024-09-19T09:28:41.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 Processor -- start 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63060 0x55d48bf6b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf6e240 0x55d48bf6bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d48bf70e10 con 0x55d48bf63980 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d48be50f10 con 0x55d48bf63060 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d48bf70f90 con 0x55d48bf6e240 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa75179c740 10 client.0 _ll_register_callbacks cb 0x55d48be74db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39896/0 (socket says 172.21.15.52:39896) 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 -- 172.21.15.52:0/3224047097 learned_addr learned my addr 172.21.15.52:0/3224047097 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74d960640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf6e240 0x55d48bf6bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74d15f640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63060 0x55d48bf6b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 -- 172.21.15.52:0/3224047097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf6e240 msgr2=0x55d48bf6bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf6e240 0x55d48bf6bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 -- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63060 msgr2=0x55d48bf6b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63060 0x55d48bf6b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.323+0000 7fa74c95e640 1 -- 172.21.15.52:0/3224047097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48bbd7580 con 0x55d48bf63980 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa738012750 tx=0x7fa738012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e4a275553b26a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738010dc0 con 0x55d48bf63980 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa738004020 con 0x55d48bf63980 2024-09-19T09:28:41.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa74000ca60 con 0x55d48bf63980 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa738004220 con 0x55d48bf63980 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa75179c740 10 client.18051 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d48bca1960 con 0x55d48bf63980 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74000ca60 con 0x55d48bf63980 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.324+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa73801a5f0 con 0x55d48bf63980 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 10 client.18051 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 10 client.18051 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 20 client.18051 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bf7de90 0x55d48bf80330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 4 client.18051 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d48bed5b90 con 0x55d48bf7de90 2024-09-19T09:28:41.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa74d15f640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bf7de90 0x55d48bf80330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa74d15f640 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bf7de90 0x55d48bf80330 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa2e59a8e94cb22 server_cookie=298280e3c7ae5a23 in_seq=0 out_seq=0 2024-09-19T09:28:41.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.325+0000 7fa730ff9640 10 client.18051 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.326+0000 7fa730ff9640 1 -- 172.21.15.52:0/3224047097 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d48bed5b90 con 0x55d48bf7de90 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.326+0000 7fa730ff9640 10 client.18051 handle_command_reply: tid=0 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.326+0000 7fa75179c740 1 client.18051 shutdown 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.326+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 msgr2=0x55d48bf6b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.326+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa738012750 tx=0x7fa738012c10 comp rx=0 tx=0).stop 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 shutdown_connections 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bf7de90 0x55d48bf80330 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf6e240 0x55d48bf6bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf6b6e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 --2- 172.21.15.52:0/3224047097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63060 0x55d48bf6b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 >> 172.21.15.52:0/3224047097 conn(0x55d48bf5f5f0 msgr2=0x55d48bf652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa730ff9640 0 client.18051 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 shutdown_connections 2024-09-19T09:28:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 1 -- 172.21.15.52:0/3224047097 wait complete. 2024-09-19T09:28:41.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.327+0000 7fa75179c740 20 client.18051 trim_cache size 0 max 16384 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 Processor -- start 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 -- start start 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf5f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf85c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481b2210 con 0x55d48bf63980 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481afae0 con 0x55d48bf6e240 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa75179c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481ad930 con 0x55d48bf63060 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39908/0 (socket says 172.21.15.52:39908) 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 -- 172.21.15.52:0/3030016516 learned_addr learned my addr 172.21.15.52:0/3030016516 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:41.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74d15f640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf5f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 -- 172.21.15.52:0/3030016516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 msgr2=0x55d48bf5f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf5f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74d960640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf85c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 -- 172.21.15.52:0/3030016516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 msgr2=0x55d48bf85c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.344+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf85c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa74c95e640 1 -- 172.21.15.52:0/3030016516 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48bf6d0e0 con 0x55d48bf63980 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa74d960640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf85c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa74c95e640 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa73801aa30 tx=0x7fa7380045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75911f573f6217 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa732ffd640 1 -- 172.21.15.52:0/3030016516 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738031070 con 0x55d48bf63980 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa732ffd640 1 -- 172.21.15.52:0/3030016516 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa738010dc0 con 0x55d48bf63980 2024-09-19T09:28:41.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.345+0000 7fa732ffd640 1 -- 172.21.15.52:0/3030016516 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7380048c0 con 0x55d48bf63980 2024-09-19T09:28:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- 172.21.15.52:0/3030016516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 msgr2=0x55d48bf651c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fa73801aa30 tx=0x7fa7380045d0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- 172.21.15.52:0/3030016516 shutdown_connections 2024-09-19T09:28:41.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf6e240 0x55d48bf85c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf63980 0x55d48bf651c0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 --2- 172.21.15.52:0/3030016516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf5f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- 172.21.15.52:0/3030016516 >> 172.21.15.52:0/3030016516 conn(0x55d48bf5f5f0 msgr2=0x55d48bf64ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- 172.21.15.52:0/3030016516 shutdown_connections 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- 172.21.15.52:0/3030016516 wait complete. 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 -- start start 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.346+0000 7fa75179c740 1 Processor -- start 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf763c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 0x55d48bf76900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481adfa0 con 0x55d48bf6e240 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481af410 con 0x55d48bf63980 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7481ae670 con 0x55d48bf63060 2024-09-19T09:28:41.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa75179c740 10 client.0 _ll_register_callbacks cb 0x7fa73800ad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39910/0 (socket says 172.21.15.52:39910) 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 -- 172.21.15.52:0/1157954962 learned_addr learned my addr 172.21.15.52:0/1157954962 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d15f640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf763c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74c95e640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 0x55d48bf76900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 -- 172.21.15.52:0/1157954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 msgr2=0x55d48bf763c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf763c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 -- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 msgr2=0x55d48bf76900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 0x55d48bf76900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 -- 172.21.15.52:0/1157954962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48bf73a00 con 0x55d48bf6e240 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74c95e640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 0x55d48bf76900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:41.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa74d960640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa740014cc0 tx=0x7fa740014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f801b4b093321a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa730ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.347+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740009b10 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa740009cb0 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa738010dc0 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa740013460 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 10 client.18057 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d48bfe9710 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa738010dc0 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa74002e070 con 0x55d48bf6e240 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 10 client.18057 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 10 client.18057 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 20 client.18057 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bfe9cc0 0x55d48bfec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:41.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 4 client.18057 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8a0a447", "release": true, "await": true}] 2024-09-19T09:28:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8a0a447", "release": true, "await": true}) -- 0x55d48bed00a0 con 0x55d48bfe9cc0 2024-09-19T09:28:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.348+0000 7fa74d15f640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bfe9cc0 0x55d48bfec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.349+0000 7fa74d15f640 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bfe9cc0 0x55d48bfec0e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2406e76df29455f server_cookie=d0edb8f78a6184d7 in_seq=0 out_seq=0 2024-09-19T09:28:41.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.349+0000 7fa730ff9640 10 client.18057 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa730ff9640 1 -- 172.21.15.52:0/1157954962 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d48bed00a0 con 0x55d48bfe9cc0 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa730ff9640 10 client.18057 handle_command_reply: tid=0 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 client.18057 shutdown 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 msgr2=0x55d48bf731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa740014cc0 tx=0x7fa740014640 comp rx=0 tx=0).stop 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 shutdown_connections 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d48bfe9cc0 0x55d48bfec0e0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d48bf6e240 0x55d48bf731d0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d48bf63980 0x55d48bf76900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 --2- 172.21.15.52:0/1157954962 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d48bf63060 0x55d48bf763c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 >> 172.21.15.52:0/1157954962 conn(0x55d48bf5f5f0 msgr2=0x55d48bf652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa730ff9640 0 client.18057 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 shutdown_connections 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.351+0000 7fa75179c740 1 -- 172.21.15.52:0/1157954962 wait complete. 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa75179c740 20 client.18057 trim_cache size 0 max 16384 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:28:41.356 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 28, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "8a0a447": { 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 28, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 145.8, 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:28:41.357 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:41.358 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 msgr2=0x7fa7340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 0x7fa7340a5780 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa740011cb0 tx=0x7fa740016000 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 msgr2=0x7fa74819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fa74402add0 tx=0x7fa744030ed0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 shutdown_connections 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7340a32c0 0x7fa7340a5780 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa74819ef50 0x7fa74819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa74810e810 0x7fa74819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 --2- 172.21.15.52:0/640910581 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa748102b50 0x7fa74819a680 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:41.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 >> 172.21.15.52:0/640910581 conn(0x7fa748077210 msgr2=0x7fa74810fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 shutdown_connections 2024-09-19T09:28:41.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:41.352+0000 7fa74f3c3640 1 -- 172.21.15.52:0/640910581 wait complete. 2024-09-19T09:28:41.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:41 smithi169 ceph-mon[35454]: pgmap v555: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:28:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:41 smithi086 ceph-mon[34813]: pgmap v555: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-19T09:28:42.114 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8a0a447', total seconds elapsed: 28.9 2024-09-19T09:28:42.114 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:28:42.114 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:28:42.378 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 -- 172.21.15.52:0/306673477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 msgr2=0x7f0f0010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 --2- 172.21.15.52:0/306673477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0010e610 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009ca0 tx=0x7f0ef802a950 comp rx=0 tx=0).stop 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 -- 172.21.15.52:0/306673477 shutdown_connections 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 --2- 172.21.15.52:0/306673477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0010e610 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 --2- 172.21.15.52:0/306673477 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00103700 0x7f0f0010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 --2- 172.21.15.52:0/306673477 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00102de0 0x7f0f001031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 -- 172.21.15.52:0/306673477 >> 172.21.15.52:0/306673477 conn(0x7f0f000fc7a0 msgr2=0x7f0f000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 -- 172.21.15.52:0/306673477 shutdown_connections 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.814+0000 7f0f05143640 1 -- 172.21.15.52:0/306673477 wait complete. 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 Processor -- start 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 -- start start 2024-09-19T09:28:42.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00102de0 0x7f0f00198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00103700 0x7f0f001988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111f30 con 0x7f0f0010c180 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111db0 con 0x7f0f00102de0 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0f05143640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001120b0 con 0x7f0f00103700 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0eff59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0eff59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39920/0 (socket says 172.21.15.52:39920) 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0eff59e640 1 -- 172.21.15.52:0/136021500 learned_addr learned my addr 172.21.15.52:0/136021500 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.815+0000 7f0efed9d640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00102de0 0x7f0f00198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0efe59c640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00103700 0x7f0f001988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 -- 172.21.15.52:0/136021500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00103700 msgr2=0x7f0f001988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00103700 0x7f0f001988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:42.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 -- 172.21.15.52:0/136021500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00102de0 msgr2=0x7f0f00198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00102de0 0x7f0f00198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 -- 172.21.15.52:0/136021500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0019d320 con 0x7f0f0010c180 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0eff59e640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f0ef802ae70 tx=0x7f0ef802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8034040 con 0x7f0f0010c180 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.816+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0019d5b0 con 0x7f0f0010c180 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.817+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a4ef0 con 0x7f0f0010c180 2024-09-19T09:28:42.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.817+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef8030920 con 0x7f0f0010c180 2024-09-19T09:28:42.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.817+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80047b0 con 0x7f0f0010c180 2024-09-19T09:28:42.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.818+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eec005290 con 0x7f0f0010c180 2024-09-19T09:28:42.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.820+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0ef8037020 con 0x7f0f0010c180 2024-09-19T09:28:42.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.821+0000 7f0ee7fff640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 0x7f0ee80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:42.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.821+0000 7f0efed9d640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 0x7f0ee80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:42.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.821+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0ef80f0720 con 0x7f0f0010c180 2024-09-19T09:28:42.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.821+0000 7f0efed9d640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 0x7f0ee80a5780 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000abe0 tx=0x7f0ef000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:42.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:42.824+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ef80bd3f0 con 0x7f0f0010c180 2024-09-19T09:28:43.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.038+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0eec005580 con 0x7f0f0010c180 2024-09-19T09:28:43.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.039+0000 7f0ee7fff640 1 -- 172.21.15.52:0/136021500 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f0ef80bccf0 con 0x7f0f0010c180 2024-09-19T09:28:43.040 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:28:43.040 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:28:43.040 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:28:43.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 msgr2=0x7f0ee80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:43.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 0x7f0ee80a5780 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000abe0 tx=0x7f0ef000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 msgr2=0x7f0f0019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:43.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f0ef802ae70 tx=0x7f0ef802f5b0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 shutdown_connections 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f0010c180 0x7f0f0019cc40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ee80a32c0 0x7f0ee80a5780 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f00103700 0x7f0f001988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 --2- 172.21.15.52:0/136021500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f00102de0 0x7f0f00198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 >> 172.21.15.52:0/136021500 conn(0x7f0f000fc7a0 msgr2=0x7f0f000fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 shutdown_connections 2024-09-19T09:28:43.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:43.041+0000 7f0f05143640 1 -- 172.21.15.52:0/136021500 wait complete. 2024-09-19T09:28:43.413 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:43 smithi052 ceph-mon[30947]: pgmap v556: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-19T09:28:43.413 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:43 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/136021500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:43 smithi169 ceph-mon[35454]: pgmap v556: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-19T09:28:43.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:43 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/136021500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:43 smithi086 ceph-mon[34813]: pgmap v556: 97 pgs: 97 active+clean; 3.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-19T09:28:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:43 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/136021500' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:28:43.728 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:28:43.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:28:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 -- 172.21.15.52:0/4261787053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c102790 msgr2=0x7f713c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 --2- 172.21.15.52:0/4261787053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c102790 0x7f713c1067e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f712802a410 comp rx=0 tx=0).stop 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 -- 172.21.15.52:0/4261787053 shutdown_connections 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 --2- 172.21.15.52:0/4261787053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c106f10 0x7f713c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 --2- 172.21.15.52:0/4261787053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c102790 0x7f713c1067e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 --2- 172.21.15.52:0/4261787053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c101de0 0x7f713c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 -- 172.21.15.52:0/4261787053 >> 172.21.15.52:0/4261787053 conn(0x7f713c0fd8c0 msgr2=0x7f713c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 -- 172.21.15.52:0/4261787053 shutdown_connections 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.450+0000 7f7142dca640 1 -- 172.21.15.52:0/4261787053 wait complete. 2024-09-19T09:28:44.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 Processor -- start 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 -- start start 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 0x7f713c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c102790 0x7f713c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f713c111f70 con 0x7f713c106f10 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f713c111df0 con 0x7f713c101de0 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7142dca640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1120f0 con 0x7f713c102790 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7141367640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7141367640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39936/0 (socket says 172.21.15.52:39936) 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7141367640 1 -- 172.21.15.52:0/1729412398 learned_addr learned my addr 172.21.15.52:0/1729412398 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f713bfff640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c102790 0x7f713c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.451+0000 7f7140b66640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 0x7f713c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 -- 172.21.15.52:0/1729412398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c102790 msgr2=0x7f713c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c102790 0x7f713c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 -- 172.21.15.52:0/1729412398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 msgr2=0x7f713c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 0x7f713c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 -- 172.21.15.52:0/1729412398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c1a69d0 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7140b66640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 0x7f713c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7141367640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f713400cad0 tx=0x7f713400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7139ffb640 1 -- 172.21.15.52:0/1729412398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713400ae20 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7139ffb640 1 -- 172.21.15.52:0/1729412398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7134005020 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c1a6cc0 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7139ffb640 1 -- 172.21.15.52:0/1729412398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713400f6f0 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.452+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c1a71d0 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.455+0000 7f7139ffb640 1 -- 172.21.15.52:0/1729412398 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f71340051d0 con 0x7f713c106f10 2024-09-19T09:28:44.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.455+0000 7f71451a3740 1 Processor -- start 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.455+0000 7f71451a3740 1 -- start start 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c3139c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c31444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608c309e160 con 0x5608c3144a30 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5608c3045720 con 0x5608c313a170 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f71451a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5608c309a120 con 0x5608c3139850 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39940/0 (socket says 172.21.15.52:39940) 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 -- 172.21.15.52:0/4196246615 learned_addr learned my addr 172.21.15.52:0/4196246615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f7139ffb640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 0x7f712c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c3139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f7140b66640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c31444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f7141367640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 0x7f712c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f7139ffb640 1 -- 172.21.15.52:0/1729412398 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f71340cf930 con 0x7f713c106f10 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 -- 172.21.15.52:0/4196246615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 msgr2=0x5608c3139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c3139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 -- 172.21.15.52:0/4196246615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 msgr2=0x5608c31444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c31444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f713bfff640 1 -- 172.21.15.52:0/4196246615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c2e0fba0 con 0x5608c3144a30 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.456+0000 7f7140b66640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c31444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f713bfff640 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f7128000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbde2d9a9f929fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f7141367640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 0x7f712c0a5780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7134098330 tx=0x7f713401baf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f7126ffd640 1 -- 172.21.15.52:0/4196246615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128035070 con 0x5608c3144a30 2024-09-19T09:28:44.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f7126ffd640 1 -- 172.21.15.52:0/4196246615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7128005020 con 0x5608c3144a30 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f7126ffd640 1 -- 172.21.15.52:0/4196246615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128004a00 con 0x5608c3144a30 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f71451a3740 1 -- 172.21.15.52:0/4196246615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 msgr2=0x5608c3146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f71451a3740 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7128009900 tx=0x7f7128000bc0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f71451a3740 1 -- 172.21.15.52:0/4196246615 shutdown_connections 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f71451a3740 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3146e20 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.457+0000 7f71451a3740 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c31444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 --2- 172.21.15.52:0/4196246615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c3139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- 172.21.15.52:0/4196246615 >> 172.21.15.52:0/4196246615 conn(0x5608c3135de0 msgr2=0x5608c31361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- 172.21.15.52:0/4196246615 shutdown_connections 2024-09-19T09:28:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- 172.21.15.52:0/4196246615 wait complete. 2024-09-19T09:28:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- start start 2024-09-19T09:28:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 Processor -- start 2024-09-19T09:28:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c3139850 0x5608c3141960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c313a170 0x5608c3141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5608c3147600 con 0x5608c3144a30 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5608c3026900 con 0x5608c3139850 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.458+0000 7f71451a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5608c3147780 con 0x5608c313a170 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f71451a3740 10 client.0 _ll_register_callbacks cb 0x5608c3024780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39946/0 (socket says 172.21.15.52:39946) 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 -- 172.21.15.52:0/2679319344 learned_addr learned my addr 172.21.15.52:0/2679319344 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f7140b66640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c313a170 0x5608c3141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c3139850 0x5608c3141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 -- 172.21.15.52:0/2679319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c313a170 msgr2=0x5608c3141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c313a170 0x5608c3141ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 -- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c3139850 msgr2=0x5608c3141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c3139850 0x5608c3141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 -- 172.21.15.52:0/2679319344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c3066c50 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f713bfff640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7128031550 tx=0x7f71280058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f865d55de9a2981a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f711bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712804e070 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7128004750 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.459+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7128005020 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f712805d050 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 10 client.18075 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5608c3153330 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7128005020 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f712803d8d0 con 0x5608c3144a30 2024-09-19T09:28:44.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 10 client.18075 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:44.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 10 client.18075 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:44.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 20 client.18075 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:44.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c3154680 0x5608c3156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 4 client.18075 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:44.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608c30ab890 con 0x5608c3154680 2024-09-19T09:28:44.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.460+0000 7f7140b66640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c3154680 0x5608c3156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.461+0000 7f7140b66640 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c3154680 0x5608c3156a70 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc4d9882c3a37b8 server_cookie=5c290cc42567a36f in_seq=0 out_seq=0 2024-09-19T09:28:44.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.461+0000 7f711bfff640 10 client.18075 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:44.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f711bfff640 1 -- 172.21.15.52:0/2679319344 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608c30ab890 con 0x5608c3154680 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f711bfff640 10 client.18075 handle_command_reply: tid=0 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 client.18075 shutdown 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 msgr2=0x5608c31423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7128031550 tx=0x7f71280058d0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 shutdown_connections 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c3154680 0x5608c3156a70 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c31423e0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c313a170 0x5608c3141ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f711bfff640 0 client.18075 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 --2- 172.21.15.52:0/2679319344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c3139850 0x5608c3141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 >> 172.21.15.52:0/2679319344 conn(0x5608c3135de0 msgr2=0x5608c313bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 shutdown_connections 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 1 -- 172.21.15.52:0/2679319344 wait complete. 2024-09-19T09:28:44.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.462+0000 7f71451a3740 20 client.18075 trim_cache size 0 max 16384 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 Processor -- start 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 -- start start 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c313b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1b2280 con 0x5608c3144a30 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1afb50 con 0x5608c313a170 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f71451a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1ad9a0 con 0x5608c3139850 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39956/0 (socket says 172.21.15.52:39956) 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f713bfff640 1 -- 172.21.15.52:0/4122500956 learned_addr learned my addr 172.21.15.52:0/4122500956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.479+0000 7f7140b66640 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 -- 172.21.15.52:0/4122500956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 msgr2=0x5608c313b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c313b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 -- 172.21.15.52:0/4122500956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 msgr2=0x5608c3159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 -- 172.21.15.52:0/4122500956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c3139680 con 0x5608c3144a30 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f713bfff640 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7128033000 tx=0x7f712802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812c9d28ab537740 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f71267fc640 1 -- 172.21.15.52:0/4122500956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712804e070 con 0x5608c3144a30 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f71267fc640 1 -- 172.21.15.52:0/4122500956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f712803cd10 con 0x5608c3144a30 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f71267fc640 1 -- 172.21.15.52:0/4122500956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128035040 con 0x5608c3144a30 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f71451a3740 1 -- 172.21.15.52:0/4122500956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 msgr2=0x5608c3159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.480+0000 7f71451a3740 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7128033000 tx=0x7f712802a410 comp rx=0 tx=0).stop 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 -- 172.21.15.52:0/4122500956 shutdown_connections 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3144a30 0x5608c3159fd0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 --2- 172.21.15.52:0/4122500956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3139850 0x5608c313b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 -- 172.21.15.52:0/4122500956 >> 172.21.15.52:0/4122500956 conn(0x5608c3135de0 msgr2=0x5608c313b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 -- 172.21.15.52:0/4122500956 shutdown_connections 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 -- 172.21.15.52:0/4122500956 wait complete. 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 -- start start 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.481+0000 7f71451a3740 1 Processor -- start 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3158130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3144a30 0x5608c31bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1ae010 con 0x5608c3139850 2024-09-19T09:28:44.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1af480 con 0x5608c313a170 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1ae6e0 con 0x5608c3144a30 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 10 client.0 _ll_register_callbacks cb 0x7f713000b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39964/0 (socket says 172.21.15.52:39964) 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 -- 172.21.15.52:0/1777635245 learned_addr learned my addr 172.21.15.52:0/1777635245 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f7140b66640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 -- 172.21.15.52:0/1777635245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3144a30 msgr2=0x5608c31bdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3144a30 0x5608c31bdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 -- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 msgr2=0x5608c3158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 -- 172.21.15.52:0/1777635245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c31be500 con 0x5608c3139850 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f713bfff640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7128031bf0 tx=0x7f712802ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402efa2a979b23d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f711bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7128065070 con 0x5608c3139850 2024-09-19T09:28:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f712803ca30 con 0x5608c3139850 2024-09-19T09:28:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.482+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f712803cd10 con 0x5608c3139850 2024-09-19T09:28:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7128035070 con 0x5608c3139850 2024-09-19T09:28:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 10 client.18081 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5608c31bf660 con 0x5608c3139850 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f712803cd10 con 0x5608c3139850 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f712803d550 con 0x5608c3139850 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 10 client.18081 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 10 client.18081 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 20 client.18081 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:44.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c31bfba0 0x5608c31c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 4 client.18081 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:28:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5608c3131410 con 0x5608c31bfba0 2024-09-19T09:28:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.483+0000 7f7140b66640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c31bfba0 0x5608c31c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.484+0000 7f7140b66640 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c31bfba0 0x5608c31c1f90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8b62347d8b77998 server_cookie=cae9baf5423eca72 in_seq=0 out_seq=0 2024-09-19T09:28:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.484+0000 7f711bfff640 10 client.18081 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.493+0000 7f711bfff640 1 -- 172.21.15.52:0/1777635245 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5608c3131410 con 0x5608c31bfba0 2024-09-19T09:28:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.493+0000 7f711bfff640 10 client.18081 handle_command_reply: tid=0 2024-09-19T09:28:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.493+0000 7f71451a3740 1 client.18081 shutdown 2024-09-19T09:28:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 msgr2=0x5608c3157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f7128031bf0 tx=0x7f712802ab80 comp rx=0 tx=0).stop 2024-09-19T09:28:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 shutdown_connections 2024-09-19T09:28:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5608c31bfba0 0x5608c31c1f90 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5608c3144a30 0x5608c31bdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5608c313a170 0x5608c3158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 --2- 172.21.15.52:0/1777635245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5608c3139850 0x5608c3157bf0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f711bfff640 0 client.18081 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 >> 172.21.15.52:0/1777635245 conn(0x5608c3135de0 msgr2=0x5608c313bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 shutdown_connections 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 1 -- 172.21.15.52:0/1777635245 wait complete. 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.494+0000 7f71451a3740 20 client.18081 trim_cache size 0 max 16384 2024-09-19T09:28:44.497 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 30, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "44c3e852": { 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 30, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:28:44.498 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 145.8, 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:28:44.499 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:28:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 msgr2=0x7f712c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 0x7f712c0a5780 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7134098330 tx=0x7f713401baf0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 msgr2=0x7f713c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f713400cad0 tx=0x7f713400cf90 comp rx=0 tx=0).stop 2024-09-19T09:28:44.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 shutdown_connections 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f713c106f10 0x7f713c074f70 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f712c0a32c0 0x7f712c0a5780 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f713c102790 0x7f713c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 --2- 172.21.15.52:0/1729412398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f713c101de0 0x7f713c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 >> 172.21.15.52:0/1729412398 conn(0x7f713c0fd8c0 msgr2=0x7f713c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 shutdown_connections 2024-09-19T09:28:44.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:28:44.495+0000 7f7142dca640 1 -- 172.21.15.52:0/1729412398 wait complete. 2024-09-19T09:28:45.251 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '44c3e852', quiesce took 3.1 seconds. Will release after: 22.65 2024-09-19T09:28:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:45 smithi052 ceph-mon[30947]: pgmap v557: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-19T09:28:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:45 smithi169 ceph-mon[35454]: pgmap v557: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-19T09:28:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:45 smithi086 ceph-mon[34813]: pgmap v557: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.5 KiB/s wr, 10 op/s 2024-09-19T09:28:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:47 smithi052 ceph-mon[30947]: pgmap v558: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-09-19T09:28:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:47 smithi169 ceph-mon[35454]: pgmap v558: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-09-19T09:28:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:47 smithi086 ceph-mon[34813]: pgmap v558: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-09-19T09:28:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 -- 172.21.15.52:0/1908044049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188100a40 msgr2=0x7f3188100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 --2- 172.21.15.52:0/1908044049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188100a40 0x7f3188100e40 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 -- 172.21.15.52:0/1908044049 shutdown_connections 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 --2- 172.21.15.52:0/1908044049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f3188108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 --2- 172.21.15.52:0/1908044049 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188101c30 0x7f31881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 --2- 172.21.15.52:0/1908044049 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188100a40 0x7f3188100e40 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 -- 172.21.15.52:0/1908044049 >> 172.21.15.52:0/1908044049 conn(0x7f31880fc1e0 msgr2=0x7f31880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 -- 172.21.15.52:0/1908044049 shutdown_connections 2024-09-19T09:28:47.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.571+0000 7f318cc53640 1 -- 172.21.15.52:0/1908044049 wait complete. 2024-09-19T09:28:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 Processor -- start 2024-09-19T09:28:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 -- start start 2024-09-19T09:28:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188100a40 0x7f318806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f318819f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f318810c6c0 con 0x7f3188101c30 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f318810c540 con 0x7f31881025f0 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.572+0000 7f318cc53640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f318810c840 con 0x7f3188100a40 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39994/0 (socket says 172.21.15.52:39994) 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 -- 172.21.15.52:0/3824507687 learned_addr learned my addr 172.21.15.52:0/3824507687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f318659c640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188100a40 0x7f318806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3186d9d640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f318819f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 -- 172.21.15.52:0/3824507687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188100a40 msgr2=0x7f318806a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188100a40 0x7f318806a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 -- 172.21.15.52:0/3824507687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 msgr2=0x7f318819f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f318819f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 -- 172.21.15.52:0/3824507687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318819fa60 con 0x7f3188101c30 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3186d9d640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f318819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f317000d770 tx=0x7f317000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f317f7fe640 1 -- 172.21.15.52:0/3824507687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170017070 con 0x7f3188101c30 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318819fcf0 con 0x7f3188101c30 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f317f7fe640 1 -- 172.21.15.52:0/3824507687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3170005500 con 0x7f3188101c30 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f317f7fe640 1 -- 172.21.15.52:0/3824507687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170004e00 con 0x7f3188101c30 2024-09-19T09:28:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.573+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31881a0190 con 0x7f3188101c30 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.576+0000 7f317f7fe640 1 -- 172.21.15.52:0/3824507687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3170004fa0 con 0x7f3188101c30 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.576+0000 7f318f9f0740 1 Processor -- start 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.576+0000 7f318f9f0740 1 -- start start 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1796242f0 con 0x55f1796c09a0 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1795cc270 con 0x55f1796c6370 2024-09-19T09:28:47.584 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318f9f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1796202b0 con 0x55f1796c12e0 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40010/0 (socket says 172.21.15.52:40010) 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 -- 172.21.15.52:0/2927958544 learned_addr learned my addr 172.21.15.52:0/2927958544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3185d9b640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318659c640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 -- 172.21.15.52:0/2927958544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 msgr2=0x55f1796c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 -- 172.21.15.52:0/2927958544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 msgr2=0x55f1796c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 -- 172.21.15.52:0/2927958544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1795cb340 con 0x55f1796c09a0 2024-09-19T09:28:47.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318659c640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f317f7fe640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 0x7f31740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f3186d9d640 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3180009cc0 tx=0x7f31800117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ef0e964992ff4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f318659c640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 0x7f31740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f317f7fe640 1 -- 172.21.15.52:0/3824507687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f31700cf3c0 con 0x7f3188101c30 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.577+0000 7f317cff9640 1 -- 172.21.15.52:0/2927958544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180012450 con 0x55f1796c09a0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f317cff9640 1 -- 172.21.15.52:0/2927958544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3180012ad0 con 0x55f1796c09a0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f317cff9640 1 -- 172.21.15.52:0/2927958544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318000fbf0 con 0x55f1796c09a0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 -- 172.21.15.52:0/2927958544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 msgr2=0x55f1796c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318659c640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 0x7f31740a57b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f3178000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f3180009cc0 tx=0x7f31800117b0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 -- 172.21.15.52:0/2927958544 shutdown_connections 2024-09-19T09:28:47.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 --2- 172.21.15.52:0/2927958544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796c0da0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.578+0000 7f318f9f0740 1 -- 172.21.15.52:0/2927958544 >> 172.21.15.52:0/2927958544 conn(0x55f1796bc010 msgr2=0x55f1796bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- 172.21.15.52:0/2927958544 shutdown_connections 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- 172.21.15.52:0/2927958544 wait complete. 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- start start 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 Processor -- start 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1796c9340 con 0x55f1796c09a0 2024-09-19T09:28:47.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1795ad290 con 0x55f1796c6370 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1796c94c0 con 0x55f1796c12e0 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318f9f0740 10 client.0 _ll_register_callbacks cb 0x55f1795de140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40014/0 (socket says 172.21.15.52:40014) 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.579+0000 7f318659c640 1 -- 172.21.15.52:0/3224682342 learned_addr learned my addr 172.21.15.52:0/3224682342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f3186d9d640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 -- 172.21.15.52:0/3224682342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 msgr2=0x55f1796cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 -- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 msgr2=0x55f1796d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 -- 172.21.15.52:0/3224682342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f179337210 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318659c640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990c4271038d7032 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f316dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178056060 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3178041030 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3180012ad0 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f317802fa60 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318f9f0740 10 client.18093 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.580+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f179403620 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3180012ad0 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3178051470 con 0x55f1796c09a0 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 10 client.18093 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 10 client.18093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 20 client.18093 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:47.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1796d67a0 0x55f1796d8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 4 client.18093 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f179631a20 con 0x55f1796d67a0 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.581+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1796d67a0 0x55f1796d8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.582+0000 7f3185d9b640 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1796d67a0 0x55f1796d8c10 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a929500f09f54ab server_cookie=bc7ee51b6bee5cb in_seq=0 out_seq=0 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.582+0000 7f316dffb640 10 client.18093 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.582+0000 7f316dffb640 1 -- 172.21.15.52:0/3224682342 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f179631a20 con 0x55f1796d67a0 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.582+0000 7f316dffb640 10 client.18093 handle_command_reply: tid=0 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 client.18093 shutdown 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 msgr2=0x55f1796cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f3178009ca0 tx=0x7f317802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 shutdown_connections 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1796d67a0 0x55f1796d8c10 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c6370 0x55f1796d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 --2- 172.21.15.52:0/3224682342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c09a0 0x55f1796cab90 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f316dffb640 0 client.18093 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 >> 172.21.15.52:0/3224682342 conn(0x55f1796bc010 msgr2=0x55f1796bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 shutdown_connections 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 1 -- 172.21.15.52:0/3224682342 wait complete. 2024-09-19T09:28:47.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.583+0000 7f318f9f0740 20 client.18093 trim_cache size 0 max 16384 2024-09-19T09:28:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.597+0000 7f318f9f0740 1 Processor -- start 2024-09-19T09:28:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 -- start start 2024-09-19T09:28:47.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c09a0 0x55f1796bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31881aba40 con 0x55f1796c6370 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31881a9310 con 0x55f1796c09a0 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f318f9f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31881a7160 con 0x55f1796c12e0 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40020/0 (socket says 172.21.15.52:40020) 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 -- 172.21.15.52:0/4206279990 learned_addr learned my addr 172.21.15.52:0/4206279990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:47.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3185d9b640 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 -- 172.21.15.52:0/4206279990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 msgr2=0x55f1796d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 -- 172.21.15.52:0/4206279990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c09a0 msgr2=0x55f1796bd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c09a0 0x55f1796bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 -- 172.21.15.52:0/4206279990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1796d5140 con 0x55f1796c6370 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3185d9b640 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f3186d9d640 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f3180009cc0 tx=0x7f3180009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37225faf86e73315 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f316ffff640 1 -- 172.21.15.52:0/4206279990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180029070 con 0x55f1796c6370 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f316ffff640 1 -- 172.21.15.52:0/4206279990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3180005520 con 0x55f1796c6370 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.598+0000 7f316ffff640 1 -- 172.21.15.52:0/4206279990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31800048c0 con 0x55f1796c6370 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- 172.21.15.52:0/4206279990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 msgr2=0x55f1796bd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f3180009cc0 tx=0x7f3180009c00 comp rx=0 tx=0).stop 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- 172.21.15.52:0/4206279990 shutdown_connections 2024-09-19T09:28:47.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796bd940 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 --2- 172.21.15.52:0/4206279990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c09a0 0x55f1796bd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- 172.21.15.52:0/4206279990 >> 172.21.15.52:0/4206279990 conn(0x55f1796bc010 msgr2=0x55f1796bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- 172.21.15.52:0/4206279990 shutdown_connections 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- 172.21.15.52:0/4206279990 wait complete. 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 -- start start 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.599+0000 7f318f9f0740 1 Processor -- start 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c09a0 0x55f1796d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31881a77d0 con 0x55f1796c6370 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31881a8c40 con 0x55f1796c12e0 2024-09-19T09:28:47.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31881a7ea0 con 0x55f1796c09a0 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 10 client.0 _ll_register_callbacks cb 0x7f3178009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40028/0 (socket says 172.21.15.52:40028) 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 -- 172.21.15.52:0/41247310 learned_addr learned my addr 172.21.15.52:0/41247310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318659c640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c09a0 0x55f1796d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3185d9b640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 -- 172.21.15.52:0/41247310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c09a0 msgr2=0x55f1796d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c09a0 0x55f1796d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 -- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 msgr2=0x55f1796d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 -- 172.21.15.52:0/41247310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1796d0ae0 con 0x55f1796c6370 2024-09-19T09:28:47.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3185d9b640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f3186d9d640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3180011cb0 tx=0x7f3180012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c865b139f9fe63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f316dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180029040 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3180012cb0 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.600+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3180005520 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f318003b020 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 10 client.18099 fetch_fsmap learned FSMap version 24 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f179742070 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3180005520 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3180025440 con 0x55f1796c6370 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 10 client.18099 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 10 client.18099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:28:47.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 20 client.18099 populate_metadata read hostname 'smithi052' 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f179742780 0x55f179744b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 4 client.18099 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f17962bd70 con 0x55f179742780 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.601+0000 7f318659c640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f179742780 0x55f179744b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.602+0000 7f318659c640 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f179742780 0x55f179744b70 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf6eacab9861f0b server_cookie=d2dc6da5bfd70cc4 in_seq=0 out_seq=0 2024-09-19T09:28:47.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.602+0000 7f316dffb640 10 client.18099 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f316dffb640 1 -- 172.21.15.52:0/41247310 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f17962bd70 con 0x55f179742780 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f316dffb640 10 client.18099 handle_command_reply: tid=0 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 client.18099 shutdown 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 msgr2=0x55f1796d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3180011cb0 tx=0x7f3180012680 comp rx=0 tx=0).stop 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 shutdown_connections 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f179742780 0x55f179744b70 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1796c6370 0x55f1796d02e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1796c12e0 0x55f1796d20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 --2- 172.21.15.52:0/41247310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1796c09a0 0x55f1796d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f316dffb640 0 client.18099 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.612+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 >> 172.21.15.52:0/41247310 conn(0x55f1796bc010 msgr2=0x55f1796bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 shutdown_connections 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318f9f0740 1 -- 172.21.15.52:0/41247310 wait complete. 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318f9f0740 20 client.18099 trim_cache size 0 max 16384 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:28:47.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 msgr2=0x7f31740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 0x7f31740a57b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3178006010 tx=0x7f3178000f40 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 msgr2=0x7f318819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f317000d770 tx=0x7f317000dc30 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 shutdown_connections 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f31881025f0 0x7f318819f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3188101c30 0x7f318819cb30 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31740a32f0 0x7f31740a57b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 --2- 172.21.15.52:0/3824507687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3188100a40 0x7f318806a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 >> 172.21.15.52:0/3824507687 conn(0x7f31880fc1e0 msgr2=0x7f3188104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 shutdown_connections 2024-09-19T09:28:47.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:28:47.613+0000 7f318cc53640 1 -- 172.21.15.52:0/3824507687 wait complete. 2024-09-19T09:28:49.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:49 smithi052 ceph-mon[30947]: pgmap v559: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:28:49.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:49 smithi169 ceph-mon[35454]: pgmap v559: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:28:49.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:49 smithi086 ceph-mon[34813]: pgmap v559: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:28:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:51 smithi052 ceph-mon[30947]: pgmap v560: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-19T09:28:51.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:51 smithi169 ceph-mon[35454]: pgmap v560: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-19T09:28:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:51 smithi086 ceph-mon[34813]: pgmap v560: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-19T09:28:53.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:53 smithi052 ceph-mon[30947]: pgmap v561: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:28:53.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:53 smithi169 ceph-mon[35454]: pgmap v561: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:28:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:53 smithi086 ceph-mon[34813]: pgmap v561: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 10 op/s 2024-09-19T09:28:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:55 smithi052 ceph-mon[30947]: pgmap v562: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:28:55.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:55 smithi169 ceph-mon[35454]: pgmap v562: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:28:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:55 smithi086 ceph-mon[34813]: pgmap v562: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:28:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:57 smithi052 ceph-mon[30947]: pgmap v563: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:28:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:57 smithi169 ceph-mon[35454]: pgmap v563: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:28:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:57 smithi086 ceph-mon[34813]: pgmap v563: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-19T09:28:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:28:59 smithi052 ceph-mon[30947]: pgmap v564: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:28:59.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:28:59 smithi169 ceph-mon[35454]: pgmap v564: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:28:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:28:59 smithi086 ceph-mon[34813]: pgmap v564: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 -- 172.21.15.52:0/3144760141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4998104f10 msgr2=0x7f4998107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 --2- 172.21.15.52:0/3144760141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4998104f10 0x7f4998107300 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f498c009900 tx=0x7f498c02a410 comp rx=0 tx=0).stop 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 -- 172.21.15.52:0/3144760141 shutdown_connections 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 --2- 172.21.15.52:0/3144760141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998107840 0x7f4998109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 --2- 172.21.15.52:0/3144760141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4998104f10 0x7f4998107300 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 --2- 172.21.15.52:0/3144760141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49981025e0 0x7f49981049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 -- 172.21.15.52:0/3144760141 >> 172.21.15.52:0/3144760141 conn(0x7f49980fc1e0 msgr2=0x7f49980fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.715 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 -- 172.21.15.52:0/3144760141 shutdown_connections 2024-09-19T09:29:00.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.714+0000 7f499cbc6640 1 -- 172.21.15.52:0/3144760141 wait complete. 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 Processor -- start 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 -- start start 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998104f10 0x7f4998198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 0x7f499819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f499810d840 con 0x7f49981025e0 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f499810d6c0 con 0x7f4998107840 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499cbc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f499810d9c0 con 0x7f4998104f10 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46230/0 (socket says 172.21.15.52:46230) 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 -- 172.21.15.52:0/2646394116 learned_addr learned my addr 172.21.15.52:0/2646394116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 0x7f499819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f4995d9b640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998104f10 0x7f4998198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 -- 172.21.15.52:0/2646394116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998104f10 msgr2=0x7f4998198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998104f10 0x7f4998198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 -- 172.21.15.52:0/2646394116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 msgr2=0x7f499819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 0x7f499819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f499659c640 1 -- 172.21.15.52:0/2646394116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499819f9f0 con 0x7f49981025e0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.715+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 0x7f499819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f499659c640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f498800c920 tx=0x7f498800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f49877fe640 1 -- 172.21.15.52:0/2646394116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988007c70 con 0x7f49981025e0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499819fce0 con 0x7f49981025e0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f49877fe640 1 -- 172.21.15.52:0/2646394116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4988007e10 con 0x7f49981025e0 2024-09-19T09:29:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f49877fe640 1 -- 172.21.15.52:0/2646394116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988018890 con 0x7f49981025e0 2024-09-19T09:29:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.716+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49981a01d0 con 0x7f49981025e0 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.718+0000 7f49877fe640 1 -- 172.21.15.52:0/2646394116 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4988018a70 con 0x7f49981025e0 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 Processor -- start 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 -- start start 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7357da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73582e0 0x5630b735cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5630b72bb2f0 con 0x5630b735d370 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5630b7263270 con 0x5630b73579a0 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499fa37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630b72b72b0 con 0x5630b73582e0 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f4995d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f4996d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7357da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f4995d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46246/0 (socket says 172.21.15.52:46246) 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f4995d9b640 1 -- 172.21.15.52:0/2549368121 learned_addr learned my addr 172.21.15.52:0/2549368121 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.719+0000 7f499659c640 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73582e0 0x5630b735cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f49877fe640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 0x7f49800a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 -- 172.21.15.52:0/2549368121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73582e0 msgr2=0x5630b735cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73582e0 0x5630b735cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 -- 172.21.15.52:0/2549368121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 msgr2=0x5630b735f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 -- 172.21.15.52:0/2549368121 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b7262340 con 0x5630b73579a0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4995d9b640 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 0x7f49800a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f49877fe640 1 -- 172.21.15.52:0/2646394116 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f49880cfbb0 con 0x7f49981025e0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7357da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f499806b3e0 tx=0x7f499000f8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d7a286d88011ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4984ff9640 1 -- 172.21.15.52:0/2549368121 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499001c910 con 0x5630b73579a0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4984ff9640 1 -- 172.21.15.52:0/2549368121 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499001b440 con 0x5630b73579a0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.720+0000 7f4984ff9640 1 -- 172.21.15.52:0/2549368121 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900105d0 con 0x5630b73579a0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 -- 172.21.15.52:0/2549368121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 msgr2=0x5630b7357da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7357da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f499806b3e0 tx=0x7f499000f8c0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f4996d9d640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 0x7f49800a57b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4990020000 tx=0x7f499001d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 -- 172.21.15.52:0/2549368121 shutdown_connections 2024-09-19T09:29:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b735f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73582e0 0x5630b735cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 --2- 172.21.15.52:0/2549368121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7357da0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 -- 172.21.15.52:0/2549368121 >> 172.21.15.52:0/2549368121 conn(0x5630b7353010 msgr2=0x5630b7353410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 -- 172.21.15.52:0/2549368121 shutdown_connections 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.721+0000 7f499fa37740 1 -- 172.21.15.52:0/2549368121 wait complete. 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 -- start start 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 Processor -- start 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7361b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 0x5630b73690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5630b7360340 con 0x5630b73582e0 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5630b7244290 con 0x5630b73579a0 2024-09-19T09:29:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630b73604c0 con 0x5630b735d370 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499fa37740 10 client.0 _ll_register_callbacks cb 0x5630b7275140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46252/0 (socket says 172.21.15.52:46252) 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 -- 172.21.15.52:0/4141034648 learned_addr learned my addr 172.21.15.52:0/4141034648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f499659c640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7361b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4996d9d640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 0x5630b73690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 -- 172.21.15.52:0/4141034648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 msgr2=0x5630b73690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 0x5630b73690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 -- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 msgr2=0x5630b7361b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7361b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4995d9b640 1 -- 172.21.15.52:0/4141034648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b6fce210 con 0x5630b73582e0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.722+0000 7f4996d9d640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 0x5630b73690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f4995d9b640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f498c009900 tx=0x7f498c004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869ab70d1466e65f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.730 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c035040 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f498c005590 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499001b440 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f498c049020 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 10 client.18111 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5630b709a620 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f499001b440 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f498c004b50 con 0x5630b73582e0 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 10 client.18111 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 10 client.18111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 20 client.18111 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b736d780 0x5630b736fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 4 client.18111 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:00.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.723+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630b72c8a20 con 0x5630b736d780 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.724+0000 7f499659c640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b736d780 0x5630b736fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.724+0000 7f499659c640 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b736d780 0x5630b736fbb0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143fca9fff20c8ac server_cookie=fb18c00f3f7346ae in_seq=0 out_seq=0 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.724+0000 7f497dffb640 10 client.18111 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f497dffb640 1 -- 172.21.15.52:0/4141034648 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630b72c8a20 con 0x5630b736d780 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f497dffb640 10 client.18111 handle_command_reply: tid=0 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 client.18111 shutdown 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 msgr2=0x5630b73620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f498c009900 tx=0x7f498c004480 comp rx=0 tx=0).stop 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 shutdown_connections 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b736d780 0x5630b736fbb0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b735d370 0x5630b73690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b73582e0 0x5630b73620a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f497dffb640 0 client.18111 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 --2- 172.21.15.52:0/4141034648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73579a0 0x5630b7361b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 >> 172.21.15.52:0/4141034648 conn(0x5630b7353010 msgr2=0x5630b7354820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 shutdown_connections 2024-09-19T09:29:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 1 -- 172.21.15.52:0/4141034648 wait complete. 2024-09-19T09:29:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.725+0000 7f499fa37740 20 client.18111 trim_cache size 0 max 16384 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 Processor -- start 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 -- start start 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b73520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b73690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49981aba80 con 0x5630b735d370 2024-09-19T09:29:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49981a9350 con 0x5630b73582e0 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f499fa37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49981a71a0 con 0x5630b73579a0 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f4996d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f4996d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46258/0 (socket says 172.21.15.52:46258) 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.740+0000 7f4996d9d640 1 -- 172.21.15.52:0/1251113211 learned_addr learned my addr 172.21.15.52:0/1251113211 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4995d9b640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b73690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 -- 172.21.15.52:0/1251113211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 msgr2=0x5630b73520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f499659c640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b73520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b73520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 -- 172.21.15.52:0/1251113211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 msgr2=0x5630b73690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b73690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 -- 172.21.15.52:0/1251113211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b73587c0 con 0x5630b735d370 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f499659c640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b73520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4995d9b640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b73690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f4996d9d640 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f499000a010 tx=0x7f499000f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad2e121ca2aee00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f497ffff640 1 -- 172.21.15.52:0/1251113211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49900103d0 con 0x5630b735d370 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f497ffff640 1 -- 172.21.15.52:0/1251113211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4990010570 con 0x5630b735d370 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.741+0000 7f497ffff640 1 -- 172.21.15.52:0/1251113211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990010d00 con 0x5630b735d370 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- 172.21.15.52:0/1251113211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 msgr2=0x5630b73744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f499000a010 tx=0x7f499000f360 comp rx=0 tx=0).stop 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- 172.21.15.52:0/1251113211 shutdown_connections 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b73744b0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b73690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- 172.21.15.52:0/1251113211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b73520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- 172.21.15.52:0/1251113211 >> 172.21.15.52:0/1251113211 conn(0x5630b7353010 msgr2=0x5630b73519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- 172.21.15.52:0/1251113211 shutdown_connections 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- 172.21.15.52:0/1251113211 wait complete. 2024-09-19T09:29:00.747 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- start start 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 Processor -- start 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b7366be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b7367120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49981a7810 con 0x5630b735d370 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49981a8c80 con 0x5630b73582e0 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f49981a7ee0 con 0x5630b73579a0 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f499fa37740 10 client.0 _ll_register_callbacks cb 0x7f498c009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f4996d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f4996d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46262/0 (socket says 172.21.15.52:46262) 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f4996d9d640 1 -- 172.21.15.52:0/835171314 learned_addr learned my addr 172.21.15.52:0/835171314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.742+0000 7f4995d9b640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b7367120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.748 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f499659c640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b7366be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 -- 172.21.15.52:0/835171314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 msgr2=0x5630b7366be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b7366be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 -- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 msgr2=0x5630b7367120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b7367120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 -- 172.21.15.52:0/835171314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b7368680 con 0x5630b735d370 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f4996d9d640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4990009ed0 tx=0x7f4990010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b465d3e0435169 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f497dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499003e060 con 0x5630b735d370 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4990036070 con 0x5630b735d370 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4990010570 con 0x5630b735d370 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f49900103d0 con 0x5630b735d370 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f499fa37740 10 client.18117 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:00.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5630b73d8760 con 0x5630b735d370 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.743+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4990010570 con 0x5630b735d370 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f499001b810 con 0x5630b735d370 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 10 client.18117 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 10 client.18117 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 20 client.18117 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b73d8f70 0x5630b73db390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 4 client.18117 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630b72c2d70 con 0x5630b73d8f70 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499659c640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b73d8f70 0x5630b73db390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f499659c640 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b73d8f70 0x5630b73db390 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7695044d8848a8c8 server_cookie=25c6ce52a70c8565 in_seq=0 out_seq=0 2024-09-19T09:29:00.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.744+0000 7f497dffb640 10 client.18117 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.753+0000 7f497dffb640 1 -- 172.21.15.52:0/835171314 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630b72c2d70 con 0x5630b73d8f70 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.753+0000 7f497dffb640 10 client.18117 handle_command_reply: tid=0 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.753+0000 7f499fa37740 1 client.18117 shutdown 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 msgr2=0x5630b7368070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f4990009ed0 tx=0x7f4990010f30 comp rx=0 tx=0).stop 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 shutdown_connections 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5630b73d8f70 0x5630b73db390 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630b735d370 0x5630b7368070 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630b73582e0 0x5630b7367120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.755 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f497dffb640 0 client.18117 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 --2- 172.21.15.52:0/835171314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630b73579a0 0x5630b7366be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 >> 172.21.15.52:0/835171314 conn(0x5630b7353010 msgr2=0x5630b73521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 shutdown_connections 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 1 -- 172.21.15.52:0/835171314 wait complete. 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499fa37740 20 client.18117 trim_cache size 0 max 16384 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:29:00.756 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:29:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 msgr2=0x7f49800a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 0x7f49800a57b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4990020000 tx=0x7f499001d000 comp rx=0 tx=0).stop 2024-09-19T09:29:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 msgr2=0x7f4998197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.754+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f498800c920 tx=0x7f498800cde0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.757 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 shutdown_connections 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4998107840 0x7f499819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f49800a32f0 0x7f49800a57b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4998104f10 0x7f4998198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 --2- 172.21.15.52:0/2646394116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49981025e0 0x7f4998197dd0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 >> 172.21.15.52:0/2646394116 conn(0x7f49980fc1e0 msgr2=0x7f4998102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 shutdown_connections 2024-09-19T09:29:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:00.755+0000 7f499cbc6640 1 -- 172.21.15.52:0/2646394116 wait complete. 2024-09-19T09:29:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:01 smithi052 ceph-mon[30947]: pgmap v565: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:29:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:01 smithi169 ceph-mon[35454]: pgmap v565: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:29:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:01 smithi086 ceph-mon[34813]: pgmap v565: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-09-19T09:29:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:03 smithi052 ceph-mon[30947]: pgmap v566: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:29:03.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:03 smithi169 ceph-mon[35454]: pgmap v566: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:29:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:03 smithi086 ceph-mon[34813]: pgmap v566: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:29:05.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:05 smithi052 ceph-mon[30947]: pgmap v567: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T09:29:05.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:05 smithi169 ceph-mon[35454]: pgmap v567: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T09:29:05.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:05 smithi086 ceph-mon[34813]: pgmap v567: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T09:29:07.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:07 smithi169 ceph-mon[35454]: pgmap v568: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:29:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:07 smithi086 ceph-mon[34813]: pgmap v568: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:29:07.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:07 smithi052 ceph-mon[30947]: pgmap v568: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T09:29:07.903 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:29:08.178 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:08.524 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/437334647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac106f10 msgr2=0x7fe3ac10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/437334647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac106f10 0x7fe3ac10ea90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009ca0 tx=0x7fe3a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/437334647 shutdown_connections 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/437334647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac106f10 0x7fe3ac10ea90 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/437334647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac102790 0x7fe3ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/437334647 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac101de0 0x7fe3ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/437334647 >> 172.21.15.52:0/437334647 conn(0x7fe3ac0fd8c0 msgr2=0x7fe3ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:08.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/437334647 shutdown_connections 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.710+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/437334647 wait complete. 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 Processor -- start 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 -- start start 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 0x7fe3ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 0x7fe3ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac111fc0 con 0x7fe3ac101de0 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac111e40 con 0x7fe3ac106f10 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b2bb9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ac112140 con 0x7fe3ac102790 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b0955640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b0955640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37930/0 (socket says 172.21.15.52:37930) 2024-09-19T09:29:08.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3b0955640 1 -- 172.21.15.52:0/2213233021 learned_addr learned my addr 172.21.15.52:0/2213233021 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.711+0000 7fe3abfff640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 0x7fe3ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b1156640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 0x7fe3ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 -- 172.21.15.52:0/2213233021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 msgr2=0x7fe3ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 0x7fe3ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 -- 172.21.15.52:0/2213233021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 msgr2=0x7fe3ac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 0x7fe3ac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 -- 172.21.15.52:0/2213233021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ac1a6860 con 0x7fe3ac101de0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b1156640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 0x7fe3ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3abfff640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 0x7fe3ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b0955640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c890 tx=0x7fe3a000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0004220 con 0x7fe3ac101de0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ac1a6b50 con 0x7fe3ac101de0 2024-09-19T09:29:08.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3a00043c0 con 0x7fe3ac101de0 2024-09-19T09:29:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.712+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a001d060 con 0x7fe3ac101de0 2024-09-19T09:29:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.713+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ac1a7090 con 0x7fe3ac101de0 2024-09-19T09:29:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.714+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ac1021c0 con 0x7fe3ac101de0 2024-09-19T09:29:08.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.715+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe3a00079b0 con 0x7fe3ac101de0 2024-09-19T09:29:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.716+0000 7fe3a9ffb640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 0x7fe39c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.716+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe3a00cf6c0 con 0x7fe3ac101de0 2024-09-19T09:29:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.716+0000 7fe3abfff640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 0x7fe39c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:08.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.717+0000 7fe3abfff640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 0x7fe39c0a5700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac075f80 tx=0x7fe39800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:08.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.722+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3a0014030 con 0x7fe3ac101de0 2024-09-19T09:29:08.787 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:08.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.951+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3ac1a72c0 con 0x7fe3ac101de0 2024-09-19T09:29:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.952+0000 7fe3a9ffb640 1 -- 172.21.15.52:0/2213233021 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe3a009c300 con 0x7fe3ac101de0 2024-09-19T09:29:08.954 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:29:08.954 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:29:08.954 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 msgr2=0x7fe39c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 0x7fe39c0a5700 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac075f80 tx=0x7fe39800b390 comp rx=0 tx=0).stop 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 msgr2=0x7fe3ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000c890 tx=0x7fe3a000cd50 comp rx=0 tx=0).stop 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 shutdown_connections 2024-09-19T09:29:08.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3ac106f10 0x7fe3ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe39c0a3240 0x7fe39c0a5700 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3ac102790 0x7fe3ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 --2- 172.21.15.52:0/2213233021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3ac101de0 0x7fe3ac0744f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 >> 172.21.15.52:0/2213233021 conn(0x7fe3ac0fd8c0 msgr2=0x7fe3ac0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 shutdown_connections 2024-09-19T09:29:08.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:08.954+0000 7fe3b2bb9640 1 -- 172.21.15.52:0/2213233021 wait complete. 2024-09-19T09:29:09.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:09 smithi169 ceph-mon[35454]: pgmap v569: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:09.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:09 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2213233021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:09.467 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:09 smithi052 ceph-mon[30947]: pgmap v569: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:09.467 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:09 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2213233021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:09.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 -- 172.21.15.52:0/830015857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 msgr2=0x7f9f501021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 --2- 172.21.15.52:0/830015857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501021c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009900 tx=0x7f9f4002a410 comp rx=0 tx=0).stop 2024-09-19T09:29:09.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 -- 172.21.15.52:0/830015857 shutdown_connections 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 --2- 172.21.15.52:0/830015857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50106f10 0x7f9f5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 --2- 172.21.15.52:0/830015857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50102790 0x7f9f501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 --2- 172.21.15.52:0/830015857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501021c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 -- 172.21.15.52:0/830015857 >> 172.21.15.52:0/830015857 conn(0x7f9f500fd8c0 msgr2=0x7f9f500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 -- 172.21.15.52:0/830015857 shutdown_connections 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 -- 172.21.15.52:0/830015857 wait complete. 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.465+0000 7f9f5528c640 1 Processor -- start 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 -- start start 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 0x7f9f50198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50106f10 0x7f9f5019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f50111f70 con 0x7f9f50101de0 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f50111df0 con 0x7f9f50106f10 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f5528c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501120f0 con 0x7f9f50102790 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37948/0 (socket says 172.21.15.52:37948) 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 -- 172.21.15.52:0/3171827157 learned_addr learned my addr 172.21.15.52:0/3171827157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50106f10 0x7f9f5019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 0x7f9f50198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 -- 172.21.15.52:0/3171827157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 msgr2=0x7f9f50198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 0x7f9f50198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 -- 172.21.15.52:0/3171827157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50106f10 msgr2=0x7f9f5019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50106f10 0x7f9f5019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f4effd640 1 -- 172.21.15.52:0/3171827157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5019d480 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.466+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 0x7f9f50198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006010 tx=0x7f9f400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f4cff9640 1 -- 172.21.15.52:0/3171827157 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4003f030 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f4cff9640 1 -- 172.21.15.52:0/3171827157 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f40003ce0 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f4cff9640 1 -- 172.21.15.52:0/3171827157 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40035070 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5019d710 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.467+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f501a5050 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.469+0000 7f9f4cff9640 1 -- 172.21.15.52:0/3171827157 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9f40042030 con 0x7f9f50101de0 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.469+0000 7f9f57665740 1 Processor -- start 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.469+0000 7f9f57665740 1 -- start start 2024-09-19T09:29:09.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134ee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5134492e0 con 0x55b5134ee680 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b5133f0ce0 con 0x55b5134e34a0 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f57665740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5134452a0 con 0x55b5134e3dc0 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37950/0 (socket says 172.21.15.52:37950) 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 -- 172.21.15.52:0/316609684 learned_addr learned my addr 172.21.15.52:0/316609684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f4effd640 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f4cff9640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 0x7f9f3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 -- 172.21.15.52:0/316609684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 msgr2=0x55b5134ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 -- 172.21.15.52:0/316609684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 msgr2=0x55b5134e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f467fc640 1 -- 172.21.15.52:0/316609684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5133d5440 con 0x55b5134ee680 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.470+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 0x7f9f3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.471+0000 7f9f4cff9640 1 -- 172.21.15.52:0/3171827157 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f400f0050 con 0x7f9f50101de0 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.471+0000 7f9f467fc640 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009c20 tx=0x7f9f3800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08de127833e0464 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.471+0000 7f9f457fa640 1 -- 172.21.15.52:0/316609684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38016070 con 0x55b5134ee680 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.471+0000 7f9f457fa640 1 -- 172.21.15.52:0/316609684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f38011950 con 0x55b5134ee680 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.471+0000 7f9f457fa640 1 -- 172.21.15.52:0/316609684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38010870 con 0x55b5134ee680 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- 172.21.15.52:0/316609684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 msgr2=0x55b5134f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 0x7f9f3c0a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9f48005fd0 tx=0x7f9f48004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009c20 tx=0x7f9f3800e6c0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- 172.21.15.52:0/316609684 shutdown_connections 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134f0a70 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- 172.21.15.52:0/316609684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- 172.21.15.52:0/316609684 >> 172.21.15.52:0/316609684 conn(0x55b5134dfa30 msgr2=0x55b5134dfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- 172.21.15.52:0/316609684 shutdown_connections 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- 172.21.15.52:0/316609684 wait complete. 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- start start 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 Processor -- start 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134eb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b5134f1250 con 0x55b5134ee680 2024-09-19T09:29:09.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b513404050 con 0x55b5134e34a0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.472+0000 7f9f57665740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b5134f13d0 con 0x55b5134e3dc0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f57665740 10 client.0 _ll_register_callbacks cb 0x55b513444160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37964/0 (socket says 172.21.15.52:37964) 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3721233619 learned_addr learned my addr 172.21.15.52:0/3721233619 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134eb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3721233619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 msgr2=0x55b5134eb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134eb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 msgr2=0x55b5134edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3721233619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5131ba3c0 con 0x55b5134ee680 2024-09-19T09:29:09.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009850 tx=0x7f9f48004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fb54e07f17c379 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f367fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4801ed70 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f4801f450 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.473+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f38011950 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f4802d070 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 10 client.18135 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5134fcc20 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f38011950 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9f4800f040 con 0x55b5134ee680 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 10 client.18135 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 20 client.18135 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:09.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134fe0e0 0x55b513500530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 4 client.18135 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.474+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b513456850 con 0x55b5134fe0e0 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.475+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134fe0e0 0x55b513500530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.475+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134fe0e0 0x55b513500530 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d0f929fde88a1b6 server_cookie=4260cec239ca54c3 in_seq=0 out_seq=0 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.475+0000 7f9f367fc640 10 client.18135 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f367fc640 1 -- 172.21.15.52:0/3721233619 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b513456850 con 0x55b5134fe0e0 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f367fc640 10 client.18135 handle_command_reply: tid=0 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 client.18135 shutdown 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 msgr2=0x55b5134eb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f9f48009850 tx=0x7f9f48004ab0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 shutdown_connections 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134fe0e0 0x55b513500530 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134ee680 0x55b5134eb760 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134e3dc0 0x55b5134eb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f367fc640 0 client.18135 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 --2- 172.21.15.52:0/3721233619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 >> 172.21.15.52:0/3721233619 conn(0x55b5134dfa30 msgr2=0x55b5134e5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 shutdown_connections 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 1 -- 172.21.15.52:0/3721233619 wait complete. 2024-09-19T09:29:09.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.476+0000 7f9f57665740 20 client.18135 trim_cache size 0 max 16384 2024-09-19T09:29:09.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.498+0000 7f9f57665740 1 Processor -- start 2024-09-19T09:29:09.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.498+0000 7f9f57665740 1 -- start start 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b513505e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501b0100 con 0x55b5134e3dc0 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501ad9d0 con 0x55b5134e34a0 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f57665740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501ab820 con 0x55b5134dfa30 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37968/0 (socket says 172.21.15.52:37968) 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3645956431 learned_addr learned my addr 172.21.15.52:0/3645956431 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b513505e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3645956431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 msgr2=0x55b5134fa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134fa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3645956431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 msgr2=0x55b513505e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b513505e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3645956431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5134ee2e0 con 0x55b5134e3dc0 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b513505e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.499+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9f48005c40 tx=0x7f9f48009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e32d84ebf645b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f44ff9640 1 -- 172.21.15.52:0/3645956431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48028dd0 con 0x55b5134e3dc0 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f44ff9640 1 -- 172.21.15.52:0/3645956431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f48023070 con 0x55b5134e3dc0 2024-09-19T09:29:09.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f44ff9640 1 -- 172.21.15.52:0/3645956431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48032bc0 con 0x55b5134e3dc0 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 -- 172.21.15.52:0/3645956431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 msgr2=0x55b513506340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9f48005c40 tx=0x7f9f48009790 comp rx=0 tx=0).stop 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 -- 172.21.15.52:0/3645956431 shutdown_connections 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b513506340 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b513505e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 --2- 172.21.15.52:0/3645956431 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134fa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 -- 172.21.15.52:0/3645956431 >> 172.21.15.52:0/3645956431 conn(0x55b5134eb8c0 msgr2=0x55b5134e9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.500+0000 7f9f57665740 1 -- 172.21.15.52:0/3645956431 shutdown_connections 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 -- 172.21.15.52:0/3645956431 wait complete. 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 -- start start 2024-09-19T09:29:09.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 Processor -- start 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134f5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501abe90 con 0x55b5134e3dc0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501ad300 con 0x55b5134e34a0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501ac560 con 0x55b5134dfa30 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f57665740 10 client.0 _ll_register_callbacks cb 0x7f9f48009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f4f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37978/0 (socket says 172.21.15.52:37978) 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3720273061 learned_addr learned my addr 172.21.15.52:0/3720273061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.501+0000 7f9f467fc640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3720273061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 msgr2=0x55b5134f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 msgr2=0x55b5134f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 -- 172.21.15.52:0/3720273061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5134f68d0 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f4f7fe640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9f480096e0 tx=0x7f9f4801eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267423fc8bfd473b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f367fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f48028670 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f48032480 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f48023070 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f48049020 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f57665740 10 client.18141 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.502+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b51356d840 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f48023070 con 0x55b5134e3dc0 2024-09-19T09:29:09.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9f48042020 con 0x55b5134e3dc0 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 10 client.18141 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 20 client.18141 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134ee680 0x55b51356fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 4 client.18141 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b513450d60 con 0x55b5134ee680 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134ee680 0x55b51356fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f367fc640 10 client.18141 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.503+0000 7f9f4effd640 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134ee680 0x55b51356fe00 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb2730d82755b53f server_cookie=f3ecf410c367d14 in_seq=0 out_seq=0 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f367fc640 1 -- 172.21.15.52:0/3720273061 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b513450d60 con 0x55b5134ee680 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f367fc640 10 client.18141 handle_command_reply: tid=0 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 client.18141 shutdown 2024-09-19T09:29:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 msgr2=0x55b5134f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9f480096e0 tx=0x7f9f4801eda0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 shutdown_connections 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b5134ee680 0x55b51356fe00 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b5134e3dc0 0x55b5134f60a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b5134e34a0 0x55b5134f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f367fc640 0 client.18141 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 --2- 172.21.15.52:0/3720273061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b5134dfa30 0x55b5134f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 >> 172.21.15.52:0/3720273061 conn(0x55b5134eb8c0 msgr2=0x55b5134deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 shutdown_connections 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 1 -- 172.21.15.52:0/3720273061 wait complete. 2024-09-19T09:29:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.504+0000 7f9f57665740 20 client.18141 trim_cache size 0 max 16384 2024-09-19T09:29:09.512 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:29:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:29:09.512 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:29:09.512 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:29:09.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 msgr2=0x7f9f3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 0x7f9f3c0a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9f48005fd0 tx=0x7f9f48004a40 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 msgr2=0x7f9f501984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f9f40006010 tx=0x7f9f400042f0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 shutdown_connections 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f50106f10 0x7f9f5019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f3c0a3240 0x7f9f3c0a5700 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f50102790 0x7f9f50198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 --2- 172.21.15.52:0/3171827157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50101de0 0x7f9f501984d0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 >> 172.21.15.52:0/3171827157 conn(0x7f9f500fd8c0 msgr2=0x7f9f500fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 shutdown_connections 2024-09-19T09:29:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:09.505+0000 7f9f5528c640 1 -- 172.21.15.52:0/3171827157 wait complete. 2024-09-19T09:29:09.514 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:09 smithi086 ceph-mon[34813]: pgmap v569: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:09.514 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:09 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2213233021' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:10.044 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 44c3e852 --release --await' 2024-09-19T09:29:10.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 44c3e852 --release --await 2024-09-19T09:29:10.779 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:29:10.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:29:10.822 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:11.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 -- 172.21.15.52:0/1138612758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c100a80 msgr2=0x7f420c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 --2- 172.21.15.52:0/1138612758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c100a80 0x7f420c100ee0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009930 tx=0x7f41f402a420 comp rx=0 tx=0).stop 2024-09-19T09:29:11.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 -- 172.21.15.52:0/1138612758 shutdown_connections 2024-09-19T09:29:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 --2- 172.21.15.52:0/1138612758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 0x7f420c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 --2- 172.21.15.52:0/1138612758 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c100a80 0x7f420c100ee0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 --2- 172.21.15.52:0/1138612758 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c106a80 0x7f420c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 -- 172.21.15.52:0/1138612758 >> 172.21.15.52:0/1138612758 conn(0x7f420c0fc7a0 msgr2=0x7f420c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.335 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:11 smithi052 ceph-mon[30947]: pgmap v570: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 -- 172.21.15.52:0/1138612758 shutdown_connections 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.332+0000 7f42125f8640 1 -- 172.21.15.52:0/1138612758 wait complete. 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.333+0000 7f42125f8640 1 Processor -- start 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.333+0000 7f42125f8640 1 -- start start 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 0x7f420c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 0x7f420c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f420c110ea0 con 0x7f420c106a80 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f420c110d20 con 0x7f420c101420 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f42125f8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f420c111020 con 0x7f420c100a80 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38004/0 (socket says 172.21.15.52:38004) 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 -- 172.21.15.52:0/2905018712 learned_addr learned my addr 172.21.15.52:0/2905018712 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 0x7f420c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f420bfff640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 0x7f420c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 -- 172.21.15.52:0/2905018712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 msgr2=0x7f420c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 0x7f420c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 -- 172.21.15.52:0/2905018712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 msgr2=0x7f420c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 0x7f420c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f4210b95640 1 -- 172.21.15.52:0/2905018712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c1a4870 con 0x7f420c106a80 2024-09-19T09:29:11.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.334+0000 7f420bfff640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 0x7f420c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f4210b95640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f420400cce0 tx=0x7f420400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f42097fa640 1 -- 172.21.15.52:0/2905018712 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420400f450 con 0x7f420c106a80 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c1a4a40 con 0x7f420c106a80 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f42097fa640 1 -- 172.21.15.52:0/2905018712 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f420400fad0 con 0x7f420c106a80 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f42097fa640 1 -- 172.21.15.52:0/2905018712 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204018c10 con 0x7f420c106a80 2024-09-19T09:29:11.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.335+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c1a4f00 con 0x7f420c106a80 2024-09-19T09:29:11.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.338+0000 7f42097fa640 1 -- 172.21.15.52:0/2905018712 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f420400f5f0 con 0x7f420c106a80 2024-09-19T09:29:11.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 Processor -- start 2024-09-19T09:29:11.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 -- start start 2024-09-19T09:29:11.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42097fa640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154df60 0x55ba9154e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154e880 0x55ba9155d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42097fa640 1 -- 172.21.15.52:0/2905018712 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f42040d0080 con 0x7f420c106a80 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba914b3620 con 0x55ba9155d650 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba9145ae50 con 0x55ba9154df60 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f42149d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba914af5e0 con 0x55ba9154e880 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38016/0 (socket says 172.21.15.52:38016) 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 -- 172.21.15.52:0/3859990292 learned_addr learned my addr 172.21.15.52:0/3859990292 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f420bfff640 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154df60 0x55ba9154e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 -- 172.21.15.52:0/3859990292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154e880 msgr2=0x55ba9155d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154e880 0x55ba9155d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 -- 172.21.15.52:0/3859990292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154df60 msgr2=0x55ba9154e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154df60 0x55ba9154e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.339+0000 7f4210b95640 1 -- 172.21.15.52:0/3859990292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9144bd40 con 0x55ba9155d650 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.340+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 0x7f41f80a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009900 tx=0x7f41f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.340+0000 7f4210b95640 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f420409c320 tx=0x7f420409bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594bca4b986fc6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.340+0000 7f42027fc640 1 -- 172.21.15.52:0/3859990292 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040a09d0 con 0x55ba9155d650 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.340+0000 7f42027fc640 1 -- 172.21.15.52:0/3859990292 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42040a5290 con 0x55ba9155d650 2024-09-19T09:29:11.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.340+0000 7f42027fc640 1 -- 172.21.15.52:0/3859990292 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040a4e00 con 0x55ba9155d650 2024-09-19T09:29:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- 172.21.15.52:0/3859990292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 msgr2=0x55ba9155fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f420409c320 tx=0x7f420409bf80 comp rx=0 tx=0).stop 2024-09-19T09:29:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- 172.21.15.52:0/3859990292 shutdown_connections 2024-09-19T09:29:11.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9155d650 0x55ba9155fa40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154e880 0x55ba9155d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 --2- 172.21.15.52:0/3859990292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154df60 0x55ba9154e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- 172.21.15.52:0/3859990292 >> 172.21.15.52:0/3859990292 conn(0x55ba9154a5f0 msgr2=0x55ba9154a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- 172.21.15.52:0/3859990292 shutdown_connections 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- 172.21.15.52:0/3859990292 wait complete. 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 -- start start 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.341+0000 7f42149d1740 1 Processor -- start 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154e880 0x55ba9155ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9155d650 0x55ba9155b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ba91560280 con 0x55ba9154df60 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ba9143bf10 con 0x55ba9154e880 2024-09-19T09:29:11.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ba91560400 con 0x55ba9155d650 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38030/0 (socket says 172.21.15.52:38030) 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 -- 172.21.15.52:0/2824206927 learned_addr learned my addr 172.21.15.52:0/2824206927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f42149d1740 10 client.0 _ll_register_callbacks cb 0x55ba9145fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154e880 0x55ba9155ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f4210b95640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9155d650 0x55ba9155b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 -- 172.21.15.52:0/2824206927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9155d650 msgr2=0x55ba9155b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9155d650 0x55ba9155b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 -- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154e880 msgr2=0x55ba9155ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154e880 0x55ba9155ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 -- 172.21.15.52:0/2824206927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba911c2580 con 0x55ba9154df60 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f420bfff640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f41fc010500 tx=0x7f41fc010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911965aef06251f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.342+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc018070 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f41fc014640 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42040a5290 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f41fc024050 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 10 client.18153 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba9128c960 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42040a5290 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f41fc0129f0 con 0x55ba9154df60 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 10 client.18153 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 10 client.18153 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 20 client.18153 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba9156d290 0x55ba9156f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 4 client.18153 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:11.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.343+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba914c0b90 con 0x55ba9156d290 2024-09-19T09:29:11.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.344+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba9156d290 0x55ba9156f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.344+0000 7f41eb7fe640 10 client.18153 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:11.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.344+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba9156d290 0x55ba9156f750 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9e8da0c44e5e6f1 server_cookie=e2d52c5227508083 in_seq=0 out_seq=0 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2824206927 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba914c0b90 con 0x55ba9156d290 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f41eb7fe640 10 client.18153 handle_command_reply: tid=0 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 client.18153 shutdown 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 msgr2=0x55ba9155a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f41fc010500 tx=0x7f41fc010900 comp rx=0 tx=0).stop 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 shutdown_connections 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba9156d290 0x55ba9156f750 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9155d650 0x55ba9155b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9154e880 0x55ba9155ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 --2- 172.21.15.52:0/2824206927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154df60 0x55ba9155a5d0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.345+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 >> 172.21.15.52:0/2824206927 conn(0x55ba9154a5f0 msgr2=0x55ba91550350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.346+0000 7f41eb7fe640 0 client.18153 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.346+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 shutdown_connections 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.346+0000 7f42149d1740 1 -- 172.21.15.52:0/2824206927 wait complete. 2024-09-19T09:29:11.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.346+0000 7f42149d1740 20 client.18153 trim_cache size 0 max 16384 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.363+0000 7f42149d1740 1 Processor -- start 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.363+0000 7f42149d1740 1 -- start start 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.363+0000 7f42149d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91549640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f42149d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f42149d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915755b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f42149d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ade80 con 0x55ba9154e880 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f42149d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ab750 con 0x55ba9155d650 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f42149d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a95a0 con 0x55ba9154df60 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38042/0 (socket says 172.21.15.52:38042) 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 -- 172.21.15.52:0/1095364931 learned_addr learned my addr 172.21.15.52:0/1095364931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f4210b95640 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915755b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420bfff640 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91549640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 -- 172.21.15.52:0/1095364931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 msgr2=0x55ba91549640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91549640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 -- 172.21.15.52:0/1095364931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 msgr2=0x55ba915755b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915755b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 -- 172.21.15.52:0/1095364931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9154b780 con 0x55ba9154e880 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f420b7fe640 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f41f403f040 tx=0x7f41f403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49300585bab63ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.364+0000 7f4201ffb640 1 -- 172.21.15.52:0/1095364931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4035040 con 0x55ba9154e880 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.365+0000 7f4201ffb640 1 -- 172.21.15.52:0/1095364931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41f4056070 con 0x55ba9154e880 2024-09-19T09:29:11.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.365+0000 7f4201ffb640 1 -- 172.21.15.52:0/1095364931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4051a50 con 0x55ba9154e880 2024-09-19T09:29:11.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.365+0000 7f42149d1740 1 -- 172.21.15.52:0/1095364931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 msgr2=0x55ba91575070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.365+0000 7f42149d1740 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f41f403f040 tx=0x7f41f403d000 comp rx=0 tx=0).stop 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 -- 172.21.15.52:0/1095364931 shutdown_connections 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915755b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba91575070 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 --2- 172.21.15.52:0/1095364931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91549640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 -- 172.21.15.52:0/1095364931 >> 172.21.15.52:0/1095364931 conn(0x55ba9154a5f0 msgr2=0x55ba91548f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 -- 172.21.15.52:0/1095364931 shutdown_connections 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 -- 172.21.15.52:0/1095364931 wait complete. 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.366+0000 7f42149d1740 1 -- start start 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 Processor -- start 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91561b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915d7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a9c10 con 0x55ba9154e880 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1ab080 con 0x55ba9155d650 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1aa2e0 con 0x55ba9154df60 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f42149d1740 10 client.0 _ll_register_callbacks cb 0x7f41fc007e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f420b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38054/0 (socket says 172.21.15.52:38054) 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f420b7fe640 1 -- 172.21.15.52:0/2835017907 learned_addr learned my addr 172.21.15.52:0/2835017907 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f4210b95640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915d7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.367+0000 7f420bfff640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91561b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 -- 172.21.15.52:0/2835017907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 msgr2=0x55ba91561b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91561b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 -- 172.21.15.52:0/2835017907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 msgr2=0x55ba915620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 -- 172.21.15.52:0/2835017907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba915d7630 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f420b7fe640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f4210b95640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915d7040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f420409c320 tx=0x7f420409c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da3e66390473bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f41eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040b9070 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4204067270 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.368+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41f4056070 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f420400f8e0 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 10 client.27221 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba915d8910 con 0x55ba9155d650 2024-09-19T09:29:11.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41f4056070 con 0x55ba9155d650 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f420407d050 con 0x55ba9155d650 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 10 client.27221 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 10 client.27221 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 20 client.27221 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba915d8bf0 0x55ba915dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 4 client.27221 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "44c3e852", "release": true, "await": true}] 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.369+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "44c3e852", "release": true, "await": true}) -- 0x55ba914bb0a0 con 0x55ba915d8bf0 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.370+0000 7f420bfff640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba915d8bf0 0x55ba915dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.370+0000 7f420bfff640 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba915d8bf0 0x55ba915dafe0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f17e4d1b70102d8 server_cookie=68beb4bfdda3056 in_seq=0 out_seq=0 2024-09-19T09:29:11.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.370+0000 7f41eb7fe640 10 client.27221 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:11.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.372+0000 7f41eb7fe640 1 -- 172.21.15.52:0/2835017907 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ba914bb0a0 con 0x55ba915d8bf0 2024-09-19T09:29:11.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.372+0000 7f41eb7fe640 10 client.27221 handle_command_reply: tid=0 2024-09-19T09:29:11.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.372+0000 7f42149d1740 1 client.27221 shutdown 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 msgr2=0x55ba915d7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915d7040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f420409c320 tx=0x7f420409c750 comp rx=0 tx=0).stop 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 shutdown_connections 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ba915d8bf0 0x55ba915dafe0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ba9155d650 0x55ba915d7040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f41eb7fe640 0 client.27221 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ba9154e880 0x55ba915620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 --2- 172.21.15.52:0/2835017907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ba9154df60 0x55ba91561b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 >> 172.21.15.52:0/2835017907 conn(0x55ba9154a5f0 msgr2=0x55ba91549750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 shutdown_connections 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 1 -- 172.21.15.52:0/2835017907 wait complete. 2024-09-19T09:29:11.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.373+0000 7f42149d1740 20 client.27221 trim_cache size 0 max 16384 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 32, 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "44c3e852": { 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 32, 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:29:11.380 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 145.8, 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:11.381 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 msgr2=0x7f41f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 0x7f41f80a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009900 tx=0x7f41f40058d0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 msgr2=0x7f420c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f420400cce0 tx=0x7f420400a620 comp rx=0 tx=0).stop 2024-09-19T09:29:11.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 shutdown_connections 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f420c106a80 0x7f420c1a4330 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f420c101420 0x7f420c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41f80a3240 0x7f41f80a5700 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 --2- 172.21.15.52:0/2905018712 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f420c100a80 0x7f420c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 >> 172.21.15.52:0/2905018712 conn(0x7f420c0fc7a0 msgr2=0x7f420c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 shutdown_connections 2024-09-19T09:29:11.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:11.375+0000 7f42125f8640 1 -- 172.21.15.52:0/2905018712 wait complete. 2024-09-19T09:29:11.385 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:11.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:11 smithi169 ceph-mon[35454]: pgmap v570: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:11.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:11 smithi086 ceph-mon[34813]: pgmap v570: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:29:12.138 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '44c3e852', total seconds elapsed: 30.0 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 -- 172.21.15.52:0/2696428660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec10e480 msgr2=0x7f57ec110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/2696428660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec10e480 0x7f57ec110870 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009ca0 tx=0x7f57e402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 -- 172.21.15.52:0/2696428660 shutdown_connections 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/2696428660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec10e480 0x7f57ec110870 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/2696428660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec101280 0x7f57ec10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/2696428660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec1008d0 0x7f57ec100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 -- 172.21.15.52:0/2696428660 >> 172.21.15.52:0/2696428660 conn(0x7f57ec0fc7a0 msgr2=0x7f57ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 -- 172.21.15.52:0/2696428660 shutdown_connections 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.626+0000 7f57f3fd2640 1 -- 172.21.15.52:0/2696428660 wait complete. 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 Processor -- start 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 -- start start 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec1008d0 0x7f57ec19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 0x7f57ec19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec114160 con 0x7f57ec101280 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec113fe0 con 0x7f57ec10e480 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f3fd2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f57ec1142e0 con 0x7f57ec1008d0 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38076/0 (socket says 172.21.15.52:38076) 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 -- 172.21.15.52:0/1845050278 learned_addr learned my addr 172.21.15.52:0/1845050278 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:12.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f1d6e640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec1008d0 0x7f57ec19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f256f640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 0x7f57ec19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 -- 172.21.15.52:0/1845050278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec1008d0 msgr2=0x7f57ec19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec1008d0 0x7f57ec19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 -- 172.21.15.52:0/1845050278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 msgr2=0x7f57ec19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 0x7f57ec19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.627+0000 7f57f156d640 1 -- 172.21.15.52:0/1845050278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ec19f690 con 0x7f57ec101280 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57f256f640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 0x7f57ec19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57f156d640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c890 tx=0x7f57dc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc004220 con 0x7f57ec101280 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ec19f980 con 0x7f57ec101280 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57dc0043c0 con 0x7f57ec101280 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ec1a7260 con 0x7f57ec101280 2024-09-19T09:29:12.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.628+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc004a00 con 0x7f57ec101280 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.629+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ec100cb0 con 0x7f57ec101280 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.630+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57dc0079b0 con 0x7f57ec101280 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.631+0000 7f57e2ffd640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 0x7f57d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.631+0000 7f57f1d6e640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 0x7f57d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.631+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f57dc0cfbd0 con 0x7f57ec101280 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.631+0000 7f57f1d6e640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 0x7f57d80a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f57e800bbe0 tx=0x7f57e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:12.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.634+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57dc014030 con 0x7f57ec101280 2024-09-19T09:29:12.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.845+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57ec109670 con 0x7f57ec101280 2024-09-19T09:29:12.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.846+0000 7f57e2ffd640 1 -- 172.21.15.52:0/1845050278 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f57dc09c810 con 0x7f57ec101280 2024-09-19T09:29:12.848 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:29:12.848 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:29:12.848 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 msgr2=0x7f57d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 0x7f57d80a5700 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f57e800bbe0 tx=0x7f57e800b390 comp rx=0 tx=0).stop 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 msgr2=0x7f57ec19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c890 tx=0x7f57dc00cd50 comp rx=0 tx=0).stop 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 shutdown_connections 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57ec10e480 0x7f57ec19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57ec101280 0x7f57ec19ac20 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57d80a3240 0x7f57d80a5700 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 --2- 172.21.15.52:0/1845050278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57ec1008d0 0x7f57ec19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 >> 172.21.15.52:0/1845050278 conn(0x7f57ec0fc7a0 msgr2=0x7f57ec0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 shutdown_connections 2024-09-19T09:29:12.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:12.848+0000 7f57f3fd2640 1 -- 172.21.15.52:0/1845050278 wait complete. 2024-09-19T09:29:13.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:13 smithi052 ceph-mon[30947]: pgmap v571: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:29:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:13 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1845050278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:13 smithi169 ceph-mon[35454]: pgmap v571: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:29:13.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:13 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1845050278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:13 smithi086 ceph-mon[34813]: pgmap v571: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T09:29:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:13 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1845050278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:13.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:29:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 -- 172.21.15.52:0/3127551179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081003c0 msgr2=0x7fda081007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/3127551179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081003c0 0x7fda081007c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fda04009900 tx=0x7fda0402a410 comp rx=0 tx=0).stop 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 -- 172.21.15.52:0/3127551179 shutdown_connections 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/3127551179 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda081016a0 0x7fda08101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/3127551179 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda08100d00 0x7fda08101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/3127551179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081003c0 0x7fda081007c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 -- 172.21.15.52:0/3127551179 >> 172.21.15.52:0/3127551179 conn(0x7fda080fc1b0 msgr2=0x7fda080fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 -- 172.21.15.52:0/3127551179 shutdown_connections 2024-09-19T09:29:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.855+0000 7fda0f3a6640 1 -- 172.21.15.52:0/3127551179 wait complete. 2024-09-19T09:29:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 Processor -- start 2024-09-19T09:29:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 -- start start 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda081003c0 0x7fda08199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda08100d00 0x7fda0819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda0810f9c0 con 0x7fda081016a0 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda0810f840 con 0x7fda081003c0 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0f3a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda0810fb40 con 0x7fda08100d00 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38094/0 (socket says 172.21.15.52:38094) 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 -- 172.21.15.52:0/1575604067 learned_addr learned my addr 172.21.15.52:0/1575604067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d142640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda081003c0 0x7fda08199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 -- 172.21.15.52:0/1575604067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda08100d00 msgr2=0x7fda0819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda08100d00 0x7fda0819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 -- 172.21.15.52:0/1575604067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda081003c0 msgr2=0x7fda08199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda081003c0 0x7fda08199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.856+0000 7fda0d943640 1 -- 172.21.15.52:0/1575604067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda081a1be0 con 0x7fda081016a0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fda0d943640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fda0000eb10 tx=0x7fda0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fd9fe7fc640 1 -- 172.21.15.52:0/1575604067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00004b20 con 0x7fda081016a0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fd9fe7fc640 1 -- 172.21.15.52:0/1575604067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda00004cc0 con 0x7fda081016a0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda081a1ed0 con 0x7fda081016a0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fd9fe7fc640 1 -- 172.21.15.52:0/1575604067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00010760 con 0x7fda081016a0 2024-09-19T09:29:13.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.857+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081a23f0 con 0x7fda081016a0 2024-09-19T09:29:13.868 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.859+0000 7fd9fe7fc640 1 -- 172.21.15.52:0/1575604067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fda00005020 con 0x7fda081016a0 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 Processor -- start 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 -- start start 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec49da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5583febad2f0 con 0x5583fec4f370 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5583feb55270 con 0x5583fec4a2e0 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda1221e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583feba92b0 con 0x5583fec499a0 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fd9fe7fc640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 0x7fd9f40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38108/0 (socket says 172.21.15.52:38108) 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 -- 172.21.15.52:0/649653470 learned_addr learned my addr 172.21.15.52:0/649653470 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:13.869 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0d142640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec49da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0d943640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 0x7fd9f40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fd9fe7fc640 1 -- 172.21.15.52:0/1575604067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fda000d00d0 con 0x7fda081016a0 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 -- 172.21.15.52:0/649653470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 msgr2=0x5583fec49da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec49da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 -- 172.21.15.52:0/649653470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 msgr2=0x5583fec4eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.860+0000 7fda0c941640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec4eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fda0c941640 1 -- 172.21.15.52:0/649653470 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583feb54340 con 0x5583fec4f370 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fda0d142640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec4eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fda0c941640 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80127d0 tx=0x7fd9f800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6cc8ffa24ddb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.870 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fda0d943640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 0x7fd9f40a57b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda000049d0 tx=0x7fda00066fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fd9f37fe640 1 -- 172.21.15.52:0/649653470 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8004040 con 0x5583fec4f370 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fd9f37fe640 1 -- 172.21.15.52:0/649653470 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f800dbc0 con 0x5583fec4f370 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.861+0000 7fd9f37fe640 1 -- 172.21.15.52:0/649653470 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80038c0 con 0x5583fec4f370 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- 172.21.15.52:0/649653470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 msgr2=0x5583fec51830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80127d0 tx=0x7fd9f800a3f0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- 172.21.15.52:0/649653470 shutdown_connections 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec51830 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec4eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- 172.21.15.52:0/649653470 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec49da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- 172.21.15.52:0/649653470 >> 172.21.15.52:0/649653470 conn(0x5583fec45010 msgr2=0x5583fec45410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- 172.21.15.52:0/649653470 shutdown_connections 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- 172.21.15.52:0/649653470 wait complete. 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- start start 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 Processor -- start 2024-09-19T09:29:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 0x5583fec53b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4f370 0x5583fec5b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5583fec52340 con 0x5583fec4a2e0 2024-09-19T09:29:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5583feb36290 con 0x5583fec499a0 2024-09-19T09:29:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.862+0000 7fda1221e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5583fec524c0 con 0x5583fec4f370 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda1221e740 10 client.0 _ll_register_callbacks cb 0x5583feb67140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38112/0 (socket says 172.21.15.52:38112) 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 -- 172.21.15.52:0/3680837344 learned_addr learned my addr 172.21.15.52:0/3680837344 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0c941640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 0x5583fec53b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0c941640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4f370 0x5583fec5b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 -- 172.21.15.52:0/3680837344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4f370 msgr2=0x5583fec5b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4f370 0x5583fec5b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 -- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 msgr2=0x5583fec53b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 0x5583fec53b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 -- 172.21.15.52:0/3680837344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fe8c0210 con 0x5583fec4a2e0 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0c941640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 0x5583fec53b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda0d142640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fda0402a930 tx=0x7fda040316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62932d794ed1bd55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fd9f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04035040 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fda04004040 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f800dbc0 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fda0404b030 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda1221e740 10 client.18177 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.863+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583fe98c620 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f800dbc0 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fda04004940 con 0x5583fec4a2e0 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 10 client.18177 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 10 client.18177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 20 client.18177 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fec5f7e0 0x5583fec61bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 4 client.18177 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583febbaa20 con 0x5583fec5f7e0 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.864+0000 7fda0c941640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fec5f7e0 0x5583fec61bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda0c941640 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fec5f7e0 0x5583fec61bd0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca259b3bad82ac7 server_cookie=7753af2fd0d7f685 in_seq=0 out_seq=0 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fd9f0ff9640 10 client.18177 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/3680837344 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583febbaa20 con 0x5583fec5f7e0 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fd9f0ff9640 10 client.18177 handle_command_reply: tid=0 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 client.18177 shutdown 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 msgr2=0x5583fec540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fda0402a930 tx=0x7fda040316b0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 shutdown_connections 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fec5f7e0 0x5583fec61bd0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4f370 0x5583fec5b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4a2e0 0x5583fec540b0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fd9f0ff9640 0 client.18177 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 --2- 172.21.15.52:0/3680837344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec499a0 0x5583fec53b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.865+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 >> 172.21.15.52:0/3680837344 conn(0x5583fec45010 msgr2=0x5583fec46820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.866+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 shutdown_connections 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.866+0000 7fda1221e740 1 -- 172.21.15.52:0/3680837344 wait complete. 2024-09-19T09:29:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.866+0000 7fda1221e740 20 client.18177 trim_cache size 0 max 16384 2024-09-19T09:29:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 Processor -- start 2024-09-19T09:29:13.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 -- start start 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec440b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda081adce0 con 0x5583fec4f370 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda081ab5b0 con 0x5583fec4a2e0 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda1221e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda081a9400 con 0x5583fec499a0 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38120/0 (socket says 172.21.15.52:38120) 2024-09-19T09:29:13.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda0c941640 1 -- 172.21.15.52:0/1856045400 learned_addr learned my addr 172.21.15.52:0/1856045400 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.880+0000 7fda0c941640 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0d142640 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 -- 172.21.15.52:0/1856045400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 msgr2=0x5583fec440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 -- 172.21.15.52:0/1856045400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 msgr2=0x5583fec5b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec5b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 -- 172.21.15.52:0/1856045400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583fec4a7c0 con 0x5583fec4f370 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda0c941640 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x5583fec43670 tx=0x7fd9f8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545eae22567b5a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fd9f2ffd640 1 -- 172.21.15.52:0/1856045400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8026040 con 0x5583fec4f370 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fd9f2ffd640 1 -- 172.21.15.52:0/1856045400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f8032070 con 0x5583fec4f370 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fd9f2ffd640 1 -- 172.21.15.52:0/1856045400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800dd50 con 0x5583fec4f370 2024-09-19T09:29:13.889 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda1221e740 1 -- 172.21.15.52:0/1856045400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 msgr2=0x5583fec664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.881+0000 7fda1221e740 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x5583fec43670 tx=0x7fd9f8014040 comp rx=0 tx=0).stop 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- 172.21.15.52:0/1856045400 shutdown_connections 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec4f370 0x5583fec664d0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4a2e0 0x5583fec5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- 172.21.15.52:0/1856045400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec499a0 0x5583fec440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- 172.21.15.52:0/1856045400 >> 172.21.15.52:0/1856045400 conn(0x5583fec45010 msgr2=0x5583fec439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- 172.21.15.52:0/1856045400 shutdown_connections 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- 172.21.15.52:0/1856045400 wait complete. 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- start start 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 Processor -- start 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4a2e0 0x5583fec58850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4f370 0x5583fec59860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.890 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda081a9a70 con 0x5583fec499a0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda081aaee0 con 0x5583fec4f370 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda081aa140 con 0x5583fec4a2e0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda1221e740 10 client.0 _ll_register_callbacks cb 0x7fda04009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.882+0000 7fda0c941640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38130/0 (socket says 172.21.15.52:38130) 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 -- 172.21.15.52:0/4170364702 learned_addr learned my addr 172.21.15.52:0/4170364702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0d142640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4a2e0 0x5583fec58850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4f370 0x5583fec59860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 -- 172.21.15.52:0/4170364702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4a2e0 msgr2=0x5583fec58850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4a2e0 0x5583fec58850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 -- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4f370 msgr2=0x5583fec59860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4f370 0x5583fec59860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 -- 172.21.15.52:0/4170364702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583fec59e70 con 0x5583fec499a0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda0c941640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8004690 tx=0x7fd9f8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c11561d9c3c6d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fd9f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f803f060 con 0x5583fec499a0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd9f8012250 con 0x5583fec499a0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9f8032070 con 0x5583fec499a0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd9f800dad0 con 0x5583fec499a0 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda1221e740 10 client.18183 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5583fec5b180 con 0x5583fec499a0 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.883+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9f8032070 con 0x5583fec499a0 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd9f802c040 con 0x5583fec499a0 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 10 client.18183 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 10 client.18183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 20 client.18183 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fecca840 0x5583fecccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 4 client.18183 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583febb4d70 con 0x5583fecca840 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda0d142640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fecca840 0x5583fecccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fd9f0ff9640 10 client.18183 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.884+0000 7fda0d142640 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fecca840 0x5583fecccc30 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf14dd4e094a4773 server_cookie=1cf95f537bdda802 in_seq=0 out_seq=0 2024-09-19T09:29:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fd9f0ff9640 1 -- 172.21.15.52:0/4170364702 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583febb4d70 con 0x5583fecca840 2024-09-19T09:29:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fd9f0ff9640 10 client.18183 handle_command_reply: tid=0 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 client.18183 shutdown 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 msgr2=0x5583fec58310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8004690 tx=0x7fd9f8004600 comp rx=0 tx=0).stop 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 shutdown_connections 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5583fecca840 0x5583fecccc30 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5583fec4f370 0x5583fec59860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fd9f0ff9640 0 client.18183 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5583fec4a2e0 0x5583fec58850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 --2- 172.21.15.52:0/4170364702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5583fec499a0 0x5583fec58310 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 >> 172.21.15.52:0/4170364702 conn(0x5583fec45010 msgr2=0x5583fec46740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 shutdown_connections 2024-09-19T09:29:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 1 -- 172.21.15.52:0/4170364702 wait complete. 2024-09-19T09:29:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.893+0000 7fda1221e740 20 client.18183 trim_cache size 0 max 16384 2024-09-19T09:29:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:29:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:29:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:29:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:29:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 msgr2=0x7fd9f40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 0x7fd9f40a57b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda000049d0 tx=0x7fda00066fa0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 msgr2=0x7fda081a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fda0000eb10 tx=0x7fda0000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 shutdown_connections 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda081016a0 0x7fda081a1570 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd9f40a32f0 0x7fd9f40a57b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda08100d00 0x7fda0819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 --2- 172.21.15.52:0/1575604067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda081003c0 0x7fda08199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 >> 172.21.15.52:0/1575604067 conn(0x7fda080fc1b0 msgr2=0x7fda080fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 shutdown_connections 2024-09-19T09:29:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:13.894+0000 7fda0f3a6640 1 -- 172.21.15.52:0/1575604067 wait complete. 2024-09-19T09:29:14.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 -- 172.21.15.52:0/1352423806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 msgr2=0x7f26ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 --2- 172.21.15.52:0/1352423806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1021c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f269c009900 tx=0x7f269c02a410 comp rx=0 tx=0).stop 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 -- 172.21.15.52:0/1352423806 shutdown_connections 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 --2- 172.21.15.52:0/1352423806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac106f10 0x7f26ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 --2- 172.21.15.52:0/1352423806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac102790 0x7f26ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 --2- 172.21.15.52:0/1352423806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1021c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 -- 172.21.15.52:0/1352423806 >> 172.21.15.52:0/1352423806 conn(0x7f26ac0fd8c0 msgr2=0x7f26ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 -- 172.21.15.52:0/1352423806 shutdown_connections 2024-09-19T09:29:14.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.304+0000 7f26b1d71640 1 -- 172.21.15.52:0/1352423806 wait complete. 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 Processor -- start 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 -- start start 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 0x7f26ac198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac106f10 0x7f26ac19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac111f70 con 0x7f26ac101de0 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac111df0 con 0x7f26ac106f10 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26b1d71640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1120f0 con 0x7f26ac102790 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38150/0 (socket says 172.21.15.52:38150) 2024-09-19T09:29:14.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26ab7fe640 1 -- 172.21.15.52:0/15241555 learned_addr learned my addr 172.21.15.52:0/15241555 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.305+0000 7f26aaffd640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 0x7f26ac198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26abfff640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac106f10 0x7f26ac19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 -- 172.21.15.52:0/15241555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 msgr2=0x7f26ac198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 0x7f26ac198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 -- 172.21.15.52:0/15241555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac106f10 msgr2=0x7f26ac19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac106f10 0x7f26ac19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 -- 172.21.15.52:0/15241555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac19d380 con 0x7f26ac101de0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26aaffd640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 0x7f26ac198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f269c005ab0 tx=0x7f269c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26a8ff9640 1 -- 172.21.15.52:0/15241555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c03f030 con 0x7f26ac101de0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac19d610 con 0x7f26ac101de0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26a8ff9640 1 -- 172.21.15.52:0/15241555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c003ce0 con 0x7f26ac101de0 2024-09-19T09:29:14.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26a8ff9640 1 -- 172.21.15.52:0/15241555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c035070 con 0x7f26ac101de0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.306+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac1a4f50 con 0x7f26ac101de0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.308+0000 7f26a8ff9640 1 -- 172.21.15.52:0/15241555 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f269c042030 con 0x7f26ac101de0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 Processor -- start 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26a8ff9640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 0x7f26940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 -- start start 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26abfff640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 0x7f26940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26a8ff9640 1 -- 172.21.15.52:0/15241555 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f269c0f0330 con 0x7f26ac101de0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 0x563077378a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077385760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5630772de2f0 con 0x563077379b40 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563077285cf0 con 0x5630773785d0 2024-09-19T09:29:14.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26b414a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5630772da2b0 con 0x563077383370 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38164/0 (socket says 172.21.15.52:38164) 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.309+0000 7f26ab7fe640 1 -- 172.21.15.52:0/3973056730 learned_addr learned my addr 172.21.15.52:0/3973056730 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26aaffd640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 0x563077378a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26abfff640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077385760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26abfff640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 0x7f26940a5700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ad30 tx=0x7f26a400a2b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 -- 172.21.15.52:0/3973056730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 msgr2=0x563077385760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077385760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 -- 172.21.15.52:0/3973056730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 msgr2=0x563077378a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 0x563077378a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 -- 172.21.15.52:0/3973056730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307726a3a0 con 0x563077379b40 2024-09-19T09:29:14.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26aaffd640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 0x563077378a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f269c0c5010 tx=0x7f269c03b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45dc835788f50c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f2691ffb640 1 -- 172.21.15.52:0/3973056730 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c049070 con 0x563077379b40 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f2691ffb640 1 -- 172.21.15.52:0/3973056730 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c0bc8d0 con 0x563077379b40 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.310+0000 7f2691ffb640 1 -- 172.21.15.52:0/3973056730 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c03b460 con 0x563077379b40 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- 172.21.15.52:0/3973056730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 msgr2=0x563077378090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f269c0c5010 tx=0x7f269c03b800 comp rx=0 tx=0).stop 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- 172.21.15.52:0/3973056730 shutdown_connections 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077385760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5630773785d0 0x563077378a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 --2- 172.21.15.52:0/3973056730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077378090 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- 172.21.15.52:0/3973056730 >> 172.21.15.52:0/3973056730 conn(0x563077341310 msgr2=0x563077374c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- 172.21.15.52:0/3973056730 shutdown_connections 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- 172.21.15.52:0/3973056730 wait complete. 2024-09-19T09:29:14.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 -- start start 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.311+0000 7f26b414a740 1 Processor -- start 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x563077380020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077380630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563077385e30 con 0x5630773785d0 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563077299060 con 0x563077379b40 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563077385fb0 con 0x563077383370 2024-09-19T09:29:14.346 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 10 client.0 _ll_register_callbacks cb 0x563076fec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38180/0 (socket says 172.21.15.52:38180) 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 -- 172.21.15.52:0/2800273956 learned_addr learned my addr 172.21.15.52:0/2800273956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26abfff640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077380630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26aaffd640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x563077380020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 -- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 msgr2=0x563077380630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077380630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 -- 172.21.15.52:0/2800273956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 msgr2=0x563077380020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x563077380020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 -- 172.21.15.52:0/2800273956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56307704f3c0 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f269c0ee120 tx=0x7f269c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c985cf6039cf70f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f268affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0d4070 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f269c0b8f40 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.312+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f269c0bc8d0 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f269c049070 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 10 client.18195 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563077385e30 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f269c0bc8d0 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f269c0bcb30 con 0x5630773785d0 2024-09-19T09:29:14.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 10 client.18195 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 10 client.18195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 20 client.18195 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773929d0 0x563077394e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 4 client.18195 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630772eb860 con 0x5630773929d0 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.313+0000 7f26aaffd640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773929d0 0x563077394e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.314+0000 7f268affd640 10 client.18195 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.314+0000 7f26aaffd640 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773929d0 0x563077394e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e12ca12eed6d50d server_cookie=25f05c9d76e0083e in_seq=0 out_seq=0 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.314+0000 7f268affd640 1 -- 172.21.15.52:0/2800273956 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630772eb860 con 0x5630773929d0 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f268affd640 10 client.18195 handle_command_reply: tid=0 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 client.18195 shutdown 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 msgr2=0x563077382d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f269c0ee120 tx=0x7f269c02a410 comp rx=0 tx=0).stop 2024-09-19T09:29:14.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 shutdown_connections 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773929d0 0x563077394e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563077383370 0x563077380630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x563077380020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f268affd640 0 client.18195 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 --2- 172.21.15.52:0/2800273956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5630773785d0 0x563077382d20 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 >> 172.21.15.52:0/2800273956 conn(0x563077341310 msgr2=0x56307737a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 shutdown_connections 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 1 -- 172.21.15.52:0/2800273956 wait complete. 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.315+0000 7f26b414a740 20 client.18195 trim_cache size 0 max 16384 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 Processor -- start 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 -- start start 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x56307737eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1b0050 con 0x563077383370 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1ad920 con 0x563077379b40 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26b414a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1ab770 con 0x5630773785d0 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38196/0 (socket says 172.21.15.52:38196) 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 -- 172.21.15.52:0/2532454010 learned_addr learned my addr 172.21.15.52:0/2532454010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26aaffd640 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x56307737eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 -- 172.21.15.52:0/2532454010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 msgr2=0x56307738f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 -- 172.21.15.52:0/2532454010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 msgr2=0x56307737eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x56307737eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.328+0000 7f26abfff640 1 -- 172.21.15.52:0/2532454010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563077379760 con 0x563077383370 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26abfff640 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005c40 tx=0x7f26a4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935c1248b5fb06cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26917fa640 1 -- 172.21.15.52:0/2532454010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a401f910 con 0x563077383370 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26917fa640 1 -- 172.21.15.52:0/2532454010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26a4023070 con 0x563077383370 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26917fa640 1 -- 172.21.15.52:0/2532454010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a401e440 con 0x563077383370 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 -- 172.21.15.52:0/2532454010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 msgr2=0x56307739a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005c40 tx=0x7f26a4011000 comp rx=0 tx=0).stop 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 -- 172.21.15.52:0/2532454010 shutdown_connections 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077383370 0x56307739a720 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077379b40 0x56307737eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 --2- 172.21.15.52:0/2532454010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 -- 172.21.15.52:0/2532454010 >> 172.21.15.52:0/2532454010 conn(0x563077341310 msgr2=0x56307737e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 -- 172.21.15.52:0/2532454010 shutdown_connections 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.329+0000 7f26b414a740 1 -- 172.21.15.52:0/2532454010 wait complete. 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 -- start start 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 Processor -- start 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 0x563077387160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1abde0 con 0x563077379b40 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1ad250 con 0x563077383370 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac1ac4b0 con 0x5630773785d0 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26aaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38202/0 (socket says 172.21.15.52:38202) 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26aaffd640 1 -- 172.21.15.52:0/3942939045 learned_addr learned my addr 172.21.15.52:0/3942939045 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:14.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.330+0000 7f26b414a740 10 client.0 _ll_register_callbacks cb 0x7f269c03bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26abfff640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 0x563077387160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 -- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 msgr2=0x56307738b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 -- 172.21.15.52:0/3942939045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 msgr2=0x563077387160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 0x563077387160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 -- 172.21.15.52:0/3942939045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563077387990 con 0x563077379b40 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26abfff640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 0x563077387160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26aaffd640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000c00 tx=0x7f26a0019950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46872f611053a3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0004220 con 0x563077379b40 2024-09-19T09:29:14.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f26a00043c0 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a4023070 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26a00035f0 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26b414a740 10 client.18201 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5630773fd720 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26a4023070 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.331+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26a0020070 con 0x563077379b40 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 10 client.18201 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 10 client.18201 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 20 client.18201 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:14.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773fde50 0x563077400270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 4 client.18201 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630772e5d70 con 0x5630773fde50 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773fde50 0x563077400270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26ab7fe640 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773fde50 0x563077400270 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=733d3196a0121774 server_cookie=28f136b044b68c2b in_seq=0 out_seq=0 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f268affd640 10 client.18201 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f268affd640 1 -- 172.21.15.52:0/3942939045 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630772e5d70 con 0x5630773fde50 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f268affd640 10 client.18201 handle_command_reply: tid=0 2024-09-19T09:29:14.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.332+0000 7f26b414a740 1 client.18201 shutdown 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 msgr2=0x563077386c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000c00 tx=0x7f26a0019950 comp rx=0 tx=0).stop 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 shutdown_connections 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5630773fde50 0x563077400270 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563077383370 0x563077387160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563077379b40 0x563077386c20 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 --2- 172.21.15.52:0/3942939045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5630773785d0 0x56307738b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 >> 172.21.15.52:0/3942939045 conn(0x563077341310 msgr2=0x56307737a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f268affd640 0 client.18201 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 shutdown_connections 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 1 -- 172.21.15.52:0/3942939045 wait complete. 2024-09-19T09:29:14.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b414a740 20 client.18201 trim_cache size 0 max 16384 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 msgr2=0x7f26940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 0x7f26940a5700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ad30 tx=0x7f26a400a2b0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 msgr2=0x7f26ac1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.333+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f269c005ab0 tx=0x7f269c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 shutdown_connections 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26ac106f10 0x7f26ac19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f26940a3240 0x7f26940a5700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f26ac102790 0x7f26ac198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 --2- 172.21.15.52:0/15241555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26ac101de0 0x7f26ac1983d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 >> 172.21.15.52:0/15241555 conn(0x7f26ac0fd8c0 msgr2=0x7f26ac0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 shutdown_connections 2024-09-19T09:29:14.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:14.334+0000 7f26b1d71640 1 -- 172.21.15.52:0/15241555 wait complete. 2024-09-19T09:29:15.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:29:15.364 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:15.429 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:15 smithi052 ceph-mon[30947]: pgmap v572: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-19T09:29:15.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:15 smithi169 ceph-mon[35454]: pgmap v572: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-19T09:29:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:15 smithi086 ceph-mon[34813]: pgmap v572: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- 172.21.15.52:0/1665071812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0102d40 msgr2=0x7fc3e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 --2- 172.21.15.52:0/1665071812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0102d40 0x7fc3e0103120 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a480 comp rx=0 tx=0).stop 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- 172.21.15.52:0/1665071812 shutdown_connections 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 --2- 172.21.15.52:0/1665071812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e010c170 0x7fc3e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 --2- 172.21.15.52:0/1665071812 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e0103660 0x7fc3e010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 --2- 172.21.15.52:0/1665071812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0102d40 0x7fc3e0103120 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- 172.21.15.52:0/1665071812 >> 172.21.15.52:0/1665071812 conn(0x7fc3e00fc7a0 msgr2=0x7fc3e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- 172.21.15.52:0/1665071812 shutdown_connections 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- 172.21.15.52:0/1665071812 wait complete. 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 Processor -- start 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.915+0000 7fc3e5347640 1 -- start start 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 0x7fc3e01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 0x7fc3e0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111fb0 con 0x7fc3e0103660 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111e30 con 0x7fc3e0102d40 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3e5347640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0112130 con 0x7fc3e010c170 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38220/0 (socket says 172.21.15.52:38220) 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 -- 172.21.15.52:0/3591600365 learned_addr learned my addr 172.21.15.52:0/3591600365 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 0x7fc3e0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3deffd640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 0x7fc3e01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 -- 172.21.15.52:0/3591600365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 msgr2=0x7fc3e0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 0x7fc3e0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 -- 172.21.15.52:0/3591600365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 msgr2=0x7fc3e01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 0x7fc3e01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 -- 172.21.15.52:0/3591600365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e01a6970 con 0x7fc3e0103660 2024-09-19T09:29:15.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 0x7fc3e0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3deffd640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 0x7fc3e01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b3f0 tx=0x7fc3d400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.916+0000 7fc3c7fff640 1 -- 172.21.15.52:0/3591600365 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4015020 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.917+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e01a6c60 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.917+0000 7fc3c7fff640 1 -- 172.21.15.52:0/3591600365 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d4011d10 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.917+0000 7fc3c7fff640 1 -- 172.21.15.52:0/3591600365 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400f2e0 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.917+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01a71a0 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.920+0000 7fc3c7fff640 1 -- 172.21.15.52:0/3591600365 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc3d4018020 con 0x7fc3e0103660 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.920+0000 7fc3e7720740 1 Processor -- start 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.920+0000 7fc3e7720740 1 -- start start 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.920+0000 7fc3c7fff640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 0x7fc3c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3c7fff640 1 -- 172.21.15.52:0/3591600365 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc3d40cf290 con 0x7fc3e0103660 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f43fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f44c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f1f3a52f0 con 0x560f1f440b40 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560f1f34ccf0 con 0x560f1f43f5d0 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3e7720740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560f1f3a12b0 con 0x560f1f44a370 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 0x7fc3c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38230/0 (socket says 172.21.15.52:38230) 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 -- 172.21.15.52:0/3675176007 learned_addr learned my addr 172.21.15.52:0/3675176007 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f44c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f43fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 -- 172.21.15.52:0/3675176007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 msgr2=0x560f1f44c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f44c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 -- 172.21.15.52:0/3675176007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 msgr2=0x560f1f43fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f43fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 -- 172.21.15.52:0/3675176007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1f3313a0 con 0x560f1f440b40 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f44c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.921+0000 7fc3deffd640 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031550 tx=0x7fc3d0032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657b3106dfb42fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.922+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 0x7fc3c80a5700 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x560f1f440070 tx=0x7fc3d8009770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.922+0000 7fc3c57fa640 1 -- 172.21.15.52:0/3675176007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d003f070 con 0x560f1f440b40 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.922+0000 7fc3c57fa640 1 -- 172.21.15.52:0/3675176007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d00317b0 con 0x560f1f440b40 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.922+0000 7fc3c57fa640 1 -- 172.21.15.52:0/3675176007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0035070 con 0x560f1f440b40 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- 172.21.15.52:0/3675176007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 msgr2=0x560f1f43f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0031550 tx=0x7fc3d0032cd0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- 172.21.15.52:0/3675176007 shutdown_connections 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f44c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f43fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 --2- 172.21.15.52:0/3675176007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f43f090 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- 172.21.15.52:0/3675176007 >> 172.21.15.52:0/3675176007 conn(0x560f1f408310 msgr2=0x560f1f43bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- 172.21.15.52:0/3675176007 shutdown_connections 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- 172.21.15.52:0/3675176007 wait complete. 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.923+0000 7fc3e7720740 1 -- start start 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 Processor -- start 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f449ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f446f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f1f44d010 con 0x560f1f44a370 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560f1f360060 con 0x560f1f440b40 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560f1f44d190 con 0x560f1f43f5d0 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3e7720740 10 client.0 _ll_register_callbacks cb 0x560f1f0b38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38244/0 (socket says 172.21.15.52:38244) 2024-09-19T09:29:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3df7fe640 1 -- 172.21.15.52:0/819222165 learned_addr learned my addr 172.21.15.52:0/819222165 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f446f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.924+0000 7fc3deffd640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f449ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 -- 172.21.15.52:0/819222165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 msgr2=0x560f1f449ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f449ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 -- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 msgr2=0x560f1f446f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f446f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 -- 172.21.15.52:0/819222165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f1f1163c0 con 0x560f1f44a370 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3deffd640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f449ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f446f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8014360 tx=0x7fc3d8009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c3556d972e0e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:15.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8023030 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc3d8010720 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d00317b0 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc3d802d030 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3e7720740 10 client.18213 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.925+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f1f458a60 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d00317b0 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc3d8032a70 con 0x560f1f44a370 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 10 client.18213 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 10 client.18213 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 20 client.18213 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f459f20 0x560f1f45c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 4 client.18213 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:15.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f1f3b2860 con 0x560f1f459f20 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.926+0000 7fc3deffd640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f459f20 0x560f1f45c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3deffd640 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f459f20 0x560f1f45c3e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=447ba08f8ee724d3 server_cookie=40f5380d429223fc in_seq=0 out_seq=0 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3c2ff5640 10 client.18213 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/819222165 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f1f3b2860 con 0x560f1f459f20 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3c2ff5640 10 client.18213 handle_command_reply: tid=0 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3e7720740 1 client.18213 shutdown 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 msgr2=0x560f1f447490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.927+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8014360 tx=0x7fc3d8009440 comp rx=0 tx=0).stop 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 shutdown_connections 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f447490 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f459f20 0x560f1f45c3e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f446f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 --2- 172.21.15.52:0/819222165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f449ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 >> 172.21.15.52:0/819222165 conn(0x560f1f408310 msgr2=0x560f1f441930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3c2ff5640 0 client.18213 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 shutdown_connections 2024-09-19T09:29:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 1 -- 172.21.15.52:0/819222165 wait complete. 2024-09-19T09:29:15.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.928+0000 7fc3e7720740 20 client.18213 trim_cache size 0 max 16384 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 Processor -- start 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 -- start start 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f4562b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f442120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01b2360 con 0x560f1f44a370 2024-09-19T09:29:15.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01afc30 con 0x560f1f440b40 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3e7720740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01ada80 con 0x560f1f43f5d0 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.952+0000 7fc3df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38256/0 (socket says 172.21.15.52:38256) 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 -- 172.21.15.52:0/2309757305 learned_addr learned my addr 172.21.15.52:0/2309757305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3deffd640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f4562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f442120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 -- 172.21.15.52:0/2309757305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 msgr2=0x560f1f4562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f4562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 -- 172.21.15.52:0/2309757305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 msgr2=0x560f1f442120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f442120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 -- 172.21.15.52:0/2309757305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1f45c750 con 0x560f1f44a370 2024-09-19T09:29:15.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3deffd640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f4562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f442120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000f80 tx=0x7fc3d80049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d218241d15abfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3c4ff9640 1 -- 172.21.15.52:0/2309757305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8023040 con 0x560f1f44a370 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3c4ff9640 1 -- 172.21.15.52:0/2309757305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d8028d90 con 0x560f1f44a370 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.953+0000 7fc3c4ff9640 1 -- 172.21.15.52:0/2309757305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8010980 con 0x560f1f44a370 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- 172.21.15.52:0/2309757305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 msgr2=0x560f1f442660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8000f80 tx=0x7fc3d80049c0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- 172.21.15.52:0/2309757305 shutdown_connections 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f44a370 0x560f1f442660 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f440b40 0x560f1f442120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2309757305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f43f5d0 0x560f1f4562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- 172.21.15.52:0/2309757305 >> 172.21.15.52:0/2309757305 conn(0x560f1f408310 msgr2=0x560f1f446f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- 172.21.15.52:0/2309757305 shutdown_connections 2024-09-19T09:29:15.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- 172.21.15.52:0/2309757305 wait complete. 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.954+0000 7fc3e7720740 1 -- start start 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 Processor -- start 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f452420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f443580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01ae0f0 con 0x560f1f440b40 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01af560 con 0x560f1f43f5d0 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01ae7c0 con 0x560f1f44a370 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3e7720740 10 client.0 _ll_register_callbacks cb 0x7fc3d8014e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38272/0 (socket says 172.21.15.52:38272) 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 -- 172.21.15.52:0/2272858298 learned_addr learned my addr 172.21.15.52:0/2272858298 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3deffd640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f452420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f443580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 -- 172.21.15.52:0/2272858298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 msgr2=0x560f1f443580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f443580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 -- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 msgr2=0x560f1f452420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f452420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3de7fc640 1 -- 172.21.15.52:0/2272858298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f1f443bc0 con 0x560f1f440b40 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.955+0000 7fc3df7fe640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f443580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3de7fc640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc3d409b530 tx=0x7fc3d40ccbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b6946a92bcd511 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40a44a0 con 0x560f1f440b40 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc3d4099b30 con 0x560f1f440b40 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d8028d90 con 0x560f1f440b40 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc3d4010510 con 0x560f1f440b40 2024-09-19T09:29:15.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 10 client.18219 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f1f4c4630 con 0x560f1f440b40 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d8028d90 con 0x560f1f440b40 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc3d4084c10 con 0x560f1f440b40 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 10 client.18219 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 10 client.18219 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 20 client.18219 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f4c4da0 0x560f1f4c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 4 client.18219 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.956+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f1f3acd70 con 0x560f1f4c4da0 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3deffd640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f4c4da0 0x560f1f4c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3c2ff5640 10 client.18219 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3deffd640 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f4c4da0 0x560f1f4c71c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3b90e9ec5fcae91 server_cookie=3554b90ec530e557 in_seq=0 out_seq=0 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3c2ff5640 1 -- 172.21.15.52:0/2272858298 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f1f3acd70 con 0x560f1f4c4da0 2024-09-19T09:29:15.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3c2ff5640 10 client.18219 handle_command_reply: tid=0 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 client.18219 shutdown 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 msgr2=0x560f1f452960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc3d409b530 tx=0x7fc3d40ccbe0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 shutdown_connections 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560f1f44a370 0x560f1f443580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f1f440b40 0x560f1f452960 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560f1f4c4da0 0x560f1f4c71c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.957+0000 7fc3e7720740 1 --2- 172.21.15.52:0/2272858298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560f1f43f5d0 0x560f1f452420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 >> 172.21.15.52:0/2272858298 conn(0x560f1f408310 msgr2=0x560f1f4457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3c2ff5640 0 client.18219 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 shutdown_connections 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e7720740 1 -- 172.21.15.52:0/2272858298 wait complete. 2024-09-19T09:29:15.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e7720740 20 client.18219 trim_cache size 0 max 16384 2024-09-19T09:29:15.971 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 msgr2=0x7fc3c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 0x7fc3c80a5700 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x560f1f440070 tx=0x7fc3d8009770 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 msgr2=0x7fc3e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400b3f0 tx=0x7fc3d400b8b0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 shutdown_connections 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc3c80a3240 0x7fc3c80a5700 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3e010c170 0x7fc3e0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc3e0103660 0x7fc3e0100ee0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 --2- 172.21.15.52:0/3591600365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3e0102d40 0x7fc3e01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.958+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 >> 172.21.15.52:0/3591600365 conn(0x7fc3e00fc7a0 msgr2=0x7fc3e00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.959+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 shutdown_connections 2024-09-19T09:29:15.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:15.959+0000 7fc3e5347640 1 -- 172.21.15.52:0/3591600365 wait complete. 2024-09-19T09:29:16.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:29:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:17.273 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:17 smithi052 ceph-mon[30947]: pgmap v573: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-09-19T09:29:17.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- 172.21.15.52:0/2989744424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244102790 msgr2=0x7fb2441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 --2- 172.21.15.52:0/2989744424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244102790 0x7fb2441067e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb238009900 tx=0x7fb23802a410 comp rx=0 tx=0).stop 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- 172.21.15.52:0/2989744424 shutdown_connections 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 --2- 172.21.15.52:0/2989744424 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244106f10 0x7fb24410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 --2- 172.21.15.52:0/2989744424 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244102790 0x7fb2441067e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 --2- 172.21.15.52:0/2989744424 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244101de0 0x7fb2441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- 172.21.15.52:0/2989744424 >> 172.21.15.52:0/2989744424 conn(0x7fb2440fd8c0 msgr2=0x7fb2440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- 172.21.15.52:0/2989744424 shutdown_connections 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- 172.21.15.52:0/2989744424 wait complete. 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 Processor -- start 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.357+0000 7fb24b2da640 1 -- start start 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 0x7fb244198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244102790 0x7fb244198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb244111f70 con 0x7fb244106f10 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb244111df0 con 0x7fb244101de0 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441120f0 con 0x7fb244102790 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38292/0 (socket says 172.21.15.52:38292) 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 -- 172.21.15.52:0/3465064642 learned_addr learned my addr 172.21.15.52:0/3465064642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249076640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 0x7fb244198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb248875640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244102790 0x7fb244198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 -- 172.21.15.52:0/3465064642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244102790 msgr2=0x7fb244198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244102790 0x7fb244198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 -- 172.21.15.52:0/3465064642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 msgr2=0x7fb244198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 0x7fb244198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 -- 172.21.15.52:0/3465064642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24419d3e0 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249076640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 0x7fb244198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb249877640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb23400eb10 tx=0x7fb23400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb2427fc640 1 -- 172.21.15.52:0/3465064642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234004b20 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb2427fc640 1 -- 172.21.15.52:0/3465064642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb234004cc0 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24419d6d0 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb2427fc640 1 -- 172.21.15.52:0/3465064642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234010760 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.358+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2441a4fb0 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb2427fc640 1 -- 172.21.15.52:0/3465064642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb234005020 con 0x7fb244106f10 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 Processor -- start 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 -- start start 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028dba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028ea780 0x561c028ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561c028412f0 con 0x561c028dcb40 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561c027e8cf0 con 0x561c028ea780 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561c0283d2b0 con 0x561c028db5d0 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.361+0000 7fb2427fc640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 0x7fb22c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38300/0 (socket says 172.21.15.52:38300) 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 -- 172.21.15.52:0/911500983 learned_addr learned my addr 172.21.15.52:0/911500983 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb249877640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 0x7fb22c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb249076640 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028dba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb2427fc640 1 -- 172.21.15.52:0/3465064642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2340d0010 con 0x7fb244106f10 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028ea780 0x561c028ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 -- 172.21.15.52:0/911500983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 msgr2=0x561c028dba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028dba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 -- 172.21.15.52:0/911500983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028ea780 msgr2=0x561c028ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028ea780 0x561c028ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 -- 172.21.15.52:0/911500983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c027cd3a0 con 0x561c028dcb40 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb249877640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 0x7fb22c0a5700 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb23409c540 tx=0x7fb234066f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb248875640 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fb238005940 tx=0x7fb238005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a91df1173760bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb22b7fe640 1 -- 172.21.15.52:0/911500983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238035050 con 0x561c028dcb40 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb22b7fe640 1 -- 172.21.15.52:0/911500983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb238004030 con 0x561c028dcb40 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.362+0000 7fb22b7fe640 1 -- 172.21.15.52:0/911500983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380055d0 con 0x561c028dcb40 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 -- 172.21.15.52:0/911500983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 msgr2=0x561c028db090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fb238005940 tx=0x7fb238005b50 comp rx=0 tx=0).stop 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 -- 172.21.15.52:0/911500983 shutdown_connections 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028ea780 0x561c028ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028dba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/911500983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028dcb40 0x561c028db090 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 -- 172.21.15.52:0/911500983 >> 172.21.15.52:0/911500983 conn(0x561c028a4310 msgr2=0x561c028d7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 -- 172.21.15.52:0/911500983 shutdown_connections 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.363+0000 7fb24d6b3740 1 -- 172.21.15.52:0/911500983 wait complete. 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 -- start start 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 Processor -- start 2024-09-19T09:29:17.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561c028ed420 con 0x561c028ea780 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561c027fc060 con 0x561c028db5d0 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561c028ed5a0 con 0x561c028dcb40 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb24d6b3740 10 client.0 _ll_register_callbacks cb 0x561c0254f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38310/0 (socket says 172.21.15.52:38310) 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb248875640 1 -- 172.21.15.52:0/253264175 learned_addr learned my addr 172.21.15.52:0/253264175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.364+0000 7fb249076640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 -- 172.21.15.52:0/253264175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 msgr2=0x561c028e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 -- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 msgr2=0x561c028ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 -- 172.21.15.52:0/253264175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c025b23c0 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb248875640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb238005910 tx=0x7fb238005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a59abfde0f10ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238035030 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb238031840 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb238004030 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb238004490 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb24d6b3740 10 client.18231 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c028f8f50 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.365+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb238004030 con 0x561c028ea780 2024-09-19T09:29:17.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb2380036f0 con 0x561c028ea780 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 10 client.18231 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 20 client.18231 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c028fa2a0 0x561c028fc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 4 client.18231 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c0284e860 con 0x561c028fa2a0 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb249076640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c028fa2a0 0x561c028fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb249076640 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c028fa2a0 0x561c028fc690 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43b0421ac30126d server_cookie=d84b30467f73763b in_seq=0 out_seq=0 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.366+0000 7fb228ff9640 10 client.18231 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb228ff9640 1 -- 172.21.15.52:0/253264175 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c0284e860 con 0x561c028fa2a0 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb228ff9640 10 client.18231 handle_command_reply: tid=0 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 client.18231 shutdown 2024-09-19T09:29:17.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 msgr2=0x561c028e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb238005910 tx=0x7fb238005a20 comp rx=0 tx=0).stop 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 shutdown_connections 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c028fa2a0 0x561c028fc690 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028e7be0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb228ff9640 0 client.18231 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/253264175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 >> 172.21.15.52:0/253264175 conn(0x561c028a4310 msgr2=0x561c028dd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.367+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 shutdown_connections 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.368+0000 7fb24d6b3740 1 -- 172.21.15.52:0/253264175 wait complete. 2024-09-19T09:29:17.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.368+0000 7fb24d6b3740 20 client.18231 trim_cache size 0 max 16384 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 Processor -- start 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 -- start start 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028dcb40 0x561c028e9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441addb0 con 0x561c028ea780 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441ab680 con 0x561c028dcb40 2024-09-19T09:29:17.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441a94d0 con 0x561c028db5d0 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38322/0 (socket says 172.21.15.52:38322) 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 -- 172.21.15.52:0/1564366883 learned_addr learned my addr 172.21.15.52:0/1564366883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb249076640 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028dcb40 0x561c028e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 -- 172.21.15.52:0/1564366883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 msgr2=0x561c028f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 -- 172.21.15.52:0/1564366883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028dcb40 msgr2=0x561c028e9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028dcb40 0x561c028e9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.381+0000 7fb248875640 1 -- 172.21.15.52:0/1564366883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c028d7ed0 con 0x561c028ea780 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb248875640 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb23802a930 tx=0x7fb23802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84805c3ffc7b076 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb22affd640 1 -- 172.21.15.52:0/1564366883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238035040 con 0x561c028ea780 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb22affd640 1 -- 172.21.15.52:0/1564366883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23804f070 con 0x561c028ea780 2024-09-19T09:29:17.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb22affd640 1 -- 172.21.15.52:0/1564366883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238004cc0 con 0x561c028ea780 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 -- 172.21.15.52:0/1564366883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 msgr2=0x561c028ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb23802a930 tx=0x7fb23802a410 comp rx=0 tx=0).stop 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 -- 172.21.15.52:0/1564366883 shutdown_connections 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028ff6b0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028dcb40 0x561c028e9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/1564366883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028db5d0 0x561c028f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.382+0000 7fb24d6b3740 1 -- 172.21.15.52:0/1564366883 >> 172.21.15.52:0/1564366883 conn(0x561c028a4310 msgr2=0x561c028e8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 -- 172.21.15.52:0/1564366883 shutdown_connections 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 -- 172.21.15.52:0/1564366883 wait complete. 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 -- start start 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 Processor -- start 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028fd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.383+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441a9b40 con 0x561c028ea780 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441aafb0 con 0x561c028db5d0 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb24d6b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2441aa210 con 0x561c028dcb40 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb24d6b3740 10 client.0 _ll_register_callbacks cb 0x7fb23c00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38336/0 (socket says 172.21.15.52:38336) 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 -- 172.21.15.52:0/3946185168 learned_addr learned my addr 172.21.15.52:0/3946185168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb249076640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 -- 172.21.15.52:0/3946185168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 msgr2=0x561c028fd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028fd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 -- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 msgr2=0x561c028fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028fd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 -- 172.21.15.52:0/3946185168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c02963be0 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb248875640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb238005ab0 tx=0x7fb23803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6311561582119094 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb228ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238005170 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb238044030 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.384+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23804f070 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb238004cc0 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 10 client.18237 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561c02964e40 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb23804f070 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb23803a640 con 0x561c028ea780 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 10 client.18237 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:17.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 20 client.18237 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c02965450 0x561c02967840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 4 client.18237 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c02848d70 con 0x561c02965450 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.385+0000 7fb249076640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c02965450 0x561c02967840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb249076640 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c02965450 0x561c02967840 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=718687e0a86ce516 server_cookie=9595edc776063726 in_seq=0 out_seq=0 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb228ff9640 10 client.18237 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb228ff9640 1 -- 172.21.15.52:0/3946185168 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c02848d70 con 0x561c02965450 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb228ff9640 10 client.18237 handle_command_reply: tid=0 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 client.18237 shutdown 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 msgr2=0x561c028fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fb238005ab0 tx=0x7fb23803f040 comp rx=0 tx=0).stop 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 shutdown_connections 2024-09-19T09:29:17.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561c02965450 0x561c02967840 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561c028ea780 0x561c028fde40 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561c028dcb40 0x561c028fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb228ff9640 0 client.18237 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 --2- 172.21.15.52:0/3946185168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561c028db5d0 0x561c028fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 >> 172.21.15.52:0/3946185168 conn(0x561c028a4310 msgr2=0x561c028d6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 shutdown_connections 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 1 -- 172.21.15.52:0/3946185168 wait complete. 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.386+0000 7fb24d6b3740 20 client.18237 trim_cache size 0 max 16384 2024-09-19T09:29:17.402 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:17.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 msgr2=0x7fb22c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 0x7fb22c0a5700 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb23409c540 tx=0x7fb234066f40 comp rx=0 tx=0).stop 2024-09-19T09:29:17.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 msgr2=0x7fb24419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb23400eb10 tx=0x7fb23400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 shutdown_connections 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb244106f10 0x7fb24419cd00 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb22c0a3240 0x7fb22c0a5700 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb244102790 0x7fb244198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 --2- 172.21.15.52:0/3465064642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb244101de0 0x7fb244198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 >> 172.21.15.52:0/3465064642 conn(0x7fb2440fd8c0 msgr2=0x7fb2440fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 shutdown_connections 2024-09-19T09:29:17.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:17.387+0000 7fb24b2da640 1 -- 172.21.15.52:0/3465064642 wait complete. 2024-09-19T09:29:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:17 smithi086 ceph-mon[34813]: pgmap v573: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-09-19T09:29:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:17 smithi169 ceph-mon[35454]: pgmap v573: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-09-19T09:29:19.066 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:29:19.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:29:19.342 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:19 smithi052 ceph-mon[30947]: pgmap v574: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:29:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:19 smithi086 ceph-mon[34813]: pgmap v574: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:29:19.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:19 smithi169 ceph-mon[35454]: pgmap v574: 97 pgs: 97 active+clean; 3.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 -- 172.21.15.52:0/2901126316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540101de0 msgr2=0x7fa5401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 --2- 172.21.15.52:0/2901126316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540101de0 0x7fa5401021c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa530009900 tx=0x7fa53002a410 comp rx=0 tx=0).stop 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 -- 172.21.15.52:0/2901126316 shutdown_connections 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 --2- 172.21.15.52:0/2901126316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa540106f10 0x7fa54010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 --2- 172.21.15.52:0/2901126316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540102790 0x7fa5401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 --2- 172.21.15.52:0/2901126316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540101de0 0x7fa5401021c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 -- 172.21.15.52:0/2901126316 >> 172.21.15.52:0/2901126316 conn(0x7fa5400fd8c0 msgr2=0x7fa5400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 -- 172.21.15.52:0/2901126316 shutdown_connections 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.807+0000 7fa546724640 1 -- 172.21.15.52:0/2901126316 wait complete. 2024-09-19T09:29:19.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.808+0000 7fa546724640 1 Processor -- start 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.808+0000 7fa546724640 1 -- start start 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540101de0 0x7fa5401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa540102790 0x7fa5401989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa540111f70 con 0x7fa540106f10 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa540111df0 con 0x7fa540102790 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401120f0 con 0x7fa540101de0 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37060/0 (socket says 172.21.15.52:37060) 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 -- 172.21.15.52:0/2616621083 learned_addr learned my addr 172.21.15.52:0/2616621083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa53ffff640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540101de0 0x7fa5401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 -- 172.21.15.52:0/2616621083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540101de0 msgr2=0x7fa5401984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540101de0 0x7fa5401984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 -- 172.21.15.52:0/2616621083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa540102790 msgr2=0x7fa5401989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa540102790 0x7fa5401989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 -- 172.21.15.52:0/2616621083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54019d460 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa544cc1640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fa53800eaa0 tx=0x7fa53800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa53dffb640 1 -- 172.21.15.52:0/2616621083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53800cdb0 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54019d750 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa53dffb640 1 -- 172.21.15.52:0/2616621083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538005020 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa53dffb640 1 -- 172.21.15.52:0/2616621083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380116b0 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.809+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5401a5030 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa53dffb640 1 -- 172.21.15.52:0/2616621083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa538005560 con 0x7fa540106f10 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 Processor -- start 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 -- start start 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e25800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ef0d80280 con 0x562ef0e25d40 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ef0d27b10 con 0x562ef0e1b480 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa548afd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ef0d7c240 con 0x562ef0e1ab60 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37074/0 (socket says 172.21.15.52:37074) 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e25800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa537fff640 1 -- 172.21.15.52:0/2871771342 learned_addr learned my addr 172.21.15.52:0/2871771342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa53dffb640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.812+0000 7fa537fff640 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 -- 172.21.15.52:0/2871771342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 msgr2=0x562ef0e1af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 -- 172.21.15.52:0/2871771342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 msgr2=0x562ef0e25800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e25800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 -- 172.21.15.52:0/2871771342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef0d341f0 con 0x562ef0e25d40 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa544cc1640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa53dffb640 1 -- 172.21.15.52:0/2616621083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa5380cfc30 con 0x7fa540106f10 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa537fff640 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa52800cf60 tx=0x7fa52800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f640ba2678cea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa5367fc640 1 -- 172.21.15.52:0/2871771342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528004020 con 0x562ef0e25d40 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa5367fc640 1 -- 172.21.15.52:0/2871771342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa528017030 con 0x562ef0e25d40 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.813+0000 7fa5367fc640 1 -- 172.21.15.52:0/2871771342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528012480 con 0x562ef0e25d40 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- 172.21.15.52:0/2871771342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 msgr2=0x562ef0e28130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa544cc1640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 0x7fa52c0a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa538020000 tx=0x7fa538086b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fa52800cf60 tx=0x7fa52800c450 comp rx=0 tx=0).stop 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- 172.21.15.52:0/2871771342 shutdown_connections 2024-09-19T09:29:19.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e28130 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e25800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 --2- 172.21.15.52:0/2871771342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- 172.21.15.52:0/2871771342 >> 172.21.15.52:0/2871771342 conn(0x562ef0e170f0 msgr2=0x562ef0e174d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- 172.21.15.52:0/2871771342 shutdown_connections 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- 172.21.15.52:0/2871771342 wait complete. 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 -- start start 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.814+0000 7fa548afd740 1 Processor -- start 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e22c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ef0e28910 con 0x562ef0e25d40 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ef0d3af10 con 0x562ef0e1b480 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ef0e28a90 con 0x562ef0e1ab60 2024-09-19T09:29:19.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa548afd740 10 client.0 _ll_register_callbacks cb 0x562ef0d03a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37082/0 (socket says 172.21.15.52:37082) 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 -- 172.21.15.52:0/3406595699 learned_addr learned my addr 172.21.15.52:0/3406595699 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa53ffff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e22c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 -- 172.21.15.52:0/3406595699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 msgr2=0x562ef0e22c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e22c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 -- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 msgr2=0x562ef0e231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 -- 172.21.15.52:0/3406595699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef0af16a0 con 0x562ef0e25d40 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa53ffff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa537fff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa528005d40 tx=0x7fa528004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c207a05ffd48d344 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.815+0000 7fa51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5280035f0 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa528003790 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa528017030 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa528030050 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 10 client.18249 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ef0e34570 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa528017030 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa52800f040 con 0x562ef0e25d40 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 10 client.18249 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:19.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 10 client.18249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 20 client.18249 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0e35980 0x562ef0e37d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 4 client.18249 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.816+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ef0d8d7f0 con 0x562ef0e35980 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.817+0000 7fa53ffff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0e35980 0x562ef0e37d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.817+0000 7fa51f7fe640 10 client.18249 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.817+0000 7fa53ffff640 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0e35980 0x562ef0e37d70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811b96436fe00857 server_cookie=54ff0dc295c5df81 in_seq=0 out_seq=0 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa51f7fe640 1 -- 172.21.15.52:0/3406595699 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ef0d8d7f0 con 0x562ef0e35980 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa51f7fe640 10 client.18249 handle_command_reply: tid=0 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 client.18249 shutdown 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 msgr2=0x562ef0e23700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa528005d40 tx=0x7fa528004660 comp rx=0 tx=0).stop 2024-09-19T09:29:19.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 shutdown_connections 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0e35980 0x562ef0e37d70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e25d40 0x562ef0e23700 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e1b480 0x562ef0e231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa51f7fe640 0 client.18249 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 --2- 172.21.15.52:0/3406595699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e22c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 >> 172.21.15.52:0/3406595699 conn(0x562ef0e170f0 msgr2=0x562ef0e1cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 shutdown_connections 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 1 -- 172.21.15.52:0/3406595699 wait complete. 2024-09-19T09:29:19.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.818+0000 7fa548afd740 20 client.18249 trim_cache size 0 max 16384 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 Processor -- start 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 -- start start 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 0x562ef0e3d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e3d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401b00b0 con 0x562ef0e1ab60 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ad980 con 0x562ef0e25d40 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.836+0000 7fa548afd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ab7d0 con 0x562ef0e1b480 2024-09-19T09:29:19.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37088/0 (socket says 172.21.15.52:37088) 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 -- 172.21.15.52:0/2523414003 learned_addr learned my addr 172.21.15.52:0/2523414003 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa53ffff640 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 0x562ef0e3d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 -- 172.21.15.52:0/2523414003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 msgr2=0x562ef0e3d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 0x562ef0e3d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 -- 172.21.15.52:0/2523414003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 msgr2=0x562ef0e3d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e3d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 -- 172.21.15.52:0/2523414003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ef0e25260 con 0x562ef0e1ab60 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa53ffff640 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 0x562ef0e3d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa537fff640 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa528012e90 tx=0x7fa528012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd655ff7bf6cc737 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa535ffb640 1 -- 172.21.15.52:0/2523414003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52800ec10 con 0x562ef0e1ab60 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa535ffb640 1 -- 172.21.15.52:0/2523414003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa528020070 con 0x562ef0e1ab60 2024-09-19T09:29:19.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.837+0000 7fa535ffb640 1 -- 172.21.15.52:0/2523414003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52801c950 con 0x562ef0e1ab60 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- 172.21.15.52:0/2523414003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 msgr2=0x562ef0e21b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa528012e90 tx=0x7fa528012480 comp rx=0 tx=0).stop 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- 172.21.15.52:0/2523414003 shutdown_connections 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e3d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1b480 0x562ef0e3d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 --2- 172.21.15.52:0/2523414003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1ab60 0x562ef0e21b50 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- 172.21.15.52:0/2523414003 >> 172.21.15.52:0/2523414003 conn(0x562ef0e170f0 msgr2=0x562ef0e21440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- 172.21.15.52:0/2523414003 shutdown_connections 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- 172.21.15.52:0/2523414003 wait complete. 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.838+0000 7fa548afd740 1 -- start start 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 Processor -- start 2024-09-19T09:29:19.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e20870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401abe40 con 0x562ef0e1b480 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ad2b0 con 0x562ef0e25d40 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ac510 con 0x562ef0e1ab60 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa548afd740 10 client.0 _ll_register_callbacks cb 0x7fa530009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37098/0 (socket says 172.21.15.52:37098) 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 -- 172.21.15.52:0/455739670 learned_addr learned my addr 172.21.15.52:0/455739670 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:19.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa537fff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e20870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa537fff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 -- 172.21.15.52:0/455739670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 msgr2=0x562ef0e1fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 -- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 msgr2=0x562ef0e20870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.839+0000 7fa53ffff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e20870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa53ffff640 1 -- 172.21.15.52:0/455739670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ef0e9f520 con 0x562ef0e1b480 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa53ffff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa53002a930 tx=0x7fa5300095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337162e9e4650db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530035040 con 0x562ef0e1b480 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa530005040 con 0x562ef0e1b480 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa528020070 con 0x562ef0e1b480 2024-09-19T09:29:19.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa530052050 con 0x562ef0e1b480 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa548afd740 10 client.18255 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ef0ea0840 con 0x562ef0e1b480 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa528020070 con 0x562ef0e1b480 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa5300035f0 con 0x562ef0e1b480 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.840+0000 7fa548afd740 10 client.18255 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa548afd740 10 client.18255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa548afd740 20 client.18255 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0ea1070 0x562ef0ea3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa548afd740 4 client.18255 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:29:19.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ef0d87d00 con 0x562ef0ea1070 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa537fff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0ea1070 0x562ef0ea3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa537fff640 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0ea1070 0x562ef0ea3460 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=964340e759a99f18 server_cookie=b123734b5841b937 in_seq=0 out_seq=0 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.841+0000 7fa51f7fe640 10 client.18255 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa51f7fe640 1 -- 172.21.15.52:0/455739670 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ef0d87d00 con 0x562ef0ea1070 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa51f7fe640 10 client.18255 handle_command_reply: tid=0 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 client.18255 shutdown 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 msgr2=0x562ef0e20330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fa53002a930 tx=0x7fa5300095b0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 shutdown_connections 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ef0ea1070 0x562ef0ea3460 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ef0e25d40 0x562ef0e20870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ef0e1b480 0x562ef0e20330 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 --2- 172.21.15.52:0/455739670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ef0e1ab60 0x562ef0e1fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 >> 172.21.15.52:0/455739670 conn(0x562ef0e170f0 msgr2=0x562ef0e21c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa51f7fe640 0 client.18255 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 shutdown_connections 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 1 -- 172.21.15.52:0/455739670 wait complete. 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.843+0000 7fa548afd740 20 client.18255 trim_cache size 0 max 16384 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "7ffc799e-234b-40d8-89ed-21ed9adb3115", 2024-09-19T09:29:19.854 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:29:19.855 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:29:19.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 msgr2=0x7fa52c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 0x7fa52c0a5700 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa538020000 tx=0x7fa538086b10 comp rx=0 tx=0).stop 2024-09-19T09:29:19.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 msgr2=0x7fa54019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fa53800eaa0 tx=0x7fa53800ef60 comp rx=0 tx=0).stop 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 shutdown_connections 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa540106f10 0x7fa54019cd80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa540102790 0x7fa5401989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 --2- 172.21.15.52:0/2616621083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa540101de0 0x7fa5401984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 >> 172.21.15.52:0/2616621083 conn(0x7fa5400fd8c0 msgr2=0x7fa5400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 shutdown_connections 2024-09-19T09:29:19.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:19.844+0000 7fa546724640 1 -- 172.21.15.52:0/2616621083 wait complete. 2024-09-19T09:29:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:189/600: open fd = 3 2024-09-19T09:29:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.441 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:190/600: open fd = 3 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:191/600: open fd = 3 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:192/600: open fd = 3 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.442 INFO:tasks.workunit.client.0.smithi052.stdout:193/600: open fd = 3 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:194/600: open fd = 3 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:195/600: open fd = 3 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:196/600: open fd = 3 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.443 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:197/600: open fd = 3 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:198/600: open fd = 3 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:199/600: open fd = 3 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.444 INFO:tasks.workunit.client.0.smithi052.stdout:200/600: open fd = 3 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:201/600: open fd = 3 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:202/600: open fd = 3 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:203/600: open fd = 3 2024-09-19T09:29:20.445 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:204/600: open fd = 3 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:205/600: open fd = 3 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:206/600: open fd = 3 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.446 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:207/600: open fd = 3 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:208/600: open fd = 3 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:209/600: open fd = 3 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:210/600: open fd = 3 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.447 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:211/600: open fd = 3 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:212/600: open fd = 3 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:213/600: open fd = 3 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.448 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:214/600: open fd = 3 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:215/600: open fd = 3 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:216/600: open fd = 3 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.449 INFO:tasks.workunit.client.0.smithi052.stdout:217/600: open fd = 3 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:218/600: open fd = 3 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:219/600: open fd = 3 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:220/600: open fd = 3 2024-09-19T09:29:20.450 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:221/600: open fd = 3 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:222/600: open fd = 3 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:223/600: open fd = 3 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.451 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:224/600: open fd = 3 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:225/600: open fd = 3 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:226/600: open fd = 3 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.452 INFO:tasks.workunit.client.0.smithi052.stdout:227/600: open fd = 3 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:228/600: open fd = 3 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:229/600: open fd = 3 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:230/600: open fd = 3 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.453 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:231/600: open fd = 3 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:232/600: open fd = 3 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:233/600: open fd = 3 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.454 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:234/600: open fd = 3 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:235/600: open fd = 3 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:236/600: open fd = 3 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.455 INFO:tasks.workunit.client.0.smithi052.stdout:237/600: open fd = 3 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:238/600: open fd = 3 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:239/600: open fd = 3 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:240/600: open fd = 3 2024-09-19T09:29:20.456 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:241/600: open fd = 3 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:242/600: open fd = 3 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:243/600: open fd = 3 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.457 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:244/600: open fd = 3 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:245/600: open fd = 3 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:246/600: open fd = 3 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.458 INFO:tasks.workunit.client.0.smithi052.stdout:247/600: open fd = 3 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:248/600: open fd = 3 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:249/600: open fd = 3 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:250/600: open fd = 3 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.459 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:29:20.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:29:20.775 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:21.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 -- 172.21.15.52:0/2202499034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c102d40 msgr2=0x7fa69c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2202499034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c102d40 0x7fa69c103120 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fa698009900 tx=0x7fa69802a480 comp rx=0 tx=0).stop 2024-09-19T09:29:21.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 -- 172.21.15.52:0/2202499034 shutdown_connections 2024-09-19T09:29:21.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2202499034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c10c170 0x7fa69c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2202499034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c103660 0x7fa69c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2202499034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c102d40 0x7fa69c103120 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 -- 172.21.15.52:0/2202499034 >> 172.21.15.52:0/2202499034 conn(0x7fa69c0fc7a0 msgr2=0x7fa69c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 -- 172.21.15.52:0/2202499034 shutdown_connections 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.265+0000 7fa6a4788640 1 -- 172.21.15.52:0/2202499034 wait complete. 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 Processor -- start 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 -- start start 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c102d40 0x7fa69c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c103660 0x7fa69c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c111fb0 con 0x7fa69c10c170 2024-09-19T09:29:21.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c111e30 con 0x7fa69c103660 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a4788640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c112130 con 0x7fa69c102d40 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37112/0 (socket says 172.21.15.52:37112) 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 -- 172.21.15.52:0/2523243618 learned_addr learned my addr 172.21.15.52:0/2523243618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c103660 0x7fa69c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2524640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c102d40 0x7fa69c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 -- 172.21.15.52:0/2523243618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c102d40 msgr2=0x7fa69c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c102d40 0x7fa69c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 -- 172.21.15.52:0/2523243618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c103660 msgr2=0x7fa69c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c103660 0x7fa69c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.266+0000 7fa6a2d25640 1 -- 172.21.15.52:0/2523243618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c1a6a30 con 0x7fa69c10c170 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6a2d25640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa69400cad0 tx=0x7fa69400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6937fe640 1 -- 172.21.15.52:0/2523243618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69400ae20 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c1a6d20 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6937fe640 1 -- 172.21.15.52:0/2523243618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa694005020 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6937fe640 1 -- 172.21.15.52:0/2523243618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69400f6f0 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.267+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1a7260 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.269+0000 7fa6937fe640 1 -- 172.21.15.52:0/2523243618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa6940051d0 con 0x7fa69c10c170 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.269+0000 7fa6a6b61740 1 Processor -- start 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 -- start start 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de254a0 0x56134de25880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 0x56134de30140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de32a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56134dd8b2e0 con 0x56134de30680 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56134dd32ce0 con 0x56134de25dc0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56134dd872a0 con 0x56134de254a0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a1d23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de32a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6937fe640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 0x7fa6880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a1d23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de32a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37118/0 (socket says 172.21.15.52:37118) 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a1d23640 1 -- 172.21.15.52:0/424396451 learned_addr learned my addr 172.21.15.52:0/424396451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 0x56134de30140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de254a0 0x56134de25880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2d25640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 0x7fa6880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6937fe640 1 -- 172.21.15.52:0/2523243618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa6940cfa60 con 0x7fa69c10c170 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 -- 172.21.15.52:0/424396451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de254a0 msgr2=0x56134de25880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de254a0 0x56134de25880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 -- 172.21.15.52:0/424396451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 msgr2=0x56134de32a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de32a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.270+0000 7fa6a2524640 1 -- 172.21.15.52:0/424396451 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134dd17440 con 0x56134de25dc0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.271+0000 7fa6a2524640 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 0x56134de30140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa698009230 tx=0x7fa698031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f3adbbde592fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.271+0000 7fa6a2d25640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 0x7fa6880a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa694098400 tx=0x7fa69406ace0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.271+0000 7fa690ff9640 1 -- 172.21.15.52:0/424396451 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69803f070 con 0x56134de25dc0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.271+0000 7fa690ff9640 1 -- 172.21.15.52:0/424396451 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa698031a20 con 0x56134de25dc0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.271+0000 7fa690ff9640 1 -- 172.21.15.52:0/424396451 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698035070 con 0x56134de25dc0 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 -- 172.21.15.52:0/424396451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 msgr2=0x56134de30140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 0x56134de30140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa698009230 tx=0x7fa698031630 comp rx=0 tx=0).stop 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 -- 172.21.15.52:0/424396451 shutdown_connections 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de32a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de25dc0 0x56134de30140 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa698009230 tx=0x7fa698031630 comp rx=0 tx=0).stop 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/424396451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de254a0 0x56134de25880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 -- 172.21.15.52:0/424396451 >> 172.21.15.52:0/424396451 conn(0x56134de21a30 msgr2=0x56134de21e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 -- 172.21.15.52:0/424396451 shutdown_connections 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.272+0000 7fa6a6b61740 1 -- 172.21.15.52:0/424396451 wait complete. 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 -- start start 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 Processor -- start 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de3c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56134de33250 con 0x56134de30680 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56134dd46050 con 0x56134de254a0 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56134de333d0 con 0x56134de2dee0 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a6b61740 10 client.0 _ll_register_callbacks cb 0x56134dd86160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a1d23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a1d23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47658/0 (socket says 172.21.15.52:47658) 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a1d23640 1 -- 172.21.15.52:0/635302410 learned_addr learned my addr 172.21.15.52:0/635302410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37134/0 (socket says 172.21.15.52:37134) 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.273+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de3c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 -- 172.21.15.52:0/635302410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 msgr2=0x56134de3c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de3c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 -- 172.21.15.52:0/635302410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 msgr2=0x56134de2d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 -- 172.21.15.52:0/635302410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134dafc3c0 con 0x56134de254a0 2024-09-19T09:29:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a2524640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006a70 tx=0x7fa68c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba3ebebbf1f15f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa685ffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c013bd0 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa68c00f040 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa698031a20 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa68c02b050 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a6b61740 10 client.27308 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.274+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56134de3f220 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa698031a20 con 0x56134de254a0 2024-09-19T09:29:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa68c0163d0 con 0x56134de254a0 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 10 client.27308 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 10 client.27308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 20 client.27308 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de40630 0x56134de42a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 4 client.27308 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56134dd98850 con 0x56134de40630 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.275+0000 7fa6a2524640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de40630 0x56134de42a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.276+0000 7fa6a2524640 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de40630 0x56134de42a40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10b8f190f91359b8 server_cookie=5a0585a5d8fdf6ec in_seq=0 out_seq=0 2024-09-19T09:29:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.276+0000 7fa685ffb640 10 client.27308 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.276+0000 7fa685ffb640 1 -- 172.21.15.52:0/635302410 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56134dd98850 con 0x56134de40630 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.276+0000 7fa685ffb640 10 client.27308 handle_command_reply: tid=0 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.276+0000 7fa6a6b61740 1 client.27308 shutdown 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 msgr2=0x56134de2d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa68c006a70 tx=0x7fa68c008040 comp rx=0 tx=0).stop 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 shutdown_connections 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de40630 0x56134de42a40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de3c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa685ffb640 0 client.27308 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:21.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de30680 0x56134de2d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/635302410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de254a0 0x56134de2d460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 >> 172.21.15.52:0/635302410 conn(0x56134de21a30 msgr2=0x56134de27760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 shutdown_connections 2024-09-19T09:29:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 1 -- 172.21.15.52:0/635302410 wait complete. 2024-09-19T09:29:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.277+0000 7fa6a6b61740 20 client.27308 trim_cache size 0 max 16384 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 Processor -- start 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 -- start start 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de2a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1b22c0 con 0x56134de254a0 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1afb90 con 0x56134de21a30 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1ad9e0 con 0x56134de2dee0 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37138/0 (socket says 172.21.15.52:37138) 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.294+0000 7fa6a2524640 1 -- 172.21.15.52:0/3480763033 learned_addr learned my addr 172.21.15.52:0/3480763033 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:21.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de2a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 -- 172.21.15.52:0/3480763033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 msgr2=0x56134de2a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de2a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 -- 172.21.15.52:0/3480763033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 msgr2=0x56134de482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 -- 172.21.15.52:0/3480763033 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134de212e0 con 0x56134de254a0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de2a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa6a2524640 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa698009900 tx=0x7fa698005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a544fabf1242eeed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa687fff640 1 -- 172.21.15.52:0/3480763033 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa698035040 con 0x56134de254a0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa687fff640 1 -- 172.21.15.52:0/3480763033 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa698005330 con 0x56134de254a0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.295+0000 7fa687fff640 1 -- 172.21.15.52:0/3480763033 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69803f040 con 0x56134de254a0 2024-09-19T09:29:21.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- 172.21.15.52:0/3480763033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 msgr2=0x56134de48800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fa698009900 tx=0x7fa698005a20 comp rx=0 tx=0).stop 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- 172.21.15.52:0/3480763033 shutdown_connections 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de2a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de48800 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/3480763033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- 172.21.15.52:0/3480763033 >> 172.21.15.52:0/3480763033 conn(0x56134de2db00 msgr2=0x56134de20b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- 172.21.15.52:0/3480763033 shutdown_connections 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- 172.21.15.52:0/3480763033 wait complete. 2024-09-19T09:29:21.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 -- start start 2024-09-19T09:29:21.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.296+0000 7fa6a6b61740 1 Processor -- start 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de36670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de37110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1ae050 con 0x56134de254a0 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1af4c0 con 0x56134de21a30 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1ae720 con 0x56134de2dee0 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 10 client.0 _ll_register_callbacks cb 0x7fa68c0093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37150/0 (socket says 172.21.15.52:37150) 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 -- 172.21.15.52:0/400086188 learned_addr learned my addr 172.21.15.52:0/400086188 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de37110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de36670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 -- 172.21.15.52:0/400086188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 msgr2=0x56134de37110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de37110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 -- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 msgr2=0x56134de36670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de36670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 -- 172.21.15.52:0/400086188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134deb2d80 con 0x56134de254a0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a2524640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa69802a4c0 tx=0x7fa698031890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42fe6e51902b336 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa685ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69803f070 con 0x56134de254a0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa698004230 con 0x56134de254a0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.297+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56134dd92d60 con 0x56134de254a0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa69805b020 con 0x56134de254a0 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 10 client.18273 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56134deb4000 con 0x56134de254a0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56134dd92d60 con 0x56134de254a0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa698055030 con 0x56134de254a0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 10 client.18273 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 20 client.18273 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de30680 0x56134deb61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 4 client.18273 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56134dd0f210 con 0x56134de30680 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.298+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de30680 0x56134deb61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa685ffb640 10 client.18273 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a1d23640 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de30680 0x56134deb61e0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6d69aca8b421d0 server_cookie=13987d1ab219508f in_seq=0 out_seq=0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa685ffb640 1 -- 172.21.15.52:0/400086188 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56134dd0f210 con 0x56134de30680 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa685ffb640 10 client.18273 handle_command_reply: tid=0 2024-09-19T09:29:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 client.18273 shutdown 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 msgr2=0x56134de36bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa69802a4c0 tx=0x7fa698031890 comp rx=0 tx=0).stop 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 shutdown_connections 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56134de30680 0x56134deb61e0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56134de2dee0 0x56134de37110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa685ffb640 0 client.18273 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56134de254a0 0x56134de36bb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 --2- 172.21.15.52:0/400086188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56134de21a30 0x56134de36670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 >> 172.21.15.52:0/400086188 conn(0x56134de2db00 msgr2=0x56134de2ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 shutdown_connections 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 1 -- 172.21.15.52:0/400086188 wait complete. 2024-09-19T09:29:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.299+0000 7fa6a6b61740 20 client.18273 trim_cache size 0 max 16384 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "7ffc799e-234b-40d8-89ed-21ed9adb3115": { 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "7ffc799e-234b-40d8-89ed-21ed9adb3115", 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:29:21.308 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 msgr2=0x7fa6880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 0x7fa6880a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa694098400 tx=0x7fa69406ace0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 msgr2=0x7fa69c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa69400cad0 tx=0x7fa69400cf90 comp rx=0 tx=0).stop 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 shutdown_connections 2024-09-19T09:29:21.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa69c10c170 0x7fa69c101420 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa69c103660 0x7fa69c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa6880a3240 0x7fa6880a5700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 --2- 172.21.15.52:0/2523243618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa69c102d40 0x7fa69c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 >> 172.21.15.52:0/2523243618 conn(0x7fa69c0fc7a0 msgr2=0x7fa69c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 shutdown_connections 2024-09-19T09:29:21.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:21.300+0000 7fa6a4788640 1 -- 172.21.15.52:0/2523243618 wait complete. 2024-09-19T09:29:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:21 smithi086 ceph-mon[34813]: pgmap v575: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:21 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:29:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:21 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:21 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:29:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:21 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.611 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:21 smithi052 ceph-mon[30947]: pgmap v575: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:21.611 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:21 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:29:21.611 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:21 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.611 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:21 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:29:21.611 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:21 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:21 smithi169 ceph-mon[35454]: pgmap v575: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:21 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:29:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:21 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:21 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:29:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:21 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:29:21.991 INFO:tasks.cephfs.filesystem:scrub status for tag:7ffc799e-234b-40d8-89ed-21ed9adb3115 - {'path': '/', 'tag': '7ffc799e-234b-40d8-89ed-21ed9adb3115', 'options': 'recursive,force'} 2024-09-19T09:29:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:23 smithi086 ceph-mon[34813]: pgmap v576: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:23.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:23 smithi052 ceph-mon[30947]: pgmap v576: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:23 smithi169 ceph-mon[35454]: pgmap v576: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 KiB/s wr, 11 op/s 2024-09-19T09:29:24.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:24 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:29:24.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:24 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:29:24.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:24 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:29:25.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:25 smithi052 ceph-mon[30947]: pgmap v577: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:29:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:25 smithi086 ceph-mon[34813]: pgmap v577: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:29:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:25 smithi169 ceph-mon[35454]: pgmap v577: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/502354313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 msgr2=0x7fa9c81020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/502354313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c81020d0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009900 tx=0x7fa9b002a410 comp rx=0 tx=0).stop 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/502354313 shutdown_connections 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/502354313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 0x7fa9c8108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/502354313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c81020d0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/502354313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 0x7fa9c8100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/502354313 >> 172.21.15.52:0/502354313 conn(0x7fa9c80fc1e0 msgr2=0x7fa9c80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/502354313 shutdown_connections 2024-09-19T09:29:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.994+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/502354313 wait complete. 2024-09-19T09:29:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.995+0000 7fa9ce0ae640 1 Processor -- start 2024-09-19T09:29:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.995+0000 7fa9ce0ae640 1 -- start start 2024-09-19T09:29:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 0x7fa9c806ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 0x7fa9c819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c810c730 con 0x7fa9c8101c50 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c810c5b0 con 0x7fa9c8102610 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9ce0ae640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c810c8b0 con 0x7fa9c8100a60 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37168/0 (socket says 172.21.15.52:37168) 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 -- 172.21.15.52:0/3745626011 learned_addr learned my addr 172.21.15.52:0/3745626011 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 0x7fa9c806ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 0x7fa9c819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 -- 172.21.15.52:0/3745626011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 msgr2=0x7fa9c806ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 0x7fa9c806ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 -- 172.21.15.52:0/3745626011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 msgr2=0x7fa9c819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 0x7fa9c819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 -- 172.21.15.52:0/3745626011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c819fa70 con 0x7fa9c8101c50 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.996+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0031440 tx=0x7fa9b0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.997+0000 7fa9c57fa640 1 -- 172.21.15.52:0/3745626011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b003f030 con 0x7fa9c8101c50 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.997+0000 7fa9c57fa640 1 -- 172.21.15.52:0/3745626011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b0003ce0 con 0x7fa9c8101c50 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.997+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c819fca0 con 0x7fa9c8101c50 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.997+0000 7fa9c57fa640 1 -- 172.21.15.52:0/3745626011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0035070 con 0x7fa9c8101c50 2024-09-19T09:29:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.997+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c81a0190 con 0x7fa9c8101c50 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.999+0000 7fa9c57fa640 1 -- 172.21.15.52:0/3745626011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa9b0042030 con 0x7fa9c8101c50 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:26.999+0000 7fa9d0e49740 1 Processor -- start 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 -- start start 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584c2e0 0x5649c5850da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5853830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649c57af2f0 con 0x5649c584b9a0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649c5757270 con 0x5649c5851370 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649c57ab2b0 con 0x5649c584c2e0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37176/0 (socket says 172.21.15.52:37176) 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 -- 172.21.15.52:0/4193126790 learned_addr learned my addr 172.21.15.52:0/4193126790 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c57fa640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 0x7fa9b40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584c2e0 0x5649c5850da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9beffd640 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5853830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 0x7fa9b40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c57fa640 1 -- 172.21.15.52:0/3745626011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9b00efe60 con 0x7fa9c8101c50 2024-09-19T09:29:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 -- 172.21.15.52:0/4193126790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584c2e0 msgr2=0x5649c5850da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584c2e0 0x5649c5850da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 -- 172.21.15.52:0/4193126790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 msgr2=0x5649c5853830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5853830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.000+0000 7fa9c7fff640 1 -- 172.21.15.52:0/4193126790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c5756340 con 0x5649c584b9a0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.001+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005c40 tx=0x7fa9c000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9269b4e86a23a66f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.001+0000 7fa9bdffb640 1 -- 172.21.15.52:0/4193126790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0022020 con 0x5649c584b9a0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.001+0000 7fa9bdffb640 1 -- 172.21.15.52:0/4193126790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c0013170 con 0x5649c584b9a0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.001+0000 7fa9bdffb640 1 -- 172.21.15.52:0/4193126790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0010720 con 0x5649c584b9a0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- 172.21.15.52:0/4193126790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 msgr2=0x5649c584bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 0x7fa9b40a57b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0023000 tx=0x7fa9c0021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0005c40 tx=0x7fa9c000f3c0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- 172.21.15.52:0/4193126790 shutdown_connections 2024-09-19T09:29:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5853830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584c2e0 0x5649c5850da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/4193126790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584b9a0 0x5649c584bda0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- 172.21.15.52:0/4193126790 >> 172.21.15.52:0/4193126790 conn(0x5649c5847010 msgr2=0x5649c5847410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- 172.21.15.52:0/4193126790 shutdown_connections 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- 172.21.15.52:0/4193126790 wait complete. 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 -- start start 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.002+0000 7fa9d0e49740 1 Processor -- start 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584b9a0 0x5649c5855bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 0x5649c585d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5649c5854340 con 0x5649c584c2e0 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5649c5738290 con 0x5649c584b9a0 2024-09-19T09:29:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5649c58544c0 con 0x5649c5851370 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9d0e49740 10 client.0 _ll_register_callbacks cb 0x5649c5769140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37186/0 (socket says 172.21.15.52:37186) 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 -- 172.21.15.52:0/204680034 learned_addr learned my addr 172.21.15.52:0/204680034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584b9a0 0x5649c5855bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 0x5649c585d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 -- 172.21.15.52:0/204680034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 msgr2=0x5649c585d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 0x5649c585d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 -- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584b9a0 msgr2=0x5649c5855bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584b9a0 0x5649c5855bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 -- 172.21.15.52:0/204680034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c54c2210 con 0x5649c584c2e0 2024-09-19T09:29:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 0x5649c585d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9beffd640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00bc3e0 tx=0x7fa9b0049bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2de637b01347dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.003+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0049040 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9b00b8ac0 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c0013170 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9b00bbf90 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 10 client.18285 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5649c558e620 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9c0013170 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9b0049c40 con 0x5649c584c2e0 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 10 client.18285 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 10 client.18285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 20 client.18285 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c5861830 0x5649c5863c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 4 client.18285 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.004+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649c57bca20 con 0x5649c5861830 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.005+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c5861830 0x5649c5863c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.005+0000 7fa9a6ffd640 10 client.18285 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.005+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c5861830 0x5649c5863c70 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2999453074b67f7d server_cookie=5dc7829a338236f4 in_seq=0 out_seq=0 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/204680034 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649c57bca20 con 0x5649c5861830 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9a6ffd640 10 client.18285 handle_command_reply: tid=0 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 client.18285 shutdown 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 msgr2=0x5649c5856130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00bc3e0 tx=0x7fa9b0049bd0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 shutdown_connections 2024-09-19T09:29:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c5861830 0x5649c5863c70 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c5851370 0x5649c585d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c5856130 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/204680034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584b9a0 0x5649c5855bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9a6ffd640 0 client.18285 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 >> 172.21.15.52:0/204680034 conn(0x5649c5847010 msgr2=0x5649c5848820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 shutdown_connections 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 1 -- 172.21.15.52:0/204680034 wait complete. 2024-09-19T09:29:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.006+0000 7fa9d0e49740 20 client.18285 trim_cache size 0 max 16384 2024-09-19T09:29:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 Processor -- start 2024-09-19T09:29:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 -- start start 2024-09-19T09:29:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c5847ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5848400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81aba20 con 0x5649c584c2e0 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81a92f0 con 0x5649c5851370 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81a7140 con 0x5649c584b9a0 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37200/0 (socket says 172.21.15.52:37200) 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 -- 172.21.15.52:0/3181297597 learned_addr learned my addr 172.21.15.52:0/3181297597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c5847ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 -- 172.21.15.52:0/3181297597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 msgr2=0x5649c5847ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c5847ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 -- 172.21.15.52:0/3181297597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 msgr2=0x5649c5848400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.025 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5848400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.021+0000 7fa9beffd640 1 -- 172.21.15.52:0/3181297597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649c58642f0 con 0x5649c584c2e0 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00b7fd0 tx=0x7fa9b0086ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf8bdad5ef6faff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9bd7fa640 1 -- 172.21.15.52:0/3181297597 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00d4030 con 0x5649c584c2e0 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9bd7fa640 1 -- 172.21.15.52:0/3181297597 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b0032e50 con 0x5649c584c2e0 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9bd7fa640 1 -- 172.21.15.52:0/3181297597 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0049050 con 0x5649c584c2e0 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3181297597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 msgr2=0x5649c585d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00b7fd0 tx=0x7fa9b0086ff0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3181297597 shutdown_connections 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c5851370 0x5649c5848400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c584c2e0 0x5649c585d130 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3181297597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c5847ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3181297597 >> 172.21.15.52:0/3181297597 conn(0x5649c5847010 msgr2=0x5649c584d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3181297597 shutdown_connections 2024-09-19T09:29:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.022+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3181297597 wait complete. 2024-09-19T09:29:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 -- start start 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 Processor -- start 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c585ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 0x5649c585b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81a77b0 con 0x5649c5851370 2024-09-19T09:29:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81a8c20 con 0x5649c584c2e0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c81a7e80 con 0x5649c584b9a0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9d0e49740 10 client.0 _ll_register_callbacks cb 0x7fa9b00b80b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37204/0 (socket says 172.21.15.52:37204) 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.023+0000 7fa9c7fff640 1 -- 172.21.15.52:0/3310046960 learned_addr learned my addr 172.21.15.52:0/3310046960 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c585ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 -- 172.21.15.52:0/3310046960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 msgr2=0x5649c585ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c585ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 -- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 msgr2=0x5649c585b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 0x5649c585b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 0x5649c585b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 -- 172.21.15.52:0/3310046960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649c585c790 con 0x5649c5851370 2024-09-19T09:29:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9beffd640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 0x5649c585b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9c7fff640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000f8c0 tx=0x7fa9c000f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143d47283520a19f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0034060 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9c0013170 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b0032e50 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9c0022040 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9d0e49740 10 client.18291 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.024+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5649c58cc930 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b0032e50 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9c0005320 con 0x5649c5851370 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 10 client.18291 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 10 client.18291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 20 client.18291 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c58cd170 0x5649c58cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 4 client.18291 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649c57b6d70 con 0x5649c58cd170 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.025+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c58cd170 0x5649c58cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.026+0000 7fa9a6ffd640 10 client.18291 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.026+0000 7fa9c77fe640 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c58cd170 0x5649c58cf590 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6eef7116984cc84 server_cookie=c740ef97d363252a in_seq=0 out_seq=0 2024-09-19T09:29:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9a6ffd640 1 -- 172.21.15.52:0/3310046960 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5649c57b6d70 con 0x5649c58cd170 2024-09-19T09:29:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9a6ffd640 10 client.18291 handle_command_reply: tid=0 2024-09-19T09:29:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 client.18291 shutdown 2024-09-19T09:29:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 msgr2=0x5649c585c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000f8c0 tx=0x7fa9c000f970 comp rx=0 tx=0).stop 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 shutdown_connections 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5649c58cd170 0x5649c58cf590 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649c5851370 0x5649c585c180 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5649c584c2e0 0x5649c585b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9a6ffd640 0 client.18291 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 --2- 172.21.15.52:0/3310046960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5649c584b9a0 0x5649c585ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 >> 172.21.15.52:0/3310046960 conn(0x5649c5847010 msgr2=0x5649c58459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 shutdown_connections 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 1 -- 172.21.15.52:0/3310046960 wait complete. 2024-09-19T09:29:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.039+0000 7fa9d0e49740 20 client.18291 trim_cache size 0 max 16384 2024-09-19T09:29:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:29:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:29:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:29:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:29:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 msgr2=0x7fa9b40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 0x7fa9b40a57b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0023000 tx=0x7fa9c0021000 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 msgr2=0x7fa9c819cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0031440 tx=0x7fa9b0032ce0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 shutdown_connections 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9c8102610 0x7fa9c819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9c8101c50 0x7fa9c819cb40 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9b40a32f0 0x7fa9b40a57b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 --2- 172.21.15.52:0/3745626011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9c8100a60 0x7fa9c806ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 >> 172.21.15.52:0/3745626011 conn(0x7fa9c80fc1e0 msgr2=0x7fa9c8104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 shutdown_connections 2024-09-19T09:29:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:27.040+0000 7fa9ce0ae640 1 -- 172.21.15.52:0/3745626011 wait complete. 2024-09-19T09:29:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:27 smithi086 ceph-mon[34813]: pgmap v578: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:27.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:27 smithi052 ceph-mon[30947]: pgmap v578: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:27.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:27 smithi169 ceph-mon[35454]: pgmap v578: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:29 smithi086 ceph-mon[34813]: pgmap v579: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:29:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:29 smithi052 ceph-mon[30947]: pgmap v579: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:29:29.839 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:29 smithi169 ceph-mon[35454]: pgmap v579: 97 pgs: 97 active+clean; 3.8 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:29:31.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:31 smithi086 ceph-mon[34813]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:29:31.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:31 smithi052 ceph-mon[30947]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:29:31.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:31 smithi169 ceph-mon[35454]: pgmap v580: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:29:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:32.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:29:32.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:32.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:32.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:32.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:29:32.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:32.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:32.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:32.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:29:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:33 smithi086 ceph-mon[34813]: pgmap v581: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:29:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:33 smithi052 ceph-mon[30947]: pgmap v581: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:29:33.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:33 smithi169 ceph-mon[35454]: pgmap v581: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:29:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:35 smithi086 ceph-mon[34813]: pgmap v582: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:29:35.682 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:35 smithi052 ceph-mon[30947]: pgmap v582: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:29:35.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:35 smithi169 ceph-mon[35454]: pgmap v582: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:29:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:37 smithi086 ceph-mon[34813]: pgmap v583: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:37.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:37 smithi052 ceph-mon[30947]: pgmap v583: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:37.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:37 smithi169 ceph-mon[35454]: pgmap v583: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:39 smithi086 ceph-mon[34813]: pgmap v584: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:39.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:39 smithi052 ceph-mon[30947]: pgmap v584: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:39 smithi169 ceph-mon[35454]: pgmap v584: 97 pgs: 97 active+clean; 3.9 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 -- 172.21.15.52:0/2029714466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24107840 msgr2=0x7f2b24109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/2029714466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24107840 0x7f2b24109cb0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009ca0 tx=0x7f2b1c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 -- 172.21.15.52:0/2029714466 shutdown_connections 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/2029714466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24107840 0x7f2b24109cb0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/2029714466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24104f10 0x7f2b24107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/2029714466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 0x7f2b241049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 -- 172.21.15.52:0/2029714466 >> 172.21.15.52:0/2029714466 conn(0x7f2b240fc1e0 msgr2=0x7f2b240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 -- 172.21.15.52:0/2029714466 shutdown_connections 2024-09-19T09:29:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 -- 172.21.15.52:0/2029714466 wait complete. 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.142+0000 7f2b2aaba640 1 Processor -- start 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 -- start start 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 0x7f2b24101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 0x7f2b24100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410d800 con 0x7f2b24104f10 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410d680 con 0x7f2b24107840 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b2aaba640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410d980 con 0x7f2b241025e0 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40984/0 (socket says 172.21.15.52:40984) 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 -- 172.21.15.52:0/3820446111 learned_addr learned my addr 172.21.15.52:0/3820446111 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b29057640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 0x7f2b24100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b28856640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 0x7f2b24101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 -- 172.21.15.52:0/3820446111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 msgr2=0x7f2b24101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 0x7f2b24101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 -- 172.21.15.52:0/3820446111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 msgr2=0x7f2b24100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 0x7f2b24100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 -- 172.21.15.52:0/3820446111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b24101360 con 0x7f2b24104f10 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b29057640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 0x7f2b24100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.143+0000 7f2b23fff640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d770 tx=0x7f2b1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.144+0000 7f2b21ffb640 1 -- 172.21.15.52:0/3820446111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10017070 con 0x7f2b24104f10 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.144+0000 7f2b21ffb640 1 -- 172.21.15.52:0/3820446111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b10009c30 con 0x7f2b24104f10 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.144+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b241a1f20 con 0x7f2b24104f10 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.144+0000 7f2b21ffb640 1 -- 172.21.15.52:0/3820446111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000f620 con 0x7f2b24104f10 2024-09-19T09:29:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.144+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b241a2380 con 0x7f2b24104f10 2024-09-19T09:29:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b2d859740 1 Processor -- start 2024-09-19T09:29:40.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b21ffb640 1 -- 172.21.15.52:0/3820446111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2b1001a070 con 0x7f2b24104f10 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b2d859740 1 -- start start 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c649a0 0x5604e3c64da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c652e0 0x5604e3c69da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.147+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b2d859740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604e3bc82f0 con 0x5604e3c6a370 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b2d859740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604e3b70270 con 0x5604e3c649a0 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b2d859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604e3bc42b0 con 0x5604e3c652e0 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40996/0 (socket says 172.21.15.52:40996) 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 -- 172.21.15.52:0/2545809500 learned_addr learned my addr 172.21.15.52:0/2545809500 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b29057640 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c649a0 0x5604e3c64da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b28856640 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c652e0 0x5604e3c69da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 -- 172.21.15.52:0/2545809500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c652e0 msgr2=0x5604e3c69da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c652e0 0x5604e3c69da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 -- 172.21.15.52:0/2545809500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c649a0 msgr2=0x5604e3c64da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c649a0 0x5604e3c64da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b21ffb640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 0x7f2b140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 -- 172.21.15.52:0/2545809500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e3b6f340 con 0x5604e3c6a370 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b28856640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 0x7f2b140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2b100cceb0 tx=0x7f2b10097d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18edbe615d2547e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.148+0000 7f2b21ffb640 1 -- 172.21.15.52:0/3820446111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2b100cf4f0 con 0x7f2b24104f10 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b0effd640 1 -- 172.21.15.52:0/2545809500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10021070 con 0x5604e3c6a370 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b0effd640 1 -- 172.21.15.52:0/2545809500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b1009c190 con 0x5604e3c6a370 2024-09-19T09:29:40.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b0effd640 1 -- 172.21.15.52:0/2545809500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100a1f20 con 0x5604e3c6a370 2024-09-19T09:29:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 -- 172.21.15.52:0/2545809500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 msgr2=0x5604e3c6c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f2b100cceb0 tx=0x7f2b10097d30 comp rx=0 tx=0).stop 2024-09-19T09:29:40.156 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b28856640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 0x7f2b140a57b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5604e3c65d10 tx=0x7f2b1800b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 -- 172.21.15.52:0/2545809500 shutdown_connections 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c6a370 0x5604e3c6c830 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c652e0 0x5604e3c69da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2545809500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c649a0 0x5604e3c64da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 -- 172.21.15.52:0/2545809500 >> 172.21.15.52:0/2545809500 conn(0x5604e3c60010 msgr2=0x5604e3c60410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 -- 172.21.15.52:0/2545809500 shutdown_connections 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.149+0000 7f2b2d859740 1 -- 172.21.15.52:0/2545809500 wait complete. 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 -- start start 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 Processor -- start 2024-09-19T09:29:40.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c6eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c76090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604e3c6d280 con 0x5604e3c652e0 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604e3b51290 con 0x5604e3c6a370 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604e3c6d400 con 0x5604e3c649a0 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b2d859740 10 client.0 _ll_register_callbacks cb 0x5604e3b82140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.150+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41008/0 (socket says 172.21.15.52:41008) 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 -- 172.21.15.52:0/2111976734 learned_addr learned my addr 172.21.15.52:0/2111976734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:40.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b29057640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c76090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b28856640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c6eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 -- 172.21.15.52:0/2111976734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 msgr2=0x5604e3c6eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c6eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 -- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 msgr2=0x5604e3c76090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c76090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 -- 172.21.15.52:0/2111976734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e38db210 con 0x5604e3c652e0 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b23fff640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2b1009c340 tx=0x7f2b1009b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19d87f1541c51a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b03fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10021040 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2b10099d90 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1009c190 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2b1009b860 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b2d859740 10 client.18303 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604e39a7620 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.151+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b1009c190 con 0x5604e3c652e0 2024-09-19T09:29:40.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2b10086110 con 0x5604e3c652e0 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 10 client.18303 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 10 client.18303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 20 client.18303 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3c7a390 0x5604e3c7c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 4 client.18303 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604e3bd5a20 con 0x5604e3c7a390 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.152+0000 7f2b28856640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3c7a390 0x5604e3c7c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b28856640 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3c7a390 0x5604e3c7c780 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5d1c3132578884e server_cookie=86212d28bfb51c55 in_seq=0 out_seq=0 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b03fff640 10 client.18303 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b03fff640 1 -- 172.21.15.52:0/2111976734 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604e3bd5a20 con 0x5604e3c7a390 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b03fff640 10 client.18303 handle_command_reply: tid=0 2024-09-19T09:29:40.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 client.18303 shutdown 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 msgr2=0x5604e3c6f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2b1009c340 tx=0x7f2b1009b5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 shutdown_connections 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3c7a390 0x5604e3c7c780 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c76090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c6f050 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b03fff640 0 client.18303 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 --2- 172.21.15.52:0/2111976734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c6eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.153+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 >> 172.21.15.52:0/2111976734 conn(0x5604e3c60010 msgr2=0x5604e3c61820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.154+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 shutdown_connections 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.154+0000 7f2b2d859740 1 -- 172.21.15.52:0/2111976734 wait complete. 2024-09-19T09:29:40.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.154+0000 7f2b2d859740 20 client.18303 trim_cache size 0 max 16384 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 Processor -- start 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 -- start start 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c77040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241addd0 con 0x5604e3c652e0 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241ab6a0 con 0x5604e3c6a370 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.168+0000 7f2b2d859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241a94f0 con 0x5604e3c649a0 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41010/0 (socket says 172.21.15.52:41010) 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 -- 172.21.15.52:0/427960444 learned_addr learned my addr 172.21.15.52:0/427960444 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 -- 172.21.15.52:0/427960444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 msgr2=0x5604e3c76b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b28856640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b29057640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c77040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c76b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 -- 172.21.15.52:0/427960444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 msgr2=0x5604e3c77040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c77040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 -- 172.21.15.52:0/427960444 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604e3c6d540 con 0x5604e3c652e0 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b29057640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c77040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b28856640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b23fff640 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2b10097ef0 tx=0x7f2b10097d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f9f6c0b7882c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b0e7fc640 1 -- 172.21.15.52:0/427960444 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10021070 con 0x5604e3c652e0 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b0e7fc640 1 -- 172.21.15.52:0/427960444 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b1009c190 con 0x5604e3c652e0 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.169+0000 7f2b0e7fc640 1 -- 172.21.15.52:0/427960444 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10098100 con 0x5604e3c652e0 2024-09-19T09:29:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- 172.21.15.52:0/427960444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 msgr2=0x5604e3c76050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2b10097ef0 tx=0x7f2b10097d30 comp rx=0 tx=0).stop 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- 172.21.15.52:0/427960444 shutdown_connections 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c6a370 0x5604e3c77040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c652e0 0x5604e3c76050 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 --2- 172.21.15.52:0/427960444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c649a0 0x5604e3c76b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- 172.21.15.52:0/427960444 >> 172.21.15.52:0/427960444 conn(0x5604e3c60010 msgr2=0x5604e3c66480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- 172.21.15.52:0/427960444 shutdown_connections 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- 172.21.15.52:0/427960444 wait complete. 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 -- start start 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.170+0000 7f2b2d859740 1 Processor -- start 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c652e0 0x5604e3c73540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c6a370 0x5604e3ce2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241a9b60 con 0x5604e3c649a0 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241aafd0 con 0x5604e3c652e0 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241aa230 con 0x5604e3c6a370 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 10 client.0 _ll_register_callbacks cb 0x7f2b1c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41016/0 (socket says 172.21.15.52:41016) 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 -- 172.21.15.52:0/3525561579 learned_addr learned my addr 172.21.15.52:0/3525561579 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 -- 172.21.15.52:0/3525561579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c6a370 msgr2=0x5604e3ce2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.178 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c6a370 0x5604e3ce2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 -- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c652e0 msgr2=0x5604e3c73540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c652e0 0x5604e3c73540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 -- 172.21.15.52:0/3525561579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604e3ce34b0 con 0x5604e3c649a0 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b28856640 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2b1801f550 tx=0x7f2b18014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6430b3a3e5518e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b03fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18027530 con 0x5604e3c649a0 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2b180276d0 con 0x5604e3c649a0 2024-09-19T09:29:40.179 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.171+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1009c190 con 0x5604e3c649a0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2b18035030 con 0x5604e3c649a0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 10 client.18309 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604e3ce47b0 con 0x5604e3c649a0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b1009c190 con 0x5604e3c649a0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2b1803ac80 con 0x5604e3c649a0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 10 client.18309 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 10 client.18309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 20 client.18309 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3ce5190 0x5604e3ce7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 4 client.18309 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604e3bcfd70 con 0x5604e3ce5190 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.172+0000 7f2b23fff640 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3ce5190 0x5604e3ce7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.180 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.173+0000 7f2b03fff640 10 client.18309 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:40.181 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.173+0000 7f2b23fff640 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3ce5190 0x5604e3ce7610 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=904b073e1a673179 server_cookie=ac4634b739479fcc in_seq=0 out_seq=0 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b03fff640 1 -- 172.21.15.52:0/3525561579 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604e3bcfd70 con 0x5604e3ce5190 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b03fff640 10 client.18309 handle_command_reply: tid=0 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 client.18309 shutdown 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 msgr2=0x5604e3c73000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2b1801f550 tx=0x7f2b18014040 comp rx=0 tx=0).stop 2024-09-19T09:29:40.189 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 shutdown_connections 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604e3ce5190 0x5604e3ce7610 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604e3c6a370 0x5604e3ce2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604e3c652e0 0x5604e3c73540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b03fff640 0 client.18309 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 --2- 172.21.15.52:0/3525561579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604e3c649a0 0x5604e3c73000 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 >> 172.21.15.52:0/3525561579 conn(0x5604e3c60010 msgr2=0x5604e3c76b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 shutdown_connections 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 1 -- 172.21.15.52:0/3525561579 wait complete. 2024-09-19T09:29:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.187+0000 7f2b2d859740 20 client.18309 trim_cache size 0 max 16384 2024-09-19T09:29:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:29:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:29:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:29:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 msgr2=0x7f2b140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 0x7f2b140a57b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x5604e3c65d10 tx=0x7f2b1800b4d0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 msgr2=0x7f2b24100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000d770 tx=0x7f2b1000dc30 comp rx=0 tx=0).stop 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 shutdown_connections 2024-09-19T09:29:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b24107840 0x7f2b24100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b24104f10 0x7f2b24100590 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2b140a32f0 0x7f2b140a57b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 --2- 172.21.15.52:0/3820446111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b241025e0 0x7f2b24101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 >> 172.21.15.52:0/3820446111 conn(0x7f2b240fc1e0 msgr2=0x7f2b24102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 shutdown_connections 2024-09-19T09:29:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:40.188+0000 7f2b2aaba640 1 -- 172.21.15.52:0/3820446111 wait complete. 2024-09-19T09:29:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:41 smithi086 ceph-mon[34813]: pgmap v585: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:41.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:41 smithi052 ceph-mon[30947]: pgmap v585: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:41.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:41 smithi169 ceph-mon[35454]: pgmap v585: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:43 smithi086 ceph-mon[34813]: pgmap v586: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:29:43.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:43 smithi052 ceph-mon[30947]: pgmap v586: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:29:43.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:43 smithi169 ceph-mon[35454]: pgmap v586: 97 pgs: 97 active+clean; 4.0 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:29:45.494 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:45 smithi052 ceph-mon[30947]: pgmap v587: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:29:45.495 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:45 smithi169 ceph-mon[35454]: pgmap v587: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:29:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:45 smithi086 ceph-mon[34813]: pgmap v587: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:29:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:47 smithi086 ceph-mon[34813]: pgmap v588: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:47.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:47 smithi052 ceph-mon[30947]: pgmap v588: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:47.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:47 smithi169 ceph-mon[35454]: pgmap v588: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:49.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:49 smithi086 ceph-mon[34813]: pgmap v589: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:49.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:49 smithi052 ceph-mon[30947]: pgmap v589: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:49 smithi169 ceph-mon[35454]: pgmap v589: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:29:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:51 smithi086 ceph-mon[34813]: pgmap v590: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:29:51.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:51 smithi052 ceph-mon[30947]: pgmap v590: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:29:51.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:51 smithi169 ceph-mon[35454]: pgmap v590: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:29:51.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:29:52.268 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:52.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 -- 172.21.15.52:0/2325241115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c106a80 msgr2=0x7fc61c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 --2- 172.21.15.52:0/2325241115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c106a80 0x7fc61c106e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009860 tx=0x7fc60c02a340 comp rx=0 tx=0).stop 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 -- 172.21.15.52:0/2325241115 shutdown_connections 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 --2- 172.21.15.52:0/2325241115 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c101420 0x7fc61c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 --2- 172.21.15.52:0/2325241115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c100a80 0x7fc61c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 --2- 172.21.15.52:0/2325241115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c106a80 0x7fc61c106e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 -- 172.21.15.52:0/2325241115 >> 172.21.15.52:0/2325241115 conn(0x7fc61c0fc7a0 msgr2=0x7fc61c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 -- 172.21.15.52:0/2325241115 shutdown_connections 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.693+0000 7fc622667640 1 -- 172.21.15.52:0/2325241115 wait complete. 2024-09-19T09:29:52.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 Processor -- start 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 -- start start 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 0x7fc61c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c101420 0x7fc61c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c110e80 con 0x7fc61c106a80 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c110d00 con 0x7fc61c100a80 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc622667640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c111000 con 0x7fc61c101420 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc620c04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 0x7fc61c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc620c04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59920/0 (socket says 172.21.15.52:59920) 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc620c04640 1 -- 172.21.15.52:0/334254876 learned_addr learned my addr 172.21.15.52:0/334254876 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.694+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c101420 0x7fc61c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 -- 172.21.15.52:0/334254876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c101420 msgr2=0x7fc61c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c101420 0x7fc61c102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 -- 172.21.15.52:0/334254876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 msgr2=0x7fc61c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 0x7fc61c102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 -- 172.21.15.52:0/334254876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c1a6900 con 0x7fc61c106a80 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc61bfff640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 0x7fc61c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc620c04640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fc61400eb10 tx=0x7fc61400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc6197fa640 1 -- 172.21.15.52:0/334254876 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61400ce20 con 0x7fc61c106a80 2024-09-19T09:29:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c1a6bf0 con 0x7fc61c106a80 2024-09-19T09:29:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc6197fa640 1 -- 172.21.15.52:0/334254876 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc614005020 con 0x7fc61c106a80 2024-09-19T09:29:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc6197fa640 1 -- 172.21.15.52:0/334254876 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614010690 con 0x7fc61c106a80 2024-09-19T09:29:52.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.695+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c1a70e0 con 0x7fc61c106a80 2024-09-19T09:29:52.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.697+0000 7fc6197fa640 1 -- 172.21.15.52:0/334254876 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc614005540 con 0x7fc61c106a80 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 Processor -- start 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 -- start start 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16df8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16df8680 0x55be16dfaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be16d532e0 con 0x55be16ded4a0 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55be16cface0 con 0x55be16df8680 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc624a40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55be16d4f2a0 con 0x55be16deddc0 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59936/0 (socket says 172.21.15.52:59936) 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 -- 172.21.15.52:0/1383826644 learned_addr learned my addr 172.21.15.52:0/1383826644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc6197fa640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 0x7fc6040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16df8680 0x55be16dfaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61bfff640 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16df8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 -- 172.21.15.52:0/1383826644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 msgr2=0x55be16df8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16df8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 -- 172.21.15.52:0/1383826644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16df8680 msgr2=0x55be16dfaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16df8680 0x55be16dfaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.698+0000 7fc61b7fe640 1 -- 172.21.15.52:0/1383826644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be16cdf440 con 0x55be16ded4a0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc620c04640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 0x7fc6040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc6197fa640 1 -- 172.21.15.52:0/334254876 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc6140cfe90 con 0x7fc61c106a80 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc610013600 tx=0x7fc610009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31909cff5460135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc6027fc640 1 -- 172.21.15.52:0/1383826644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610004030 con 0x55be16ded4a0 2024-09-19T09:29:52.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc6027fc640 1 -- 172.21.15.52:0/1383826644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6100041d0 con 0x55be16ded4a0 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.699+0000 7fc6027fc640 1 -- 172.21.15.52:0/1383826644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61000f700 con 0x55be16ded4a0 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- 172.21.15.52:0/1383826644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 msgr2=0x55be16ded880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc610013600 tx=0x7fc610009870 comp rx=0 tx=0).stop 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc620c04640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 0x7fc6040a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc6140049d0 tx=0x7fc614091910 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- 172.21.15.52:0/1383826644 shutdown_connections 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16df8680 0x55be16dfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16df8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 --2- 172.21.15.52:0/1383826644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16ded4a0 0x55be16ded880 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- 172.21.15.52:0/1383826644 >> 172.21.15.52:0/1383826644 conn(0x55be16de9a30 msgr2=0x55be16de9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- 172.21.15.52:0/1383826644 shutdown_connections 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- 172.21.15.52:0/1383826644 wait complete. 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 -- start start 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.700+0000 7fc624a40740 1 Processor -- start 2024-09-19T09:29:52.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16ded4a0 0x55be16df7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16deddc0 0x55be16df5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55be16dfb250 con 0x55be16df8680 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55be16d0e050 con 0x55be16deddc0 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55be16dfb3d0 con 0x55be16ded4a0 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc624a40740 10 client.0 _ll_register_callbacks cb 0x55be16d4e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59946/0 (socket says 172.21.15.52:59946) 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3533981400 learned_addr learned my addr 172.21.15.52:0/3533981400 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16ded4a0 0x55be16df7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16deddc0 0x55be16df5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3533981400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16ded4a0 msgr2=0x55be16df7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16ded4a0 0x55be16df7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16deddc0 msgr2=0x55be16df5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16deddc0 0x55be16df5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3533981400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be16ac43c0 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc610003f20 tx=0x7fc610003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71488d5c5f50eeaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.701+0000 7fc5fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610024060 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc610005250 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6100041d0 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc61002a040 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 10 client.18321 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55be16e06bc0 con 0x55be16df8680 2024-09-19T09:29:52.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6100041d0 con 0x55be16df8680 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc61000f500 con 0x55be16df8680 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 10 client.18321 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 20 client.18321 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e07f10 0x55be16e0a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 4 client.18321 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.702+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be16d60850 con 0x55be16e07f10 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.703+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e07f10 0x55be16e0a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.703+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e07f10 0x55be16e0a300 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e0acd97f654f8e0 server_cookie=c6c9330b6b4b0038 in_seq=0 out_seq=0 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.703+0000 7fc5fb7fe640 10 client.18321 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:52.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3533981400 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be16d60850 con 0x55be16e07f10 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc5fb7fe640 10 client.18321 handle_command_reply: tid=0 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 client.18321 shutdown 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 msgr2=0x55be16df5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc610003f20 tx=0x7fc610003e20 comp rx=0 tx=0).stop 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 shutdown_connections 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e07f10 0x55be16e0a300 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16df5760 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16deddc0 0x55be16df5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc5fb7fe640 0 client.18321 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 --2- 172.21.15.52:0/3533981400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16ded4a0 0x55be16df7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 >> 172.21.15.52:0/3533981400 conn(0x55be16de9a30 msgr2=0x55be16def710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 shutdown_connections 2024-09-19T09:29:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 1 -- 172.21.15.52:0/3533981400 wait complete. 2024-09-19T09:29:52.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.704+0000 7fc624a40740 20 client.18321 trim_cache size 0 max 16384 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.721+0000 7fc624a40740 1 Processor -- start 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.721+0000 7fc624a40740 1 -- start start 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16e044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16df8680 0x55be16e0fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1b2350 con 0x55be16deddc0 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1afc20 con 0x55be16ded4a0 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc624a40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1ada70 con 0x55be16df8680 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59952/0 (socket says 172.21.15.52:59952) 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 -- 172.21.15.52:0/3864998314 learned_addr learned my addr 172.21.15.52:0/3864998314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 -- 172.21.15.52:0/3864998314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16df8680 msgr2=0x55be16e0fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16df8680 0x55be16e0fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16e044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 -- 172.21.15.52:0/3864998314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 msgr2=0x55be16e044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16e044b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 -- 172.21.15.52:0/3864998314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be16df6690 con 0x55be16deddc0 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0095f0 tx=0x7fc60c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b0990a4d5eb097 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc601ffb640 1 -- 172.21.15.52:0/3864998314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c037040 con 0x55be16deddc0 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc601ffb640 1 -- 172.21.15.52:0/3864998314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc60c0309e0 con 0x55be16deddc0 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.722+0000 7fc601ffb640 1 -- 172.21.15.52:0/3864998314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c032440 con 0x55be16deddc0 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- 172.21.15.52:0/3864998314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 msgr2=0x55be16e0f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0095f0 tx=0x7fc60c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- 172.21.15.52:0/3864998314 shutdown_connections 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16df8680 0x55be16e0fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16deddc0 0x55be16e0f990 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 --2- 172.21.15.52:0/3864998314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16e044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- 172.21.15.52:0/3864998314 >> 172.21.15.52:0/3864998314 conn(0x55be16de9a30 msgr2=0x55be16df4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- 172.21.15.52:0/3864998314 shutdown_connections 2024-09-19T09:29:52.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- 172.21.15.52:0/3864998314 wait complete. 2024-09-19T09:29:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.723+0000 7fc624a40740 1 -- start start 2024-09-19T09:29:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 Processor -- start 2024-09-19T09:29:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16dfde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16dfe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1ae0e0 con 0x55be16df8680 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1af550 con 0x55be16ded4a0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c1ae7b0 con 0x55be16deddc0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc624a40740 10 client.0 _ll_register_callbacks cb 0x7fc610013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc61b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59958/0 (socket says 172.21.15.52:59958) 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3816458514 learned_addr learned my addr 172.21.15.52:0/3816458514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16dfde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.724+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16dfe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3816458514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 msgr2=0x55be16dfe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16dfe360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 msgr2=0x55be16dfde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:52.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16dfde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 -- 172.21.15.52:0/3816458514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be16e00a30 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc61b7fe640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc61000f920 tx=0x7fc610009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0126964b14395ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc5fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610024040 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55be16d5ad60 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc610009860 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc61000fd10 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc624a40740 10 client.18327 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55be16e724e0 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.725+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55be16d5ad60 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc610003f50 con 0x55be16df8680 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 10 client.18327 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:52.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 20 client.18327 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e72b50 0x55be16e74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 4 client.18327 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be16cd7210 con 0x55be16e72b50 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e72b50 0x55be16e74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc61bfff640 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e72b50 0x55be16e74f40 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1be9853490db77 server_cookie=35db055f250fe500 in_seq=0 out_seq=0 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.726+0000 7fc5fb7fe640 10 client.18327 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc5fb7fe640 1 -- 172.21.15.52:0/3816458514 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55be16cd7210 con 0x55be16e72b50 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc5fb7fe640 10 client.18327 handle_command_reply: tid=0 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 client.18327 shutdown 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 msgr2=0x55be16e003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc61000f920 tx=0x7fc610009260 comp rx=0 tx=0).stop 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 shutdown_connections 2024-09-19T09:29:52.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55be16e72b50 0x55be16e74f40 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc5fb7fe640 0 client.18327 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55be16df8680 0x55be16e003f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55be16deddc0 0x55be16dfe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 --2- 172.21.15.52:0/3816458514 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55be16ded4a0 0x55be16dfde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 >> 172.21.15.52:0/3816458514 conn(0x55be16de9a30 msgr2=0x55be16df6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 shutdown_connections 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 1 -- 172.21.15.52:0/3816458514 wait complete. 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.727+0000 7fc624a40740 20 client.18327 trim_cache size 0 max 16384 2024-09-19T09:29:52.734 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:29:52.735 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:29:52.735 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:29:52.735 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:29:52.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 msgr2=0x7fc6040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 0x7fc6040a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc6140049d0 tx=0x7fc614091910 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 msgr2=0x7fc61c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fc61400eb10 tx=0x7fc61400ef10 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 shutdown_connections 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc61c106a80 0x7fc61c1030d0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6040a3240 0x7fc6040a5700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc61c101420 0x7fc61c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 --2- 172.21.15.52:0/334254876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc61c100a80 0x7fc61c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 >> 172.21.15.52:0/334254876 conn(0x7fc61c0fc7a0 msgr2=0x7fc61c104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 shutdown_connections 2024-09-19T09:29:52.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:52.728+0000 7fc622667640 1 -- 172.21.15.52:0/334254876 wait complete. 2024-09-19T09:29:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- 172.21.15.52:0/3967854768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e701025e0 msgr2=0x7f1e701049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- 172.21.15.52:0/3967854768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e701025e0 0x7f1e701049d0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f1e60009900 tx=0x7f1e6002a410 comp rx=0 tx=0).stop 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- 172.21.15.52:0/3967854768 shutdown_connections 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- 172.21.15.52:0/3967854768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e70107840 0x7f1e70109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- 172.21.15.52:0/3967854768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70104f10 0x7f1e70107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- 172.21.15.52:0/3967854768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e701025e0 0x7f1e701049d0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- 172.21.15.52:0/3967854768 >> 172.21.15.52:0/3967854768 conn(0x7f1e700fc1e0 msgr2=0x7f1e700fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- 172.21.15.52:0/3967854768 shutdown_connections 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- 172.21.15.52:0/3967854768 wait complete. 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 Processor -- start 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- start start 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e701025e0 0x7f1e70197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70107840 0x7f1e7019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7010d960 con 0x7f1e70104f10 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7010d7e0 con 0x7f1e701025e0 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.280+0000 7f1e771c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7010dae0 con 0x7f1e70107840 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59970/0 (socket says 172.21.15.52:59970) 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 -- 172.21.15.52:0/709689553 learned_addr learned my addr 172.21.15.52:0/709689553 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e75761640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70107840 0x7f1e7019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e74f60640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e701025e0 0x7f1e70197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 -- 172.21.15.52:0/709689553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70107840 msgr2=0x7f1e7019f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70107840 0x7f1e7019f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 -- 172.21.15.52:0/709689553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e701025e0 msgr2=0x7f1e70197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e701025e0 0x7f1e70197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 -- 172.21.15.52:0/709689553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7019fb90 con 0x7f1e70104f10 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400b450 tx=0x7f1e6400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6dffb640 1 -- 172.21.15.52:0/709689553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64015020 con 0x7f1e70104f10 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6dffb640 1 -- 172.21.15.52:0/709689553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e64011d70 con 0x7f1e70104f10 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7019fe80 con 0x7f1e70104f10 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.281+0000 7f1e6dffb640 1 -- 172.21.15.52:0/709689553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400f340 con 0x7f1e70104f10 2024-09-19T09:29:53.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.282+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e701a0370 con 0x7f1e70104f10 2024-09-19T09:29:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.284+0000 7f1e6dffb640 1 -- 172.21.15.52:0/709689553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1e64018020 con 0x7f1e70104f10 2024-09-19T09:29:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.284+0000 7f1e7a038740 1 Processor -- start 2024-09-19T09:29:53.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 -- start start 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ed5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed6370 0x562991ed8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562991e342f0 con 0x562991ed09a0 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562991ddc270 con 0x562991ed12e0 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e7a038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562991e302b0 con 0x562991ed6370 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e6dffb640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 0x7f1e580a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ed5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59974/0 (socket says 172.21.15.52:59974) 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e75761640 1 -- 172.21.15.52:0/3265130471 learned_addr learned my addr 172.21.15.52:0/3265130471 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e75761640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 0x7f1e580a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.292 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e6dffb640 1 -- 172.21.15.52:0/709689553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1e640cf4d0 con 0x7f1e70104f10 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed6370 0x562991ed8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 -- 172.21.15.52:0/3265130471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed6370 msgr2=0x562991ed8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed6370 0x562991ed8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 -- 172.21.15.52:0/3265130471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 msgr2=0x562991ed0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e74f60640 1 -- 172.21.15.52:0/3265130471 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562991ddb340 con 0x562991ed12e0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.285+0000 7f1e75761640 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e75761640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 0x7f1e580a57b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009900 tx=0x7f1e68009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e74f60640 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ed5da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e6002a930 tx=0x7f1e60004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccfd9d4b88d07d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e56ffd640 1 -- 172.21.15.52:0/3265130471 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6003f070 con 0x562991ed12e0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e56ffd640 1 -- 172.21.15.52:0/3265130471 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e60005500 con 0x562991ed12e0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e56ffd640 1 -- 172.21.15.52:0/3265130471 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60035070 con 0x562991ed12e0 2024-09-19T09:29:53.293 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e7a038740 1 -- 172.21.15.52:0/3265130471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 msgr2=0x562991ed5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.286+0000 7f1e7a038740 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ed5da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1e6002a930 tx=0x7f1e60004170 comp rx=0 tx=0).stop 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- 172.21.15.52:0/3265130471 shutdown_connections 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed6370 0x562991ed8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ed5da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- 172.21.15.52:0/3265130471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed09a0 0x562991ed0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- 172.21.15.52:0/3265130471 >> 172.21.15.52:0/3265130471 conn(0x562991ecc010 msgr2=0x562991ecc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- 172.21.15.52:0/3265130471 shutdown_connections 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- 172.21.15.52:0/3265130471 wait complete. 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- start start 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 Processor -- start 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991edab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.294 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991edb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562991ed92e0 con 0x562991ed6370 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562991dbd290 con 0x562991ed12e0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562991ed9460 con 0x562991ed09a0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e7a038740 10 client.0 _ll_register_callbacks cb 0x562991dee140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.287+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59978/0 (socket says 172.21.15.52:59978) 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 -- 172.21.15.52:0/557354341 learned_addr learned my addr 172.21.15.52:0/557354341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e74f60640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991edab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991edb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 -- 172.21.15.52:0/557354341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 msgr2=0x562991edab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991edab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.295 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 -- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 msgr2=0x562991edb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991edb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 -- 172.21.15.52:0/557354341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562991b47210 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e75761640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009fa0 tx=0x7f1e68004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354f9ecca7474698 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6802b060 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1e6801bb40 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e60005500 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e68014040 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e7a038740 10 client.18339 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.288+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562991c13620 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e60005500 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1e68019380 con 0x562991ed6370 2024-09-19T09:29:53.296 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 10 client.18339 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 10 client.18339 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 20 client.18339 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991ee6820 0x562991ee8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 4 client.18339 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562991e41a20 con 0x562991ee6820 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e74f60640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991ee6820 0x562991ee8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e4ffff640 10 client.18339 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.289+0000 7f1e74f60640 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991ee6820 0x562991ee8c30 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48dee88f2171b7ae server_cookie=4e959a41452f30fe in_seq=0 out_seq=0 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e4ffff640 1 -- 172.21.15.52:0/557354341 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562991e41a20 con 0x562991ee6820 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e4ffff640 10 client.18339 handle_command_reply: tid=0 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 client.18339 shutdown 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 msgr2=0x562991ee20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009fa0 tx=0x7f1e68004b50 comp rx=0 tx=0).stop 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 shutdown_connections 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991ee6820 0x562991ee8c30 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee20b0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e4ffff640 0 client.18339 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991edb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 --2- 172.21.15.52:0/557354341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991edab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.290+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 >> 172.21.15.52:0/557354341 conn(0x562991ecc010 msgr2=0x562991ecd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.291+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 shutdown_connections 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.291+0000 7f1e7a038740 1 -- 172.21.15.52:0/557354341 wait complete. 2024-09-19T09:29:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.291+0000 7f1e7a038740 20 client.18339 trim_cache size 0 max 16384 2024-09-19T09:29:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 Processor -- start 2024-09-19T09:29:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 -- start start 2024-09-19T09:29:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991ecb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ee2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701abab0 con 0x562991ed6370 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a9380 con 0x562991ed12e0 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e7a038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a71d0 con 0x562991ed09a0 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59980/0 (socket says 172.21.15.52:59980) 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.306+0000 7f1e75761640 1 -- 172.21.15.52:0/2107718449 learned_addr learned my addr 172.21.15.52:0/2107718449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ee2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e74f60640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991ecb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 -- 172.21.15.52:0/2107718449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 msgr2=0x562991ecb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991ecb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 -- 172.21.15.52:0/2107718449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 msgr2=0x562991ee2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ee2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 -- 172.21.15.52:0/2107718449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562991ecbe30 con 0x562991ed6370 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e74f60640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991ecb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e75761640 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800e040 tx=0x7f1e68009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ec551fdde1b85a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e567fc640 1 -- 172.21.15.52:0/2107718449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68009330 con 0x562991ed6370 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e567fc640 1 -- 172.21.15.52:0/2107718449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6800bd10 con 0x562991ed6370 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e567fc640 1 -- 172.21.15.52:0/2107718449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e680316d0 con 0x562991ed6370 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e7a038740 1 -- 172.21.15.52:0/2107718449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 msgr2=0x562991eed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.307+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800e040 tx=0x7f1e68009fd0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- 172.21.15.52:0/2107718449 shutdown_connections 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991eed530 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed12e0 0x562991ee2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2107718449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed09a0 0x562991ecb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- 172.21.15.52:0/2107718449 >> 172.21.15.52:0/2107718449 conn(0x562991ecc010 msgr2=0x562991eca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- 172.21.15.52:0/2107718449 shutdown_connections 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- 172.21.15.52:0/2107718449 wait complete. 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- start start 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 Processor -- start 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed09a0 0x562991edf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed12e0 0x562991edfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a7840 con 0x562991ed6370 2024-09-19T09:29:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a8cb0 con 0x562991ed09a0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e701a7f10 con 0x562991ed12e0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e7a038740 10 client.0 _ll_register_callbacks cb 0x7f1e68009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.308+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59988/0 (socket says 172.21.15.52:59988) 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 -- 172.21.15.52:0/2618703362 learned_addr learned my addr 172.21.15.52:0/2618703362 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e74f60640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed09a0 0x562991edf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e6ffff640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed12e0 0x562991edfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 -- 172.21.15.52:0/2618703362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed12e0 msgr2=0x562991edfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed12e0 0x562991edfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 -- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed09a0 msgr2=0x562991edf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed09a0 0x562991edf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 -- 172.21.15.52:0/2618703362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562991ee1100 con 0x562991ed6370 2024-09-19T09:29:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e75761640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009d00 tx=0x7f1e68019bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37fd720ce0dde72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68048060 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1e68043450 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6800bd10 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e68009330 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e7a038740 10 client.18345 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.309+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562991ee2380 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6800bd10 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1e68031500 con 0x562991ed6370 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 10 client.18345 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 10 client.18345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 20 client.18345 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991f51b60 0x562991f53f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 4 client.18345 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:29:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562991e3bd70 con 0x562991f51b60 2024-09-19T09:29:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e74f60640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991f51b60 0x562991f53f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.311+0000 7f1e4ffff640 10 client.18345 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.310+0000 7f1e74f60640 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991f51b60 0x562991f53f80 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f8bd5272c7f35ee server_cookie=41babe7c0f75cddd in_seq=0 out_seq=0 2024-09-19T09:29:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e4ffff640 1 -- 172.21.15.52:0/2618703362 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562991e3bd70 con 0x562991f51b60 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e4ffff640 10 client.18345 handle_command_reply: tid=0 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 client.18345 shutdown 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 msgr2=0x562991ee0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009d00 tx=0x7f1e68019bf0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 shutdown_connections 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562991f51b60 0x562991f53f80 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562991ed6370 0x562991ee0af0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562991ed12e0 0x562991edfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e4ffff640 0 client.18345 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 --2- 172.21.15.52:0/2618703362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562991ed09a0 0x562991edf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 >> 172.21.15.52:0/2618703362 conn(0x562991ecc010 msgr2=0x562991ecd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 shutdown_connections 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 1 -- 172.21.15.52:0/2618703362 wait complete. 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.326+0000 7f1e7a038740 20 client.18345 trim_cache size 0 max 16384 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:29:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:29:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 msgr2=0x7f1e580a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 0x7f1e580a57b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009900 tx=0x7f1e68009650 comp rx=0 tx=0).stop 2024-09-19T09:29:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 msgr2=0x7f1e701984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400b450 tx=0x7f1e6400b910 comp rx=0 tx=0).stop 2024-09-19T09:29:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 shutdown_connections 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e580a32f0 0x7f1e580a57b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e70107840 0x7f1e7019f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e70104f10 0x7f1e701984b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 --2- 172.21.15.52:0/709689553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e701025e0 0x7f1e70197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 >> 172.21.15.52:0/709689553 conn(0x7f1e700fc1e0 msgr2=0x7f1e70102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 shutdown_connections 2024-09-19T09:29:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:29:53.327+0000 7f1e771c4640 1 -- 172.21.15.52:0/709689553 wait complete. 2024-09-19T09:29:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:53 smithi086 ceph-mon[34813]: pgmap v591: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:53.530 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:53 smithi052 ceph-mon[30947]: pgmap v591: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:53.559 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:29:53.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:29:53.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:53 smithi169 ceph-mon[35454]: pgmap v591: 97 pgs: 97 active+clean; 4.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:29:53.819 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:54.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 -- 172.21.15.52:0/4112693292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 msgr2=0x7f5c14103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 --2- 172.21.15.52:0/4112693292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14103180 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f5c04009900 tx=0x7f5c0402a480 comp rx=0 tx=0).stop 2024-09-19T09:29:54.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 -- 172.21.15.52:0/4112693292 shutdown_connections 2024-09-19T09:29:54.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 --2- 172.21.15.52:0/4112693292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1410c180 0x7f5c1410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 --2- 172.21.15.52:0/4112693292 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c141036c0 0x7f5c1410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 --2- 172.21.15.52:0/4112693292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14103180 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 -- 172.21.15.52:0/4112693292 >> 172.21.15.52:0/4112693292 conn(0x7f5c140fc7a0 msgr2=0x7f5c140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 -- 172.21.15.52:0/4112693292 shutdown_connections 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 -- 172.21.15.52:0/4112693292 wait complete. 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.317+0000 7f5c18e36640 1 Processor -- start 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 -- start start 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c141036c0 0x7f5c14100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c1410c180 0x7f5c14101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14112020 con 0x7f5c14102da0 2024-09-19T09:29:54.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5c14111ea0 con 0x7f5c141036c0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c18e36640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5c141121a0 con 0x7f5c1410c180 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59994/0 (socket says 172.21.15.52:59994) 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 -- 172.21.15.52:0/1555198864 learned_addr learned my addr 172.21.15.52:0/1555198864 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c12d9d640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c1410c180 0x7f5c14101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c09d9b640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c141036c0 0x7f5c14100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 -- 172.21.15.52:0/1555198864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c1410c180 msgr2=0x7f5c14101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c1410c180 0x7f5c14101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 -- 172.21.15.52:0/1555198864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c141036c0 msgr2=0x7f5c14100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c141036c0 0x7f5c14100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.318+0000 7f5c1259c640 1 -- 172.21.15.52:0/1555198864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c141a6a60 con 0x7f5c14102da0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c1259c640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005ab0 tx=0x7f5c040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0403f030 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c141a6cf0 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c04003ce0 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04035070 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.319+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c141a71c0 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.320+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c14103200 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.321+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5c04042030 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.322+0000 7f5c0bfff640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 0x7f5c000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.322+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5c040f05e0 con 0x7f5c14102da0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.322+0000 7f5c09d9b640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 0x7f5c000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.323+0000 7f5c09d9b640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 0x7f5c000a5700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5c14102490 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.325+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c040bd220 con 0x7f5c14102da0 2024-09-19T09:29:54.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.537+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c14107200 con 0x7f5c14102da0 2024-09-19T09:29:54.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.537+0000 7f5c0bfff640 1 -- 172.21.15.52:0/1555198864 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f5c040bcb20 con 0x7f5c14102da0 2024-09-19T09:29:54.539 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:29:54.539 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:29:54.539 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:29:54.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.539+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 msgr2=0x7f5c000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.539+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 0x7f5c000a5700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5c14102490 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.539+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 msgr2=0x7f5c14100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.539+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f5c04005ab0 tx=0x7f5c040042f0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 shutdown_connections 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5c000a3240 0x7f5c000a5700 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5c1410c180 0x7f5c14101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c141036c0 0x7f5c14100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 --2- 172.21.15.52:0/1555198864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c14102da0 0x7f5c14100a00 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 >> 172.21.15.52:0/1555198864 conn(0x7f5c140fc7a0 msgr2=0x7f5c140fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 shutdown_connections 2024-09-19T09:29:54.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:54.540+0000 7f5c18e36640 1 -- 172.21.15.52:0/1555198864 wait complete. 2024-09-19T09:29:55.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:29:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:55 smithi086 ceph-mon[34813]: pgmap v592: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:55 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1555198864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:55.664 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:55 smithi052 ceph-mon[30947]: pgmap v592: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:55.664 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:55 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1555198864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:55.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:55 smithi169 ceph-mon[35454]: pgmap v592: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:29:55.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:55 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1555198864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:29:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 -- 172.21.15.52:0/2854203665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 msgr2=0x7f509010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 --2- 172.21.15.52:0/2854203665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509010ea90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f5088009ca0 tx=0x7f508802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 -- 172.21.15.52:0/2854203665 shutdown_connections 2024-09-19T09:29:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 --2- 172.21.15.52:0/2854203665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509010ea90 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 --2- 172.21.15.52:0/2854203665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f50901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 --2- 172.21.15.52:0/2854203665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 0x7f50901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 -- 172.21.15.52:0/2854203665 >> 172.21.15.52:0/2854203665 conn(0x7f50900fd8c0 msgr2=0x7f50900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 -- 172.21.15.52:0/2854203665 shutdown_connections 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.008+0000 7f5094da3640 1 -- 172.21.15.52:0/2854203665 wait complete. 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.009+0000 7f5094da3640 1 Processor -- start 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.009+0000 7f5094da3640 1 -- start start 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 0x7f50901983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f5090198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5090111f70 con 0x7f5090106f10 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5090111df0 con 0x7f5090101de0 2024-09-19T09:29:56.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50901120f0 con 0x7f5090102790 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60000/0 (socket says 172.21.15.52:60000) 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 -- 172.21.15.52:0/2987920792 learned_addr learned my addr 172.21.15.52:0/2987920792 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508e59c640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 0x7f50901983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f5090198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 -- 172.21.15.52:0/2987920792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 msgr2=0x7f5090198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f5090198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 -- 172.21.15.52:0/2987920792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 msgr2=0x7f50901983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 0x7f50901983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 -- 172.21.15.52:0/2987920792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509019d3a0 con 0x7f5090106f10 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f5090198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:56.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f508ed9d640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5088031a20 tx=0x7f5088031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f507f7fe640 1 -- 172.21.15.52:0/2987920792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088003c30 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509019d630 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f507f7fe640 1 -- 172.21.15.52:0/2987920792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5088003dd0 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.010+0000 7f507f7fe640 1 -- 172.21.15.52:0/2987920792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508802fcf0 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.011+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50901a4f70 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f507f7fe640 1 -- 172.21.15.52:0/2987920792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5088004050 con 0x7f5090106f10 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f509717c740 1 Processor -- start 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f509717c740 1 -- start start 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f509717c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185cab40 0x5610185c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f509717c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.013+0000 7f509717c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 0x5610185d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f509717c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56101852f2f0 con 0x5610185c95d0 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f509717c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5610184d6cf0 con 0x5610185d4370 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f509717c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56101852b2b0 con 0x5610185cab40 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60016/0 (socket says 172.21.15.52:60016) 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 -- 172.21.15.52:0/2176741685 learned_addr learned my addr 172.21.15.52:0/2176741685 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185cab40 0x5610185c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 0x5610185d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 -- 172.21.15.52:0/2176741685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185cab40 msgr2=0x5610185c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185cab40 0x5610185c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 -- 172.21.15.52:0/2176741685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 msgr2=0x5610185d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 0x5610185d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 -- 172.21.15.52:0/2176741685 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610184bb3a0 con 0x5610185c95d0 2024-09-19T09:29:56.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 0x5610185d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508e59c640 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f508000bd10 tx=0x7f50800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9ee27b29d5c9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f507f7fe640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 0x7f50780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f507cff9640 1 -- 172.21.15.52:0/2176741685 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080004030 con 0x5610185c95d0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f507cff9640 1 -- 172.21.15.52:0/2176741685 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50800041d0 con 0x5610185c95d0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f507cff9640 1 -- 172.21.15.52:0/2176741685 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080011840 con 0x5610185c95d0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 0x7f50780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.014+0000 7f507f7fe640 1 -- 172.21.15.52:0/2987920792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50880f0d10 con 0x7f5090106f10 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 -- 172.21.15.52:0/2176741685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 msgr2=0x5610185c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 0x7f50780a5700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5610185ca070 tx=0x7f5084005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f508000bd10 tx=0x7f50800107a0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 -- 172.21.15.52:0/2176741685 shutdown_connections 2024-09-19T09:29:56.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185d4370 0x5610185d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185c9a10 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 --2- 172.21.15.52:0/2176741685 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185cab40 0x5610185c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 -- 172.21.15.52:0/2176741685 >> 172.21.15.52:0/2176741685 conn(0x561018592310 msgr2=0x5610185c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 -- 172.21.15.52:0/2176741685 shutdown_connections 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.015+0000 7f509717c740 1 -- 172.21.15.52:0/2176741685 wait complete. 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 -- start start 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 Processor -- start 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185c95d0 0x5610185d3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5610185d7070 con 0x5610185d4370 2024-09-19T09:29:56.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5610184ea060 con 0x5610185cab40 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5610185d71f0 con 0x5610185c95d0 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f509717c740 10 client.0 _ll_register_callbacks cb 0x56101823d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f508ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f508ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60018/0 (socket says 172.21.15.52:60018) 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f508ed9d640 1 -- 172.21.15.52:0/3594310615 learned_addr learned my addr 172.21.15.52:0/3594310615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f508dd9b640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.016+0000 7f508e59c640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185c95d0 0x5610185d3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 -- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185c95d0 msgr2=0x5610185d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185c95d0 0x5610185d3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 -- 172.21.15.52:0/3594310615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 msgr2=0x5610185d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 -- 172.21.15.52:0/3594310615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610182a03c0 con 0x5610185d4370 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f508ed9d640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f50880c5b10 tx=0x7f50880bd060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ed71e7e5f00bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880bd460 con 0x5610185d4370 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f50880b9ad0 con 0x5610185d4370 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50800041d0 con 0x5610185d4370 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f50880c1810 con 0x5610185d4370 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f509717c740 10 client.18363 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:56.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5610185d7070 con 0x5610185d4370 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50800041d0 con 0x5610185d4370 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f50880c5c20 con 0x5610185d4370 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f509717c740 10 client.18363 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.017+0000 7f509717c740 10 client.18363 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f509717c740 20 client.18363 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5610185e3f90 0x5610185e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f509717c740 4 client.18363 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56101853c860 con 0x5610185e3f90 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f508e59c640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5610185e3f90 0x5610185e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f508e59c640 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5610185e3f90 0x5610185e63e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d37587ac448f15d server_cookie=8a4758f4fb276f34 in_seq=0 out_seq=0 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.018+0000 7f5075ffb640 10 client.18363 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f5075ffb640 1 -- 172.21.15.52:0/3594310615 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56101853c860 con 0x5610185e3f90 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f5075ffb640 10 client.18363 handle_command_reply: tid=0 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 client.18363 shutdown 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 msgr2=0x5610185d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f50880c5b10 tx=0x7f50880bd060 comp rx=0 tx=0).stop 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 shutdown_connections 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5610185e3f90 0x5610185e63e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185d4370 0x5610185d1640 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185d1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f5075ffb640 0 client.18363 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 --2- 172.21.15.52:0/3594310615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185c95d0 0x5610185d3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 >> 172.21.15.52:0/3594310615 conn(0x561018592310 msgr2=0x5610185cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 shutdown_connections 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 1 -- 172.21.15.52:0/3594310615 wait complete. 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.019+0000 7f509717c740 20 client.18363 trim_cache size 0 max 16384 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.032+0000 7f509717c740 1 Processor -- start 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 -- start start 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 0x5610185c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50901affc0 con 0x5610185cab40 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50901ad890 con 0x5610185c95d0 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f509717c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50901ab6e0 con 0x5610185d4370 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60034/0 (socket says 172.21.15.52:60034) 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 -- 172.21.15.52:0/9544463 learned_addr learned my addr 172.21.15.52:0/9544463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:56.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508e59c640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 0x5610185c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508ed9d640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 -- 172.21.15.52:0/9544463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 msgr2=0x5610185cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 -- 172.21.15.52:0/9544463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 msgr2=0x5610185c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 0x5610185c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 -- 172.21.15.52:0/9544463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610185d6a90 con 0x5610185cab40 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508e59c640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 0x5610185c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.033+0000 7f508dd9b640 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f50840115e0 tx=0x7f5084014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e770525b626c6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f5077fff640 1 -- 172.21.15.52:0/9544463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084020780 con 0x5610185cab40 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f5077fff640 1 -- 172.21.15.52:0/9544463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084020e00 con 0x5610185cab40 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f5077fff640 1 -- 172.21.15.52:0/9544463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084028e20 con 0x5610185cab40 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- 172.21.15.52:0/9544463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 msgr2=0x5610185cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f50840115e0 tx=0x7f5084014040 comp rx=0 tx=0).stop 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- 172.21.15.52:0/9544463 shutdown_connections 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185cab40 0x5610185cc120 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 --2- 172.21.15.52:0/9544463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185c95d0 0x5610185c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- 172.21.15.52:0/9544463 >> 172.21.15.52:0/9544463 conn(0x561018592310 msgr2=0x5610185c44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- 172.21.15.52:0/9544463 shutdown_connections 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- 172.21.15.52:0/9544463 wait complete. 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.034+0000 7f509717c740 1 -- start start 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 Processor -- start 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f50901abd50 con 0x5610185c95d0 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50901ad1c0 con 0x5610185cab40 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f50901ac420 con 0x5610185d4370 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f509717c740 10 client.0 _ll_register_callbacks cb 0x7f5088005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60046/0 (socket says 172.21.15.52:60046) 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 -- 172.21.15.52:0/2710697664 learned_addr learned my addr 172.21.15.52:0/2710697664 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508ed9d640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 -- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 msgr2=0x5610185ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 -- 172.21.15.52:0/2710697664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 msgr2=0x5610185cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:56.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 -- 172.21.15.52:0/2710697664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101864dc90 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f508e59c640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f508000bc30 tx=0x7f508000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffc627e255bf900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.035+0000 7f5075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080003a80 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5080005040 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5084020e00 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5080035020 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 10 client.18369 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56101864ee50 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5084020e00 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f508002e020 con 0x5610185c95d0 2024-09-19T09:29:56.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 10 client.18369 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 10 client.18369 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:29:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 20 client.18369 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:56.060 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:56.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56101864f250 0x561018651640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 4 client.18369 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.036+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561018536d70 con 0x56101864f250 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56101864f250 0x561018651640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f508dd9b640 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56101864f250 0x561018651640 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf7b5af999395def server_cookie=5860d018967a11d5 in_seq=0 out_seq=0 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f5075ffb640 10 client.18369 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f5075ffb640 1 -- 172.21.15.52:0/2710697664 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561018536d70 con 0x56101864f250 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f5075ffb640 10 client.18369 handle_command_reply: tid=0 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 client.18369 shutdown 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 msgr2=0x5610185dcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f508000bc30 tx=0x7f508000bf60 comp rx=0 tx=0).stop 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 shutdown_connections 2024-09-19T09:29:56.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56101864f250 0x561018651640 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5610185d4370 0x5610185ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5610185cab40 0x5610185cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f5075ffb640 0 client.18369 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 --2- 172.21.15.52:0/2710697664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5610185c95d0 0x5610185dcdc0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 >> 172.21.15.52:0/2710697664 conn(0x561018592310 msgr2=0x5610185d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 shutdown_connections 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.037+0000 7f509717c740 1 -- 172.21.15.52:0/2710697664 wait complete. 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f509717c740 20 client.18369 trim_cache size 0 max 16384 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 msgr2=0x7f50780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 0x7f50780a5700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5610185ca070 tx=0x7f5084005850 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 msgr2=0x7f509019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f5088031a20 tx=0x7f5088031a50 comp rx=0 tx=0).stop 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 shutdown_connections 2024-09-19T09:29:56.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5090106f10 0x7f509019ccc0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f50780a3240 0x7f50780a5700 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5090102790 0x7f5090198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 --2- 172.21.15.52:0/2987920792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5090101de0 0x7f50901983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 >> 172.21.15.52:0/2987920792 conn(0x7f50900fd8c0 msgr2=0x7f50900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 shutdown_connections 2024-09-19T09:29:56.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:56.038+0000 7f5094da3640 1 -- 172.21.15.52:0/2987920792 wait complete. 2024-09-19T09:29:56.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:29:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:57 smithi052 ceph-mon[30947]: pgmap v593: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:57 smithi086 ceph-mon[34813]: pgmap v593: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:57.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 -- 172.21.15.52:0/819310236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88100a80 msgr2=0x7fca88100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/819310236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88100a80 0x7fca88100ee0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009930 tx=0x7fca7c02a420 comp rx=0 tx=0).stop 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 -- 172.21.15.52:0/819310236 shutdown_connections 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/819310236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 0x7fca8810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/819310236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88100a80 0x7fca88100ee0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/819310236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88106a80 0x7fca88106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 -- 172.21.15.52:0/819310236 >> 172.21.15.52:0/819310236 conn(0x7fca880fc7a0 msgr2=0x7fca880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 -- 172.21.15.52:0/819310236 shutdown_connections 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 -- 172.21.15.52:0/819310236 wait complete. 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.557+0000 7fca8d0b1640 1 Processor -- start 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 -- start start 2024-09-19T09:29:57.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88100a80 0x7fca88198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 0x7fca88198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca88111f60 con 0x7fca88106a80 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca88111de0 con 0x7fca88101420 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8d0b1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca881120e0 con 0x7fca88100a80 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60068/0 (socket says 172.21.15.52:60068) 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 -- 172.21.15.52:0/477444154 learned_addr learned my addr 172.21.15.52:0/477444154 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8659c640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 0x7fca88198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca86d9d640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88100a80 0x7fca88198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 -- 172.21.15.52:0/477444154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88100a80 msgr2=0x7fca88198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88100a80 0x7fca88198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 -- 172.21.15.52:0/477444154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 msgr2=0x7fca88198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 0x7fca88198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.558+0000 7fca8759e640 1 -- 172.21.15.52:0/477444154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8819d3f0 con 0x7fca88106a80 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca8759e640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fca8000eaa0 tx=0x7fca8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca6ffff640 1 -- 172.21.15.52:0/477444154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8000cdb0 con 0x7fca88106a80 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca8819d6e0 con 0x7fca88106a80 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca6ffff640 1 -- 172.21.15.52:0/477444154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca80005020 con 0x7fca88106a80 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca6ffff640 1 -- 172.21.15.52:0/477444154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca800116b0 con 0x7fca88106a80 2024-09-19T09:29:57.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.559+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca881a4fc0 con 0x7fca88106a80 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.561+0000 7fca6ffff640 1 -- 172.21.15.52:0/477444154 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca80005560 con 0x7fca88106a80 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 Processor -- start 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 -- start start 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca6ffff640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 0x7fca700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eabfba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8659c640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 0x7fca700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac0cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab612f0 con 0x55c1eabfcb40 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab08cf0 con 0x55c1eac0a780 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8f48a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab5d2b0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca6ffff640 1 -- 172.21.15.52:0/477444154 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca800cfb60 con 0x7fca88106a80 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60080/0 (socket says 172.21.15.52:60080) 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 -- 172.21.15.52:0/3088468870 learned_addr learned my addr 172.21.15.52:0/3088468870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8759e640 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac0cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 -- 172.21.15.52:0/3088468870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 msgr2=0x55c1eabfba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eabfba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 -- 172.21.15.52:0/3088468870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 msgr2=0x55c1eac0cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac0cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 -- 172.21.15.52:0/3088468870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1eaaed3a0 con 0x55c1eabfcb40 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca8659c640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 0x7fca700a5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009900 tx=0x7fca7c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.562+0000 7fca86d9d640 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fca7800bc10 tx=0x7fca780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf44b0a6b06e092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca6d7fa640 1 -- 172.21.15.52:0/3088468870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7801c480 con 0x55c1eabfcb40 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca6d7fa640 1 -- 172.21.15.52:0/3088468870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7801cb00 con 0x55c1eabfcb40 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca6d7fa640 1 -- 172.21.15.52:0/3088468870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78011b20 con 0x55c1eabfcb40 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 -- 172.21.15.52:0/3088468870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 msgr2=0x55c1eabfb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fca7800bc10 tx=0x7fca780107a0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 -- 172.21.15.52:0/3088468870 shutdown_connections 2024-09-19T09:29:57.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac0cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eabfba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 --2- 172.21.15.52:0/3088468870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eabfb090 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.563+0000 7fca8f48a740 1 -- 172.21.15.52:0/3088468870 >> 172.21.15.52:0/3088468870 conn(0x55c1eabc4310 msgr2=0x55c1eabf7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- 172.21.15.52:0/3088468870 shutdown_connections 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- 172.21.15.52:0/3088468870 wait complete. 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- start start 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 Processor -- start 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c1eac0d480 con 0x55c1eabfcb40 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c1eab1c060 con 0x55c1eac0a780 2024-09-19T09:29:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c1eac0d600 con 0x55c1eabfb5d0 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8f48a740 10 client.0 _ll_register_callbacks cb 0x55c1ea86f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.564+0000 7fca8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60082/0 (socket says 172.21.15.52:60082) 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 -- 172.21.15.52:0/2778890341 learned_addr learned my addr 172.21.15.52:0/2778890341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8759e640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 -- 172.21.15.52:0/2778890341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 msgr2=0x55c1eac0a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 -- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 msgr2=0x55c1eac079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 -- 172.21.15.52:0/2778890341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1ea8d23c0 con 0x55c1eabfcb40 2024-09-19T09:29:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8659c640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0096c0 tx=0x7fca7c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0758bff88a0e823 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7c035040 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca7c003b80 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7801cb00 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca7c057050 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8f48a740 10 client.18381 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.565+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c1eac18ee0 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca7801cb00 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca7c03c430 con 0x55c1eabfcb40 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 10 client.18381 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 10 client.18381 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 20 client.18381 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac1c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 4 client.18381 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1eab6e860 con 0x55c1eac1a3f0 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac1c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac1c850 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92f2832f933d9c81 server_cookie=93e3b07c43231cbb in_seq=0 out_seq=0 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.566+0000 7fca6aff5640 10 client.18381 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca6aff5640 1 -- 172.21.15.52:0/2778890341 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1eab6e860 con 0x55c1eac1a3f0 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca6aff5640 10 client.18381 handle_command_reply: tid=0 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 client.18381 shutdown 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 msgr2=0x55c1eac073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0096c0 tx=0x7fca7c02a420 comp rx=0 tx=0).stop 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 shutdown_connections 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac1c850 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca6aff5640 0 client.18381 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfcb40 0x55c1eac073f0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2778890341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.567+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 >> 172.21.15.52:0/2778890341 conn(0x55c1eabc4310 msgr2=0x55c1eabfd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.568+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 shutdown_connections 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.568+0000 7fca8f48a740 1 -- 172.21.15.52:0/2778890341 wait complete. 2024-09-19T09:29:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.568+0000 7fca8f48a740 20 client.18381 trim_cache size 0 max 16384 2024-09-19T09:29:57.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 Processor -- start 2024-09-19T09:29:57.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 -- start start 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac16720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 0x55c1eac06cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca881ade60 con 0x55c1eac0a780 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca881ab730 con 0x55c1eabfcb40 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.581+0000 7fca8f48a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca881a9580 con 0x55c1eabfb5d0 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60090/0 (socket says 172.21.15.52:60090) 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 -- 172.21.15.52:0/786592335 learned_addr learned my addr 172.21.15.52:0/786592335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8659c640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 0x55c1eac06cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca86d9d640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac16720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 -- 172.21.15.52:0/786592335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 msgr2=0x55c1eac16720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac16720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 -- 172.21.15.52:0/786592335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 msgr2=0x55c1eac06cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 0x55c1eac06cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 -- 172.21.15.52:0/786592335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1eabfe120 con 0x55c1eac0a780 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8659c640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 0x55c1eac06cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca86d9d640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca8759e640 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fca80098610 tx=0x7fca8009c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5210d5cfd64898e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca6cff9640 1 -- 172.21.15.52:0/786592335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8001f040 con 0x55c1eac0a780 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca6cff9640 1 -- 172.21.15.52:0/786592335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca800a01b0 con 0x55c1eac0a780 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.582+0000 7fca6cff9640 1 -- 172.21.15.52:0/786592335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8009b600 con 0x55c1eac0a780 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- 172.21.15.52:0/786592335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 msgr2=0x55c1eac063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fca80098610 tx=0x7fca8009c000 comp rx=0 tx=0).stop 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- 172.21.15.52:0/786592335 shutdown_connections 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eac0a780 0x55c1eac063d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eabfcb40 0x55c1eac06cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 --2- 172.21.15.52:0/786592335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfb5d0 0x55c1eac16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- 172.21.15.52:0/786592335 >> 172.21.15.52:0/786592335 conn(0x55c1eabc4310 msgr2=0x55c1eac05cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- 172.21.15.52:0/786592335 shutdown_connections 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- 172.21.15.52:0/786592335 wait complete. 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.583+0000 7fca8f48a740 1 -- start start 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 Processor -- start 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfcb40 0x55c1eac0e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac7d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca881a9bf0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fca881ab060 con 0x55c1eac0a780 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fca881aa2c0 con 0x55c1eabfcb40 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8f48a740 10 client.0 _ll_register_callbacks cb 0x7fca7c031630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:57.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60098/0 (socket says 172.21.15.52:60098) 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 -- 172.21.15.52:0/2955361960 learned_addr learned my addr 172.21.15.52:0/2955361960 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8759e640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac7d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca8659c640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfcb40 0x55c1eac0e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 -- 172.21.15.52:0/2955361960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfcb40 msgr2=0x55c1eac0e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfcb40 0x55c1eac0e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 -- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 msgr2=0x55c1eac7d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac7d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.584+0000 7fca86d9d640 1 -- 172.21.15.52:0/2955361960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1eac7d710 con 0x55c1eabfb5d0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca86d9d640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fca78000c00 tx=0x7fca78011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359bd916bf243ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca78005240 con 0x55c1eabfb5d0 2024-09-19T09:29:57.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fca780053e0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca800a01b0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca780055e0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 10 client.18387 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c1eac84a60 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca800a01b0 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fca78004b30 con 0x55c1eabfb5d0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 10 client.18387 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 10 client.18387 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 20 client.18387 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac86ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 4 client.18387 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.585+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1eab68d70 con 0x55c1eac1a3f0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca8659c640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac86ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:57.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca8659c640 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac86ef0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d74f2b65c01ec1f server_cookie=f1d59814b4943d9f in_seq=0 out_seq=0 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca6aff5640 10 client.18387 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca6aff5640 1 -- 172.21.15.52:0/2955361960 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1eab68d70 con 0x55c1eac1a3f0 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca6aff5640 10 client.18387 handle_command_reply: tid=0 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.586+0000 7fca8f48a740 1 client.18387 shutdown 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 msgr2=0x55c1eac0dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fca78000c00 tx=0x7fca78011440 comp rx=0 tx=0).stop 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 shutdown_connections 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c1eac1a3f0 0x55c1eac86ef0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c1eac0a780 0x55c1eac7d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c1eabfcb40 0x55c1eac0e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 --2- 172.21.15.52:0/2955361960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c1eabfb5d0 0x55c1eac0dfd0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 >> 172.21.15.52:0/2955361960 conn(0x55c1eabc4310 msgr2=0x55c1eac064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca6aff5640 0 client.18387 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:29:57.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 shutdown_connections 2024-09-19T09:29:57.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 1 -- 172.21.15.52:0/2955361960 wait complete. 2024-09-19T09:29:57.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8f48a740 20 client.18387 trim_cache size 0 max 16384 2024-09-19T09:29:57.599 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 msgr2=0x7fca700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 0x7fca700a5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009900 tx=0x7fca7c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 msgr2=0x7fca8819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fca8000eaa0 tx=0x7fca8000ef60 comp rx=0 tx=0).stop 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 shutdown_connections 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca88106a80 0x7fca8819cd10 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca88101420 0x7fca88198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fca700a3240 0x7fca700a5700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 --2- 172.21.15.52:0/477444154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fca88100a80 0x7fca88198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.587+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 >> 172.21.15.52:0/477444154 conn(0x7fca880fc7a0 msgr2=0x7fca880fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.588+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 shutdown_connections 2024-09-19T09:29:57.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:57.588+0000 7fca8d0b1640 1 -- 172.21.15.52:0/477444154 wait complete. 2024-09-19T09:29:57.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:57 smithi169 ceph-mon[35454]: pgmap v593: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:29:58.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:29:58.602 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 -- 172.21.15.52:0/3162429260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 msgr2=0x7f23fc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 --2- 172.21.15.52:0/3162429260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc10e610 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009ca0 tx=0x7f23f402a950 comp rx=0 tx=0).stop 2024-09-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 -- 172.21.15.52:0/3162429260 shutdown_connections 2024-09-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 --2- 172.21.15.52:0/3162429260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc10e610 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 --2- 172.21.15.52:0/3162429260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc103660 0x7f23fc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 --2- 172.21.15.52:0/3162429260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc102d40 0x7f23fc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 -- 172.21.15.52:0/3162429260 >> 172.21.15.52:0/3162429260 conn(0x7f23fc0fc7a0 msgr2=0x7f23fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.051+0000 7f24027d0640 1 -- 172.21.15.52:0/3162429260 shutdown_connections 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.052+0000 7f24027d0640 1 -- 172.21.15.52:0/3162429260 wait complete. 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.052+0000 7f24027d0640 1 Processor -- start 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.052+0000 7f24027d0640 1 -- start start 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc102d40 0x7f23fc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc103660 0x7f23fc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc112030 con 0x7f23fc10c170 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc111eb0 con 0x7f23fc103660 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f24027d0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1121b0 con 0x7f23fc102d40 2024-09-19T09:29:59.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53082/0 (socket says 172.21.15.52:53082) 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 -- 172.21.15.52:0/1309196143 learned_addr learned my addr 172.21.15.52:0/1309196143 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc103660 0x7f23fc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f23fbfff640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc102d40 0x7f23fc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 -- 172.21.15.52:0/1309196143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc102d40 msgr2=0x7f23fc1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc102d40 0x7f23fc1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 -- 172.21.15.52:0/1309196143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc103660 msgr2=0x7f23fc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc103660 0x7f23fc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.053+0000 7f2400d6d640 1 -- 172.21.15.52:0/1309196143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc1a69f0 con 0x7f23fc10c170 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f2400d6d640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006010 tx=0x7f23f402f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f23f97fa640 1 -- 172.21.15.52:0/1309196143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4034040 con 0x7f23fc10c170 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f23f97fa640 1 -- 172.21.15.52:0/1309196143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f4003e00 con 0x7f23fc10c170 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc1a6c80 con 0x7f23fc10c170 2024-09-19T09:29:59.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f23f97fa640 1 -- 172.21.15.52:0/1309196143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4045480 con 0x7f23fc10c170 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.054+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1a7160 con 0x7f23fc10c170 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.056+0000 7f23f97fa640 1 -- 172.21.15.52:0/1309196143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f23f4037020 con 0x7f23fc10c170 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.056+0000 7f2404ba9740 1 Processor -- start 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.056+0000 7f2404ba9740 1 -- start start 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b8b40 0x560b3d8b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 0x560b3d8b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d81d2f0 con 0x560b3d8c2370 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560b3d7c4cf0 con 0x560b3d8b75d0 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2404ba9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560b3d8192b0 con 0x560b3d8b8b40 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23f97fa640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 0x7f23e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2400d6d640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 0x7f23e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53098/0 (socket says 172.21.15.52:53098) 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3146174747 learned_addr learned my addr 172.21.15.52:0/3146174747 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fbfff640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 0x560b3d8b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b8b40 0x560b3d8b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23f97fa640 1 -- 172.21.15.52:0/1309196143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f23f40f0a20 con 0x7f23fc10c170 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3146174747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b8b40 msgr2=0x560b3d8b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b8b40 0x560b3d8b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3146174747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 msgr2=0x560b3d8b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 0x560b3d8b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3146174747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d7a93a0 con 0x560b3d8c2370 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fbfff640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 0x560b3d8b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006aa0 tx=0x7f23f0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603aa22ad1f04abc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.057+0000 7f2400d6d640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 0x7f23e40a5700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f23f40b9990 tx=0x7f23f408bd00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f23e27fc640 1 -- 172.21.15.52:0/3146174747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0015760 con 0x560b3d8c2370 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f23e27fc640 1 -- 172.21.15.52:0/3146174747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f001d070 con 0x560b3d8c2370 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f23e27fc640 1 -- 172.21.15.52:0/3146174747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0018b30 con 0x560b3d8c2370 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 -- 172.21.15.52:0/3146174747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 msgr2=0x560b3d8c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f23f0006aa0 tx=0x7f23f0009500 comp rx=0 tx=0).stop 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 -- 172.21.15.52:0/3146174747 shutdown_connections 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8c4760 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b75d0 0x560b3d8b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3146174747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b8b40 0x560b3d8b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 -- 172.21.15.52:0/3146174747 >> 172.21.15.52:0/3146174747 conn(0x560b3d880310 msgr2=0x560b3d8b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 -- 172.21.15.52:0/3146174747 shutdown_connections 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.058+0000 7f2404ba9740 1 -- 172.21.15.52:0/3146174747 wait complete. 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 -- start start 2024-09-19T09:29:59.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 Processor -- start 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b3d8c5010 con 0x560b3d8c2370 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560b3d7d8060 con 0x560b3d8b8b40 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560b3d8c5190 con 0x560b3d8b75d0 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.059+0000 7f2404ba9740 10 client.0 _ll_register_callbacks cb 0x560b3d52b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53102/0 (socket says 172.21.15.52:53102) 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2934302032 learned_addr learned my addr 172.21.15.52:0/2934302032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fbfff640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2934302032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 msgr2=0x560b3d8c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 msgr2=0x560b3d8bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2934302032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d58e3c0 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f23f00185d0 tx=0x7f23f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc761748e812752 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f002a070 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f23f0015730 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.060+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f001d070 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23f0015930 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 10 client.18399 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560b3d8d0ae0 con 0x560b3d8c2370 2024-09-19T09:29:59.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f001d070 con 0x560b3d8c2370 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f23f002d030 con 0x560b3d8c2370 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 10 client.18399 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 10 client.18399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 20 client.18399 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d8d1e30 0x560b3d8d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 4 client.18399 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b3d82a860 con 0x560b3d8d1e30 2024-09-19T09:29:59.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.061+0000 7f23fbfff640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d8d1e30 0x560b3d8d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.062+0000 7f23fbfff640 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d8d1e30 0x560b3d8d4220 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=113ae7359f57894a server_cookie=4d048169118778f3 in_seq=0 out_seq=0 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.062+0000 7f23db7fe640 10 client.18399 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.062+0000 7f23db7fe640 1 -- 172.21.15.52:0/2934302032 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560b3d82a860 con 0x560b3d8d1e30 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.062+0000 7f23db7fe640 10 client.18399 handle_command_reply: tid=0 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.062+0000 7f2404ba9740 1 client.18399 shutdown 2024-09-19T09:29:59.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 msgr2=0x560b3d8bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f23f00185d0 tx=0x7f23f0008040 comp rx=0 tx=0).stop 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 shutdown_connections 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d8d1e30 0x560b3d8d4220 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d8bf600 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f23db7fe640 0 client.18399 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 --2- 172.21.15.52:0/2934302032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 >> 172.21.15.52:0/2934302032 conn(0x560b3d880310 msgr2=0x560b3d8b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 shutdown_connections 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 1 -- 172.21.15.52:0/2934302032 wait complete. 2024-09-19T09:29:59.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.063+0000 7f2404ba9740 20 client.18399 trim_cache size 0 max 16384 2024-09-19T09:29:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 Processor -- start 2024-09-19T09:29:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 -- start start 2024-09-19T09:29:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8c2370 0x560b3d8d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1b22c0 con 0x560b3d8b75d0 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1afb90 con 0x560b3d8b8b40 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f2404ba9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1ad9e0 con 0x560b3d8c2370 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f23fbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53104/0 (socket says 172.21.15.52:53104) 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.076+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3808065687 learned_addr learned my addr 172.21.15.52:0/3808065687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3808065687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8c2370 msgr2=0x560b3d8d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8c2370 0x560b3d8d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3808065687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 msgr2=0x560b3d8d7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 -- 172.21.15.52:0/3808065687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3d8c2090 con 0x560b3d8b75d0 2024-09-19T09:29:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fbfff640 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:29:59.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d794df867f6dde00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23e1ffb640 1 -- 172.21.15.52:0/3808065687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f002a070 con 0x560b3d8b75d0 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23e1ffb640 1 -- 172.21.15.52:0/3808065687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f001d030 con 0x560b3d8b75d0 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f23e1ffb640 1 -- 172.21.15.52:0/3808065687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0021680 con 0x560b3d8b75d0 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f2404ba9740 1 -- 172.21.15.52:0/3808065687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 msgr2=0x560b3d8bdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.077+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f0004640 comp rx=0 tx=0).stop 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- 172.21.15.52:0/3808065687 shutdown_connections 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8c2370 0x560b3d8d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- 172.21.15.52:0/3808065687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8b75d0 0x560b3d8bdf20 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- 172.21.15.52:0/3808065687 >> 172.21.15.52:0/3808065687 conn(0x560b3d880310 msgr2=0x560b3d8bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- 172.21.15.52:0/3808065687 shutdown_connections 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- 172.21.15.52:0/3808065687 wait complete. 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- start start 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 Processor -- start 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.078+0000 7f2404ba9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1ae050 con 0x560b3d8c2370 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f2404ba9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1af4c0 con 0x560b3d8b8b40 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f2404ba9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1ae720 con 0x560b3d8b75d0 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f2404ba9740 10 client.0 _ll_register_callbacks cb 0x7f23ec0093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53112/0 (socket says 172.21.15.52:53112) 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 -- 172.21.15.52:0/115592630 learned_addr learned my addr 172.21.15.52:0/115592630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fbfff640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8d49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 -- 172.21.15.52:0/115592630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 msgr2=0x560b3d8d49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8d49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 -- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 msgr2=0x560b3d8d4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 -- 172.21.15.52:0/115592630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3d934dd0 con 0x560b3d8c2370 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f23f0021ea0 tx=0x7f23f0006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1248c50c86179d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003e070 con 0x560b3d8c2370 2024-09-19T09:29:59.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f001d030 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.079+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f23f0009850 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23f002a040 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 10 client.18405 fetch_fsmap learned FSMap version 24 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560b3d93c160 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f001d030 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f23f002d070 con 0x560b3d8c2370 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 10 client.18405 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 10 client.18405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 20 client.18405 populate_metadata read hostname 'smithi052' 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d93c780 0x560b3d93eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 4 client.18405 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:29:59.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b3d824d70 con 0x560b3d93c780 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.080+0000 7f23fbfff640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d93c780 0x560b3d93eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f23fbfff640 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d93c780 0x560b3d93eba0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c462bd534b75b48 server_cookie=ed747d2e3fbe7f00 in_seq=0 out_seq=0 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f23db7fe640 10 client.18405 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f23db7fe640 1 -- 172.21.15.52:0/115592630 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b3d824d70 con 0x560b3d93c780 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f23db7fe640 10 client.18405 handle_command_reply: tid=0 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 client.18405 shutdown 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 msgr2=0x560b3d934730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f23f0021ea0 tx=0x7f23f0006a30 comp rx=0 tx=0).stop 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 shutdown_connections 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560b3d93c780 0x560b3d93eba0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b3d8c2370 0x560b3d934730 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560b3d8b8b40 0x560b3d8d4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f23db7fe640 0 client.18405 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 --2- 172.21.15.52:0/115592630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560b3d8b75d0 0x560b3d8d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 >> 172.21.15.52:0/115592630 conn(0x560b3d880310 msgr2=0x560b3d8c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 shutdown_connections 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 1 -- 172.21.15.52:0/115592630 wait complete. 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.081+0000 7f2404ba9740 20 client.18405 trim_cache size 0 max 16384 2024-09-19T09:29:59.091 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 msgr2=0x7f23e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 0x7f23e40a5700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f23f40b9990 tx=0x7f23f408bd00 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 msgr2=0x7f23fc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f23f4006010 tx=0x7f23f402f710 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 shutdown_connections 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc10c170 0x7f23fc101420 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23fc103660 0x7f23fc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23e40a3240 0x7f23e40a5700 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 --2- 172.21.15.52:0/1309196143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23fc102d40 0x7f23fc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 >> 172.21.15.52:0/1309196143 conn(0x7f23fc0fc7a0 msgr2=0x7f23fc0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 shutdown_connections 2024-09-19T09:29:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:29:59.082+0000 7f24027d0640 1 -- 172.21.15.52:0/1309196143 wait complete. 2024-09-19T09:29:59.401 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:29:59 smithi052 ceph-mon[30947]: pgmap v594: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:29:59.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:29:59 smithi169 ceph-mon[35454]: pgmap v594: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:29:59.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:29:59 smithi086 ceph-mon[34813]: pgmap v594: 97 pgs: 97 active+clean; 4.2 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:30:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:00 smithi052 ceph-mon[30947]: overall HEALTH_OK 2024-09-19T09:30:01.009 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:30:01.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:30:01.010 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:00 smithi086 ceph-mon[34813]: overall HEALTH_OK 2024-09-19T09:30:01.010 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:00 smithi169 ceph-mon[35454]: overall HEALTH_OK 2024-09-19T09:30:01.285 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:01.406 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:01 smithi052 ceph-mon[30947]: pgmap v595: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:01 smithi169 ceph-mon[35454]: pgmap v595: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:01.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:01 smithi086 ceph-mon[34813]: pgmap v595: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 -- 172.21.15.52:0/787600703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148103660 msgr2=0x7f314810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 --2- 172.21.15.52:0/787600703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148103660 0x7f314810bb50 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f3130009900 tx=0x7f313002a480 comp rx=0 tx=0).stop 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 -- 172.21.15.52:0/787600703 shutdown_connections 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 --2- 172.21.15.52:0/787600703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 0x7f314810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 --2- 172.21.15.52:0/787600703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148103660 0x7f314810bb50 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 --2- 172.21.15.52:0/787600703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148102d40 0x7f3148103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 -- 172.21.15.52:0/787600703 >> 172.21.15.52:0/787600703 conn(0x7f31480fc7a0 msgr2=0x7f31480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 -- 172.21.15.52:0/787600703 shutdown_connections 2024-09-19T09:30:01.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.778+0000 7f314d085640 1 -- 172.21.15.52:0/787600703 wait complete. 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 Processor -- start 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 -- start start 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148103660 0x7f314819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 0x7f314819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3148111f70 con 0x7f3148102d40 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3148111df0 con 0x7f314810c170 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314d085640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31481120f0 con 0x7f3148103660 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f3146d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f3146d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53134/0 (socket says 172.21.15.52:53134) 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f3146d9d640 1 -- 172.21.15.52:0/945191376 learned_addr learned my addr 172.21.15.52:0/945191376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.779+0000 7f314759e640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 0x7f314819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f314659c640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148103660 0x7f314819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 -- 172.21.15.52:0/945191376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148103660 msgr2=0x7f314819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148103660 0x7f314819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 -- 172.21.15.52:0/945191376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 msgr2=0x7f314819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 0x7f314819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 -- 172.21.15.52:0/945191376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314819f660 con 0x7f3148102d40 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f3146d9d640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f313800d770 tx=0x7f313800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f313ffff640 1 -- 172.21.15.52:0/945191376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138017070 con 0x7f3148102d40 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f313ffff640 1 -- 172.21.15.52:0/945191376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3138005500 con 0x7f3148102d40 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314819f950 con 0x7f3148102d40 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f313ffff640 1 -- 172.21.15.52:0/945191376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138004e00 con 0x7f3148102d40 2024-09-19T09:30:01.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.780+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31481a7230 con 0x7f3148102d40 2024-09-19T09:30:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.782+0000 7f313ffff640 1 -- 172.21.15.52:0/945191376 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3138004fa0 con 0x7f3148102d40 2024-09-19T09:30:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 Processor -- start 2024-09-19T09:30:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 -- start start 2024-09-19T09:30:01.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7ab60 0x5633a0c7af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c85800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633a0be0280 con 0x5633a0c85d40 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5633a0b87b10 con 0x5633a0c7b480 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314f45e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5633a0bdc240 con 0x5633a0c7ab60 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53140/0 (socket says 172.21.15.52:53140) 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314659c640 1 -- 172.21.15.52:0/1379567447 learned_addr learned my addr 172.21.15.52:0/1379567447 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.783+0000 7f314759e640 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7ab60 0x5633a0c7af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f3146d9d640 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c85800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 -- 172.21.15.52:0/1379567447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7ab60 msgr2=0x5633a0c7af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7ab60 0x5633a0c7af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 -- 172.21.15.52:0/1379567447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 msgr2=0x5633a0c85800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c85800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f313ffff640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 0x7f31340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 -- 172.21.15.52:0/1379567447 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633a0b941f0 con 0x5633a0c85d40 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314759e640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 0x7f31340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f314659c640 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3130009900 tx=0x7f3130032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e863f89ad520acab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f313ffff640 1 -- 172.21.15.52:0/945191376 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f31380cf420 con 0x7f3148102d40 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f313d7fa640 1 -- 172.21.15.52:0/1379567447 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313003f070 con 0x5633a0c85d40 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f313d7fa640 1 -- 172.21.15.52:0/1379567447 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3130032e20 con 0x5633a0c85d40 2024-09-19T09:30:01.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.784+0000 7f313d7fa640 1 -- 172.21.15.52:0/1379567447 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130035070 con 0x5633a0c85d40 2024-09-19T09:30:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 -- 172.21.15.52:0/1379567447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 msgr2=0x5633a0c88130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314759e640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 0x7f31340a5700 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f314000ae90 tx=0x7f314000a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3130009900 tx=0x7f3130032c30 comp rx=0 tx=0).stop 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 -- 172.21.15.52:0/1379567447 shutdown_connections 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c88130 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c85800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 --2- 172.21.15.52:0/1379567447 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7ab60 0x5633a0c7af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 -- 172.21.15.52:0/1379567447 >> 172.21.15.52:0/1379567447 conn(0x5633a0c770f0 msgr2=0x5633a0c774d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 -- 172.21.15.52:0/1379567447 shutdown_connections 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.785+0000 7f314f45e740 1 -- 172.21.15.52:0/1379567447 wait complete. 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 -- start start 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 Processor -- start 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c83180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5633a0c88910 con 0x5633a0c7ab60 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5633a0b9af10 con 0x5633a0c7b480 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5633a0c88a90 con 0x5633a0c85d40 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314f45e740 10 client.0 _ll_register_callbacks cb 0x5633a0b63a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53152/0 (socket says 172.21.15.52:53152) 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 -- 172.21.15.52:0/62667755 learned_addr learned my addr 172.21.15.52:0/62667755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314759e640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314659c640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c83180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 -- 172.21.15.52:0/62667755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 msgr2=0x5633a0c836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 -- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 msgr2=0x5633a0c83180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c83180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f3146d9d640 1 -- 172.21.15.52:0/62667755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633a09516a0 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314759e640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.786+0000 7f314659c640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c83180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f3146d9d640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f313800d740 tx=0x7f313809b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b610464ef4d4eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138020070 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f31380ccf50 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3130032e20 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f31380046c0 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 10 client.18417 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5633a0c94540 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3130032e20 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3138097fd0 con 0x5633a0c7ab60 2024-09-19T09:30:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 10 client.18417 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 10 client.18417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 20 client.18417 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0c95ba0 0x5633a0c98060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 4 client.18417 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.787+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633a0bed7f0 con 0x5633a0c95ba0 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.788+0000 7f314659c640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0c95ba0 0x5633a0c98060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.788+0000 7f314659c640 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0c95ba0 0x5633a0c98060 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c1b2d24081c967 server_cookie=cf1955bad434ddfa in_seq=0 out_seq=0 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.788+0000 7f312e7fc640 10 client.18417 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f312e7fc640 1 -- 172.21.15.52:0/62667755 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633a0bed7f0 con 0x5633a0c95ba0 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f312e7fc640 10 client.18417 handle_command_reply: tid=0 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 client.18417 shutdown 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 msgr2=0x5633a0c82c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f313800d740 tx=0x7f313809b4a0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 shutdown_connections 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0c95ba0 0x5633a0c98060 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7b480 0x5633a0c83180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 --2- 172.21.15.52:0/62667755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7ab60 0x5633a0c82c40 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 >> 172.21.15.52:0/62667755 conn(0x5633a0c770f0 msgr2=0x5633a0c7cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f312e7fc640 0 client.18417 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 shutdown_connections 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 1 -- 172.21.15.52:0/62667755 wait complete. 2024-09-19T09:30:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.789+0000 7f314f45e740 20 client.18417 trim_cache size 0 max 16384 2024-09-19T09:30:01.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.806+0000 7f314f45e740 1 Processor -- start 2024-09-19T09:30:01.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.806+0000 7f314f45e740 1 -- start start 2024-09-19T09:30:01.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c9d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c7c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31481b2260 con 0x5633a0c7b480 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31481afb30 con 0x5633a0c7ab60 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314f45e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31481ad980 con 0x5633a0c85d40 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53166/0 (socket says 172.21.15.52:53166) 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 -- 172.21.15.52:0/2678838386 learned_addr learned my addr 172.21.15.52:0/2678838386 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314759e640 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c7c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f3146d9d640 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c9d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 -- 172.21.15.52:0/2678838386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 msgr2=0x5633a0c7c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c7c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 -- 172.21.15.52:0/2678838386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 msgr2=0x5633a0c9d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c9d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 -- 172.21.15.52:0/2678838386 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633a0c85510 con 0x5633a0c7b480 2024-09-19T09:30:01.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f314659c640 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3130031550 tx=0x7f3130000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8c2080c125804d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.807+0000 7f313cff9640 1 -- 172.21.15.52:0/2678838386 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130035040 con 0x5633a0c7b480 2024-09-19T09:30:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f313cff9640 1 -- 172.21.15.52:0/2678838386 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313004c330 con 0x5633a0c7b480 2024-09-19T09:30:01.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f313cff9640 1 -- 172.21.15.52:0/2678838386 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313003f040 con 0x5633a0c7b480 2024-09-19T09:30:01.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 -- 172.21.15.52:0/2678838386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 msgr2=0x5633a0c9dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3130031550 tx=0x7f3130000bc0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 -- 172.21.15.52:0/2678838386 shutdown_connections 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c85d40 0x5633a0c7c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c7b480 0x5633a0c9dd10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 --2- 172.21.15.52:0/2678838386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c9d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 -- 172.21.15.52:0/2678838386 >> 172.21.15.52:0/2678838386 conn(0x5633a0c770f0 msgr2=0x5633a0c81d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 -- 172.21.15.52:0/2678838386 shutdown_connections 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.808+0000 7f314f45e740 1 -- 172.21.15.52:0/2678838386 wait complete. 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 -- start start 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 Processor -- start 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c8e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7b480 0x5633a0c7f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f31481adff0 con 0x5633a0c85d40 2024-09-19T09:30:01.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f31481af460 con 0x5633a0c7ab60 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31481ae6c0 con 0x5633a0c7b480 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314f45e740 10 client.0 _ll_register_callbacks cb 0x7f31380d2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314659c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7b480 0x5633a0c7f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53182/0 (socket says 172.21.15.52:53182) 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f314759e640 1 -- 172.21.15.52:0/538464658 learned_addr learned my addr 172.21.15.52:0/538464658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.809+0000 7f3146d9d640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c8e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 -- 172.21.15.52:0/538464658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7b480 msgr2=0x5633a0c7f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7b480 0x5633a0c7f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 -- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 msgr2=0x5633a0c8e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c8e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 -- 172.21.15.52:0/538464658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633a0c80690 con 0x5633a0c85d40 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314759e640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f314000fd90 tx=0x7f3140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56ead29b49da580 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:01.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f312e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314002c060 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f314001d930 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f313004c330 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f314001db30 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314f45e740 10 client.18423 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5633a0d00810 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.810+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313004c330 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3140027400 con 0x5633a0c85d40 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 10 client.18423 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 20 client.18423 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0d00fc0 0x5633a0d033e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:01.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 4 client.18423 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:30:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5633a0be7d00 con 0x5633a0d00fc0 2024-09-19T09:30:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f3146d9d640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0d00fc0 0x5633a0d033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f312e7fc640 10 client.18423 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:01.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.811+0000 7f3146d9d640 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0d00fc0 0x5633a0d033e0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e25f277a20dec74 server_cookie=df3fb1a320537940 in_seq=0 out_seq=0 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f312e7fc640 1 -- 172.21.15.52:0/538464658 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5633a0be7d00 con 0x5633a0d00fc0 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f312e7fc640 10 client.18423 handle_command_reply: tid=0 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 client.18423 shutdown 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 msgr2=0x5633a0c7fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f314000fd90 tx=0x7f3140004a40 comp rx=0 tx=0).stop 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 shutdown_connections 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5633a0d00fc0 0x5633a0d033e0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5633a0c85d40 0x5633a0c7fe80 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5633a0c7b480 0x5633a0c7f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 --2- 172.21.15.52:0/538464658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5633a0c7ab60 0x5633a0c8e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 >> 172.21.15.52:0/538464658 conn(0x5633a0c770f0 msgr2=0x5633a0c7c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.812+0000 7f312e7fc640 0 client.18423 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 shutdown_connections 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314f45e740 1 -- 172.21.15.52:0/538464658 wait complete. 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314f45e740 20 client.18423 trim_cache size 0 max 16384 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "1fd3ad61-73f3-431d-b66b-8247ded65714", 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:30:01.818 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 msgr2=0x7f31340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 0x7f31340a5700 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f314000ae90 tx=0x7f314000a4d0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 msgr2=0x7f314819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f313800d770 tx=0x7f313800dc30 comp rx=0 tx=0).stop 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 shutdown_connections 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f314810c170 0x7f314819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f31340a3240 0x7f31340a5700 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3148103660 0x7f314819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 --2- 172.21.15.52:0/945191376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3148102d40 0x7f314819a750 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:01.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 >> 172.21.15.52:0/945191376 conn(0x7f31480fc7a0 msgr2=0x7f31480fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:01.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 shutdown_connections 2024-09-19T09:30:01.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:01.813+0000 7f314d085640 1 -- 172.21.15.52:0/945191376 wait complete. 2024-09-19T09:30:02.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:30:02.830 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:03.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 -- 172.21.15.52:0/2353634266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74841036e0 msgr2=0x7f7484107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 --2- 172.21.15.52:0/2353634266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74841036e0 0x7f7484107b90 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f7478009930 tx=0x7f747802a420 comp rx=0 tx=0).stop 2024-09-19T09:30:03.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 -- 172.21.15.52:0/2353634266 shutdown_connections 2024-09-19T09:30:03.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 --2- 172.21.15.52:0/2353634266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841082a0 0x7f748410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 --2- 172.21.15.52:0/2353634266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74841036e0 0x7f7484107b90 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 --2- 172.21.15.52:0/2353634266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7484102d30 0x7f7484103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 -- 172.21.15.52:0/2353634266 >> 172.21.15.52:0/2353634266 conn(0x7f74840fc7d0 msgr2=0x7f74840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 -- 172.21.15.52:0/2353634266 shutdown_connections 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 -- 172.21.15.52:0/2353634266 wait complete. 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.304+0000 7f748c71b640 1 Processor -- start 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 -- start start 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841036e0 0x7f7484198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 0x7f748419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74841120a0 con 0x7f7484102d30 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7484111f20 con 0x7f74841036e0 2024-09-19T09:30:03.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748c71b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7484112220 con 0x7f74841082a0 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53202/0 (socket says 172.21.15.52:53202) 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 -- 172.21.15.52:0/3438042476 learned_addr learned my addr 172.21.15.52:0/3438042476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748acb8640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 0x7f748419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f7489cb6640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841036e0 0x7f7484198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 -- 172.21.15.52:0/3438042476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 msgr2=0x7f748419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 0x7f748419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 -- 172.21.15.52:0/3438042476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841036e0 msgr2=0x7f7484198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841036e0 0x7f7484198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 -- 172.21.15.52:0/3438042476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748419d590 con 0x7f7484102d30 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748acb8640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 0x7f748419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.305+0000 7f748a4b7640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e9f0 tx=0x7f747c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.306+0000 7f74837fe640 1 -- 172.21.15.52:0/3438042476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c00cd80 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.306+0000 7f74837fe640 1 -- 172.21.15.52:0/3438042476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747c005500 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.306+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748419d880 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.306+0000 7f74837fe640 1 -- 172.21.15.52:0/3438042476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c010690 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.306+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74841a5160 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.308+0000 7f74837fe640 1 -- 172.21.15.52:0/3438042476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f747c0046c0 con 0x7f7484102d30 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.308+0000 7f748eaf4740 1 Processor -- start 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 -- start start 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83166880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83171140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564f830cc2e0 con 0x564f83171680 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564f83073ce0 con 0x564f83166dc0 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748eaf4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f830c82a0 con 0x564f831664a0 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53208/0 (socket says 172.21.15.52:53208) 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 -- 172.21.15.52:0/3347587920 learned_addr learned my addr 172.21.15.52:0/3347587920 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748a4b7640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748acb8640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83166880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 -- 172.21.15.52:0/3347587920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 msgr2=0x564f83166880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f74837fe640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 0x7f746c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83166880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 -- 172.21.15.52:0/3347587920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 msgr2=0x564f83171140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83171140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f7489cb6640 1 -- 172.21.15.52:0/3347587920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83058440 con 0x564f83171680 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748a4b7640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83171140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.309+0000 7f748acb8640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 0x7f746c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f74837fe640 1 -- 172.21.15.52:0/3438042476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f747c0cfe20 con 0x7f7484102d30 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f7489cb6640 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af789504ed1f63a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f7480ff9640 1 -- 172.21.15.52:0/3347587920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478040070 con 0x564f83171680 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f748acb8640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 0x7f746c0a5700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7474005fd0 tx=0x7f7474004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f7480ff9640 1 -- 172.21.15.52:0/3347587920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7478004030 con 0x564f83171680 2024-09-19T09:30:03.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.310+0000 7f7480ff9640 1 -- 172.21.15.52:0/3347587920 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478035040 con 0x564f83171680 2024-09-19T09:30:03.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- 172.21.15.52:0/3347587920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 msgr2=0x564f83173a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f7478000c00 tx=0x7f7478005e80 comp rx=0 tx=0).stop 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- 172.21.15.52:0/3347587920 shutdown_connections 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83173a70 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83171140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 --2- 172.21.15.52:0/3347587920 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83166880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- 172.21.15.52:0/3347587920 >> 172.21.15.52:0/3347587920 conn(0x564f83162a30 msgr2=0x564f83162e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- 172.21.15.52:0/3347587920 shutdown_connections 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- 172.21.15.52:0/3347587920 wait complete. 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 -- start start 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.311+0000 7f748eaf4740 1 Processor -- start 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83170ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f8316e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564f83174250 con 0x564f83171680 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564f83087050 con 0x564f83166dc0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f831743d0 con 0x564f831664a0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748eaf4740 10 client.0 _ll_register_callbacks cb 0x564f830c7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53216/0 (socket says 172.21.15.52:53216) 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 -- 172.21.15.52:0/1670991311 learned_addr learned my addr 172.21.15.52:0/1670991311 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83170ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f7489cb6640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f8316e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 -- 172.21.15.52:0/1670991311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 msgr2=0x564f83170ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83170ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 -- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 msgr2=0x564f8316e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f8316e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 -- 172.21.15.52:0/1670991311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f82e3d3c0 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f7489cb6640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f8316e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f748acb8640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f747400f940 tx=0x7f7474004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d67a7b28ac7728f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.312+0000 7f7469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747401ede0 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f747401b410 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7478004030 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f747401b610 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 10 client.18435 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f8317fc80 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7478004030 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7474025070 con 0x564f83171680 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 10 client.18435 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 10 client.18435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:03.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 20 client.18435 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f83181130 0x564f831835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 4 client.18435 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.313+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f830d9850 con 0x564f83181130 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.314+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f83181130 0x564f831835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.314+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f83181130 0x564f831835d0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e514f8f1f383134 server_cookie=207e6d9b16a2a46f in_seq=0 out_seq=0 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.314+0000 7f7469ffb640 10 client.18435 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f7469ffb640 1 -- 172.21.15.52:0/1670991311 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f830d9850 con 0x564f83181130 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f7469ffb640 10 client.18435 handle_command_reply: tid=0 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 client.18435 shutdown 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 msgr2=0x564f8316e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f747400f940 tx=0x7f7474004ab0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 shutdown_connections 2024-09-19T09:30:03.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f83181130 0x564f831835d0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f8316e800 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f8316e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1670991311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f83170ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 >> 172.21.15.52:0/1670991311 conn(0x564f83162a30 msgr2=0x564f83168710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f7469ffb640 0 client.18435 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 shutdown_connections 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 1 -- 172.21.15.52:0/1670991311 wait complete. 2024-09-19T09:30:03.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.315+0000 7f748eaf4740 20 client.18435 trim_cache size 0 max 16384 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 Processor -- start 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 -- start start 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f8317d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83188ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74841b0080 con 0x564f83171680 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ad950 con 0x564f83166dc0 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748eaf4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ab7a0 con 0x564f831664a0 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53232/0 (socket says 172.21.15.52:53232) 2024-09-19T09:30:03.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.332+0000 7f748acb8640 1 -- 172.21.15.52:0/1376041560 learned_addr learned my addr 172.21.15.52:0/1376041560 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f8317d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f7489cb6640 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83188ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 -- 172.21.15.52:0/1376041560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 msgr2=0x564f8317d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f8317d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 -- 172.21.15.52:0/1376041560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 msgr2=0x564f83188ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83188ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 -- 172.21.15.52:0/1376041560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83171360 con 0x564f83171680 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f748acb8640 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f7474012db0 tx=0x7f7474009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946f1f04c500ea3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f746bfff640 1 -- 172.21.15.52:0/1376041560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747401ebe0 con 0x564f83171680 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f746bfff640 1 -- 172.21.15.52:0/1376041560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747401ed80 con 0x564f83171680 2024-09-19T09:30:03.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.333+0000 7f746bfff640 1 -- 172.21.15.52:0/1376041560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740276f0 con 0x564f83171680 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- 172.21.15.52:0/1376041560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 msgr2=0x564f831893e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f7474012db0 tx=0x7f7474009af0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- 172.21.15.52:0/1376041560 shutdown_connections 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f831893e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83188ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1376041560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f8317d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- 172.21.15.52:0/1376041560 >> 172.21.15.52:0/1376041560 conn(0x564f83162a30 msgr2=0x564f83169870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- 172.21.15.52:0/1376041560 shutdown_connections 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- 172.21.15.52:0/1376041560 wait complete. 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- start start 2024-09-19T09:30:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 Processor -- start 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f831e7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83179620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74841abe10 con 0x564f83171680 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.334+0000 7f748eaf4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ad280 con 0x564f83166dc0 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748eaf4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74841ac4e0 con 0x564f831664a0 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748eaf4740 10 client.0 _ll_register_callbacks cb 0x7f7474009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53238/0 (socket says 172.21.15.52:53238) 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 -- 172.21.15.52:0/1640514760 learned_addr learned my addr 172.21.15.52:0/1640514760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f831e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:03 smithi052 ceph-mon[30947]: pgmap v596: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:03.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:03 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:30:03.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:03 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:03 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:30:03.339 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:03 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f7489cb6640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83179620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 -- 172.21.15.52:0/1640514760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 msgr2=0x564f831e7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f831e7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 -- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 msgr2=0x564f83179620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83179620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 -- 172.21.15.52:0/1640514760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8317a1a0 con 0x564f83171680 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748acb8640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7474031aa0 tx=0x7f747401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a62a96b1d39657b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f7469ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747401ebe0 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7474031690 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.335+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f747401ed80 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7474005040 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 10 client.18441 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f831f0280 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747401ed80 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7474025070 con 0x564f83171680 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 10 client.18441 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 10 client.18441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 20 client.18441 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f831f0880 0x564f831f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 4 client.18441 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564f830d3d60 con 0x564f831f0880 2024-09-19T09:30:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.336+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f831f0880 0x564f831f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748a4b7640 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f831f0880 0x564f831f2c70 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c36f887894e322 server_cookie=afe12c0d90a46600 in_seq=0 out_seq=0 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f7469ffb640 10 client.18441 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f7469ffb640 1 -- 172.21.15.52:0/1640514760 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564f830d3d60 con 0x564f831f0880 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f7469ffb640 10 client.18441 handle_command_reply: tid=0 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 client.18441 shutdown 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 msgr2=0x564f83179b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7474031aa0 tx=0x7f747401beb0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 shutdown_connections 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f831f0880 0x564f831f2c70 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f7469ffb640 0 client.18441 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f83171680 0x564f83179b60 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f83166dc0 0x564f83179620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 --2- 172.21.15.52:0/1640514760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f831664a0 0x564f831e7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 >> 172.21.15.52:0/1640514760 conn(0x564f83162a30 msgr2=0x564f83167ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 shutdown_connections 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 1 -- 172.21.15.52:0/1640514760 wait complete. 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.337+0000 7f748eaf4740 20 client.18441 trim_cache size 0 max 16384 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:30:03.344 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 msgr2=0x7f746c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 0x7f746c0a5700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7474005fd0 tx=0x7f7474004a40 comp rx=0 tx=0).stop 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 msgr2=0x7f74841985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e9f0 tx=0x7f747c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 shutdown_connections 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f746c0a3240 0x7f746c0a5700 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74841082a0 0x7f748419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74841036e0 0x7f7484198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 --2- 172.21.15.52:0/3438042476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7484102d30 0x7f74841985e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 >> 172.21.15.52:0/3438042476 conn(0x7f74840fc7d0 msgr2=0x7f7484105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 shutdown_connections 2024-09-19T09:30:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:03.338+0000 7f748c71b640 1 -- 172.21.15.52:0/3438042476 wait complete. 2024-09-19T09:30:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:03 smithi169 ceph-mon[35454]: pgmap v596: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:03.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:03 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:30:03.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:03 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:03 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:30:03.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:03 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:03 smithi086 ceph-mon[34813]: pgmap v596: 97 pgs: 97 active+clean; 4.3 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:03 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:30:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:03 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:03 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:30:03.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:03 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:03.970 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:30:03.970 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:30:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:04.594 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:04 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:30:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 -- 172.21.15.52:0/709383235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 msgr2=0x7fc82810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 --2- 172.21.15.52:0/709383235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82810e610 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc820009ca0 tx=0x7fc82002a950 comp rx=0 tx=0).stop 2024-09-19T09:30:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 -- 172.21.15.52:0/709383235 shutdown_connections 2024-09-19T09:30:04.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 --2- 172.21.15.52:0/709383235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82810e610 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 --2- 172.21.15.52:0/709383235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 0x7fc82810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 --2- 172.21.15.52:0/709383235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 0x7fc828103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 -- 172.21.15.52:0/709383235 >> 172.21.15.52:0/709383235 conn(0x7fc8280fc7a0 msgr2=0x7fc8280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 -- 172.21.15.52:0/709383235 shutdown_connections 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.674+0000 7fc82f652640 1 -- 172.21.15.52:0/709383235 wait complete. 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 Processor -- start 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 -- start start 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 0x7fc82819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 0x7fc82819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc828111f70 con 0x7fc82810c170 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc828111df0 con 0x7fc828103660 2024-09-19T09:30:04.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82f652640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281120f0 con 0x7fc828102d40 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82dbef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82d3ee640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 0x7fc82819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82dbef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53250/0 (socket says 172.21.15.52:53250) 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82dbef640 1 -- 172.21.15.52:0/4120411906 learned_addr learned my addr 172.21.15.52:0/4120411906 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.675+0000 7fc82cbed640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 0x7fc82819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 -- 172.21.15.52:0/4120411906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 msgr2=0x7fc82819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 0x7fc82819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 -- 172.21.15.52:0/4120411906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 msgr2=0x7fc82819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 0x7fc82819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 -- 172.21.15.52:0/4120411906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82819f620 con 0x7fc82810c170 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82dbef640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc82002ae70 tx=0x7fc82002f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820034040 con 0x7fc82810c170 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82819f8b0 con 0x7fc82810c170 2024-09-19T09:30:04.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.676+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a71f0 con 0x7fc82810c170 2024-09-19T09:30:04.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.677+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8200098d0 con 0x7fc82810c170 2024-09-19T09:30:04.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.677+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820045770 con 0x7fc82810c170 2024-09-19T09:30:04.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.678+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80c005290 con 0x7fc82810c170 2024-09-19T09:30:04.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.680+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc820037020 con 0x7fc82810c170 2024-09-19T09:30:04.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.680+0000 7fc81e7fc640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 0x7fc8140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:04.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.681+0000 7fc82d3ee640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 0x7fc8140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:04.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.681+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc8200f0be0 con 0x7fc82810c170 2024-09-19T09:30:04.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.681+0000 7fc82d3ee640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 0x7fc8140a5780 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc824005fd0 tx=0x7fc82400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:04.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.684+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc82004a060 con 0x7fc82810c170 2024-09-19T09:30:04.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:04 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:30:04.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:04 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:30:04.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.896+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc80c005580 con 0x7fc82810c170 2024-09-19T09:30:04.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.897+0000 7fc81e7fc640 1 -- 172.21.15.52:0/4120411906 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fc8200bd820 con 0x7fc82810c170 2024-09-19T09:30:04.898 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:30:04.898 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:30:04.899 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 msgr2=0x7fc8140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 0x7fc8140a5780 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc824005fd0 tx=0x7fc82400b390 comp rx=0 tx=0).stop 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 msgr2=0x7fc82819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc82002ae70 tx=0x7fc82002f5b0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 shutdown_connections 2024-09-19T09:30:04.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc82810c170 0x7fc82819ef40 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc828103660 0x7fc82819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc8140a32c0 0x7fc8140a5780 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 --2- 172.21.15.52:0/4120411906 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc828102d40 0x7fc82819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 >> 172.21.15.52:0/4120411906 conn(0x7fc8280fc7a0 msgr2=0x7fc8280fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 shutdown_connections 2024-09-19T09:30:04.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:04.899+0000 7fc82f652640 1 -- 172.21.15.52:0/4120411906 wait complete. 2024-09-19T09:30:05.540 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:05 smithi052 ceph-mon[30947]: pgmap v597: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:05.540 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:05 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4120411906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:05.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:30:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:05 smithi169 ceph-mon[35454]: pgmap v597: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:05 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4120411906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:05 smithi086 ceph-mon[34813]: pgmap v597: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:05 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4120411906' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:05.835 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 -- 172.21.15.52:0/110263817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8102790 msgr2=0x7ffaa81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/110263817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8102790 0x7ffaa81067e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009900 tx=0x7ffa9002a410 comp rx=0 tx=0).stop 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 -- 172.21.15.52:0/110263817 shutdown_connections 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/110263817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8106f10 0x7ffaa810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/110263817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8102790 0x7ffaa81067e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/110263817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8101de0 0x7ffaa81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 -- 172.21.15.52:0/110263817 >> 172.21.15.52:0/110263817 conn(0x7ffaa80fd8c0 msgr2=0x7ffaa80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.318+0000 7ffaad5e6640 1 -- 172.21.15.52:0/110263817 shutdown_connections 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 -- 172.21.15.52:0/110263817 wait complete. 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 Processor -- start 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 -- start start 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8101de0 0x7ffaa819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8102790 0x7ffaa819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8111fc0 con 0x7ffaa8106f10 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8111e40 con 0x7ffaa8101de0 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaad5e6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8112140 con 0x7ffaa8102790 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.319+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53274/0 (socket says 172.21.15.52:53274) 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 -- 172.21.15.52:0/2609480108 learned_addr learned my addr 172.21.15.52:0/2609480108 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8102790 0x7ffaa819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8101de0 0x7ffaa819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 -- 172.21.15.52:0/2609480108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8102790 msgr2=0x7ffaa819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8102790 0x7ffaa819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 -- 172.21.15.52:0/2609480108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8101de0 msgr2=0x7ffaa819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8101de0 0x7ffaa819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 -- 172.21.15.52:0/2609480108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa819f630 con 0x7ffaa8106f10 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009fd0 tx=0x7ffaa000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa4ff9640 1 -- 172.21.15.52:0/2609480108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0017070 con 0x7ffaa8106f10 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa819f920 con 0x7ffaa8106f10 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa4ff9640 1 -- 172.21.15.52:0/2609480108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa0003e50 con 0x7ffaa8106f10 2024-09-19T09:30:06.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaa4ff9640 1 -- 172.21.15.52:0/2609480108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00106c0 con 0x7ffaa8106f10 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.320+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81a7200 con 0x7ffaa8106f10 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.323+0000 7ffaaf9bf740 1 Processor -- start 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.323+0000 7ffaa4ff9640 1 -- 172.21.15.52:0/2609480108 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffaa0003970 con 0x7ffaa8106f10 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.323+0000 7ffaaf9bf740 1 -- start start 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b35090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b35a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3a9b2f0 con 0x55e6d3b40370 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3a42cf0 con 0x55e6d3b36b40 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3a972b0 con 0x55e6d3b355d0 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53290/0 (socket says 172.21.15.52:53290) 2024-09-19T09:30:06.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 -- 172.21.15.52:0/217093671 learned_addr learned my addr 172.21.15.52:0/217093671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b35a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b35090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 -- 172.21.15.52:0/217093671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 msgr2=0x55e6d3b35a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b35a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 -- 172.21.15.52:0/217093671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 msgr2=0x55e6d3b35090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b35090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffa9ffff640 1 -- 172.21.15.52:0/217093671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d3a273a0 con 0x55e6d3b40370 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.324+0000 7ffaa4ff9640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 0x7ffa940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 0x7ffa940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009230 tx=0x7ffa90005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18fff1a832d107c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffaa4ff9640 1 -- 172.21.15.52:0/2609480108 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffaa00cf670 con 0x7ffaa8106f10 2024-09-19T09:30:06.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffa9d7fa640 1 -- 172.21.15.52:0/217093671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90044020 con 0x55e6d3b40370 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffa9d7fa640 1 -- 172.21.15.52:0/217093671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa900044b0 con 0x55e6d3b40370 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.325+0000 7ffa9d7fa640 1 -- 172.21.15.52:0/217093671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90035070 con 0x55e6d3b40370 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/217093671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 msgr2=0x55e6d3b42760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009230 tx=0x7ffa90005b50 comp rx=0 tx=0).stop 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 0x7ffa940a5700 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55e6d3b32ac0 tx=0x7ffa98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/217093671 shutdown_connections 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b40370 0x55e6d3b42760 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b35a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/217093671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b35090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/217093671 >> 172.21.15.52:0/217093671 conn(0x55e6d3afe310 msgr2=0x55e6d3b31c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/217093671 shutdown_connections 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/217093671 wait complete. 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- start start 2024-09-19T09:30:06.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 Processor -- start 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b355d0 0x55e6d3b3fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3b3d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3b43010 con 0x55e6d3b36b40 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3a56060 con 0x55e6d3b355d0 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.326+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e6d3b43190 con 0x55e6d3b40370 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaaf9bf740 10 client.0 _ll_register_callbacks cb 0x55e6d37a98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53298/0 (socket says 172.21.15.52:53298) 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 -- 172.21.15.52:0/3150041160 learned_addr learned my addr 172.21.15.52:0/3150041160 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3b3d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b355d0 0x55e6d3b3fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 -- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 msgr2=0x55e6d3b3d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3b3d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 -- 172.21.15.52:0/3150041160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b355d0 msgr2=0x55e6d3b3fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b355d0 0x55e6d3b3fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 -- 172.21.15.52:0/3150041160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d380c3c0 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001eb0 tx=0x7ffa9002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf574adb1a8d1979 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90044030 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa900044b0 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffa90005350 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa9005a050 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaaf9bf740 10 client.18459 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.327+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6d3b4eab0 con 0x55e6d3b36b40 2024-09-19T09:30:06.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa900044b0 con 0x55e6d3b36b40 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffa90003660 con 0x55e6d3b36b40 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 10 client.18459 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 10 client.18459 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 20 client.18459 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3b4fe00 0x55e6d3b521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 4 client.18459 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6d3aa8860 con 0x55e6d3b4fe00 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.328+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3b4fe00 0x55e6d3b521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3b4fe00 0x55e6d3b521f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b9968949adce872 server_cookie=2b9b224afd64fab5 in_seq=0 out_seq=0 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffa8e7fc640 10 client.18459 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3150041160 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6d3aa8860 con 0x55e6d3b4fe00 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffa8e7fc640 10 client.18459 handle_command_reply: tid=0 2024-09-19T09:30:06.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 client.18459 shutdown 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 msgr2=0x55e6d3b3d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001eb0 tx=0x7ffa9002a410 comp rx=0 tx=0).stop 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 shutdown_connections 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3b4fe00 0x55e6d3b521f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3b3d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b3d020 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3150041160 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b355d0 0x55e6d3b3fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.329+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 >> 172.21.15.52:0/3150041160 conn(0x55e6d3afe310 msgr2=0x55e6d3b37960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.330+0000 7ffa8e7fc640 0 client.18459 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.330+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 shutdown_connections 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.330+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3150041160 wait complete. 2024-09-19T09:30:06.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.330+0000 7ffaaf9bf740 20 client.18459 trim_cache size 0 max 16384 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 Processor -- start 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 -- start start 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b38120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b40370 0x55e6d3b54e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81b2240 con 0x55e6d3b36b40 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81afb10 con 0x55e6d3b40370 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81ad960 con 0x55e6d3b355d0 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53306/0 (socket says 172.21.15.52:53306) 2024-09-19T09:30:06.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffa9ffff640 1 -- 172.21.15.52:0/2878012410 learned_addr learned my addr 172.21.15.52:0/2878012410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b38120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.343+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b40370 0x55e6d3b54e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 -- 172.21.15.52:0/2878012410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 msgr2=0x55e6d3b38120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b38120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 -- 172.21.15.52:0/2878012410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b40370 msgr2=0x55e6d3b54e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b40370 0x55e6d3b54e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 -- 172.21.15.52:0/2878012410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d3b3f990 con 0x55e6d3b36b40 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ffa90003bd0 tx=0x7ffa90004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915fd2e68ea14aca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9cff9640 1 -- 172.21.15.52:0/2878012410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90044030 con 0x55e6d3b36b40 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9cff9640 1 -- 172.21.15.52:0/2878012410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa90057020 con 0x55e6d3b36b40 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.344+0000 7ffa9cff9640 1 -- 172.21.15.52:0/2878012410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90035070 con 0x55e6d3b36b40 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/2878012410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 msgr2=0x55e6d3b38660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ffa90003bd0 tx=0x7ffa90004540 comp rx=0 tx=0).stop 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/2878012410 shutdown_connections 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b40370 0x55e6d3b54e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b36b40 0x55e6d3b38660 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/2878012410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b355d0 0x55e6d3b38120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/2878012410 >> 172.21.15.52:0/2878012410 conn(0x55e6d3afe310 msgr2=0x55e6d3b3c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/2878012410 shutdown_connections 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/2878012410 wait complete. 2024-09-19T09:30:06.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.345+0000 7ffaaf9bf740 1 -- start start 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 Processor -- start 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3bb16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81adfd0 con 0x55e6d3b355d0 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81af440 con 0x55e6d3b36b40 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81ae6a0 con 0x55e6d3b40370 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaaf9bf740 10 client.0 _ll_register_callbacks cb 0x7ffa90004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaa6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaa6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53320/0 (socket says 172.21.15.52:53320) 2024-09-19T09:30:06.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffa9ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:52082/0 (socket says 172.21.15.52:52082) 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.346+0000 7ffaa6ffd640 1 -- 172.21.15.52:0/3781460061 learned_addr learned my addr 172.21.15.52:0/3781460061 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3bb16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 -- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 msgr2=0x55e6d3bb16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3bb16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 -- 172.21.15.52:0/3781460061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 msgr2=0x55e6d3b52bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 -- 172.21.15.52:0/3781460061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d3bb1d90 con 0x55e6d3b355d0 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa77fe640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3bb16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaa6ffd640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ffa98004250 tx=0x7ffa980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f5e85eb6ffdfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98030070 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffa98003d80 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa90057020 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffa9803c050 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaaf9bf740 10 client.18465 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e6d3bba360 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.347+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa90057020 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffa9801f6c0 con 0x55e6d3b355d0 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 10 client.18465 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 10 client.18465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 20 client.18465 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:06.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3bbaac0 0x55e6d3bbcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 4 client.18465 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6d3aa2d70 con 0x55e6d3bbaac0 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.348+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3bbaac0 0x55e6d3bbcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffa9ffff640 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3bbaac0 0x55e6d3bbcee0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5c8c9e50b5df6f9 server_cookie=96d20ece164e17cb in_seq=0 out_seq=0 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffa8e7fc640 10 client.18465 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffa8e7fc640 1 -- 172.21.15.52:0/3781460061 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6d3aa2d70 con 0x55e6d3bbaac0 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffa8e7fc640 10 client.18465 handle_command_reply: tid=0 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 client.18465 shutdown 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 msgr2=0x55e6d3b52690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ffa98004250 tx=0x7ffa980046c0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 shutdown_connections 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e6d3bbaac0 0x55e6d3bbcee0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e6d3b40370 0x55e6d3bb16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e6d3b36b40 0x55e6d3b52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffa8e7fc640 0 client.18465 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 --2- 172.21.15.52:0/3781460061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e6d3b355d0 0x55e6d3b52690 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 >> 172.21.15.52:0/3781460061 conn(0x55e6d3afe310 msgr2=0x55e6d3b304e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 shutdown_connections 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 1 -- 172.21.15.52:0/3781460061 wait complete. 2024-09-19T09:30:06.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.349+0000 7ffaaf9bf740 20 client.18465 trim_cache size 0 max 16384 2024-09-19T09:30:06.360 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 msgr2=0x7ffa940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 0x7ffa940a5700 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55e6d3b32ac0 tx=0x7ffa98005f90 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 msgr2=0x7ffaa819ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009fd0 tx=0x7ffaa000b260 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 shutdown_connections 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffaa8106f10 0x7ffaa819ef50 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffa940a3240 0x7ffa940a5700 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffaa8102790 0x7ffaa819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 --2- 172.21.15.52:0/2609480108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffaa8101de0 0x7ffaa819a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 >> 172.21.15.52:0/2609480108 conn(0x7ffaa80fd8c0 msgr2=0x7ffaa80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 shutdown_connections 2024-09-19T09:30:06.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:06.350+0000 7ffaad5e6640 1 -- 172.21.15.52:0/2609480108 wait complete. 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 -- 172.21.15.52:0/1166135195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054100a40 msgr2=0x7f4054100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 --2- 172.21.15.52:0/1166135195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054100a40 0x7f4054100e40 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4044009900 tx=0x7f404402a410 comp rx=0 tx=0).stop 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 -- 172.21.15.52:0/1166135195 shutdown_connections 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 --2- 172.21.15.52:0/1166135195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40541025f0 0x7f4054108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 --2- 172.21.15.52:0/1166135195 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4054101c30 0x7f40541020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 --2- 172.21.15.52:0/1166135195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054100a40 0x7f4054100e40 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 -- 172.21.15.52:0/1166135195 >> 172.21.15.52:0/1166135195 conn(0x7f40540fc1e0 msgr2=0x7f40540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 -- 172.21.15.52:0/1166135195 shutdown_connections 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.420+0000 7f4058de4640 1 -- 172.21.15.52:0/1166135195 wait complete. 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 Processor -- start 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 -- start start 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 0x7f4054197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40541025f0 0x7f405419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f405410c6c0 con 0x7f4054101c30 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f405410c540 con 0x7f4054100a40 2024-09-19T09:30:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4058de4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f405410c840 con 0x7f40541025f0 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53330/0 (socket says 172.21.15.52:53330) 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f4051d9b640 1 -- 172.21.15.52:0/4212458565 learned_addr learned my addr 172.21.15.52:0/4212458565 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.421+0000 7f405259c640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 0x7f4054197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4052d9d640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40541025f0 0x7f405419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 -- 172.21.15.52:0/4212458565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40541025f0 msgr2=0x7f405419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40541025f0 0x7f405419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 -- 172.21.15.52:0/4212458565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 msgr2=0x7f4054197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 0x7f4054197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 -- 172.21.15.52:0/4212458565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405419fa40 con 0x7f4054101c30 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f405259c640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 0x7f4054197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4051d9b640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f404800c970 tx=0x7f404800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f40437fe640 1 -- 172.21.15.52:0/4212458565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048007bb0 con 0x7f4054101c30 2024-09-19T09:30:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f40437fe640 1 -- 172.21.15.52:0/4212458565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4048007d50 con 0x7f4054101c30 2024-09-19T09:30:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405419fd30 con 0x7f4054101c30 2024-09-19T09:30:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f40437fe640 1 -- 172.21.15.52:0/4212458565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404800f450 con 0x7f4054101c30 2024-09-19T09:30:06.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.422+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40541a0220 con 0x7f4054101c30 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.424+0000 7f40437fe640 1 -- 172.21.15.52:0/4212458565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4048005020 con 0x7f4054101c30 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.424+0000 7f405bc5b740 1 Processor -- start 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 -- start start 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9eefeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef03da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f9ee622f0 con 0x559f9ef04370 2024-09-19T09:30:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f9ee0a270 con 0x559f9eefe9a0 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405bc5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f9ee5e2b0 con 0x559f9eeff2e0 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53334/0 (socket says 172.21.15.52:53334) 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 -- 172.21.15.52:0/2101412092 learned_addr learned my addr 172.21.15.52:0/2101412092 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4052d9d640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9eefeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f405259c640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef03da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f40437fe640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 0x7f403c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 -- 172.21.15.52:0/2101412092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 msgr2=0x559f9ef03da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef03da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 -- 172.21.15.52:0/2101412092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 msgr2=0x559f9eefeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9eefeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.425+0000 7f4051d9b640 1 -- 172.21.15.52:0/2101412092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9ee09340 con 0x559f9ef04370 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4052d9d640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9eefeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4052d9d640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 0x7f403c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f40437fe640 1 -- 172.21.15.52:0/4212458565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f40480cf700 con 0x7f4054101c30 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4051d9b640 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f40480a20d0 tx=0x7f40480d5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaad6138af0996a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4040ff9640 1 -- 172.21.15.52:0/2101412092 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404801d030 con 0x559f9ef04370 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4040ff9640 1 -- 172.21.15.52:0/2101412092 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40480a2840 con 0x559f9ef04370 2024-09-19T09:30:06.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.426+0000 7f4040ff9640 1 -- 172.21.15.52:0/2101412092 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404809e040 con 0x559f9ef04370 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- 172.21.15.52:0/2101412092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 msgr2=0x559f9ef06830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f40480a20d0 tx=0x7f40480d5f60 comp rx=0 tx=0).stop 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f4052d9d640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 0x7f403c0a5830 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f404c009fd0 tx=0x7f404c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- 172.21.15.52:0/2101412092 shutdown_connections 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9ef04370 0x559f9ef06830 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef03da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 --2- 172.21.15.52:0/2101412092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9eefeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- 172.21.15.52:0/2101412092 >> 172.21.15.52:0/2101412092 conn(0x559f9eefa010 msgr2=0x559f9eefa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- 172.21.15.52:0/2101412092 shutdown_connections 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- 172.21.15.52:0/2101412092 wait complete. 2024-09-19T09:30:06.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 -- start start 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 Processor -- start 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.427+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9ef08bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9ef04370 0x559f9ef10170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559f9ef07340 con 0x559f9eeff2e0 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559f9edeb290 con 0x559f9eefe9a0 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f9ef074c0 con 0x559f9ef04370 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 10 client.0 _ll_register_callbacks cb 0x559f9ee1c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53342/0 (socket says 172.21.15.52:53342) 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 -- 172.21.15.52:0/562048646 learned_addr learned my addr 172.21.15.52:0/562048646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405259c640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9ef08bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 -- 172.21.15.52:0/562048646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9ef04370 msgr2=0x559f9ef10170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9ef04370 0x559f9ef10170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 -- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 msgr2=0x559f9ef08bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9ef08bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 -- 172.21.15.52:0/562048646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9eb75210 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405259c640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9ef08bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4051d9b640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f40480cd1d0 tx=0x7f4048004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ead599ed31efc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40480b9060 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4048099fa0 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559f9ee6fa20 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f404801d070 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 10 client.18477 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.428+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559f9ec41620 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559f9ee6fa20 con 0x559f9eeff2e0 2024-09-19T09:30:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4048098310 con 0x559f9eeff2e0 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 10 client.18477 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 10 client.18477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 20 client.18477 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef14470 0x559f9ef16860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 4 client.18477 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9ee69d70 con 0x559f9ef14470 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.429+0000 7f405259c640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef14470 0x559f9ef16860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f405259c640 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef14470 0x559f9ef16860 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83fde38f12d84745 server_cookie=b4e1df4bde9136b3 in_seq=0 out_seq=0 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f4039ffb640 10 client.18477 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f4039ffb640 1 -- 172.21.15.52:0/562048646 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f9ee69d70 con 0x559f9ef14470 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f4039ffb640 10 client.18477 handle_command_reply: tid=0 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f405bc5b740 1 client.18477 shutdown 2024-09-19T09:30:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 msgr2=0x559f9ef09130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.430+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f40480cd1d0 tx=0x7f4048004920 comp rx=0 tx=0).stop 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 shutdown_connections 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef14470 0x559f9ef16860 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f4039ffb640 0 client.18477 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9ef04370 0x559f9ef10170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eeff2e0 0x559f9ef09130 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 --2- 172.21.15.52:0/562048646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9eefe9a0 0x559f9ef08bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 >> 172.21.15.52:0/562048646 conn(0x559f9eefa010 msgr2=0x559f9eefb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 shutdown_connections 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 1 -- 172.21.15.52:0/562048646 wait complete. 2024-09-19T09:30:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.431+0000 7f405bc5b740 20 client.18477 trim_cache size 0 max 16384 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 Processor -- start 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 -- start start 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9eefb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40541abb50 con 0x559f9eefe9a0 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f40541a9420 con 0x559f9ef04370 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405bc5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f40541a7270 con 0x559f9eeff2e0 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53352/0 (socket says 172.21.15.52:53352) 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.445+0000 7f405259c640 1 -- 172.21.15.52:0/1586778963 learned_addr learned my addr 172.21.15.52:0/1586778963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f4051d9b640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f4052d9d640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9eefb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 -- 172.21.15.52:0/1586778963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 msgr2=0x559f9ef10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 -- 172.21.15.52:0/1586778963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 msgr2=0x559f9eefb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9eefb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 -- 172.21.15.52:0/1586778963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9ef07600 con 0x559f9eefe9a0 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f4051d9b640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f4052d9d640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9eefb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405259c640 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f4044005ab0 tx=0x7f4044005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458f3546e3a9c7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.451 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f403bfff640 1 -- 172.21.15.52:0/1586778963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044035040 con 0x559f9eefe9a0 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f403bfff640 1 -- 172.21.15.52:0/1586778963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044005040 con 0x559f9eefe9a0 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f403bfff640 1 -- 172.21.15.52:0/1586778963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440049c0 con 0x559f9eefe9a0 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 -- 172.21.15.52:0/1586778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 msgr2=0x559f9eef90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f4044005ab0 tx=0x7f4044005fd0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 -- 172.21.15.52:0/1586778963 shutdown_connections 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9eefb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1586778963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9eef90b0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 -- 172.21.15.52:0/1586778963 >> 172.21.15.52:0/1586778963 conn(0x559f9eefa010 msgr2=0x559f9eef89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.446+0000 7f405bc5b740 1 -- 172.21.15.52:0/1586778963 shutdown_connections 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 -- 172.21.15.52:0/1586778963 wait complete. 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 -- start start 2024-09-19T09:30:06.452 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 Processor -- start 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef0de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9ef0ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40541a78e0 con 0x559f9eefe9a0 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f40541a8d50 con 0x559f9ef04370 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f40541a7fb0 con 0x559f9eeff2e0 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405bc5b740 10 client.0 _ll_register_callbacks cb 0x7f404c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53354/0 (socket says 172.21.15.52:53354) 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f405259c640 1 -- 172.21.15.52:0/1647219864 learned_addr learned my addr 172.21.15.52:0/1647219864 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f4052d9d640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9ef0ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.453 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.447+0000 7f4051d9b640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef0de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 -- 172.21.15.52:0/1647219864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 msgr2=0x559f9ef0de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef0de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 -- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 msgr2=0x559f9ef0ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9ef0ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 -- 172.21.15.52:0/1647219864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9ef16dc0 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405259c640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f40440314e0 tx=0x7f4044004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f6ae6a169242d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044035040 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4044048070 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044005040 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4044031c40 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 10 client.18483 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559f9ef10550 con 0x559f9eefe9a0 2024-09-19T09:30:06.454 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044005040 con 0x559f9eefe9a0 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f40440035f0 con 0x559f9eefe9a0 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 10 client.18483 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 10 client.18483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.448+0000 7f405bc5b740 20 client.18483 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef7f790 0x559f9ef81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f405bc5b740 4 client.18483 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f9ede6900 con 0x559f9ef7f790 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f4051d9b640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef7f790 0x559f9ef81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f4051d9b640 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef7f790 0x559f9ef81bb0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcefc62d0fbc04c5 server_cookie=b003d707d828020d in_seq=0 out_seq=0 2024-09-19T09:30:06.455 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.449+0000 7f4039ffb640 10 client.18483 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f4039ffb640 1 -- 172.21.15.52:0/1647219864 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f9ede6900 con 0x559f9ef7f790 2024-09-19T09:30:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f4039ffb640 10 client.18483 handle_command_reply: tid=0 2024-09-19T09:30:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 client.18483 shutdown 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 msgr2=0x559f9ef0d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f40440314e0 tx=0x7f4044004760 comp rx=0 tx=0).stop 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 shutdown_connections 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559f9ef7f790 0x559f9ef81bb0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559f9ef04370 0x559f9ef0ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f9eeff2e0 0x559f9ef0de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f4039ffb640 0 client.18483 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 --2- 172.21.15.52:0/1647219864 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559f9eefe9a0 0x559f9ef0d940 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 >> 172.21.15.52:0/1647219864 conn(0x559f9eefa010 msgr2=0x559f9eef91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 shutdown_connections 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 1 -- 172.21.15.52:0/1647219864 wait complete. 2024-09-19T09:30:06.465 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.463+0000 7f405bc5b740 20 client.18483 trim_cache size 0 max 16384 2024-09-19T09:30:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:30:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:30:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:30:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:30:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 msgr2=0x7f403c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 0x7f403c0a5830 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f404c009fd0 tx=0x7f404c004a40 comp rx=0 tx=0).stop 2024-09-19T09:30:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 msgr2=0x7f4054198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f404800c970 tx=0x7f404800ce30 comp rx=0 tx=0).stop 2024-09-19T09:30:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 shutdown_connections 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f403c0a3370 0x7f403c0a5830 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40541025f0 0x7f405419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4054101c30 0x7f4054198360 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 --2- 172.21.15.52:0/4212458565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4054100a40 0x7f4054197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 >> 172.21.15.52:0/4212458565 conn(0x7f40540fc1e0 msgr2=0x7f40540fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 shutdown_connections 2024-09-19T09:30:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:06.464+0000 7f4058de4640 1 -- 172.21.15.52:0/4212458565 wait complete. 2024-09-19T09:30:06.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:30:07.255 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:07.644 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:07 smithi052 ceph-mon[30947]: pgmap v598: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:07.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:07 smithi169 ceph-mon[35454]: pgmap v598: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 -- 172.21.15.52:0/3847251660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 msgr2=0x7f460410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 --2- 172.21.15.52:0/3847251660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f460410da40 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009900 tx=0x7f45fc02a480 comp rx=0 tx=0).stop 2024-09-19T09:30:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 -- 172.21.15.52:0/3847251660 shutdown_connections 2024-09-19T09:30:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 --2- 172.21.15.52:0/3847251660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f460410da40 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 --2- 172.21.15.52:0/3847251660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604102570 0x7f46041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 --2- 172.21.15.52:0/3847251660 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604100e20 0x7f4604101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 -- 172.21.15.52:0/3847251660 >> 172.21.15.52:0/3847251660 conn(0x7f46040fc7d0 msgr2=0x7f46040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 -- 172.21.15.52:0/3847251660 shutdown_connections 2024-09-19T09:30:07.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.728+0000 7f460b75d640 1 -- 172.21.15.52:0/3847251660 wait complete. 2024-09-19T09:30:07.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 Processor -- start 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 -- start start 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 0x7f46040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102570 0x7f46040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4604110fa0 con 0x7f4604102ef0 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4604110e20 con 0x7f4604100e20 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f460b75d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4604111120 con 0x7f4604102570 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f4609cfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f4609cfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53380/0 (socket says 172.21.15.52:53380) 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f4609cfa640 1 -- 172.21.15.52:0/112555119 learned_addr learned my addr 172.21.15.52:0/112555119 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f4608cf8640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102570 0x7f46040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.729+0000 7f46094f9640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 0x7f46040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 -- 172.21.15.52:0/112555119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102570 msgr2=0x7f46040fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102570 0x7f46040fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 -- 172.21.15.52:0/112555119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 msgr2=0x7f46040fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 0x7f46040fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 -- 172.21.15.52:0/112555119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46041a6910 con 0x7f4604102ef0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f46094f9640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 0x7f46040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f4609cfa640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005ab0 tx=0x7f45fc003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f46027fc640 1 -- 172.21.15.52:0/112555119 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc03f070 con 0x7f4604102ef0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f46027fc640 1 -- 172.21.15.52:0/112555119 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc031e30 con 0x7f4604102ef0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46041a6ba0 con 0x7f4604102ef0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f46027fc640 1 -- 172.21.15.52:0/112555119 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc035030 con 0x7f4604102ef0 2024-09-19T09:30:07.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.730+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46041a7080 con 0x7f4604102ef0 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.732+0000 7f46027fc640 1 -- 172.21.15.52:0/112555119 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f45fc042070 con 0x7f4604102ef0 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 Processor -- start 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 -- start start 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a21090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a21a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559bc29872f0 con 0x559bc2a2c370 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bc292ecf0 con 0x559bc2a22b40 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f460db36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559bc29832b0 con 0x559bc2a215d0 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53382/0 (socket says 172.21.15.52:53382) 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.733+0000 7f4608cf8640 1 -- 172.21.15.52:0/1071123889 learned_addr learned my addr 172.21.15.52:0/1071123889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a21090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f46027fc640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f46094f9640 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a21a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4609cfa640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 -- 172.21.15.52:0/1071123889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 msgr2=0x559bc2a21a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a21a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 -- 172.21.15.52:0/1071123889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 msgr2=0x559bc2a21090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a21090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 -- 172.21.15.52:0/1071123889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc29133a0 con 0x559bc2a2c370 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f46027fc640 1 -- 172.21.15.52:0/112555119 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45fc0f0250 con 0x7f4604102ef0 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f45f800bdb0 tx=0x7f45f8009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6eeca8912e035e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f45eb7fe640 1 -- 172.21.15.52:0/1071123889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8014040 con 0x559bc2a2c370 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f4609cfa640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 0x7f45ec0a5700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005ec0 tx=0x7f45fc0a7040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f45eb7fe640 1 -- 172.21.15.52:0/1071123889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8008d50 con 0x559bc2a2c370 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.734+0000 7f45eb7fe640 1 -- 172.21.15.52:0/1071123889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f801a640 con 0x559bc2a2c370 2024-09-19T09:30:07.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- 172.21.15.52:0/1071123889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 msgr2=0x559bc2a2e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f45f800bdb0 tx=0x7f45f8009bc0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- 172.21.15.52:0/1071123889 shutdown_connections 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a2e760 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a21a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 --2- 172.21.15.52:0/1071123889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a21090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- 172.21.15.52:0/1071123889 >> 172.21.15.52:0/1071123889 conn(0x559bc29ea310 msgr2=0x559bc2a1dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- 172.21.15.52:0/1071123889 shutdown_connections 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- 172.21.15.52:0/1071123889 wait complete. 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.735+0000 7f460db36740 1 -- start start 2024-09-19T09:30:07.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 Processor -- start 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a215d0 0x559bc2a2bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a22b40 0x559bc2a29050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559bc2a2f010 con 0x559bc2a2c370 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559bc2942060 con 0x559bc2a215d0 2024-09-19T09:30:07.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559bc2a2f190 con 0x559bc2a22b40 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f460db36740 10 client.0 _ll_register_callbacks cb 0x559bc26958c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53390/0 (socket says 172.21.15.52:53390) 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f4608cf8640 1 -- 172.21.15.52:0/2033631506 learned_addr learned my addr 172.21.15.52:0/2033631506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f46094f9640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a22b40 0x559bc2a29050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.736+0000 7f4608cf8640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a215d0 0x559bc2a2bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 -- 172.21.15.52:0/2033631506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a22b40 msgr2=0x559bc2a29050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a22b40 0x559bc2a29050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 -- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a215d0 msgr2=0x559bc2a2bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a215d0 0x559bc2a2bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 -- 172.21.15.52:0/2033631506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc26f83c0 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f4608cf8640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f45f8002230 tx=0x7f45f801bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d52a002421bde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f45e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f802e060 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45f800b050 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f8008d50 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45f800b250 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f460db36740 10 client.18495 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559bc2a3ab20 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.737+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8008d50 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45f8028730 con 0x559bc2a2c370 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 10 client.18495 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 10 client.18495 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:30:07.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 20 client.18495 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2a3bed0 0x559bc2a3e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 4 client.18495 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bc2994860 con 0x559bc2a3bed0 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f46094f9640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2a3bed0 0x559bc2a3e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f45e8ff9640 10 client.18495 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.738+0000 7f46094f9640 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2a3bed0 0x559bc2a3e2c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbdac1d75e70b063 server_cookie=44033a79cfdc5ffb in_seq=0 out_seq=0 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f45e8ff9640 1 -- 172.21.15.52:0/2033631506 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559bc2994860 con 0x559bc2a3bed0 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f45e8ff9640 10 client.18495 handle_command_reply: tid=0 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 client.18495 shutdown 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 msgr2=0x559bc2a297e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f45f8002230 tx=0x7f45f801bdb0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 shutdown_connections 2024-09-19T09:30:07.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a297e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a22b40 0x559bc2a29050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2a3bed0 0x559bc2a3e2c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 --2- 172.21.15.52:0/2033631506 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a215d0 0x559bc2a2bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 >> 172.21.15.52:0/2033631506 conn(0x559bc29ea310 msgr2=0x559bc2a23960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.739+0000 7f45e8ff9640 0 client.18495 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.740+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 shutdown_connections 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.740+0000 7f460db36740 1 -- 172.21.15.52:0/2033631506 wait complete. 2024-09-19T09:30:07.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.740+0000 7f460db36740 20 client.18495 trim_cache size 0 max 16384 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 Processor -- start 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 -- start start 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a28030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a43a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46041b21e0 con 0x559bc2a2c370 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46041afab0 con 0x559bc2a22b40 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f460db36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46041ad900 con 0x559bc2a215d0 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53396/0 (socket says 172.21.15.52:53396) 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 -- 172.21.15.52:0/1682486259 learned_addr learned my addr 172.21.15.52:0/1682486259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f46094f9640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a43a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a28030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 -- 172.21.15.52:0/1682486259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 msgr2=0x559bc2a28030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a28030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 -- 172.21.15.52:0/1682486259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 msgr2=0x559bc2a43a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a43a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f4608cf8640 1 -- 172.21.15.52:0/1682486259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc2a275a0 con 0x559bc2a2c370 2024-09-19T09:30:07.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.753+0000 7f46094f9640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a43a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f45f80071a0 tx=0x7f45f80098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c25e4c2c705b0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f45eaffd640 1 -- 172.21.15.52:0/1682486259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f802e040 con 0x559bc2a2c370 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f45eaffd640 1 -- 172.21.15.52:0/1682486259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8028910 con 0x559bc2a2c370 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f45eaffd640 1 -- 172.21.15.52:0/1682486259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f801b790 con 0x559bc2a2c370 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 -- 172.21.15.52:0/1682486259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 msgr2=0x559bc2a43f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f45f80071a0 tx=0x7f45f80098d0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 -- 172.21.15.52:0/1682486259 shutdown_connections 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a2c370 0x559bc2a43f40 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a22b40 0x559bc2a43a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 --2- 172.21.15.52:0/1682486259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a28030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 -- 172.21.15.52:0/1682486259 >> 172.21.15.52:0/1682486259 conn(0x559bc29ea310 msgr2=0x559bc2a27920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 -- 172.21.15.52:0/1682486259 shutdown_connections 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.754+0000 7f460db36740 1 -- 172.21.15.52:0/1682486259 wait complete. 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 -- start start 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 Processor -- start 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a2c370 0x559bc2a2fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46041adf70 con 0x559bc2a22b40 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46041af3e0 con 0x559bc2a2c370 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46041ae640 con 0x559bc2a215d0 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f460db36740 10 client.0 _ll_register_callbacks cb 0x7f45f800b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f46094f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f46094f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53402/0 (socket says 172.21.15.52:53402) 2024-09-19T09:30:07.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f46094f9640 1 -- 172.21.15.52:0/1140687209 learned_addr learned my addr 172.21.15.52:0/1140687209 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.755+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a2c370 0x559bc2a2fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 -- 172.21.15.52:0/1140687209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 msgr2=0x559bc2a9ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a9ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 -- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a2c370 msgr2=0x559bc2a2fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a2c370 0x559bc2a2fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 -- 172.21.15.52:0/1140687209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc2a30120 con 0x559bc2a22b40 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f46094f9640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x559bc2a1eac0 tx=0x7f45f4012b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7f58cd5d429ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f45e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4005220 con 0x559bc2a22b40 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f8028910 con 0x559bc2a22b40 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f45f40053c0 con 0x559bc2a22b40 2024-09-19T09:30:07.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45f402b050 con 0x559bc2a22b40 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f460db36740 10 client.18501 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.756+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559bc2aa65b0 con 0x559bc2a22b40 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8028910 con 0x559bc2a22b40 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45f4004bb0 con 0x559bc2a22b40 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 10 client.18501 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 10 client.18501 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 20 client.18501 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2aa6d90 0x559bc2aa91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 4 client.18501 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bc298ed70 con 0x559bc2aa6d90 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2aa6d90 0x559bc2aa91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f4608cf8640 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2aa6d90 0x559bc2aa91b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47b8f5aa612e92f4 server_cookie=e3b410fa76c0d39d in_seq=0 out_seq=0 2024-09-19T09:30:07.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.757+0000 7f45e8ff9640 10 client.18501 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f45e8ff9640 1 -- 172.21.15.52:0/1140687209 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bc298ed70 con 0x559bc2aa6d90 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f45e8ff9640 10 client.18501 handle_command_reply: tid=0 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 client.18501 shutdown 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 msgr2=0x559bc2a9f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x559bc2a1eac0 tx=0x7f45f4012b10 comp rx=0 tx=0).stop 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 shutdown_connections 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559bc2aa6d90 0x559bc2aa91b0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559bc2a2c370 0x559bc2a2fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559bc2a22b40 0x559bc2a9f200 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f45e8ff9640 0 client.18501 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 --2- 172.21.15.52:0/1140687209 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559bc2a215d0 0x559bc2a9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 >> 172.21.15.52:0/1140687209 conn(0x559bc29ea310 msgr2=0x559bc2a28140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 shutdown_connections 2024-09-19T09:30:07.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 1 -- 172.21.15.52:0/1140687209 wait complete. 2024-09-19T09:30:07.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.758+0000 7f460db36740 20 client.18501 trim_cache size 0 max 16384 2024-09-19T09:30:07.765 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 msgr2=0x7f45ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 0x7f45ec0a5700 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005ec0 tx=0x7f45fc0a7040 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 msgr2=0x7f46040fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f45fc005ab0 tx=0x7f45fc003c30 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 shutdown_connections 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4604102ef0 0x7f46040fd700 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4604102570 0x7f46040fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 --2- 172.21.15.52:0/112555119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4604100e20 0x7f46040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:07.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 >> 172.21.15.52:0/112555119 conn(0x7f46040fc7d0 msgr2=0x7f460406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:07.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 shutdown_connections 2024-09-19T09:30:07.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:07.759+0000 7f460b75d640 1 -- 172.21.15.52:0/112555119 wait complete. 2024-09-19T09:30:07.767 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:07 smithi086 ceph-mon[34813]: pgmap v598: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:08.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:30:08.746 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 -- 172.21.15.52:0/1007365825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c100a80 msgr2=0x7f964c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 --2- 172.21.15.52:0/1007365825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c100a80 0x7f964c100ee0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f963c009930 tx=0x7f963c02a420 comp rx=0 tx=0).stop 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 -- 172.21.15.52:0/1007365825 shutdown_connections 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 --2- 172.21.15.52:0/1007365825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c101420 0x7f964c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 --2- 172.21.15.52:0/1007365825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c100a80 0x7f964c100ee0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 --2- 172.21.15.52:0/1007365825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c106a80 0x7f964c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 -- 172.21.15.52:0/1007365825 >> 172.21.15.52:0/1007365825 conn(0x7f964c0fc7a0 msgr2=0x7f964c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 -- 172.21.15.52:0/1007365825 shutdown_connections 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.244+0000 7f9652ec3640 1 -- 172.21.15.52:0/1007365825 wait complete. 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 Processor -- start 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 -- start start 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c100a80 0x7f964c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c106a80 0x7f964c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110ea0 con 0x7f964c101420 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f964c110d20 con 0x7f964c106a80 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9652ec3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f964c111020 con 0x7f964c100a80 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56992/0 (socket says 172.21.15.52:56992) 2024-09-19T09:30:09.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9643fff640 1 -- 172.21.15.52:0/3222459183 learned_addr learned my addr 172.21.15.52:0/3222459183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9650c5f640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c100a80 0x7f964c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.245+0000 7f9651460640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c106a80 0x7f964c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 -- 172.21.15.52:0/3222459183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c100a80 msgr2=0x7f964c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c100a80 0x7f964c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 -- 172.21.15.52:0/3222459183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c106a80 msgr2=0x7f964c1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c106a80 0x7f964c1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 -- 172.21.15.52:0/3222459183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964c1a4910 con 0x7f964c101420 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9643fff640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f963c009230 tx=0x7f963c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9641ffb640 1 -- 172.21.15.52:0/3222459183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c03f030 con 0x7f964c101420 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964c1a4ae0 con 0x7f964c101420 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9641ffb640 1 -- 172.21.15.52:0/3222459183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f963c003ad0 con 0x7f964c101420 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9641ffb640 1 -- 172.21.15.52:0/3222459183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c035070 con 0x7f964c101420 2024-09-19T09:30:09.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.246+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964c1a4f40 con 0x7f964c101420 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.248+0000 7f9641ffb640 1 -- 172.21.15.52:0/3222459183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f963c042030 con 0x7f964c101420 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 Processor -- start 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 -- start start 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a6c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a6ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5636489d22f0 con 0x563648a77370 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563648979cf0 con 0x563648a6db40 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f965529c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5636489ce2b0 con 0x563648a6c5d0 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56996/0 (socket says 172.21.15.52:56996) 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f9643fff640 1 -- 172.21.15.52:0/1119250813 learned_addr learned my addr 172.21.15.52:0/1119250813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:09.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f9641ffb640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 0x7f96340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.249+0000 7f9651460640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a6c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9650c5f640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a6ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 0x7f96340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9641ffb640 1 -- 172.21.15.52:0/3222459183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f963c0efe20 con 0x7f964c101420 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 -- 172.21.15.52:0/1119250813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 msgr2=0x563648a6ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a6ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 -- 172.21.15.52:0/1119250813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 msgr2=0x563648a79760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 -- 172.21.15.52:0/1119250813 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56364895e3a0 con 0x563648a6db40 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9643fff640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a6c090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f96440129b0 tx=0x7f9644012e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254bd758171ef0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9651460640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 0x7f96340a5700 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f964401b000 tx=0x7f964401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9632ffd640 1 -- 172.21.15.52:0/1119250813 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644012030 con 0x563648a6db40 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9632ffd640 1 -- 172.21.15.52:0/1119250813 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96440121d0 con 0x563648a6db40 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.250+0000 7f9632ffd640 1 -- 172.21.15.52:0/1119250813 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964401da30 con 0x563648a6db40 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 -- 172.21.15.52:0/1119250813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 msgr2=0x563648a6c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a6c090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f96440129b0 tx=0x7f9644012e70 comp rx=0 tx=0).stop 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 -- 172.21.15.52:0/1119250813 shutdown_connections 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a79760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a6ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 --2- 172.21.15.52:0/1119250813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a6c090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 -- 172.21.15.52:0/1119250813 >> 172.21.15.52:0/1119250813 conn(0x563648a35310 msgr2=0x563648a68c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 -- 172.21.15.52:0/1119250813 shutdown_connections 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.251+0000 7f965529c740 1 -- 172.21.15.52:0/1119250813 wait complete. 2024-09-19T09:30:09.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.252+0000 7f965529c740 1 -- start start 2024-09-19T09:30:09.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.252+0000 7f965529c740 1 Processor -- start 2024-09-19T09:30:09.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a76d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a74020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563648a7a010 con 0x563648a77370 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56364898d060 con 0x563648a6db40 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563648a7a190 con 0x563648a6c5d0 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f965529c740 10 client.0 _ll_register_callbacks cb 0x5636486e08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57010/0 (socket says 172.21.15.52:57010) 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 -- 172.21.15.52:0/4045781366 learned_addr learned my addr 172.21.15.52:0/4045781366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9643fff640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9650c5f640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a76d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 -- 172.21.15.52:0/4045781366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 msgr2=0x563648a76d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a76d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 -- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 msgr2=0x563648a74020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a74020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 -- 172.21.15.52:0/4045781366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636487433c0 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f9651460640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9644006010 tx=0x7f964401efc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e29dee885403cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f962bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.253+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964401d400 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f964401d9a0 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96440121d0 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9644004a00 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 10 client.18513 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563648a85aa0 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96440121d0 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f964400f040 con 0x563648a77370 2024-09-19T09:30:09.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 10 client.18513 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 10 client.18513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 20 client.18513 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648a86df0 0x563648a891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 4 client.18513 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636489df860 con 0x563648a86df0 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.254+0000 7f9650c5f640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648a86df0 0x563648a891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.255+0000 7f962bfff640 10 client.18513 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.255+0000 7f9650c5f640 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648a86df0 0x563648a891e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b71233ff3da10c server_cookie=c650cd9cac95e0a6 in_seq=0 out_seq=0 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f962bfff640 1 -- 172.21.15.52:0/4045781366 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636489df860 con 0x563648a86df0 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f962bfff640 10 client.18513 handle_command_reply: tid=0 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 client.18513 shutdown 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 msgr2=0x563648a74630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f9644006010 tx=0x7f964401efc0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 shutdown_connections 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648a86df0 0x563648a891e0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a77370 0x563648a74630 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a6db40 0x563648a74020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 --2- 172.21.15.52:0/4045781366 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a76d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 >> 172.21.15.52:0/4045781366 conn(0x563648a35310 msgr2=0x563648a6e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f962bfff640 0 client.18513 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 shutdown_connections 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 1 -- 172.21.15.52:0/4045781366 wait complete. 2024-09-19T09:30:09.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.256+0000 7f965529c740 20 client.18513 trim_cache size 0 max 16384 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.269+0000 7f965529c740 1 Processor -- start 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.269+0000 7f965529c740 1 -- start start 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6db40 0x563648a75f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a8e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1b0050 con 0x563648a6c5d0 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ad920 con 0x563648a77370 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f965529c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ab770 con 0x563648a6db40 2024-09-19T09:30:09.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57020/0 (socket says 172.21.15.52:57020) 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 -- 172.21.15.52:0/3263805312 learned_addr learned my addr 172.21.15.52:0/3263805312 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9643fff640 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6db40 0x563648a75f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 -- 172.21.15.52:0/3263805312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6db40 msgr2=0x563648a75f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6db40 0x563648a75f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 -- 172.21.15.52:0/3263805312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 msgr2=0x563648a8e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a8e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 -- 172.21.15.52:0/3263805312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563648a77090 con 0x563648a6c5d0 2024-09-19T09:30:09.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f9650c5f640 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ce0b0935377ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.270+0000 7f96327fc640 1 -- 172.21.15.52:0/3263805312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648017d80 con 0x563648a6c5d0 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f96327fc640 1 -- 172.21.15.52:0/3263805312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9648021030 con 0x563648a6c5d0 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f96327fc640 1 -- 172.21.15.52:0/3263805312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964801d3d0 con 0x563648a6c5d0 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 -- 172.21.15.52:0/3263805312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 msgr2=0x563648a832b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648009110 comp rx=0 tx=0).stop 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 -- 172.21.15.52:0/3263805312 shutdown_connections 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a8e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6db40 0x563648a75f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 --2- 172.21.15.52:0/3263805312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6c5d0 0x563648a832b0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 -- 172.21.15.52:0/3263805312 >> 172.21.15.52:0/3263805312 conn(0x563648a35310 msgr2=0x563648a75880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 -- 172.21.15.52:0/3263805312 shutdown_connections 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.271+0000 7f965529c740 1 -- 172.21.15.52:0/3263805312 wait complete. 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 -- start start 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 Processor -- start 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a7ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1abde0 con 0x563648a6db40 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ad250 con 0x563648a77370 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f964c1ac4b0 con 0x563648a6c5d0 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f965529c740 10 client.0 _ll_register_callbacks cb 0x7f963c0b8600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f9643fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57026/0 (socket says 172.21.15.52:57026) 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f9643fff640 1 -- 172.21.15.52:0/2863024474 learned_addr learned my addr 172.21.15.52:0/2863024474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f9650c5f640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.272+0000 7f9651460640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a7ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 -- 172.21.15.52:0/2863024474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 msgr2=0x563648a7c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a7c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 -- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 msgr2=0x563648a7ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a7ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 -- 172.21.15.52:0/2863024474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563648aef940 con 0x563648a6db40 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9651460640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a7ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f9643fff640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f963c0f00c0 tx=0x7f963c0bbf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f1bf6336d35194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:09.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c049040 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f963c0c4b40 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9648021030 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f963c0d5020 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f965529c740 10 client.18519 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563648af0cb0 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9648021030 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.273+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f963c0d51c0 con 0x563648a6db40 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 10 client.18519 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 10 client.18519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 20 client.18519 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:09.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648af13e0 0x563648af3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 4 client.18519 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636489d9d70 con 0x563648af13e0 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f9650c5f640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648af13e0 0x563648af3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f9650c5f640 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648af13e0 0x563648af3800 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a1d15da2ec0641 server_cookie=48f27d702c49e3cc in_seq=0 out_seq=0 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f962bfff640 10 client.18519 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f962bfff640 1 -- 172.21.15.52:0/2863024474 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636489d9d70 con 0x563648af13e0 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f962bfff640 10 client.18519 handle_command_reply: tid=0 2024-09-19T09:30:09.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 1 client.18519 shutdown 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 msgr2=0x563648a7c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.274+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f963c0f00c0 tx=0x7f963c0bbf60 comp rx=0 tx=0).stop 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 shutdown_connections 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563648af13e0 0x563648af3800 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563648a77370 0x563648a7ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563648a6db40 0x563648a7c930 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f962bfff640 0 client.18519 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:09.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 --2- 172.21.15.52:0/2863024474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563648a6c5d0 0x563648a7c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 >> 172.21.15.52:0/2863024474 conn(0x563648a35310 msgr2=0x563648a674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 shutdown_connections 2024-09-19T09:30:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 1 -- 172.21.15.52:0/2863024474 wait complete. 2024-09-19T09:30:09.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f965529c740 20 client.18519 trim_cache size 0 max 16384 2024-09-19T09:30:09.281 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 msgr2=0x7f96340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 0x7f96340a5700 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f964401b000 tx=0x7f964401d000 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 msgr2=0x7f964c199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f963c009230 tx=0x7f963c004270 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 shutdown_connections 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f964c106a80 0x7f964c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f964c101420 0x7f964c199890 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96340a3240 0x7f96340a5700 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.275+0000 7f9652ec3640 1 --2- 172.21.15.52:0/3222459183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f964c100a80 0x7f964c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.276+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 >> 172.21.15.52:0/3222459183 conn(0x7f964c0fc7a0 msgr2=0x7f964c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:09.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.276+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 shutdown_connections 2024-09-19T09:30:09.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:09.276+0000 7f9652ec3640 1 -- 172.21.15.52:0/3222459183 wait complete. 2024-09-19T09:30:09.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:09 smithi052 ceph-mon[30947]: pgmap v599: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:09.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:09 smithi169 ceph-mon[35454]: pgmap v599: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:09 smithi086 ceph-mon[34813]: pgmap v599: 97 pgs: 97 active+clean; 4.3 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:10.938 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:30:10.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:30:11.213 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:11.554 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:11 smithi052 ceph-mon[30947]: pgmap v600: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:30:11.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 -- 172.21.15.52:0/3179960527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4106f10 msgr2=0x7f97d410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/3179960527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4106f10 0x7f97d410ea90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009ca0 tx=0x7f97cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 -- 172.21.15.52:0/3179960527 shutdown_connections 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/3179960527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4106f10 0x7f97d410ea90 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/3179960527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 0x7f97d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/3179960527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4101de0 0x7f97d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 -- 172.21.15.52:0/3179960527 >> 172.21.15.52:0/3179960527 conn(0x7f97d40fd8c0 msgr2=0x7f97d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.639+0000 7f97dbbfc640 1 -- 172.21.15.52:0/3179960527 shutdown_connections 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 -- 172.21.15.52:0/3179960527 wait complete. 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 Processor -- start 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 -- start start 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 0x7f97d419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4106f10 0x7f97d419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4111f70 con 0x7f97d4101de0 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4111df0 con 0x7f97d4106f10 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97dbbfc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41120f0 con 0x7f97d4102790 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97d9998640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97d9998640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57040/0 (socket says 172.21.15.52:57040) 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.640+0000 7f97d9998640 1 -- 172.21.15.52:0/969017725 learned_addr learned my addr 172.21.15.52:0/969017725 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9197640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 0x7f97d419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97da199640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4106f10 0x7f97d419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 -- 172.21.15.52:0/969017725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 msgr2=0x7f97d419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 0x7f97d419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 -- 172.21.15.52:0/969017725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4106f10 msgr2=0x7f97d419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4106f10 0x7f97d419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 -- 172.21.15.52:0/969017725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d419f5a0 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97d9998640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c920 tx=0x7f97d000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97c6ffd640 1 -- 172.21.15.52:0/969017725 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0007c70 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97c6ffd640 1 -- 172.21.15.52:0/969017725 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97d0007e10 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d419f890 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97c6ffd640 1 -- 172.21.15.52:0/969017725 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0018890 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.641+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41a7170 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.643+0000 7f97c6ffd640 1 -- 172.21.15.52:0/969017725 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f97d0018a70 con 0x7f97d4101de0 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 Processor -- start 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 -- start start 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb84130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55665eadc280 con 0x55665eb76b60 2024-09-19T09:30:11.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55665ea83b10 con 0x55665eb77480 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55665ead8240 con 0x55665eb81d40 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97c6ffd640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97da199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97da199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57046/0 (socket says 172.21.15.52:57046) 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.644+0000 7f97da199640 1 -- 172.21.15.52:0/2207918324 learned_addr learned my addr 172.21.15.52:0/2207918324 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97d9197640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb84130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97c6ffd640 1 -- 172.21.15.52:0/969017725 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f97d00cfa30 con 0x7f97d4101de0 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97d9998640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 -- 172.21.15.52:0/2207918324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 msgr2=0x55665eb84130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb84130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 -- 172.21.15.52:0/2207918324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 msgr2=0x55665eb81800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb81800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 -- 172.21.15.52:0/2207918324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665ea901f0 con 0x55665eb76b60 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97d9998640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb81800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f97cc004af0 tx=0x7f97cc003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8113f2608508393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97bffff640 1 -- 172.21.15.52:0/2207918324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc003e40 con 0x55665eb76b60 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97bffff640 1 -- 172.21.15.52:0/2207918324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc04f070 con 0x55665eb76b60 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97bffff640 1 -- 172.21.15.52:0/2207918324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc02fcb0 con 0x55665eb76b60 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.645+0000 7f97da199640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 0x7f97c00a5700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f97cc04e000 tx=0x7f97cc04c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- 172.21.15.52:0/2207918324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 msgr2=0x55665eb76f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f97cc004af0 tx=0x7f97cc003a70 comp rx=0 tx=0).stop 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- 172.21.15.52:0/2207918324 shutdown_connections 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb84130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb81800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/2207918324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb76b60 0x55665eb76f40 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- 172.21.15.52:0/2207918324 >> 172.21.15.52:0/2207918324 conn(0x55665eb730f0 msgr2=0x55665eb734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- 172.21.15.52:0/2207918324 shutdown_connections 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- 172.21.15.52:0/2207918324 wait complete. 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 -- start start 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.646+0000 7f97ddfd5740 1 Processor -- start 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 0x55665eb7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb7f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55665eb84790 con 0x55665eb81d40 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55665ea96f10 con 0x55665eb77480 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55665eb84910 con 0x55665eb76b60 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97ddfd5740 10 client.0 _ll_register_callbacks cb 0x55665ea5fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57052/0 (socket says 172.21.15.52:57052) 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 -- 172.21.15.52:0/967324223 learned_addr learned my addr 172.21.15.52:0/967324223 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97d9998640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 0x55665eb7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97d9197640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb7f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 -- 172.21.15.52:0/967324223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 msgr2=0x55665eb7ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 0x55665eb7ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 -- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 msgr2=0x55665eb7f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb7f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97da199640 1 -- 172.21.15.52:0/967324223 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665e84d6a0 con 0x55665eb81d40 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97d9998640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 0x55665eb7ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.647+0000 7f97d9197640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb7f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97da199640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f97cc031b10 tx=0x7f97cc005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a62d4d973b1a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97cc05c060 con 0x55665eb81d40 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f97cc02fc40 con 0x55665eb81d40 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97cc04f070 con 0x55665eb81d40 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97cc004410 con 0x55665eb81d40 2024-09-19T09:30:11.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 10 client.18531 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55665eb84790 con 0x55665eb81d40 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97cc04f070 con 0x55665eb81d40 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97cc04a470 con 0x55665eb81d40 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 10 client.18531 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 10 client.18531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 20 client.18531 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665eb91460 0x55665eb93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 4 client.18531 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.648+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55665eae97f0 con 0x55665eb91460 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.649+0000 7f97d9998640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665eb91460 0x55665eb93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.649+0000 7f97bd7fa640 10 client.18531 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.649+0000 7f97d9998640 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665eb91460 0x55665eb93880 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d5133be2720c13 server_cookie=a57178e3e3ac1327 in_seq=0 out_seq=0 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97bd7fa640 1 -- 172.21.15.52:0/967324223 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55665eae97f0 con 0x55665eb91460 2024-09-19T09:30:11.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97bd7fa640 10 client.18531 handle_command_reply: tid=0 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 client.18531 shutdown 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 msgr2=0x55665eb7f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f97cc031b10 tx=0x7f97cc005b50 comp rx=0 tx=0).stop 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 shutdown_connections 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665eb91460 0x55665eb93880 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb81d40 0x55665eb7f680 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb77480 0x55665eb7f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97bd7fa640 0 client.18531 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/967324223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb76b60 0x55665eb7ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 >> 172.21.15.52:0/967324223 conn(0x55665eb730f0 msgr2=0x55665eb72270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 shutdown_connections 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 1 -- 172.21.15.52:0/967324223 wait complete. 2024-09-19T09:30:11.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.650+0000 7f97ddfd5740 20 client.18531 trim_cache size 0 max 16384 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 Processor -- start 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 -- start start 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb7f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb99150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41b21e0 con 0x55665eb77480 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41afab0 con 0x55665eb76b60 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.667+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41ad900 con 0x55665eb81d40 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57060/0 (socket says 172.21.15.52:57060) 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 -- 172.21.15.52:0/830061004 learned_addr learned my addr 172.21.15.52:0/830061004 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97da199640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb99150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9998640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb7f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 -- 172.21.15.52:0/830061004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 msgr2=0x55665eb99150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb99150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 -- 172.21.15.52:0/830061004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 msgr2=0x55665eb7f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb7f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 -- 172.21.15.52:0/830061004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55665eb72b90 con 0x55665eb77480 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97da199640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb99150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9998640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb7f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97d9197640 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f97c8005fd0 tx=0x7f97c800bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcc11621de3d6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97bf7fe640 1 -- 172.21.15.52:0/830061004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c800bda0 con 0x55665eb77480 2024-09-19T09:30:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97bf7fe640 1 -- 172.21.15.52:0/830061004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c8011440 con 0x55665eb77480 2024-09-19T09:30:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.668+0000 7f97bf7fe640 1 -- 172.21.15.52:0/830061004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8010670 con 0x55665eb77480 2024-09-19T09:30:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- 172.21.15.52:0/830061004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 msgr2=0x55665eb78cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f97c8005fd0 tx=0x7f97c800bb50 comp rx=0 tx=0).stop 2024-09-19T09:30:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- 172.21.15.52:0/830061004 shutdown_connections 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb99150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb78cc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/830061004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb7f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- 172.21.15.52:0/830061004 >> 172.21.15.52:0/830061004 conn(0x55665eb730f0 msgr2=0x55665eb785b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- 172.21.15.52:0/830061004 shutdown_connections 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- 172.21.15.52:0/830061004 wait complete. 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 -- start start 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.669+0000 7f97ddfd5740 1 Processor -- start 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb7bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41adf70 con 0x55665eb77480 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41af3e0 con 0x55665eb76b60 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41ae640 con 0x55665eb81d40 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97ddfd5740 10 client.0 _ll_register_callbacks cb 0x7f97c8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57066/0 (socket says 172.21.15.52:57066) 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 -- 172.21.15.52:0/1927033438 learned_addr learned my addr 172.21.15.52:0/1927033438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97da199640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb7bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9998640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 -- 172.21.15.52:0/1927033438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 msgr2=0x55665eb7bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb7bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 -- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 msgr2=0x55665eb8a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb8a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 -- 172.21.15.52:0/1927033438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55665eb7c790 con 0x55665eb77480 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9998640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb8a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97d9197640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f97c8011be0 tx=0x7f97c800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761346117e6ef6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.670+0000 7f97bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c8021040 con 0x55665eb77480 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f97c80115f0 con 0x55665eb77480 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97c8011440 con 0x55665eb77480 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97c80117f0 con 0x55665eb77480 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 10 client.18537 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55665ebfc1c0 con 0x55665eb77480 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c8011440 con 0x55665eb77480 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97c8024070 con 0x55665eb77480 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 10 client.18537 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 10 client.18537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 20 client.18537 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665ebfc870 0x55665ebfec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 4 client.18537 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.671+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55665eae3d00 con 0x55665ebfc870 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.672+0000 7f97d9998640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665ebfc870 0x55665ebfec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.672+0000 7f97bd7fa640 10 client.18537 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.672+0000 7f97d9998640 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665ebfc870 0x55665ebfec60 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70727b339624b2f9 server_cookie=74ea088a8e0717b4 in_seq=0 out_seq=0 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97bd7fa640 1 -- 172.21.15.52:0/1927033438 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55665eae3d00 con 0x55665ebfc870 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97bd7fa640 10 client.18537 handle_command_reply: tid=0 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 client.18537 shutdown 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 msgr2=0x55665eb7ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f97c8011be0 tx=0x7f97c800bfd0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 shutdown_connections 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55665ebfc870 0x55665ebfec60 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55665eb81d40 0x55665eb7bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55665eb77480 0x55665eb7ba20 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97bd7fa640 0 client.18537 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:11.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 --2- 172.21.15.52:0/1927033438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55665eb76b60 0x55665eb8a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 >> 172.21.15.52:0/1927033438 conn(0x55665eb730f0 msgr2=0x55665eb78dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 shutdown_connections 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.673+0000 7f97ddfd5740 1 -- 172.21.15.52:0/1927033438 wait complete. 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97ddfd5740 20 client.18537 trim_cache size 0 max 16384 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "56de9593-f42b-4c07-b203-2a7a74e3b0d4", 2024-09-19T09:30:11.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:30:11.682 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:11.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 msgr2=0x7f97c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 0x7f97c00a5700 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f97cc04e000 tx=0x7f97cc04c000 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 msgr2=0x7f97d419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f97d000c920 tx=0x7f97d000cde0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 shutdown_connections 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97d4106f10 0x7f97d419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f97d4102790 0x7f97d419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 --2- 172.21.15.52:0/969017725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97d4101de0 0x7f97d419a5f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 >> 172.21.15.52:0/969017725 conn(0x7f97d40fd8c0 msgr2=0x7f97d40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 shutdown_connections 2024-09-19T09:30:11.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:11.674+0000 7f97dbbfc640 1 -- 172.21.15.52:0/969017725 wait complete. 2024-09-19T09:30:11.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:11 smithi169 ceph-mon[35454]: pgmap v600: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:30:11.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:11 smithi086 ceph-mon[34813]: pgmap v600: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-19T09:30:12.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:30:12.654 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 -- 172.21.15.52:0/2776808484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 msgr2=0x7f302410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 --2- 172.21.15.52:0/2776808484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302410ea90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f301c009900 tx=0x7f301c02a410 comp rx=0 tx=0).stop 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 -- 172.21.15.52:0/2776808484 shutdown_connections 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 --2- 172.21.15.52:0/2776808484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302410ea90 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 --2- 172.21.15.52:0/2776808484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024102790 0x7f30241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 --2- 172.21.15.52:0/2776808484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024101de0 0x7f30241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 -- 172.21.15.52:0/2776808484 >> 172.21.15.52:0/2776808484 conn(0x7f30240fd8c0 msgr2=0x7f30240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 -- 172.21.15.52:0/2776808484 shutdown_connections 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.078+0000 7f3029739640 1 -- 172.21.15.52:0/2776808484 wait complete. 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 Processor -- start 2024-09-19T09:30:13.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 -- start start 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024101de0 0x7f302419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024102790 0x7f302419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3024111f70 con 0x7f3024106f10 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3024111df0 con 0x7f3024101de0 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f3029739640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30241120f0 con 0x7f3024102790 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.079+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57084/0 (socket says 172.21.15.52:57084) 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 -- 172.21.15.52:0/2061382026 learned_addr learned my addr 172.21.15.52:0/2061382026 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30227fc640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024102790 0x7f302419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f3022ffd640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024101de0 0x7f302419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 -- 172.21.15.52:0/2061382026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024102790 msgr2=0x7f302419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024102790 0x7f302419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 -- 172.21.15.52:0/2061382026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024101de0 msgr2=0x7f302419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024101de0 0x7f302419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 -- 172.21.15.52:0/2061382026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302419f5c0 con 0x7f3024106f10 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f30237fe640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f301c005ab0 tx=0x7f301c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f301bfff640 1 -- 172.21.15.52:0/2061382026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c03f030 con 0x7f3024106f10 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302419f850 con 0x7f3024106f10 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f301bfff640 1 -- 172.21.15.52:0/2061382026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f301c003ce0 con 0x7f3024106f10 2024-09-19T09:30:13.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f301bfff640 1 -- 172.21.15.52:0/2061382026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c035070 con 0x7f3024106f10 2024-09-19T09:30:13.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.080+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30241a7190 con 0x7f3024106f10 2024-09-19T09:30:13.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.082+0000 7f301bfff640 1 -- 172.21.15.52:0/2061382026 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f301c042030 con 0x7f3024106f10 2024-09-19T09:30:13.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 Processor -- start 2024-09-19T09:30:13.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 -- start start 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f301bfff640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 0x7f30100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56057d2552e0 con 0x56057d2fa680 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56057d1fcce0 con 0x56057d2efdc0 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.083+0000 7f302bb12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56057d2512a0 con 0x56057d2ef4a0 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30227fc640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 0x7f30100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57092/0 (socket says 172.21.15.52:57092) 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f301bfff640 1 -- 172.21.15.52:0/2061382026 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f301c0f0040 con 0x7f3024106f10 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 -- 172.21.15.52:0/3060152561 learned_addr learned my addr 172.21.15.52:0/3060152561 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f3022ffd640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30227fc640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 -- 172.21.15.52:0/3060152561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 msgr2=0x56057d2ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 -- 172.21.15.52:0/3060152561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 msgr2=0x56057d2fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 -- 172.21.15.52:0/3060152561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057d1e1440 con 0x56057d2fa680 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30227fc640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30237fe640 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f301c003fb0 tx=0x7f301c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7567358bc294a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30227fc640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 0x7f30100a5700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x56057d2ec890 tx=0x7f300c009ae0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30197fa640 1 -- 172.21.15.52:0/3060152561 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c049070 con 0x56057d2fa680 2024-09-19T09:30:13.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30197fa640 1 -- 172.21.15.52:0/3060152561 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f301c090970 con 0x56057d2fa680 2024-09-19T09:30:13.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.084+0000 7f30197fa640 1 -- 172.21.15.52:0/3060152561 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c0ba7d0 con 0x56057d2fa680 2024-09-19T09:30:13.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 -- 172.21.15.52:0/3060152561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 msgr2=0x56057d2fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f301c003fb0 tx=0x7f301c03b6b0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 -- 172.21.15.52:0/3060152561 shutdown_connections 2024-09-19T09:30:13.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fca70 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 --2- 172.21.15.52:0/3060152561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 -- 172.21.15.52:0/3060152561 >> 172.21.15.52:0/3060152561 conn(0x56057d2eba30 msgr2=0x56057d2ebe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 -- 172.21.15.52:0/3060152561 shutdown_connections 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.085+0000 7f302bb12740 1 -- 172.21.15.52:0/3060152561 wait complete. 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 -- start start 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 Processor -- start 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56057d2fd010 con 0x56057d2fa680 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56057d210050 con 0x56057d2efdc0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56057d2fd190 con 0x56057d2ef4a0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f302bb12740 10 client.0 _ll_register_callbacks cb 0x56057d250160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57104/0 (socket says 172.21.15.52:57104) 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 -- 172.21.15.52:0/3764747584 learned_addr learned my addr 172.21.15.52:0/3764747584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f3022ffd640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30227fc640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 -- 172.21.15.52:0/3764747584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 msgr2=0x56057d2f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2f9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.086+0000 7f30237fe640 1 -- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 msgr2=0x56057d2f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f30237fe640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f30237fe640 1 -- 172.21.15.52:0/3764747584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057cfc63c0 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f3022ffd640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f30237fe640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f301c0c4dc0 tx=0x7f301c0c0aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147e0025e67fd3a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c0d5060 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f301c03f1d0 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f301c090970 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f301c049040 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 10 client.18549 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56057d2fd010 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f301c090970 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f301c03ec40 con 0x56057d2fa680 2024-09-19T09:30:13.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 10 client.18549 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 10 client.18549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.087+0000 7f302bb12740 20 client.18549 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d309b40 0x56057d30bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f302bb12740 4 client.18549 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56057d262850 con 0x56057d309b40 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f3022ffd640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d309b40 0x56057d30bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f3022ffd640 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d309b40 0x56057d30bf60 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dbfb391324ec352 server_cookie=ad424662ff2fc087 in_seq=0 out_seq=0 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.088+0000 7f300a7fc640 10 client.18549 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f300a7fc640 1 -- 172.21.15.52:0/3764747584 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56057d262850 con 0x56057d309b40 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f300a7fc640 10 client.18549 handle_command_reply: tid=0 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 client.18549 shutdown 2024-09-19T09:30:13.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 msgr2=0x56057d2f7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f301c0c4dc0 tx=0x7f301c0c0aa0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 shutdown_connections 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d309b40 0x56057d30bf60 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2f7780 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d2f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 --2- 172.21.15.52:0/3764747584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d2f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 >> 172.21.15.52:0/3764747584 conn(0x56057d2eba30 msgr2=0x56057d2f1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f300a7fc640 0 client.18549 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 shutdown_connections 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 1 -- 172.21.15.52:0/3764747584 wait complete. 2024-09-19T09:30:13.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.089+0000 7f302bb12740 20 client.18549 trim_cache size 0 max 16384 2024-09-19T09:30:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.106+0000 7f302bb12740 1 Processor -- start 2024-09-19T09:30:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.106+0000 7f302bb12740 1 -- start start 2024-09-19T09:30:13.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2efdc0 0x56057d311810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2fa680 0x56057d311d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30241b22d0 con 0x56057d2ef4a0 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30241afba0 con 0x56057d2fa680 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f302bb12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30241ad9f0 con 0x56057d2efdc0 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57108/0 (socket says 172.21.15.52:57108) 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 -- 172.21.15.52:0/362649077 learned_addr learned my addr 172.21.15.52:0/362649077 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f30227fc640 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2efdc0 0x56057d311810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 -- 172.21.15.52:0/362649077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2efdc0 msgr2=0x56057d311810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2efdc0 0x56057d311810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 -- 172.21.15.52:0/362649077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2fa680 msgr2=0x56057d311d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2fa680 0x56057d311d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 -- 172.21.15.52:0/362649077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057d2f9bb0 con 0x56057d2ef4a0 2024-09-19T09:30:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.107+0000 7f3022ffd640 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f301400bb60 tx=0x7f301400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8abdab8b29c5d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f3018ff9640 1 -- 172.21.15.52:0/362649077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014005020 con 0x56057d2ef4a0 2024-09-19T09:30:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f3018ff9640 1 -- 172.21.15.52:0/362649077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30140047a0 con 0x56057d2ef4a0 2024-09-19T09:30:13.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f3018ff9640 1 -- 172.21.15.52:0/362649077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014011860 con 0x56057d2ef4a0 2024-09-19T09:30:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 -- 172.21.15.52:0/362649077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 msgr2=0x56057d3061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f301400bb60 tx=0x7f301400b390 comp rx=0 tx=0).stop 2024-09-19T09:30:13.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 -- 172.21.15.52:0/362649077 shutdown_connections 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2fa680 0x56057d311d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2efdc0 0x56057d311810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 --2- 172.21.15.52:0/362649077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2ef4a0 0x56057d3061e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 -- 172.21.15.52:0/362649077 >> 172.21.15.52:0/362649077 conn(0x56057d2eba30 msgr2=0x56057d2f2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 -- 172.21.15.52:0/362649077 shutdown_connections 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.108+0000 7f302bb12740 1 -- 172.21.15.52:0/362649077 wait complete. 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 -- start start 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 Processor -- start 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d36cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d36d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30241ae060 con 0x56057d2fa680 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30241af4d0 con 0x56057d2efdc0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30241ae730 con 0x56057d2ef4a0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f302bb12740 10 client.0 _ll_register_callbacks cb 0x7f3014004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57120/0 (socket says 172.21.15.52:57120) 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 -- 172.21.15.52:0/2098926794 learned_addr learned my addr 172.21.15.52:0/2098926794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30227fc640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d36d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f3022ffd640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d36cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 -- 172.21.15.52:0/2098926794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 msgr2=0x56057d36cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d36cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.109+0000 7f30237fe640 1 -- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 msgr2=0x56057d36d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f30237fe640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d36d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f30237fe640 1 -- 172.21.15.52:0/2098926794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56057d2fdfc0 con 0x56057d2fa680 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f30237fe640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ba9e0 tx=0x7f301c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4900a86674e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c0d5040 con 0x56057d2fa680 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f301c0c4e60 con 0x56057d2fa680 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30140047a0 con 0x56057d2fa680 2024-09-19T09:30:13.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f301c0bcc10 con 0x56057d2fa680 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 10 client.18555 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56057d2fdfc0 con 0x56057d2fa680 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30140047a0 con 0x56057d2fa680 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f301c0d0ba0 con 0x56057d2fa680 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 10 client.18555 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 10 client.18555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.110+0000 7f302bb12740 20 client.18555 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d374550 0x56057d376940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f302bb12740 4 client.18555 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56057d25cd60 con 0x56057d374550 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f3022ffd640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d374550 0x56057d376940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f3022ffd640 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d374550 0x56057d376940 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e10877b261dc9f server_cookie=1b0634d3fcd41ea7 in_seq=0 out_seq=0 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f300a7fc640 10 client.18555 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:13.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f300a7fc640 1 -- 172.21.15.52:0/2098926794 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56057d25cd60 con 0x56057d374550 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f300a7fc640 10 client.18555 handle_command_reply: tid=0 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.111+0000 7f302bb12740 1 client.18555 shutdown 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 msgr2=0x56057d2fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ba9e0 tx=0x7f301c03b6b0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 shutdown_connections 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56057d374550 0x56057d376940 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56057d2fa680 0x56057d2fd8d0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f300a7fc640 0 client.18555 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56057d2efdc0 0x56057d36d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 --2- 172.21.15.52:0/2098926794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56057d2ef4a0 0x56057d36cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 >> 172.21.15.52:0/2098926794 conn(0x56057d2eba30 msgr2=0x56057d2f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 shutdown_connections 2024-09-19T09:30:13.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 1 -- 172.21.15.52:0/2098926794 wait complete. 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f302bb12740 20 client.18555 trim_cache size 0 max 16384 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "56de9593-f42b-4c07-b203-2a7a74e3b0d4": { 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "56de9593-f42b-4c07-b203-2a7a74e3b0d4", 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:13.119 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:13.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 msgr2=0x7f30100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 0x7f30100a5700 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x56057d2ec890 tx=0x7f300c009ae0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 msgr2=0x7f302419eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f301c005ab0 tx=0x7f301c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 shutdown_connections 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3024106f10 0x7f302419eee0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f30100a3240 0x7f30100a5700 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3024102790 0x7f302419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.112+0000 7f3029739640 1 --2- 172.21.15.52:0/2061382026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3024101de0 0x7f302419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.113+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 >> 172.21.15.52:0/2061382026 conn(0x7f30240fd8c0 msgr2=0x7f30240ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.113+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 shutdown_connections 2024-09-19T09:30:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:13.113+0000 7f3029739640 1 -- 172.21.15.52:0/2061382026 wait complete. 2024-09-19T09:30:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:13 smithi052 ceph-mon[30947]: pgmap v601: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:13 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:30:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:13 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:13 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:30:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:13 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:13 smithi169 ceph-mon[35454]: pgmap v601: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:13 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:30:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:13 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:13 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:30:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:13 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:13 smithi086 ceph-mon[34813]: pgmap v601: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:13 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:30:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:13 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:13 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:30:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:13 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:13.798 INFO:tasks.cephfs.filesystem:scrub status for tag:56de9593-f42b-4c07-b203-2a7a74e3b0d4 - {'path': '/', 'tag': '56de9593-f42b-4c07-b203-2a7a74e3b0d4', 'options': 'recursive,force'} 2024-09-19T09:30:14.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:14 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:30:14.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:14 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:30:14.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:14 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:30:15.594 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:15 smithi169 ceph-mon[35454]: pgmap v602: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:30:15.659 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:15 smithi086 ceph-mon[34813]: pgmap v602: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:30:15.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:15 smithi052 ceph-mon[30947]: pgmap v602: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:30:17.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:17 smithi052 ceph-mon[30947]: pgmap v603: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:17 smithi169 ceph-mon[35454]: pgmap v603: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:17.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:17 smithi086 ceph-mon[34813]: pgmap v603: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 -- 172.21.15.52:0/3304613721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 msgr2=0x7fe648101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 --2- 172.21.15.52:0/3304613721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648101f60 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe638009ca0 tx=0x7fe63802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 -- 172.21.15.52:0/3304613721 shutdown_connections 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 --2- 172.21.15.52:0/3304613721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 0x7fe648109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 --2- 172.21.15.52:0/3304613721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 0x7fe6481031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 --2- 172.21.15.52:0/3304613721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648101f60 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 -- 172.21.15.52:0/3304613721 >> 172.21.15.52:0/3304613721 conn(0x7fe6480fd2e0 msgr2=0x7fe6480ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 -- 172.21.15.52:0/3304613721 shutdown_connections 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.565+0000 7fe650152640 1 -- 172.21.15.52:0/3304613721 wait complete. 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 Processor -- start 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 -- start start 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 0x7fe648198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 0x7fe64819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe64810d810 con 0x7fe648101b60 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe64810d690 con 0x7fe648103710 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe650152640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe64810d990 con 0x7fe648102d50 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35706/0 (socket says 172.21.15.52:35706) 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe64deee640 1 -- 172.21.15.52:0/3978644484 learned_addr learned my addr 172.21.15.52:0/3978644484 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 0x7fe648198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.566+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 0x7fe64819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 -- 172.21.15.52:0/3978644484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 msgr2=0x7fe648198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 0x7fe648198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 -- 172.21.15.52:0/3978644484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 msgr2=0x7fe64819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 0x7fe64819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 -- 172.21.15.52:0/3978644484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64819f9f0 con 0x7fe648101b60 2024-09-19T09:30:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe64deee640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe638000f80 tx=0x7fe6380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe646ffd640 1 -- 172.21.15.52:0/3978644484 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638003bf0 con 0x7fe648101b60 2024-09-19T09:30:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe646ffd640 1 -- 172.21.15.52:0/3978644484 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe638003d90 con 0x7fe648101b60 2024-09-19T09:30:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe646ffd640 1 -- 172.21.15.52:0/3978644484 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63802fd30 con 0x7fe648101b60 2024-09-19T09:30:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64819fc80 con 0x7fe648101b60 2024-09-19T09:30:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.567+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6481a01d0 con 0x7fe648101b60 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.570+0000 7fe646ffd640 1 -- 172.21.15.52:0/3978644484 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe638004040 con 0x7fe648101b60 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.570+0000 7fe652fcd740 1 Processor -- start 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 -- start start 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05996da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a058f52f0 con 0x560a05997370 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560a0589d270 con 0x560a059919a0 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe652fcd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560a058f12b0 con 0x560a059922e0 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64d6ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64e6ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64e6ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:33898/0 (socket says 172.21.15.52:33898) 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64d6ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35710/0 (socket says 172.21.15.52:35710) 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64e6ef640 1 -- 172.21.15.52:0/3744483258 learned_addr learned my addr 172.21.15.52:0/3744483258 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe64deee640 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05996da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.571+0000 7fe646ffd640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 0x7fe6300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 -- 172.21.15.52:0/3744483258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 msgr2=0x560a05996da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05996da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 -- 172.21.15.52:0/3744483258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 msgr2=0x560a05991da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 -- 172.21.15.52:0/3744483258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0589c340 con 0x560a05997370 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 0x7fe6300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe646ffd640 1 -- 172.21.15.52:0/3978644484 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe6380f0da0 con 0x7fe648101b60 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00bbc0 tx=0x7fe63c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62245886f805f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe62ffff640 1 -- 172.21.15.52:0/3744483258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c004030 con 0x560a05997370 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe62ffff640 1 -- 172.21.15.52:0/3744483258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63c0041d0 con 0x560a05997370 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.572+0000 7fe62ffff640 1 -- 172.21.15.52:0/3744483258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0116a0 con 0x560a05997370 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- 172.21.15.52:0/3744483258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 msgr2=0x560a05999830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 0x7fe6300a57b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe640009fd0 tx=0x7fe6400046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00bbc0 tx=0x7fe63c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- 172.21.15.52:0/3744483258 shutdown_connections 2024-09-19T09:30:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a05997370 0x560a05999830 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05996da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 --2- 172.21.15.52:0/3744483258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059919a0 0x560a05991da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- 172.21.15.52:0/3744483258 >> 172.21.15.52:0/3744483258 conn(0x560a0598d010 msgr2=0x560a0598d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- 172.21.15.52:0/3744483258 shutdown_connections 2024-09-19T09:30:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- 172.21.15.52:0/3744483258 wait complete. 2024-09-19T09:30:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.573+0000 7fe652fcd740 1 -- start start 2024-09-19T09:30:19.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 Processor -- start 2024-09-19T09:30:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 0x560a0599bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a059a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a0599a340 con 0x560a059922e0 2024-09-19T09:30:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560a0587e290 con 0x560a05997370 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560a0599a4c0 con 0x560a059919a0 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe652fcd740 10 client.0 _ll_register_callbacks cb 0x560a058af140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35722/0 (socket says 172.21.15.52:35722) 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 -- 172.21.15.52:0/2225916669 learned_addr learned my addr 172.21.15.52:0/2225916669 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a059a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 -- 172.21.15.52:0/2225916669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 msgr2=0x560a0599bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64deee640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 0x560a0599bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 0x560a0599bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 -- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 msgr2=0x560a059a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a059a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.574+0000 7fe64d6ed640 1 -- 172.21.15.52:0/2225916669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a05608210 con 0x560a059922e0 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe64deee640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 0x560a0599bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe63c011010 tx=0x7fe63c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4434cc5d3bd7f671 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0035f0 con 0x560a059922e0 2024-09-19T09:30:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe63c003790 con 0x560a059922e0 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe63c0041d0 con 0x560a059922e0 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe63c0039b0 con 0x560a059922e0 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe652fcd740 10 client.18567 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a056d4620 con 0x560a059922e0 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63c0041d0 con 0x560a059922e0 2024-09-19T09:30:19.589 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.575+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe63c004a30 con 0x560a059922e0 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 10 client.18567 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 10 client.18567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 20 client.18567 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a059a75a0 0x560a059a9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 4 client.18567 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a05902a20 con 0x560a059a75a0 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe64deee640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a059a75a0 0x560a059a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe64deee640 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a059a75a0 0x560a059a9990 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54748d6e0e118906 server_cookie=5c147d1a99f25fdb in_seq=0 out_seq=0 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.576+0000 7fe62d7fa640 10 client.18567 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe62d7fa640 1 -- 172.21.15.52:0/2225916669 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a05902a20 con 0x560a059a75a0 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe62d7fa640 10 client.18567 handle_command_reply: tid=0 2024-09-19T09:30:19.591 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 client.18567 shutdown 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 msgr2=0x560a0599c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fe63c011010 tx=0x7fe63c00bfa0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 shutdown_connections 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a059a75a0 0x560a059a9990 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a059a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.592 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059922e0 0x560a0599c130 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2225916669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059919a0 0x560a0599bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe62d7fa640 0 client.18567 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 >> 172.21.15.52:0/2225916669 conn(0x560a0598d010 msgr2=0x560a0598e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 shutdown_connections 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 1 -- 172.21.15.52:0/2225916669 wait complete. 2024-09-19T09:30:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.577+0000 7fe652fcd740 20 client.18567 trim_cache size 0 max 16384 2024-09-19T09:30:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 Processor -- start 2024-09-19T09:30:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 -- start start 2024-09-19T09:30:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 0x560a059ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a05997370 0x560a059ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481abb20 con 0x560a059919a0 2024-09-19T09:30:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481a93f0 con 0x560a059922e0 2024-09-19T09:30:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe652fcd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481a7240 con 0x560a05997370 2024-09-19T09:30:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35726/0 (socket says 172.21.15.52:35726) 2024-09-19T09:30:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 -- 172.21.15.52:0/2846292430 learned_addr learned my addr 172.21.15.52:0/2846292430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 0x560a059ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.604 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 -- 172.21.15.52:0/2846292430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a05997370 msgr2=0x560a059ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a05997370 0x560a059ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 -- 172.21.15.52:0/2846292430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 msgr2=0x560a059ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 0x560a059ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64deee640 1 -- 172.21.15.52:0/2846292430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a05999ba0 con 0x560a059919a0 2024-09-19T09:30:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.592+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 0x560a059ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe64deee640 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe6380b9da0 tx=0x7fe63803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4322b34229c3e28a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe62f7fe640 1 -- 172.21.15.52:0/2846292430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6380dd040 con 0x560a059919a0 2024-09-19T09:30:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe62f7fe640 1 -- 172.21.15.52:0/2846292430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe638036070 con 0x560a059919a0 2024-09-19T09:30:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe62f7fe640 1 -- 172.21.15.52:0/2846292430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6380c1780 con 0x560a059919a0 2024-09-19T09:30:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 -- 172.21.15.52:0/2846292430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 msgr2=0x560a0598eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fe6380b9da0 tx=0x7fe63803e040 comp rx=0 tx=0).stop 2024-09-19T09:30:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 -- 172.21.15.52:0/2846292430 shutdown_connections 2024-09-19T09:30:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a05997370 0x560a059ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a059922e0 0x560a059ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 --2- 172.21.15.52:0/2846292430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a0598eb10 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 -- 172.21.15.52:0/2846292430 >> 172.21.15.52:0/2846292430 conn(0x560a0598d010 msgr2=0x560a0598d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 -- 172.21.15.52:0/2846292430 shutdown_connections 2024-09-19T09:30:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.593+0000 7fe652fcd740 1 -- 172.21.15.52:0/2846292430 wait complete. 2024-09-19T09:30:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 -- start start 2024-09-19T09:30:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 Processor -- start 2024-09-19T09:30:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05a0df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a05a14f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481a78b0 con 0x560a059919a0 2024-09-19T09:30:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481a8d20 con 0x560a05997370 2024-09-19T09:30:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6481a7f80 con 0x560a059922e0 2024-09-19T09:30:19.610 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe652fcd740 10 client.0 _ll_register_callbacks cb 0x7fe640009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe64deee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35738/0 (socket says 172.21.15.52:35738) 2024-09-19T09:30:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe64deee640 1 -- 172.21.15.52:0/783011396 learned_addr learned my addr 172.21.15.52:0/783011396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:19.611 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05a0df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.594+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a05a14f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 -- 172.21.15.52:0/783011396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 msgr2=0x560a05a0df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05a0df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.612 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 -- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 msgr2=0x560a05a14f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a05a14f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 -- 172.21.15.52:0/783011396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a05a15580 con 0x560a059919a0 2024-09-19T09:30:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64e6ef640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a05a14f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe64deee640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fe638006010 tx=0x7fe6380bcda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3622b33ae7bfbae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:19.613 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe62d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6380a6040 con 0x560a059919a0 2024-09-19T09:30:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe6380d62b0 con 0x560a059919a0 2024-09-19T09:30:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe638036070 con 0x560a059919a0 2024-09-19T09:30:19.614 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe6380db020 con 0x560a059919a0 2024-09-19T09:30:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe652fcd740 10 client.18573 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a05a16800 con 0x560a059919a0 2024-09-19T09:30:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.595+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe638036070 con 0x560a059919a0 2024-09-19T09:30:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe6380a1020 con 0x560a059919a0 2024-09-19T09:30:19.615 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 10 client.18573 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 10 client.18573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 20 client.18573 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a05a17120 0x560a05a19540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 4 client.18573 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:30:19.616 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a058fcd70 con 0x560a05a17120 2024-09-19T09:30:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a05a17120 0x560a05a19540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe62d7fa640 10 client.18573 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:19.617 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.596+0000 7fe64d6ed640 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a05a17120 0x560a05a19540 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70daa25780476fcc server_cookie=26bc090c6afcae25 in_seq=0 out_seq=0 2024-09-19T09:30:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe62d7fa640 1 -- 172.21.15.52:0/783011396 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a058fcd70 con 0x560a05a17120 2024-09-19T09:30:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe62d7fa640 10 client.18573 handle_command_reply: tid=0 2024-09-19T09:30:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 client.18573 shutdown 2024-09-19T09:30:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 msgr2=0x560a05a0d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fe638006010 tx=0x7fe6380bcda0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 shutdown_connections 2024-09-19T09:30:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a05a17120 0x560a05a19540 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a05997370 0x560a05a14f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a059922e0 0x560a05a0df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe62d7fa640 0 client.18573 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 --2- 172.21.15.52:0/783011396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a059919a0 0x560a05a0d9f0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 >> 172.21.15.52:0/783011396 conn(0x560a0598d010 msgr2=0x560a0598dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 shutdown_connections 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.611+0000 7fe652fcd740 1 -- 172.21.15.52:0/783011396 wait complete. 2024-09-19T09:30:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe652fcd740 20 client.18573 trim_cache size 0 max 16384 2024-09-19T09:30:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:30:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:30:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:30:19.623 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:30:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 msgr2=0x7fe6300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 0x7fe6300a57b0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe640009fd0 tx=0x7fe6400046c0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 msgr2=0x7fe648197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:19.625 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe638000f80 tx=0x7fe6380319f0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 shutdown_connections 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe648103710 0x7fe64819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6300a32f0 0x7fe6300a57b0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648102d50 0x7fe648198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 --2- 172.21.15.52:0/3978644484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe648101b60 0x7fe648197dd0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:19.626 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 >> 172.21.15.52:0/3978644484 conn(0x7fe6480fd2e0 msgr2=0x7fe6481060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 shutdown_connections 2024-09-19T09:30:19.627 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:19.612+0000 7fe650152640 1 -- 172.21.15.52:0/3978644484 wait complete. 2024-09-19T09:30:19.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:19 smithi052 ceph-mon[30947]: pgmap v604: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:30:19.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:19 smithi169 ceph-mon[35454]: pgmap v604: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:30:19.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:19 smithi086 ceph-mon[34813]: pgmap v604: 97 pgs: 97 active+clean; 4.4 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:30:21.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:21 smithi052 ceph-mon[30947]: pgmap v605: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:21 smithi169 ceph-mon[35454]: pgmap v605: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:21.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:21 smithi086 ceph-mon[34813]: pgmap v605: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:251/600: open fd = 3 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:252/600: open fd = 3 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.916 INFO:tasks.workunit.client.0.smithi052.stdout:253/600: open fd = 3 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:254/600: open fd = 3 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:255/600: open fd = 3 2024-09-19T09:30:22.917 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:256/600: open fd = 3 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:257/600: open fd = 3 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:258/600: open fd = 3 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.918 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:259/600: open fd = 3 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:260/600: open fd = 3 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.919 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:261/600: open fd = 3 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:262/600: open fd = 3 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:263/600: open fd = 3 2024-09-19T09:30:22.920 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:264/600: open fd = 3 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:265/600: open fd = 3 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:266/600: open fd = 3 2024-09-19T09:30:22.921 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:267/600: open fd = 3 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:268/600: open fd = 3 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:269/600: open fd = 3 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.922 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:270/600: open fd = 3 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:271/600: open fd = 3 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:272/600: open fd = 3 2024-09-19T09:30:22.923 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:273/600: open fd = 3 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:274/600: open fd = 3 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:275/600: open fd = 3 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.924 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:276/600: open fd = 3 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:277/600: open fd = 3 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:278/600: open fd = 3 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.925 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:279/600: open fd = 3 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:280/600: open fd = 3 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:281/600: open fd = 3 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.926 INFO:tasks.workunit.client.0.smithi052.stdout:282/600: open fd = 3 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:283/600: open fd = 3 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:284/600: open fd = 3 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:285/600: open fd = 3 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.927 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:286/600: open fd = 3 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:287/600: open fd = 3 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:288/600: open fd = 3 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.928 INFO:tasks.workunit.client.0.smithi052.stdout:289/600: open fd = 3 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:290/600: open fd = 3 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:291/600: open fd = 3 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:292/600: open fd = 3 2024-09-19T09:30:22.929 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:293/600: open fd = 3 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:294/600: open fd = 3 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:295/600: open fd = 3 2024-09-19T09:30:22.930 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:296/600: open fd = 3 2024-09-19T09:30:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.931 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:297/600: open fd = 3 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:298/600: open fd = 3 2024-09-19T09:30:22.932 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:299/600: open fd = 3 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:300/600: open fd = 3 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:301/600: open fd = 3 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.933 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:302/600: open fd = 3 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:303/600: open fd = 3 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:304/600: open fd = 3 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.934 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:305/600: open fd = 3 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:306/600: open fd = 3 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:307/600: open fd = 3 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.935 INFO:tasks.workunit.client.0.smithi052.stdout:308/600: open fd = 3 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:309/600: open fd = 3 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:310/600: open fd = 3 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.936 INFO:tasks.workunit.client.0.smithi052.stdout:311/600: open fd = 3 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:312/600: open fd = 3 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:22.937 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:30:23.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:23 smithi052 ceph-mon[30947]: pgmap v606: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:23 smithi169 ceph-mon[35454]: pgmap v606: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:23.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:23 smithi086 ceph-mon[34813]: pgmap v606: 97 pgs: 97 active+clean; 4.5 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:30:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:25 smithi052 ceph-mon[30947]: pgmap v607: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:25.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:25 smithi169 ceph-mon[35454]: pgmap v607: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:25 smithi086 ceph-mon[34813]: pgmap v607: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:27.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:27 smithi052 ceph-mon[30947]: pgmap v608: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:27.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:27 smithi169 ceph-mon[35454]: pgmap v608: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:27.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:27 smithi086 ceph-mon[34813]: pgmap v608: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:29 smithi052 ceph-mon[30947]: pgmap v609: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:29.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:29 smithi169 ceph-mon[35454]: pgmap v609: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:29 smithi086 ceph-mon[34813]: pgmap v609: 97 pgs: 97 active+clean; 4.6 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:31.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:31 smithi052 ceph-mon[30947]: pgmap v610: 97 pgs: 97 active+clean; 4.6 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:31.876 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:31 smithi086 ceph-mon[34813]: pgmap v610: 97 pgs: 97 active+clean; 4.6 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:31.876 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:31 smithi169 ceph-mon[35454]: pgmap v610: 97 pgs: 97 active+clean; 4.6 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:32.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:32 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:32.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:32 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 -- 172.21.15.52:0/1907122988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86580ffe10 msgr2=0x7f8658100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 --2- 172.21.15.52:0/1907122988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86580ffe10 0x7f8658100210 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f8648009900 tx=0x7f864802a410 comp rx=0 tx=0).stop 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 -- 172.21.15.52:0/1907122988 shutdown_connections 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 --2- 172.21.15.52:0/1907122988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86581037a0 0x7f865810a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 --2- 172.21.15.52:0/1907122988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8658102de0 0x7f8658103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 --2- 172.21.15.52:0/1907122988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86580ffe10 0x7f8658100210 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 -- 172.21.15.52:0/1907122988 >> 172.21.15.52:0/1907122988 conn(0x7f86580fb970 msgr2=0x7f86580fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 -- 172.21.15.52:0/1907122988 shutdown_connections 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.704+0000 7f865d43c640 1 -- 172.21.15.52:0/1907122988 wait complete. 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 Processor -- start 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 -- start start 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 0x7f8658102750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86581037a0 0x7f86581012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f865810d7e0 con 0x7f8658102de0 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f865810d660 con 0x7f86581037a0 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f865d43c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f865810d960 con 0x7f86580ffe10 2024-09-19T09:30:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50780/0 (socket says 172.21.15.52:50780) 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 -- 172.21.15.52:0/1173553688 learned_addr learned my addr 172.21.15.52:0/1173553688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f86577fe640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86581037a0 0x7f86581012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f8656ffd640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 0x7f8658102750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 -- 172.21.15.52:0/1173553688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 msgr2=0x7f8658102750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 0x7f8658102750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 -- 172.21.15.52:0/1173553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86581037a0 msgr2=0x7f86581012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86581037a0 0x7f86581012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f864ffff640 1 -- 172.21.15.52:0/1173553688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658101b60 con 0x7f8658102de0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.705+0000 7f8656ffd640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 0x7f8658102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f864ffff640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f864000d950 tx=0x7f864000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f8654ff9640 1 -- 172.21.15.52:0/1173553688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640017070 con 0x7f8658102de0 2024-09-19T09:30:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f8654ff9640 1 -- 172.21.15.52:0/1173553688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8640009c30 con 0x7f8658102de0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86581a1ed0 con 0x7f8658102de0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f8654ff9640 1 -- 172.21.15.52:0/1173553688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864000f6b0 con 0x7f8658102de0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.706+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86581a2340 con 0x7f8658102de0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.708+0000 7f86601d8740 1 Processor -- start 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 -- start start 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f91eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f926830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a34f8822f0 con 0x55a34f91f2e0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a34f82a270 con 0x55a34f91e9a0 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86601d8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a34f87e2b0 con 0x55a34f924370 2024-09-19T09:30:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50784/0 (socket says 172.21.15.52:50784) 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 -- 172.21.15.52:0/3618625622 learned_addr learned my addr 172.21.15.52:0/3618625622 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f86577fe640 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f91eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8654ff9640 1 -- 172.21.15.52:0/1173553688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f86400109d0 con 0x7f8658102de0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 -- 172.21.15.52:0/3618625622 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 msgr2=0x55a34f926830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f926830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 -- 172.21.15.52:0/3618625622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 msgr2=0x55a34f91eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f91eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.709+0000 7f8656ffd640 1 -- 172.21.15.52:0/3618625622 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34f829340 con 0x55a34f91f2e0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f8656ffd640 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8648031440 tx=0x7f8648032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184936747c093fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f864d7fa640 1 -- 172.21.15.52:0/3618625622 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864803f070 con 0x55a34f91f2e0 2024-09-19T09:30:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f864d7fa640 1 -- 172.21.15.52:0/3618625622 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86480318b0 con 0x55a34f91f2e0 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f864d7fa640 1 -- 172.21.15.52:0/3618625622 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648035070 con 0x55a34f91f2e0 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f8654ff9640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 0x7f86440a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f8654ff9640 1 -- 172.21.15.52:0/1173553688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86400cf4b0 con 0x7f8658102de0 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.710+0000 7f86577fe640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 0x7f86440a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- 172.21.15.52:0/3618625622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 msgr2=0x55a34f923da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f8648031440 tx=0x7f8648032c70 comp rx=0 tx=0).stop 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- 172.21.15.52:0/3618625622 shutdown_connections 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f926830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f923da0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 --2- 172.21.15.52:0/3618625622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f91eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- 172.21.15.52:0/3618625622 >> 172.21.15.52:0/3618625622 conn(0x55a34f91a010 msgr2=0x55a34f91a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86577fe640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 0x7f86440a5830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8650005fd0 tx=0x7f8650009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- 172.21.15.52:0/3618625622 shutdown_connections 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- 172.21.15.52:0/3618625622 wait complete. 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 -- start start 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.711+0000 7f86601d8740 1 Processor -- start 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f928bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f930170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a34f9272e0 con 0x55a34f91f2e0 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a34f80b290 con 0x55a34f91e9a0 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a34f927460 con 0x55a34f924370 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86601d8740 10 client.0 _ll_register_callbacks cb 0x55a34f83c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50792/0 (socket says 172.21.15.52:50792) 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 -- 172.21.15.52:0/4277983347 learned_addr learned my addr 172.21.15.52:0/4277983347 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f86577fe640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f930170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f8656ffd640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f928bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 -- 172.21.15.52:0/4277983347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 msgr2=0x55a34f930170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f930170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 -- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 msgr2=0x55a34f928bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f928bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 -- 172.21.15.52:0/4277983347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34f595210 con 0x55a34f91f2e0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f864ffff640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f864009b750 tx=0x7f8640005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5855f26483e2dfc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f863e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.712+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640020070 con 0x55a34f91f2e0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f86400860b0 con 0x55a34f91f2e0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86480318b0 con 0x55a34f91f2e0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f864009ba50 con 0x55a34f91f2e0 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 10 client.18585 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a34f661620 con 0x55a34f91f2e0 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86480318b0 con 0x55a34f91f2e0 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f864009aea0 con 0x55a34f91f2e0 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 10 client.18585 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 10 client.18585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 20 client.18585 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f934840 0x55a34f936c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 4 client.18585 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a34f88fa20 con 0x55a34f934840 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.713+0000 7f8656ffd640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f934840 0x55a34f936c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.714+0000 7f8656ffd640 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f934840 0x55a34f936c30 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bdb60e8d0019c94 server_cookie=fc2dafa6461ace70 in_seq=0 out_seq=0 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.714+0000 7f863e7fc640 10 client.18585 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.714+0000 7f863e7fc640 1 -- 172.21.15.52:0/4277983347 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a34f88fa20 con 0x55a34f934840 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.714+0000 7f863e7fc640 10 client.18585 handle_command_reply: tid=0 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.714+0000 7f86601d8740 1 client.18585 shutdown 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 msgr2=0x55a34f929130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f864009b750 tx=0x7f8640005880 comp rx=0 tx=0).stop 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 shutdown_connections 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f934840 0x55a34f936c30 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f930170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91f2e0 0x55a34f929130 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f863e7fc640 0 client.18585 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 --2- 172.21.15.52:0/4277983347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91e9a0 0x55a34f928bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 >> 172.21.15.52:0/4277983347 conn(0x55a34f91a010 msgr2=0x55a34f91b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 shutdown_connections 2024-09-19T09:30:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 1 -- 172.21.15.52:0/4277983347 wait complete. 2024-09-19T09:30:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.715+0000 7f86601d8740 20 client.18585 trim_cache size 0 max 16384 2024-09-19T09:30:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 Processor -- start 2024-09-19T09:30:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 -- start start 2024-09-19T09:30:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f91e9a0 0x55a34f91aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f930130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86581adb00 con 0x55a34f924370 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86581ab3d0 con 0x55a34f91f2e0 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86601d8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86581a9220 con 0x55a34f91e9a0 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50808/0 (socket says 172.21.15.52:50808) 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f86577fe640 1 -- 172.21.15.52:0/2025642059 learned_addr learned my addr 172.21.15.52:0/2025642059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f864ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f930130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.730+0000 7f8656ffd640 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f91e9a0 0x55a34f91aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 -- 172.21.15.52:0/2025642059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f91e9a0 msgr2=0x55a34f91aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f91e9a0 0x55a34f91aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 -- 172.21.15.52:0/2025642059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 msgr2=0x55a34f91b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 -- 172.21.15.52:0/2025642059 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34f91aca0 con 0x55a34f91f2e0 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f86577fe640 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864ffff640 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f930130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8640009610 tx=0x7f8640099f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab746bb422c6fb17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864cff9640 1 -- 172.21.15.52:0/2025642059 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640020070 con 0x55a34f91f2e0 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864cff9640 1 -- 172.21.15.52:0/2025642059 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864009fe00 con 0x55a34f91f2e0 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.731+0000 7f864cff9640 1 -- 172.21.15.52:0/2025642059 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400cf110 con 0x55a34f91f2e0 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- 172.21.15.52:0/2025642059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 msgr2=0x55a34f930130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f930130 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8640009610 tx=0x7f8640099f60 comp rx=0 tx=0).stop 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- 172.21.15.52:0/2025642059 shutdown_connections 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f924370 0x55a34f91b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f930130 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- 172.21.15.52:0/2025642059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f91e9a0 0x55a34f91aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- 172.21.15.52:0/2025642059 >> 172.21.15.52:0/2025642059 conn(0x55a34f91a010 msgr2=0x55a34f920520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- 172.21.15.52:0/2025642059 shutdown_connections 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- 172.21.15.52:0/2025642059 wait complete. 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- start start 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 Processor -- start 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f92dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f92ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86581a9890 con 0x55a34f91e9a0 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f86581aad00 con 0x55a34f91f2e0 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.732+0000 7f86601d8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f86581a9f60 con 0x55a34f924370 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f86601d8740 10 client.0 _ll_register_callbacks cb 0x7f864000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50824/0 (socket says 172.21.15.52:50824) 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 -- 172.21.15.52:0/345801948 learned_addr learned my addr 172.21.15.52:0/345801948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f864ffff640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f92dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f86577fe640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f92ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 -- 172.21.15.52:0/345801948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 msgr2=0x55a34f92ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f92ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 -- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 msgr2=0x55a34f92dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f92dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 -- 172.21.15.52:0/345801948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34f92f330 con 0x55a34f91e9a0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f864ffff640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f92dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f8656ffd640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f8648033000 tx=0x7f864802a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c60d79c626aec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f863e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648035040 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f864009fe00 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8648004440 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.733+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f864803f040 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 10 client.18591 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a34f99f450 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f864009fe00 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f86480035f0 con 0x55a34f91e9a0 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 10 client.18591 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 10 client.18591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 20 client.18591 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f99f900 0x55a34f9a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 4 client.18591 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:30:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a34f889d70 con 0x55a34f99f900 2024-09-19T09:30:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.734+0000 7f864ffff640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f99f900 0x55a34f9a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.735+0000 7f863e7fc640 10 client.18591 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.735+0000 7f864ffff640 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f99f900 0x55a34f9a1d20 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d02447b5bb3200f4 server_cookie=8e0d61ae68dce532 in_seq=0 out_seq=0 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.746+0000 7f863e7fc640 1 -- 172.21.15.52:0/345801948 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a34f889d70 con 0x55a34f99f900 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.746+0000 7f863e7fc640 10 client.18591 handle_command_reply: tid=0 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.746+0000 7f86601d8740 1 client.18591 shutdown 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.746+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 msgr2=0x55a34f92d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f8648033000 tx=0x7f864802a9b0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 shutdown_connections 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a34f99f900 0x55a34f9a1d20 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a34f924370 0x55a34f92ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.749 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a34f91f2e0 0x55a34f92dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 --2- 172.21.15.52:0/345801948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a34f91e9a0 0x55a34f92d820 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f863e7fc640 0 client.18591 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 >> 172.21.15.52:0/345801948 conn(0x55a34f91a010 msgr2=0x55a34f9189a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 shutdown_connections 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 1 -- 172.21.15.52:0/345801948 wait complete. 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f86601d8740 20 client.18591 trim_cache size 0 max 16384 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:30:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:30:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:30:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 msgr2=0x7f86440a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 0x7f86440a5830 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8650005fd0 tx=0x7f8650009500 comp rx=0 tx=0).stop 2024-09-19T09:30:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 msgr2=0x7f8658100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f864000d950 tx=0x7f864000de10 comp rx=0 tx=0).stop 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 shutdown_connections 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86581037a0 0x7f86581012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8658102de0 0x7f8658100d90 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f86440a3370 0x7f86440a5830 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 --2- 172.21.15.52:0/1173553688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f86580ffe10 0x7f8658102750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.747+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 >> 172.21.15.52:0/1173553688 conn(0x7f86580fb970 msgr2=0x7f8658106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.748+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 shutdown_connections 2024-09-19T09:30:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:32.748+0000 7f865d43c640 1 -- 172.21.15.52:0/1173553688 wait complete. 2024-09-19T09:30:32.757 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:32 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:33 smithi052 ceph-mon[30947]: pgmap v611: 97 pgs: 97 active+clean; 4.7 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:30:33.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:33 smithi169 ceph-mon[35454]: pgmap v611: 97 pgs: 97 active+clean; 4.7 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:33.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:33.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:33.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:30:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:33 smithi086 ceph-mon[34813]: pgmap v611: 97 pgs: 97 active+clean; 4.7 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:30:35.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:35 smithi052 ceph-mon[30947]: pgmap v612: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:35.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:35 smithi169 ceph-mon[35454]: pgmap v612: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:35.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:35 smithi086 ceph-mon[34813]: pgmap v612: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:37.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:37 smithi052 ceph-mon[30947]: pgmap v613: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:30:37.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:37 smithi169 ceph-mon[35454]: pgmap v613: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:30:37.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:37 smithi086 ceph-mon[34813]: pgmap v613: 97 pgs: 97 active+clean; 669 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:30:39.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:39 smithi052 ceph-mon[30947]: pgmap v614: 97 pgs: 97 active+clean; 740 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:39 smithi169 ceph-mon[35454]: pgmap v614: 97 pgs: 97 active+clean; 740 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:39.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:39 smithi086 ceph-mon[34813]: pgmap v614: 97 pgs: 97 active+clean; 740 KiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-09-19T09:30:41.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:41 smithi052 ceph-mon[30947]: pgmap v615: 97 pgs: 97 active+clean; 740 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:41.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:41 smithi169 ceph-mon[35454]: pgmap v615: 97 pgs: 97 active+clean; 740 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:41.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:41 smithi086 ceph-mon[34813]: pgmap v615: 97 pgs: 97 active+clean; 740 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:43.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:43 smithi052 ceph-mon[30947]: pgmap v616: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:43.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:43 smithi169 ceph-mon[35454]: pgmap v616: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:43 smithi086 ceph-mon[34813]: pgmap v616: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:30:43.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:30:44.070 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 -- 172.21.15.52:0/4098325134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7620103660 msgr2=0x7f762010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 --2- 172.21.15.52:0/4098325134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7620103660 0x7f762010bb50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f7610009900 tx=0x7f761002a480 comp rx=0 tx=0).stop 2024-09-19T09:30:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 -- 172.21.15.52:0/4098325134 shutdown_connections 2024-09-19T09:30:44.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 --2- 172.21.15.52:0/4098325134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f762010c170 0x7f762010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 --2- 172.21.15.52:0/4098325134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7620103660 0x7f762010bb50 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 --2- 172.21.15.52:0/4098325134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 0x7f7620103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 -- 172.21.15.52:0/4098325134 >> 172.21.15.52:0/4098325134 conn(0x7f76200fc7a0 msgr2=0x7f76200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 -- 172.21.15.52:0/4098325134 shutdown_connections 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 -- 172.21.15.52:0/4098325134 wait complete. 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.621+0000 7f7627f76640 1 Processor -- start 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 -- start start 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 0x7f7620198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 0x7f76201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7620111f70 con 0x7f762010c170 2024-09-19T09:30:44.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7620111df0 con 0x7f7620103660 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7627f76640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76201120f0 con 0x7f7620102d40 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33540/0 (socket says 172.21.15.52:33540) 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 -- 172.21.15.52:0/2676596931 learned_addr learned my addr 172.21.15.52:0/2676596931 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7625d12640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 0x7f7620198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7625511640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 0x7f76201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 -- 172.21.15.52:0/2676596931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 msgr2=0x7f7620198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 0x7f7620198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 -- 172.21.15.52:0/2676596931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 msgr2=0x7f76201989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 0x7f76201989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7626513640 1 -- 172.21.15.52:0/2676596931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762019d440 con 0x7f762010c170 2024-09-19T09:30:44.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.622+0000 7f7625511640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 0x7f76201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7626513640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f761800cad0 tx=0x7f761800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7616ffd640 1 -- 172.21.15.52:0/2676596931 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761800ae20 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762019d730 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7616ffd640 1 -- 172.21.15.52:0/2676596931 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7618005020 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7616ffd640 1 -- 172.21.15.52:0/2676596931 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761800f6f0 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.623+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76201a5010 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.625+0000 7f7616ffd640 1 -- 172.21.15.52:0/2676596931 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f76180051d0 con 0x7f762010c170 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.625+0000 7f762a34f740 1 Processor -- start 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 -- start start 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757bb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7616ffd640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 0x7f760c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a757212e0 con 0x564a757bbdc0 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564a756c8ce0 con 0x564a757bb4a0 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f762a34f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564a7571d2a0 con 0x564a757c6680 2024-09-19T09:30:44.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7625511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7625511640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33554/0 (socket says 172.21.15.52:33554) 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7625511640 1 -- 172.21.15.52:0/1658728539 learned_addr learned my addr 172.21.15.52:0/1658728539 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7616ffd640 1 -- 172.21.15.52:0/2676596931 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f76180cfad0 con 0x7f762010c170 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7625d12640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 0x7f760c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7626513640 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.626+0000 7f7625511640 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757bb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 -- 172.21.15.52:0/1658728539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 msgr2=0x564a757c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 -- 172.21.15.52:0/1658728539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 msgr2=0x564a757bb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757bb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 -- 172.21.15.52:0/1658728539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a756ad440 con 0x564a757bbdc0 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625d12640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 0x7f760c0a5700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f7625511640 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7610009900 tx=0x7f76100056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8911c4a3b6f699c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f760bfff640 1 -- 172.21.15.52:0/1658728539 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610035040 con 0x564a757bbdc0 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f760bfff640 1 -- 172.21.15.52:0/1658728539 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76100035f0 con 0x564a757bbdc0 2024-09-19T09:30:44.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.627+0000 7f760bfff640 1 -- 172.21.15.52:0/1658728539 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761003d6c0 con 0x564a757bbdc0 2024-09-19T09:30:44.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- 172.21.15.52:0/1658728539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 msgr2=0x564a757c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7610009900 tx=0x7f76100056d0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- 172.21.15.52:0/1658728539 shutdown_connections 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bbdc0 0x564a757c6140 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 --2- 172.21.15.52:0/1658728539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757bb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- 172.21.15.52:0/1658728539 >> 172.21.15.52:0/1658728539 conn(0x564a757b7a30 msgr2=0x564a757b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- 172.21.15.52:0/1658728539 shutdown_connections 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- 172.21.15.52:0/1658728539 wait complete. 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 -- start start 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.628+0000 7f762a34f740 1 Processor -- start 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757bbdc0 0x564a757c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564a757c9250 con 0x564a757c6680 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564a756dc050 con 0x564a757bb4a0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564a757c93d0 con 0x564a757bbdc0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f762a34f740 10 client.0 _ll_register_callbacks cb 0x564a7571c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33560/0 (socket says 172.21.15.52:33560) 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 -- 172.21.15.52:0/3412648990 learned_addr learned my addr 172.21.15.52:0/3412648990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7625d12640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7625511640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757bbdc0 0x564a757c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 -- 172.21.15.52:0/3412648990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757bbdc0 msgr2=0x564a757c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757bbdc0 0x564a757c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 -- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 msgr2=0x564a757c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.629+0000 7f7626513640 1 -- 172.21.15.52:0/3412648990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a754923c0 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f7626513640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f76180989e0 tx=0x7f761809c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d791a29dd6edaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761801d070 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f76180cd600 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76100035f0 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7618005560 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 10 client.18603 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a757d4bd0 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76100035f0 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7618096b80 con 0x564a757c6680 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 10 client.18603 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:44.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 10 client.18603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 20 client.18603 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a757d5fe0 0x564a757d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 4 client.18603 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.630+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a7572e850 con 0x564a757d5fe0 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.631+0000 7f7625d12640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a757d5fe0 0x564a757d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.631+0000 7f76097fa640 10 client.18603 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.631+0000 7f7625d12640 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a757d5fe0 0x564a757d8410 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e3393511f654f9 server_cookie=a88f48178b519762 in_seq=0 out_seq=0 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f76097fa640 1 -- 172.21.15.52:0/3412648990 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a7572e850 con 0x564a757d5fe0 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f76097fa640 10 client.18603 handle_command_reply: tid=0 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 client.18603 shutdown 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 msgr2=0x564a757c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f76180989e0 tx=0x7f761809c850 comp rx=0 tx=0).stop 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 shutdown_connections 2024-09-19T09:30:44.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a757d5fe0 0x564a757d8410 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757c6680 0x564a757c3790 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f76097fa640 0 client.18603 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757bbdc0 0x564a757c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 --2- 172.21.15.52:0/3412648990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bb4a0 0x564a757c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 >> 172.21.15.52:0/3412648990 conn(0x564a757b7a30 msgr2=0x564a757bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 shutdown_connections 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 1 -- 172.21.15.52:0/3412648990 wait complete. 2024-09-19T09:30:44.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.632+0000 7f762a34f740 20 client.18603 trim_cache size 0 max 16384 2024-09-19T09:30:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.649+0000 7f762a34f740 1 Processor -- start 2024-09-19T09:30:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.649+0000 7f762a34f740 1 -- start start 2024-09-19T09:30:44.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757de270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76201b0110 con 0x564a757bb4a0 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76201ad9e0 con 0x564a757bbdc0 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f762a34f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76201ab830 con 0x564a757c6680 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33576/0 (socket says 172.21.15.52:33576) 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 -- 172.21.15.52:0/105291591 learned_addr learned my addr 172.21.15.52:0/105291591 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625511640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757ddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 -- 172.21.15.52:0/105291591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 msgr2=0x564a757de270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7626513640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757de270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757de270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 -- 172.21.15.52:0/105291591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 msgr2=0x564a757ddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757ddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 -- 172.21.15.52:0/105291591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a757c17a0 con 0x564a757bb4a0 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625511640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f7625d12640 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f761c00bfd0 tx=0x7f761c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728f0b27d0106f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f760b7fe640 1 -- 172.21.15.52:0/105291591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c020e60 con 0x564a757bb4a0 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f760b7fe640 1 -- 172.21.15.52:0/105291591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f761c02e070 con 0x564a757bb4a0 2024-09-19T09:30:44.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.650+0000 7f760b7fe640 1 -- 172.21.15.52:0/105291591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c011a70 con 0x564a757bb4a0 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- 172.21.15.52:0/105291591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 msgr2=0x564a757c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f761c00bfd0 tx=0x7f761c015000 comp rx=0 tx=0).stop 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- 172.21.15.52:0/105291591 shutdown_connections 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757de270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 --2- 172.21.15.52:0/105291591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757c51c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- 172.21.15.52:0/105291591 >> 172.21.15.52:0/105291591 conn(0x564a757b7a30 msgr2=0x564a757c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- 172.21.15.52:0/105291591 shutdown_connections 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- 172.21.15.52:0/105291591 wait complete. 2024-09-19T09:30:44.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.651+0000 7f762a34f740 1 -- start start 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 Processor -- start 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76201abea0 con 0x564a757bb4a0 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f76201ad310 con 0x564a757bbdc0 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f76201ac570 con 0x564a757c6680 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f762a34f740 10 client.0 _ll_register_callbacks cb 0x7f761809bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33582/0 (socket says 172.21.15.52:33582) 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 -- 172.21.15.52:0/17933058 learned_addr learned my addr 172.21.15.52:0/17933058 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625511640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7626513640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 -- 172.21.15.52:0/17933058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 msgr2=0x564a757cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 -- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 msgr2=0x564a757cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625d12640 1 -- 172.21.15.52:0/17933058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a757ccee0 con 0x564a757bb4a0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.652+0000 7f7625511640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f7625d12640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f761c011650 tx=0x7f761c0053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5157572634d8fd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c038020 con 0x564a757bb4a0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f761c011bc0 con 0x564a757bb4a0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f761c02e070 con 0x564a757bb4a0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f761c043050 con 0x564a757bb4a0 2024-09-19T09:30:44.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 10 client.18609 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a758451c0 con 0x564a757bb4a0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f761c02e070 con 0x564a757bb4a0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f761c028550 con 0x564a757bb4a0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 10 client.18609 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 10 client.18609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 20 client.18609 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a758458d0 0x564a75847cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 4 client.18609 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.653+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a757c3b20 con 0x564a758458d0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f7625511640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a758458d0 0x564a75847cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f76097fa640 10 client.18609 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f7625511640 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a758458d0 0x564a75847cf0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd3ddf7fdd44f0e6 server_cookie=ba5f5d422c4cc916 in_seq=0 out_seq=0 2024-09-19T09:30:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f76097fa640 1 -- 172.21.15.52:0/17933058 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564a757c3b20 con 0x564a758458d0 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f76097fa640 10 client.18609 handle_command_reply: tid=0 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f762a34f740 1 client.18609 shutdown 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 msgr2=0x564a757cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.654+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f761c011650 tx=0x7f761c0053b0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 shutdown_connections 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564a758458d0 0x564a75847cf0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564a757c6680 0x564a757cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564a757bbdc0 0x564a757cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f76097fa640 0 client.18609 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 --2- 172.21.15.52:0/17933058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564a757bb4a0 0x564a757cee00 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 >> 172.21.15.52:0/17933058 conn(0x564a757b7a30 msgr2=0x564a757c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 shutdown_connections 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 1 -- 172.21.15.52:0/17933058 wait complete. 2024-09-19T09:30:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f762a34f740 20 client.18609 trim_cache size 0 max 16384 2024-09-19T09:30:44.663 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:44.663 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:30:44.663 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:30:44.663 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 msgr2=0x7f760c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 0x7f760c0a5700 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c005850 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 msgr2=0x7f762019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f761800cad0 tx=0x7f761800cf90 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 shutdown_connections 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f762010c170 0x7f762019cd60 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7620103660 0x7f76201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f760c0a3240 0x7f760c0a5700 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.655+0000 7f7627f76640 1 --2- 172.21.15.52:0/2676596931 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7620102d40 0x7f7620198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.656+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 >> 172.21.15.52:0/2676596931 conn(0x7f76200fc7a0 msgr2=0x7f76200fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.656+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 shutdown_connections 2024-09-19T09:30:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:44.656+0000 7f7627f76640 1 -- 172.21.15.52:0/2676596931 wait complete. 2024-09-19T09:30:45.493 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:45 smithi052 ceph-mon[30947]: pgmap v617: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:45.495 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:30:45.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:30:45.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:45 smithi169 ceph-mon[35454]: pgmap v617: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:45 smithi086 ceph-mon[34813]: pgmap v617: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:30:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 -- 172.21.15.52:0/1693295648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 msgr2=0x7f54041020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 --2- 172.21.15.52:0/1693295648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041020d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f53f8009900 tx=0x7f53f802a410 comp rx=0 tx=0).stop 2024-09-19T09:30:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 -- 172.21.15.52:0/1693295648 shutdown_connections 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 --2- 172.21.15.52:0/1693295648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404102610 0x7f5404108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 --2- 172.21.15.52:0/1693295648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041020d0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 --2- 172.21.15.52:0/1693295648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404100a60 0x7f5404100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 -- 172.21.15.52:0/1693295648 >> 172.21.15.52:0/1693295648 conn(0x7f54040fc1e0 msgr2=0x7f54040fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 -- 172.21.15.52:0/1693295648 shutdown_connections 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.841+0000 7f540889b640 1 -- 172.21.15.52:0/1693295648 wait complete. 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 Processor -- start 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 -- start start 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404100a60 0x7f540410b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404102610 0x7f5404109de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f540410d870 con 0x7f5404101c50 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f540410d6f0 con 0x7f5404102610 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540889b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f540410d9f0 con 0x7f5404100a60 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33590/0 (socket says 172.21.15.52:33590) 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f5401d9b640 1 -- 172.21.15.52:0/2983392349 learned_addr learned my addr 172.21.15.52:0/2983392349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f540259c640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404100a60 0x7f540410b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.842+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404102610 0x7f5404109de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 -- 172.21.15.52:0/2983392349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404100a60 msgr2=0x7f540410b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404100a60 0x7f540410b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 -- 172.21.15.52:0/2983392349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404102610 msgr2=0x7f5404109de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404102610 0x7f5404109de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 -- 172.21.15.52:0/2983392349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f540410a670 con 0x7f5404101c50 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f53f802aa00 tx=0x7f53f8032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f53f37fe640 1 -- 172.21.15.52:0/2983392349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f803f030 con 0x7f5404101c50 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f53f37fe640 1 -- 172.21.15.52:0/2983392349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f8003ce0 con 0x7f5404101c50 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54041a1e20 con 0x7f5404101c50 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f53f37fe640 1 -- 172.21.15.52:0/2983392349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8035070 con 0x7f5404101c50 2024-09-19T09:30:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.843+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54041a2290 con 0x7f5404101c50 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.845+0000 7f53f37fe640 1 -- 172.21.15.52:0/2983392349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f53f8042030 con 0x7f5404101c50 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.845+0000 7f540b635740 1 Processor -- start 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 -- start start 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cda0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cda8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56497cd042f0 con 0x56497cda12e0 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56497ccac270 con 0x56497cda09a0 2024-09-19T09:30:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540b635740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56497cd002b0 con 0x56497cda6370 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33592/0 (socket says 172.21.15.52:33592) 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cda0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540259c640 1 -- 172.21.15.52:0/2806371841 learned_addr learned my addr 172.21.15.52:0/2806371841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cda8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 -- 172.21.15.52:0/2806371841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 msgr2=0x56497cda8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cda8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f53f37fe640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 0x7f53ec0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 -- 172.21.15.52:0/2806371841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 msgr2=0x56497cda5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5402d9d640 1 -- 172.21.15.52:0/2806371841 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497ccab340 con 0x56497cda09a0 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cda8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.846+0000 7f540259c640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f53f37fe640 1 -- 172.21.15.52:0/2983392349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f53f80efd10 con 0x7f5404101c50 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cda0da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f53fc008d00 tx=0x7f53fc00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf4ea04be8fb5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 0x7f53ec0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f53f0ff9640 1 -- 172.21.15.52:0/2806371841 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc014070 con 0x56497cda09a0 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f53f0ff9640 1 -- 172.21.15.52:0/2806371841 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53fc010430 con 0x56497cda09a0 2024-09-19T09:30:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f53f0ff9640 1 -- 172.21.15.52:0/2806371841 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0186e0 con 0x56497cda09a0 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f540b635740 1 -- 172.21.15.52:0/2806371841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 msgr2=0x56497cda0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 0x7f53ec0a5830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00f010 tx=0x7f53fc019f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.847+0000 7f540b635740 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cda0da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f53fc008d00 tx=0x7f53fc00e720 comp rx=0 tx=0).stop 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- 172.21.15.52:0/2806371841 shutdown_connections 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cda8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cda5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- 172.21.15.52:0/2806371841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cda0da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- 172.21.15.52:0/2806371841 >> 172.21.15.52:0/2806371841 conn(0x56497cd9c010 msgr2=0x56497cd9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- 172.21.15.52:0/2806371841 shutdown_connections 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- 172.21.15.52:0/2806371841 wait complete. 2024-09-19T09:30:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- start start 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 Processor -- start 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56497cda9340 con 0x56497cda12e0 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56497cc8d290 con 0x56497cda09a0 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56497cda94c0 con 0x56497cda6370 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f540b635740 10 client.0 _ll_register_callbacks cb 0x56497ccbe140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33602/0 (socket says 172.21.15.52:33602) 2024-09-19T09:30:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.848+0000 7f5401d9b640 1 -- 172.21.15.52:0/1909896474 learned_addr learned my addr 172.21.15.52:0/1909896474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f540259c640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5402d9d640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 -- 172.21.15.52:0/1909896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 msgr2=0x56497cdb2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 -- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 msgr2=0x56497cdaac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 -- 172.21.15.52:0/1909896474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497ca17210 con 0x56497cda12e0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f53f80bc240 tx=0x7f53f802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8135285c8d075051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f53e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8049050 con 0x56497cda12e0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f53f803b5f0 con 0x56497cda12e0 2024-09-19T09:30:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53fc010430 con 0x56497cda12e0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f53f80d5050 con 0x56497cda12e0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f540b635740 10 client.18621 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56497cae3620 con 0x56497cda12e0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.849+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53fc010430 con 0x56497cda12e0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f53f80bc510 con 0x56497cda12e0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 10 client.18621 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 10 client.18621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 20 client.18621 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497cdb6800 0x56497cdb8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 4 client.18621 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56497cd11a20 con 0x56497cdb6800 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540259c640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497cdb6800 0x56497cdb8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f53e9ffb640 10 client.18621 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.850+0000 7f540259c640 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497cdb6800 0x56497cdb8c30 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e70cb5684df4c3 server_cookie=37b9e4ba3bc849df in_seq=0 out_seq=0 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1909896474 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56497cd11a20 con 0x56497cdb6800 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f53e9ffb640 10 client.18621 handle_command_reply: tid=0 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 client.18621 shutdown 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 msgr2=0x56497cdab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f53f80bc240 tx=0x7f53f802a410 comp rx=0 tx=0).stop 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 shutdown_connections 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497cdb6800 0x56497cdb8c30 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdab1c0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f53e9ffb640 0 client.18621 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 --2- 172.21.15.52:0/1909896474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 >> 172.21.15.52:0/1909896474 conn(0x56497cd9c010 msgr2=0x56497cd9d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 shutdown_connections 2024-09-19T09:30:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 1 -- 172.21.15.52:0/1909896474 wait complete. 2024-09-19T09:30:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.851+0000 7f540b635740 20 client.18621 trim_cache size 0 max 16384 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 Processor -- start 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 -- start start 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda09a0 0x56497cd9cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 0x56497cdb2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54041adb50 con 0x56497cda6370 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54041ab420 con 0x56497cda12e0 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f540b635740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54041a9270 con 0x56497cda09a0 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33606/0 (socket says 172.21.15.52:33606) 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 -- 172.21.15.52:0/2329412576 learned_addr learned my addr 172.21.15.52:0/2329412576 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 0x56497cdb2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 -- 172.21.15.52:0/2329412576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda09a0 msgr2=0x56497cd9cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda09a0 0x56497cd9cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 -- 172.21.15.52:0/2329412576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 msgr2=0x56497cdb2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 0x56497cdb2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 -- 172.21.15.52:0/2329412576 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497cdb9280 con 0x56497cda6370 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5401d9b640 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 0x56497cdb2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f5402d9d640 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00ec20 tx=0x7f53fc025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582a07907e06824d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.866+0000 7f53ebfff640 1 -- 172.21.15.52:0/2329412576 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc014040 con 0x56497cda6370 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f53ebfff640 1 -- 172.21.15.52:0/2329412576 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53fc003e50 con 0x56497cda6370 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f53ebfff640 1 -- 172.21.15.52:0/2329412576 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00fb70 con 0x56497cda6370 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- 172.21.15.52:0/2329412576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 msgr2=0x56497cd9d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00ec20 tx=0x7f53fc025000 comp rx=0 tx=0).stop 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- 172.21.15.52:0/2329412576 shutdown_connections 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda6370 0x56497cd9d400 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda12e0 0x56497cdb2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 --2- 172.21.15.52:0/2329412576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda09a0 0x56497cd9cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- 172.21.15.52:0/2329412576 >> 172.21.15.52:0/2329412576 conn(0x56497cd9c010 msgr2=0x56497cda2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- 172.21.15.52:0/2329412576 shutdown_connections 2024-09-19T09:30:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- 172.21.15.52:0/2329412576 wait complete. 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 -- start start 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.867+0000 7f540b635740 1 Processor -- start 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54041a98e0 con 0x56497cda12e0 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54041aad50 con 0x56497cda09a0 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54041a9fb0 con 0x56497cda6370 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 10 client.0 _ll_register_callbacks cb 0x7f53f803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33622/0 (socket says 172.21.15.52:33622) 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 -- 172.21.15.52:0/1030814475 learned_addr learned my addr 172.21.15.52:0/1030814475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540259c640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5402d9d640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 -- 172.21.15.52:0/1030814475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 msgr2=0x56497cdb0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 -- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 msgr2=0x56497cdaf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 -- 172.21.15.52:0/1030814475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497cda9580 con 0x56497cda12e0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f5401d9b640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f53f80c0660 tx=0x7f53f80c5010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db9b914c166b638 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f53e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f80d9020 con 0x56497cda12e0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53fc003e50 con 0x56497cda12e0 2024-09-19T09:30:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.868+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f53f80c4c90 con 0x56497cda12e0 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f53f8049070 con 0x56497cda12e0 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 10 client.18627 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56497cdb23e0 con 0x56497cda12e0 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53fc003e50 con 0x56497cda12e0 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f53f80dc0b0 con 0x56497cda12e0 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 10 client.18627 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 10 client.18627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 20 client.18627 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497ce21940 0x56497ce23d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 4 client.18627 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:30:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56497cd0bd70 con 0x56497ce21940 2024-09-19T09:30:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.869+0000 7f540259c640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497ce21940 0x56497ce23d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.870+0000 7f540259c640 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497ce21940 0x56497ce23d60 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddad8b1062571825 server_cookie=1e64bf80d71ebf1e in_seq=0 out_seq=0 2024-09-19T09:30:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.870+0000 7f53e9ffb640 10 client.18627 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:45.884 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f53e9ffb640 1 -- 172.21.15.52:0/1030814475 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56497cd0bd70 con 0x56497ce21940 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f53e9ffb640 10 client.18627 handle_command_reply: tid=0 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 client.18627 shutdown 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 msgr2=0x56497cdafd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f53f80c0660 tx=0x7f53f80c5010 comp rx=0 tx=0).stop 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 shutdown_connections 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56497ce21940 0x56497ce23d60 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56497cda6370 0x56497cdb0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56497cda12e0 0x56497cdafd80 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f53e9ffb640 0 client.18627 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 --2- 172.21.15.52:0/1030814475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56497cda09a0 0x56497cdaf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 >> 172.21.15.52:0/1030814475 conn(0x56497cd9c010 msgr2=0x56497cdaac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.885 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 shutdown_connections 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.882+0000 7f540b635740 1 -- 172.21.15.52:0/1030814475 wait complete. 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540b635740 20 client.18627 trim_cache size 0 max 16384 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:30:45.886 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 msgr2=0x7f53ec0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 0x7f53ec0a5830 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00f010 tx=0x7f53fc019f90 comp rx=0 tx=0).stop 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 msgr2=0x7f54041098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f53f802aa00 tx=0x7f53f8032da0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 shutdown_connections 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5404102610 0x7f5404109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.887 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5404101c50 0x7f54041098a0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53ec0a3370 0x7f53ec0a5830 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 --2- 172.21.15.52:0/2983392349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5404100a60 0x7f540410b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 >> 172.21.15.52:0/2983392349 conn(0x7f54040fc1e0 msgr2=0x7f5404104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 shutdown_connections 2024-09-19T09:30:45.888 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:45.883+0000 7f540889b640 1 -- 172.21.15.52:0/2983392349 wait complete. 2024-09-19T09:30:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 -- 172.21.15.52:0/2790601223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218101420 msgr2=0x7fc21810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 --2- 172.21.15.52:0/2790601223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218101420 0x7fc21810d950 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc210009cd0 tx=0x7fc21002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 -- 172.21.15.52:0/2790601223 shutdown_connections 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 --2- 172.21.15.52:0/2790601223 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218101420 0x7fc21810d950 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 --2- 172.21.15.52:0/2790601223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218100a80 0x7fc218100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 --2- 172.21.15.52:0/2790601223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218106a80 0x7fc218106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 -- 172.21.15.52:0/2790601223 >> 172.21.15.52:0/2790601223 conn(0x7fc2180fc7a0 msgr2=0x7fc2180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 -- 172.21.15.52:0/2790601223 shutdown_connections 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.250+0000 7fc21c893640 1 -- 172.21.15.52:0/2790601223 wait complete. 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 Processor -- start 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 -- start start 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218100a80 0x7fc21810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218101420 0x7fc21810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc218111fa0 con 0x7fc218106a80 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc218111e20 con 0x7fc218100a80 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.251+0000 7fc21c893640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc218112120 con 0x7fc218101420 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33640/0 (socket says 172.21.15.52:33640) 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 -- 172.21.15.52:0/965554565 learned_addr learned my addr 172.21.15.52:0/965554565 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc215d9b640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218101420 0x7fc21810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc21659c640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218100a80 0x7fc21810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 -- 172.21.15.52:0/965554565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218101420 msgr2=0x7fc21810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218101420 0x7fc21810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 -- 172.21.15.52:0/965554565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218100a80 msgr2=0x7fc21810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218100a80 0x7fc21810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 -- 172.21.15.52:0/965554565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2181a68c0 con 0x7fc218106a80 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc216d9d640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc210006010 tx=0x7fc210003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210004450 con 0x7fc218106a80 2024-09-19T09:30:46.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2181a6b50 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc210003e10 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.252+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210046480 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.253+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181a70e0 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.253+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218100ee0 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.255+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc2100045f0 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.255+0000 7fc2077fe640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 0x7fc2000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.256+0000 7fc21659c640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 0x7fc2000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.256+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc21002e030 con 0x7fc218106a80 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.256+0000 7fc21659c640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 0x7fc2000a5700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc208005e10 tx=0x7fc208005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:46.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.259+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc21004b060 con 0x7fc218106a80 2024-09-19T09:30:46.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.473+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21810f910 con 0x7fc218106a80 2024-09-19T09:30:46.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.474+0000 7fc2077fe640 1 -- 172.21.15.52:0/965554565 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fc2100be130 con 0x7fc218106a80 2024-09-19T09:30:46.476 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:30:46.476 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:30:46.476 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 msgr2=0x7fc2000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 0x7fc2000a5700 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc208005e10 tx=0x7fc208005da0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 msgr2=0x7fc21810ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc210006010 tx=0x7fc210003c20 comp rx=0 tx=0).stop 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 shutdown_connections 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc218106a80 0x7fc21810ee60 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc2000a3240 0x7fc2000a5700 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc218101420 0x7fc21810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 --2- 172.21.15.52:0/965554565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc218100a80 0x7fc21810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:46.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 >> 172.21.15.52:0/965554565 conn(0x7fc2180fc7a0 msgr2=0x7fc2180fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:46.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 shutdown_connections 2024-09-19T09:30:46.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:46.476+0000 7fc21c893640 1 -- 172.21.15.52:0/965554565 wait complete. 2024-09-19T09:30:47.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:30:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:47 smithi052 ceph-mon[30947]: pgmap v618: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:30:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:47 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/965554565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:47.480 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:47.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:47 smithi169 ceph-mon[35454]: pgmap v618: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:30:47.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:47 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/965554565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:47 smithi086 ceph-mon[34813]: pgmap v618: 97 pgs: 97 active+clean; 801 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:30:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:47 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/965554565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:47.782 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:30:47.783 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:30:47.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:30:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 -- 172.21.15.52:0/429658813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a401082a0 msgr2=0x7f9a4010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 --2- 172.21.15.52:0/429658813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a401082a0 0x7f9a4010ec40 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009cd0 tx=0x7f9a3802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 -- 172.21.15.52:0/429658813 shutdown_connections 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 --2- 172.21.15.52:0/429658813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a401082a0 0x7f9a4010ec40 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 --2- 172.21.15.52:0/429658813 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401036e0 0x7f9a40107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 --2- 172.21.15.52:0/429658813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40102d30 0x7f9a40103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 -- 172.21.15.52:0/429658813 >> 172.21.15.52:0/429658813 conn(0x7f9a400fc7d0 msgr2=0x7f9a400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 -- 172.21.15.52:0/429658813 shutdown_connections 2024-09-19T09:30:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.963+0000 7f9a460cc640 1 -- 172.21.15.52:0/429658813 wait complete. 2024-09-19T09:30:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.964+0000 7f9a460cc640 1 Processor -- start 2024-09-19T09:30:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.964+0000 7f9a460cc640 1 -- start start 2024-09-19T09:30:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a401036e0 0x7f9a40198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401082a0 0x7f9a4019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401120d0 con 0x7f9a40102d30 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40111f50 con 0x7f9a401036e0 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a460cc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40112250 con 0x7f9a401082a0 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33648/0 (socket says 172.21.15.52:33648) 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2308964134 learned_addr learned my addr 172.21.15.52:0/2308964134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a401036e0 0x7f9a40198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401082a0 0x7f9a4019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2308964134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401082a0 msgr2=0x7f9a4019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401082a0 0x7f9a4019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2308964134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a401036e0 msgr2=0x7f9a40198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a401036e0 0x7f9a40198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2308964134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4019d5c0 con 0x7f9a40102d30 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.965+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009f50 tx=0x7f9a3000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.966+0000 7f9a3cff9640 1 -- 172.21.15.52:0/2308964134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30024070 con 0x7f9a40102d30 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.966+0000 7f9a3cff9640 1 -- 172.21.15.52:0/2308964134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a3001f440 con 0x7f9a40102d30 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.966+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4019d8b0 con 0x7f9a40102d30 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.966+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401008c0 con 0x7f9a40102d30 2024-09-19T09:30:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.966+0000 7f9a3cff9640 1 -- 172.21.15.52:0/2308964134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3001d5a0 con 0x7f9a40102d30 2024-09-19T09:30:47.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.968+0000 7f9a3cff9640 1 -- 172.21.15.52:0/2308964134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9a30027070 con 0x7f9a40102d30 2024-09-19T09:30:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.969+0000 7f9a3cff9640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 0x7f9a280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 Processor -- start 2024-09-19T09:30:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 0x7f9a280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a3cff9640 1 -- 172.21.15.52:0/2308964134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9a300d7e50 con 0x7f9a40102d30 2024-09-19T09:30:47.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 -- start start 2024-09-19T09:30:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 0x7f9a280a5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9a40107440 tx=0x7f9a3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b711090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b71e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556d7b6772f0 con 0x556d7b7115d0 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556d7b61ecf0 con 0x556d7b712b40 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a484a5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d7b6732b0 con 0x556d7b71c370 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.970+0000 7f9a3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33652/0 (socket says 172.21.15.52:33652) 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b711090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3effd640 1 -- 172.21.15.52:0/1101181678 learned_addr learned my addr 172.21.15.52:0/1101181678 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b71e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/1101181678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 msgr2=0x556d7b71e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b71e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/1101181678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 msgr2=0x556d7b711a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/1101181678 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7b6033a0 con 0x556d7b712b40 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3effd640 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b711090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a300d5920 tx=0x7f9a300a3e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8f0c9be8cda8da4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a25ffb640 1 -- 172.21.15.52:0/1101181678 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300ad060 con 0x556d7b712b40 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a25ffb640 1 -- 172.21.15.52:0/1101181678 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a300a27a0 con 0x556d7b712b40 2024-09-19T09:30:47.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.971+0000 7f9a25ffb640 1 -- 172.21.15.52:0/1101181678 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300acbd0 con 0x556d7b712b40 2024-09-19T09:30:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 -- 172.21.15.52:0/1101181678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 msgr2=0x556d7b711090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b711090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a300d5920 tx=0x7f9a300a3e00 comp rx=0 tx=0).stop 2024-09-19T09:30:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 -- 172.21.15.52:0/1101181678 shutdown_connections 2024-09-19T09:30:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b71e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b711a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 --2- 172.21.15.52:0/1101181678 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b711090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.972+0000 7f9a484a5740 1 -- 172.21.15.52:0/1101181678 >> 172.21.15.52:0/1101181678 conn(0x556d7b6da310 msgr2=0x556d7b70dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.973+0000 7f9a484a5740 1 -- 172.21.15.52:0/1101181678 shutdown_connections 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.973+0000 7f9a484a5740 1 -- 172.21.15.52:0/1101181678 wait complete. 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.973+0000 7f9a484a5740 1 -- start start 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.973+0000 7f9a484a5740 1 Processor -- start 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b712b40 0x556d7b719040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b719650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556d7b71f010 con 0x556d7b7115d0 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556d7b632060 con 0x556d7b71c370 2024-09-19T09:30:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556d7b71f190 con 0x556d7b712b40 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33654/0 (socket says 172.21.15.52:33654) 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2863973034 learned_addr learned my addr 172.21.15.52:0/2863973034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b719650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a484a5740 10 client.0 _ll_register_callbacks cb 0x556d7b3858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b712b40 0x556d7b719040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b712b40 msgr2=0x556d7b719040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b712b40 0x556d7b719040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2863973034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 msgr2=0x556d7b719650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b719650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/2863973034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7b3e83c0 con 0x556d7b7115d0 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.974+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b719650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9a300d5c40 tx=0x7f9a300a8920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6587aeafc79dfd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300bc070 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9a300bd260 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a300a27a0 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9a300acbd0 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a484a5740 10 client.18645 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.975+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d7b72aaa0 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a300a27a0 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9a300a3360 con 0x556d7b7115d0 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 10 client.18645 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 10 client.18645 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 20 client.18645 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b72bdf0 0x556d7b72e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 4 client.18645 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:47.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.976+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d7b684860 con 0x556d7b72bdf0 2024-09-19T09:30:47.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.977+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b72bdf0 0x556d7b72e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.977+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b72bdf0 0x556d7b72e1e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=625fb37ee8854b37 server_cookie=93bbc8a9cbf96239 in_seq=0 out_seq=0 2024-09-19T09:30:47.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.977+0000 7f9a1effd640 10 client.18645 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:47.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a1effd640 1 -- 172.21.15.52:0/2863973034 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d7b684860 con 0x556d7b72bdf0 2024-09-19T09:30:47.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a1effd640 10 client.18645 handle_command_reply: tid=0 2024-09-19T09:30:47.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 client.18645 shutdown 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 msgr2=0x556d7b71bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f9a300d5c40 tx=0x7f9a300a8920 comp rx=0 tx=0).stop 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 shutdown_connections 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b72bdf0 0x556d7b72e1e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b719650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b712b40 0x556d7b719040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2863973034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b71bd90 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 >> 172.21.15.52:0/2863973034 conn(0x556d7b6da310 msgr2=0x556d7b7139c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a1effd640 0 client.18645 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 shutdown_connections 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 1 -- 172.21.15.52:0/2863973034 wait complete. 2024-09-19T09:30:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.978+0000 7f9a484a5740 20 client.18645 trim_cache size 0 max 16384 2024-09-19T09:30:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 Processor -- start 2024-09-19T09:30:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 -- start start 2024-09-19T09:30:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b730e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b731360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401adf40 con 0x556d7b7115d0 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401ab810 con 0x556d7b712b40 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.991+0000 7f9a484a5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401a9660 con 0x556d7b71c370 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33656/0 (socket says 172.21.15.52:33656) 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/3344498833 learned_addr learned my addr 172.21.15.52:0/3344498833 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3effd640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b730e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b731360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/3344498833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 msgr2=0x556d7b731360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b731360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/3344498833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 msgr2=0x556d7b730e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b730e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 -- 172.21.15.52:0/3344498833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d7b719fe0 con 0x556d7b7115d0 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3effd640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b730e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b731360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9a300a41a0 tx=0x7f9a300a3f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ea6ca6df5d3775 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a257fa640 1 -- 172.21.15.52:0/3344498833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300bc070 con 0x556d7b7115d0 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a257fa640 1 -- 172.21.15.52:0/3344498833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a300a9cd0 con 0x556d7b7115d0 2024-09-19T09:30:47.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.992+0000 7f9a257fa640 1 -- 172.21.15.52:0/3344498833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300bd260 con 0x556d7b7115d0 2024-09-19T09:30:47.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- 172.21.15.52:0/3344498833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 msgr2=0x556d7b728430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9a300a41a0 tx=0x7f9a300a3f30 comp rx=0 tx=0).stop 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- 172.21.15.52:0/3344498833 shutdown_connections 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b71c370 0x556d7b731360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b712b40 0x556d7b730e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 --2- 172.21.15.52:0/3344498833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b7115d0 0x556d7b728430 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- 172.21.15.52:0/3344498833 >> 172.21.15.52:0/3344498833 conn(0x556d7b6da310 msgr2=0x556d7b718130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- 172.21.15.52:0/3344498833 shutdown_connections 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- 172.21.15.52:0/3344498833 wait complete. 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.993+0000 7f9a484a5740 1 -- start start 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 Processor -- start 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b7115d0 0x556d7b730ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:48.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b72e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401a9cd0 con 0x556d7b712b40 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401ab140 con 0x556d7b71c370 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33662/0 (socket says 172.21.15.52:33662) 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a3effd640 1 -- 172.21.15.52:0/2148858836 learned_addr learned my addr 172.21.15.52:0/2148858836 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a401aa3a0 con 0x556d7b7115d0 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a484a5740 10 client.0 _ll_register_callbacks cb 0x7f9a3400b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a3ffff640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b72e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.994+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b7115d0 0x556d7b730ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 -- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b7115d0 msgr2=0x556d7b730ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b7115d0 0x556d7b730ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 -- 172.21.15.52:0/2148858836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 msgr2=0x556d7b72e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:48.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b72e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 -- 172.21.15.52:0/2148858836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d7b72eb60 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a3effd640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x556d7b7188d0 tx=0x7f9a34013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a370f6790cc9ded1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a1effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3402a6f0 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9a3402a890 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a300a9cd0 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9a3403a050 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a484a5740 10 client.18651 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556d7b7961e0 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.995+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a300a9cd0 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9a3401ece0 con 0x556d7b712b40 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 10 client.18651 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:48.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 10 client.18651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 20 client.18651 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b796990 0x556d7b798db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 4 client.18651 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d7b67ed70 con 0x556d7b796990 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.996+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b796990 0x556d7b798db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a3f7fe640 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b796990 0x556d7b798db0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d48546e5a1d15952 server_cookie=18a9018b9ca52fc5 in_seq=0 out_seq=0 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a1effd640 10 client.18651 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a1effd640 1 -- 172.21.15.52:0/2148858836 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d7b67ed70 con 0x556d7b796990 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a1effd640 10 client.18651 handle_command_reply: tid=0 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 client.18651 shutdown 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 msgr2=0x556d7b731430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x556d7b7188d0 tx=0x7f9a34013070 comp rx=0 tx=0).stop 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 shutdown_connections 2024-09-19T09:30:48.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556d7b796990 0x556d7b798db0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556d7b71c370 0x556d7b72e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d7b712b40 0x556d7b731430 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a1effd640 0 client.18651 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 --2- 172.21.15.52:0/2148858836 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556d7b7115d0 0x556d7b730ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 >> 172.21.15.52:0/2148858836 conn(0x556d7b6da310 msgr2=0x556d7b713110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.997+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 shutdown_connections 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a484a5740 1 -- 172.21.15.52:0/2148858836 wait complete. 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a484a5740 20 client.18651 trim_cache size 0 max 16384 2024-09-19T09:30:48.004 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 msgr2=0x7f9a280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 0x7f9a280a5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9a40107440 tx=0x7f9a3400b390 comp rx=0 tx=0).stop 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 msgr2=0x7f9a40198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009f50 tx=0x7f9a3000ee50 comp rx=0 tx=0).stop 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 shutdown_connections 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9a280a32c0 0x7f9a280a5780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a401082a0 0x7f9a4019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a401036e0 0x7f9a40198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 --2- 172.21.15.52:0/2308964134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a40102d30 0x7f9a40198610 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:48.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 >> 172.21.15.52:0/2308964134 conn(0x7f9a400fc7d0 msgr2=0x7f9a400fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:48.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.998+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 shutdown_connections 2024-09-19T09:30:48.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:47.999+0000 7f9a460cc640 1 -- 172.21.15.52:0/2308964134 wait complete. 2024-09-19T09:30:48.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:30:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 -- 172.21.15.52:0/3888287711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8101de0 msgr2=0x7f3dd81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/3888287711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8101de0 0x7f3dd81021c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009900 tx=0x7f3dc802a410 comp rx=0 tx=0).stop 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 -- 172.21.15.52:0/3888287711 shutdown_connections 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/3888287711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8106f10 0x7f3dd810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/3888287711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 0x7f3dd81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/3888287711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8101de0 0x7f3dd81021c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 -- 172.21.15.52:0/3888287711 >> 172.21.15.52:0/3888287711 conn(0x7f3dd80fd8c0 msgr2=0x7f3dd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 -- 172.21.15.52:0/3888287711 shutdown_connections 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.311+0000 7f3ddc80b640 1 -- 172.21.15.52:0/3888287711 wait complete. 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 Processor -- start 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 -- start start 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8101de0 0x7f3dd8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 0x7f3dd8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8111f70 con 0x7f3dd8106f10 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8111df0 con 0x7f3dd8101de0 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3ddc80b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81120f0 con 0x7f3dd8102790 2024-09-19T09:30:49.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.312+0000 7f3dd6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37064/0 (socket says 172.21.15.52:37064) 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 -- 172.21.15.52:0/838221457 learned_addr learned my addr 172.21.15.52:0/838221457 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dcffff640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 0x7f3dd8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd659c640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8101de0 0x7f3dd8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 -- 172.21.15.52:0/838221457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 msgr2=0x7f3dd8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 0x7f3dd8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 -- 172.21.15.52:0/838221457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8101de0 msgr2=0x7f3dd8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8101de0 0x7f3dd8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 -- 172.21.15.52:0/838221457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd819d400 con 0x7f3dd8106f10 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dd6d9d640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000eb10 tx=0x7f3dd000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004b20 con 0x7f3dd8106f10 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dd0004cc0 con 0x7f3dd8106f10 2024-09-19T09:30:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd819d6f0 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0010760 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.313+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd81a4fd0 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.314+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd81021c0 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.316+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3dd0010900 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.317+0000 7f3dcf7fe640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 0x7f3dc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.317+0000 7f3dd659c640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 0x7f3dc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.317+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3dd00d01c0 con 0x7f3dd8106f10 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.317+0000 7f3dd659c640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 0x7f3dc40a5700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005ab0 tx=0x7f3dc8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.320+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3dd0054210 con 0x7f3dd8106f10 2024-09-19T09:30:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:49.487 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:49 smithi052 ceph-mon[30947]: pgmap v619: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:30:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.550+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dd81997b0 con 0x7f3dd8106f10 2024-09-19T09:30:49.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.550+0000 7f3dcf7fe640 1 -- 172.21.15.52:0/838221457 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f3dd81997b0 con 0x7f3dd8106f10 2024-09-19T09:30:49.553 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:30:49.553 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:30:49.553 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 msgr2=0x7f3dc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 0x7f3dc40a5700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8005ab0 tx=0x7f3dc8005a20 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 msgr2=0x7f3dd819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000eb10 tx=0x7f3dd000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 shutdown_connections 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3dd8106f10 0x7f3dd819cd20 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f3dc40a3240 0x7f3dc40a5700 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3dd8102790 0x7f3dd8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 --2- 172.21.15.52:0/838221457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3dd8101de0 0x7f3dd8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 >> 172.21.15.52:0/838221457 conn(0x7f3dd80fd8c0 msgr2=0x7f3dd80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 shutdown_connections 2024-09-19T09:30:49.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:49.553+0000 7f3ddc80b640 1 -- 172.21.15.52:0/838221457 wait complete. 2024-09-19T09:30:49.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:49 smithi169 ceph-mon[35454]: pgmap v619: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:30:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:49 smithi086 ceph-mon[34813]: pgmap v619: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T09:30:50.293 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:30:50.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:30:50.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 -- 172.21.15.52:0/2632485041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa040745a0 msgr2=0x7faa04074980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2632485041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa040745a0 0x7faa04074980 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009900 tx=0x7fa9f402a410 comp rx=0 tx=0).stop 2024-09-19T09:30:50.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 -- 172.21.15.52:0/2632485041 shutdown_connections 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2632485041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 0x7faa041108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2632485041 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa04074f50 0x7faa0410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2632485041 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa040745a0 0x7faa04074980 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 -- 172.21.15.52:0/2632485041 >> 172.21.15.52:0/2632485041 conn(0x7faa040fd8d0 msgr2=0x7faa040ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 -- 172.21.15.52:0/2632485041 shutdown_connections 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.464+0000 7faa0a41b640 1 -- 172.21.15.52:0/2632485041 wait complete. 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 Processor -- start 2024-09-19T09:30:50.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 -- start start 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 0x7faa0419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 0x7faa0419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa04114200 con 0x7faa04074f50 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa04114080 con 0x7faa0410e470 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa0a41b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa04114380 con 0x7faa040745a0 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37076/0 (socket says 172.21.15.52:37076) 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa037fe640 1 -- 172.21.15.52:0/2816627289 learned_addr learned my addr 172.21.15.52:0/2816627289 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:50.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa089b8640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 0x7faa0419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa03fff640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 0x7faa0419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa037fe640 1 -- 172.21.15.52:0/2816627289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 msgr2=0x7faa0419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.465+0000 7faa037fe640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 0x7faa0419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa037fe640 1 -- 172.21.15.52:0/2816627289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 msgr2=0x7faa0419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa037fe640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 0x7faa0419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa037fe640 1 -- 172.21.15.52:0/2816627289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0419f5f0 con 0x7faa04074f50 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa03fff640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 0x7faa0419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa037fe640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e9f0 tx=0x7fa9f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa017fa640 1 -- 172.21.15.52:0/2816627289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f800cd80 con 0x7faa04074f50 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0419f8e0 con 0x7faa04074f50 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa017fa640 1 -- 172.21.15.52:0/2816627289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f8005500 con 0x7faa04074f50 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa017fa640 1 -- 172.21.15.52:0/2816627289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8010690 con 0x7faa04074f50 2024-09-19T09:30:50.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.466+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa041a71c0 con 0x7faa04074f50 2024-09-19T09:30:50.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.468+0000 7faa017fa640 1 -- 172.21.15.52:0/2816627289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa9f80046c0 con 0x7faa04074f50 2024-09-19T09:30:50.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 Processor -- start 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa017fa640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 0x7fa9ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 -- start start 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa089b8640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 0x7fa9ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa017fa640 1 -- 172.21.15.52:0/2816627289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9f80cfe80 con 0x7faa04074f50 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3908c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab38ff22f0 con 0x55ab3909fb80 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ab38f99cf0 con 0x55ab3908c5d0 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.469+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab38fee2b0 con 0x55ab3908db40 2024-09-19T09:30:50.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:48960/0 (socket says 172.21.15.52:48960) 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 -- 172.21.15.52:0/2117120536 learned_addr learned my addr 172.21.15.52:0/2117120536 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa03fff640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3908c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa089b8640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 -- 172.21.15.52:0/2117120536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 msgr2=0x55ab3908c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3908c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 -- 172.21.15.52:0/2117120536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 msgr2=0x55ab390a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 -- 172.21.15.52:0/2117120536 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab38f7e3a0 con 0x55ab3908c5d0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa089b8640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa089b8640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 0x7fa9ec0a5700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc007e30 tx=0x7fa9fc007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7faa037fe640 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9f809c350 tx=0x7fa9f809bfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9df6a270df2283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7fa9ea7fc640 1 -- 172.21.15.52:0/2117120536 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80b5070 con 0x55ab3908c5d0 2024-09-19T09:30:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7fa9ea7fc640 1 -- 172.21.15.52:0/2117120536 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f809c3c0 con 0x55ab3908c5d0 2024-09-19T09:30:50.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.470+0000 7fa9ea7fc640 1 -- 172.21.15.52:0/2117120536 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f80a4ba0 con 0x55ab3908c5d0 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2117120536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 msgr2=0x55ab3908ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9f809c350 tx=0x7fa9f809bfc0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2117120536 shutdown_connections 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3908ca10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2117120536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3908c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.471+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2117120536 >> 172.21.15.52:0/2117120536 conn(0x55ab39055310 msgr2=0x55ab39088c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2117120536 shutdown_connections 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2117120536 wait complete. 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- start start 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 Processor -- start 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3909f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3909c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab390a2880 con 0x55ab3909fb80 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ab38fad060 con 0x55ab3908c5d0 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.472+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab390a2a00 con 0x55ab3908db40 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa0c7f4740 10 client.0 _ll_register_callbacks cb 0x55ab38d008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:50.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa037fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3909c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37098/0 (socket says 172.21.15.52:37098) 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 -- 172.21.15.52:0/1082160594 learned_addr learned my addr 172.21.15.52:0/1082160594 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa03fff640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3909f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 -- 172.21.15.52:0/1082160594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 msgr2=0x55ab3909c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3909c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 -- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 msgr2=0x55ab3909f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3909f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 -- 172.21.15.52:0/1082160594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab38d633c0 con 0x55ab3909fb80 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7faa089b8640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc010e90 tx=0x7fa9fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4626680f6e5b5189 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7fa9e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.473+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc026680 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f809c3c0 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9fc026820 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9fc02b020 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 10 client.18666 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ab390ae360 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f809c3c0 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9fc030570 con 0x55ab3909fb80 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 10 client.18666 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 10 client.18666 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 20 client.18666 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab390af820 0x55ab390b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 4 client.18666 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:50.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.474+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab38fff860 con 0x55ab390af820 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.475+0000 7faa03fff640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab390af820 0x55ab390b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.475+0000 7faa03fff640 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab390af820 0x55ab390b1c10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af6c38ac964b687e server_cookie=6112abed9d61e6f8 in_seq=0 out_seq=0 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.475+0000 7fa9e37fe640 10 client.18666 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7fa9e37fe640 1 -- 172.21.15.52:0/1082160594 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab38fff860 con 0x55ab390af820 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7fa9e37fe640 10 client.18666 handle_command_reply: tid=0 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 client.18666 shutdown 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 msgr2=0x55ab3909d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc010e90 tx=0x7fa9fc004ab0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 shutdown_connections 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab3909d010 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab3909c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab390af820 0x55ab390b1c10 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/1082160594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab3909f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 >> 172.21.15.52:0/1082160594 conn(0x55ab39055310 msgr2=0x55ab3908e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7fa9e37fe640 0 client.18666 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:50.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 shutdown_connections 2024-09-19T09:30:50.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 1 -- 172.21.15.52:0/1082160594 wait complete. 2024-09-19T09:30:50.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.476+0000 7faa0c7f4740 20 client.18666 trim_cache size 0 max 16384 2024-09-19T09:30:50.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.497+0000 7faa0c7f4740 1 Processor -- start 2024-09-19T09:30:50.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 -- start start 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 0x55ab390b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa041ade20 con 0x55ab3908c5d0 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa041ab6f0 con 0x55ab3909fb80 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa041a9560 con 0x55ab3908db40 2024-09-19T09:30:50.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa03fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37112/0 (socket says 172.21.15.52:37112) 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.498+0000 7faa03fff640 1 -- 172.21.15.52:0/2806303572 learned_addr learned my addr 172.21.15.52:0/2806303572 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa037fe640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa089b8640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 0x55ab390b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 -- 172.21.15.52:0/2806303572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 msgr2=0x55ab390b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 -- 172.21.15.52:0/2806303572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 msgr2=0x55ab390b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 0x55ab390b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 -- 172.21.15.52:0/2806303572 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab390abb20 con 0x55ab3908c5d0 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa089b8640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 0x55ab390b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7faa03fff640 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009900 tx=0x7fa9f4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5ea8322d6f3859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7fa9e9ffb640 1 -- 172.21.15.52:0/2806303572 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4049070 con 0x55ab3908c5d0 2024-09-19T09:30:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7fa9e9ffb640 1 -- 172.21.15.52:0/2806303572 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f4005520 con 0x55ab3908c5d0 2024-09-19T09:30:50.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.499+0000 7fa9e9ffb640 1 -- 172.21.15.52:0/2806303572 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4035040 con 0x55ab3908c5d0 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2806303572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 msgr2=0x55ab3909e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009900 tx=0x7fa9f4005b50 comp rx=0 tx=0).stop 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2806303572 shutdown_connections 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3909fb80 0x55ab390b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2806303572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3908c5d0 0x55ab3909e7f0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2806303572 >> 172.21.15.52:0/2806303572 conn(0x55ab39055310 msgr2=0x55ab3909e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2806303572 shutdown_connections 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.500+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2806303572 wait complete. 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.501+0000 7faa0c7f4740 1 -- start start 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.501+0000 7faa0c7f4740 1 Processor -- start 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.501+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab390a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.501+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.501+0000 7faa0c7f4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa041a9bb0 con 0x55ab3909fb80 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faa041ab020 con 0x55ab3908c5d0 2024-09-19T09:30:50.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa089b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa0c7f4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faa041aa280 con 0x55ab3908db40 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa089b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37122/0 (socket says 172.21.15.52:37122) 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa089b8640 1 -- 172.21.15.52:0/2290656702 learned_addr learned my addr 172.21.15.52:0/2290656702 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa0c7f4740 10 client.0 _ll_register_callbacks cb 0x7fa9fc007a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa03fff640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab390a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 -- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 msgr2=0x55ab390a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab390a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 -- 172.21.15.52:0/2290656702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 msgr2=0x55ab390a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 -- 172.21.15.52:0/2290656702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab390a87c0 con 0x55ab3908db40 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa03fff640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab390a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:50.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa089b8640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7faa037fe640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390a81d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9f809c350 tx=0x7fa9f80cdbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfeda2bb94fa1068 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.502+0000 7fa9e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8066060 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa9f80a4ba0 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9f4005520 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa9f80b5040 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 10 client.27358 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ab3911a980 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9f4005520 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa9f809b8a0 con 0x55ab3908db40 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 10 client.27358 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 10 client.27358 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:30:50.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 20 client.27358 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab3911acc0 0x55ab3911d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 4 client.27358 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.503+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab38ff9d70 con 0x55ab3911acc0 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7faa03fff640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab3911acc0 0x55ab3911d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7faa03fff640 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab3911acc0 0x55ab3911d0b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=596ebbff843778b0 server_cookie=86424b27bba1452d in_seq=0 out_seq=0 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7fa9e37fe640 10 client.27358 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7fa9e37fe640 1 -- 172.21.15.52:0/2290656702 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab38ff9d70 con 0x55ab3911acc0 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7fa9e37fe640 10 client.27358 handle_command_reply: tid=0 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.504+0000 7faa0c7f4740 1 client.27358 shutdown 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 msgr2=0x55ab390a81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390a81d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9f809c350 tx=0x7fa9f80cdbc0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 shutdown_connections 2024-09-19T09:30:50.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab3909fb80 0x55ab390a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab3908db40 0x55ab390a81d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55ab3911acc0 0x55ab3911d0b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7fa9e37fe640 0 client.27358 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 --2- 172.21.15.52:0/2290656702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab3908c5d0 0x55ab390a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 >> 172.21.15.52:0/2290656702 conn(0x55ab39055310 msgr2=0x55ab390ab330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 shutdown_connections 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 1 -- 172.21.15.52:0/2290656702 wait complete. 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.505+0000 7faa0c7f4740 20 client.27358 trim_cache size 0 max 16384 2024-09-19T09:30:50.512 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 msgr2=0x7fa9ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 0x7fa9ec0a5700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc007e30 tx=0x7fa9fc007520 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 msgr2=0x7faa0419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e9f0 tx=0x7fa9f800edf0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 shutdown_connections 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faa0410e470 0x7faa0419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa04074f50 0x7faa0419ab80 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa9ec0a3240 0x7fa9ec0a5700 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 --2- 172.21.15.52:0/2816627289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faa040745a0 0x7faa0419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:50.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 >> 172.21.15.52:0/2816627289 conn(0x7faa040fd8d0 msgr2=0x7faa040fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 shutdown_connections 2024-09-19T09:30:50.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:50.506+0000 7faa0a41b640 1 -- 172.21.15.52:0/2816627289 wait complete. 2024-09-19T09:30:50.520 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:50 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/838221457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:50.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:50 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/838221457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:50.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:50 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/838221457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:30:51.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:30:51.436 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:51.629 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:51 smithi052 ceph-mon[30947]: pgmap v620: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:51 smithi169 ceph-mon[35454]: pgmap v620: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:51.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:51 smithi086 ceph-mon[34813]: pgmap v620: 97 pgs: 97 active+clean; 872 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:30:51.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 -- 172.21.15.52:0/1144767275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420100e20 msgr2=0x7fa420101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 --2- 172.21.15.52:0/1144767275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420100e20 0x7fa420101200 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa414009900 tx=0x7fa41402a480 comp rx=0 tx=0).stop 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 -- 172.21.15.52:0/1144767275 shutdown_connections 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 --2- 172.21.15.52:0/1144767275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102ef0 0x7fa42010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 --2- 172.21.15.52:0/1144767275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420102570 0x7fa4201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 --2- 172.21.15.52:0/1144767275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420100e20 0x7fa420101200 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.866+0000 7fa426e6b640 1 -- 172.21.15.52:0/1144767275 >> 172.21.15.52:0/1144767275 conn(0x7fa4200fc7d0 msgr2=0x7fa4200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 -- 172.21.15.52:0/1144767275 shutdown_connections 2024-09-19T09:30:51.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 -- 172.21.15.52:0/1144767275 wait complete. 2024-09-19T09:30:51.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 Processor -- start 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 -- start start 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 0x7fa42019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.867+0000 7fa426e6b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102570 0x7fa42019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa426e6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa426e6b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110f80 con 0x7fa420102ef0 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa426e6b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa420110e00 con 0x7fa420100e20 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa426e6b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa420111100 con 0x7fa420102570 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa424c07640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 0x7fa42019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37130/0 (socket says 172.21.15.52:37130) 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 -- 172.21.15.52:0/233328360 learned_addr learned my addr 172.21.15.52:0/233328360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa41ffff640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102570 0x7fa42019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 -- 172.21.15.52:0/233328360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102570 msgr2=0x7fa42019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102570 0x7fa42019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 -- 172.21.15.52:0/233328360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 msgr2=0x7fa42019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 0x7fa42019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 -- 172.21.15.52:0/233328360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42019f660 con 0x7fa420102ef0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa424c07640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 0x7fa42019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.868+0000 7fa425408640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa418007440 tx=0x7fa418007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.869+0000 7fa41dffb640 1 -- 172.21.15.52:0/233328360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418012d30 con 0x7fa420102ef0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.869+0000 7fa41dffb640 1 -- 172.21.15.52:0/233328360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4180140d0 con 0x7fa420102ef0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.869+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42019f8f0 con 0x7fa420102ef0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.869+0000 7fa41dffb640 1 -- 172.21.15.52:0/233328360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4180052f0 con 0x7fa420102ef0 2024-09-19T09:30:51.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.869+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa420107980 con 0x7fa420102ef0 2024-09-19T09:30:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa41dffb640 1 -- 172.21.15.52:0/233328360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa418005490 con 0x7fa420102ef0 2024-09-19T09:30:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 Processor -- start 2024-09-19T09:30:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 -- start start 2024-09-19T09:30:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135ccd760 0x55f135ccdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f135c332a0 con 0x55f135cd8940 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f135bdab10 con 0x55f135ccd760 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa429244740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f135c2f260 con 0x55f135cce080 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37144/0 (socket says 172.21.15.52:37144) 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa41ffff640 1 -- 172.21.15.52:0/929230527 learned_addr learned my addr 172.21.15.52:0/929230527 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.872+0000 7fa424c07640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135ccd760 0x55f135ccdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41dffb640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 0x7fa4100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 -- 172.21.15.52:0/929230527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 msgr2=0x55f135cd8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 -- 172.21.15.52:0/929230527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135ccd760 msgr2=0x55f135ccdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135ccd760 0x55f135ccdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 -- 172.21.15.52:0/929230527 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1359a4b90 con 0x55f135cd8940 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa424c07640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa425408640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 0x7fa4100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41dffb640 1 -- 172.21.15.52:0/233328360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa4180d73e0 con 0x7fa420102ef0 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa41ffff640 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa40c012660 tx=0x7fa40c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413fd939089e3f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa40affd640 1 -- 172.21.15.52:0/929230527 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004220 con 0x55f135cd8940 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa40affd640 1 -- 172.21.15.52:0/929230527 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa40c0043c0 con 0x55f135cd8940 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.873+0000 7fa40affd640 1 -- 172.21.15.52:0/929230527 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c010ad0 con 0x55f135cd8940 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 -- 172.21.15.52:0/929230527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 msgr2=0x55f135cdad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa40c012660 tx=0x7fa40c00ba70 comp rx=0 tx=0).stop 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa425408640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 0x7fa4100a5780 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa418014a30 tx=0x7fa418016040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 -- 172.21.15.52:0/929230527 shutdown_connections 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cd8940 0x55f135cdad30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 --2- 172.21.15.52:0/929230527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135ccd760 0x55f135ccdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 -- 172.21.15.52:0/929230527 >> 172.21.15.52:0/929230527 conn(0x55f135cc9cf0 msgr2=0x55f135cca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 -- 172.21.15.52:0/929230527 shutdown_connections 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.874+0000 7fa429244740 1 -- 172.21.15.52:0/929230527 wait complete. 2024-09-19T09:30:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 -- start start 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 Processor -- start 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cd6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f135cdb510 con 0x55f135ccd760 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f135bbb6e0 con 0x55f135cd8940 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f135cdb690 con 0x55f135cce080 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa429244740 10 client.0 _ll_register_callbacks cb 0x55f135bdfa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37154/0 (socket says 172.21.15.52:37154) 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa41ffff640 1 -- 172.21.15.52:0/708890369 learned_addr learned my addr 172.21.15.52:0/708890369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.875+0000 7fa424c07640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 -- 172.21.15.52:0/708890369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 msgr2=0x55f135cd5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 -- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 msgr2=0x55f135cd6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cd6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 -- 172.21.15.52:0/708890369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f135ce4a80 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa41ffff640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006010 tx=0x7fa40c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0f42cc4b9a0e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c022040 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa40c005240 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.876+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa40c0043c0 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa40c005440 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 10 client.18684 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f135ce7410 con 0x55f135ccd760 2024-09-19T09:30:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa40c0043c0 con 0x55f135ccd760 2024-09-19T09:30:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa40c025070 con 0x55f135ccd760 2024-09-19T09:30:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 10 client.18684 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 10 client.18684 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:30:51.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 20 client.18684 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135ce8870 0x55f135ceac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 4 client.18684 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.877+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f135c409d0 con 0x55f135ce8870 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.878+0000 7fa424c07640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135ce8870 0x55f135ceac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.878+0000 7fa424c07640 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135ce8870 0x55f135ceac60 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e509af8629a45ab server_cookie=809b0376ff9734dc in_seq=0 out_seq=0 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.878+0000 7fa3fffff640 10 client.18684 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa3fffff640 1 -- 172.21.15.52:0/708890369 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f135c409d0 con 0x55f135ce8870 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa3fffff640 10 client.18684 handle_command_reply: tid=0 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 client.18684 shutdown 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 msgr2=0x55f135cd58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa40c006010 tx=0x7fa40c004250 comp rx=0 tx=0).stop 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 shutdown_connections 2024-09-19T09:30:51.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135ce8870 0x55f135ceac60 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cd6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cd5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa3fffff640 0 client.18684 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 --2- 172.21.15.52:0/708890369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cd58b0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 >> 172.21.15.52:0/708890369 conn(0x55f135cc9cf0 msgr2=0x55f135ccf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 shutdown_connections 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.879+0000 7fa429244740 1 -- 172.21.15.52:0/708890369 wait complete. 2024-09-19T09:30:51.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.880+0000 7fa429244740 20 client.18684 trim_cache size 0 max 16384 2024-09-19T09:30:51.899 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:51.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 Processor -- start 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 -- start start 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cf0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cf08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201adf50 con 0x55f135ccd760 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201ab820 con 0x55f135cd8940 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa429244740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201a96b0 con 0x55f135cce080 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa41ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37166/0 (socket says 172.21.15.52:37166) 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa41ffff640 1 -- 172.21.15.52:0/2390466652 learned_addr learned my addr 172.21.15.52:0/2390466652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:51.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.900+0000 7fa424c07640 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cf0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cf08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 -- 172.21.15.52:0/2390466652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 msgr2=0x55f135cf0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cf0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 -- 172.21.15.52:0/2390466652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 msgr2=0x55f135cf08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cf08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 -- 172.21.15.52:0/2390466652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f135cc5260 con 0x55f135ccd760 2024-09-19T09:30:51.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa41ffff640 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0124e0 tx=0x7fa40c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582ff47f07fb0ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa40a7fc640 1 -- 172.21.15.52:0/2390466652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c004bd0 con 0x55f135ccd760 2024-09-19T09:30:51.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa40a7fc640 1 -- 172.21.15.52:0/2390466652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa40c02b070 con 0x55f135ccd760 2024-09-19T09:30:51.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.901+0000 7fa40a7fc640 1 -- 172.21.15.52:0/2390466652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0107e0 con 0x55f135ccd760 2024-09-19T09:30:51.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- 172.21.15.52:0/2390466652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 msgr2=0x55f135cc8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0124e0 tx=0x7fa40c00b900 comp rx=0 tx=0).stop 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- 172.21.15.52:0/2390466652 shutdown_connections 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cf08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135cce080 0x55f135cf0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 --2- 172.21.15.52:0/2390466652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135ccd760 0x55f135cc8d60 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- 172.21.15.52:0/2390466652 >> 172.21.15.52:0/2390466652 conn(0x55f135cc9cf0 msgr2=0x55f135cc8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- 172.21.15.52:0/2390466652 shutdown_connections 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- 172.21.15.52:0/2390466652 wait complete. 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 -- start start 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.902+0000 7fa429244740 1 Processor -- start 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135ccd760 0x55f135ce0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cdc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201a9d00 con 0x55f135cce080 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201ab150 con 0x55f135cd8940 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4201aa3b0 con 0x55f135ccd760 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa429244740 10 client.0 _ll_register_callbacks cb 0x7fa40c0105c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37174/0 (socket says 172.21.15.52:37174) 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 -- 172.21.15.52:0/3979751015 learned_addr learned my addr 172.21.15.52:0/3979751015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa41ffff640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cdc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa41ffff640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135ccd760 0x55f135ce0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 -- 172.21.15.52:0/3979751015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135ccd760 msgr2=0x55f135ce0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135ccd760 0x55f135ce0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 -- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 msgr2=0x55f135cdc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cdc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa424c07640 1 -- 172.21.15.52:0/3979751015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f135cdcde0 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.903+0000 7fa41ffff640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cdc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa424c07640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa4140314e0 tx=0x7fa4140039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc33e11ef359285 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa3fffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414035040 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa414005020 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa40c02b070 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa414054050 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa429244740 10 client.18690 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f135d53220 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.904+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa40c02b070 con 0x55f135cce080 2024-09-19T09:30:51.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa414031540 con 0x55f135cce080 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 10 client.18690 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 10 client.18690 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 20 client.18690 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135d539e0 0x55f135d55e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 4 client.18690 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55f135c3ad20 con 0x55f135d539e0 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa41ffff640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135d539e0 0x55f135d55e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa3fffff640 10 client.18690 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:51.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.905+0000 7fa41ffff640 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135d539e0 0x55f135d55e00 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c6705ae2dd7ed7 server_cookie=777a8eb8c077af47 in_seq=0 out_seq=0 2024-09-19T09:30:51.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa3fffff640 1 -- 172.21.15.52:0/3979751015 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f135c3ad20 con 0x55f135d539e0 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa3fffff640 10 client.18690 handle_command_reply: tid=0 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa429244740 1 client.18690 shutdown 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 msgr2=0x55f135cdc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa4140314e0 tx=0x7fa4140039f0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 shutdown_connections 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f135d539e0 0x55f135d55e00 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.912+0000 7fa3fffff640 0 client.18690 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f135cd8940 0x55f135cdc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f135cce080 0x55f135cdc200 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 --2- 172.21.15.52:0/3979751015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f135ccd760 0x55f135ce0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 >> 172.21.15.52:0/3979751015 conn(0x55f135cc9cf0 msgr2=0x55f135cc8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 shutdown_connections 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 1 -- 172.21.15.52:0/3979751015 wait complete. 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.913+0000 7fa429244740 20 client.18690 trim_cache size 0 max 16384 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 34, 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "3f96d27e": { 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 34, 2024-09-19T09:30:51.916 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 150.0, 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:30:51.917 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 msgr2=0x7fa4100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 0x7fa4100a5780 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa418014a30 tx=0x7fa418016040 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 msgr2=0x7fa42019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa418007440 tx=0x7fa418007900 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 shutdown_connections 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa420102ef0 0x7fa42019ef80 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4100a32c0 0x7fa4100a5780 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa420102570 0x7fa42019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 --2- 172.21.15.52:0/233328360 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa420100e20 0x7fa42019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 >> 172.21.15.52:0/233328360 conn(0x7fa4200fc7d0 msgr2=0x7fa42006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 shutdown_connections 2024-09-19T09:30:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:51.914+0000 7fa426e6b640 1 -- 172.21.15.52:0/233328360 wait complete. 2024-09-19T09:30:52.603 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:52 smithi052 ceph-mon[30947]: pgmap v621: 97 pgs: 97 active+clean; 916 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:30:52.635 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3f96d27e', quiesce took 4.9 seconds. Will release after: 25.1 2024-09-19T09:30:52.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:52 smithi169 ceph-mon[35454]: pgmap v621: 97 pgs: 97 active+clean; 916 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:30:52.761 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:52 smithi086 ceph-mon[34813]: pgmap v621: 97 pgs: 97 active+clean; 916 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:30:53.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 -- 172.21.15.52:0/869497206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0100ca0 msgr2=0x7f91d0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 --2- 172.21.15.52:0/869497206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0100ca0 0x7f91d0106840 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009930 tx=0x7f91c402a420 comp rx=0 tx=0).stop 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 -- 172.21.15.52:0/869497206 shutdown_connections 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 --2- 172.21.15.52:0/869497206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 0x7f91d010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 --2- 172.21.15.52:0/869497206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d0100ca0 0x7f91d0106840 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 --2- 172.21.15.52:0/869497206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d01002f0 0x7f91d01006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 -- 172.21.15.52:0/869497206 >> 172.21.15.52:0/869497206 conn(0x7f91d0077210 msgr2=0x7f91d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 -- 172.21.15.52:0/869497206 shutdown_connections 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.081+0000 7f91d58ad640 1 -- 172.21.15.52:0/869497206 wait complete. 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 Processor -- start 2024-09-19T09:30:53.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 -- start start 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d0100ca0 0x7f91d01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 0x7f91d019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0111f60 con 0x7f91d01002f0 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0111de0 con 0x7f91d0106f50 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91d58ad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01120e0 con 0x7f91d0100ca0 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37182/0 (socket says 172.21.15.52:37182) 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91ceffd640 1 -- 172.21.15.52:0/2818970296 learned_addr learned my addr 172.21.15.52:0/2818970296 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 0x7f91d019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.082+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d0100ca0 0x7f91d01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 -- 172.21.15.52:0/2818970296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d0100ca0 msgr2=0x7f91d01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d0100ca0 0x7f91d01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 -- 172.21.15.52:0/2818970296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 msgr2=0x7f91d019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 0x7f91d019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 -- 172.21.15.52:0/2818970296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d019d460 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f91c000d950 tx=0x7f91c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91d48ab640 1 -- 172.21.15.52:0/2818970296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0017070 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91d48ab640 1 -- 172.21.15.52:0/2818970296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c0009c30 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d019d750 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91d48ab640 1 -- 172.21.15.52:0/2818970296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c000f6b0 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.083+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d01a5030 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d48ab640 1 -- 172.21.15.52:0/2818970296 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91c00109d0 con 0x7f91d01002f0 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 Processor -- start 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 -- start start 2024-09-19T09:30:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f4fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f4fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e51f4642f0 con 0x55e51f50d780 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e51f40bcf0 con 0x55e51f4ffb40 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d7c86740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e51f4602b0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91d48ab640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91ce7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91ce7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37184/0 (socket says 172.21.15.52:37184) 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.086+0000 7f91ce7fc640 1 -- 172.21.15.52:0/1026751736 learned_addr learned my addr 172.21.15.52:0/1026751736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ceffd640 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f4fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f4fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91d48ab640 1 -- 172.21.15.52:0/2818970296 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f91c00cf570 con 0x7f91d01002f0 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 -- 172.21.15.52:0/1026751736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 msgr2=0x55e51f4fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f4fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 -- 172.21.15.52:0/1026751736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 msgr2=0x55e51f4fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f4fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 -- 172.21.15.52:0/1026751736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f3f03a0 con 0x55e51f50d780 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009900 tx=0x7f91c4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4186f71106eb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 0x7f91b80a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009fd0 tx=0x7f91c8009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91b5ffb640 1 -- 172.21.15.52:0/1026751736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4040070 con 0x55e51f50d780 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91b5ffb640 1 -- 172.21.15.52:0/1026751736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4031930 con 0x55e51f50d780 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.087+0000 7f91b5ffb640 1 -- 172.21.15.52:0/1026751736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4035040 con 0x55e51f50d780 2024-09-19T09:30:53.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- 172.21.15.52:0/1026751736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 msgr2=0x55e51f50fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009900 tx=0x7f91c4005c00 comp rx=0 tx=0).stop 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- 172.21.15.52:0/1026751736 shutdown_connections 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50fb70 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f4fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1026751736 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f4fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- 172.21.15.52:0/1026751736 >> 172.21.15.52:0/1026751736 conn(0x55e51f4c7310 msgr2=0x55e51f4fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- 172.21.15.52:0/1026751736 shutdown_connections 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- 172.21.15.52:0/1026751736 wait complete. 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.088+0000 7f91d7c86740 1 -- start start 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 Processor -- start 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f50a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f50d780 0x55e51f50a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e51f510420 con 0x55e51f4fe5d0 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e51f41f060 con 0x55e51f50d780 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e51f5105a0 con 0x55e51f4ffb40 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91d7c86740 10 client.0 _ll_register_callbacks cb 0x55e51f1728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37198/0 (socket says 172.21.15.52:37198) 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 -- 172.21.15.52:0/2929386013 learned_addr learned my addr 172.21.15.52:0/2929386013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f50d780 0x55e51f50a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f50a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 -- 172.21.15.52:0/2929386013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 msgr2=0x55e51f50a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f50a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 -- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f50d780 msgr2=0x55e51f50a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f50d780 0x55e51f50a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.089+0000 7f91ceffd640 1 -- 172.21.15.52:0/2929386013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51f1d53c0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f50a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91ceffd640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f91c0098020 tx=0x7f91c006a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bb4813c0066d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0020070 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f91c00a42f0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c4031930 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91c009bbc0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91d7c86740 10 client.18702 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e51f51be00 con 0x55e51f4fe5d0 2024-09-19T09:30:53.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4031930 con 0x55e51f4fe5d0 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f91c00cf0f0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91d7c86740 10 client.18702 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.090+0000 7f91d7c86740 10 client.18702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91d7c86740 20 client.18702 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f51d2c0 0x55e51f51f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91d7c86740 4 client.18702 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e51f471860 con 0x55e51f51d2c0 2024-09-19T09:30:53.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f51d2c0 0x55e51f51f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f51d2c0 0x55e51f51f6b0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ef0f11f5d2f791 server_cookie=5118d489a5f12607 in_seq=0 out_seq=0 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.091+0000 7f91aeffd640 10 client.18702 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91aeffd640 1 -- 172.21.15.52:0/2929386013 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e51f471860 con 0x55e51f51d2c0 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91aeffd640 10 client.18702 handle_command_reply: tid=0 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 client.18702 shutdown 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 msgr2=0x55e51f50d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f91c0098020 tx=0x7f91c006a900 comp rx=0 tx=0).stop 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 shutdown_connections 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f51d2c0 0x55e51f51f6b0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f50d780 0x55e51f50a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f50a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 --2- 172.21.15.52:0/2929386013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f4fe5d0 0x55e51f50d040 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 >> 172.21.15.52:0/2929386013 conn(0x55e51f4c7310 msgr2=0x55e51f500960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91aeffd640 0 client.18702 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 shutdown_connections 2024-09-19T09:30:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 1 -- 172.21.15.52:0/2929386013 wait complete. 2024-09-19T09:30:53.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.092+0000 7f91d7c86740 20 client.18702 trim_cache size 0 max 16384 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 Processor -- start 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 -- start start 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4fe5d0 0x55e51f5196c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f4fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01ade00 con 0x55e51f50d780 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01ab6d0 con 0x55e51f4fe5d0 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.105+0000 7f91d7c86740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01a9520 con 0x55e51f4ffb40 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37214/0 (socket says 172.21.15.52:37214) 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 -- 172.21.15.52:0/1878683658 learned_addr learned my addr 172.21.15.52:0/1878683658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:53.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f4fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91ceffd640 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4fe5d0 0x55e51f5196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 -- 172.21.15.52:0/1878683658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 msgr2=0x55e51f4fdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f4fdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 -- 172.21.15.52:0/1878683658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4fe5d0 msgr2=0x55e51f5196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4fe5d0 0x55e51f5196c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 -- 172.21.15.52:0/1878683658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51f508840 con 0x55e51f50d780 2024-09-19T09:30:53.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f91c8005ed0 tx=0x7f91c801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d48edc028e2f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91b57fa640 1 -- 172.21.15.52:0/1878683658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c801eaa0 con 0x55e51f50d780 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91b57fa640 1 -- 172.21.15.52:0/1878683658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c801ec40 con 0x55e51f50d780 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.106+0000 7f91b57fa640 1 -- 172.21.15.52:0/1878683658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8020400 con 0x55e51f50d780 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- 172.21.15.52:0/1878683658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 msgr2=0x55e51f50eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f91c8005ed0 tx=0x7f91c801f000 comp rx=0 tx=0).stop 2024-09-19T09:30:53.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- 172.21.15.52:0/1878683658 shutdown_connections 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f50eb70 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4ffb40 0x55e51f4fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 --2- 172.21.15.52:0/1878683658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4fe5d0 0x55e51f5196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- 172.21.15.52:0/1878683658 >> 172.21.15.52:0/1878683658 conn(0x55e51f4c7310 msgr2=0x55e51f51f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- 172.21.15.52:0/1878683658 shutdown_connections 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- 172.21.15.52:0/1878683658 wait complete. 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.107+0000 7f91d7c86740 1 -- start start 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 Processor -- start 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f5243d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f524910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01a9b90 con 0x55e51f50d780 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01ab000 con 0x55e51f4ffb40 2024-09-19T09:30:53.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01aa260 con 0x55e51f4fe5d0 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91d7c86740 10 client.0 _ll_register_callbacks cb 0x7f91c009ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37220/0 (socket says 172.21.15.52:37220) 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 -- 172.21.15.52:0/942353729 learned_addr learned my addr 172.21.15.52:0/942353729 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f524910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91ceffd640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f5243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 -- 172.21.15.52:0/942353729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 msgr2=0x55e51f5243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f5243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 -- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 msgr2=0x55e51f524910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f524910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91cf7fe640 1 -- 172.21.15.52:0/942353729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51f514ed0 con 0x55e51f50d780 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.108+0000 7f91ce7fc640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f524910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:53.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91cf7fe640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f91c802b040 tx=0x7f91c8010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c57049359cc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8037060 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f91c8004c50 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c801ec40 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91c801eaa0 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 10 client.18708 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e51f5161b0 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c801ec40 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f91c801f070 con 0x55e51f50d780 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 10 client.18708 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 10 client.18708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 20 client.18708 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f588040 0x55e51f58a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:53.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 4 client.18708 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.109+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e51f46bd70 con 0x55e51f588040 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.110+0000 7f91ceffd640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f588040 0x55e51f58a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.110+0000 7f91ceffd640 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f588040 0x55e51f58a460 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba3a37c41f607884 server_cookie=e9d962a456543169 in_seq=0 out_seq=0 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.110+0000 7f91aeffd640 10 client.18708 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91aeffd640 1 -- 172.21.15.52:0/942353729 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e51f46bd70 con 0x55e51f588040 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91aeffd640 10 client.18708 handle_command_reply: tid=0 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 client.18708 shutdown 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 msgr2=0x55e51f514830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f91c802b040 tx=0x7f91c8010f70 comp rx=0 tx=0).stop 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 shutdown_connections 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e51f588040 0x55e51f58a460 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e51f50d780 0x55e51f514830 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e51f4ffb40 0x55e51f524910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 --2- 172.21.15.52:0/942353729 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e51f4fe5d0 0x55e51f5243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 >> 172.21.15.52:0/942353729 conn(0x55e51f4c7310 msgr2=0x55e51f508b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91aeffd640 0 client.18708 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 shutdown_connections 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 1 -- 172.21.15.52:0/942353729 wait complete. 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.111+0000 7f91d7c86740 20 client.18708 trim_cache size 0 max 16384 2024-09-19T09:30:53.118 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 msgr2=0x7f91b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 0x7f91b80a5700 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009fd0 tx=0x7f91c8009d80 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 msgr2=0x7f91d01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f91c000d950 tx=0x7f91c000de10 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 shutdown_connections 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91d0106f50 0x7f91d019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91b80a3240 0x7f91b80a5700 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91d0100ca0 0x7f91d01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 --2- 172.21.15.52:0/2818970296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91d01002f0 0x7f91d01984b0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 >> 172.21.15.52:0/2818970296 conn(0x7f91d0077210 msgr2=0x7f91d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 shutdown_connections 2024-09-19T09:30:53.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:53.112+0000 7f91d58ad640 1 -- 172.21.15.52:0/2818970296 wait complete. 2024-09-19T09:30:54.897 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:30:54.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:30:54.926 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:54 smithi052 ceph-mon[30947]: pgmap v622: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:30:54.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:54 smithi169 ceph-mon[35454]: pgmap v622: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:30:55.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:54 smithi086 ceph-mon[34813]: pgmap v622: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:30:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:55.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 -- 172.21.15.52:0/1317540904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 msgr2=0x7ff66410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 --2- 172.21.15.52:0/1317540904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66410da40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009900 tx=0x7ff65c02a480 comp rx=0 tx=0).stop 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 -- 172.21.15.52:0/1317540904 shutdown_connections 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 --2- 172.21.15.52:0/1317540904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66410da40 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 --2- 172.21.15.52:0/1317540904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664102570 0x7ff6641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 --2- 172.21.15.52:0/1317540904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664100e20 0x7ff664101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 -- 172.21.15.52:0/1317540904 >> 172.21.15.52:0/1317540904 conn(0x7ff6640fc7d0 msgr2=0x7ff6640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 -- 172.21.15.52:0/1317540904 shutdown_connections 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.570+0000 7ff6695eb640 1 -- 172.21.15.52:0/1317540904 wait complete. 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 Processor -- start 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 -- start start 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 0x7ff66419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664102570 0x7ff66419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff664110f80 con 0x7ff664102ef0 2024-09-19T09:30:55.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff664110e00 con 0x7ff664100e20 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.571+0000 7ff6695eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff664111100 con 0x7ff664102570 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37244/0 (socket says 172.21.15.52:37244) 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 -- 172.21.15.52:0/4209920078 learned_addr learned my addr 172.21.15.52:0/4209920078 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664102570 0x7ff66419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff662ffd640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 0x7ff66419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 -- 172.21.15.52:0/4209920078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664102570 msgr2=0x7ff66419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664102570 0x7ff66419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 -- 172.21.15.52:0/4209920078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 msgr2=0x7ff66419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 0x7ff66419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 -- 172.21.15.52:0/4209920078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66419f590 con 0x7ff664102ef0 2024-09-19T09:30:55.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff662ffd640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 0x7ff66419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6637fe640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff65c004770 tx=0x7ff65c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff64bfff640 1 -- 172.21.15.52:0/4209920078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c03f070 con 0x7ff664102ef0 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66419f820 con 0x7ff664102ef0 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff64bfff640 1 -- 172.21.15.52:0/4209920078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff65c031c30 con 0x7ff664102ef0 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.572+0000 7ff64bfff640 1 -- 172.21.15.52:0/4209920078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c035030 con 0x7ff664102ef0 2024-09-19T09:30:55.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.573+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a7160 con 0x7ff664102ef0 2024-09-19T09:30:55.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff64bfff640 1 -- 172.21.15.52:0/4209920078 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff65c042070 con 0x7ff664102ef0 2024-09-19T09:30:55.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 Processor -- start 2024-09-19T09:30:55.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 -- start start 2024-09-19T09:30:55.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56461a21c280 con 0x56461a2b7480 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56461a1c3b10 con 0x56461a2b6b60 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56461a218240 con 0x56461a2c1d40 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff662ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff662ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37254/0 (socket says 172.21.15.52:37254) 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.575+0000 7ff662ffd640 1 -- 172.21.15.52:0/432677450 learned_addr learned my addr 172.21.15.52:0/432677450 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff64bfff640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 0x7ff64c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6627fc640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6627fc640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6637fe640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 0x7ff64c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 -- 172.21.15.52:0/432677450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 msgr2=0x56461a2c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 -- 172.21.15.52:0/432677450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 msgr2=0x56461a2b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 -- 172.21.15.52:0/432677450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56461a1d01f0 con 0x56461a2b7480 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6627fc640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff64bfff640 1 -- 172.21.15.52:0/4209920078 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff65c0f0530 con 0x7ff664102ef0 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff662ffd640 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff6540103a0 tx=0x7ff654010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ea7a47465afde3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6497fa640 1 -- 172.21.15.52:0/432677450 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654024680 con 0x56461a2b7480 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6637fe640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 0x7ff64c0a5700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff65c005940 tx=0x7ff65c087900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6497fa640 1 -- 172.21.15.52:0/432677450 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff654022860 con 0x56461a2b7480 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.576+0000 7ff6497fa640 1 -- 172.21.15.52:0/432677450 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654023940 con 0x56461a2b7480 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- 172.21.15.52:0/432677450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 msgr2=0x56461a2c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff6540103a0 tx=0x7ff654010860 comp rx=0 tx=0).stop 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- 172.21.15.52:0/432677450 shutdown_connections 2024-09-19T09:30:55.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c1800 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/432677450 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- 172.21.15.52:0/432677450 >> 172.21.15.52:0/432677450 conn(0x56461a2b30f0 msgr2=0x56461a2b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- 172.21.15.52:0/432677450 shutdown_connections 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- 172.21.15.52:0/432677450 wait complete. 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.577+0000 7ff66b9c4740 1 -- start start 2024-09-19T09:30:55.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 Processor -- start 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2bec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2b7480 0x56461a2bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56461a2c4910 con 0x56461a2c1d40 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56461a1d6f10 con 0x56461a2b6b60 2024-09-19T09:30:55.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56461a2c4a90 con 0x56461a2b7480 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff66b9c4740 10 client.0 _ll_register_callbacks cb 0x56461a19fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37264/0 (socket says 172.21.15.52:37264) 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 -- 172.21.15.52:0/2557451585 learned_addr learned my addr 172.21.15.52:0/2557451585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff662ffd640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2b7480 0x56461a2bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 -- 172.21.15.52:0/2557451585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2b7480 msgr2=0x56461a2bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2b7480 0x56461a2bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 -- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 msgr2=0x56461a2bec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2bec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.578+0000 7ff6627fc640 1 -- 172.21.15.52:0/2557451585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564619f8d6a0 con 0x56461a2c1d40 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff6627fc640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff658011d70 tx=0x7ff658013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2b17ab319405cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658011e60 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff658005020 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff654022860 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff658026020 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 10 client.18720 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56461a2d0550 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff654022860 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff658004ba0 con 0x56461a2c1d40 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 10 client.18720 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 10 client.18720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 20 client.18720 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a2d1960 0x56461a2d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 4 client.18720 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.579+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56461a2297f0 con 0x56461a2d1960 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.580+0000 7ff662ffd640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a2d1960 0x56461a2d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.580+0000 7ff662ffd640 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a2d1960 0x56461a2d3d50 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44c6d7af21da32bb server_cookie=4f6b9e3f07175346 in_seq=0 out_seq=0 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.580+0000 7ff646ff5640 10 client.18720 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff646ff5640 1 -- 172.21.15.52:0/2557451585 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56461a2297f0 con 0x56461a2d1960 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff646ff5640 10 client.18720 handle_command_reply: tid=0 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 client.18720 shutdown 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 msgr2=0x56461a2bf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff658011d70 tx=0x7ff658013040 comp rx=0 tx=0).stop 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 shutdown_connections 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a2d1960 0x56461a2d3d50 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2c1d40 0x56461a2bf680 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2b7480 0x56461a2bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/2557451585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2bec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff646ff5640 0 client.18720 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.581+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 >> 172.21.15.52:0/2557451585 conn(0x56461a2b30f0 msgr2=0x56461a2b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.582+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 shutdown_connections 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.582+0000 7ff66b9c4740 1 -- 172.21.15.52:0/2557451585 wait complete. 2024-09-19T09:30:55.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.582+0000 7ff66b9c4740 20 client.18720 trim_cache size 0 max 16384 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 Processor -- start 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 -- start start 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 0x56461a2d95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641ade00 con 0x56461a2b6b60 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641ab6d0 con 0x56461a2b7480 2024-09-19T09:30:55.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641a9540 con 0x56461a2c1d40 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff6627fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff6627fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37276/0 (socket says 172.21.15.52:37276) 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.599+0000 7ff6627fc640 1 -- 172.21.15.52:0/3788837430 learned_addr learned my addr 172.21.15.52:0/3788837430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff662ffd640 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 0x56461a2d95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 -- 172.21.15.52:0/3788837430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 msgr2=0x56461a2d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 -- 172.21.15.52:0/3788837430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 msgr2=0x56461a2d95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 0x56461a2d95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 -- 172.21.15.52:0/3788837430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56461a2bd150 con 0x56461a2b6b60 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff662ffd640 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 0x56461a2d95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff6627fc640 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658011570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a260bd5070dc70b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff648ff9640 1 -- 172.21.15.52:0/3788837430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658011e60 con 0x56461a2b6b60 2024-09-19T09:30:55.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff648ff9640 1 -- 172.21.15.52:0/3788837430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff65800a2d0 con 0x56461a2b6b60 2024-09-19T09:30:55.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.600+0000 7ff648ff9640 1 -- 172.21.15.52:0/3788837430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658005350 con 0x56461a2b6b60 2024-09-19T09:30:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- 172.21.15.52:0/3788837430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 msgr2=0x56461a2b8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658011570 comp rx=0 tx=0).stop 2024-09-19T09:30:55.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- 172.21.15.52:0/3788837430 shutdown_connections 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a2d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b7480 0x56461a2d95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/3788837430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b6b60 0x56461a2b8d10 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- 172.21.15.52:0/3788837430 >> 172.21.15.52:0/3788837430 conn(0x56461a2b30f0 msgr2=0x56461a2b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- 172.21.15.52:0/3788837430 shutdown_connections 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- 172.21.15.52:0/3788837430 wait complete. 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- start start 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 Processor -- start 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a33b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641a9b90 con 0x56461a2b7480 2024-09-19T09:30:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641ab000 con 0x56461a2b6b60 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff66b9c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641aa260 con 0x56461a2c1d40 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.601+0000 7ff662ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff66b9c4740 10 client.0 _ll_register_callbacks cb 0x7ff65800ae40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37290/0 (socket says 172.21.15.52:37290) 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 -- 172.21.15.52:0/4235885277 learned_addr learned my addr 172.21.15.52:0/4235885277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a33b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 -- 172.21.15.52:0/4235885277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 msgr2=0x56461a33b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a33b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 -- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 msgr2=0x56461a2c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 -- 172.21.15.52:0/4235885277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56461a2c6c20 con 0x56461a2b7480 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff662ffd640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff6540234f0 tx=0x7ff654023520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a6a56c54d4a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff646ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654022c90 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff654004a00 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff65800a2d0 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff654022e30 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff66b9c4740 10 client.18726 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.602+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56461a33cc10 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff65800a2d0 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff65400f040 con 0x56461a2b7480 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 10 client.18726 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 10 client.18726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 20 client.18726 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a33d110 0x56461a33f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:55.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 4 client.18726 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56461a223d00 con 0x56461a33d110 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.603+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a33d110 0x56461a33f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.604+0000 7ff6627fc640 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a33d110 0x56461a33f530 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81937f3deec190bb server_cookie=1d067ee4b6d03c9f in_seq=0 out_seq=0 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.604+0000 7ff646ff5640 10 client.18726 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff646ff5640 1 -- 172.21.15.52:0/4235885277 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56461a223d00 con 0x56461a33d110 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff646ff5640 10 client.18726 handle_command_reply: tid=0 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 client.18726 shutdown 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 msgr2=0x56461a2c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff6540234f0 tx=0x7ff654023520 comp rx=0 tx=0).stop 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 shutdown_connections 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56461a33d110 0x56461a33f530 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56461a2c1d40 0x56461a33b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56461a2b7480 0x56461a2c6370 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 --2- 172.21.15.52:0/4235885277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56461a2b6b60 0x56461a2c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 >> 172.21.15.52:0/4235885277 conn(0x56461a2b30f0 msgr2=0x56461a2b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff646ff5640 0 client.18726 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 shutdown_connections 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 1 -- 172.21.15.52:0/4235885277 wait complete. 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.605+0000 7ff66b9c4740 20 client.18726 trim_cache size 0 max 16384 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "550b91b6-ef4f-4c8f-96b9-517a6e47bd47", 2024-09-19T09:30:55.612 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 msgr2=0x7ff64c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 0x7ff64c0a5700 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff65c005940 tx=0x7ff65c087900 comp rx=0 tx=0).stop 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 msgr2=0x7ff66419eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ff65c004770 tx=0x7ff65c003c10 comp rx=0 tx=0).stop 2024-09-19T09:30:55.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 shutdown_connections 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff664102ef0 0x7ff66419eeb0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff64c0a3240 0x7ff64c0a5700 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff664102570 0x7ff66419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 --2- 172.21.15.52:0/4209920078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff664100e20 0x7ff66419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 >> 172.21.15.52:0/4209920078 conn(0x7ff6640fc7d0 msgr2=0x7ff66406a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 shutdown_connections 2024-09-19T09:30:55.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:55.606+0000 7ff6695eb640 1 -- 172.21.15.52:0/4209920078 wait complete. 2024-09-19T09:30:56.302 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:30:56.604 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:56.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:56 smithi052 ceph-mon[30947]: pgmap v623: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:30:56.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:56 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:30:56.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:56 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:56.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:56 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:30:56.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:56 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:56 smithi169 ceph-mon[35454]: pgmap v623: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:30:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:56 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:30:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:56 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:56 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:30:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:56 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:56 smithi086 ceph-mon[34813]: pgmap v623: 97 pgs: 97 active+clean; 916 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:30:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:56 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:30:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:56 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:56 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:30:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:56 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 -- 172.21.15.52:0/1242351365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 msgr2=0x7f8bc410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/1242351365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc410ea90 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc009ca0 tx=0x7f8bbc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 -- 172.21.15.52:0/1242351365 shutdown_connections 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/1242351365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc410ea90 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/1242351365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 0x7f8bc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/1242351365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 0x7f8bc41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 -- 172.21.15.52:0/1242351365 >> 172.21.15.52:0/1242351365 conn(0x7f8bc40fd8c0 msgr2=0x7f8bc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 -- 172.21.15.52:0/1242351365 shutdown_connections 2024-09-19T09:30:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.067+0000 7f8bca3ad640 1 -- 172.21.15.52:0/1242351365 wait complete. 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 Processor -- start 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 -- start start 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 0x7f8bc40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 0x7f8bc4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4111f70 con 0x7f8bc4106f10 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc4111df0 con 0x7f8bc4102790 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bca3ad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41120f0 con 0x7f8bc4101de0 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bbbfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 0x7f8bc4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37304/0 (socket says 172.21.15.52:37304) 2024-09-19T09:30:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 0x7f8bc40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 -- 172.21.15.52:0/4121136405 learned_addr learned my addr 172.21.15.52:0/4121136405 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 -- 172.21.15.52:0/4121136405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 msgr2=0x7f8bc40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 0x7f8bc40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 -- 172.21.15.52:0/4121136405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 msgr2=0x7f8bc4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 0x7f8bc4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.068+0000 7f8bc894a640 1 -- 172.21.15.52:0/4121136405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc41a6890 con 0x7f8bc4106f10 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bc894a640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc031a20 tx=0x7f8bbc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bc1ffb640 1 -- 172.21.15.52:0/4121136405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc003c30 con 0x7f8bc4106f10 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bc1ffb640 1 -- 172.21.15.52:0/4121136405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bbc003dd0 con 0x7f8bc4106f10 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bc1ffb640 1 -- 172.21.15.52:0/4121136405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc02fcf0 con 0x7f8bc4106f10 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc41a6b20 con 0x7f8bc4106f10 2024-09-19T09:30:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.069+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc41a7010 con 0x7f8bc4106f10 2024-09-19T09:30:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.071+0000 7f8bc1ffb640 1 -- 172.21.15.52:0/4121136405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8bbc004050 con 0x7f8bc4106f10 2024-09-19T09:30:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 Processor -- start 2024-09-19T09:30:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 -- start start 2024-09-19T09:30:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 0x5604de7ee140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604de7492e0 con 0x5604de7ee680 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604de6f0ce0 con 0x5604de7e3dc0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bcc786740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604de7452a0 con 0x5604de7e34a0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bc1ffb640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 0x7f8bb00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37310/0 (socket says 172.21.15.52:37310) 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.072+0000 7f8bbbfff640 1 -- 172.21.15.52:0/1444536326 learned_addr learned my addr 172.21.15.52:0/1444536326 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 0x5604de7ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bc894a640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 0x7f8bb00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 -- 172.21.15.52:0/1444536326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 msgr2=0x5604de7e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bc1ffb640 1 -- 172.21.15.52:0/4121136405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8bbc0f0c70 con 0x7f8bc4106f10 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 -- 172.21.15.52:0/1444536326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 msgr2=0x5604de7ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 0x5604de7ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 -- 172.21.15.52:0/1444536326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604de6d5440 con 0x5604de7ee680 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 0x5604de7ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8bac012740 tx=0x7f8bac00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc93eac933e9c95f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bc894a640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 0x7f8bb00a5780 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b7e00 tx=0x7f8bbc088360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bba7fc640 1 -- 172.21.15.52:0/1444536326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac012cc0 con 0x5604de7ee680 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bba7fc640 1 -- 172.21.15.52:0/1444536326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bac010c50 con 0x5604de7ee680 2024-09-19T09:30:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.073+0000 7f8bba7fc640 1 -- 172.21.15.52:0/1444536326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bac01eaf0 con 0x5604de7ee680 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- 172.21.15.52:0/1444536326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 msgr2=0x5604de7f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8bac012740 tx=0x7f8bac00b700 comp rx=0 tx=0).stop 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- 172.21.15.52:0/1444536326 shutdown_connections 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7ee680 0x5604de7f0a70 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e3dc0 0x5604de7ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1444536326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- 172.21.15.52:0/1444536326 >> 172.21.15.52:0/1444536326 conn(0x5604de7dfa30 msgr2=0x5604de7dfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- 172.21.15.52:0/1444536326 shutdown_connections 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- 172.21.15.52:0/1444536326 wait complete. 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.074+0000 7f8bcc786740 1 -- start start 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 Processor -- start 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 0x5604de7eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5604de7f1250 con 0x5604de7e3dc0 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5604de704050 con 0x5604de7ee680 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5604de7f13d0 con 0x5604de7e34a0 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bcc786740 10 client.0 _ll_register_callbacks cb 0x5604de744160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37324/0 (socket says 172.21.15.52:37324) 2024-09-19T09:30:57.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 -- 172.21.15.52:0/1590044787 learned_addr learned my addr 172.21.15.52:0/1590044787 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 0x5604de7eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 -- 172.21.15.52:0/1590044787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 msgr2=0x5604de7ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7ee000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 -- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 msgr2=0x5604de7eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 0x5604de7eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bc3fff640 1 -- 172.21.15.52:0/1590044787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604de4ba3c0 con 0x5604de7e3dc0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.075+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 0x5604de7eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400b9a0 tx=0x7f8bb400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a4ec9df4c4020e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4003ea0 con 0x5604de7e3dc0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bac010c50 con 0x5604de7e3dc0 2024-09-19T09:30:57.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8bb401b640 con 0x5604de7e3dc0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bb4020020 con 0x5604de7e3dc0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8bcc786740 10 client.18738 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604de7fccd0 con 0x5604de7e3dc0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bac010c50 con 0x5604de7e3dc0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.076+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8bb4019020 con 0x5604de7e3dc0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 10 client.18738 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 10 client.18738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 20 client.18738 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de7fe1e0 0x5604de800600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 4 client.18738 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604de756850 con 0x5604de7fe1e0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de7fe1e0 0x5604de800600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8ba37fe640 10 client.18738 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:57.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.077+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de7fe1e0 0x5604de800600 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3288246b45fe40b5 server_cookie=7166b88ad82235bf in_seq=0 out_seq=0 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8ba37fe640 1 -- 172.21.15.52:0/1590044787 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604de756850 con 0x5604de7fe1e0 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8ba37fe640 10 client.18738 handle_command_reply: tid=0 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 client.18738 shutdown 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 msgr2=0x5604de7eb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400b9a0 tx=0x7f8bb400be60 comp rx=0 tx=0).stop 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 shutdown_connections 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de7fe1e0 0x5604de800600 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7ee680 0x5604de7eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7eb2b0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 --2- 172.21.15.52:0/1590044787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7e34a0 0x5604de7ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8ba37fe640 0 client.18738 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 >> 172.21.15.52:0/1590044787 conn(0x5604de7dfa30 msgr2=0x5604de7e5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 shutdown_connections 2024-09-19T09:30:57.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 1 -- 172.21.15.52:0/1590044787 wait complete. 2024-09-19T09:30:57.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.078+0000 7f8bcc786740 20 client.18738 trim_cache size 0 max 16384 2024-09-19T09:30:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 Processor -- start 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 -- start start 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de805eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41b2230 con 0x5604de7e3dc0 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41afb00 con 0x5604de7e34a0 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bcc786740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41ad950 con 0x5604de7ee680 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37326/0 (socket says 172.21.15.52:37326) 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 -- 172.21.15.52:0/63597215 learned_addr learned my addr 172.21.15.52:0/63597215 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de805eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 -- 172.21.15.52:0/63597215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 msgr2=0x5604de805eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de805eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 -- 172.21.15.52:0/63597215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 msgr2=0x5604de7fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.096+0000 7f8bc3fff640 1 -- 172.21.15.52:0/63597215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604de7ebba0 con 0x5604de7e3dc0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4011e00 tx=0x7f8bb4005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd45bfb007466c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bb9ffb640 1 -- 172.21.15.52:0/63597215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4011640 con 0x5604de7e3dc0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bb9ffb640 1 -- 172.21.15.52:0/63597215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bb402a070 con 0x5604de7e3dc0 2024-09-19T09:30:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bb9ffb640 1 -- 172.21.15.52:0/63597215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4004a40 con 0x5604de7e3dc0 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bcc786740 1 -- 172.21.15.52:0/63597215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 msgr2=0x5604de7e67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bcc786740 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4011e00 tx=0x7f8bb4005c50 comp rx=0 tx=0).stop 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bcc786740 1 -- 172.21.15.52:0/63597215 shutdown_connections 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.097+0000 7f8bcc786740 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de805eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7e67f0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 --2- 172.21.15.52:0/63597215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- 172.21.15.52:0/63597215 >> 172.21.15.52:0/63597215 conn(0x5604de7dfa30 msgr2=0x5604de7e60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- 172.21.15.52:0/63597215 shutdown_connections 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- 172.21.15.52:0/63597215 wait complete. 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- start start 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 Processor -- start 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de7f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41adfc0 con 0x5604de7e3dc0 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41af430 con 0x5604de7e34a0 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc41ae690 con 0x5604de7ee680 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bcc786740 10 client.0 _ll_register_callbacks cb 0x7f8bb4004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.098+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37332/0 (socket says 172.21.15.52:37332) 2024-09-19T09:30:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 -- 172.21.15.52:0/3429853231 learned_addr learned my addr 172.21.15.52:0/3429853231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de7f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 -- 172.21.15.52:0/3429853231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 msgr2=0x5604de7f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de7f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 -- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 msgr2=0x5604de7f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 -- 172.21.15.52:0/3429853231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604de7f2de0 con 0x5604de7e3dc0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bc3fff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4011e50 tx=0x7f8bb4011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7106cf6f2b88ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40268a0 con 0x5604de7e3dc0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8bb4026a40 con 0x5604de7e3dc0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb402a070 con 0x5604de7e3dc0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8bb4041050 con 0x5604de7e3dc0 2024-09-19T09:30:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bcc786740 10 client.18744 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.099+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5604de868e60 con 0x5604de7e3dc0 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bb402a070 con 0x5604de7e3dc0 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8bb4019070 con 0x5604de7e3dc0 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 10 client.18744 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 10 client.18744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 20 client.18744 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de8694c0 0x5604de86b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 4 client.18744 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5604de750d60 con 0x5604de8694c0 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.100+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de8694c0 0x5604de86b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8ba37fe640 10 client.18744 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bbbfff640 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de8694c0 0x5604de86b8b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=678ac47ff0abff74 server_cookie=e996fc4648c07ff9 in_seq=0 out_seq=0 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8ba37fe640 1 -- 172.21.15.52:0/3429853231 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f8bac02f110 con 0x5604de8694c0 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8ba37fe640 10 client.18744 handle_command_reply: tid=0 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 client.18744 shutdown 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 msgr2=0x5604de7f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4011e50 tx=0x7f8bb4011af0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 shutdown_connections 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5604de8694c0 0x5604de86b8b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5604de7ee680 0x5604de7f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5604de7e3dc0 0x5604de7f20a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 --2- 172.21.15.52:0/3429853231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5604de7e34a0 0x5604de7f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 >> 172.21.15.52:0/3429853231 conn(0x5604de7dfa30 msgr2=0x5604de7ed330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8ba37fe640 0 client.18744 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 shutdown_connections 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 1 -- 172.21.15.52:0/3429853231 wait complete. 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.101+0000 7f8bcc786740 20 client.18744 trim_cache size 0 max 16384 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:30:57.109 INFO:teuthology.orchestra.run.smithi052.stdout: "550b91b6-ef4f-4c8f-96b9-517a6e47bd47": { 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "550b91b6-ef4f-4c8f-96b9-517a6e47bd47", 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 msgr2=0x7f8bb00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 0x7f8bb00a5780 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0b7e00 tx=0x7f8bbc088360 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 msgr2=0x7f8bc4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc031a20 tx=0x7f8bbc031a50 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 shutdown_connections 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bc4106f10 0x7f8bc4074f70 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bc4102790 0x7f8bc4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8bb00a32c0 0x7f8bb00a5780 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 --2- 172.21.15.52:0/4121136405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8bc4101de0 0x7f8bc40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 >> 172.21.15.52:0/4121136405 conn(0x7f8bc40fd8c0 msgr2=0x7f8bc40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 shutdown_connections 2024-09-19T09:30:57.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:30:57.102+0000 7f8bca3ad640 1 -- 172.21.15.52:0/4121136405 wait complete. 2024-09-19T09:30:57.795 INFO:tasks.cephfs.filesystem:scrub status for tag:550b91b6-ef4f-4c8f-96b9-517a6e47bd47 - {'path': '/', 'tag': '550b91b6-ef4f-4c8f-96b9-517a6e47bd47', 'options': 'recursive,force'} 2024-09-19T09:30:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:58 smithi052 ceph-mon[30947]: pgmap v624: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:30:58 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:30:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:58 smithi169 ceph-mon[35454]: pgmap v624: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:30:58 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 -- 172.21.15.52:0/226402141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 msgr2=0x7fe670101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 --2- 172.21.15.52:0/226402141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670101f60 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fe660009900 tx=0x7fe66002a410 comp rx=0 tx=0).stop 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 -- 172.21.15.52:0/226402141 shutdown_connections 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 --2- 172.21.15.52:0/226402141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 0x7fe670109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 --2- 172.21.15.52:0/226402141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 --2- 172.21.15.52:0/226402141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670101f60 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.983+0000 7fe67673b640 1 -- 172.21.15.52:0/226402141 >> 172.21.15.52:0/226402141 conn(0x7fe6700fd2e0 msgr2=0x7fe6700ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.984+0000 7fe67673b640 1 -- 172.21.15.52:0/226402141 shutdown_connections 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.984+0000 7fe67673b640 1 -- 172.21.15.52:0/226402141 wait complete. 2024-09-19T09:30:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.984+0000 7fe67673b640 1 Processor -- start 2024-09-19T09:30:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.984+0000 7fe67673b640 1 -- start start 2024-09-19T09:30:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 0x7fe67019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe67010d840 con 0x7fe670101b60 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe67010d6c0 con 0x7fe670102d50 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe67673b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe67010d9c0 con 0x7fe670103710 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50794/0 (socket says 172.21.15.52:50794) 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 -- 172.21.15.52:0/2399761076 learned_addr learned my addr 172.21.15.52:0/2399761076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 0x7fe67019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 -- 172.21.15.52:0/2399761076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 msgr2=0x7fe67019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 0x7fe67019f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 -- 172.21.15.52:0/2399761076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 msgr2=0x7fe6701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 -- 172.21.15.52:0/2399761076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67019fa80 con 0x7fe670101b60 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe660031610 tx=0x7fe6600043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66d7fa640 1 -- 172.21.15.52:0/2399761076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66003f030 con 0x7fe670101b60 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.985+0000 7fe66d7fa640 1 -- 172.21.15.52:0/2399761076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe660003ce0 con 0x7fe670101b60 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.986+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67019fd10 con 0x7fe670101b60 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.986+0000 7fe66d7fa640 1 -- 172.21.15.52:0/2399761076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660035070 con 0x7fe670101b60 2024-09-19T09:30:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.986+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6701a01b0 con 0x7fe670101b60 2024-09-19T09:30:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe66d7fa640 1 -- 172.21.15.52:0/2399761076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe660042030 con 0x7fe670101b60 2024-09-19T09:30:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 Processor -- start 2024-09-19T09:30:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 -- start start 2024-09-19T09:30:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed341b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56157ec8e2f0 con 0x56157ed2edb0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56157ec36270 con 0x56157ed34780 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.988+0000 7fe6794d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56157ec8a2b0 con 0x56157ed2f6f0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe66d7fa640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 0x7fe6580a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50796/0 (socket says 172.21.15.52:50796) 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 -- 172.21.15.52:0/1818746309 learned_addr learned my addr 172.21.15.52:0/1818746309 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe66ffff640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 0x7fe6580a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe66d7fa640 1 -- 172.21.15.52:0/2399761076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe6600f0010 con 0x7fe670101b60 2024-09-19T09:30:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 -- 172.21.15.52:0/1818746309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 msgr2=0x56157ed341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 -- 172.21.15.52:0/1818746309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 msgr2=0x56157ed36c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed36c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 -- 172.21.15.52:0/1818746309 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56157ec35340 con 0x56157ed2edb0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe66ffff640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe674cd8640 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe6680137f0 tx=0x7fe668013cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0589c6531a795dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.989+0000 7fe6567fc640 1 -- 172.21.15.52:0/1818746309 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668016640 con 0x56157ed2edb0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6567fc640 1 -- 172.21.15.52:0/1818746309 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800c070 con 0x56157ed2edb0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6567fc640 1 -- 172.21.15.52:0/1818746309 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66801e8a0 con 0x56157ed2edb0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 -- 172.21.15.52:0/1818746309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 msgr2=0x56157ed2f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 0x7fe6580a57b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe66801d000 tx=0x7fe66801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fe6680137f0 tx=0x7fe668013cb0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 -- 172.21.15.52:0/1818746309 shutdown_connections 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed36c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 --2- 172.21.15.52:0/1818746309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2edb0 0x56157ed2f1b0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 -- 172.21.15.52:0/1818746309 >> 172.21.15.52:0/1818746309 conn(0x56157ed26010 msgr2=0x56157ed26410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 -- 172.21.15.52:0/1818746309 shutdown_connections 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.990+0000 7fe6794d5740 1 -- 172.21.15.52:0/1818746309 wait complete. 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 -- start start 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 Processor -- start 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed34780 0x56157ed40560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56157ed37750 con 0x56157ed2f6f0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56157ec17290 con 0x56157ed2edb0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56157ed378d0 con 0x56157ed34780 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe6794d5740 10 client.0 _ll_register_callbacks cb 0x56157ec48140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50808/0 (socket says 172.21.15.52:50808) 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe66f7fe640 1 -- 172.21.15.52:0/3192960687 learned_addr learned my addr 172.21.15.52:0/3192960687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.991+0000 7fe66ffff640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe674cd8640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed34780 0x56157ed40560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 -- 172.21.15.52:0/3192960687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed34780 msgr2=0x56157ed40560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed34780 0x56157ed40560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 -- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 msgr2=0x56157ed38fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed38fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 -- 172.21.15.52:0/3192960687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56157e9a1210 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66ffff640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed38fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bf70 tx=0x7fe6640128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c412d52a527449 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe64f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6640035f0 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe664003790 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66800c070 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe664003990 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe6794d5740 10 client.18756 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.992+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56157ea6d620 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800c070 con 0x56157ed2f6f0 2024-09-19T09:30:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe664019070 con 0x56157ed2f6f0 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 10 client.18756 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 10 client.18756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 20 client.18756 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157ed44bf0 0x56157ed47060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 4 client.18756 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56157ec9ba20 con 0x56157ed44bf0 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.993+0000 7fe66ffff640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157ed44bf0 0x56157ed47060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.994+0000 7fe66ffff640 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157ed44bf0 0x56157ed47060 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7a4411802f61b8 server_cookie=8cf78480685c6ac9 in_seq=0 out_seq=0 2024-09-19T09:30:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.994+0000 7fe64f7fe640 10 client.18756 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.994+0000 7fe64f7fe640 1 -- 172.21.15.52:0/3192960687 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56157ec9ba20 con 0x56157ed44bf0 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.994+0000 7fe64f7fe640 10 client.18756 handle_command_reply: tid=0 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.994+0000 7fe6794d5740 1 client.18756 shutdown 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 msgr2=0x56157ed39520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bf70 tx=0x7fe6640128e0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 shutdown_connections 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157ed44bf0 0x56157ed47060 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed34780 0x56157ed40560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed39520 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe64f7fe640 0 client.18756 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 --2- 172.21.15.52:0/3192960687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed38fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 >> 172.21.15.52:0/3192960687 conn(0x56157ed26010 msgr2=0x56157ed27820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 shutdown_connections 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 1 -- 172.21.15.52:0/3192960687 wait complete. 2024-09-19T09:30:59.003 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:58.995+0000 7fe6794d5740 20 client.18756 trim_cache size 0 max 16384 2024-09-19T09:30:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:58 smithi086 ceph-mon[34813]: pgmap v624: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:30:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:30:58 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 Processor -- start 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 -- start start 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2edb0 0x56157ed38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a9930 con 0x56157ed2f6f0 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a7200 con 0x56157ed34780 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe6794d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a5050 con 0x56157ed2edb0 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50822/0 (socket says 172.21.15.52:50822) 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 -- 172.21.15.52:0/837290303 learned_addr learned my addr 172.21.15.52:0/837290303 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66ffff640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2edb0 0x56157ed38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe674cd8640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 -- 172.21.15.52:0/837290303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2edb0 msgr2=0x56157ed38540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2edb0 0x56157ed38540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 -- 172.21.15.52:0/837290303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 msgr2=0x56157ed250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 -- 172.21.15.52:0/837290303 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56157ed30380 con 0x56157ed2f6f0 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe674cd8640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.010+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe664025e50 tx=0x7fe6640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70c8b0154c5c27b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe655ffb640 1 -- 172.21.15.52:0/837290303 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6640035f0 con 0x56157ed2f6f0 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe655ffb640 1 -- 172.21.15.52:0/837290303 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe664003790 con 0x56157ed2f6f0 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe655ffb640 1 -- 172.21.15.52:0/837290303 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664025750 con 0x56157ed2f6f0 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- 172.21.15.52:0/837290303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 msgr2=0x56157ed40520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fe664025e50 tx=0x7fe6640057f0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- 172.21.15.52:0/837290303 shutdown_connections 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed34780 0x56157ed250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed2f6f0 0x56157ed40520 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 --2- 172.21.15.52:0/837290303 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2edb0 0x56157ed38540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- 172.21.15.52:0/837290303 >> 172.21.15.52:0/837290303 conn(0x56157ed26010 msgr2=0x56157ed249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:59.015 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- 172.21.15.52:0/837290303 shutdown_connections 2024-09-19T09:30:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- 172.21.15.52:0/837290303 wait complete. 2024-09-19T09:30:59.016 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.011+0000 7fe6794d5740 1 -- start start 2024-09-19T09:30:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 Processor -- start 2024-09-19T09:30:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed3db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a56c0 con 0x56157ed34780 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a6b30 con 0x56157ed2edb0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701a5d90 con 0x56157ed2f6f0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe6794d5740 10 client.0 _ll_register_callbacks cb 0x7fe66400b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50832/0 (socket says 172.21.15.52:50832) 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 -- 172.21.15.52:0/2890991478 learned_addr learned my addr 172.21.15.52:0/2890991478 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed3db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 -- 172.21.15.52:0/2890991478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 msgr2=0x56157ed3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed3e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.019 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.012+0000 7fe674cd8640 1 -- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 msgr2=0x56157ed3db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed3db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe674cd8640 1 -- 172.21.15.52:0/2890991478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56157ed3f670 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe66f7fe640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe674cd8640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe668010600 tx=0x7fe66801e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667f62fcd07b83de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66802d030 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe664003790 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe668023040 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe668037030 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe6794d5740 10 client.18762 fetch_fsmap learned FSMap version 24 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56157edaf940 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe664003790 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe668029af0 con 0x56157ed34780 2024-09-19T09:30:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.013+0000 7fe6794d5740 10 client.18762 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe6794d5740 10 client.18762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe6794d5740 20 client.18762 populate_metadata read hostname 'smithi052' 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157edafef0 0x56157edb22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe6794d5740 4 client.18762 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56157ec95d70 con 0x56157edafef0 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157edafef0 0x56157edb22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe66ffff640 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157edafef0 0x56157edb22e0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863496a0b44a0119 server_cookie=afb7ef7d6abb3436 in_seq=0 out_seq=0 2024-09-19T09:30:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.014+0000 7fe64f7fe640 10 client.18762 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe64f7fe640 1 -- 172.21.15.52:0/2890991478 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56157ec95d70 con 0x56157edafef0 2024-09-19T09:30:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe64f7fe640 10 client.18762 handle_command_reply: tid=0 2024-09-19T09:30:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 client.18762 shutdown 2024-09-19T09:30:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 msgr2=0x56157ed3f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fe668010600 tx=0x7fe66801e630 comp rx=0 tx=0).stop 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 shutdown_connections 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56157edafef0 0x56157edb22e0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56157ed34780 0x56157ed3f060 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56157ed2f6f0 0x56157ed3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 --2- 172.21.15.52:0/2890991478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56157ed2edb0 0x56157ed3db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe64f7fe640 0 client.18762 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 >> 172.21.15.52:0/2890991478 conn(0x56157ed26010 msgr2=0x56157ed251c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 shutdown_connections 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 1 -- 172.21.15.52:0/2890991478 wait complete. 2024-09-19T09:30:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.026+0000 7fe6794d5740 20 client.18762 trim_cache size 0 max 16384 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 msgr2=0x7fe6580a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.030 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 0x7fe6580a57b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe66801d000 tx=0x7fe66801b000 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 msgr2=0x7fe670197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fe660031610 tx=0x7fe6600043b0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 shutdown_connections 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6580a32f0 0x7fe6580a57b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe670103710 0x7fe67019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe670102d50 0x7fe6701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 --2- 172.21.15.52:0/2399761076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe670101b60 0x7fe670197e60 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 >> 172.21.15.52:0/2399761076 conn(0x7fe6700fd2e0 msgr2=0x7fe6701060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 shutdown_connections 2024-09-19T09:30:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:30:59.027+0000 7fe67673b640 1 -- 172.21.15.52:0/2399761076 wait complete. 2024-09-19T09:31:00.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:00 smithi052 ceph-mon[30947]: pgmap v625: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 11 op/s 2024-09-19T09:31:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:00 smithi169 ceph-mon[35454]: pgmap v625: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 11 op/s 2024-09-19T09:31:01.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:00 smithi086 ceph-mon[34813]: pgmap v625: 97 pgs: 97 active+clean; 937 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 KiB/s wr, 11 op/s 2024-09-19T09:31:02.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:02 smithi052 ceph-mon[30947]: pgmap v626: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T09:31:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:02 smithi169 ceph-mon[35454]: pgmap v626: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T09:31:03.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:02 smithi086 ceph-mon[34813]: pgmap v626: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 12 op/s 2024-09-19T09:31:04.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:04 smithi052 ceph-mon[30947]: pgmap v627: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-09-19T09:31:04.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:04 smithi169 ceph-mon[35454]: pgmap v627: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-09-19T09:31:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:04 smithi086 ceph-mon[34813]: pgmap v627: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-09-19T09:31:06.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:06 smithi052 ceph-mon[30947]: pgmap v628: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-19T09:31:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:06 smithi169 ceph-mon[35454]: pgmap v628: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-19T09:31:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:06 smithi086 ceph-mon[34813]: pgmap v628: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-19T09:31:08.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:08 smithi052 ceph-mon[30947]: pgmap v629: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-09-19T09:31:08.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:08 smithi169 ceph-mon[35454]: pgmap v629: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-09-19T09:31:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:08 smithi086 ceph-mon[34813]: pgmap v629: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-09-19T09:31:10.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:10 smithi052 ceph-mon[30947]: pgmap v630: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:31:10.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:10 smithi169 ceph-mon[35454]: pgmap v630: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:31:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:10 smithi086 ceph-mon[34813]: pgmap v630: 97 pgs: 97 active+clean; 948 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-19T09:31:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 -- 172.21.15.52:0/3904467905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 msgr2=0x7f1a701020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 --2- 172.21.15.52:0/3904467905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701020b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009900 tx=0x7f1a6402a410 comp rx=0 tx=0).stop 2024-09-19T09:31:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 -- 172.21.15.52:0/3904467905 shutdown_connections 2024-09-19T09:31:12.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 --2- 172.21.15.52:0/3904467905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 0x7f1a70108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 --2- 172.21.15.52:0/3904467905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701020b0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 --2- 172.21.15.52:0/3904467905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 0x7f1a70100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 -- 172.21.15.52:0/3904467905 >> 172.21.15.52:0/3904467905 conn(0x7f1a700fc1e0 msgr2=0x7f1a700fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 -- 172.21.15.52:0/3904467905 shutdown_connections 2024-09-19T09:31:12.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.128+0000 7f1a74add640 1 -- 172.21.15.52:0/3904467905 wait complete. 2024-09-19T09:31:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 Processor -- start 2024-09-19T09:31:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 -- start start 2024-09-19T09:31:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 0x7f1a70196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 0x7f1a7019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010c710 con 0x7f1a70101c30 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010c590 con 0x7f1a70100a40 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a74add640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7010c890 con 0x7f1a701025f0 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54776/0 (socket says 172.21.15.52:54776) 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.129+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/719987056 learned_addr learned my addr 172.21.15.52:0/719987056 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 0x7f1a70196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 0x7f1a7019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/719987056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 msgr2=0x7f1a7019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 0x7f1a7019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/719987056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 msgr2=0x7f1a70196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 0x7f1a70196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/719987056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70069920 con 0x7f1a70101c30 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1a64031440 tx=0x7f1a64032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a5f7fe640 1 -- 172.21.15.52:0/719987056 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6403f030 con 0x7f1a70101c30 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a5f7fe640 1 -- 172.21.15.52:0/719987056 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a64003ce0 con 0x7f1a70101c30 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a70069bb0 con 0x7f1a70101c30 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a5f7fe640 1 -- 172.21.15.52:0/719987056 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64035070 con 0x7f1a70101c30 2024-09-19T09:31:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.130+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7006a0f0 con 0x7f1a70101c30 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.133+0000 7f1a5f7fe640 1 -- 172.21.15.52:0/719987056 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a64042030 con 0x7f1a70101c30 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.133+0000 7f1a7787b740 1 Processor -- start 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.133+0000 7f1a7787b740 1 -- start start 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4932e0 0x55d51d497da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d49a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d51d3f62f0 con 0x55d51d4929a0 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d51d39e270 con 0x55d51d498370 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a7787b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d51d3f22b0 con 0x55d51d4932e0 2024-09-19T09:31:12.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54784/0 (socket says 172.21.15.52:54784) 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/2745401859 learned_addr learned my addr 172.21.15.52:0/2745401859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a5f7fe640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 0x7f1a580a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4932e0 0x55d51d497da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d49a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/2745401859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4932e0 msgr2=0x55d51d497da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4932e0 0x55d51d497da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/2745401859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 msgr2=0x55d51d49a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d49a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/2745401859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d51d39d340 con 0x55d51d4929a0 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d49a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 0x7f1a580a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.134+0000 7f1a5f7fe640 1 -- 172.21.15.52:0/719987056 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1a640efef0 con 0x7f1a70101c30 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1a68010510 tx=0x7f1a68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd8dfbe8f308111 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a5cff9640 1 -- 172.21.15.52:0/2745401859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68023070 con 0x55d51d4929a0 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a5cff9640 1 -- 172.21.15.52:0/2745401859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a680134c0 con 0x55d51d4929a0 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a5cff9640 1 -- 172.21.15.52:0/2745401859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680118e0 con 0x55d51d4929a0 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a7787b740 1 -- 172.21.15.52:0/2745401859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 msgr2=0x55d51d492da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1a68010510 tx=0x7f1a68009f90 comp rx=0 tx=0).stop 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.135+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 0x7f1a580a5830 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1a68020000 tx=0x7f1a6801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- 172.21.15.52:0/2745401859 shutdown_connections 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d49a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4932e0 0x55d51d497da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2745401859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4929a0 0x55d51d492da0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- 172.21.15.52:0/2745401859 >> 172.21.15.52:0/2745401859 conn(0x55d51d48e010 msgr2=0x55d51d48e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- 172.21.15.52:0/2745401859 shutdown_connections 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- 172.21.15.52:0/2745401859 wait complete. 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- start start 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 Processor -- start 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d49cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d4a4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d51d49b340 con 0x55d51d4932e0 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d51d37f290 con 0x55d51d498370 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d51d49b4c0 con 0x55d51d4929a0 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a7787b740 10 client.0 _ll_register_callbacks cb 0x55d51d3b0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.136+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54798/0 (socket says 172.21.15.52:54798) 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/2056692800 learned_addr learned my addr 172.21.15.52:0/2056692800 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d49cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/2056692800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 msgr2=0x55d51d49cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d4a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d49cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 msgr2=0x55d51d4a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d4a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/2056692800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d51d109210 con 0x55d51d4932e0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d4a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1a640b8f10 tx=0x7f1a640b81e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f910b09b8ae0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64049070 con 0x55d51d4932e0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1a64003800 con 0x55d51d4932e0 2024-09-19T09:31:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a680134c0 con 0x55d51d4932e0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1a6409c050 con 0x55d51d4932e0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a7787b740 10 client.18774 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d51d1d5620 con 0x55d51d4932e0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.137+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a680134c0 con 0x55d51d4932e0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1a640bc7a0 con 0x55d51d4932e0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 10 client.18774 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 10 client.18774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 20 client.18774 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d4a86c0 0x55d51d4aab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 4 client.18774 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d51d403a20 con 0x55d51d4a86c0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.138+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d4a86c0 0x55d51d4aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.139+0000 7f1a55ffb640 10 client.18774 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.139+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d4a86c0 0x55d51d4aab10 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20bd40f7cef412ec server_cookie=d304a9cee2416bc7 in_seq=0 out_seq=0 2024-09-19T09:31:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a55ffb640 1 -- 172.21.15.52:0/2056692800 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d51d403a20 con 0x55d51d4a86c0 2024-09-19T09:31:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a55ffb640 10 client.18774 handle_command_reply: tid=0 2024-09-19T09:31:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 client.18774 shutdown 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 msgr2=0x55d51d49d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1a640b8f10 tx=0x7f1a640b81e0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 shutdown_connections 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d4a86c0 0x55d51d4aab10 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d498370 0x55d51d4a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d49d110 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 --2- 172.21.15.52:0/2056692800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d49cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a55ffb640 0 client.18774 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 >> 172.21.15.52:0/2056692800 conn(0x55d51d48e010 msgr2=0x55d51d48f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 shutdown_connections 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 1 -- 172.21.15.52:0/2056692800 wait complete. 2024-09-19T09:31:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.140+0000 7f1a7787b740 20 client.18774 trim_cache size 0 max 16384 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 Processor -- start 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 -- start start 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4929a0 0x55d51d48d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 0x55d51d4af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701aba40 con 0x55d51d4932e0 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701a9310 con 0x55d51d4929a0 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a7787b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701a7160 con 0x55d51d498370 2024-09-19T09:31:12.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54802/0 (socket says 172.21.15.52:54802) 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/3292927955 learned_addr learned my addr 172.21.15.52:0/3292927955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4929a0 0x55d51d48d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 0x55d51d4af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/3292927955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 msgr2=0x55d51d4af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 0x55d51d4af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/3292927955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4929a0 msgr2=0x55d51d48d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4929a0 0x55d51d48d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6dd9b640 1 -- 172.21.15.52:0/3292927955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d51d48de30 con 0x55d51d4932e0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.155+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 0x55d51d4af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1a64043040 tx=0x7f1a6402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37855a3ac9b9024e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a57fff640 1 -- 172.21.15.52:0/3292927955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64049070 con 0x55d51d4932e0 2024-09-19T09:31:12.161 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a57fff640 1 -- 172.21.15.52:0/3292927955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a640c0840 con 0x55d51d4932e0 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a57fff640 1 -- 172.21.15.52:0/3292927955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a640bc7a0 con 0x55d51d4932e0 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a7787b740 1 -- 172.21.15.52:0/3292927955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 msgr2=0x55d51d4a4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.156+0000 7f1a7787b740 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f1a64043040 tx=0x7f1a6402a410 comp rx=0 tx=0).stop 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- 172.21.15.52:0/3292927955 shutdown_connections 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d498370 0x55d51d4af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d4932e0 0x55d51d4a4110 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- 172.21.15.52:0/3292927955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4929a0 0x55d51d48d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- 172.21.15.52:0/3292927955 >> 172.21.15.52:0/3292927955 conn(0x55d51d48e010 msgr2=0x55d51d48c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- 172.21.15.52:0/3292927955 shutdown_connections 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- 172.21.15.52:0/3292927955 wait complete. 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- start start 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 Processor -- start 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d4a1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.162 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4932e0 0x55d51d4a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701a77d0 con 0x55d51d498370 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701a8c40 con 0x55d51d4932e0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1a701a7ea0 con 0x55d51d4929a0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a7787b740 10 client.0 _ll_register_callbacks cb 0x7f1a640b88b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54812/0 (socket says 172.21.15.52:54812) 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/768722487 learned_addr learned my addr 172.21.15.52:0/768722487 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d4a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.157+0000 7f1a6dd9b640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4932e0 0x55d51d4a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/768722487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 msgr2=0x55d51d4a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d4a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4932e0 msgr2=0x55d51d4a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4932e0 0x55d51d4a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 -- 172.21.15.52:0/768722487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d51d4a34c0 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a6ed9d640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009770 tx=0x7f1a680136f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6172dc0df1d0309a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a55ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68023040 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1a68003b80 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a640c0840 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1a68003d80 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a7787b740 10 client.18780 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d51d513500 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.158+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a640c0840 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1a6800f040 con 0x55d51d498370 2024-09-19T09:31:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 10 client.18780 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 10 client.18780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 20 client.18780 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d513d10 0x55d51d516130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 4 client.18780 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d51d3fdd70 con 0x55d51d513d10 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d513d10 0x55d51d516130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a55ffb640 10 client.18780 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.159+0000 7f1a6e59c640 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d513d10 0x55d51d516130 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d947b8de826b739 server_cookie=70cb1b28899fdfb in_seq=0 out_seq=0 2024-09-19T09:31:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a55ffb640 1 -- 172.21.15.52:0/768722487 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d51d3fdd70 con 0x55d51d513d10 2024-09-19T09:31:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a55ffb640 10 client.18780 handle_command_reply: tid=0 2024-09-19T09:31:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 client.18780 shutdown 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 msgr2=0x55d51d4a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009770 tx=0x7f1a680136f0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 shutdown_connections 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d51d513d10 0x55d51d516130 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d51d498370 0x55d51d4a2eb0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d51d4932e0 0x55d51d4a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a55ffb640 0 client.18780 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 --2- 172.21.15.52:0/768722487 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d51d4929a0 0x55d51d4a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 >> 172.21.15.52:0/768722487 conn(0x55d51d48e010 msgr2=0x55d51d48d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 shutdown_connections 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 1 -- 172.21.15.52:0/768722487 wait complete. 2024-09-19T09:31:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.169+0000 7f1a7787b740 20 client.18780 trim_cache size 0 max 16384 2024-09-19T09:31:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:31:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:31:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:31:12.172 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 msgr2=0x7f1a580a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 0x7f1a580a5830 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1a68020000 tx=0x7f1a6801b000 comp rx=0 tx=0).stop 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 msgr2=0x7f1a701971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1a64031440 tx=0x7f1a64032e20 comp rx=0 tx=0).stop 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 shutdown_connections 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1a580a3370 0x7f1a580a5830 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1a701025f0 0x7f1a7019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a70101c30 0x7f1a701971f0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.173 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 --2- 172.21.15.52:0/719987056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a70100a40 0x7f1a70196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 >> 172.21.15.52:0/719987056 conn(0x7f1a700fc1e0 msgr2=0x7f1a70104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 shutdown_connections 2024-09-19T09:31:12.174 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:12.170+0000 7f1a74add640 1 -- 172.21.15.52:0/719987056 wait complete. 2024-09-19T09:31:12.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:12 smithi052 ceph-mon[30947]: pgmap v631: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:31:12.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:12 smithi169 ceph-mon[35454]: pgmap v631: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:31:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:12 smithi086 ceph-mon[34813]: pgmap v631: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:31:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:14 smithi052 ceph-mon[30947]: pgmap v632: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:31:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:14 smithi169 ceph-mon[35454]: pgmap v632: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:31:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:14 smithi086 ceph-mon[34813]: pgmap v632: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T09:31:16.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:16 smithi052 ceph-mon[30947]: pgmap v633: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:31:16.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:16 smithi169 ceph-mon[35454]: pgmap v633: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:31:17.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:16 smithi086 ceph-mon[34813]: pgmap v633: 97 pgs: 97 active+clean; 951 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T09:31:17.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:18.006 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- 172.21.15.52:0/3161456242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100e10 msgr2=0x7f7090104e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 --2- 172.21.15.52:0/3161456242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100e10 0x7f7090104e60 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f7084009900 tx=0x7f708402a410 comp rx=0 tx=0).stop 2024-09-19T09:31:18.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- 172.21.15.52:0/3161456242 shutdown_connections 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 --2- 172.21.15.52:0/3161456242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7090105590 0x7f709010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 --2- 172.21.15.52:0/3161456242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100e10 0x7f7090104e60 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 --2- 172.21.15.52:0/3161456242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090100460 0x7f7090100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- 172.21.15.52:0/3161456242 >> 172.21.15.52:0/3161456242 conn(0x7f70900fbee0 msgr2=0x7f70900fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- 172.21.15.52:0/3161456242 shutdown_connections 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- 172.21.15.52:0/3161456242 wait complete. 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 Processor -- start 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.465+0000 7f7096350640 1 -- start start 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7090100e10 0x7f7090198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090105590 0x7f709019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7090111f90 con 0x7f7090100460 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7090111e10 con 0x7f7090105590 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f7096350640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7090112110 con 0x7f7090100e10 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36418/0 (socket says 172.21.15.52:36418) 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 -- 172.21.15.52:0/589795802 learned_addr learned my addr 172.21.15.52:0/589795802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f70948ed640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090105590 0x7f709019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 -- 172.21.15.52:0/589795802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7090100e10 msgr2=0x7f7090198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7090100e10 0x7f7090198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 -- 172.21.15.52:0/589795802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090105590 msgr2=0x7f709019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090105590 0x7f709019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.466+0000 7f708ffff640 1 -- 172.21.15.52:0/589795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709019d3c0 con 0x7f7090100460 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f708ffff640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f708000c920 tx=0x7f708000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:18.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080007c70 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7080007e10 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709019d6b0 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080018890 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.467+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70901a4f90 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.468+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7090100840 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.469+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7080018a50 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.470+0000 7f708d7fa640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 0x7f70780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.470+0000 7f708f7fe640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 0x7f70780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.470+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f70800cfd80 con 0x7f7090100460 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.470+0000 7f708f7fe640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 0x7f70780a5780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f708402a930 tx=0x7f7084000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:18.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.473+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7080014030 con 0x7f7090100460 2024-09-19T09:31:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:18 smithi052 ceph-mon[30947]: pgmap v634: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:31:18.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.687+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7090199770 con 0x7f7090100460 2024-09-19T09:31:18.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.688+0000 7f708d7fa640 1 -- 172.21.15.52:0/589795802 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f7090199770 con 0x7f7090100460 2024-09-19T09:31:18.689 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:18.689 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:18.690 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 msgr2=0x7f70780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 0x7f70780a5780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f708402a930 tx=0x7f7084000bc0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 msgr2=0x7f7090198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f708000c920 tx=0x7f708000cde0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 shutdown_connections 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7090105590 0x7f709019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70780a32c0 0x7f70780a5780 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7090100e10 0x7f7090198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 --2- 172.21.15.52:0/589795802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7090100460 0x7f7090198410 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:18.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 >> 172.21.15.52:0/589795802 conn(0x7f70900fbee0 msgr2=0x7f70900fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:18.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 shutdown_connections 2024-09-19T09:31:18.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:18.690+0000 7f7096350640 1 -- 172.21.15.52:0/589795802 wait complete. 2024-09-19T09:31:18.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:18 smithi169 ceph-mon[35454]: pgmap v634: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:31:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:18 smithi086 ceph-mon[34813]: pgmap v634: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:31:19.395 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id 3f96d27e --release --await' 2024-09-19T09:31:19.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id 3f96d27e --release --await 2024-09-19T09:31:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:19.679 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:19 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/589795802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:19.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:19 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/589795802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:20.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:19 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/589795802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:20.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 -- 172.21.15.52:0/3052346787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c8103660 msgr2=0x7f69c810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 --2- 172.21.15.52:0/3052346787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c8103660 0x7f69c810bb50 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009900 tx=0x7f69bc02a480 comp rx=0 tx=0).stop 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 -- 172.21.15.52:0/3052346787 shutdown_connections 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 --2- 172.21.15.52:0/3052346787 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c810c170 0x7f69c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 --2- 172.21.15.52:0/3052346787 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c8103660 0x7f69c810bb50 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 --2- 172.21.15.52:0/3052346787 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8102d40 0x7f69c8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 -- 172.21.15.52:0/3052346787 >> 172.21.15.52:0/3052346787 conn(0x7f69c80fc7a0 msgr2=0x7f69c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 -- 172.21.15.52:0/3052346787 shutdown_connections 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.106+0000 7f69cef6f640 1 -- 172.21.15.52:0/3052346787 wait complete. 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 Processor -- start 2024-09-19T09:31:20.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 -- start start 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c8102d40 0x7f69c8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8103660 0x7f69c81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8111f70 con 0x7f69c810c170 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8111df0 con 0x7f69c8103660 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cef6f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81120f0 con 0x7f69c8102d40 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cd50c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cd50c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36438/0 (socket says 172.21.15.52:36438) 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69cd50c640 1 -- 172.21.15.52:0/328290565 learned_addr learned my addr 172.21.15.52:0/328290565 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69c7fff640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8103660 0x7f69c81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.107+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c8102d40 0x7f69c8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 -- 172.21.15.52:0/328290565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c8102d40 msgr2=0x7f69c8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c8102d40 0x7f69c8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 -- 172.21.15.52:0/328290565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8103660 msgr2=0x7f69c81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8103660 0x7f69c81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 -- 172.21.15.52:0/328290565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c819d420 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cd50c640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f69c000eaa0 tx=0x7f69c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69c5ffb640 1 -- 172.21.15.52:0/328290565 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c000cdb0 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c819d710 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69c5ffb640 1 -- 172.21.15.52:0/328290565 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69c0005020 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69c5ffb640 1 -- 172.21.15.52:0/328290565 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c00116d0 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.108+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c81a4ff0 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.110+0000 7f69c5ffb640 1 -- 172.21.15.52:0/328290565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f69c00054d0 con 0x7f69c810c170 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 Processor -- start 2024-09-19T09:31:20.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 -- start start 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f060 0x564aaff9f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 0x564aaffa9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564aaff04620 con 0x564aaffaa240 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564aafeabe50 con 0x564aaff9f980 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.111+0000 7f69d1348740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564aaff005e0 con 0x564aaff9f060 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c5ffb640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36446/0 (socket says 172.21.15.52:36446) 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c7fff640 1 -- 172.21.15.52:0/1199805804 learned_addr learned my addr 172.21.15.52:0/1199805804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 0x564aaffa9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c7fff640 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f060 0x564aaff9f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69cd50c640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 -- 172.21.15.52:0/1199805804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f060 msgr2=0x564aaff9f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f060 0x564aaff9f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 -- 172.21.15.52:0/1199805804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 msgr2=0x564aaffac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 -- 172.21.15.52:0/1199805804 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aafe9cd40 con 0x564aaff9f980 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69c5ffb640 1 -- 172.21.15.52:0/328290565 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69c00cfb40 con 0x7f69c810c170 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 0x564aaffa9d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fd0 tx=0x7f69b80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac6091433e69824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69cd50c640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 0x7f69b00a5700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69c001c000 tx=0x7f69c0009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69aeffd640 1 -- 172.21.15.52:0/1199805804 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b801c480 con 0x564aaff9f980 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69aeffd640 1 -- 172.21.15.52:0/1199805804 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b801cb00 con 0x564aaff9f980 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.112+0000 7f69aeffd640 1 -- 172.21.15.52:0/1199805804 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011c20 con 0x564aaff9f980 2024-09-19T09:31:20.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 -- 172.21.15.52:0/1199805804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 msgr2=0x564aaffa9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 0x564aaffa9d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69b8005fd0 tx=0x7f69b80107a0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 -- 172.21.15.52:0/1199805804 shutdown_connections 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f980 0x564aaffa9d00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 --2- 172.21.15.52:0/1199805804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f060 0x564aaff9f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 -- 172.21.15.52:0/1199805804 >> 172.21.15.52:0/1199805804 conn(0x564aaff9b5f0 msgr2=0x564aaff9b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 -- 172.21.15.52:0/1199805804 shutdown_connections 2024-09-19T09:31:20.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.113+0000 7f69d1348740 1 -- 172.21.15.52:0/1199805804 wait complete. 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 -- start start 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 Processor -- start 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffa76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564aafface10 con 0x564aaffaa240 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564aafe8cf10 con 0x564aaff9f060 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564aaffacf90 con 0x564aaff9f980 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69d1348740 10 client.0 _ll_register_callbacks cb 0x564aafeb0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36450/0 (socket says 172.21.15.52:36450) 2024-09-19T09:31:20.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69c7fff640 1 -- 172.21.15.52:0/1270623646 learned_addr learned my addr 172.21.15.52:0/1270623646 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69c7fff640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.114+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffa76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 -- 172.21.15.52:0/1270623646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 msgr2=0x564aaffa76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffa76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 -- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 msgr2=0x564aaffa7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 -- 172.21.15.52:0/1270623646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564aafc13580 con 0x564aaffaa240 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69c7fff640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005a90 tx=0x7f69bc02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9963609ab12ba6b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc035070 con 0x564aaffaa240 2024-09-19T09:31:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69bc004030 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b801cb00 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f69bc004230 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69d1348740 10 client.18798 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564aafcdd960 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.115+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b801cb00 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f69bc04a020 con 0x564aaffaa240 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 10 client.18798 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 10 client.18798 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 20 client.18798 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564aaffb9e10 0x564aaffbc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 4 client.18798 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564aaff11b90 con 0x564aaffb9e10 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564aaffb9e10 0x564aaffbc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564aaffb9e10 0x564aaffbc200 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a01e9c19f5654 server_cookie=681b1fb5f912ffa4 in_seq=0 out_seq=0 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.116+0000 7f69a7fff640 10 client.18798 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69a7fff640 1 -- 172.21.15.52:0/1270623646 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564aaff11b90 con 0x564aaffb9e10 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69a7fff640 10 client.18798 handle_command_reply: tid=0 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 client.18798 shutdown 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 msgr2=0x564aaffa7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005a90 tx=0x7f69bc02a480 comp rx=0 tx=0).stop 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 shutdown_connections 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564aaffb9e10 0x564aaffbc200 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffa7c10 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffa76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 --2- 172.21.15.52:0/1270623646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69a7fff640 0 client.18798 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.117+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 >> 172.21.15.52:0/1270623646 conn(0x564aaff9b5f0 msgr2=0x564aaffa12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.118+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 shutdown_connections 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.118+0000 7f69d1348740 1 -- 172.21.15.52:0/1270623646 wait complete. 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.118+0000 7f69d1348740 20 client.18798 trim_cache size 0 max 16384 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.134+0000 7f69d1348740 1 Processor -- start 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 -- start start 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffc1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81b01c0 con 0x564aaffaa240 2024-09-19T09:31:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ada90 con 0x564aaff9f060 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69d1348740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ab8e0 con 0x564aaff9f980 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 36, 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "3f96d27e": { 2024-09-19T09:31:20.165 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 36, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 150.0, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:20.166 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36460/0 (socket says 172.21.15.52:36460) 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 -- 172.21.15.52:0/2486017008 learned_addr learned my addr 172.21.15.52:0/2486017008 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:20.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffc1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 -- 172.21.15.52:0/2486017008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 msgr2=0x564aaffc1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffc1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 -- 172.21.15.52:0/2486017008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 msgr2=0x564aaffa7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 -- 172.21.15.52:0/2486017008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564aaff99bb0 con 0x564aaffaa240 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffc1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.135+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f69bc033000 tx=0x7f69bc031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713768c914a4e17a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69ae7fc640 1 -- 172.21.15.52:0/2486017008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc035070 con 0x564aaffaa240 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69ae7fc640 1 -- 172.21.15.52:0/2486017008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69bc0043d0 con 0x564aaffaa240 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69ae7fc640 1 -- 172.21.15.52:0/2486017008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc03d6b0 con 0x564aaffaa240 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 -- 172.21.15.52:0/2486017008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 msgr2=0x564aaffc1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f69bc033000 tx=0x7f69bc031830 comp rx=0 tx=0).stop 2024-09-19T09:31:20.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 -- 172.21.15.52:0/2486017008 shutdown_connections 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaffaa240 0x564aaffc1eb0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaff9f980 0x564aaffc1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 --2- 172.21.15.52:0/2486017008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffa7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 -- 172.21.15.52:0/2486017008 >> 172.21.15.52:0/2486017008 conn(0x564aaff9b5f0 msgr2=0x564aaffa7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 -- 172.21.15.52:0/2486017008 shutdown_connections 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.136+0000 7f69d1348740 1 -- 172.21.15.52:0/2486017008 wait complete. 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 -- start start 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 Processor -- start 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffaf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 0x564aaffafc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81abf50 con 0x564aaff9f980 2024-09-19T09:31:20.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ad3c0 con 0x564aaff9f060 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69c81ac620 con 0x564aaffaa240 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69d1348740 10 client.0 _ll_register_callbacks cb 0x7f69bc0315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69ccd0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69ccd0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36468/0 (socket says 172.21.15.52:36468) 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.137+0000 7f69ccd0b640 1 -- 172.21.15.52:0/2148587365 learned_addr learned my addr 172.21.15.52:0/2148587365 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffaf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 0x564aaffafc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 -- 172.21.15.52:0/2148587365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 msgr2=0x564aaffafc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 0x564aaffafc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 -- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 msgr2=0x564aaffaf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffaf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 -- 172.21.15.52:0/2148587365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ab0024950 con 0x564aaff9f980 2024-09-19T09:31:20.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 0x564aaffafc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69ccd0b640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x564aaff9c450 tx=0x7f69b8011780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3681fb8047a29e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8005240 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69bc0043d0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69b80053e0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f69b80055e0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69d1348740 10 client.18804 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.138+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564ab0025bb0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69bc0043d0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f69b801c7e0 con 0x564aaff9f980 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 10 client.18804 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:20.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 10 client.18804 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 20 client.18804 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564ab00260a0 0x564ab00284c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 4 client.18804 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3f96d27e", "release": true, "await": true}] 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3f96d27e", "release": true, "await": true}) -- 0x564aaff0c0a0 con 0x564ab00260a0 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564ab00260a0 0x564ab00284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69c7fff640 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564ab00260a0 0x564ab00284c0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1651332a00aa72e server_cookie=23db148a78d7779d in_seq=0 out_seq=0 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.139+0000 7f69a7fff640 10 client.18804 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.141+0000 7f69a7fff640 1 -- 172.21.15.52:0/2148587365 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564aaff0c0a0 con 0x564ab00260a0 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.141+0000 7f69a7fff640 10 client.18804 handle_command_reply: tid=0 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.141+0000 7f69d1348740 1 client.18804 shutdown 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 msgr2=0x564aaffaf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x564aaff9c450 tx=0x7f69b8011780 comp rx=0 tx=0).stop 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 shutdown_connections 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564ab00260a0 0x564ab00284c0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564aaffaa240 0x564aaffafc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564aaff9f980 0x564aaffaf6f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69a7fff640 0 client.18804 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 --2- 172.21.15.52:0/2148587365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564aaff9f060 0x564aaffaf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 >> 172.21.15.52:0/2148587365 conn(0x564aaff9b5f0 msgr2=0x564aaffa9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 shutdown_connections 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 1 -- 172.21.15.52:0/2148587365 wait complete. 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69d1348740 20 client.18804 trim_cache size 0 max 16384 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 msgr2=0x7f69b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 0x7f69b00a5700 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69c001c000 tx=0x7f69c0009270 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 msgr2=0x7f69c819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f69c000eaa0 tx=0x7f69c000ef60 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 shutdown_connections 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69c810c170 0x7f69c819cd40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69c8103660 0x7f69c81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69b00a3240 0x7f69b00a5700 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.142+0000 7f69cef6f640 1 --2- 172.21.15.52:0/328290565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69c8102d40 0x7f69c8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.143+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 >> 172.21.15.52:0/328290565 conn(0x7f69c80fc7a0 msgr2=0x7f69c80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.143+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 shutdown_connections 2024-09-19T09:31:20.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:20.143+0000 7f69cef6f640 1 -- 172.21.15.52:0/328290565 wait complete. 2024-09-19T09:31:20.907 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:20 smithi052 ceph-mon[30947]: pgmap v635: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:31:20.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:20 smithi169 ceph-mon[35454]: pgmap v635: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:31:20.943 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3f96d27e', total seconds elapsed: 33.2 2024-09-19T09:31:20.943 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:31:20.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:21.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:20 smithi086 ceph-mon[34813]: pgmap v635: 97 pgs: 97 active+clean; 957 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:31:21.210 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 -- 172.21.15.52:0/301120942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c081036c0 msgr2=0x7f0c0810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 --2- 172.21.15.52:0/301120942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c081036c0 0x7f0c0810bbb0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009900 tx=0x7f0bf802a480 comp rx=0 tx=0).stop 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 -- 172.21.15.52:0/301120942 shutdown_connections 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 --2- 172.21.15.52:0/301120942 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c0810c180 0x7f0c0810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 --2- 172.21.15.52:0/301120942 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c081036c0 0x7f0c0810bbb0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 --2- 172.21.15.52:0/301120942 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 0x7f0c08103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 -- 172.21.15.52:0/301120942 >> 172.21.15.52:0/301120942 conn(0x7f0c080fc780 msgr2=0x7f0c080feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 -- 172.21.15.52:0/301120942 shutdown_connections 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 -- 172.21.15.52:0/301120942 wait complete. 2024-09-19T09:31:21.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.666+0000 7f0c0febf640 1 Processor -- start 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 -- start start 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 0x7f0c081983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c081036c0 0x7f0c08198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0c08111f50 con 0x7f0c0810c180 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c08111dd0 con 0x7f0c081036c0 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0febf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c081120d0 con 0x7f0c08102da0 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36492/0 (socket says 172.21.15.52:36492) 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 -- 172.21.15.52:0/3530412861 learned_addr learned my addr 172.21.15.52:0/3530412861 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0dc5b640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 0x7f0c081983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0d45a640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c081036c0 0x7f0c08198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 -- 172.21.15.52:0/3530412861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 msgr2=0x7f0c081983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:21.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 0x7f0c081983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 -- 172.21.15.52:0/3530412861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c081036c0 msgr2=0x7f0c08198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c081036c0 0x7f0c08198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.667+0000 7f0c0e45c640 1 -- 172.21.15.52:0/3530412861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0819d370 con 0x7f0c0810c180 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0c0e45c640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000eaa0 tx=0x7f0c0000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00004d20 con 0x7f0c0810c180 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c00005020 con 0x7f0c0810c180 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0819d660 con 0x7f0c0810c180 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c000116d0 con 0x7f0c0810c180 2024-09-19T09:31:21.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.668+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c081a4f40 con 0x7f0c0810c180 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.669+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c08103180 con 0x7f0c0810c180 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.670+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c000051d0 con 0x7f0c0810c180 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.671+0000 7f0bfeffd640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 0x7f0bf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.671+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0c000cff20 con 0x7f0c0810c180 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.671+0000 7f0c0dc5b640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 0x7f0bf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:21.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.671+0000 7f0c0dc5b640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 0x7f0bf40a5700 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400abe0 tx=0x7f0c0400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:21.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.674+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c00016030 con 0x7f0c0810c180 2024-09-19T09:31:21.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.885+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c08199720 con 0x7f0c0810c180 2024-09-19T09:31:21.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.886+0000 7f0bfeffd640 1 -- 172.21.15.52:0/3530412861 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f0c08199720 con 0x7f0c0810c180 2024-09-19T09:31:21.887 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:21.888 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:21.888 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 msgr2=0x7f0bf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 0x7f0bf40a5700 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400abe0 tx=0x7f0c0400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 msgr2=0x7f0c0819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000eaa0 tx=0x7f0c0000eea0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 shutdown_connections 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c0810c180 0x7f0c0819cc90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c081036c0 0x7f0c08198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0bf40a3240 0x7f0bf40a5700 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 --2- 172.21.15.52:0/3530412861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c08102da0 0x7f0c081983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 >> 172.21.15.52:0/3530412861 conn(0x7f0c080fc780 msgr2=0x7f0c080fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 shutdown_connections 2024-09-19T09:31:21.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:21.888+0000 7f0c0febf640 1 -- 172.21.15.52:0/3530412861 wait complete. 2024-09-19T09:31:22.638 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:22 smithi052 ceph-mon[30947]: pgmap v636: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:31:22.638 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3530412861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:22.640 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:31:22.640 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:31:22.903 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:22.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:22 smithi169 ceph-mon[35454]: pgmap v636: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:31:22.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3530412861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:23.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:22 smithi086 ceph-mon[34813]: pgmap v636: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-19T09:31:23.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3530412861' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 -- 172.21.15.52:0/3764439218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef9410c170 msgr2=0x7fef9410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/3764439218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef9410c170 0x7fef9410e610 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009ca0 tx=0x7fef8c02a950 comp rx=0 tx=0).stop 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 -- 172.21.15.52:0/3764439218 shutdown_connections 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/3764439218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef9410c170 0x7fef9410e610 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/3764439218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef94103660 0x7fef9410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/3764439218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef94103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 -- 172.21.15.52:0/3764439218 >> 172.21.15.52:0/3764439218 conn(0x7fef940fc7a0 msgr2=0x7fef940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 -- 172.21.15.52:0/3764439218 shutdown_connections 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.377+0000 7fef9c4ef640 1 -- 172.21.15.52:0/3764439218 wait complete. 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 Processor -- start 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 -- start start 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef941009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 0x7fef94101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef94111f70 con 0x7fef94103660 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef94111df0 con 0x7fef9410c170 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9c4ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef941120f0 con 0x7fef94102d40 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef99a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef99a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36514/0 (socket says 172.21.15.52:36514) 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef99a8a640 1 -- 172.21.15.52:0/382440297 learned_addr learned my addr 172.21.15.52:0/382440297 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.378+0000 7fef9a28b640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef941009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 0x7fef94101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 -- 172.21.15.52:0/382440297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 msgr2=0x7fef941009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef941009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 -- 172.21.15.52:0/382440297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 msgr2=0x7fef94101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 0x7fef94101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 -- 172.21.15.52:0/382440297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef941a68b0 con 0x7fef94103660 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 0x7fef94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef9a28b640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef941009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:23.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef99a8a640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c970 tx=0x7fef8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef8b7fe640 1 -- 172.21.15.52:0/382440297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84007bb0 con 0x7fef94103660 2024-09-19T09:31:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef8b7fe640 1 -- 172.21.15.52:0/382440297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef84007d50 con 0x7fef94103660 2024-09-19T09:31:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef8b7fe640 1 -- 172.21.15.52:0/382440297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84018820 con 0x7fef94103660 2024-09-19T09:31:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef941a6ba0 con 0x7fef94103660 2024-09-19T09:31:23.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.379+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef941a70e0 con 0x7fef94103660 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef8b7fe640 1 -- 172.21.15.52:0/382440297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef840189c0 con 0x7fef94103660 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 Processor -- start 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 -- start start 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 0x55b159bcd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b159b282a0 con 0x55b159bc2760 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b159acfb10 con 0x55b159bcd940 2024-09-19T09:31:23.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b159b24260 con 0x55b159bc3080 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9aa8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9aa8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36520/0 (socket says 172.21.15.52:36520) 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef9aa8c640 1 -- 172.21.15.52:0/3582808882 learned_addr learned my addr 172.21.15.52:0/3582808882 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.382+0000 7fef99a8a640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef8b7fe640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 0x7fef800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9a28b640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 0x55b159bcd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 -- 172.21.15.52:0/3582808882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 msgr2=0x55b159bcd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 0x55b159bcd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 -- 172.21.15.52:0/3582808882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 msgr2=0x55b159bcfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 -- 172.21.15.52:0/3582808882 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159899b90 con 0x55b159bc2760 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9a28b640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 0x55b159bcd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef8b7fe640 1 -- 172.21.15.52:0/382440297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef840cfab0 con 0x7fef94103660 2024-09-19T09:31:23.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 0x7fef800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fef8c02fa90 tx=0x7fef8c02fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c845ba5b96053d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef88ff9640 1 -- 172.21.15.52:0/3582808882 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c041040 con 0x55b159bc2760 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef88ff9640 1 -- 172.21.15.52:0/3582808882 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8c004520 con 0x55b159bc2760 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.383+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 0x7fef800a5700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fef8c04c000 tx=0x7fef8c04d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef88ff9640 1 -- 172.21.15.52:0/3582808882 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c034040 con 0x55b159bc2760 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3582808882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 msgr2=0x55b159bc2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fef8c02fa90 tx=0x7fef8c02fac0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3582808882 shutdown_connections 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc3080 0x55b159bcd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3582808882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc2b40 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3582808882 >> 172.21.15.52:0/3582808882 conn(0x55b159bbecf0 msgr2=0x55b159bbf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3582808882 shutdown_connections 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.384+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3582808882 wait complete. 2024-09-19T09:31:23.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 -- start start 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 Processor -- start 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc2760 0x55b159bca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b159bd0560 con 0x55b159bc3080 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b159ab06e0 con 0x55b159bcd940 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b159bd06e0 con 0x55b159bc2760 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9e8c8740 10 client.0 _ll_register_callbacks cb 0x55b159ad4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36526/0 (socket says 172.21.15.52:36526) 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 -- 172.21.15.52:0/3440256369 learned_addr learned my addr 172.21.15.52:0/3440256369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef9a28b640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc2760 0x55b159bca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 -- 172.21.15.52:0/3440256369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc2760 msgr2=0x55b159bca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc2760 0x55b159bca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 -- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 msgr2=0x55b159bcb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.385+0000 7fef99a8a640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef99a8a640 1 -- 172.21.15.52:0/3440256369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b159bd9a30 con 0x55b159bc3080 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef99a8a640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fef84098450 tx=0x7fef8400a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49d8c6a34689147 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8409c6f0 con 0x55b159bc3080 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef8400fac0 con 0x55b159bc3080 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8c004520 con 0x55b159bc3080 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef840bc0b0 con 0x55b159bc3080 2024-09-19T09:31:23.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef9e8c8740 10 client.18822 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b159bdc400 con 0x55b159bc3080 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8c004520 con 0x55b159bc3080 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef840a47d0 con 0x55b159bc3080 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef9e8c8740 10 client.18822 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.386+0000 7fef9e8c8740 10 client.18822 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9e8c8740 20 client.18822 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159bdd8c0 0x55b159bdfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9e8c8740 4 client.18822 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b159b359d0 con 0x55b159bdd8c0 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9a28b640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159bdd8c0 0x55b159bdfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef7dffb640 10 client.18822 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.387+0000 7fef9a28b640 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159bdd8c0 0x55b159bdfcf0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54880a398c8fbe6d server_cookie=715267476cad2da7 in_seq=0 out_seq=0 2024-09-19T09:31:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef7dffb640 1 -- 172.21.15.52:0/3440256369 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b159b359d0 con 0x55b159bdd8c0 2024-09-19T09:31:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef7dffb640 10 client.18822 handle_command_reply: tid=0 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 client.18822 shutdown 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 msgr2=0x55b159bcad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fef84098450 tx=0x7fef8400a580 comp rx=0 tx=0).stop 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 shutdown_connections 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159bdd8c0 0x55b159bdfcf0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bcd940 0x55b159bcb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc3080 0x55b159bcad10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/3440256369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bc2760 0x55b159bca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef7dffb640 0 client.18822 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 >> 172.21.15.52:0/3440256369 conn(0x55b159bbecf0 msgr2=0x55b159bbde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 shutdown_connections 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 1 -- 172.21.15.52:0/3440256369 wait complete. 2024-09-19T09:31:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.388+0000 7fef9e8c8740 20 client.18822 trim_cache size 0 max 16384 2024-09-19T09:31:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 Processor -- start 2024-09-19T09:31:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 -- start start 2024-09-19T09:31:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159bcc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bc48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef941b21a0 con 0x55b159bc2760 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef941afa70 con 0x55b159bc3080 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef941ad8c0 con 0x55b159bcd940 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36538/0 (socket says 172.21.15.52:36538) 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 -- 172.21.15.52:0/1806700830 learned_addr learned my addr 172.21.15.52:0/1806700830 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 -- 172.21.15.52:0/1806700830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 msgr2=0x55b159bc48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bc48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 -- 172.21.15.52:0/1806700830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 msgr2=0x55b159bcc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159bcc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 -- 172.21.15.52:0/1806700830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159bbeb20 con 0x55b159bc2760 2024-09-19T09:31:23.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.406+0000 7fef9a28b640 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x55b159be04e0 tx=0x7fef9000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f2676078fa974f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef7ffff640 1 -- 172.21.15.52:0/1806700830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9001f030 con 0x55b159bc2760 2024-09-19T09:31:23.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef7ffff640 1 -- 172.21.15.52:0/1806700830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef90005500 con 0x55b159bc2760 2024-09-19T09:31:23.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef7ffff640 1 -- 172.21.15.52:0/1806700830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9001b600 con 0x55b159bc2760 2024-09-19T09:31:23.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 -- 172.21.15.52:0/1806700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 msgr2=0x55b159bc9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x55b159be04e0 tx=0x7fef9000a620 comp rx=0 tx=0).stop 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 -- 172.21.15.52:0/1806700830 shutdown_connections 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bc48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159bcc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/1806700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159bc9af0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 -- 172.21.15.52:0/1806700830 >> 172.21.15.52:0/1806700830 conn(0x55b159bbecf0 msgr2=0x55b159bc41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 -- 172.21.15.52:0/1806700830 shutdown_connections 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.407+0000 7fef9e8c8740 1 -- 172.21.15.52:0/1806700830 wait complete. 2024-09-19T09:31:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 -- start start 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 Processor -- start 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159c41da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bd1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef941adf30 con 0x55b159bc2760 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fef941af3a0 con 0x55b159bc3080 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef941ae600 con 0x55b159bcd940 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9e8c8740 10 client.0 _ll_register_callbacks cb 0x7fef8400a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36542/0 (socket says 172.21.15.52:36542) 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 -- 172.21.15.52:0/2228797310 learned_addr learned my addr 172.21.15.52:0/2228797310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef99a8a640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159c41da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9aa8c640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bd1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 -- 172.21.15.52:0/2228797310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 msgr2=0x55b159bd1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bd1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 -- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 msgr2=0x55b159c41da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159c41da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.408+0000 7fef9a28b640 1 -- 172.21.15.52:0/2228797310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b159bba260 con 0x55b159bc2760 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef99a8a640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159c41da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9a28b640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fef9001d000 tx=0x7fef90004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e01350feab60cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90029070 con 0x55b159bc2760 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fef90005200 con 0x55b159bc2760 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef90005500 con 0x55b159bc2760 2024-09-19T09:31:23.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef90035050 con 0x55b159bc2760 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 10 client.18828 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b159c48e00 con 0x55b159bc2760 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef90005500 con 0x55b159bc2760 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fef90025610 con 0x55b159bc2760 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 10 client.18828 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 10 client.18828 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.409+0000 7fef9e8c8740 20 client.18828 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159c494b0 0x55b159c4b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef9e8c8740 4 client.18828 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55b159b2fd20 con 0x55b159c494b0 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef99a8a640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159c494b0 0x55b159c4b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:23.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef7dffb640 10 client.18828 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:23.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.410+0000 7fef99a8a640 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159c494b0 0x55b159c4b8d0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8459abca24d659b1 server_cookie=97c5b00408395461 in_seq=0 out_seq=0 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.420+0000 7fef7dffb640 1 -- 172.21.15.52:0/2228797310 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b159b2fd20 con 0x55b159c494b0 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.420+0000 7fef7dffb640 10 client.18828 handle_command_reply: tid=0 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.420+0000 7fef9e8c8740 1 client.18828 shutdown 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 msgr2=0x55b159c41860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fef9001d000 tx=0x7fef90004ee0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 shutdown_connections 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b159c494b0 0x55b159c4b8d0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b159bcd940 0x55b159bd1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b159bc3080 0x55b159c41da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 --2- 172.21.15.52:0/2228797310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b159bc2760 0x55b159c41860 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef7dffb640 0 client.18828 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 >> 172.21.15.52:0/2228797310 conn(0x55b159bbecf0 msgr2=0x55b159bc49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 shutdown_connections 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 1 -- 172.21.15.52:0/2228797310 wait complete. 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9e8c8740 20 client.18828 trim_cache size 0 max 16384 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 38, 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:31:23.423 INFO:teuthology.orchestra.run.smithi052.stdout: "ae66c313": { 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 38, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 150.0, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:31:23.424 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:23.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 msgr2=0x7fef800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 0x7fef800a5700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fef8c04c000 tx=0x7fef8c04d000 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 msgr2=0x7fef94100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c970 tx=0x7fef8400ce30 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 shutdown_connections 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef9410c170 0x7fef94101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef94103660 0x7fef94100ee0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fef800a3240 0x7fef800a5700 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 --2- 172.21.15.52:0/382440297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef94102d40 0x7fef941009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 >> 172.21.15.52:0/382440297 conn(0x7fef940fc7a0 msgr2=0x7fef940fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.421+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 shutdown_connections 2024-09-19T09:31:23.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:23.422+0000 7fef9c4ef640 1 -- 172.21.15.52:0/382440297 wait complete. 2024-09-19T09:31:24.197 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ae66c313', quiesce took 3.3 seconds. Will release after: 26.7 2024-09-19T09:31:24.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:24 smithi052 ceph-mon[30947]: pgmap v637: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:31:24.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:24 smithi169 ceph-mon[35454]: pgmap v637: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:31:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:24 smithi086 ceph-mon[34813]: pgmap v637: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T09:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/3609500042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b81003d0 msgr2=0x7ff7b81007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/3609500042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b81003d0 0x7ff7b81007d0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009900 tx=0x7ff7b402a410 comp rx=0 tx=0).stop 2024-09-19T09:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/3609500042 shutdown_connections 2024-09-19T09:31:25.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/3609500042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81016b0 0x7ff7b8101b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/3609500042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b8100d10 0x7ff7b8101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/3609500042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b81003d0 0x7ff7b81007d0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.272+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/3609500042 >> 172.21.15.52:0/3609500042 conn(0x7ff7b80fc1e0 msgr2=0x7ff7b80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/3609500042 shutdown_connections 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/3609500042 wait complete. 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 Processor -- start 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- start start 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 0x7ff7b8199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b81016b0 0x7ff7b81a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b810f9d0 con 0x7ff7b8100d10 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b810f850 con 0x7ff7b81003d0 2024-09-19T09:31:25.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bfe8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b810fb50 con 0x7ff7b81016b0 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.273+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36560/0 (socket says 172.21.15.52:36560) 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 -- 172.21.15.52:0/1475719247 learned_addr learned my addr 172.21.15.52:0/1475719247 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7be42a640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b81016b0 0x7ff7b81a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 0x7ff7b8199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 -- 172.21.15.52:0/1475719247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b81016b0 msgr2=0x7ff7b81a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b81016b0 0x7ff7b81a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 -- 172.21.15.52:0/1475719247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 msgr2=0x7ff7b8199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 0x7ff7b8199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 -- 172.21.15.52:0/1475719247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b81a1c10 con 0x7ff7b8100d10 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 0x7ff7b8199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800e9f0 tx=0x7ff7a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7aeffd640 1 -- 172.21.15.52:0/1475719247 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800cd80 con 0x7ff7b8100d10 2024-09-19T09:31:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7aeffd640 1 -- 172.21.15.52:0/1475719247 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a8005500 con 0x7ff7b8100d10 2024-09-19T09:31:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b81a1f00 con 0x7ff7b8100d10 2024-09-19T09:31:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7aeffd640 1 -- 172.21.15.52:0/1475719247 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8010690 con 0x7ff7b8100d10 2024-09-19T09:31:25.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.274+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b81a2370 con 0x7ff7b8100d10 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7aeffd640 1 -- 172.21.15.52:0/1475719247 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff7a80046c0 con 0x7ff7b8100d10 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 Processor -- start 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 -- start start 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b783bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b7843830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.277+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2b779f2f0 con 0x55c2b783c2e0 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2b7747270 con 0x55c2b783b9a0 2024-09-19T09:31:25.281 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2b779b2b0 con 0x55c2b7841370 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36572/0 (socket says 172.21.15.52:36572) 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 -- 172.21.15.52:0/2867983392 learned_addr learned my addr 172.21.15.52:0/2867983392 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bd428640 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b7843830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7be42a640 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b783bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 -- 172.21.15.52:0/2867983392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 msgr2=0x55c2b7843830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b7843830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 -- 172.21.15.52:0/2867983392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 msgr2=0x55c2b783bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b783bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 -- 172.21.15.52:0/2867983392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b7746340 con 0x55c2b783c2e0 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7aeffd640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 0x7ff7a40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4006010 tx=0x7ff7b4032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a067ad7febc31714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7be42a640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 0x7ff7a40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7aeffd640 1 -- 172.21.15.52:0/1475719247 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff7a80cfe10 con 0x7ff7b8100d10 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.278+0000 7ff7a3fff640 1 -- 172.21.15.52:0/2867983392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b403f070 con 0x55c2b783c2e0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7a3fff640 1 -- 172.21.15.52:0/2867983392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b40318b0 con 0x55c2b783c2e0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7a3fff640 1 -- 172.21.15.52:0/2867983392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4035070 con 0x55c2b783c2e0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/2867983392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 msgr2=0x55c2b7840da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7be42a640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 0x7ff7a40a57b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0005fd0 tx=0x7ff7b0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4006010 tx=0x7ff7b4032cb0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/2867983392 shutdown_connections 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b7843830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7840da0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/2867983392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b783bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.279+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/2867983392 >> 172.21.15.52:0/2867983392 conn(0x55c2b7837010 msgr2=0x55c2b7837410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/2867983392 shutdown_connections 2024-09-19T09:31:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/2867983392 wait complete. 2024-09-19T09:31:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- start start 2024-09-19T09:31:25.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 Processor -- start 2024-09-19T09:31:25.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b7845b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2b78442e0 con 0x55c2b783c2e0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2b7728290 con 0x55c2b783b9a0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.280+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2b7844460 con 0x55c2b7841370 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7c2c2a740 10 client.0 _ll_register_callbacks cb 0x55c2b7759140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36586/0 (socket says 172.21.15.52:36586) 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 -- 172.21.15.52:0/823967515 learned_addr learned my addr 172.21.15.52:0/823967515 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7be42a640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b7845b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 -- 172.21.15.52:0/823967515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 msgr2=0x55c2b784d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 -- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 msgr2=0x55c2b7845b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b7845b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 -- 172.21.15.52:0/823967515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b74b2210 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7bd428640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80a4af0 tx=0x7ff7a8098710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848bc09953f64aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80a4d90 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff7a809b800 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7b40318b0 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff7a80b5020 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7c2c2a740 10 client.18840 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.281+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2b757e620 con 0x55c2b783c2e0 2024-09-19T09:31:25.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b40318b0 con 0x55c2b783c2e0 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff7a80b51c0 con 0x55c2b783c2e0 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 10 client.18840 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 10 client.18840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 20 client.18840 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b7851810 0x55c2b7853c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 4 client.18840 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2b77aca20 con 0x55c2b7851810 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.282+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b7851810 0x55c2b7853c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.283+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b7851810 0x55c2b7853c20 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30f5ceb6efd61b6b server_cookie=90e1cdf1edaabe1c in_seq=0 out_seq=0 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.283+0000 7ff7a17fa640 10 client.18840 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.283+0000 7ff7a17fa640 1 -- 172.21.15.52:0/823967515 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2b77aca20 con 0x55c2b7851810 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.283+0000 7ff7a17fa640 10 client.18840 handle_command_reply: tid=0 2024-09-19T09:31:25.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.283+0000 7ff7c2c2a740 1 client.18840 shutdown 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 msgr2=0x55c2b7846050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80a4af0 tx=0x7ff7a8098710 comp rx=0 tx=0).stop 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 shutdown_connections 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b7851810 0x55c2b7853c20 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b7846050 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7a17fa640 0 client.18840 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/823967515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b7845b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 >> 172.21.15.52:0/823967515 conn(0x55c2b7837010 msgr2=0x55c2b7838820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 shutdown_connections 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/823967515 wait complete. 2024-09-19T09:31:25.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.284+0000 7ff7c2c2a740 20 client.18840 trim_cache size 0 max 16384 2024-09-19T09:31:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.298+0000 7ff7c2c2a740 1 Processor -- start 2024-09-19T09:31:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.298+0000 7ff7c2c2a740 1 -- start start 2024-09-19T09:31:25.300 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 0x55c2b784d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b7841370 0x55c2b7858520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81adc40 con 0x55c2b783b9a0 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81ab510 con 0x55c2b7841370 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81a9360 con 0x55c2b783c2e0 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36594/0 (socket says 172.21.15.52:36594) 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 -- 172.21.15.52:0/1824003848 learned_addr learned my addr 172.21.15.52:0/1824003848 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 0x55c2b784d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7be42a640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b7841370 0x55c2b7858520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 -- 172.21.15.52:0/1824003848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 msgr2=0x55c2b784d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 0x55c2b784d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.301 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 -- 172.21.15.52:0/1824003848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b7841370 msgr2=0x55c2b7858520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b7841370 0x55c2b7858520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 -- 172.21.15.52:0/1824003848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b783c7c0 con 0x55c2b783b9a0 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 0x55c2b784d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009900 tx=0x7ff7b4032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951a94283381f1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7a37fe640 1 -- 172.21.15.52:0/1824003848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b403f070 con 0x55c2b783b9a0 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7a37fe640 1 -- 172.21.15.52:0/1824003848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b4031d90 con 0x55c2b783b9a0 2024-09-19T09:31:25.302 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.299+0000 7ff7a37fe640 1 -- 172.21.15.52:0/1824003848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4035040 con 0x55c2b783b9a0 2024-09-19T09:31:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1824003848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 msgr2=0x55c2b78360b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.305 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009900 tx=0x7ff7b4032ea0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1824003848 shutdown_connections 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b7841370 0x55c2b7858520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b783c2e0 0x55c2b784d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1824003848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783b9a0 0x55c2b78360b0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1824003848 >> 172.21.15.52:0/1824003848 conn(0x55c2b7837010 msgr2=0x55c2b78359a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1824003848 shutdown_connections 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1824003848 wait complete. 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 -- start start 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.300+0000 7ff7c2c2a740 1 Processor -- start 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b784aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.306 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81a99d0 con 0x55c2b783c2e0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81aae40 con 0x55c2b783b9a0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b81aa0a0 con 0x55c2b7841370 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7c2c2a740 10 client.0 _ll_register_callbacks cb 0x7ff7a800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36608/0 (socket says 172.21.15.52:36608) 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 -- 172.21.15.52:0/1448576300 learned_addr learned my addr 172.21.15.52:0/1448576300 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b784aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7be42a640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 -- 172.21.15.52:0/1448576300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 msgr2=0x55c2b784c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 -- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 msgr2=0x55c2b784aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b784aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.307 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 -- 172.21.15.52:0/1448576300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b784c700 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b784aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7bd428640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8098d30 tx=0x7ff7a809b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde46a79e68698f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.301+0000 7ff7a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a809bef0 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff7a80a4da0 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7b4031d90 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff7a8067020 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 10 client.18846 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2b78bc980 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7b4031d90 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff7a80a7080 con 0x55c2b783c2e0 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 10 client.18846 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:25.308 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 10 client.18846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 20 client.18846 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b78bd1a0 0x55c2b78bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 4 client.18846 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2b77a6d70 con 0x55c2b78bd1a0 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.302+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b78bd1a0 0x55c2b78bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.303+0000 7ff7a17fa640 10 client.18846 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:25.309 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.303+0000 7ff7bdc29640 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b78bd1a0 0x55c2b78bf5c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b330dc37cce6928 server_cookie=bdc048063e72f535 in_seq=0 out_seq=0 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7a17fa640 1 -- 172.21.15.52:0/1448576300 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2b77a6d70 con 0x55c2b78bd1a0 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7a17fa640 10 client.18846 handle_command_reply: tid=0 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 client.18846 shutdown 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 msgr2=0x55c2b784b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8098d30 tx=0x7ff7a809b730 comp rx=0 tx=0).stop 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 shutdown_connections 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c2b78bd1a0 0x55c2b78bf5c0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2b7841370 0x55c2b784c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.315 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2b783c2e0 0x55c2b784b0e0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7a17fa640 0 client.18846 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 --2- 172.21.15.52:0/1448576300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2b783b9a0 0x55c2b784aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 >> 172.21.15.52:0/1448576300 conn(0x55c2b7837010 msgr2=0x55c2b78361c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 shutdown_connections 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 1 -- 172.21.15.52:0/1448576300 wait complete. 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.314+0000 7ff7c2c2a740 20 client.18846 trim_cache size 0 max 16384 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:31:25.316 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:31:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 msgr2=0x7ff7a40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 0x7ff7a40a57b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0005fd0 tx=0x7ff7b0009500 comp rx=0 tx=0).stop 2024-09-19T09:31:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 msgr2=0x7ff7b819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:25.317 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800e9f0 tx=0x7ff7a800edf0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 shutdown_connections 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7a40a32f0 0x7ff7a40a57b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7b81016b0 0x7ff7b81a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7b8100d10 0x7ff7b819a530 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 --2- 172.21.15.52:0/1475719247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff7b81003d0 0x7ff7b8199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 >> 172.21.15.52:0/1475719247 conn(0x7ff7b80fc1e0 msgr2=0x7ff7b80fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 shutdown_connections 2024-09-19T09:31:25.318 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:25.315+0000 7ff7bfe8d640 1 -- 172.21.15.52:0/1475719247 wait complete. 2024-09-19T09:31:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:26 smithi052 ceph-mon[30947]: pgmap v638: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-19T09:31:26.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:26 smithi169 ceph-mon[35454]: pgmap v638: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-19T09:31:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:26 smithi086 ceph-mon[34813]: pgmap v638: 97 pgs: 97 active+clean; 968 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-19T09:31:27.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:31:28.067 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 -- 172.21.15.52:0/3122358973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b410c170 msgr2=0x7f03b410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 --2- 172.21.15.52:0/3122358973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b410c170 0x7f03b410e610 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009ca0 tx=0x7f03ac02a950 comp rx=0 tx=0).stop 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 -- 172.21.15.52:0/3122358973 shutdown_connections 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 --2- 172.21.15.52:0/3122358973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b410c170 0x7f03b410e610 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 --2- 172.21.15.52:0/3122358973 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b4103660 0x7f03b410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 --2- 172.21.15.52:0/3122358973 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4102d40 0x7f03b4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 -- 172.21.15.52:0/3122358973 >> 172.21.15.52:0/3122358973 conn(0x7f03b40fc7a0 msgr2=0x7f03b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 -- 172.21.15.52:0/3122358973 shutdown_connections 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.622+0000 7f03b98e1640 1 -- 172.21.15.52:0/3122358973 wait complete. 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 Processor -- start 2024-09-19T09:31:28.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 -- start start 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 0x7f03b41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 0x7f03b419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03b4111f50 con 0x7f03b4102d40 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03b4111dd0 con 0x7f03b4103660 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b98e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41120d0 con 0x7f03b410c170 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48898/0 (socket says 172.21.15.52:48898) 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1149767239 learned_addr learned my addr 172.21.15.52:0/1149767239 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03abfff640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 0x7f03b41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 0x7f03b419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1149767239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 msgr2=0x7f03b419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 0x7f03b419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1149767239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 msgr2=0x7f03b41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 0x7f03b41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1149767239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b419d410 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03abfff640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 0x7f03b41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.623+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 0x7f03b419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f03a400d950 tx=0x7f03a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b88df640 1 -- 172.21.15.52:0/1149767239 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4017070 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b419d700 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b88df640 1 -- 172.21.15.52:0/1149767239 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a4009c30 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b88df640 1 -- 172.21.15.52:0/1149767239 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a400f6b0 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.624+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b41a4fe0 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.626+0000 7f03b88df640 1 -- 172.21.15.52:0/1149767239 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f03a40109d0 con 0x7f03b4102d40 2024-09-19T09:31:28.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 Processor -- start 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 -- start start 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd654a0 0x5613cbd65880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd70680 0x5613cbd72a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5613cbccb2e0 con 0x5613cbd65dc0 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5613cbc72ce0 con 0x5613cbd654a0 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03bbcba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5613cbcc72a0 con 0x5613cbd70680 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48908/0 (socket says 172.21.15.52:48908) 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03b2ffd640 1 -- 172.21.15.52:0/129727206 learned_addr learned my addr 172.21.15.52:0/129727206 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03b37fe640 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd654a0 0x5613cbd65880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03abfff640 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd70680 0x5613cbd72a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.627+0000 7f03b88df640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 0x7f03a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 -- 172.21.15.52:0/129727206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd70680 msgr2=0x5613cbd72a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd70680 0x5613cbd72a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 -- 172.21.15.52:0/129727206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd654a0 msgr2=0x5613cbd65880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd654a0 0x5613cbd65880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 -- 172.21.15.52:0/129727206 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cbc57440 con 0x5613cbd65dc0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 0x7f03a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b88df640 1 -- 172.21.15.52:0/1149767239 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f03a40cf6b0 con 0x7f03b4102d40 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c1b80 tx=0x7f03a40c69c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46377cbcb116f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03a9ffb640 1 -- 172.21.15.52:0/129727206 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a409b730 con 0x5613cbd65dc0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03a9ffb640 1 -- 172.21.15.52:0/129727206 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a40c50d0 con 0x5613cbd65dc0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.628+0000 7f03a9ffb640 1 -- 172.21.15.52:0/129727206 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a409b550 con 0x5613cbd65dc0 2024-09-19T09:31:28.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- 172.21.15.52:0/129727206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 msgr2=0x5613cbd70140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 0x7f03a00a5700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f03ac030040 tx=0x7f03ac0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f03a40c1b80 tx=0x7f03a40c69c0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- 172.21.15.52:0/129727206 shutdown_connections 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd70680 0x5613cbd72a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbd70140 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 --2- 172.21.15.52:0/129727206 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd654a0 0x5613cbd65880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- 172.21.15.52:0/129727206 >> 172.21.15.52:0/129727206 conn(0x5613cbd61a30 msgr2=0x5613cbd61e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- 172.21.15.52:0/129727206 shutdown_connections 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- 172.21.15.52:0/129727206 wait complete. 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 -- start start 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.629+0000 7f03bbcba740 1 Processor -- start 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd6d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5613cbd73250 con 0x5613cbd654a0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5613cbc86050 con 0x5613cbd70680 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5613cbd733d0 con 0x5613cbd65dc0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03bbcba740 10 client.0 _ll_register_callbacks cb 0x5613cbcc6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48920/0 (socket says 172.21.15.52:48920) 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 -- 172.21.15.52:0/2064195556 learned_addr learned my addr 172.21.15.52:0/2064195556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03abfff640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd6d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b37fe640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 -- 172.21.15.52:0/2064195556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 msgr2=0x5613cbd6d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd6d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 -- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 msgr2=0x5613cbd6d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd6d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 -- 172.21.15.52:0/2064195556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cba3c3c0 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b37fe640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd6d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f03a40058c0 tx=0x7f03a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b24b7296258f50e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.630+0000 7f0392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4020070 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a40c50d0 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f03a4099ef0 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f03a409b730 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 10 client.18858 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613cbd7ec00 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a40c50d0 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f03a40cd150 con 0x5613cbd654a0 2024-09-19T09:31:28.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 10 client.18858 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 10 client.18858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 20 client.18858 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbd7ff50 0x5613cbd82340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 4 client.18858 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.631+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613cbcd8850 con 0x5613cbd7ff50 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.632+0000 7f03abfff640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbd7ff50 0x5613cbd82340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.632+0000 7f03abfff640 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbd7ff50 0x5613cbd82340 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcb610c7b754ad server_cookie=c7461e0bfba8305d in_seq=0 out_seq=0 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.632+0000 7f0392ffd640 10 client.18858 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f0392ffd640 1 -- 172.21.15.52:0/2064195556 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613cbcd8850 con 0x5613cbd7ff50 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f0392ffd640 10 client.18858 handle_command_reply: tid=0 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 client.18858 shutdown 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 msgr2=0x5613cbd6ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f03a40058c0 tx=0x7f03a4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 shutdown_connections 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbd7ff50 0x5613cbd82340 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd6d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd6d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 --2- 172.21.15.52:0/2064195556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd6ffb0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f0392ffd640 0 client.18858 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 >> 172.21.15.52:0/2064195556 conn(0x5613cbd61a30 msgr2=0x5613cbd67710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 shutdown_connections 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 1 -- 172.21.15.52:0/2064195556 wait complete. 2024-09-19T09:31:28.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.633+0000 7f03bbcba740 20 client.18858 trim_cache size 0 max 16384 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 Processor -- start 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 -- start start 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd78a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd78f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41b0050 con 0x5613cbd654a0 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41ad920 con 0x5613cbd70680 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03bbcba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41ab770 con 0x5613cbd65dc0 2024-09-19T09:31:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48926/0 (socket says 172.21.15.52:48926) 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.650+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1928697556 learned_addr learned my addr 172.21.15.52:0/1928697556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd78f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03abfff640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd78a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1928697556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 msgr2=0x5613cbd78a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd78a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1928697556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 msgr2=0x5613cbd78f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd78f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 -- 172.21.15.52:0/1928697556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613cbd61860 con 0x5613cbd654a0 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd78f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03abfff640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f03a409b8f0 tx=0x7f03a4097dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea932a411d34291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03a97fa640 1 -- 172.21.15.52:0/1928697556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4020040 con 0x5613cbd654a0 2024-09-19T09:31:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03a97fa640 1 -- 172.21.15.52:0/1928697556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a409c2f0 con 0x5613cbd654a0 2024-09-19T09:31:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.651+0000 7f03a97fa640 1 -- 172.21.15.52:0/1928697556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4099ef0 con 0x5613cbd654a0 2024-09-19T09:31:28.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- 172.21.15.52:0/1928697556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 msgr2=0x5613cbd60a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f03a409b8f0 tx=0x7f03a4097dd0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- 172.21.15.52:0/1928697556 shutdown_connections 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbd78f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd65dc0 0x5613cbd78a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1928697556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd654a0 0x5613cbd60a60 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- 172.21.15.52:0/1928697556 >> 172.21.15.52:0/1928697556 conn(0x5613cbd61a30 msgr2=0x5613cbd60350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- 172.21.15.52:0/1928697556 shutdown_connections 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- 172.21.15.52:0/1928697556 wait complete. 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 -- start start 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.652+0000 7f03bbcba740 1 Processor -- start 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 0x5613cbde17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbde5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41abde0 con 0x5613cbd65dc0 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41ad250 con 0x5613cbd70680 2024-09-19T09:31:28.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f03b41ac4b0 con 0x5613cbd654a0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03bbcba740 10 client.0 _ll_register_callbacks cb 0x7f03ac009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48936/0 (socket says 172.21.15.52:48936) 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 -- 172.21.15.52:0/1518147452 learned_addr learned my addr 172.21.15.52:0/1518147452 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 0x5613cbde17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03b37fe640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbde5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 -- 172.21.15.52:0/1518147452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 msgr2=0x5613cbde17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 0x5613cbde17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 -- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 msgr2=0x5613cbde5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbde5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 -- 172.21.15.52:0/1518147452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613cbde6450 con 0x5613cbd65dc0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 0x5613cbde17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f03abfff640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x5613cbd62db0 tx=0x7f039c011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315859dc79868527 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f0392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:28.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.653+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c01d8f0 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f039c01da90 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a409c2f0 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f039c02a020 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 10 client.18864 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5613cbdeea80 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a409c2f0 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f039c024030 con 0x5613cbd65dc0 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 10 client.18864 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 10 client.18864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 20 client.18864 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbdef1e0 0x5613cbdf1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 4 client.18864 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:31:28.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613cbcd2d60 con 0x5613cbdef1e0 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.654+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbdef1e0 0x5613cbdf1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03b2ffd640 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbdef1e0 0x5613cbdf1600 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6595aaeef415e0 server_cookie=3b5c724c7736efcd in_seq=0 out_seq=0 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f0392ffd640 10 client.18864 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f0392ffd640 1 -- 172.21.15.52:0/1518147452 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5613cbcd2d60 con 0x5613cbdef1e0 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f0392ffd640 10 client.18864 handle_command_reply: tid=0 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 client.18864 shutdown 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 msgr2=0x5613cbde1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x5613cbd62db0 tx=0x7f039c011ae0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 shutdown_connections 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5613cbdef1e0 0x5613cbdf1600 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5613cbd70680 0x5613cbde5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5613cbd65dc0 0x5613cbde1ce0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 --2- 172.21.15.52:0/1518147452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5613cbd654a0 0x5613cbde17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 >> 172.21.15.52:0/1518147452 conn(0x5613cbd61a30 msgr2=0x5613cbd6b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f0392ffd640 0 client.18864 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 shutdown_connections 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.655+0000 7f03bbcba740 1 -- 172.21.15.52:0/1518147452 wait complete. 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03bbcba740 20 client.18864 trim_cache size 0 max 16384 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:31:28.662 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 msgr2=0x7f03a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 0x7f03a00a5700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f03ac030040 tx=0x7f03ac0095c0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 msgr2=0x7f03b4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f03a400d950 tx=0x7f03a400de10 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 shutdown_connections 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f03a00a3240 0x7f03a00a5700 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f03b410c170 0x7f03b419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03b4103660 0x7f03b41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 --2- 172.21.15.52:0/1149767239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4102d40 0x7f03b4198460 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 >> 172.21.15.52:0/1149767239 conn(0x7f03b40fc7a0 msgr2=0x7f03b40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 shutdown_connections 2024-09-19T09:31:28.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:28.656+0000 7f03b98e1640 1 -- 172.21.15.52:0/1149767239 wait complete. 2024-09-19T09:31:28.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:28 smithi052 ceph-mon[30947]: pgmap v639: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:31:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:28 smithi169 ceph-mon[35454]: pgmap v639: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:31:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:28 smithi086 ceph-mon[34813]: pgmap v639: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-19T09:31:29.486 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:31:29.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:29.753 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:30.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 -- 172.21.15.52:0/3408046419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa438102da0 msgr2=0x7fa438103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3408046419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa438102da0 0x7fa438103180 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fa428009ca0 tx=0x7fa42802a950 comp rx=0 tx=0).stop 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 -- 172.21.15.52:0/3408046419 shutdown_connections 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3408046419 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa43810c180 0x7fa43810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3408046419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 0x7fa43810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3408046419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa438102da0 0x7fa438103180 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 -- 172.21.15.52:0/3408046419 >> 172.21.15.52:0/3408046419 conn(0x7fa4380fc7a0 msgr2=0x7fa4380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 -- 172.21.15.52:0/3408046419 shutdown_connections 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.209+0000 7fa43e21a640 1 -- 172.21.15.52:0/3408046419 wait complete. 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 Processor -- start 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 -- start start 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438102da0 0x7fa4381984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 0x7fa4381989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa438111f60 con 0x7fa43810c180 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa438111de0 con 0x7fa438102da0 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa43e21a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4381120e0 con 0x7fa4381036c0 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa437fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa437fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48944/0 (socket says 172.21.15.52:48944) 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa437fff640 1 -- 172.21.15.52:0/3090833770 learned_addr learned my addr 172.21.15.52:0/3090833770 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa4377fe640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438102da0 0x7fa4381984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.210+0000 7fa436ffd640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 0x7fa4381989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 -- 172.21.15.52:0/3090833770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 msgr2=0x7fa4381989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 0x7fa4381989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 -- 172.21.15.52:0/3090833770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438102da0 msgr2=0x7fa4381984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438102da0 0x7fa4381984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 -- 172.21.15.52:0/3090833770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43819d460 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa437fff640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d750 tx=0x7fa43000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430017070 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa430005500 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430004d90 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43819d750 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.211+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381a5030 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.212+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa438103180 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.214+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa430004f30 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.214+0000 7fa434ff9640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 0x7fa4240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.215+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa4300cf250 con 0x7fa43810c180 2024-09-19T09:31:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.215+0000 7fa4377fe640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 0x7fa4240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.215+0000 7fa4377fe640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 0x7fa4240a5700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa428004ad0 tx=0x7fa428004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:30.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.219+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa43009b8a0 con 0x7fa43810c180 2024-09-19T09:31:30.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.432+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa438107280 con 0x7fa43810c180 2024-09-19T09:31:30.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.432+0000 7fa434ff9640 1 -- 172.21.15.52:0/3090833770 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fa43009fba0 con 0x7fa43810c180 2024-09-19T09:31:30.433 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:30.434 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:30.434 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 msgr2=0x7fa4240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:30.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 0x7fa4240a5700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa428004ad0 tx=0x7fa428004a60 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 msgr2=0x7fa43819cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d750 tx=0x7fa43000dc10 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 shutdown_connections 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa43810c180 0x7fa43819cd80 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4240a3240 0x7fa4240a5700 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4381036c0 0x7fa4381989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 --2- 172.21.15.52:0/3090833770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438102da0 0x7fa4381984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.434+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 >> 172.21.15.52:0/3090833770 conn(0x7fa4380fc7a0 msgr2=0x7fa4380fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.435+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 shutdown_connections 2024-09-19T09:31:30.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:30.435+0000 7fa43e21a640 1 -- 172.21.15.52:0/3090833770 wait complete. 2024-09-19T09:31:30.808 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:30 smithi052 ceph-mon[30947]: pgmap v640: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-19T09:31:30.808 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:30 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3090833770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:30 smithi169 ceph-mon[35454]: pgmap v640: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-19T09:31:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:30 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3090833770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:30 smithi086 ceph-mon[34813]: pgmap v640: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-19T09:31:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:30 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3090833770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:31.220 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:31:31.484 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:31.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 -- 172.21.15.52:0/3158846309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102570 msgr2=0x7f74e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 --2- 172.21.15.52:0/3158846309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102570 0x7f74e01029b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009900 tx=0x7f74d402a480 comp rx=0 tx=0).stop 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 -- 172.21.15.52:0/3158846309 shutdown_connections 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 --2- 172.21.15.52:0/3158846309 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102ef0 0x7f74e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 --2- 172.21.15.52:0/3158846309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102570 0x7f74e01029b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 --2- 172.21.15.52:0/3158846309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 -- 172.21.15.52:0/3158846309 >> 172.21.15.52:0/3158846309 conn(0x7f74e00fc7d0 msgr2=0x7f74e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 -- 172.21.15.52:0/3158846309 shutdown_connections 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.936+0000 7f74e5387640 1 -- 172.21.15.52:0/3158846309 wait complete. 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.937+0000 7f74e5387640 1 Processor -- start 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.937+0000 7f74e5387640 1 -- start start 2024-09-19T09:31:31.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.937+0000 7f74e5387640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.937+0000 7f74e5387640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102570 0x7f74e00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.937+0000 7f74e5387640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74e5387640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0111020 con 0x7f74e0102ef0 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74e5387640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0110ea0 con 0x7f74e0102570 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74e5387640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01111a0 con 0x7f74e0100e20 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48966/0 (socket says 172.21.15.52:48966) 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 -- 172.21.15.52:0/1214028011 learned_addr learned my addr 172.21.15.52:0/1214028011 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102570 0x7f74e00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74deffd640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 -- 172.21.15.52:0/1214028011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 msgr2=0x7f74e00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 -- 172.21.15.52:0/1214028011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102570 msgr2=0x7f74e00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102570 0x7f74e00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 -- 172.21.15.52:0/1214028011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e01a6bd0 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74deffd640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74df7fe640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f74d800b970 tx=0x7f74d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74c7fff640 1 -- 172.21.15.52:0/1214028011 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8019070 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e01a6ec0 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74c7fff640 1 -- 172.21.15.52:0/1214028011 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d800cb40 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74c7fff640 1 -- 172.21.15.52:0/1214028011 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8007650 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.938+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e01a7380 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74c7fff640 1 -- 172.21.15.52:0/1214028011 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f74d801c070 con 0x7f74e0102ef0 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 Processor -- start 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 -- start start 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cf488232f0 con 0x55cf488beb40 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cf487cacf0 con 0x55cf488c8370 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74e7760740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cf4881f2b0 con 0x55cf488bd5d0 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48972/0 (socket says 172.21.15.52:48972) 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.941+0000 7f74de7fc640 1 -- 172.21.15.52:0/3664676339 learned_addr learned my addr 172.21.15.52:0/3664676339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74deffd640 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74c7fff640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 0x7f74c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 -- 172.21.15.52:0/3664676339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 msgr2=0x55cf488bda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488bda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 -- 172.21.15.52:0/3664676339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 msgr2=0x55cf488ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 -- 172.21.15.52:0/3664676339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf487af3a0 con 0x55cf488beb40 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74df7fe640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 0x7f74c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74c7fff640 1 -- 172.21.15.52:0/1214028011 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f74d80cef70 con 0x7f74e0102ef0 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74de7fc640 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f74d402a9a0 tx=0x7f74d4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c1755652f8f090 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74c57fa640 1 -- 172.21.15.52:0/3664676339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4035070 con 0x55cf488beb40 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74c57fa640 1 -- 172.21.15.52:0/3664676339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d4003d50 con 0x55cf488beb40 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.942+0000 7f74c57fa640 1 -- 172.21.15.52:0/3664676339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d403b460 con 0x55cf488beb40 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- 172.21.15.52:0/3664676339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 msgr2=0x55cf488bd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74df7fe640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 0x7f74c80a5700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f74d80ccd60 tx=0x7f74d8066000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f74d402a9a0 tx=0x7f74d4005c00 comp rx=0 tx=0).stop 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- 172.21.15.52:0/3664676339 shutdown_connections 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488bda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 --2- 172.21.15.52:0/3664676339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488beb40 0x55cf488bd090 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- 172.21.15.52:0/3664676339 >> 172.21.15.52:0/3664676339 conn(0x55cf48886310 msgr2=0x55cf488b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- 172.21.15.52:0/3664676339 shutdown_connections 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- 172.21.15.52:0/3664676339 wait complete. 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.943+0000 7f74e7760740 1 -- start start 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 Processor -- start 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488beb40 0x55cf488c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cf488cb010 con 0x55cf488c8370 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cf487de060 con 0x55cf488beb40 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cf488cb190 con 0x55cf488bd5d0 2024-09-19T09:31:31.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74e7760740 10 client.0 _ll_register_callbacks cb 0x55cf485318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48976/0 (socket says 172.21.15.52:48976) 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 -- 172.21.15.52:0/1725172289 learned_addr learned my addr 172.21.15.52:0/1725172289 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74deffd640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488beb40 0x55cf488c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 -- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 msgr2=0x55cf488c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 -- 172.21.15.52:0/1725172289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488beb40 msgr2=0x55cf488c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488beb40 0x55cf488c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 -- 172.21.15.52:0/1725172289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf485943c0 con 0x55cf488c8370 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f74d402ac50 tx=0x7f74d4031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db28253964aaa069 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.944+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4053020 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f74d4003870 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d4003d50 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f74d4035070 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 10 client.18882 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cf488cb010 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d4003d50 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f74d403bce0 con 0x55cf488c8370 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 10 client.18882 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 10 client.18882 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 20 client.18882 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf488d7c10 0x55cf488da000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 4 client.18882 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.945+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf48830860 con 0x55cf488d7c10 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.946+0000 7f74deffd640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf488d7c10 0x55cf488da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.946+0000 7f74deffd640 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf488d7c10 0x55cf488da000 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1790144e8a0a6403 server_cookie=620283bf1e267efd in_seq=0 out_seq=0 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.946+0000 7f74c2ff5640 10 client.18882 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1725172289 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cf48830860 con 0x55cf488d7c10 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74c2ff5640 10 client.18882 handle_command_reply: tid=0 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 client.18882 shutdown 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 msgr2=0x55cf488c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f74d402ac50 tx=0x7f74d4031bb0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 shutdown_connections 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf488d7c10 0x55cf488da000 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488c5560 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488beb40 0x55cf488c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74c2ff5640 0 client.18882 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 --2- 172.21.15.52:0/1725172289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488bd5d0 0x55cf488c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 >> 172.21.15.52:0/1725172289 conn(0x55cf48886310 msgr2=0x55cf488bf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 shutdown_connections 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 1 -- 172.21.15.52:0/1725172289 wait complete. 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.947+0000 7f74e7760740 20 client.18882 trim_cache size 0 max 16384 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.960+0000 7f74e7760740 1 Processor -- start 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.960+0000 7f74e7760740 1 -- start start 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488bd5d0 0x55cf488d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01b22b0 con 0x55cf488c8370 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01afb80 con 0x55cf488bd5d0 2024-09-19T09:31:31.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74e7760740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01ad9d0 con 0x55cf488beb40 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48978/0 (socket says 172.21.15.52:48978) 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 -- 172.21.15.52:0/1537028693 learned_addr learned my addr 172.21.15.52:0/1537028693 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74deffd640 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488bd5d0 0x55cf488d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 -- 172.21.15.52:0/1537028693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 msgr2=0x55cf488df6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488df6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 -- 172.21.15.52:0/1537028693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488bd5d0 msgr2=0x55cf488d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488bd5d0 0x55cf488d42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 -- 172.21.15.52:0/1537028693 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf488be750 con 0x55cf488c8370 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f74d4001eb0 tx=0x7f74d4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc87d66c2200a181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74c4ff9640 1 -- 172.21.15.52:0/1537028693 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4053040 con 0x55cf488c8370 2024-09-19T09:31:31.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74c4ff9640 1 -- 172.21.15.52:0/1537028693 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d4005020 con 0x55cf488c8370 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.961+0000 7f74c4ff9640 1 -- 172.21.15.52:0/1537028693 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4004a00 con 0x55cf488c8370 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- 172.21.15.52:0/1537028693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 msgr2=0x55cf488dfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f74d4001eb0 tx=0x7f74d4031400 comp rx=0 tx=0).stop 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- 172.21.15.52:0/1537028693 shutdown_connections 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488c8370 0x55cf488dfc30 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488df6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 --2- 172.21.15.52:0/1537028693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488bd5d0 0x55cf488d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- 172.21.15.52:0/1537028693 >> 172.21.15.52:0/1537028693 conn(0x55cf48886310 msgr2=0x55cf488c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- 172.21.15.52:0/1537028693 shutdown_connections 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- 172.21.15.52:0/1537028693 wait complete. 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 -- start start 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.962+0000 7f74e7760740 1 Processor -- start 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488c2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01ae040 con 0x55cf488bd5d0 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01af4b0 con 0x55cf488c8370 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01ae710 con 0x55cf488beb40 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 10 client.0 _ll_register_callbacks cb 0x7f74d000a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48980/0 (socket says 172.21.15.52:48980) 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 -- 172.21.15.52:0/1042855156 learned_addr learned my addr 172.21.15.52:0/1042855156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 -- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 msgr2=0x55cf488c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488c2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 -- 172.21.15.52:0/1042855156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 msgr2=0x55cf488c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 -- 172.21.15.52:0/1042855156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf489416f0 con 0x55cf488bd5d0 2024-09-19T09:31:31.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74de7fc640 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f74d40092a0 tx=0x7f74d402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93efc2f67417f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4053070 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f74d4049e00 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.963+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d4005020 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f74d40047a0 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 10 client.18888 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cf489429b0 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d4005020 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f74d4003680 con 0x55cf488bd5d0 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 10 client.18888 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 10 client.18888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 20 client.18888 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf48942e20 0x55cf48945210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:31.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 4 client.18888 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf4882ad70 con 0x55cf48942e20 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.964+0000 7f74deffd640 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf48942e20 0x55cf48945210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74deffd640 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf48942e20 0x55cf48945210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d0d29ff624ca447 server_cookie=8e08b7c484910989 in_seq=0 out_seq=0 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74c2ff5640 10 client.18888 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74c2ff5640 1 -- 172.21.15.52:0/1042855156 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf4882ad70 con 0x55cf48942e20 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74c2ff5640 10 client.18888 handle_command_reply: tid=0 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 client.18888 shutdown 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 msgr2=0x55cf488c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f74d40092a0 tx=0x7f74d402a480 comp rx=0 tx=0).stop 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 shutdown_connections 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55cf48942e20 0x55cf48945210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cf488c8370 0x55cf488c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cf488beb40 0x55cf488c2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74c2ff5640 0 client.18888 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:31.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 --2- 172.21.15.52:0/1042855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cf488bd5d0 0x55cf488c1fd0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 >> 172.21.15.52:0/1042855156 conn(0x55cf48886310 msgr2=0x55cf488b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.988 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:31.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 shutdown_connections 2024-09-19T09:31:31.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.965+0000 7f74e7760740 1 -- 172.21.15.52:0/1042855156 wait complete. 2024-09-19T09:31:31.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e7760740 20 client.18888 trim_cache size 0 max 16384 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 msgr2=0x7f74c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 0x7f74c80a5700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f74d80ccd60 tx=0x7f74d8066000 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 msgr2=0x7f74e00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f74d800b970 tx=0x7f74d800be30 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 shutdown_connections 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74e0102ef0 0x7f74e00fd700 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74e0102570 0x7f74e00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f74c80a3240 0x7f74c80a5700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 --2- 172.21.15.52:0/1214028011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f74e0100e20 0x7f74e00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 >> 172.21.15.52:0/1214028011 conn(0x7f74e00fc7d0 msgr2=0x7f74e006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 shutdown_connections 2024-09-19T09:31:31.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:31.966+0000 7f74e5387640 1 -- 172.21.15.52:0/1214028011 wait complete. 2024-09-19T09:31:32.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:31:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:32 smithi052 ceph-mon[30947]: pgmap v641: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:31:32.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:32 smithi169 ceph-mon[35454]: pgmap v641: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:31:32.988 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:33.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:32 smithi086 ceph-mon[34813]: pgmap v641: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2024-09-19T09:31:33.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 -- 172.21.15.52:0/3485722082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64102d40 msgr2=0x7fce64103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 --2- 172.21.15.52:0/3485722082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64102d40 0x7fce64103120 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fce54009900 tx=0x7fce5402a480 comp rx=0 tx=0).stop 2024-09-19T09:31:33.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 -- 172.21.15.52:0/3485722082 shutdown_connections 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 --2- 172.21.15.52:0/3485722082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce6410c170 0x7fce6410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 --2- 172.21.15.52:0/3485722082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce64103660 0x7fce6410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 --2- 172.21.15.52:0/3485722082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64102d40 0x7fce64103120 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 -- 172.21.15.52:0/3485722082 >> 172.21.15.52:0/3485722082 conn(0x7fce640fc7a0 msgr2=0x7fce640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 -- 172.21.15.52:0/3485722082 shutdown_connections 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.480+0000 7fce69c0f640 1 -- 172.21.15.52:0/3485722082 wait complete. 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.481+0000 7fce69c0f640 1 Processor -- start 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.481+0000 7fce69c0f640 1 -- start start 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce64102d40 0x7fce641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce6410c170 0x7fce64101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111f70 con 0x7fce64103660 2024-09-19T09:31:33.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce64111df0 con 0x7fce64102d40 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce641120f0 con 0x7fce6410c170 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49000/0 (socket says 172.21.15.52:49000) 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 -- 172.21.15.52:0/1191839393 learned_addr learned my addr 172.21.15.52:0/1191839393 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce637fe640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce64102d40 0x7fce641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce63fff640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce6410c170 0x7fce64101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 -- 172.21.15.52:0/1191839393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce6410c170 msgr2=0x7fce64101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce6410c170 0x7fce64101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 -- 172.21.15.52:0/1191839393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce64102d40 msgr2=0x7fce641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce64102d40 0x7fce641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 -- 172.21.15.52:0/1191839393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce641a69b0 con 0x7fce64103660 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce62ffd640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fce5800d950 tx=0x7fce5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce60ff9640 1 -- 172.21.15.52:0/1191839393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58017030 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce641a6ca0 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce60ff9640 1 -- 172.21.15.52:0/1191839393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce58004020 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.482+0000 7fce60ff9640 1 -- 172.21.15.52:0/1191839393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce580047a0 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.483+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641a71d0 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.485+0000 7fce60ff9640 1 -- 172.21.15.52:0/1191839393 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce580041d0 con 0x7fce64103660 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.485+0000 7fce6bfe8740 1 Processor -- start 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.485+0000 7fce6bfe8740 1 -- start start 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b3da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4aa32f0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4a4acf0 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4a9f2b0 con 0x55fbc4b48370 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49012/0 (socket says 172.21.15.52:49012) 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b3da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce63fff640 1 -- 172.21.15.52:0/1778714997 learned_addr learned my addr 172.21.15.52:0/1778714997 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce60ff9640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 0x7fce4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce62ffd640 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 -- 172.21.15.52:0/1778714997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 msgr2=0x55fbc4b4a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 -- 172.21.15.52:0/1778714997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 msgr2=0x55fbc4b3d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce60ff9640 1 -- 172.21.15.52:0/1191839393 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce580cf240 con 0x7fce64103660 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 -- 172.21.15.52:0/1778714997 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc4a2f3a0 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce63fff640 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce63fff640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 0x7fce4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.486+0000 7fce637fe640 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b3da10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce54005940 tx=0x7fce54005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=340b3d064b7ab010 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce63fff640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 0x7fce4c0a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0049d0 tx=0x7fce5c015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce49ffb640 1 -- 172.21.15.52:0/1778714997 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54040070 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce49ffb640 1 -- 172.21.15.52:0/1778714997 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce540318f0 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce49ffb640 1 -- 172.21.15.52:0/1778714997 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54035040 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 -- 172.21.15.52:0/1778714997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 msgr2=0x55fbc4b3da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b3da10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fce54005940 tx=0x7fce54005e00 comp rx=0 tx=0).stop 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 -- 172.21.15.52:0/1778714997 shutdown_connections 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b3da10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/1778714997 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b3d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 -- 172.21.15.52:0/1778714997 >> 172.21.15.52:0/1778714997 conn(0x55fbc4b06310 msgr2=0x55fbc4b39c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 -- 172.21.15.52:0/1778714997 shutdown_connections 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.487+0000 7fce6bfe8740 1 -- 172.21.15.52:0/1778714997 wait complete. 2024-09-19T09:31:33.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 -- start start 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 Processor -- start 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b47d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b45530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4b4b010 con 0x55fbc4b3eb40 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4a5e060 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4b4b190 con 0x55fbc4b48370 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce6bfe8740 10 client.0 _ll_register_callbacks cb 0x55fbc47b18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49028/0 (socket says 172.21.15.52:49028) 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce637fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b47d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce62ffd640 1 -- 172.21.15.52:0/288850723 learned_addr learned my addr 172.21.15.52:0/288850723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.488+0000 7fce63fff640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b45530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 -- 172.21.15.52:0/288850723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 msgr2=0x55fbc4b45530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b45530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 -- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 msgr2=0x55fbc4b47d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b47d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 -- 172.21.15.52:0/288850723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc48143c0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce62ffd640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fce580cccc0 tx=0x7fce580056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6183078abcbdb9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5809b320 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce58099ae0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce540318f0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce580b9050 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce6bfe8740 10 client.18900 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fbc4b56af0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce540318f0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.489+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce58097e50 con 0x55fbc4b3eb40 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 10 client.18900 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 10 client.18900 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 20 client.18900 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4b58020 0x55fbc4b5a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 4 client.18900 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbc4ab0860 con 0x55fbc4b58020 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce637fe640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4b58020 0x55fbc4b5a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce42ffd640 10 client.18900 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.490+0000 7fce637fe640 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4b58020 0x55fbc4b5a460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=855fe1ce9e49596 server_cookie=19e1fbe71f3aa39f in_seq=0 out_seq=0 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce42ffd640 1 -- 172.21.15.52:0/288850723 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbc4ab0860 con 0x55fbc4b58020 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce42ffd640 10 client.18900 handle_command_reply: tid=0 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 client.18900 shutdown 2024-09-19T09:31:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 msgr2=0x55fbc4b44fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fce580cccc0 tx=0x7fce580056c0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 shutdown_connections 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b45530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44fb0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4b58020 0x55fbc4b5a460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/288850723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b47d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce42ffd640 0 client.18900 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 >> 172.21.15.52:0/288850723 conn(0x55fbc4b06310 msgr2=0x55fbc4b3f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 shutdown_connections 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 1 -- 172.21.15.52:0/288850723 wait complete. 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.491+0000 7fce6bfe8740 20 client.18900 trim_cache size 0 max 16384 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 Processor -- start 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 -- start start 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce641b2260 con 0x55fbc4b48370 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce641afb30 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce641ad980 con 0x55fbc4b3eb40 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49038/0 (socket says 172.21.15.52:49038) 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.504+0000 7fce63fff640 1 -- 172.21.15.52:0/3856481432 learned_addr learned my addr 172.21.15.52:0/3856481432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:33.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce637fe640 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce62ffd640 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 -- 172.21.15.52:0/3856481432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b3eb40 msgr2=0x55fbc4b44870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 -- 172.21.15.52:0/3856481432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 msgr2=0x55fbc4b542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 -- 172.21.15.52:0/3856481432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc4b43500 con 0x55fbc4b48370 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce63fff640 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0122c0 tx=0x7fce5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf93385dd669ca95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce497fa640 1 -- 172.21.15.52:0/3856481432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c01d680 con 0x55fbc4b48370 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce497fa640 1 -- 172.21.15.52:0/3856481432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce5c01dd00 con 0x55fbc4b48370 2024-09-19T09:31:33.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.505+0000 7fce497fa640 1 -- 172.21.15.52:0/3856481432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c010d00 con 0x55fbc4b48370 2024-09-19T09:31:33.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3856481432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 msgr2=0x55fbc4b5fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0122c0 tx=0x7fce5c017000 comp rx=0 tx=0).stop 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3856481432 shutdown_connections 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b48370 0x55fbc4b5fc40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b44870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3856481432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3856481432 >> 172.21.15.52:0/3856481432 conn(0x55fbc4b06310 msgr2=0x55fbc4b47030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3856481432 shutdown_connections 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3856481432 wait complete. 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.506+0000 7fce6bfe8740 1 -- start start 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 Processor -- start 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b50710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce641adff0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce641af460 con 0x55fbc4b3d5d0 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fce641ae6c0 con 0x55fbc4b48370 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce6bfe8740 10 client.0 _ll_register_callbacks cb 0x7fce58097420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49046/0 (socket says 172.21.15.52:49046) 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce62ffd640 1 -- 172.21.15.52:0/3074962919 learned_addr learned my addr 172.21.15.52:0/3074962919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce637fe640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b50710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.507+0000 7fce63fff640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 -- 172.21.15.52:0/3074962919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 msgr2=0x55fbc4b4baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 -- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 msgr2=0x55fbc4b50710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b50710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 -- 172.21.15.52:0/3074962919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc4b4c320 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce637fe640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b50710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce62ffd640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fce58097c40 tx=0x7fce580a4010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacb935b2b4337bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5809b140 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce5809ae30 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce5c01dd00 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fce5809b320 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce6bfe8740 10 client.18906 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.508+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fbc4bc27b0 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce5c01dd00 con 0x55fbc4b3eb40 2024-09-19T09:31:33.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fce58097530 con 0x55fbc4b3eb40 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 10 client.18906 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 10 client.18906 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 20 client.18906 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4bc2ef0 0x55fbc4bc5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 4 client.18906 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbc4aaad70 con 0x55fbc4bc2ef0 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce637fe640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4bc2ef0 0x55fbc4bc5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce637fe640 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4bc2ef0 0x55fbc4bc5310 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1cd30947d2c0e608 server_cookie=ec3508986abe4a02 in_seq=0 out_seq=0 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.509+0000 7fce42ffd640 10 client.18906 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce42ffd640 1 -- 172.21.15.52:0/3074962919 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbc4aaad70 con 0x55fbc4bc2ef0 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce42ffd640 10 client.18906 handle_command_reply: tid=0 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 client.18906 shutdown 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 msgr2=0x55fbc4b50c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fce58097c40 tx=0x7fce580a4010 comp rx=0 tx=0).stop 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 shutdown_connections 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fbc4b48370 0x55fbc4b4baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fbc4b3eb40 0x55fbc4b50c50 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55fbc4bc2ef0 0x55fbc4bc5310 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce42ffd640 0 client.18906 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 --2- 172.21.15.52:0/3074962919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fbc4b3d5d0 0x55fbc4b50710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 >> 172.21.15.52:0/3074962919 conn(0x55fbc4b06310 msgr2=0x55fbc4b43750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 shutdown_connections 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 1 -- 172.21.15.52:0/3074962919 wait complete. 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.510+0000 7fce6bfe8740 20 client.18906 trim_cache size 0 max 16384 2024-09-19T09:31:33.525 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:33.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 msgr2=0x7fce4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 0x7fce4c0a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0049d0 tx=0x7fce5c015040 comp rx=0 tx=0).stop 2024-09-19T09:31:33.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 msgr2=0x7fce64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:33.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fce5800d950 tx=0x7fce5800de10 comp rx=0 tx=0).stop 2024-09-19T09:31:33.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 shutdown_connections 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce4c0a3240 0x7fce4c0a5700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fce6410c170 0x7fce64101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce64103660 0x7fce64100ee0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 --2- 172.21.15.52:0/1191839393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fce64102d40 0x7fce641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 >> 172.21.15.52:0/1191839393 conn(0x7fce640fc7a0 msgr2=0x7fce640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 shutdown_connections 2024-09-19T09:31:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:33.511+0000 7fce69c0f640 1 -- 172.21.15.52:0/1191839393 wait complete. 2024-09-19T09:31:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:33 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:33.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:33 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:33 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:34.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:31:35.083 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:35.459 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:35 smithi052 ceph-mon[30947]: pgmap v642: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:35.460 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.460 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.460 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.460 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:35 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:35 smithi086 ceph-mon[34813]: pgmap v642: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:35 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 -- 172.21.15.52:0/1647880852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 msgr2=0x7f02f81006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 --2- 172.21.15.52:0/1647880852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f81006d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009930 tx=0x7f02e802a420 comp rx=0 tx=0).stop 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 -- 172.21.15.52:0/1647880852 shutdown_connections 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 --2- 172.21.15.52:0/1647880852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 --2- 172.21.15.52:0/1647880852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 0x7f02f8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.543+0000 7f02fe52e640 1 --2- 172.21.15.52:0/1647880852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f81006d0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.544+0000 7f02fe52e640 1 -- 172.21.15.52:0/1647880852 >> 172.21.15.52:0/1647880852 conn(0x7f02f8077210 msgr2=0x7f02f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.544+0000 7f02fe52e640 1 -- 172.21.15.52:0/1647880852 shutdown_connections 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.544+0000 7f02fe52e640 1 -- 172.21.15.52:0/1647880852 wait complete. 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.544+0000 7f02fe52e640 1 Processor -- start 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.544+0000 7f02fe52e640 1 -- start start 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 0x7f02f81017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f8101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8111fa0 con 0x7f02f81002f0 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8111e20 con 0x7f02f8106f50 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02f8112120 con 0x7f02f8100ca0 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49064/0 (socket says 172.21.15.52:49064) 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 -- 172.21.15.52:0/626242053 learned_addr learned my addr 172.21.15.52:0/626242053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f77fe640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 0x7f02f81017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fcacb640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f8101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 -- 172.21.15.52:0/626242053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 msgr2=0x7f02f81017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 0x7f02f81017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 -- 172.21.15.52:0/626242053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 msgr2=0x7f02f8101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f8101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 -- 172.21.15.52:0/626242053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f81a68a0 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fcacb640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f8101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f7fff640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009a50 tx=0x7f02e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f57fa640 1 -- 172.21.15.52:0/626242053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e803f030 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f57fa640 1 -- 172.21.15.52:0/626242053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e8003ad0 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f81a6b30 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.545+0000 7f02f57fa640 1 -- 172.21.15.52:0/626242053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8035070 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.546+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f81a7010 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02f57fa640 1 -- 172.21.15.52:0/626242053 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f02e8042030 con 0x7f02f81002f0 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 Processor -- start 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 -- start start 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f14b40 0x5648c9f13090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f20760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e792f0 con 0x5648c9f135d0 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e20cf0 con 0x5648c9f14b40 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f0300907740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e752b0 con 0x5648c9f1e370 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49066/0 (socket says 172.21.15.52:49066) 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02f7fff640 1 -- 172.21.15.52:0/2715649155 learned_addr learned my addr 172.21.15.52:0/2715649155 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02f77fe640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f20760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.548+0000 7f02fcacb640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f14b40 0x5648c9f13090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f57fa640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 0x7f02e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02fcacb640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 0x7f02e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 -- 172.21.15.52:0/2715649155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f14b40 msgr2=0x5648c9f13090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f14b40 0x5648c9f13090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 -- 172.21.15.52:0/2715649155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 msgr2=0x5648c9f13a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 -- 172.21.15.52:0/2715649155 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c9e053a0 con 0x5648c9f1e370 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f7fff640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f57fa640 1 -- 172.21.15.52:0/626242053 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02e80f0060 con 0x7f02f81002f0 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02f77fe640 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f20760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02f806a100 tx=0x7f02ec00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f9d40689b6cc89f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02fcacb640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 0x7f02e00a5700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005cc0 tx=0x7f02f0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02de7fc640 1 -- 172.21.15.52:0/2715649155 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec005220 con 0x5648c9f1e370 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02de7fc640 1 -- 172.21.15.52:0/2715649155 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ec004c80 con 0x5648c9f1e370 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.549+0000 7f02de7fc640 1 -- 172.21.15.52:0/2715649155 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0187b0 con 0x5648c9f1e370 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- 172.21.15.52:0/2715649155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 msgr2=0x5648c9f20760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f20760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02f806a100 tx=0x7f02ec00f790 comp rx=0 tx=0).stop 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- 172.21.15.52:0/2715649155 shutdown_connections 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f20760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f135d0 0x5648c9f13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 --2- 172.21.15.52:0/2715649155 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f14b40 0x5648c9f13090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- 172.21.15.52:0/2715649155 >> 172.21.15.52:0/2715649155 conn(0x5648c9edc310 msgr2=0x5648c9f0fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- 172.21.15.52:0/2715649155 shutdown_connections 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- 172.21.15.52:0/2715649155 wait complete. 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.550+0000 7f0300907740 1 -- start start 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 Processor -- start 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f1dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f1b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5648c9f21070 con 0x5648c9f14b40 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e34060 con 0x5648c9f135d0 2024-09-19T09:31:35.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5648c9f211f0 con 0x5648c9f1e370 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f0300907740 10 client.0 _ll_register_callbacks cb 0x5648c9b878c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49070/0 (socket says 172.21.15.52:49070) 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 -- 172.21.15.52:0/1056003661 learned_addr learned my addr 172.21.15.52:0/1056003661 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f1dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 -- 172.21.15.52:0/1056003661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 msgr2=0x5648c9f1b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f1b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 -- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 msgr2=0x5648c9f1dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f1dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.551+0000 7f02f77fe640 1 -- 172.21.15.52:0/1056003661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c9bea3c0 con 0x5648c9f14b40 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f02ec005700 tx=0x7f02ec004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df34ac057943ff88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f02d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec027070 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02ec0186c0 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02ec004c80 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02ec033050 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f0300907740 10 client.18918 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.552+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5648c9f2cab0 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ec004c80 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02ec023430 con 0x5648c9f14b40 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 10 client.18918 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 10 client.18918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 20 client.18918 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f2de60 0x5648c9f30250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 4 client.18918 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:35.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648c9e86860 con 0x5648c9f2de60 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f2de60 0x5648c9f30250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f2de60 0x5648c9f30250 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a5c61a6a4d9cba server_cookie=2069f9bf196f92c2 in_seq=0 out_seq=0 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.553+0000 7f02d77fe640 10 client.18918 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f02d77fe640 1 -- 172.21.15.52:0/1056003661 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648c9e86860 con 0x5648c9f2de60 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f02d77fe640 10 client.18918 handle_command_reply: tid=0 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 client.18918 shutdown 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 msgr2=0x5648c9f1af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f02ec005700 tx=0x7f02ec004970 comp rx=0 tx=0).stop 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 shutdown_connections 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f2de60 0x5648c9f30250 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f1e370 0x5648c9f1b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f1af70 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 --2- 172.21.15.52:0/1056003661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f1dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f02d77fe640 0 client.18918 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 >> 172.21.15.52:0/1056003661 conn(0x5648c9edc310 msgr2=0x5648c9f15930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 shutdown_connections 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.554+0000 7f0300907740 1 -- 172.21.15.52:0/1056003661 wait complete. 2024-09-19T09:31:35.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.555+0000 7f0300907740 20 client.18918 trim_cache size 0 max 16384 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 Processor -- start 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 -- start start 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f2a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 0x5648c9f35900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81b2220 con 0x5648c9f1e370 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81afaf0 con 0x5648c9f135d0 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f0300907740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81ad940 con 0x5648c9f14b40 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f02fcacb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f02fcacb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49074/0 (socket says 172.21.15.52:49074) 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f02fcacb640 1 -- 172.21.15.52:0/1473539838 learned_addr learned my addr 172.21.15.52:0/1473539838 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.568+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 0x5648c9f35900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f2a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 -- 172.21.15.52:0/1473539838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 msgr2=0x5648c9f35900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 0x5648c9f35900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 -- 172.21.15.52:0/1473539838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 msgr2=0x5648c9f2a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f2a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 -- 172.21.15.52:0/1473539838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c9f10df0 con 0x5648c9f1e370 2024-09-19T09:31:35.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 0x5648c9f35900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f02f00143b0 tx=0x7f02f0008730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df82f86ca0ff0c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02ddffb640 1 -- 172.21.15.52:0/1473539838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f001b030 con 0x5648c9f1e370 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02ddffb640 1 -- 172.21.15.52:0/1473539838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f001c040 con 0x5648c9f1e370 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.569+0000 7f02ddffb640 1 -- 172.21.15.52:0/1473539838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0005440 con 0x5648c9f1e370 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- 172.21.15.52:0/1473539838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 msgr2=0x5648c9f35e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f02f00143b0 tx=0x7f02f0008730 comp rx=0 tx=0).stop 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- 172.21.15.52:0/1473539838 shutdown_connections 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f1e370 0x5648c9f35e40 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f14b40 0x5648c9f35900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 --2- 172.21.15.52:0/1473539838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f135d0 0x5648c9f2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- 172.21.15.52:0/1473539838 >> 172.21.15.52:0/1473539838 conn(0x5648c9edc310 msgr2=0x5648c9f1cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- 172.21.15.52:0/1473539838 shutdown_connections 2024-09-19T09:31:35.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- 172.21.15.52:0/1473539838 wait complete. 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.570+0000 7f0300907740 1 -- start start 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 Processor -- start 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 0x5648c9f26570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 0x5648c9f229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81adfb0 con 0x5648c9f14b40 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81af420 con 0x5648c9f1e370 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02f81ae680 con 0x5648c9f135d0 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f0300907740 10 client.0 _ll_register_callbacks cb 0x7f02e80f3aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f02f77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49078/0 (socket says 172.21.15.52:49078) 2024-09-19T09:31:35.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f02f77fe640 1 -- 172.21.15.52:0/1128664005 learned_addr learned my addr 172.21.15.52:0/1128664005 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 0x5648c9f229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.571+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 0x5648c9f26570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 -- 172.21.15.52:0/1128664005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 msgr2=0x5648c9f26570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 0x5648c9f26570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 -- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 msgr2=0x5648c9f229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 0x5648c9f229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 -- 172.21.15.52:0/1128664005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c9f231e0 con 0x5648c9f14b40 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 0x5648c9f26570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02fcacb640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 0x5648c9f229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02f77fe640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00f7d0 tx=0x7f02ec00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f5e83e30ee2734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec027040 con 0x5648c9f14b40 2024-09-19T09:31:35.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02ec023430 con 0x5648c9f14b40 2024-09-19T09:31:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02f001c040 con 0x5648c9f14b40 2024-09-19T09:31:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02ec005730 con 0x5648c9f14b40 2024-09-19T09:31:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f0300907740 10 client.18924 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.572+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5648c9f993c0 con 0x5648c9f14b40 2024-09-19T09:31:35.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02f001c040 con 0x5648c9f14b40 2024-09-19T09:31:35.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02ec040670 con 0x5648c9f14b40 2024-09-19T09:31:35.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 10 client.18924 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:35.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 10 client.18924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:35.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 20 client.18924 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f99a20 0x5648c9f9be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 4 client.18924 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648c9e80d70 con 0x5648c9f99a20 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.573+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f99a20 0x5648c9f9be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f02f7fff640 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f99a20 0x5648c9f9be40 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c725d9ceef693f9a server_cookie=4e5fb2561fece5d9 in_seq=0 out_seq=0 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f02d77fe640 10 client.18924 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f02d77fe640 1 -- 172.21.15.52:0/1128664005 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648c9e80d70 con 0x5648c9f99a20 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f02d77fe640 10 client.18924 handle_command_reply: tid=0 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 client.18924 shutdown 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 msgr2=0x5648c9f26ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00f7d0 tx=0x7f02ec00fd40 comp rx=0 tx=0).stop 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 shutdown_connections 2024-09-19T09:31:35.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5648c9f99a20 0x5648c9f9be40 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5648c9f1e370 0x5648c9f229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5648c9f14b40 0x5648c9f26ab0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.574+0000 7f0300907740 1 --2- 172.21.15.52:0/1128664005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5648c9f135d0 0x5648c9f26570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f02d77fe640 0 client.18924 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 >> 172.21.15.52:0/1128664005 conn(0x5648c9edc310 msgr2=0x5648c9f19710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 shutdown_connections 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f0300907740 1 -- 172.21.15.52:0/1128664005 wait complete. 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f0300907740 20 client.18924 trim_cache size 0 max 16384 2024-09-19T09:31:35.581 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 msgr2=0x7f02e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 0x7f02e00a5700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f02f0005cc0 tx=0x7f02f0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 msgr2=0x7f02f8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.575+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009a50 tx=0x7f02e8004270 comp rx=0 tx=0).stop 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 shutdown_connections 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02f8106f50 0x7f02f8101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02e00a3240 0x7f02e00a5700 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02f8100ca0 0x7f02f81017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 --2- 172.21.15.52:0/626242053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02f81002f0 0x7f02f8101270 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:35.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 >> 172.21.15.52:0/626242053 conn(0x7f02f8077210 msgr2=0x7f02f8105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:35.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 shutdown_connections 2024-09-19T09:31:35.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:35.576+0000 7f02fe52e640 1 -- 172.21.15.52:0/626242053 wait complete. 2024-09-19T09:31:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:35 smithi169 ceph-mon[35454]: pgmap v642: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:35 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.214 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:31:37.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:31:37.473 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: pgmap v643: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.595 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: pgmap v643: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-19T09:31:37.596 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.596 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.596 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:37.596 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:37.596 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: pgmap v643: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 -- 172.21.15.52:0/1829620015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0101440 msgr2=0x7fd6a010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/1829620015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0101440 0x7fd6a010df30 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fd694009900 tx=0x7fd69402a410 comp rx=0 tx=0).stop 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 -- 172.21.15.52:0/1829620015 shutdown_connections 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/1829620015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 0x7fd6a0110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/1829620015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0101440 0x7fd6a010df30 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/1829620015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0100b20 0x7fd6a0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 -- 172.21.15.52:0/1829620015 >> 172.21.15.52:0/1829620015 conn(0x7fd6a00fc7d0 msgr2=0x7fd6a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 -- 172.21.15.52:0/1829620015 shutdown_connections 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.937+0000 7fd6a56b7640 1 -- 172.21.15.52:0/1829620015 wait complete. 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 Processor -- start 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 -- start start 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0101440 0x7fd6a019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 0x7fd6a019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0114270 con 0x7fd6a0100b20 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01140f0 con 0x7fd6a0101440 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd6a56b7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01143f0 con 0x7fd6a010e500 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.938+0000 7fd69effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49104/0 (socket says 172.21.15.52:49104) 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 -- 172.21.15.52:0/2947428407 learned_addr learned my addr 172.21.15.52:0/2947428407 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:37.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 0x7fd6a019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0101440 0x7fd6a019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 -- 172.21.15.52:0/2947428407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 msgr2=0x7fd6a019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 0x7fd6a019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 -- 172.21.15.52:0/2947428407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0101440 msgr2=0x7fd6a019ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0101440 0x7fd6a019ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 -- 172.21.15.52:0/2947428407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a019e740 con 0x7fd6a0100b20 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd69effd640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c890 tx=0x7fd69000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd687fff640 1 -- 172.21.15.52:0/2947428407 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690004220 con 0x7fd6a0100b20 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd687fff640 1 -- 172.21.15.52:0/2947428407 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6900043c0 con 0x7fd6a0100b20 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a019ea30 con 0x7fd6a0100b20 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd687fff640 1 -- 172.21.15.52:0/2947428407 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900049e0 con 0x7fd6a0100b20 2024-09-19T09:31:37.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.939+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a01a73a0 con 0x7fd6a0100b20 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd687fff640 1 -- 172.21.15.52:0/2947428407 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd6900079b0 con 0x7fd6a0100b20 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 Processor -- start 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 -- start start 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13653b60 0x55ad13653f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 0x55ad1365e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ad135b9280 con 0x55ad1365ed40 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ad13560b10 con 0x55ad13654480 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.942+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad135b5240 con 0x55ad13653b60 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49110/0 (socket says 172.21.15.52:49110) 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2819550472 learned_addr learned my addr 172.21.15.52:0/2819550472 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13653b60 0x55ad13653f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd687fff640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 0x7fd6880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69effd640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 0x55ad1365e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2819550472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13653b60 msgr2=0x55ad13653f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13653b60 0x55ad13653f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2819550472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 msgr2=0x55ad1365e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 0x55ad1365e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2819550472 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad1356d1f0 con 0x55ad1365ed40 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 0x7fd6880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69effd640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 0x55ad1365e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd687fff640 1 -- 172.21.15.52:0/2947428407 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd6900cf980 con 0x7fd6a0100b20 2024-09-19T09:31:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006a140 tx=0x7fd694031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b516724c54fcf68e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd6857fa640 1 -- 172.21.15.52:0/2819550472 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040070 con 0x55ad1365ed40 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd6857fa640 1 -- 172.21.15.52:0/2819550472 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694005020 con 0x55ad1365ed40 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd6857fa640 1 -- 172.21.15.52:0/2819550472 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694035040 con 0x55ad1365ed40 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.943+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 0x7fd6880a5700 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0069760 tx=0x7fd698004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2819550472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 msgr2=0x55ad13661130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd6a006a140 tx=0x7fd694031630 comp rx=0 tx=0).stop 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2819550472 shutdown_connections 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad1365ed40 0x55ad13661130 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13654480 0x55ad1365e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2819550472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13653b60 0x55ad13653f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2819550472 >> 172.21.15.52:0/2819550472 conn(0x55ad136500f0 msgr2=0x55ad136504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2819550472 shutdown_connections 2024-09-19T09:31:37.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.944+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2819550472 wait complete. 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 -- start start 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 Processor -- start 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad1365bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad1365c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ad13661910 con 0x55ad13654480 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ad13573f10 con 0x55ad13653b60 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ad13661a90 con 0x55ad1365ed40 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd6a7a90740 10 client.0 _ll_register_callbacks cb 0x55ad1353ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49118/0 (socket says 172.21.15.52:49118) 2024-09-19T09:31:37.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2758796638 learned_addr learned my addr 172.21.15.52:0/2758796638 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69effd640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad1365bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad1365c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.945+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2758796638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 msgr2=0x55ad1365c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad1365c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 msgr2=0x55ad1365bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad1365bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69e7fc640 1 -- 172.21.15.52:0/2758796638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad1332a6a0 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad1365c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69effd640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad1365bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd694005940 tx=0x7fd694005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3bdd739fa32fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040030 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd6940055f0 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd694005020 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd694053020 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd6a7a90740 10 client.18936 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ad1366d4a0 con 0x55ad13654480 2024-09-19T09:31:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694005020 con 0x55ad13654480 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.946+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd69403cbe0 con 0x55ad13654480 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 10 client.18936 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 10 client.18936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 20 client.18936 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad13670be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 4 client.18936 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad135c67f0 con 0x55ad1366e7f0 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd69effd640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad13670be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd69effd640 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad13670be0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dca8de4832abad3 server_cookie=731188fd3c2d100e in_seq=0 out_seq=0 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.947+0000 7fd682ff5640 10 client.18936 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd682ff5640 1 -- 172.21.15.52:0/2758796638 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad135c67f0 con 0x55ad1366e7f0 2024-09-19T09:31:37.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd682ff5640 10 client.18936 handle_command_reply: tid=0 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 client.18936 shutdown 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 msgr2=0x55ad1365c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd694005940 tx=0x7fd694005400 comp rx=0 tx=0).stop 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 shutdown_connections 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad13670be0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad1365c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad1365c0e0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd682ff5640 0 client.18936 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2758796638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad1365bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 >> 172.21.15.52:0/2758796638 conn(0x55ad136500f0 msgr2=0x55ad13655dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 shutdown_connections 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2758796638 wait complete. 2024-09-19T09:31:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.948+0000 7fd6a7a90740 20 client.18936 trim_cache size 0 max 16384 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.965+0000 7fd6a7a90740 1 Processor -- start 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.965+0000 7fd6a7a90740 1 -- start start 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 0x55ad13673c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 0x55ad13674140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01b22d0 con 0x55ad13653b60 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01afba0 con 0x55ad1365ed40 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01ad9f0 con 0x55ad13654480 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49124/0 (socket says 172.21.15.52:49124) 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 -- 172.21.15.52:0/2084156991 learned_addr learned my addr 172.21.15.52:0/2084156991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 0x55ad13673c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 0x55ad13674140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 -- 172.21.15.52:0/2084156991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 msgr2=0x55ad13673c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 0x55ad13673c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 -- 172.21.15.52:0/2084156991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 msgr2=0x55ad13674140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 0x55ad13674140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 -- 172.21.15.52:0/2084156991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad136542b0 con 0x55ad13653b60 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 0x55ad13673c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:37.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 0x55ad13674140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd69effd640 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd6900cd3a0 tx=0x7fd6900cd270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfe17b74798e2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd684ff9640 1 -- 172.21.15.52:0/2084156991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69001d040 con 0x55ad13653b60 2024-09-19T09:31:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd684ff9640 1 -- 172.21.15.52:0/2084156991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6900a4b30 con 0x55ad13653b60 2024-09-19T09:31:37.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.966+0000 7fd684ff9640 1 -- 172.21.15.52:0/2084156991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6900a4900 con 0x55ad13653b60 2024-09-19T09:31:37.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2084156991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 msgr2=0x55ad13655cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd6900cd3a0 tx=0x7fd6900cd270 comp rx=0 tx=0).stop 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2084156991 shutdown_connections 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad1365ed40 0x55ad13674140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad13654480 0x55ad13673c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/2084156991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13653b60 0x55ad13655cc0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2084156991 >> 172.21.15.52:0/2084156991 conn(0x55ad136500f0 msgr2=0x55ad136555b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2084156991 shutdown_connections 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- 172.21.15.52:0/2084156991 wait complete. 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 -- start start 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.967+0000 7fd6a7a90740 1 Processor -- start 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad13672270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad136d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01ae060 con 0x55ad13654480 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01af4d0 con 0x55ad13653b60 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a01ae730 con 0x55ad1365ed40 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd6a7a90740 10 client.0 _ll_register_callbacks cb 0x7fd698009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49140/0 (socket says 172.21.15.52:49140) 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 -- 172.21.15.52:0/4105042463 learned_addr learned my addr 172.21.15.52:0/4105042463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69f7fe640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad136d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69effd640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad13672270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 -- 172.21.15.52:0/4105042463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 msgr2=0x55ad136d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad136d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 -- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 msgr2=0x55ad13672270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:37.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad13672270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 -- 172.21.15.52:0/4105042463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad136d2810 con 0x55ad13654480 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd69e7fc640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd694031920 tx=0x7fd694009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d47e2577fb03ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd682ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.968+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694040070 con 0x55ad13654480 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.969+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6900a4b30 con 0x55ad13654480 2024-09-19T09:31:37.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.969+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd694058850 con 0x55ad13654480 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.970+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd694035070 con 0x55ad13654480 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.970+0000 7fd6a7a90740 10 client.18942 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.970+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ad136d9bc0 con 0x55ad13654480 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6900a4b30 con 0x55ad13654480 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd69403c4d0 con 0x55ad13654480 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 10 client.18942 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 10 client.18942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 20 client.18942 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad136dc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:37.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 4 client.18942 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:31:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.973+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ad135c0d00 con 0x55ad1366e7f0 2024-09-19T09:31:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.974+0000 7fd69effd640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad136dc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.974+0000 7fd69effd640 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad136dc380 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24320d3c133e2fc5 server_cookie=97db66302ab8c2d5 in_seq=0 out_seq=0 2024-09-19T09:31:37.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.974+0000 7fd682ff5640 10 client.18942 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:37.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd682ff5640 1 -- 172.21.15.52:0/4105042463 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ad135c0d00 con 0x55ad1366e7f0 2024-09-19T09:31:37.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd682ff5640 10 client.18942 handle_command_reply: tid=0 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 client.18942 shutdown 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 msgr2=0x55ad136727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd694031920 tx=0x7fd694009520 comp rx=0 tx=0).stop 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 shutdown_connections 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ad1366e7f0 0x55ad136dc380 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ad1365ed40 0x55ad136d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ad13654480 0x55ad136727b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 --2- 172.21.15.52:0/4105042463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ad13653b60 0x55ad13672270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 >> 172.21.15.52:0/4105042463 conn(0x55ad136500f0 msgr2=0x55ad1364f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd682ff5640 0 client.18942 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.975+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 shutdown_connections 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a7a90740 1 -- 172.21.15.52:0/4105042463 wait complete. 2024-09-19T09:31:37.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a7a90740 20 client.18942 trim_cache size 0 max 16384 2024-09-19T09:31:37.978 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:37.978 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:31:37.978 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b1941145-48e6-47e2-8edf-5a869f28ec47", 2024-09-19T09:31:37.978 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:31:37.978 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 msgr2=0x7fd6880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 0x7fd6880a5700 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0069760 tx=0x7fd698004a40 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 msgr2=0x7fd6a019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c890 tx=0x7fd69000cd50 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 shutdown_connections 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd6880a3240 0x7fd6880a5700 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6a010e500 0x7fd6a019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6a0101440 0x7fd6a019ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 --2- 172.21.15.52:0/2947428407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd6a0100b20 0x7fd6a019a7f0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 >> 172.21.15.52:0/2947428407 conn(0x7fd6a00fc7d0 msgr2=0x7fd6a010f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 shutdown_connections 2024-09-19T09:31:37.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:37.976+0000 7fd6a56b7640 1 -- 172.21.15.52:0/2947428407 wait complete. 2024-09-19T09:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 -- 172.21.15.52:0/2298069738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14101036f0 msgr2=0x7f1410109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 --2- 172.21.15.52:0/2298069738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14101036f0 0x7f1410109f80 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f1408009ca0 tx=0x7f140802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 -- 172.21.15.52:0/2298069738 shutdown_connections 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 --2- 172.21.15.52:0/2298069738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f14101036f0 0x7f1410109f80 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 --2- 172.21.15.52:0/2298069738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410102d30 0x7f14101031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 --2- 172.21.15.52:0/2298069738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1410101b40 0x7f1410101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 -- 172.21.15.52:0/2298069738 >> 172.21.15.52:0/2298069738 conn(0x7f14100fd2e0 msgr2=0x7f14100ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 -- 172.21.15.52:0/2298069738 shutdown_connections 2024-09-19T09:31:38.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.406+0000 7f1414b31640 1 -- 172.21.15.52:0/2298069738 wait complete. 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 Processor -- start 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 -- start start 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410101b40 0x7f1410197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14101036f0 0x7f141019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f141010d820 con 0x7f1410102d30 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f141010d6a0 con 0x7f14101036f0 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f1414b31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f141010d9a0 con 0x7f1410101b40 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37050/0 (socket says 172.21.15.52:37050) 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.407+0000 7f140dd9b640 1 -- 172.21.15.52:0/2736997249 learned_addr learned my addr 172.21.15.52:0/2736997249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:38.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140ed9d640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14101036f0 0x7f141019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140e59c640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410101b40 0x7f1410197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 -- 172.21.15.52:0/2736997249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410101b40 msgr2=0x7f1410197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410101b40 0x7f1410197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 -- 172.21.15.52:0/2736997249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14101036f0 msgr2=0x7f141019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14101036f0 0x7f141019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 -- 172.21.15.52:0/2736997249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141019fa40 con 0x7f1410102d30 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f140dd9b640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f140400b4a0 tx=0x7f140400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f13ff7fe640 1 -- 172.21.15.52:0/2736997249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404014070 con 0x7f1410102d30 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f13ff7fe640 1 -- 172.21.15.52:0/2736997249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1404010af0 con 0x7f1410102d30 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141019fd30 con 0x7f1410102d30 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f13ff7fe640 1 -- 172.21.15.52:0/2736997249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404017d10 con 0x7f1410102d30 2024-09-19T09:31:38.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.408+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14101a0250 con 0x7f1410102d30 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f13ff7fe640 1 -- 172.21.15.52:0/2736997249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1404017070 con 0x7f1410102d30 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 Processor -- start 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 -- start start 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55baaa0492f0 con 0x55baaa0eb370 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55baa9ff1270 con 0x55baaa0e62e0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f14178cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55baaa0452b0 con 0x55baaa0e59a0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37058/0 (socket says 172.21.15.52:37058) 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.411+0000 7f140dd9b640 1 -- 172.21.15.52:0/235821682 learned_addr learned my addr 172.21.15.52:0/235821682 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f13ff7fe640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 0x7f13f80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140ed9d640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140ed9d640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 0x7f13f80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 -- 172.21.15.52:0/235821682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 msgr2=0x55baaa0e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 -- 172.21.15.52:0/235821682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 msgr2=0x55baaa0ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f13ff7fe640 1 -- 172.21.15.52:0/2736997249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f14040cecb0 con 0x7f1410102d30 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 -- 172.21.15.52:0/235821682 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa9ff0340 con 0x55baaa0e62e0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140dd9b640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140e59c640 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0eada0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1400009bf0 tx=0x7f1400011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2f3f739f22cb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f140ed9d640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 0x7f13f80a57b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1408009430 tx=0x7f1408005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f13fcff9640 1 -- 172.21.15.52:0/235821682 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400009da0 con 0x55baaa0e62e0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f13fcff9640 1 -- 172.21.15.52:0/235821682 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1400005020 con 0x55baaa0e62e0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.412+0000 7f13fcff9640 1 -- 172.21.15.52:0/235821682 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400004bc0 con 0x55baaa0e62e0 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 -- 172.21.15.52:0/235821682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 msgr2=0x55baaa0eada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0eada0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1400009bf0 tx=0x7f1400011810 comp rx=0 tx=0).stop 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 -- 172.21.15.52:0/235821682 shutdown_connections 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0eb370 0x55baaa0ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0eada0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 --2- 172.21.15.52:0/235821682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 -- 172.21.15.52:0/235821682 >> 172.21.15.52:0/235821682 conn(0x55baaa0e1010 msgr2=0x55baaa0e1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 -- 172.21.15.52:0/235821682 shutdown_connections 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.413+0000 7f14178cc740 1 -- 172.21.15.52:0/235821682 wait complete. 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 -- start start 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 Processor -- start 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0efc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa0f7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55baaa0ee340 con 0x55baaa0e62e0 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55baa9fd2290 con 0x55baaa0eb370 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55baaa0ee4c0 con 0x55baaa0e59a0 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f14178cc740 10 client.0 _ll_register_callbacks cb 0x55baaa003140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:38.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37070/0 (socket says 172.21.15.52:37070) 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 -- 172.21.15.52:0/3214727243 learned_addr learned my addr 172.21.15.52:0/3214727243 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140ed9d640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa0f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140e59c640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0efc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 -- 172.21.15.52:0/3214727243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 msgr2=0x55baaa0efc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0efc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 -- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 msgr2=0x55baaa0f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa0f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 -- 172.21.15.52:0/3214727243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa9d5c210 con 0x55baaa0e62e0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f140dd9b640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1404009420 tx=0x7f1404095ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7603d1221149614 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.414+0000 7f13f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:38.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140401e070 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1404097970 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1400005020 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f140409ac60 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 10 client.18954 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55baa9e28620 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1400005020 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1404010ca0 con 0x55baaa0e62e0 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 10 client.18954 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 10 client.18954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 20 client.18954 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa0fb880 0x55baaa0fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 4 client.18954 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.415+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baaa056a20 con 0x55baaa0fb880 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.416+0000 7f140e59c640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa0fb880 0x55baaa0fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.416+0000 7f13f5ffb640 10 client.18954 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.416+0000 7f140e59c640 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa0fb880 0x55baaa0fdcb0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=872b799b51cdcdff server_cookie=e38f0770f82ab538 in_seq=0 out_seq=0 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f13f5ffb640 1 -- 172.21.15.52:0/3214727243 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baaa056a20 con 0x55baaa0fb880 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f13f5ffb640 10 client.18954 handle_command_reply: tid=0 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 client.18954 shutdown 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 msgr2=0x55baaa0f0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1404009420 tx=0x7f1404095ec0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 shutdown_connections 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa0fb880 0x55baaa0fdcb0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa0f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f0160 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f13f5ffb640 0 client.18954 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 --2- 172.21.15.52:0/3214727243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa0efc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 >> 172.21.15.52:0/3214727243 conn(0x55baaa0e1010 msgr2=0x55baaa0e2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 shutdown_connections 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 1 -- 172.21.15.52:0/3214727243 wait complete. 2024-09-19T09:31:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.417+0000 7f14178cc740 20 client.18954 trim_cache size 0 max 16384 2024-09-19T09:31:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.431+0000 7f14178cc740 1 Processor -- start 2024-09-19T09:31:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.431+0000 7f14178cc740 1 -- start start 2024-09-19T09:31:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa102af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14101abbe0 con 0x55baaa0e62e0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14101a94b0 con 0x55baaa0eb370 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f14178cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14101a7300 con 0x55baaa0e59a0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37074/0 (socket says 172.21.15.52:37074) 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 -- 172.21.15.52:0/10374827 learned_addr learned my addr 172.21.15.52:0/10374827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140ed9d640 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa102af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140e59c640 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 -- 172.21.15.52:0/10374827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 msgr2=0x55baaa1025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa1025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 -- 172.21.15.52:0/10374827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 msgr2=0x55baaa102af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa102af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 -- 172.21.15.52:0/10374827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baaa0e1ca0 con 0x55baaa0e62e0 2024-09-19T09:31:38.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f140dd9b640 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f14040cc780 tx=0x7f1404099810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25e791de74d276b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f13f7fff640 1 -- 172.21.15.52:0/10374827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140401e070 con 0x55baaa0e62e0 2024-09-19T09:31:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f13f7fff640 1 -- 172.21.15.52:0/10374827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140409f600 con 0x55baaa0e62e0 2024-09-19T09:31:38.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.432+0000 7f13f7fff640 1 -- 172.21.15.52:0/10374827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140409f1d0 con 0x55baaa0e62e0 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- 172.21.15.52:0/10374827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 msgr2=0x55baaa0f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f14040cc780 tx=0x7f1404099810 comp rx=0 tx=0).stop 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- 172.21.15.52:0/10374827 shutdown_connections 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0eb370 0x55baaa102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e62e0 0x55baaa0f70f0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 --2- 172.21.15.52:0/10374827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0e59a0 0x55baaa1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- 172.21.15.52:0/10374827 >> 172.21.15.52:0/10374827 conn(0x55baaa0e1010 msgr2=0x55baaa0e01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- 172.21.15.52:0/10374827 shutdown_connections 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- 172.21.15.52:0/10374827 wait complete. 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 -- start start 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.433+0000 7f14178cc740 1 Processor -- start 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 0x55baaa0f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f14101a7970 con 0x55baaa0e59a0 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f14101a8de0 con 0x55baaa0e62e0 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14101a8040 con 0x55baaa0eb370 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 10 client.0 _ll_register_callbacks cb 0x7f14040092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37090/0 (socket says 172.21.15.52:37090) 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 -- 172.21.15.52:0/4170412198 learned_addr learned my addr 172.21.15.52:0/4170412198 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140dd9b640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140ed9d640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 0x55baaa0f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 -- 172.21.15.52:0/4170412198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 msgr2=0x55baaa0f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 0x55baaa0f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 -- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 msgr2=0x55baaa0f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 -- 172.21.15.52:0/4170412198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baaa0f6c40 con 0x55baaa0e59a0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140ed9d640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 0x55baaa0f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f140e59c640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1400014040 tx=0x7f1400009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4d1cea8219d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f13f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1400009ce0 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1400016040 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.434+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140409f600 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1400005460 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 10 client.18960 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55baaa166e60 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140409f600 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1400003a40 con 0x55baaa0e59a0 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 10 client.18960 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 10 client.18960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 20 client.18960 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa167630 0x55baaa169a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 4 client.18960 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55baaa0eb0c0 con 0x55baaa167630 2024-09-19T09:31:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.435+0000 7f140dd9b640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa167630 0x55baaa169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.436+0000 7f13f5ffb640 10 client.18960 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.436+0000 7f140dd9b640 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa167630 0x55baaa169a50 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba491a08c176ede0 server_cookie=aee840cde84ee626 in_seq=0 out_seq=0 2024-09-19T09:31:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f13f5ffb640 1 -- 172.21.15.52:0/4170412198 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55baaa0eb0c0 con 0x55baaa167630 2024-09-19T09:31:38.446 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f13f5ffb640 10 client.18960 handle_command_reply: tid=0 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 client.18960 shutdown 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 msgr2=0x55baaa0f5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1400014040 tx=0x7f1400009660 comp rx=0 tx=0).stop 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 shutdown_connections 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55baaa167630 0x55baaa169a50 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55baaa0eb370 0x55baaa0f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55baaa0e62e0 0x55baaa0f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f13f5ffb640 0 client.18960 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 --2- 172.21.15.52:0/4170412198 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55baaa0e59a0 0x55baaa0f5130 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 >> 172.21.15.52:0/4170412198 conn(0x55baaa0e1010 msgr2=0x55baaa0e1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 shutdown_connections 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 1 -- 172.21.15.52:0/4170412198 wait complete. 2024-09-19T09:31:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f14178cc740 20 client.18960 trim_cache size 0 max 16384 2024-09-19T09:31:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:31:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:31:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:31:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 msgr2=0x7f13f80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.445+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 0x7f13f80a57b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1408009430 tx=0x7f1408005d80 comp rx=0 tx=0).stop 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 msgr2=0x7f1410198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f140400b4a0 tx=0x7f140400b960 comp rx=0 tx=0).stop 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 shutdown_connections 2024-09-19T09:31:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14101036f0 0x7f141019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1410102d30 0x7f1410198360 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f13f80a32f0 0x7f13f80a57b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 --2- 172.21.15.52:0/2736997249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1410101b40 0x7f1410197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 >> 172.21.15.52:0/2736997249 conn(0x7f14100fd2e0 msgr2=0x7f1410106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 shutdown_connections 2024-09-19T09:31:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:38.446+0000 7f1414b31640 1 -- 172.21.15.52:0/2736997249 wait complete. 2024-09-19T09:31:38.667 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:31:38.923 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:39.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: pgmap v644: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:39.343 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:31:39.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:31:39.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:39 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:31:39.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 -- 172.21.15.52:0/2235123213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0101de0 msgr2=0x7f71c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 --2- 172.21.15.52:0/2235123213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0101de0 0x7f71c01021c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009900 tx=0x7f71b002a410 comp rx=0 tx=0).stop 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 -- 172.21.15.52:0/2235123213 shutdown_connections 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 --2- 172.21.15.52:0/2235123213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 --2- 172.21.15.52:0/2235123213 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0102790 0x7f71c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 --2- 172.21.15.52:0/2235123213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0101de0 0x7f71c01021c0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.427+0000 7f71c70fd640 1 -- 172.21.15.52:0/2235123213 >> 172.21.15.52:0/2235123213 conn(0x7f71c00fd8c0 msgr2=0x7f71c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- 172.21.15.52:0/2235123213 shutdown_connections 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- 172.21.15.52:0/2235123213 wait complete. 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 Processor -- start 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- start start 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0101de0 0x7f71c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0112010 con 0x7f71c0102790 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0111e90 con 0x7f71c0106f10 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.428+0000 7f71c70fd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0112190 con 0x7f71c0101de0 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37102/0 (socket says 172.21.15.52:37102) 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 -- 172.21.15.52:0/4280476583 learned_addr learned my addr 172.21.15.52:0/4280476583 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71c4e99640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0101de0 0x7f71c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71c569a640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 -- 172.21.15.52:0/4280476583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0101de0 msgr2=0x7f71c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0101de0 0x7f71c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 -- 172.21.15.52:0/4280476583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 msgr2=0x7f71c0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 -- 172.21.15.52:0/4280476583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c01a6a70 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71c569a640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bffff640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b4a0 tx=0x7f71b400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bdffb640 1 -- 172.21.15.52:0/4280476583 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4014070 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c01a6d60 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bdffb640 1 -- 172.21.15.52:0/4280476583 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b4010af0 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.429+0000 7f71bdffb640 1 -- 172.21.15.52:0/4280476583 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4017d10 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.430+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c01a7240 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71bdffb640 1 -- 172.21.15.52:0/4280476583 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f71b4017070 con 0x7f71c0102790 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 Processor -- start 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 -- start start 2024-09-19T09:31:39.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71bdffb640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 0x7f71a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38fdc0 0x56368a39a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a39ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56368a2f52e0 con 0x56368a38f4a0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56368a29cce0 con 0x56368a39a680 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c94d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56368a2f12a0 con 0x56368a38fdc0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c4e99640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 0x7f71a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37104/0 (socket says 172.21.15.52:37104) 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71c569a640 1 -- 172.21.15.52:0/3673541846 learned_addr learned my addr 172.21.15.52:0/3673541846 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.432+0000 7f71bdffb640 1 -- 172.21.15.52:0/4280476583 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f71b40ced60 con 0x7f71c0102790 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71bffff640 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38fdc0 0x56368a39a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a39ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 -- 172.21.15.52:0/3673541846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38fdc0 msgr2=0x56368a39a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38fdc0 0x56368a39a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 -- 172.21.15.52:0/3673541846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 msgr2=0x56368a39ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a39ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 -- 172.21.15.52:0/3673541846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368a281440 con 0x56368a38f4a0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c4e99640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 0x7f71a80a5700 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c00 tx=0x7f71b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71c569a640 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f71b80138e0 tx=0x7f71b8007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c92ff021afd7431 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71a6ffd640 1 -- 172.21.15.52:0/3673541846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b800ebf0 con 0x56368a38f4a0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71a6ffd640 1 -- 172.21.15.52:0/3673541846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b800ed90 con 0x56368a38f4a0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.433+0000 7f71a6ffd640 1 -- 172.21.15.52:0/3673541846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8010620 con 0x56368a38f4a0 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- 172.21.15.52:0/3673541846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 msgr2=0x56368a38f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f71b80138e0 tx=0x7f71b8007970 comp rx=0 tx=0).stop 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- 172.21.15.52:0/3673541846 shutdown_connections 2024-09-19T09:31:39.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a39ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38fdc0 0x56368a39a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3673541846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38f4a0 0x56368a38f880 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- 172.21.15.52:0/3673541846 >> 172.21.15.52:0/3673541846 conn(0x56368a38ba30 msgr2=0x56368a38be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- 172.21.15.52:0/3673541846 shutdown_connections 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- 172.21.15.52:0/3673541846 wait complete. 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 -- start start 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.434+0000 7f71c94d6740 1 Processor -- start 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a399f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a397760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56368a39d250 con 0x56368a38fdc0 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56368a2b0050 con 0x56368a39a680 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56368a39d3d0 con 0x56368a38f4a0 2024-09-19T09:31:39.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c94d6740 10 client.0 _ll_register_callbacks cb 0x56368a2f0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37108/0 (socket says 172.21.15.52:37108) 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 -- 172.21.15.52:0/3934423239 learned_addr learned my addr 172.21.15.52:0/3934423239 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c4e99640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a399f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71c569a640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a397760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 -- 172.21.15.52:0/3934423239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 msgr2=0x56368a399f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a399f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 -- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 msgr2=0x56368a397760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a397760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 -- 172.21.15.52:0/3934423239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368a0663c0 con 0x56368a38fdc0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f71bffff640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f71b40cc7e0 tx=0x7f71b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e748eff52e07206 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.435+0000 7f719ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:39.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b401e040 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f71b4010ca0 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b800ed90 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71b40ac020 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 10 client.18972 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56368a3a8c20 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b800ed90 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f71b4097970 con 0x56368a38fdc0 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 10 client.18972 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 10 client.18972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 20 client.18972 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a3aa4a0 0x56368a3ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 4 client.18972 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:39.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.436+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56368a302850 con 0x56368a3aa4a0 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.437+0000 7f71c4e99640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a3aa4a0 0x56368a3ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.437+0000 7f71c4e99640 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a3aa4a0 0x56368a3ac890 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a6afef8239c703 server_cookie=e8b336d678e15e55 in_seq=0 out_seq=0 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.437+0000 7f719ffff640 10 client.18972 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f719ffff640 1 -- 172.21.15.52:0/3934423239 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56368a302850 con 0x56368a3aa4a0 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f719ffff640 10 client.18972 handle_command_reply: tid=0 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 client.18972 shutdown 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 msgr2=0x56368a397220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f71b40cc7e0 tx=0x7f71b40046c0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 shutdown_connections 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a3aa4a0 0x56368a3ac890 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a39a680 0x56368a397760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a38fdc0 0x56368a397220 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 --2- 172.21.15.52:0/3934423239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a399f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f719ffff640 0 client.18972 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 >> 172.21.15.52:0/3934423239 conn(0x56368a38ba30 msgr2=0x56368a391710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 shutdown_connections 2024-09-19T09:31:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 1 -- 172.21.15.52:0/3934423239 wait complete. 2024-09-19T09:31:39.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.438+0000 7f71c94d6740 20 client.18972 trim_cache size 0 max 16384 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 Processor -- start 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 -- start start 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.455+0000 7f71c94d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b23a0 con 0x56368a39a680 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c94d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01afc70 con 0x56368a38fdc0 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c94d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01adac0 con 0x56368a38f4a0 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37118/0 (socket says 172.21.15.52:37118) 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 -- 172.21.15.52:0/2434816820 learned_addr learned my addr 172.21.15.52:0/2434816820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71bffff640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c4e99640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 -- 172.21.15.52:0/2434816820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 msgr2=0x56368a3a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 -- 172.21.15.52:0/2434816820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 msgr2=0x56368a3927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 -- 172.21.15.52:0/2434816820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56368a39d360 con 0x56368a39a680 2024-09-19T09:31:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71bffff640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71c569a640 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f71b8011d70 tx=0x7f71b8007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45511c298adcae32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71a67fc640 1 -- 172.21.15.52:0/2434816820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b800e9f0 con 0x56368a39a680 2024-09-19T09:31:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71a67fc640 1 -- 172.21.15.52:0/2434816820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b802c070 con 0x56368a39a680 2024-09-19T09:31:39.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.456+0000 7f71a67fc640 1 -- 172.21.15.52:0/2434816820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b801c420 con 0x56368a39a680 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- 172.21.15.52:0/2434816820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 msgr2=0x56368a3b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f71b8011d70 tx=0x7f71b8007bb0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- 172.21.15.52:0/2434816820 shutdown_connections 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a3b21a0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 --2- 172.21.15.52:0/2434816820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- 172.21.15.52:0/2434816820 >> 172.21.15.52:0/2434816820 conn(0x56368a38ba30 msgr2=0x56368a3920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- 172.21.15.52:0/2434816820 shutdown_connections 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- 172.21.15.52:0/2434816820 wait complete. 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.457+0000 7f71c94d6740 1 -- start start 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 Processor -- start 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01ae130 con 0x56368a39a680 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01af5a0 con 0x56368a38fdc0 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01ae800 con 0x56368a38f4a0 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c94d6740 10 client.0 _ll_register_callbacks cb 0x7f71b400b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c569a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37132/0 (socket says 172.21.15.52:37132) 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c569a640 1 -- 172.21.15.52:0/442237760 learned_addr learned my addr 172.21.15.52:0/442237760 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71c4e99640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.458+0000 7f71bffff640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 -- 172.21.15.52:0/442237760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 msgr2=0x56368a3a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 -- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 msgr2=0x56368a3a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 -- 172.21.15.52:0/442237760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56368a39e7b0 con 0x56368a39a680 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c569a640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f71b8004a80 tx=0x7f71b800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338d816bd0226566 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f719ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8007540 con 0x56368a39a680 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f71b80113d0 con 0x56368a39a680 2024-09-19T09:31:39.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b802c070 con 0x56368a39a680 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f71b803d030 con 0x56368a39a680 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c94d6740 10 client.18978 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56368a414e30 con 0x56368a39a680 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.459+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b802c070 con 0x56368a39a680 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f71b8042850 con 0x56368a39a680 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 10 client.18978 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 10 client.18978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 20 client.18978 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a4152f0 0x56368a4176e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 4 client.18978 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56368a2fcd60 con 0x56368a4152f0 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.460+0000 7f71c4e99640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a4152f0 0x56368a4176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c4e99640 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a4152f0 0x56368a4176e0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7581d38e66cad378 server_cookie=8fdda4118108c0ac in_seq=0 out_seq=0 2024-09-19T09:31:39.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f719ffff640 10 client.18978 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f719ffff640 1 -- 172.21.15.52:0/442237760 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56368a2fcd60 con 0x56368a4152f0 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f719ffff640 10 client.18978 handle_command_reply: tid=0 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 client.18978 shutdown 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 msgr2=0x56368a39df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f71b8004a80 tx=0x7f71b800e6b0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 shutdown_connections 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56368a4152f0 0x56368a4176e0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56368a39a680 0x56368a39df80 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56368a38fdc0 0x56368a3a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 --2- 172.21.15.52:0/442237760 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56368a38f4a0 0x56368a3a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 >> 172.21.15.52:0/442237760 conn(0x56368a38ba30 msgr2=0x56368a3992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f719ffff640 0 client.18978 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 shutdown_connections 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 1 -- 172.21.15.52:0/442237760 wait complete. 2024-09-19T09:31:39.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.461+0000 7f71c94d6740 20 client.18978 trim_cache size 0 max 16384 2024-09-19T09:31:39.468 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:39.468 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:31:39.468 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:31:39.468 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 msgr2=0x7f71a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 0x7f71a80a5700 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f71b0000c00 tx=0x7f71b00058d0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 msgr2=0x7f71c0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b4a0 tx=0x7f71b400b960 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 shutdown_connections 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71c0106f10 0x7f71c0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71c0102790 0x7f71c0074a30 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f71a80a3240 0x7f71a80a5700 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 --2- 172.21.15.52:0/4280476583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f71c0101de0 0x7f71c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 >> 172.21.15.52:0/4280476583 conn(0x7f71c00fd8c0 msgr2=0x7f71c00fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 shutdown_connections 2024-09-19T09:31:39.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:39.462+0000 7f71c70fd640 1 -- 172.21.15.52:0/4280476583 wait complete. 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: pgmap v644: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:39 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:31:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: pgmap v644: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:31:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:31:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:31:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:39 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:31:40.119 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:31:40.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:40.379 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:40.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.857+0000 7fa8cd268640 1 -- 172.21.15.52:0/3391961972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 msgr2=0x7fa8c8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.857+0000 7fa8cd268640 1 --2- 172.21.15.52:0/3391961972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8103110 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009900 tx=0x7fa8b802a480 comp rx=0 tx=0).stop 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 -- 172.21.15.52:0/3391961972 shutdown_connections 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 --2- 172.21.15.52:0/3391961972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c810c160 0x7fa8c810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 --2- 172.21.15.52:0/3391961972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8c8103650 0x7fa8c810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 --2- 172.21.15.52:0/3391961972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8103110 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 -- 172.21.15.52:0/3391961972 >> 172.21.15.52:0/3391961972 conn(0x7fa8c80fc7d0 msgr2=0x7fa8c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 -- 172.21.15.52:0/3391961972 shutdown_connections 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 -- 172.21.15.52:0/3391961972 wait complete. 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 Processor -- start 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.858+0000 7fa8cd268640 1 -- start start 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 0x7fa8c8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8c810c160 0x7fa8c8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8112020 con 0x7fa8c8102d30 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8111ea0 con 0x7fa8c8103650 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81121a0 con 0x7fa8c810c160 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37150/0 (socket says 172.21.15.52:37150) 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 -- 172.21.15.52:0/938714548 learned_addr learned my addr 172.21.15.52:0/938714548 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c67fc640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 0x7fa8c8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 -- 172.21.15.52:0/938714548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8c810c160 msgr2=0x7fa8c8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8c810c160 0x7fa8c8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 -- 172.21.15.52:0/938714548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 msgr2=0x7fa8c8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 0x7fa8c8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:40.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 -- 172.21.15.52:0/938714548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c81a6a50 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c67fc640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 0x7fa8c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8c6ffd640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8005ab0 tx=0x7fa8b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b803f030 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8b8003ce0 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c81a6ce0 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.859+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8035070 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.860+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c81a71c0 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.860+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c8103190 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.862+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa8b8042030 con 0x7fa8c8102d30 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.862+0000 7fa8affff640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 0x7fa8b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.862+0000 7fa8c67fc640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 0x7fa8b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:40.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.862+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa8b80f0350 con 0x7fa8c8102d30 2024-09-19T09:31:40.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.863+0000 7fa8c67fc640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 0x7fa8b00a5700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006fd0 tx=0x7fa8bc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:40.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:40.867+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8b80bcff0 con 0x7fa8c8102d30 2024-09-19T09:31:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.082+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8c8106c40 con 0x7fa8c8102d30 2024-09-19T09:31:41.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.083+0000 7fa8affff640 1 -- 172.21.15.52:0/938714548 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fa8b80bc8f0 con 0x7fa8c8102d30 2024-09-19T09:31:41.083 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:41.084 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:41.084 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 msgr2=0x7fa8b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 0x7fa8b00a5700 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc006fd0 tx=0x7fa8bc008040 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 msgr2=0x7fa8c8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8005ab0 tx=0x7fa8b80042f0 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 shutdown_connections 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8b00a3240 0x7fa8b00a5700 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8c810c160 0x7fa8c8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8c8103650 0x7fa8c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 --2- 172.21.15.52:0/938714548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8c8102d30 0x7fa8c8100990 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 >> 172.21.15.52:0/938714548 conn(0x7fa8c80fc7d0 msgr2=0x7fa8c80fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:41.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 shutdown_connections 2024-09-19T09:31:41.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:41.085+0000 7fa8cd268640 1 -- 172.21.15.52:0/938714548 wait complete. 2024-09-19T09:31:41.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:41 smithi052 ceph-mon[30947]: pgmap v645: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:31:41.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:41 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/938714548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:41 smithi086 ceph-mon[34813]: pgmap v645: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:31:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:41 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/938714548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:41.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:41 smithi169 ceph-mon[35454]: pgmap v645: 97 pgs: 97 active+clean; 1011 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T09:31:41.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:41 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/938714548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:41.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:31:42.041 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 -- 172.21.15.52:0/3624563951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c101de0 msgr2=0x7f585c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 --2- 172.21.15.52:0/3624563951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c101de0 0x7f585c1021c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f585802a410 comp rx=0 tx=0).stop 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 -- 172.21.15.52:0/3624563951 shutdown_connections 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 --2- 172.21.15.52:0/3624563951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c106f10 0x7f585c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 --2- 172.21.15.52:0/3624563951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 0x7f585c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 --2- 172.21.15.52:0/3624563951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c101de0 0x7f585c1021c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 -- 172.21.15.52:0/3624563951 >> 172.21.15.52:0/3624563951 conn(0x7f585c0fd8c0 msgr2=0x7f585c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 -- 172.21.15.52:0/3624563951 shutdown_connections 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.492+0000 7f5863768640 1 -- 172.21.15.52:0/3624563951 wait complete. 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 Processor -- start 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 -- start start 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c101de0 0x7f585c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 0x7f585c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f585c111f30 con 0x7f585c106f10 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f585c111db0 con 0x7f585c102790 2024-09-19T09:31:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5863768640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1120b0 con 0x7f585c101de0 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5861d05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5861d05640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37170/0 (socket says 172.21.15.52:37170) 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5861d05640 1 -- 172.21.15.52:0/3078166816 learned_addr learned my addr 172.21.15.52:0/3078166816 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5861504640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c101de0 0x7f585c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.493+0000 7f5860d03640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 0x7f585c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 -- 172.21.15.52:0/3078166816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c101de0 msgr2=0x7f585c198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c101de0 0x7f585c198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 -- 172.21.15.52:0/3078166816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 msgr2=0x7f585c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 0x7f585c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 -- 172.21.15.52:0/3078166816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c19d340 con 0x7f585c106f10 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5861d05640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f585400eaa0 tx=0x7f585400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f58527fc640 1 -- 172.21.15.52:0/3078166816 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854004d20 con 0x7f585c106f10 2024-09-19T09:31:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f58527fc640 1 -- 172.21.15.52:0/3078166816 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5854005020 con 0x7f585c106f10 2024-09-19T09:31:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c19d630 con 0x7f585c106f10 2024-09-19T09:31:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f58527fc640 1 -- 172.21.15.52:0/3078166816 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58540116d0 con 0x7f585c106f10 2024-09-19T09:31:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.494+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c074420 con 0x7f585c106f10 2024-09-19T09:31:42.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f58527fc640 1 -- 172.21.15.52:0/3078166816 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58540051d0 con 0x7f585c106f10 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 Processor -- start 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 -- start start 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbfb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563e4bb542f0 con 0x563e4bbee5d0 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563e4bafbcf0 con 0x563e4bbefb40 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5865b41740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563e4bb502b0 con 0x563e4bbf9370 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5861504640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f58527fc640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 0x7f58480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5861504640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37186/0 (socket says 172.21.15.52:37186) 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.497+0000 7f5861504640 1 -- 172.21.15.52:0/2578698067 learned_addr learned my addr 172.21.15.52:0/2578698067 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:42.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5860d03640 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5860d03640 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbfb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861d05640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 0x7f58480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f58527fc640 1 -- 172.21.15.52:0/3078166816 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58540cfaa0 con 0x7f585c106f10 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 -- 172.21.15.52:0/2578698067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 msgr2=0x563e4bbfb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbfb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 -- 172.21.15.52:0/2578698067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 msgr2=0x563e4bbee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 -- 172.21.15.52:0/2578698067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e4bae03a0 con 0x563e4bbee5d0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861504640 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f5858031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decb161253038f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f5861d05640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 0x7f58480a5700 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5854098a10 tx=0x7f5854004f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f58477fe640 1 -- 172.21.15.52:0/2578698067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858040070 con 0x563e4bbee5d0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f58477fe640 1 -- 172.21.15.52:0/2578698067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5858005020 con 0x563e4bbee5d0 2024-09-19T09:31:42.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.498+0000 7f58477fe640 1 -- 172.21.15.52:0/2578698067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858035040 con 0x563e4bbee5d0 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 -- 172.21.15.52:0/2578698067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 msgr2=0x563e4bbeea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f5858031630 comp rx=0 tx=0).stop 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 -- 172.21.15.52:0/2578698067 shutdown_connections 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbfb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbeea10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 --2- 172.21.15.52:0/2578698067 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 -- 172.21.15.52:0/2578698067 >> 172.21.15.52:0/2578698067 conn(0x563e4bbb7310 msgr2=0x563e4bbeac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 -- 172.21.15.52:0/2578698067 shutdown_connections 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.499+0000 7f5865b41740 1 -- 172.21.15.52:0/2578698067 wait complete. 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 -- start start 2024-09-19T09:31:42.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 Processor -- start 2024-09-19T09:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbf5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbf64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563e4bbfc010 con 0x563e4bbee5d0 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563e4bb0f060 con 0x563e4bbefb40 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563e4bbfc190 con 0x563e4bbf9370 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5865b41740 10 client.0 _ll_register_callbacks cb 0x563e4b8628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37196/0 (socket says 172.21.15.52:37196) 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5860d03640 1 -- 172.21.15.52:0/1057481968 learned_addr learned my addr 172.21.15.52:0/1057481968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.500+0000 7f5861504640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbf5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbf64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 -- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 msgr2=0x563e4bbf64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbf64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 -- 172.21.15.52:0/1057481968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 msgr2=0x563e4bbf5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbf5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 -- 172.21.15.52:0/1057481968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e4b8c53c0 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5860d03640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f584c00abf0 tx=0x7f584c00ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0748308a0bf02bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0111b0 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5858005020 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f584c005020 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f584c026030 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5865b41740 10 client.18996 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.501+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563e4bc07ad0 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5858005020 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f584c004cf0 con 0x563e4bbee5d0 2024-09-19T09:31:42.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 10 client.18996 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 10 client.18996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 20 client.18996 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bc08ee0 0x563e4bc0b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 4 client.18996 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e4bb61860 con 0x563e4bc08ee0 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.502+0000 7f5861504640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bc08ee0 0x563e4bc0b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.503+0000 7f5861504640 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bc08ee0 0x563e4bc0b2d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=854d20da001d614b server_cookie=8c28829dbe8eb556 in_seq=0 out_seq=0 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.503+0000 7f5844ff9640 10 client.18996 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5844ff9640 1 -- 172.21.15.52:0/1057481968 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e4bb61860 con 0x563e4bc08ee0 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5844ff9640 10 client.18996 handle_command_reply: tid=0 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 client.18996 shutdown 2024-09-19T09:31:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 msgr2=0x563e4bbf8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f584c00abf0 tx=0x7f584c00ab50 comp rx=0 tx=0).stop 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 shutdown_connections 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bc08ee0 0x563e4bc0b2d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbf9370 0x563e4bbf64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbefb40 0x563e4bbf5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5844ff9640 0 client.18996 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 --2- 172.21.15.52:0/1057481968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbee5d0 0x563e4bbf8ce0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 >> 172.21.15.52:0/1057481968 conn(0x563e4bbb7310 msgr2=0x563e4bbf0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 shutdown_connections 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 1 -- 172.21.15.52:0/1057481968 wait complete. 2024-09-19T09:31:42.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.504+0000 7f5865b41740 20 client.18996 trim_cache size 0 max 16384 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.517+0000 7f5865b41740 1 Processor -- start 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.517+0000 7f5865b41740 1 -- start start 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbb7310 0x563e4bbeae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bc052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1b2240 con 0x563e4bbefb40 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1afb10 con 0x563e4bbee5d0 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5865b41740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1ad960 con 0x563e4bbb7310 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37210/0 (socket says 172.21.15.52:37210) 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 -- 172.21.15.52:0/1888200451 learned_addr learned my addr 172.21.15.52:0/1888200451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbb7310 0x563e4bbeae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 -- 172.21.15.52:0/1888200451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbb7310 msgr2=0x563e4bbeae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbb7310 0x563e4bbeae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 -- 172.21.15.52:0/1888200451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 msgr2=0x563e4bc052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5861504640 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bc052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bc052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 -- 172.21.15.52:0/1888200451 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e4bc0b900 con 0x563e4bbefb40 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5860d03640 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f584c001eb0 tx=0x7f584c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19aac08dcc1cd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5846ffd640 1 -- 172.21.15.52:0/1888200451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0111b0 con 0x563e4bbefb40 2024-09-19T09:31:42.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5846ffd640 1 -- 172.21.15.52:0/1888200451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f584c031030 con 0x563e4bbefb40 2024-09-19T09:31:42.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.518+0000 7f5846ffd640 1 -- 172.21.15.52:0/1888200451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0051e0 con 0x563e4bbefb40 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- 172.21.15.52:0/1888200451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 msgr2=0x563e4bbe5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f584c001eb0 tx=0x7f584c00ef90 comp rx=0 tx=0).stop 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- 172.21.15.52:0/1888200451 shutdown_connections 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbefb40 0x563e4bbe5ad0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bc052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 --2- 172.21.15.52:0/1888200451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbb7310 0x563e4bbeae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- 172.21.15.52:0/1888200451 >> 172.21.15.52:0/1888200451 conn(0x563e4bbf19a0 msgr2=0x563e4bbea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- 172.21.15.52:0/1888200451 shutdown_connections 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- 172.21.15.52:0/1888200451 wait complete. 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.519+0000 7f5865b41740 1 -- start start 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 Processor -- start 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bbf2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbefb40 0x563e4bbf3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1adfd0 con 0x563e4bbb7310 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1af440 con 0x563e4bbee5d0 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1ae6a0 con 0x563e4bbefb40 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5865b41740 10 client.0 _ll_register_callbacks cb 0x7f584c00acc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37216/0 (socket says 172.21.15.52:37216) 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 -- 172.21.15.52:0/3463955804 learned_addr learned my addr 172.21.15.52:0/3463955804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5861504640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bbf2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 -- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbefb40 msgr2=0x563e4bbf3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbefb40 0x563e4bbf3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 -- 172.21.15.52:0/3463955804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 msgr2=0x563e4bbf2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bbf2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.520+0000 7f5860d03640 1 -- 172.21.15.52:0/3463955804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e4bbf3a20 con 0x563e4bbb7310 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5860d03640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a3f0 tx=0x7f584c00a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117091ca2524d5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c03c070 con 0x563e4bbb7310 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f584c02baf0 con 0x563e4bbb7310 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584c031030 con 0x563e4bbb7310 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f584c02bcf0 con 0x563e4bbb7310 2024-09-19T09:31:42.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 10 client.19002 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563e4bc73ae0 con 0x563e4bbb7310 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f584c031030 con 0x563e4bbb7310 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f584c03f050 con 0x563e4bbb7310 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 10 client.19002 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 10 client.19002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 20 client.19002 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bbf9370 0x563e4bc76120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 4 client.19002 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.521+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563e4bb5bd70 con 0x563e4bbf9370 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5861504640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bbf9370 0x563e4bc76120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5861504640 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bbf9370 0x563e4bc76120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2503db9facab973 server_cookie=146081f546668805 in_seq=0 out_seq=0 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5844ff9640 10 client.19002 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5844ff9640 1 -- 172.21.15.52:0/3463955804 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563e4bb5bd70 con 0x563e4bbf9370 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5844ff9640 10 client.19002 handle_command_reply: tid=0 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 client.19002 shutdown 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 msgr2=0x563e4bc01bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f584c00a3f0 tx=0x7f584c00a550 comp rx=0 tx=0).stop 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 shutdown_connections 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563e4bbf9370 0x563e4bc76120 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563e4bbefb40 0x563e4bbf3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.522+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563e4bbee5d0 0x563e4bbf2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5844ff9640 0 client.19002 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5865b41740 1 --2- 172.21.15.52:0/3463955804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563e4bbb7310 0x563e4bc01bd0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 >> 172.21.15.52:0/3463955804 conn(0x563e4bbf19a0 msgr2=0x563e4bbea700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 shutdown_connections 2024-09-19T09:31:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5865b41740 1 -- 172.21.15.52:0/3463955804 wait complete. 2024-09-19T09:31:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5865b41740 20 client.19002 trim_cache size 0 max 16384 2024-09-19T09:31:42.529 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 msgr2=0x7f58480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 0x7f58480a5700 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5854098a10 tx=0x7f5854004f50 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 msgr2=0x7f585c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f585400eaa0 tx=0x7f585400eea0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 shutdown_connections 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f585c106f10 0x7f585c19cc60 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f585c102790 0x7f585c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58480a3240 0x7f58480a5700 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 --2- 172.21.15.52:0/3078166816 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f585c101de0 0x7f585c198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 >> 172.21.15.52:0/3078166816 conn(0x7f585c0fd8c0 msgr2=0x7f585c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.523+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 shutdown_connections 2024-09-19T09:31:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:42.524+0000 7f5863768640 1 -- 172.21.15.52:0/3078166816 wait complete. 2024-09-19T09:31:43.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:31:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:43 smithi086 ceph-mon[34813]: pgmap v646: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:31:43.606 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:43 smithi052 ceph-mon[30947]: pgmap v646: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:31:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:43 smithi169 ceph-mon[35454]: pgmap v646: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 -- 172.21.15.52:0/3331186645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8106a80 msgr2=0x7f1ec8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/3331186645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8106a80 0x7f1ec8106e60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009930 tx=0x7f1eb802a420 comp rx=0 tx=0).stop 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 -- 172.21.15.52:0/3331186645 shutdown_connections 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/3331186645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8101420 0x7f1ec810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/3331186645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8100a80 0x7f1ec8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/3331186645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8106a80 0x7f1ec8106e60 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 -- 172.21.15.52:0/3331186645 >> 172.21.15.52:0/3331186645 conn(0x7f1ec80fc7a0 msgr2=0x7f1ec80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 -- 172.21.15.52:0/3331186645 shutdown_connections 2024-09-19T09:31:43.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.918+0000 7f1ecd82f640 1 -- 172.21.15.52:0/3331186645 wait complete. 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 Processor -- start 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 -- start start 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 0x7f1ec81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8106a80 0x7f1ec819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110e40 con 0x7f1ec8101420 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110cc0 con 0x7f1ec8100a80 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ecd82f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110fc0 con 0x7f1ec8106a80 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.919+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37224/0 (socket says 172.21.15.52:37224) 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1927966832 learned_addr learned my addr 172.21.15.52:0/1927966832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8106a80 0x7f1ec819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 0x7f1ec81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1927966832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8106a80 msgr2=0x7f1ec819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8106a80 0x7f1ec819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1927966832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 msgr2=0x7f1ec81983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 0x7f1ec81983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1927966832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec819d370 con 0x7f1ec8101420 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 0x7f1ec81983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c920 tx=0x7f1ebc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ecc82d640 1 -- 172.21.15.52:0/1927966832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc007c70 con 0x7f1ec8101420 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec819d660 con 0x7f1ec8101420 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ecc82d640 1 -- 172.21.15.52:0/1927966832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc007e10 con 0x7f1ec8101420 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ecc82d640 1 -- 172.21.15.52:0/1927966832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc018890 con 0x7f1ec8101420 2024-09-19T09:31:43.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.920+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec81a4f40 con 0x7f1ec8101420 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecc82d640 1 -- 172.21.15.52:0/1927966832 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ebc018a70 con 0x7f1ec8101420 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 Processor -- start 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 -- start start 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 0x564fe87b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b05d0 0x564fe87b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564fe87162f0 con 0x564fe87bf780 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564fe86bdcf0 con 0x564fe87b05d0 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564fe87122b0 con 0x564fe87b1b40 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37230/0 (socket says 172.21.15.52:37230) 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1070972325 learned_addr learned my addr 172.21.15.52:0/1070972325 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b05d0 0x564fe87b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ecc82d640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.923+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 0x564fe87b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ecc82d640 1 -- 172.21.15.52:0/1927966832 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1ebc0cfae0 con 0x7f1ec8101420 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1070972325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 msgr2=0x564fe87b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 0x564fe87b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1070972325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b05d0 msgr2=0x564fe87b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b05d0 0x564fe87b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 -- 172.21.15.52:0/1070972325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe86a23a0 con 0x564fe87bf780 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 0x564fe87b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc098a50 tx=0x7f1ebc098450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696b730c75076fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1eadffb640 1 -- 172.21.15.52:0/1070972325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc09c780 con 0x564fe87bf780 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1eadffb640 1 -- 172.21.15.52:0/1070972325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc0a4cf0 con 0x564fe87bf780 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.924+0000 7f1eadffb640 1 -- 172.21.15.52:0/1070972325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc09a1b0 con 0x564fe87bf780 2024-09-19T09:31:43.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1070972325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 msgr2=0x564fe87c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc098a50 tx=0x7f1ebc098450 comp rx=0 tx=0).stop 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 0x7f1eb00a5700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0005fd0 tx=0x7f1ec0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1070972325 shutdown_connections 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87c1b70 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b05d0 0x564fe87b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1070972325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b1b40 0x564fe87b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1070972325 >> 172.21.15.52:0/1070972325 conn(0x564fe8779310 msgr2=0x564fe87acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1070972325 shutdown_connections 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1070972325 wait complete. 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.925+0000 7f1ecfc08740 1 -- start start 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 Processor -- start 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564fe87c2420 con 0x564fe87b05d0 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564fe86d1060 con 0x564fe87b1b40 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564fe87c25a0 con 0x564fe87bf780 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ecfc08740 10 client.0 _ll_register_callbacks cb 0x564fe84248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37240/0 (socket says 172.21.15.52:37240) 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/2442839146 learned_addr learned my addr 172.21.15.52:0/2442839146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/2442839146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 msgr2=0x564fe87bcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 msgr2=0x564fe87bc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87bc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/2442839146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe84873c0 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009930 tx=0x7f1eb8031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c2fa62a680224a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.926+0000 7f1ea6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8035040 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1eb8004240 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ebc0a4cf0 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1eb804a020 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 10 client.19014 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fe87cdf30 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc0a4cf0 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1eb8004ad0 con 0x564fe87b05d0 2024-09-19T09:31:43.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 10 client.19014 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 10 client.19014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 20 client.19014 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe87cf3f0 0x564fe87d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 4 client.19014 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.927+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fe8723860 con 0x564fe87cf3f0 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.928+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe87cf3f0 0x564fe87d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.928+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe87cf3f0 0x564fe87d1820 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bd0cd9f639679fa server_cookie=762b2f2c41a129d2 in_seq=0 out_seq=0 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.928+0000 7f1ea6ffd640 10 client.19014 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/2442839146 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fe8723860 con 0x564fe87cf3f0 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ea6ffd640 10 client.19014 handle_command_reply: tid=0 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 client.19014 shutdown 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 msgr2=0x564fe87bf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009930 tx=0x7f1eb8031920 comp rx=0 tx=0).stop 2024-09-19T09:31:43.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 shutdown_connections 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87bcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe87cf3f0 0x564fe87d1820 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87bc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/2442839146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87bf1d0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 >> 172.21.15.52:0/2442839146 conn(0x564fe8779310 msgr2=0x564fe87b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ea6ffd640 0 client.19014 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 shutdown_connections 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 1 -- 172.21.15.52:0/2442839146 wait complete. 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.929+0000 7f1ecfc08740 20 client.19014 trim_cache size 0 max 16384 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 Processor -- start 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 -- start start 2024-09-19T09:31:43.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b05d0 0x564fe87bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81ade40 con 0x564fe87bf780 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81ab710 con 0x564fe87b1b40 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81a9560 con 0x564fe87b05d0 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ec77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37256/0 (socket says 172.21.15.52:37256) 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ec77fe640 1 -- 172.21.15.52:0/1443777464 learned_addr learned my addr 172.21.15.52:0/1443777464 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.942+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b05d0 0x564fe87bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 -- 172.21.15.52:0/1443777464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b05d0 msgr2=0x564fe87bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b05d0 0x564fe87bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 -- 172.21.15.52:0/1443777464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 msgr2=0x564fe87ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 -- 172.21.15.52:0/1443777464 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fe87ad180 con 0x564fe87bf780 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ec77fe640 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0013810 tx=0x7f1ec0015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f637be9fb2cfead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ead7fa640 1 -- 172.21.15.52:0/1443777464 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec001e8e0 con 0x564fe87bf780 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ead7fa640 1 -- 172.21.15.52:0/1443777464 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec0023070 con 0x564fe87bf780 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.943+0000 7f1ead7fa640 1 -- 172.21.15.52:0/1443777464 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec001f450 con 0x564fe87bf780 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1443777464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 msgr2=0x564fe87acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0013810 tx=0x7f1ec0015070 comp rx=0 tx=0).stop 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1443777464 shutdown_connections 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87bf780 0x564fe87acc40 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1443777464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87b05d0 0x564fe87bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1443777464 >> 172.21.15.52:0/1443777464 conn(0x564fe8779310 msgr2=0x564fe87b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1443777464 shutdown_connections 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1443777464 wait complete. 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 -- start start 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.944+0000 7f1ecfc08740 1 Processor -- start 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81a9bd0 con 0x564fe87b05d0 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81ab040 con 0x564fe87b1b40 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81aa2a0 con 0x564fe87bf780 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ecfc08740 10 client.0 _ll_register_callbacks cb 0x7f1eb80315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ec6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37262/0 (socket says 172.21.15.52:37262) 2024-09-19T09:31:43.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/1581888377 learned_addr learned my addr 172.21.15.52:0/1581888377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.945+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/1581888377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 msgr2=0x564fe87b8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 msgr2=0x564fe87c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 -- 172.21.15.52:0/1581888377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fe87b9540 con 0x564fe87b05d0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ec6ffd640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802a460 tx=0x7f1eb80049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d11f4111717ee38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ea6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8035050 con 0x564fe87b05d0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ec0023070 con 0x564fe87b05d0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1eb8004fc0 con 0x564fe87b05d0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1eb805f050 con 0x564fe87b05d0 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ecfc08740 10 client.19020 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:43.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.946+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564fe8839c00 con 0x564fe87b05d0 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec0023070 con 0x564fe87b05d0 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1eb8003fd0 con 0x564fe87b05d0 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 10 client.19020 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 10 client.19020 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 20 client.19020 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe883a3d0 0x564fe883c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 4 client.19020 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fe871dd70 con 0x564fe883a3d0 2024-09-19T09:31:43.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe883a3d0 0x564fe883c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ec67fc640 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe883a3d0 0x564fe883c7f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7af810be7c4818f2 server_cookie=a39c65dc5357ba9b in_seq=0 out_seq=0 2024-09-19T09:31:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.947+0000 7f1ea6ffd640 10 client.19020 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ea6ffd640 1 -- 172.21.15.52:0/1581888377 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fe871dd70 con 0x564fe883a3d0 2024-09-19T09:31:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ea6ffd640 10 client.19020 handle_command_reply: tid=0 2024-09-19T09:31:43.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 client.19020 shutdown 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 msgr2=0x564fe87c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f1eb802a460 tx=0x7f1eb80049f0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 shutdown_connections 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564fe87bf780 0x564fe87b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x564fe883a3d0 0x564fe883c7f0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564fe87b1b40 0x564fe87c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 --2- 172.21.15.52:0/1581888377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564fe87b05d0 0x564fe87c7ac0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ea6ffd640 0 client.19020 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 >> 172.21.15.52:0/1581888377 conn(0x564fe8779310 msgr2=0x564fe87b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 shutdown_connections 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 1 -- 172.21.15.52:0/1581888377 wait complete. 2024-09-19T09:31:43.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.948+0000 7f1ecfc08740 20 client.19020 trim_cache size 0 max 16384 2024-09-19T09:31:43.965 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 msgr2=0x7f1eb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 0x7f1eb00a5700 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0005fd0 tx=0x7f1ec0004a40 comp rx=0 tx=0).stop 2024-09-19T09:31:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 msgr2=0x7f1ec8198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:43.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c920 tx=0x7f1ebc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 shutdown_connections 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ec8106a80 0x7f1ec819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1ec8101420 0x7f1ec8198900 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 --2- 172.21.15.52:0/1927966832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ec8100a80 0x7f1ec81983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 >> 172.21.15.52:0/1927966832 conn(0x7f1ec80fc7a0 msgr2=0x7f1ec806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 shutdown_connections 2024-09-19T09:31:43.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:43.949+0000 7f1ecd82f640 1 -- 172.21.15.52:0/1927966832 wait complete. 2024-09-19T09:31:44.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:31:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:45.327 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:45 smithi052 ceph-mon[30947]: pgmap v647: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 -- 172.21.15.52:0/3813719875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c102d40 msgr2=0x7fbe5c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 --2- 172.21.15.52:0/3813719875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c102d40 0x7fbe5c103120 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009900 tx=0x7fbe5802a480 comp rx=0 tx=0).stop 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 -- 172.21.15.52:0/3813719875 shutdown_connections 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 --2- 172.21.15.52:0/3813719875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c10c170 0x7fbe5c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 --2- 172.21.15.52:0/3813719875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c103660 0x7fbe5c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 --2- 172.21.15.52:0/3813719875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c102d40 0x7fbe5c103120 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 -- 172.21.15.52:0/3813719875 >> 172.21.15.52:0/3813719875 conn(0x7fbe5c0fc7a0 msgr2=0x7fbe5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 -- 172.21.15.52:0/3813719875 shutdown_connections 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.411+0000 7fbe6400e640 1 -- 172.21.15.52:0/3813719875 wait complete. 2024-09-19T09:31:45.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 Processor -- start 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 -- start start 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c102d40 0x7fbe5c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c10c170 0x7fbe5c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c111f70 con 0x7fbe5c103660 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c111df0 con 0x7fbe5c102d40 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe6400e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1120f0 con 0x7fbe5c10c170 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37268/0 (socket says 172.21.15.52:37268) 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe61daa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c102d40 0x7fbe5c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 -- 172.21.15.52:0/1729788253 learned_addr learned my addr 172.21.15.52:0/1729788253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe625ab640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c10c170 0x7fbe5c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 -- 172.21.15.52:0/1729788253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c10c170 msgr2=0x7fbe5c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c10c170 0x7fbe5c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 -- 172.21.15.52:0/1729788253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c102d40 msgr2=0x7fbe5c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c102d40 0x7fbe5c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.412+0000 7fbe615a9640 1 -- 172.21.15.52:0/1729788253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c19d3b0 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe615a9640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00d740 tx=0x7fbe4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe52ffd640 1 -- 172.21.15.52:0/1729788253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c017070 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe52ffd640 1 -- 172.21.15.52:0/1729788253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe4c00de50 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c19d6a0 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe52ffd640 1 -- 172.21.15.52:0/1729788253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00f620 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.413+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c1a4f80 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.415+0000 7fbe52ffd640 1 -- 172.21.15.52:0/1729788253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe4c009c30 con 0x7fbe5c103660 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.415+0000 7fbe663e7740 1 Processor -- start 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 -- start start 2024-09-19T09:31:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c2a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c37760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6b902f0 con 0x55f1e6c35370 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6b37cf0 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe663e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6b8c2b0 con 0x55f1e6c2bb40 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe52ffd640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 0x7fbe480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c37760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe61daa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe61daa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:50312/0 (socket says 172.21.15.52:50312) 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c37760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37272/0 (socket says 172.21.15.52:37272) 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe61daa640 1 -- 172.21.15.52:0/739287988 learned_addr learned my addr 172.21.15.52:0/739287988 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe625ab640 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c2a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.416+0000 7fbe625ab640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 0x7fbe480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe52ffd640 1 -- 172.21.15.52:0/1729788253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe4c0cf5f0 con 0x7fbe5c103660 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 -- 172.21.15.52:0/739287988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 msgr2=0x55f1e6c2aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 -- 172.21.15.52:0/739287988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 msgr2=0x55f1e6c37760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c37760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 -- 172.21.15.52:0/739287988 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e6b1c3a0 con 0x55f1e6c2bb40 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c2a090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe54005fd0 tx=0x7fbe54010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed78420b2eb8304 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe625ab640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 0x7fbe480a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe54010c40 tx=0x7fbe54017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe47fff640 1 -- 172.21.15.52:0/739287988 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54023070 con 0x55f1e6c2bb40 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe47fff640 1 -- 172.21.15.52:0/739287988 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe54009b70 con 0x55f1e6c2bb40 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.417+0000 7fbe47fff640 1 -- 172.21.15.52:0/739287988 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54005280 con 0x55f1e6c2bb40 2024-09-19T09:31:45.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- 172.21.15.52:0/739287988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 msgr2=0x55f1e6c2a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c2a090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe54005fd0 tx=0x7fbe54010740 comp rx=0 tx=0).stop 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- 172.21.15.52:0/739287988 shutdown_connections 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c37760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 --2- 172.21.15.52:0/739287988 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c2a090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- 172.21.15.52:0/739287988 >> 172.21.15.52:0/739287988 conn(0x55f1e6bf3310 msgr2=0x55f1e6c26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- 172.21.15.52:0/739287988 shutdown_connections 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- 172.21.15.52:0/739287988 wait complete. 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 -- start start 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.418+0000 7fbe663e7740 1 Processor -- start 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c32080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c32810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6c38010 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6b4b060 con 0x55f1e6c2bb40 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f1e6c38190 con 0x55f1e6c35370 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe663e7740 10 client.0 _ll_register_callbacks cb 0x55f1e689e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37286/0 (socket says 172.21.15.52:37286) 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 -- 172.21.15.52:0/3413707118 learned_addr learned my addr 172.21.15.52:0/3413707118 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe615a9640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c32080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 -- 172.21.15.52:0/3413707118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 msgr2=0x55f1e6c32810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c32810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 -- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 msgr2=0x55f1e6c32080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c32080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 -- 172.21.15.52:0/3413707118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e69013c0 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe615a9640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c32080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009230 tx=0x7fbe58031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b907a6ea66af17c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.419+0000 7fbe457fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58035040 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe58004450 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe54009b70 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe5804b030 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 10 client.19032 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f1e6c43b80 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe54009b70 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe580035f0 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 10 client.19032 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 10 client.19032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 20 client.19032 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6c45040 0x55f1e6c47470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 4 client.19032 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.420+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1e6b9d860 con 0x55f1e6c45040 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.421+0000 7fbe615a9640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6c45040 0x55f1e6c47470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.421+0000 7fbe457fa640 10 client.19032 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.421+0000 7fbe615a9640 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6c45040 0x55f1e6c47470 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9c28e9f613c380d server_cookie=782f5ef2fb4ad71 in_seq=0 out_seq=0 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe457fa640 1 -- 172.21.15.52:0/3413707118 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1e6b9d860 con 0x55f1e6c45040 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe457fa640 10 client.19032 handle_command_reply: tid=0 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 client.19032 shutdown 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 msgr2=0x55f1e6c34dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009230 tx=0x7fbe58031920 comp rx=0 tx=0).stop 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 shutdown_connections 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6c45040 0x55f1e6c47470 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c32810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c32080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3413707118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c34dd0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe457fa640 0 client.19032 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 >> 172.21.15.52:0/3413707118 conn(0x55f1e6bf3310 msgr2=0x55f1e6c2c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 shutdown_connections 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 1 -- 172.21.15.52:0/3413707118 wait complete. 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.422+0000 7fbe663e7740 20 client.19032 trim_cache size 0 max 16384 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.435+0000 7fbe663e7740 1 Processor -- start 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.435+0000 7fbe663e7740 1 -- start start 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.435+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c30e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe663e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1aff40 con 0x55f1e6c2bb40 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe663e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1ad810 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe663e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1ab660 con 0x55f1e6c35370 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37296/0 (socket says 172.21.15.52:37296) 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 -- 172.21.15.52:0/472049316 learned_addr learned my addr 172.21.15.52:0/472049316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe61daa640 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 -- 172.21.15.52:0/472049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 msgr2=0x55f1e6c30e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c30e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 -- 172.21.15.52:0/472049316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 msgr2=0x55f1e6c2b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 -- 172.21.15.52:0/472049316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e6c47af0 con 0x55f1e6c2bb40 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe615a9640 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c097f90 tx=0x7fbe4c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2b8d5ec3efeefd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe477fe640 1 -- 172.21.15.52:0/472049316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c020040 con 0x55f1e6c2bb40 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe477fe640 1 -- 172.21.15.52:0/472049316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe4c0cd120 con 0x55f1e6c2bb40 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.436+0000 7fbe477fe640 1 -- 172.21.15.52:0/472049316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c09ce60 con 0x55f1e6c2bb40 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- 172.21.15.52:0/472049316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 msgr2=0x55f1e6c30950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c097f90 tx=0x7fbe4c086040 comp rx=0 tx=0).stop 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- 172.21.15.52:0/472049316 shutdown_connections 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c35370 0x55f1e6c30e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c30950 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 --2- 172.21.15.52:0/472049316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c2b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- 172.21.15.52:0/472049316 >> 172.21.15.52:0/472049316 conn(0x55f1e6bf3310 msgr2=0x55f1e6c21a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- 172.21.15.52:0/472049316 shutdown_connections 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- 172.21.15.52:0/472049316 wait complete. 2024-09-19T09:31:45.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 -- start start 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.437+0000 7fbe663e7740 1 Processor -- start 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c3d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c3dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1abcd0 con 0x55f1e6c35370 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1ad140 con 0x55f1e6c2bb40 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c1ac3a0 con 0x55f1e6c2a5d0 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe663e7740 10 client.0 _ll_register_callbacks cb 0x7fbe58009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37312/0 (socket says 172.21.15.52:37312) 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 -- 172.21.15.52:0/3715358123 learned_addr learned my addr 172.21.15.52:0/3715358123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe615a9640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c3dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c3d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 -- 172.21.15.52:0/3715358123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2a5d0 msgr2=0x55f1e6c3d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c3d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 -- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 msgr2=0x55f1e6c3dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c3dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.438+0000 7fbe625ab640 1 -- 172.21.15.52:0/3715358123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e6c392b0 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe625ab640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbe54010780 tx=0x7fbe54012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1888f804ae829b44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5402b070 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbe5400cb40 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe4c0cd120 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbe54037050 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe663e7740 10 client.19038 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f1e6caf890 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe4c0cd120 con 0x55f1e6c35370 2024-09-19T09:31:45.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbe54004bc0 con 0x55f1e6c35370 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.439+0000 7fbe663e7740 10 client.19038 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe663e7740 10 client.19038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe663e7740 20 client.19038 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6cafd80 0x55f1e6cb2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe663e7740 4 client.19038 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1e6b97d70 con 0x55f1e6cafd80 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6cafd80 0x55f1e6cb2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe61daa640 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6cafd80 0x55f1e6cb2170 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ccdd2d9e6664947 server_cookie=7f20e1d393128dee in_seq=0 out_seq=0 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe457fa640 10 client.19038 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe457fa640 1 -- 172.21.15.52:0/3715358123 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1e6b97d70 con 0x55f1e6cafd80 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.440+0000 7fbe457fa640 10 client.19038 handle_command_reply: tid=0 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 client.19038 shutdown 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 msgr2=0x55f1e6c38a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fbe54010780 tx=0x7fbe54012520 comp rx=0 tx=0).stop 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 shutdown_connections 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f1e6cafd80 0x55f1e6cb2170 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f1e6c35370 0x55f1e6c38a80 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f1e6c2bb40 0x55f1e6c3dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 --2- 172.21.15.52:0/3715358123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f1e6c2a5d0 0x55f1e6c3d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe457fa640 0 client.19038 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 >> 172.21.15.52:0/3715358123 conn(0x55f1e6bf3310 msgr2=0x55f1e6c30880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 shutdown_connections 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 1 -- 172.21.15.52:0/3715358123 wait complete. 2024-09-19T09:31:45.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe663e7740 20 client.19038 trim_cache size 0 max 16384 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 msgr2=0x7fbe480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 0x7fbe480a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe54010c40 tx=0x7fbe54017000 comp rx=0 tx=0).stop 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 msgr2=0x7fbe5c198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.441+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00d740 tx=0x7fbe4c00dc00 comp rx=0 tx=0).stop 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 shutdown_connections 2024-09-19T09:31:45.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbe480a3240 0x7fbe480a5700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe5c10c170 0x7fbe5c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe5c103660 0x7fbe5c198940 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 --2- 172.21.15.52:0/1729788253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbe5c102d40 0x7fbe5c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 >> 172.21.15.52:0/1729788253 conn(0x7fbe5c0fc7a0 msgr2=0x7fbe5c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 shutdown_connections 2024-09-19T09:31:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:45.442+0000 7fbe6400e640 1 -- 172.21.15.52:0/1729788253 wait complete. 2024-09-19T09:31:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:45 smithi086 ceph-mon[34813]: pgmap v647: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:45.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:45 smithi169 ceph-mon[35454]: pgmap v647: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:47.191 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:31:47.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:31:47.463 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:47.584 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:47 smithi052 ceph-mon[30947]: pgmap v648: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:31:47.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:47 smithi169 ceph-mon[35454]: pgmap v648: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:31:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:47 smithi086 ceph-mon[34813]: pgmap v648: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-19T09:31:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 -- 172.21.15.52:0/306079781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0102d40 msgr2=0x7f88c0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 --2- 172.21.15.52:0/306079781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0102d40 0x7f88c0103120 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009900 tx=0x7f88b002a480 comp rx=0 tx=0).stop 2024-09-19T09:31:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 -- 172.21.15.52:0/306079781 shutdown_connections 2024-09-19T09:31:47.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 --2- 172.21.15.52:0/306079781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 --2- 172.21.15.52:0/306079781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0103660 0x7f88c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 --2- 172.21.15.52:0/306079781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0102d40 0x7f88c0103120 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 -- 172.21.15.52:0/306079781 >> 172.21.15.52:0/306079781 conn(0x7f88c00fc7a0 msgr2=0x7f88c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 -- 172.21.15.52:0/306079781 shutdown_connections 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.947+0000 7f88c5173640 1 -- 172.21.15.52:0/306079781 wait complete. 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.948+0000 7f88c5173640 1 Processor -- start 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.948+0000 7f88c5173640 1 -- start start 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0102d40 0x7f88c019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88c0111fb0 con 0x7f88c0103660 2024-09-19T09:31:47.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88c0111e30 con 0x7f88c010c170 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88c5173640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88c0112130 con 0x7f88c0102d40 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37330/0 (socket says 172.21.15.52:37330) 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 -- 172.21.15.52:0/2685756782 learned_addr learned my addr 172.21.15.52:0/2685756782 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88bf59e640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88bed9d640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0102d40 0x7f88c019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 -- 172.21.15.52:0/2685756782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0102d40 msgr2=0x7f88c019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0102d40 0x7f88c019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 -- 172.21.15.52:0/2685756782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 msgr2=0x7f88c019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 -- 172.21.15.52:0/2685756782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c019f6c0 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88bf59e640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.949+0000 7f88be59c640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b3f0 tx=0x7f88b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.950+0000 7f88a7fff640 1 -- 172.21.15.52:0/2685756782 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4015020 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.950+0000 7f88a7fff640 1 -- 172.21.15.52:0/2685756782 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b4011d10 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.950+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c019f9b0 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.950+0000 7f88a7fff640 1 -- 172.21.15.52:0/2685756782 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b400f2e0 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.950+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c01a7290 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88a7fff640 1 -- 172.21.15.52:0/2685756782 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f88b4018020 con 0x7f88c0103660 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 Processor -- start 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 -- start start 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c40b60 0x55e4a5c40f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 0x55e4a5c4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5ba6280 con 0x55e4a5c4bd40 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5b4db10 con 0x55e4a5c41480 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88c754c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5ba2240 con 0x55e4a5c40b60 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 0x55e4a5c4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37334/0 (socket says 172.21.15.52:37334) 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88be59c640 1 -- 172.21.15.52:0/1992367547 learned_addr learned my addr 172.21.15.52:0/1992367547 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88a7fff640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 0x7f88a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.953+0000 7f88bf59e640 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c40b60 0x55e4a5c40f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 -- 172.21.15.52:0/1992367547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c40b60 msgr2=0x55e4a5c40f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c40b60 0x55e4a5c40f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 -- 172.21.15.52:0/1992367547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 msgr2=0x55e4a5c4e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 -- 172.21.15.52:0/1992367547 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a5b5a1f0 con 0x55e4a5c41480 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88be59c640 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88a7fff640 1 -- 172.21.15.52:0/2685756782 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88b40cf130 con 0x7f88c0103660 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bf59e640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 0x7f88a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 0x55e4a5c4b800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88b0005940 tx=0x7f88b0031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ccb9e7224f1dacb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88a57fa640 1 -- 172.21.15.52:0/1992367547 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0040070 con 0x55e4a5c41480 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88a57fa640 1 -- 172.21.15.52:0/1992367547 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b0005020 con 0x55e4a5c41480 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88bf59e640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 0x7f88a80a5700 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005fd0 tx=0x7f88b8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.954+0000 7f88a57fa640 1 -- 172.21.15.52:0/1992367547 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0035040 con 0x55e4a5c41480 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- 172.21.15.52:0/1992367547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 msgr2=0x55e4a5c4b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 0x55e4a5c4b800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f88b0005940 tx=0x7f88b0031630 comp rx=0 tx=0).stop 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- 172.21.15.52:0/1992367547 shutdown_connections 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c4e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c41480 0x55e4a5c4b800 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 --2- 172.21.15.52:0/1992367547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c40b60 0x55e4a5c40f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- 172.21.15.52:0/1992367547 >> 172.21.15.52:0/1992367547 conn(0x55e4a5c3d0f0 msgr2=0x55e4a5c3d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- 172.21.15.52:0/1992367547 shutdown_connections 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- 172.21.15.52:0/1992367547 wait complete. 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 -- start start 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.955+0000 7f88c754c740 1 Processor -- start 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c49120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c49660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5c4e910 con 0x55e4a5c40b60 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5b60f10 con 0x55e4a5c4bd40 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e4a5c4ea90 con 0x55e4a5c41480 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88c754c740 10 client.0 _ll_register_callbacks cb 0x55e4a5b29a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37342/0 (socket says 172.21.15.52:37342) 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 -- 172.21.15.52:0/4182832521 learned_addr learned my addr 172.21.15.52:0/4182832521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bf59e640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c49660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88be59c640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c49120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 -- 172.21.15.52:0/4182832521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 msgr2=0x55e4a5c49120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c49120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 -- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 msgr2=0x55e4a5c49660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c49660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 -- 172.21.15.52:0/4182832521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a59176a0 con 0x55e4a5c40b60 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88bed9d640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f88b002a9a0 tx=0x7f88b0005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70905e2a69ecb37e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.956+0000 7f88a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0040070 con 0x55e4a5c40b60 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88b00055f0 con 0x55e4a5c40b60 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88b0005020 con 0x55e4a5c40b60 2024-09-19T09:31:47.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f88b0053030 con 0x55e4a5c40b60 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 10 client.19050 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e4a5c5a4e0 con 0x55e4a5c40b60 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b0005020 con 0x55e4a5c40b60 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f88b00038c0 con 0x55e4a5c40b60 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 10 client.19050 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 10 client.19050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 20 client.19050 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5c5b830 0x55e4a5c5dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 4 client.19050 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.957+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4a5bb37f0 con 0x55e4a5c5b830 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.958+0000 7f88be59c640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5c5b830 0x55e4a5c5dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.958+0000 7f88a2ff5640 10 client.19050 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:47.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.958+0000 7f88be59c640 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5c5b830 0x55e4a5c5dc20 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b746f74dcb132fbc server_cookie=9b0022dddfe418b5 in_seq=0 out_seq=0 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88a2ff5640 1 -- 172.21.15.52:0/4182832521 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4a5bb37f0 con 0x55e4a5c5b830 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88a2ff5640 10 client.19050 handle_command_reply: tid=0 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 client.19050 shutdown 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 msgr2=0x55e4a5c48be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f88b002a9a0 tx=0x7f88b0005400 comp rx=0 tx=0).stop 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 shutdown_connections 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5c5b830 0x55e4a5c5dc20 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c49660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c49120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 --2- 172.21.15.52:0/4182832521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c48be0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88a2ff5640 0 client.19050 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 >> 172.21.15.52:0/4182832521 conn(0x55e4a5c3d0f0 msgr2=0x55e4a5c42dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 shutdown_connections 2024-09-19T09:31:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 1 -- 172.21.15.52:0/4182832521 wait complete. 2024-09-19T09:31:47.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.959+0000 7f88c754c740 20 client.19050 trim_cache size 0 max 16384 2024-09-19T09:31:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 Processor -- start 2024-09-19T09:31:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 -- start start 2024-09-19T09:31:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c40b60 0x55e4a5c47a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c63700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01b21c0 con 0x55e4a5c41480 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01afa90 con 0x55e4a5c40b60 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.976+0000 7f88c754c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01ad8e0 con 0x55e4a5c4bd40 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37348/0 (socket says 172.21.15.52:37348) 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 -- 172.21.15.52:0/3593224435 learned_addr learned my addr 172.21.15.52:0/3593224435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88bf59e640 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c63700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88bed9d640 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c40b60 0x55e4a5c47a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 -- 172.21.15.52:0/3593224435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c4bd40 msgr2=0x55e4a5c63700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c63700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 -- 172.21.15.52:0/3593224435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c40b60 msgr2=0x55e4a5c47a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c40b60 0x55e4a5c47a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 -- 172.21.15.52:0/3593224435 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4a5c5df90 con 0x55e4a5c41480 2024-09-19T09:31:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88be59c640 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f88b40980a0 tx=0x7f88b40d1640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1a62be6c29592d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88a4ff9640 1 -- 172.21.15.52:0/3593224435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b409b6d0 con 0x55e4a5c41480 2024-09-19T09:31:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88a4ff9640 1 -- 172.21.15.52:0/3593224435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b409fa80 con 0x55e4a5c41480 2024-09-19T09:31:47.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.977+0000 7f88a4ff9640 1 -- 172.21.15.52:0/3593224435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4097d40 con 0x55e4a5c41480 2024-09-19T09:31:47.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- 172.21.15.52:0/3593224435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 msgr2=0x55e4a5c631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f88b40980a0 tx=0x7f88b40d1640 comp rx=0 tx=0).stop 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- 172.21.15.52:0/3593224435 shutdown_connections 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c63700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c41480 0x55e4a5c631c0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 --2- 172.21.15.52:0/3593224435 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c40b60 0x55e4a5c47a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- 172.21.15.52:0/3593224435 >> 172.21.15.52:0/3593224435 conn(0x55e4a5c3d0f0 msgr2=0x55e4a5c47380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- 172.21.15.52:0/3593224435 shutdown_connections 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- 172.21.15.52:0/3593224435 wait complete. 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 -- start start 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.978+0000 7f88c754c740 1 Processor -- start 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c50250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c507b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01adf50 con 0x55e4a5c40b60 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01af3c0 con 0x55e4a5c4bd40 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88c01ae620 con 0x55e4a5c41480 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37362/0 (socket says 172.21.15.52:37362) 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88c754c740 10 client.0 _ll_register_callbacks cb 0x7f88b0009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 -- 172.21.15.52:0/1273804400 learned_addr learned my addr 172.21.15.52:0/1273804400 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88be59c640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c50250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bf59e640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 -- 172.21.15.52:0/1273804400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 msgr2=0x55e4a5c50250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c50250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 -- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 msgr2=0x55e4a5c507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:47.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 -- 172.21.15.52:0/1273804400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4a5cc5460 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88be59c640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c50250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88bed9d640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f88b00096c0 tx=0x7f88b0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaf80e985b4239d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.979+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0040030 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88b0054070 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88b409fa80 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f88b0035030 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 10 client.19056 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e4a5cc67a0 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88b409fa80 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f88b0004e30 con 0x55e4a5c40b60 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 10 client.19056 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:47.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 10 client.19056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 20 client.19056 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5cc6ec0 0x55e4a5cc92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 4 client.19056 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e4a5badd00 con 0x55e4a5cc6ec0 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.980+0000 7f88be59c640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5cc6ec0 0x55e4a5cc92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.981+0000 7f88be59c640 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5cc6ec0 0x55e4a5cc92e0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a50ab0342d65149 server_cookie=2ede18cf32e5cc35 in_seq=0 out_seq=0 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.981+0000 7f88a2ff5640 10 client.19056 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88a2ff5640 1 -- 172.21.15.52:0/1273804400 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e4a5badd00 con 0x55e4a5cc6ec0 2024-09-19T09:31:47.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88a2ff5640 10 client.19056 handle_command_reply: tid=0 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 client.19056 shutdown 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 msgr2=0x55e4a5c4fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f88b00096c0 tx=0x7f88b0005850 comp rx=0 tx=0).stop 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 shutdown_connections 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e4a5cc6ec0 0x55e4a5cc92e0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e4a5c4bd40 0x55e4a5c507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e4a5c41480 0x55e4a5c50250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 --2- 172.21.15.52:0/1273804400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e4a5c40b60 0x55e4a5c4fd10 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 >> 172.21.15.52:0/1273804400 conn(0x55e4a5c3d0f0 msgr2=0x55e4a5c42dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88a2ff5640 0 client.19056 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:47.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 shutdown_connections 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 1 -- 172.21.15.52:0/1273804400 wait complete. 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.982+0000 7f88c754c740 20 client.19056 trim_cache size 0 max 16384 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "b2a2fb5c-1fd9-4b5b-b92d-36f97448c48a", 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:31:47.990 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 msgr2=0x7f88a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 0x7f88a80a5700 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005fd0 tx=0x7f88b8004a40 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 msgr2=0x7f88c019ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f88b400b3f0 tx=0x7f88b400b8b0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 shutdown_connections 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88c010c170 0x7f88c019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88c0103660 0x7f88c019ac50 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88a80a3240 0x7f88a80a5700 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 --2- 172.21.15.52:0/2685756782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88c0102d40 0x7f88c019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 >> 172.21.15.52:0/2685756782 conn(0x7f88c00fc7a0 msgr2=0x7f88c010d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:47.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 shutdown_connections 2024-09-19T09:31:47.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:47.983+0000 7f88c5173640 1 -- 172.21.15.52:0/2685756782 wait complete. 2024-09-19T09:31:48.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:31:48.920 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:49.361 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: pgmap v649: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:49.361 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:31:49.361 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.362 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:31:49.362 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.362 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:49 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.361+0000 7ffae613c640 1 -- 172.21.15.52:0/3637493112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 msgr2=0x7ffae010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.361+0000 7ffae613c640 1 --2- 172.21.15.52:0/3637493112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae010ea90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009ca0 tx=0x7ffad802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 -- 172.21.15.52:0/3637493112 shutdown_connections 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 --2- 172.21.15.52:0/3637493112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae010ea90 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 --2- 172.21.15.52:0/3637493112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0102790 0x7ffae01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 --2- 172.21.15.52:0/3637493112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0101de0 0x7ffae01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 -- 172.21.15.52:0/3637493112 >> 172.21.15.52:0/3637493112 conn(0x7ffae00fd8c0 msgr2=0x7ffae00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 -- 172.21.15.52:0/3637493112 shutdown_connections 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 -- 172.21.15.52:0/3637493112 wait complete. 2024-09-19T09:31:49.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 Processor -- start 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.362+0000 7ffae613c640 1 -- start start 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0101de0 0x7ffae019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102790 0x7ffae019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0111f70 con 0x7ffae0106f10 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0111df0 con 0x7ffae0101de0 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffae613c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01120f0 con 0x7ffae0102790 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33096/0 (socket says 172.21.15.52:33096) 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 -- 172.21.15.52:0/2832360991 learned_addr learned my addr 172.21.15.52:0/2832360991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadeffd640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102790 0x7ffae019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0101de0 0x7ffae019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 -- 172.21.15.52:0/2832360991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102790 msgr2=0x7ffae019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102790 0x7ffae019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 -- 172.21.15.52:0/2832360991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0101de0 msgr2=0x7ffae019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0101de0 0x7ffae019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 -- 172.21.15.52:0/2832360991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae019f560 con 0x7ffae0106f10 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadffff640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ffad8031a20 tx=0x7ffad8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.363+0000 7ffadcff9640 1 -- 172.21.15.52:0/2832360991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8003c30 con 0x7ffae0106f10 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.364+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae019f7f0 con 0x7ffae0106f10 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.364+0000 7ffadcff9640 1 -- 172.21.15.52:0/2832360991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad8003dd0 con 0x7ffae0106f10 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.364+0000 7ffadcff9640 1 -- 172.21.15.52:0/2832360991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad802fcf0 con 0x7ffae0106f10 2024-09-19T09:31:49.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.364+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae01a7130 con 0x7ffae0106f10 2024-09-19T09:31:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 Processor -- start 2024-09-19T09:31:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffadcff9640 1 -- 172.21.15.52:0/2832360991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffad8004050 con 0x7ffae0106f10 2024-09-19T09:31:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 -- start start 2024-09-19T09:31:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8c391a2e0 con 0x55d8c39b44a0 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d8c38c1ce0 con 0x55d8c39bf680 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.366+0000 7ffae8515740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8c39162a0 con 0x55d8c39b4dc0 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33100/0 (socket says 172.21.15.52:33100) 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 -- 172.21.15.52:0/26148854 learned_addr learned my addr 172.21.15.52:0/26148854 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:49.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 -- 172.21.15.52:0/26148854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 msgr2=0x55d8c39bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 -- 172.21.15.52:0/26148854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 msgr2=0x55d8c39c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 -- 172.21.15.52:0/26148854 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c38a6440 con 0x55d8c39b44a0 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadcff9640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 0x7ffac80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadeffd640 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ffad40058a0 tx=0x7ffad40127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f991643d8a693e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 0x7ffac80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffadcff9640 1 -- 172.21.15.52:0/2832360991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffad80f0c90 con 0x7ffae0106f10 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffac5ffb640 1 -- 172.21.15.52:0/26148854 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad40120d0 con 0x55d8c39b44a0 2024-09-19T09:31:49.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffac5ffb640 1 -- 172.21.15.52:0/26148854 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad4016070 con 0x55d8c39b44a0 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.367+0000 7ffac5ffb640 1 -- 172.21.15.52:0/26148854 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad40107e0 con 0x55d8c39b44a0 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 0x7ffac80a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55d8c39b1890 tx=0x7ffad000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 -- 172.21.15.52:0/26148854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 msgr2=0x55d8c39b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ffad40058a0 tx=0x7ffad40127c0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 -- 172.21.15.52:0/26148854 shutdown_connections 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 --2- 172.21.15.52:0/26148854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39b4880 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 -- 172.21.15.52:0/26148854 >> 172.21.15.52:0/26148854 conn(0x55d8c39b0a30 msgr2=0x55d8c39b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 -- 172.21.15.52:0/26148854 shutdown_connections 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.368+0000 7ffae8515740 1 -- 172.21.15.52:0/26148854 wait complete. 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 -- start start 2024-09-19T09:31:49.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 Processor -- start 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39bc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d8c39c2250 con 0x55d8c39b44a0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d8c38d5050 con 0x55d8c39bf680 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d8c39c23d0 con 0x55d8c39b4dc0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffae8515740 10 client.0 _ll_register_callbacks cb 0x55d8c3915160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffadf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffadf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33116/0 (socket says 172.21.15.52:33116) 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffadf7fe640 1 -- 172.21.15.52:0/1065357112 learned_addr learned my addr 172.21.15.52:0/1065357112 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffadeffd640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.369+0000 7ffadffff640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 -- 172.21.15.52:0/1065357112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 msgr2=0x55d8c39bc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 -- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 msgr2=0x55d8c39bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 -- 172.21.15.52:0/1065357112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c368b3c0 con 0x55d8c39b44a0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7ffad0004130 tx=0x7ffad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a3892e267a954e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffabeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad002c060 con 0x55d8c39b44a0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffad0017030 con 0x55d8c39b44a0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad4016070 con 0x55d8c39b44a0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffad0031410 con 0x55d8c39b44a0 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffae8515740 10 client.19068 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:49.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.370+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d8c39cdd10 con 0x55d8c39b44a0 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad4016070 con 0x55d8c39b44a0 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffad00116e0 con 0x55d8c39b44a0 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 10 client.19068 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 10 client.19068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 20 client.19068 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c39cf1d0 0x55d8c39d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 4 client.19068 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8c3927850 con 0x55d8c39cf1d0 2024-09-19T09:31:49.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.371+0000 7ffadeffd640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c39cf1d0 0x55d8c39d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffadeffd640 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c39cf1d0 0x55d8c39d15c0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba2c2c526b976b8 server_cookie=a94d7b00165948da in_seq=0 out_seq=0 2024-09-19T09:31:49.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffabeffd640 10 client.19068 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffabeffd640 1 -- 172.21.15.52:0/1065357112 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8c3927850 con 0x55d8c39cf1d0 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffabeffd640 10 client.19068 handle_command_reply: tid=0 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffae8515740 1 client.19068 shutdown 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 msgr2=0x55d8c39bf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7ffad0004130 tx=0x7ffad00046c0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.372+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 shutdown_connections 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c39cf1d0 0x55d8c39d15c0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39bf680 0x55d8c39bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39bc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 --2- 172.21.15.52:0/1065357112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39b44a0 0x55d8c39bf070 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffabeffd640 0 client.19068 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:49.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 >> 172.21.15.52:0/1065357112 conn(0x55d8c39b0a30 msgr2=0x55d8c39b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 shutdown_connections 2024-09-19T09:31:49.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 1 -- 172.21.15.52:0/1065357112 wait complete. 2024-09-19T09:31:49.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.373+0000 7ffae8515740 20 client.19068 trim_cache size 0 max 16384 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 Processor -- start 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 -- start start 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39babf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39d6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b21e0 con 0x55d8c39bf680 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01afab0 con 0x55d8c39b44a0 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffae8515740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01ad900 con 0x55d8c39b4dc0 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33122/0 (socket says 172.21.15.52:33122) 2024-09-19T09:31:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffadffff640 1 -- 172.21.15.52:0/2918426521 learned_addr learned my addr 172.21.15.52:0/2918426521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffadeffd640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39d6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.390+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39babf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 -- 172.21.15.52:0/2918426521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 msgr2=0x55d8c39d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39d6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 -- 172.21.15.52:0/2918426521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 msgr2=0x55d8c39babf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39babf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 -- 172.21.15.52:0/2918426521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8c39bb2d0 con 0x55d8c39bf680 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadeffd640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39babf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffadffff640 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ffad80b96c0 tx=0x7ffad80ee580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c787f4b443334a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffac57fa640 1 -- 172.21.15.52:0/2918426521 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad802fe90 con 0x55d8c39bf680 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffac57fa640 1 -- 172.21.15.52:0/2918426521 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad8036040 con 0x55d8c39bf680 2024-09-19T09:31:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffac57fa640 1 -- 172.21.15.52:0/2918426521 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad80b98d0 con 0x55d8c39bf680 2024-09-19T09:31:49.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffae8515740 1 -- 172.21.15.52:0/2918426521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 msgr2=0x55d8c39d7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.391+0000 7ffae8515740 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ffad80b96c0 tx=0x7ffad80ee580 comp rx=0 tx=0).stop 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- 172.21.15.52:0/2918426521 shutdown_connections 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c39d7380 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- 172.21.15.52:0/2918426521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39babf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- 172.21.15.52:0/2918426521 >> 172.21.15.52:0/2918426521 conn(0x55d8c39b0a30 msgr2=0x55d8c39be3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- 172.21.15.52:0/2918426521 shutdown_connections 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- 172.21.15.52:0/2918426521 wait complete. 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- start start 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 Processor -- start 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01adf70 con 0x55d8c39bf680 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01af3e0 con 0x55d8c39b44a0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01ae640 con 0x55d8c39b4dc0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.392+0000 7ffae8515740 10 client.0 _ll_register_callbacks cb 0x7ffad0004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33128/0 (socket says 172.21.15.52:33128) 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 -- 172.21.15.52:0/3083612448 learned_addr learned my addr 172.21.15.52:0/3083612448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadeffd640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 -- 172.21.15.52:0/3083612448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 msgr2=0x55d8c39c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 -- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 msgr2=0x55d8c39c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:49.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 -- 172.21.15.52:0/3083612448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8c39bf3e0 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffadffff640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7ffad80c5910 tx=0x7ffad802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4241a9f340f3c3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffabeffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad80bd260 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ffad80b98d0 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.393+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad8036040 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ffad80c5e40 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 10 client.19074 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d8c3a3a200 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad8036040 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ffad80c59b0 con 0x55d8c39bf680 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 10 client.19074 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:49.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 10 client.19074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 20 client.19074 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c3a3a970 0x55d8c3a3cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 4 client.19074 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8c3921d60 con 0x55d8c3a3a970 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.394+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c3a3a970 0x55d8c3a3cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffadf7fe640 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c3a3a970 0x55d8c3a3cd60 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44c11636ae56555 server_cookie=811d0408ab75d3f0 in_seq=0 out_seq=0 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffabeffd640 10 client.19074 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffabeffd640 1 -- 172.21.15.52:0/3083612448 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d8c3921d60 con 0x55d8c3a3a970 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffabeffd640 10 client.19074 handle_command_reply: tid=0 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 client.19074 shutdown 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 msgr2=0x55d8c3a38e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7ffad80c5910 tx=0x7ffad802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 shutdown_connections 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d8c3a3a970 0x55d8c3a3cd60 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d8c39bf680 0x55d8c3a38e20 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffabeffd640 0 client.19074 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d8c39b4dc0 0x55d8c39c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 --2- 172.21.15.52:0/3083612448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d8c39b44a0 0x55d8c39c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 >> 172.21.15.52:0/3083612448 conn(0x55d8c39b0a30 msgr2=0x55d8c39be3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 shutdown_connections 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 1 -- 172.21.15.52:0/3083612448 wait complete. 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.395+0000 7ffae8515740 20 client.19074 trim_cache size 0 max 16384 2024-09-19T09:31:49.405 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:49.406 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:31:49.406 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:31:49.406 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 msgr2=0x7ffac80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 0x7ffac80a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55d8c39b1890 tx=0x7ffad000b390 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 msgr2=0x7ffae019ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ffad8031a20 tx=0x7ffad8031a50 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 shutdown_connections 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffae0106f10 0x7ffae019ee80 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ffac80a3240 0x7ffac80a5700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffae0102790 0x7ffae019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 --2- 172.21.15.52:0/2832360991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0101de0 0x7ffae019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 >> 172.21.15.52:0/2832360991 conn(0x7ffae00fd8c0 msgr2=0x7ffae00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 shutdown_connections 2024-09-19T09:31:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:49.396+0000 7ffae613c640 1 -- 172.21.15.52:0/2832360991 wait complete. 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: pgmap v649: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:49 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: pgmap v649: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:31:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:49 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:31:50.152 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:31:50.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:50.415 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 -- 172.21.15.52:0/2968881263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 msgr2=0x7fb22c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:50.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 --2- 172.21.15.52:0/2968881263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c1067e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fb218009900 tx=0x7fb21802a410 comp rx=0 tx=0).stop 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 -- 172.21.15.52:0/2968881263 shutdown_connections 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 --2- 172.21.15.52:0/2968881263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c106f10 0x7fb22c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 --2- 172.21.15.52:0/2968881263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c1067e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 --2- 172.21.15.52:0/2968881263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c101de0 0x7fb22c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 -- 172.21.15.52:0/2968881263 >> 172.21.15.52:0/2968881263 conn(0x7fb22c0fd8c0 msgr2=0x7fb22c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 -- 172.21.15.52:0/2968881263 shutdown_connections 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.860+0000 7fb232ea1640 1 -- 172.21.15.52:0/2968881263 wait complete. 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 Processor -- start 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 -- start start 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 0x7fb22c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:50.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 0x7fb22c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c111f30 con 0x7fb22c102790 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c111db0 con 0x7fb22c106f10 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.861+0000 7fb232ea1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c1120b0 con 0x7fb22c101de0 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb230c3d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 0x7fb22c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33142/0 (socket says 172.21.15.52:33142) 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 -- 172.21.15.52:0/4292121731 learned_addr learned my addr 172.21.15.52:0/4292121731 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb230c3d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 0x7fb22c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:35712/0 (socket says 172.21.15.52:35712) 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb23143e640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 0x7fb22c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 -- 172.21.15.52:0/4292121731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 msgr2=0x7fb22c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 0x7fb22c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 -- 172.21.15.52:0/4292121731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 msgr2=0x7fb22c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 0x7fb22c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 -- 172.21.15.52:0/4292121731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c1a6840 con 0x7fb22c102790 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb23143e640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 0x7fb22c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb22bfff640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fb218006010 tx=0x7fb2180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21803f030 con 0x7fb22c102790 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb218003ce0 con 0x7fb22c102790 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c1a6ad0 con 0x7fb22c102790 2024-09-19T09:31:50.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.862+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218035070 con 0x7fb22c102790 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.863+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c1a6fb0 con 0x7fb22c102790 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.864+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c1021c0 con 0x7fb22c102790 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.865+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb218042030 con 0x7fb22c102790 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.866+0000 7fb229ffb640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 0x7fb21c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.866+0000 7fb230c3d640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 0x7fb21c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.866+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2180f00f0 con 0x7fb22c102790 2024-09-19T09:31:50.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.866+0000 7fb230c3d640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 0x7fb21c0a5700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb22000abe0 tx=0x7fb22000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:50.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:50.869+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2180bcd30 con 0x7fb22c102790 2024-09-19T09:31:50.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:31:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.090+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb22c10a0f0 con 0x7fb22c102790 2024-09-19T09:31:51.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.091+0000 7fb229ffb640 1 -- 172.21.15.52:0/4292121731 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fb2180bc630 con 0x7fb22c102790 2024-09-19T09:31:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:51.092 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:51.092 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:51.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 msgr2=0x7fb21c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 0x7fb21c0a5700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb22000abe0 tx=0x7fb22000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 msgr2=0x7fb22c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fb218006010 tx=0x7fb2180042f0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 shutdown_connections 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb22c106f10 0x7fb22c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb22c102790 0x7fb22c074a30 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb21c0a3240 0x7fb21c0a5700 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 --2- 172.21.15.52:0/4292121731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb22c101de0 0x7fb22c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 >> 172.21.15.52:0/4292121731 conn(0x7fb22c0fd8c0 msgr2=0x7fb22c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 shutdown_connections 2024-09-19T09:31:51.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:51.093+0000 7fb232ea1640 1 -- 172.21.15.52:0/4292121731 wait complete. 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 -- 172.21.15.52:0/3524439517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b8107820 msgr2=0x7f68b8109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 --2- 172.21.15.52:0/3524439517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b8107820 0x7f68b8109c90 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009900 tx=0x7f68b002a410 comp rx=0 tx=0).stop 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 -- 172.21.15.52:0/3524439517 shutdown_connections 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 --2- 172.21.15.52:0/3524439517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b8107820 0x7f68b8109c90 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 --2- 172.21.15.52:0/3524439517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8104ef0 0x7f68b81072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 --2- 172.21.15.52:0/3524439517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b81025c0 0x7f68b81049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 -- 172.21.15.52:0/3524439517 >> 172.21.15.52:0/3524439517 conn(0x7f68b80fc1e0 msgr2=0x7f68b80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.537+0000 7f68bd21e640 1 -- 172.21.15.52:0/3524439517 shutdown_connections 2024-09-19T09:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.538+0000 7f68bd21e640 1 -- 172.21.15.52:0/3524439517 wait complete. 2024-09-19T09:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.538+0000 7f68bd21e640 1 Processor -- start 2024-09-19T09:31:51.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.538+0000 7f68bd21e640 1 -- start start 2024-09-19T09:31:51.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b8104ef0 0x7f68b8100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8107820 0x7f68b8100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68b810d800 con 0x7f68b81025c0 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68b810d680 con 0x7f68b8104ef0 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68b810d980 con 0x7f68b8107820 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33172/0 (socket says 172.21.15.52:33172) 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1144343186 learned_addr learned my addr 172.21.15.52:0/1144343186 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b759e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8107820 0x7f68b8100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1144343186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8107820 msgr2=0x7f68b8100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8107820 0x7f68b8100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1144343186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b8104ef0 msgr2=0x7f68b8100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b8104ef0 0x7f68b8100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1144343186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b8101340 con 0x7f68b81025c0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f68a800cce0 tx=0x7f68a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f689ffff640 1 -- 172.21.15.52:0/1144343186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a800f650 con 0x7f68b81025c0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f689ffff640 1 -- 172.21.15.52:0/1144343186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a800fcd0 con 0x7f68b81025c0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f689ffff640 1 -- 172.21.15.52:0/1144343186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8018c70 con 0x7f68b81025c0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.539+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b81a1e90 con 0x7f68b81025c0 2024-09-19T09:31:51.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.540+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b81a22f0 con 0x7f68b81025c0 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f689ffff640 1 -- 172.21.15.52:0/1144343186 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f68a800f7f0 con 0x7f68b81025c0 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 Processor -- start 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 -- start start 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683259da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683261830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5586831bd2f0 con 0x55868325a2e0 2024-09-19T09:31:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558683165270 con 0x55868325f370 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.542+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5586831b92b0 con 0x5586832599a0 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33178/0 (socket says 172.21.15.52:33178) 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1115047766 learned_addr learned my addr 172.21.15.52:0/1115047766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b759e640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683259da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f689ffff640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 0x7f68a00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b659c640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683261830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1115047766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 msgr2=0x558683259da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683259da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1115047766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 msgr2=0x558683261830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683261830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 -- 172.21.15.52:0/1115047766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558683164340 con 0x55868325a2e0 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b659c640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683261830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b759e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 0x7f68a00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f689ffff640 1 -- 172.21.15.52:0/1144343186 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68a80cff10 con 0x7f68b81025c0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f68a801fb80 tx=0x7f68a8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7053d70f5f74e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f689d7fa640 1 -- 172.21.15.52:0/1115047766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a809bdb0 con 0x55868325a2e0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f689d7fa640 1 -- 172.21.15.52:0/1115047766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a800dd50 con 0x55868325a2e0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.543+0000 7f689d7fa640 1 -- 172.21.15.52:0/1115047766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80d3a40 con 0x55868325a2e0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1115047766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 msgr2=0x55868325eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68b759e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 0x7f68a00a57b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f68a801fb80 tx=0x7f68a8020000 comp rx=0 tx=0).stop 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1115047766 shutdown_connections 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683261830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868325eda0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1115047766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683259da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1115047766 >> 172.21.15.52:0/1115047766 conn(0x558683255010 msgr2=0x558683255410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1115047766 shutdown_connections 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1115047766 wait complete. 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.544+0000 7f68bfbfd740 1 -- start start 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 Processor -- start 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683264070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x55868326b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5586832622e0 con 0x5586832599a0 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558683146290 con 0x55868325f370 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558683262460 con 0x55868325a2e0 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68bfbfd740 10 client.0 _ll_register_callbacks cb 0x558683177140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33180/0 (socket says 172.21.15.52:33180) 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 -- 172.21.15.52:0/2740466591 learned_addr learned my addr 172.21.15.52:0/2740466591 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b659c640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683264070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b759e640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x55868326b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 -- 172.21.15.52:0/2740466591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 msgr2=0x558683264070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683264070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 -- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 msgr2=0x55868326b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x55868326b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 -- 172.21.15.52:0/2740466591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558682ed0210 con 0x5586832599a0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f68a809c150 tx=0x7f68a80078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6778c806b8ebeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.545+0000 7f689aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80d3a40 con 0x5586832599a0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68a809a4f0 con 0x5586832599a0 2024-09-19T09:31:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5586831caa20 con 0x5586832599a0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f68a809bdb0 con 0x5586832599a0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 10 client.19092 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558682f9c620 con 0x5586832599a0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5586831caa20 con 0x5586832599a0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f68a801f370 con 0x5586832599a0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 10 client.19092 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 10 client.19092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 20 client.19092 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55868326f3b0 0x5586832717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 4 client.19092 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586831c4d70 con 0x55868326f3b0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.546+0000 7f68b659c640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55868326f3b0 0x5586832717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.547+0000 7f68b659c640 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55868326f3b0 0x5586832717a0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c738451961bfd9b server_cookie=76738707db7fe20f in_seq=0 out_seq=0 2024-09-19T09:31:51.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.547+0000 7f689aff5640 10 client.19092 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f689aff5640 1 -- 172.21.15.52:0/2740466591 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586831c4d70 con 0x55868326f3b0 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f689aff5640 10 client.19092 handle_command_reply: tid=0 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 client.19092 shutdown 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 msgr2=0x558683263b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f68a809c150 tx=0x7f68a80078c0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 shutdown_connections 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55868326f3b0 0x5586832717a0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x55868326b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683264070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/2740466591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683263b30 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 >> 172.21.15.52:0/2740466591 conn(0x558683255010 msgr2=0x558683256820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f689aff5640 0 client.19092 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 shutdown_connections 2024-09-19T09:31:51.556 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 1 -- 172.21.15.52:0/2740466591 wait complete. 2024-09-19T09:31:51.557 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.548+0000 7f68bfbfd740 20 client.19092 trim_cache size 0 max 16384 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 Processor -- start 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 -- start start 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683255ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683256400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81adbc0 con 0x55868325a2e0 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81ab490 con 0x55868325f370 2024-09-19T09:31:51.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81a92e0 con 0x5586832599a0 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68b659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.562+0000 7f68b659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33190/0 (socket says 172.21.15.52:33190) 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 -- 172.21.15.52:0/1086271613 learned_addr learned my addr 172.21.15.52:0/1086271613 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683255ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 -- 172.21.15.52:0/1086271613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 msgr2=0x558683255ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683255ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 -- 172.21.15.52:0/1086271613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 msgr2=0x558683256400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b759e640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683256400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683256400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 -- 172.21.15.52:0/1086271613 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868325a720 con 0x55868325a2e0 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683255ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:51.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f68b659c640 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f68ac005d00 tx=0x7f68ac00d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2a4615a6169770 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f689cff9640 1 -- 172.21.15.52:0/1086271613 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac004050 con 0x55868325a2e0 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f689cff9640 1 -- 172.21.15.52:0/1086271613 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ac0041f0 con 0x55868325a2e0 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.563+0000 7f689cff9640 1 -- 172.21.15.52:0/1086271613 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01b6e0 con 0x55868325a2e0 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1086271613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 msgr2=0x55868326b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f68ac005d00 tx=0x7f68ac00d650 comp rx=0 tx=0).stop 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1086271613 shutdown_connections 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683256400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55868325a2e0 0x55868326b040 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/1086271613 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5586832599a0 0x558683255ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1086271613 >> 172.21.15.52:0/1086271613 conn(0x558683255010 msgr2=0x5586832638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1086271613 shutdown_connections 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- 172.21.15.52:0/1086271613 wait complete. 2024-09-19T09:31:51.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- start start 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 Processor -- start 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683268c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683269c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81a9950 con 0x5586832599a0 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aadc0 con 0x55868325f370 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68b81aa020 con 0x55868325a2e0 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68bfbfd740 10 client.0 _ll_register_callbacks cb 0x7f68b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68b6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33202/0 (socket says 172.21.15.52:33202) 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.564+0000 7f68b6d9d640 1 -- 172.21.15.52:0/760546023 learned_addr learned my addr 172.21.15.52:0/760546023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:51.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b759e640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683269c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b659c640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683268c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 -- 172.21.15.52:0/760546023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 msgr2=0x558683268c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683268c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 -- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 msgr2=0x558683269c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683269c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 -- 172.21.15.52:0/760546023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868326a290 con 0x5586832599a0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b659c640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683268c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68b6d9d640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f68a8098e20 tx=0x7f68a809c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35558d89b22941e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80d3a40 con 0x5586832599a0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f68a809a750 con 0x5586832599a0 2024-09-19T09:31:51.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68ac0041f0 con 0x5586832599a0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f68a80ba020 con 0x5586832599a0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68bfbfd740 10 client.19098 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5586832d9fa0 con 0x5586832599a0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ac0041f0 con 0x5586832599a0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.565+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f68a801f300 con 0x5586832599a0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 10 client.19098 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 10 client.19098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 20 client.19098 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5586832da480 0x5586832dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 4 client.19098 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558683141900 con 0x5586832da480 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68b659c640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5586832da480 0x5586832dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:51.573 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f68b659c640 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5586832da480 0x5586832dc8c0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b46b3c3106f2a2f server_cookie=18aaa44d736781db in_seq=0 out_seq=0 2024-09-19T09:31:51.574 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.566+0000 7f689aff5640 10 client.19098 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f689aff5640 1 -- 172.21.15.52:0/760546023 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558683141900 con 0x5586832da480 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f689aff5640 10 client.19098 handle_command_reply: tid=0 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 client.19098 shutdown 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 msgr2=0x558683268730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f68a8098e20 tx=0x7f68a809c350 comp rx=0 tx=0).stop 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 shutdown_connections 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5586832da480 0x5586832dc8c0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55868325f370 0x558683269c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55868325a2e0 0x558683268c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.575 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 --2- 172.21.15.52:0/760546023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5586832599a0 0x558683268730 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f689aff5640 0 client.19098 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 >> 172.21.15.52:0/760546023 conn(0x558683255010 msgr2=0x5586832539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 shutdown_connections 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.573+0000 7f68bfbfd740 1 -- 172.21.15.52:0/760546023 wait complete. 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bfbfd740 20 client.19098 trim_cache size 0 max 16384 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:31:51.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:31:51.577 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:51 smithi052 ceph-mon[30947]: pgmap v650: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:51.577 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:51 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4292121731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 msgr2=0x7f68a00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 0x7f68a00a57b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b0009260 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 msgr2=0x7f68b8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f68a800cce0 tx=0x7f68a800a620 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 shutdown_connections 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f68a00a32f0 0x7f68a00a57b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b8107820 0x7f68b8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68b8104ef0 0x7f68b8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 --2- 172.21.15.52:0/1144343186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68b81025c0 0x7f68b8101f30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:51.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 >> 172.21.15.52:0/1144343186 conn(0x7f68b80fc1e0 msgr2=0x7f68b8102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 shutdown_connections 2024-09-19T09:31:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:31:51.574+0000 7f68bd21e640 1 -- 172.21.15.52:0/1144343186 wait complete. 2024-09-19T09:31:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:51 smithi169 ceph-mon[35454]: pgmap v650: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:51 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4292121731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:51 smithi086 ceph-mon[34813]: pgmap v650: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:31:51.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:51 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4292121731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:31:51.919 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 -- 172.21.15.52:0/2532205134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141036e0 msgr2=0x7f0a14107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 --2- 172.21.15.52:0/2532205134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141036e0 0x7f0a14107b90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009930 tx=0x7f0a0802a420 comp rx=0 tx=0).stop 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 -- 172.21.15.52:0/2532205134 shutdown_connections 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 --2- 172.21.15.52:0/2532205134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a141082a0 0x7f0a1410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 --2- 172.21.15.52:0/2532205134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141036e0 0x7f0a14107b90 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 --2- 172.21.15.52:0/2532205134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a14102d30 0x7f0a14103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 -- 172.21.15.52:0/2532205134 >> 172.21.15.52:0/2532205134 conn(0x7f0a140fc7d0 msgr2=0x7f0a140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 -- 172.21.15.52:0/2532205134 shutdown_connections 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 -- 172.21.15.52:0/2532205134 wait complete. 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.359+0000 7f0a1968c640 1 Processor -- start 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 -- start start 2024-09-19T09:31:52.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a14102d30 0x7f0a141a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a141036e0 0x7f0a141a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a141120c0 con 0x7f0a141082a0 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0a14111f40 con 0x7f0a14102d30 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a1968c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a14112240 con 0x7f0a141036e0 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33222/0 (socket says 172.21.15.52:33222) 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 -- 172.21.15.52:0/3926306092 learned_addr learned my addr 172.21.15.52:0/3926306092 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a12ffd640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a14102d30 0x7f0a141a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a127fc640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a141036e0 0x7f0a141a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 -- 172.21.15.52:0/3926306092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a141036e0 msgr2=0x7f0a141a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a141036e0 0x7f0a141a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 -- 172.21.15.52:0/3926306092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a14102d30 msgr2=0x7f0a141a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a14102d30 0x7f0a141a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.360+0000 7f0a137fe640 1 -- 172.21.15.52:0/3926306092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1419acc0 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f0a137fe640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b970 tx=0x7f0a0c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c019070 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1419afb0 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a0c014440 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0075d0 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.361+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a141a72a0 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.362+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a14103110 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.363+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a0c01c070 con 0x7f0a141082a0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.364+0000 7f09fbfff640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 0x7f09fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.364+0000 7f0a12ffd640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 0x7f09fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:52.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.364+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0a0c0cf040 con 0x7f0a141082a0 2024-09-19T09:31:52.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.364+0000 7f0a12ffd640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 0x7f09fc0a5700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400abe0 tx=0x7f0a0400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:52.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.368+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a0c09bc80 con 0x7f0a141082a0 2024-09-19T09:31:52.415 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:52.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.596+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a1419bac0 con 0x7f0a141082a0 2024-09-19T09:31:52.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.597+0000 7f09fbfff640 1 -- 172.21.15.52:0/3926306092 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f0a1419bac0 con 0x7f0a141082a0 2024-09-19T09:31:52.599 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:31:52.599 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:31:52.599 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:31:52.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 msgr2=0x7f09fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 0x7f09fc0a5700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400abe0 tx=0x7f0a0400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 msgr2=0x7f0a1419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b970 tx=0x7f0a0c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 shutdown_connections 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a141082a0 0x7f0a1419a590 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f09fc0a3240 0x7f09fc0a5700 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a141036e0 0x7f0a141a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 --2- 172.21.15.52:0/3926306092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a14102d30 0x7f0a141a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 >> 172.21.15.52:0/3926306092 conn(0x7f0a140fc7d0 msgr2=0x7f0a141013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 shutdown_connections 2024-09-19T09:31:52.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:52.599+0000 7f0a1968c640 1 -- 172.21.15.52:0/3926306092 wait complete. 2024-09-19T09:31:53.265 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id ae66c313 --release --await' 2024-09-19T09:31:53.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id ae66c313 --release --await 2024-09-19T09:31:53.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:53 smithi052 ceph-mon[30947]: pgmap v651: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:31:53.329 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:53 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3926306092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 -- 172.21.15.52:0/204158545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80106b80 msgr2=0x7fdc80106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 --2- 172.21.15.52:0/204158545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80106b80 0x7fdc80106f60 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009900 tx=0x7fdc7002a410 comp rx=0 tx=0).stop 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 -- 172.21.15.52:0/204158545 shutdown_connections 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 --2- 172.21.15.52:0/204158545 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80100aa0 0x7fdc8010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 --2- 172.21.15.52:0/204158545 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc80100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 --2- 172.21.15.52:0/204158545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80106b80 0x7fdc80106f60 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 -- 172.21.15.52:0/204158545 >> 172.21.15.52:0/204158545 conn(0x7fdc80077230 msgr2=0x7fdc800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 -- 172.21.15.52:0/204158545 shutdown_connections 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.489+0000 7fdc8697c640 1 -- 172.21.15.52:0/204158545 wait complete. 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.490+0000 7fdc8697c640 1 Processor -- start 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.490+0000 7fdc8697c640 1 -- start start 2024-09-19T09:31:53.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc801984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80106b80 0x7fdc8019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80112010 con 0x7fdc80100aa0 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80111e90 con 0x7fdc80106b80 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc8697c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80112190 con 0x7fdc80100100 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc801984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33236/0 (socket says 172.21.15.52:33236) 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/3569941494 learned_addr learned my addr 172.21.15.52:0/3569941494 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc84f19640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80106b80 0x7fdc8019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/3569941494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 msgr2=0x7fdc801984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc801984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/3569941494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80106b80 msgr2=0x7fdc8019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80106b80 0x7fdc8019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/3569941494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8019d460 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc801984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.491+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400d950 tx=0x7fdc7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.492+0000 7fdc7d7fa640 1 -- 172.21.15.52:0/3569941494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74017070 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.492+0000 7fdc7d7fa640 1 -- 172.21.15.52:0/3569941494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc74009c30 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.492+0000 7fdc7d7fa640 1 -- 172.21.15.52:0/3569941494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400f6b0 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.492+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8019d750 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.492+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc801a5030 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 Processor -- start 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 -- start start 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc7d7fa640 1 -- 172.21.15.52:0/3569941494 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc740109d0 con 0x7fdc80100aa0 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568132f6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813303760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55681325c2f0 con 0x556813301370 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556813203cf0 con 0x5568132f65d0 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc88d55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5568132582b0 con 0x5568132f7b40 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:36658/0 (socket says 172.21.15.52:36658) 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2294717028 learned_addr learned my addr 172.21.15.52:0/2294717028 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.495+0000 7fdc84f19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568132f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813303760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2294717028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 msgr2=0x5568132f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568132f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2294717028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 msgr2=0x556813303760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813303760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2294717028 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568131e83a0 con 0x5568132f65d0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc7002a930 tx=0x7fdc70031580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84596e85056a54bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7d7fa640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 0x7fdc680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc84f19640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 0x7fdc680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc667fc640 1 -- 172.21.15.52:0/2294717028 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70040070 con 0x5568132f65d0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc7d7fa640 1 -- 172.21.15.52:0/3569941494 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdc740cf570 con 0x7fdc80100aa0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc667fc640 1 -- 172.21.15.52:0/2294717028 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc700044b0 con 0x5568132f65d0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.496+0000 7fdc667fc640 1 -- 172.21.15.52:0/2294717028 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70035040 con 0x5568132f65d0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 -- 172.21.15.52:0/2294717028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 msgr2=0x5568132f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc7002a930 tx=0x7fdc70031580 comp rx=0 tx=0).stop 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc84f19640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 0x7fdc680a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc801077c0 tx=0x7fdc780096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 -- 172.21.15.52:0/2294717028 shutdown_connections 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813303760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x5568132f6a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2294717028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568132f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 -- 172.21.15.52:0/2294717028 >> 172.21.15.52:0/2294717028 conn(0x5568132bf310 msgr2=0x5568132f2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 -- 172.21.15.52:0/2294717028 shutdown_connections 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.497+0000 7fdc88d55740 1 -- 172.21.15.52:0/2294717028 wait complete. 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 -- start start 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 Processor -- start 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813300d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 0x5568132fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556813304010 con 0x5568132f7b40 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556813217060 con 0x5568132f65d0 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556813304190 con 0x556813301370 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.498+0000 7fdc88d55740 10 client.0 _ll_register_callbacks cb 0x556812f6a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:53.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33258/0 (socket says 172.21.15.52:33258) 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 0x5568132fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813300d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/1524487001 learned_addr learned my addr 172.21.15.52:0/1524487001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 -- 172.21.15.52:0/1524487001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 msgr2=0x556813300d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813300d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 -- 172.21.15.52:0/1524487001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 msgr2=0x5568132fdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 -- 172.21.15.52:0/1524487001 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556812fcd3c0 con 0x556813301370 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc84f19640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 0x5568132fe5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004950 tx=0x7fdc78004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34de6967983b27f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7802c060 con 0x556813301370 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc700044b0 con 0x556813301370 2024-09-19T09:31:53.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.499+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdc78017030 con 0x556813301370 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.500+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc78011650 con 0x556813301370 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.500+0000 7fdc88d55740 10 client.27688 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.500+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55681330fb30 con 0x556813301370 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.500+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc700044b0 con 0x556813301370 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc780278d0 con 0x556813301370 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 10 client.27688 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 10 client.27688 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 20 client.27688 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556813310f40 0x556813313350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 4 client.27688 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556813269860 con 0x556813310f40 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556813310f40 0x556813313350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc5f7fe640 10 client.27688 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.501+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556813310f40 0x556813313350 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=702c3e3710a1dc34 server_cookie=535f1079beea8d62 in_seq=0 out_seq=0 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.502+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/1524487001 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556813269860 con 0x556813310f40 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.502+0000 7fdc5f7fe640 10 client.27688 handle_command_reply: tid=0 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.502+0000 7fdc88d55740 1 client.27688 shutdown 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.502+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 msgr2=0x5568132fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 0x5568132fe5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc78004950 tx=0x7fdc78004ab0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 shutdown_connections 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x556813310f40 0x556813313350 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556813301370 0x5568132fe5e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f7b40 0x5568132fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 --2- 172.21.15.52:0/1524487001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813300d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 >> 172.21.15.52:0/1524487001 conn(0x5568132bf310 msgr2=0x5568132f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc5f7fe640 0 client.27688 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:53.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 shutdown_connections 2024-09-19T09:31:53.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 1 -- 172.21.15.52:0/1524487001 wait complete. 2024-09-19T09:31:53.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.503+0000 7fdc88d55740 20 client.27688 trim_cache size 0 max 16384 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 Processor -- start 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 -- start start 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x55681330d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556813301370 0x5568132f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801b0020 con 0x5568132f65d0 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ad8f0 con 0x556813301370 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc88d55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ab740 con 0x5568132f7b40 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.517+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33266/0 (socket says 172.21.15.52:33266) 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2534779498 learned_addr learned my addr 172.21.15.52:0/2534779498 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc84f19640 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556813301370 0x5568132f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x55681330d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2534779498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 msgr2=0x55681330d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x55681330d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2534779498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556813301370 msgr2=0x5568132f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556813301370 0x5568132f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 -- 172.21.15.52:0/2534779498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568132fc540 con 0x5568132f65d0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fdc7002a930 tx=0x7fdc70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27764354eca4a159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc65ffb640 1 -- 172.21.15.52:0/2534779498 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70040040 con 0x5568132f65d0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc65ffb640 1 -- 172.21.15.52:0/2534779498 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc700044b0 con 0x5568132f65d0 2024-09-19T09:31:53.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.518+0000 7fdc65ffb640 1 -- 172.21.15.52:0/2534779498 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70035040 con 0x5568132f65d0 2024-09-19T09:31:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- 172.21.15.52:0/2534779498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 msgr2=0x5568132f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fdc7002a930 tx=0x7fdc70000bc0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- 172.21.15.52:0/2534779498 shutdown_connections 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556813301370 0x5568132f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x55681330d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 --2- 172.21.15.52:0/2534779498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5568132f65d0 0x5568132f2e10 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- 172.21.15.52:0/2534779498 >> 172.21.15.52:0/2534779498 conn(0x5568132bf310 msgr2=0x5568132f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- 172.21.15.52:0/2534779498 shutdown_connections 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- 172.21.15.52:0/2534779498 wait complete. 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.519+0000 7fdc88d55740 1 -- start start 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 Processor -- start 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813309490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813374340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801abdb0 con 0x556813301370 2024-09-19T09:31:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ad220 con 0x5568132f65d0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ac480 con 0x5568132f7b40 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc88d55740 10 client.0 _ll_register_callbacks cb 0x7fdc78003f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc84f19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813374340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc7f7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:35824/0 (socket says 172.21.15.52:35824) 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc7ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813309490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.520+0000 7fdc7f7fe640 1 -- 172.21.15.52:0/3797704440 learned_addr learned my addr 172.21.15.52:0/3797704440 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 -- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 msgr2=0x5568133099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 -- 172.21.15.52:0/3797704440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 msgr2=0x556813374340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813374340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 -- 172.21.15.52:0/3797704440 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568133749b0 con 0x5568132f65d0 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc84f19640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813374340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc7ffff640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813309490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc70006010 tx=0x7fdc700316e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e63d2e4bdc84126 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70035070 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdc700319f0 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc700044b0 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc70040040 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc88d55740 10 client.27977 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.521+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556813306f00 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc700044b0 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc70004800 con 0x5568132f65d0 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 10 client.27977 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 10 client.27977 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:31:53.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 20 client.27977 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55681337ffd0 0x5568133823c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 4 client.27977 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556813263d70 con 0x55681337ffd0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.522+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55681337ffd0 0x5568133823c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc5f7fe640 10 client.27977 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc7f7fe640 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55681337ffd0 0x5568133823c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d630239a0c2584b5 server_cookie=524b37f54762287a in_seq=0 out_seq=0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc5f7fe640 1 -- 172.21.15.52:0/3797704440 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556813263d70 con 0x55681337ffd0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc5f7fe640 10 client.27977 handle_command_reply: tid=0 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 client.27977 shutdown 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 msgr2=0x556813309490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813309490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc70006010 tx=0x7fdc700316e0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 shutdown_connections 2024-09-19T09:31:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55681337ffd0 0x5568133823c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556813301370 0x556813374340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc5f7fe640 0 client.27977 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5568132f7b40 0x5568133099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 --2- 172.21.15.52:0/3797704440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5568132f65d0 0x556813309490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 >> 172.21.15.52:0/3797704440 conn(0x5568132bf310 msgr2=0x5568132ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 shutdown_connections 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.523+0000 7fdc88d55740 1 -- 172.21.15.52:0/3797704440 wait complete. 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc88d55740 20 client.27977 trim_cache size 0 max 16384 2024-09-19T09:31:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 msgr2=0x7fdc680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 0x7fdc680a5700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc801077c0 tx=0x7fdc780096c0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 msgr2=0x7fdc801989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400d950 tx=0x7fdc7400de10 comp rx=0 tx=0).stop 2024-09-19T09:31:53.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 shutdown_connections 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc80106b80 0x7fdc8019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc80100aa0 0x7fdc801989f0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdc680a3240 0x7fdc680a5700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 --2- 172.21.15.52:0/3569941494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc80100100 0x7fdc801984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 >> 172.21.15.52:0/3569941494 conn(0x7fdc80077230 msgr2=0x7fdc80104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 shutdown_connections 2024-09-19T09:31:53.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:53.524+0000 7fdc8697c640 1 -- 172.21.15.52:0/3569941494 wait complete. 2024-09-19T09:31:53.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:53 smithi169 ceph-mon[35454]: pgmap v651: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:31:53.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:53 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3926306092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:53.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:53 smithi086 ceph-mon[34813]: pgmap v651: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:31:53.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:53 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3926306092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:31:54.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:31:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 -- 172.21.15.52:0/2206914862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 msgr2=0x7ff11810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 --2- 172.21.15.52:0/2206914862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11810e790 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7ff110009ca0 tx=0x7ff11002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 -- 172.21.15.52:0/2206914862 shutdown_connections 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 --2- 172.21.15.52:0/2206914862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11810e790 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 --2- 172.21.15.52:0/2206914862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 0x7ff11810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 --2- 172.21.15.52:0/2206914862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 0x7ff1181031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 -- 172.21.15.52:0/2206914862 >> 172.21.15.52:0/2206914862 conn(0x7ff1180fc7d0 msgr2=0x7ff1180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 -- 172.21.15.52:0/2206914862 shutdown_connections 2024-09-19T09:31:54.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.765+0000 7ff11efbc640 1 -- 172.21.15.52:0/2206914862 wait complete. 2024-09-19T09:31:54.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 Processor -- start 2024-09-19T09:31:54.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 -- start start 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 0x7ff118198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 0x7ff118198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181120f0 con 0x7ff11810c2f0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff118111f70 con 0x7ff118102df0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11efbc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff118112270 con 0x7ff1181037a0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11d559640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11d559640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33290/0 (socket says 172.21.15.52:33290) 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11d559640 1 -- 172.21.15.52:0/3807182180 learned_addr learned my addr 172.21.15.52:0/3807182180 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff11cd58640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 0x7ff118198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.766+0000 7ff117fff640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 0x7ff118198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 -- 172.21.15.52:0/3807182180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 msgr2=0x7ff118198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 0x7ff118198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 -- 172.21.15.52:0/3807182180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 msgr2=0x7ff118198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 0x7ff118198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 -- 172.21.15.52:0/3807182180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11819d5c0 con 0x7ff11810c2f0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11d559640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff110031a20 tx=0x7ff110031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff115ffb640 1 -- 172.21.15.52:0/3807182180 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110003c30 con 0x7ff11810c2f0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff115ffb640 1 -- 172.21.15.52:0/3807182180 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff110003dd0 con 0x7ff11810c2f0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11819d850 con 0x7ff11810c2f0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff115ffb640 1 -- 172.21.15.52:0/3807182180 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11002fcf0 con 0x7ff11810c2f0 2024-09-19T09:31:54.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.767+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1181a5190 con 0x7ff11810c2f0 2024-09-19T09:31:54.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.770+0000 7ff121395740 1 Processor -- start 2024-09-19T09:31:54.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.770+0000 7ff115ffb640 1 -- 172.21.15.52:0/3807182180 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff110004050 con 0x7ff11810c2f0 2024-09-19T09:31:54.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.770+0000 7ff121395740 1 -- start start 2024-09-19T09:31:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.770+0000 7ff121395740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6060 0x55ff0a9d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.770+0000 7ff121395740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff121395740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff121395740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a93b620 con 0x55ff0a9d6980 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff121395740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a8e2e50 con 0x55ff0a9d6060 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff121395740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a9375e0 con 0x55ff0a9e1240 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33302/0 (socket says 172.21.15.52:33302) 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 -- 172.21.15.52:0/4085094081 learned_addr learned my addr 172.21.15.52:0/4085094081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff117fff640 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff117fff640 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6060 0x55ff0a9d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 -- 172.21.15.52:0/4085094081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 msgr2=0x55ff0a9e3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 -- 172.21.15.52:0/4085094081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6060 msgr2=0x55ff0a9d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6060 0x55ff0a9d6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff11cd58640 1 -- 172.21.15.52:0/4085094081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a8d3d40 con 0x55ff0a9d6980 2024-09-19T09:31:54.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.771+0000 7ff115ffb640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 0x7ff1080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff117fff640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 0x7ff1080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff115ffb640 1 -- 172.21.15.52:0/3807182180 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff1100f0c30 con 0x7ff11810c2f0 2024-09-19T09:31:54.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff11cd58640 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00bd10 tx=0x7ff10c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0a24c921c33324 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff102ffd640 1 -- 172.21.15.52:0/4085094081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c004030 con 0x55ff0a9d6980 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff102ffd640 1 -- 172.21.15.52:0/4085094081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff10c0041d0 con 0x55ff0a9d6980 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.772+0000 7ff102ffd640 1 -- 172.21.15.52:0/4085094081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0117a0 con 0x55ff0a9d6980 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- 172.21.15.52:0/4085094081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 msgr2=0x55ff0a9e0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff117fff640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 0x7ff1080a5700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55ff0a9d3970 tx=0x7ff10400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00bd10 tx=0x7ff10c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- 172.21.15.52:0/4085094081 shutdown_connections 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e0d00 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 --2- 172.21.15.52:0/4085094081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6060 0x55ff0a9d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- 172.21.15.52:0/4085094081 >> 172.21.15.52:0/4085094081 conn(0x55ff0a9d25f0 msgr2=0x55ff0a9d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- 172.21.15.52:0/4085094081 shutdown_connections 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- 172.21.15.52:0/4085094081 wait complete. 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.773+0000 7ff121395740 1 -- start start 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 Processor -- start 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a9e3e10 con 0x55ff0a9d6060 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a8c3f10 con 0x55ff0a9d6980 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a9e3f90 con 0x55ff0a9e1240 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff121395740 10 client.0 _ll_register_callbacks cb 0x55ff0a8e7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:54.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33306/0 (socket says 172.21.15.52:33306) 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.774+0000 7ff11cd58640 1 -- 172.21.15.52:0/2681362848 learned_addr learned my addr 172.21.15.52:0/2681362848 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11d559640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 -- 172.21.15.52:0/2681362848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 msgr2=0x55ff0a9deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9deb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 -- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 msgr2=0x55ff0a9de5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9de5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 -- 172.21.15.52:0/2681362848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0a64a580 con 0x55ff0a9d6060 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff10c003d30 tx=0x7ff10c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f976fd6f801922c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c029060 con 0x55ff0a9d6060 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff10c004380 con 0x55ff0a9d6060 2024-09-19T09:31:54.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff10c0041d0 con 0x55ff0a9d6060 2024-09-19T09:31:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff10c0035f0 con 0x55ff0a9d6060 2024-09-19T09:31:54.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.775+0000 7ff121395740 10 client.19134 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff0a714960 con 0x55ff0a9d6060 2024-09-19T09:31:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff10c005040 con 0x55ff0a9d6060 2024-09-19T09:31:54.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff10c004870 con 0x55ff0a9d6060 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 10 client.19134 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 10 client.19134 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 20 client.19134 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0a9f0c70 0x55ff0a9f3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 4 client.19134 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.776+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff10c0041d0 con 0x55ff0a9f0c70 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.777+0000 7ff117fff640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0a9f0c70 0x55ff0a9f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.777+0000 7ff117fff640 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0a9f0c70 0x55ff0a9f3060 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc1b721d0b7b1c1 server_cookie=956f0e9a06956b57 in_seq=0 out_seq=0 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.777+0000 7ff0f7fff640 10 client.19134 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2681362848 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff10c0041d0 con 0x55ff0a9f0c70 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff0f7fff640 10 client.19134 handle_command_reply: tid=0 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 client.19134 shutdown 2024-09-19T09:31:54.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 msgr2=0x55ff0a9de0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7ff10c003d30 tx=0x7ff10c003d60 comp rx=0 tx=0).stop 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 shutdown_connections 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0a9f0c70 0x55ff0a9f3060 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff0f7fff640 0 client.19134 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 --2- 172.21.15.52:0/2681362848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9de0a0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 >> 172.21.15.52:0/2681362848 conn(0x55ff0a9d25f0 msgr2=0x55ff0a9d8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 shutdown_connections 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 1 -- 172.21.15.52:0/2681362848 wait complete. 2024-09-19T09:31:54.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.778+0000 7ff121395740 20 client.19134 trim_cache size 0 max 16384 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 Processor -- start 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 -- start start 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9f8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9db320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181b00e0 con 0x55ff0a9d6060 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181ad9b0 con 0x55ff0a9d6980 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff121395740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181ab800 con 0x55ff0a9e1240 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33314/0 (socket says 172.21.15.52:33314) 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff11cd58640 1 -- 172.21.15.52:0/372848825 learned_addr learned my addr 172.21.15.52:0/372848825 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff117fff640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9f8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.797+0000 7ff11d559640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 -- 172.21.15.52:0/372848825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 msgr2=0x55ff0a9db320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9db320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 -- 172.21.15.52:0/372848825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 msgr2=0x55ff0a9f8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9f8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 -- 172.21.15.52:0/372848825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a9d2420 con 0x55ff0a9d6060 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff117fff640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff11cd58640 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00bc30 tx=0x7ff10c005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2908cd4360300a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff1027fc640 1 -- 172.21.15.52:0/372848825 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c029050 con 0x55ff0a9d6060 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff1027fc640 1 -- 172.21.15.52:0/372848825 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff10c011650 con 0x55ff0a9d6060 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.798+0000 7ff1027fc640 1 -- 172.21.15.52:0/372848825 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0052a0 con 0x55ff0a9d6060 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 -- 172.21.15.52:0/372848825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 msgr2=0x55ff0a9f8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00bc30 tx=0x7ff10c005900 comp rx=0 tx=0).stop 2024-09-19T09:31:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 -- 172.21.15.52:0/372848825 shutdown_connections 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9db320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9f8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 --2- 172.21.15.52:0/372848825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9f8720 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 -- 172.21.15.52:0/372848825 >> 172.21.15.52:0/372848825 conn(0x55ff0a9d25f0 msgr2=0x55ff0a9dd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 -- 172.21.15.52:0/372848825 shutdown_connections 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.799+0000 7ff121395740 1 -- 172.21.15.52:0/372848825 wait complete. 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 -- start start 2024-09-19T09:31:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 Processor -- start 2024-09-19T09:31:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181abe70 con 0x55ff0a9d6060 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181ad2e0 con 0x55ff0a9d6980 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181ac540 con 0x55ff0a9e1240 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff121395740 10 client.0 _ll_register_callbacks cb 0x7ff10c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.800+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33320/0 (socket says 172.21.15.52:33320) 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 -- 172.21.15.52:0/2170102296 learned_addr learned my addr 172.21.15.52:0/2170102296 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff117fff640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11d559640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 -- 172.21.15.52:0/2170102296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 msgr2=0x55ff0a9e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 -- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 msgr2=0x55ff0a9e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 -- 172.21.15.52:0/2170102296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0a9e96b0 con 0x55ff0a9d6060 2024-09-19T09:31:54.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff117fff640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff11cd58640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff10c005530 tx=0x7ff10c005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68290f621ebf4b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff0f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c03d020 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff10c0039a0 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.801+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff10c011650 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff10c048050 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 10 client.19140 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff0aa60440 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff10c011650 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff10c0047b0 con 0x55ff0a9d6060 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 10 client.19140 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 10 client.19140 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 20 client.19140 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:54.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0aa60aa0 0x55ff0aa62ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 4 client.19140 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ae66c313", "release": true, "await": true}] 2024-09-19T09:31:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ae66c313", "release": true, "await": true}) -- 0x55ff0a948b90 con 0x55ff0aa60aa0 2024-09-19T09:31:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.802+0000 7ff117fff640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0aa60aa0 0x55ff0aa62ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.808 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.803+0000 7ff0f7fff640 10 client.19140 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.803+0000 7ff117fff640 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0aa60aa0 0x55ff0aa62ec0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30ffee05a0c853a6 server_cookie=379a8cfda8d377c2 in_seq=0 out_seq=0 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff0f7fff640 1 -- 172.21.15.52:0/2170102296 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ff0a948b90 con 0x55ff0aa60aa0 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff0f7fff640 10 client.19140 handle_command_reply: tid=0 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 client.19140 shutdown 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 msgr2=0x55ff0a9e81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff10c005530 tx=0x7ff10c005560 comp rx=0 tx=0).stop 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 shutdown_connections 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff0aa60aa0 0x55ff0aa62ec0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff0a9e1240 0x55ff0a9e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff0a9d6980 0x55ff0a9e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff0f7fff640 0 client.19140 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 --2- 172.21.15.52:0/2170102296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff0a9d6060 0x55ff0a9e81e0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 >> 172.21.15.52:0/2170102296 conn(0x55ff0a9d25f0 msgr2=0x55ff0a9d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 shutdown_connections 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.805+0000 7ff121395740 1 -- 172.21.15.52:0/2170102296 wait complete. 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff121395740 20 client.19140 trim_cache size 0 max 16384 2024-09-19T09:31:54.810 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 40, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "ae66c313": { 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 40, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:31:54.811 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 150.0, 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:31:54.812 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 msgr2=0x7ff1080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 0x7ff1080a5700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55ff0a9d3970 tx=0x7ff10400b390 comp rx=0 tx=0).stop 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 msgr2=0x7ff11819cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7ff110031a20 tx=0x7ff110031a50 comp rx=0 tx=0).stop 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 shutdown_connections 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff11810c2f0 0x7ff11819cee0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff1080a3240 0x7ff1080a5700 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1181037a0 0x7ff118198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 --2- 172.21.15.52:0/3807182180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff118102df0 0x7ff118198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 >> 172.21.15.52:0/3807182180 conn(0x7ff1180fc7d0 msgr2=0x7ff1180fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 shutdown_connections 2024-09-19T09:31:54.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:54.806+0000 7ff11efbc640 1 -- 172.21.15.52:0/3807182180 wait complete. 2024-09-19T09:31:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:55 smithi052 ceph-mon[30947]: pgmap v652: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.523+0000 7f2a625a5640 1 -- 172.21.15.52:0/2345620996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c101de0 msgr2=0x7f2a5c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.523+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2345620996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1021c0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009900 tx=0x7f2a4c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 -- 172.21.15.52:0/2345620996 shutdown_connections 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2345620996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 0x7f2a5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2345620996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c102790 0x7f2a5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2345620996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1021c0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 -- 172.21.15.52:0/2345620996 >> 172.21.15.52:0/2345620996 conn(0x7f2a5c0fd8c0 msgr2=0x7f2a5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 -- 172.21.15.52:0/2345620996 shutdown_connections 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 -- 172.21.15.52:0/2345620996 wait complete. 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 Processor -- start 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.524+0000 7f2a625a5640 1 -- start start 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 0x7f2a5c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c111f70 con 0x7f2a5c102790 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c111df0 con 0x7f2a5c106f10 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a625a5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1120f0 con 0x7f2a5c101de0 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33336/0 (socket says 172.21.15.52:33336) 2024-09-19T09:31:55.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 -- 172.21.15.52:0/2449801019 learned_addr learned my addr 172.21.15.52:0/2449801019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a60b42640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 0x7f2a5c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 -- 172.21.15.52:0/2449801019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 msgr2=0x7f2a5c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 -- 172.21.15.52:0/2449801019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 msgr2=0x7f2a5c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 0x7f2a5c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 -- 172.21.15.52:0/2449801019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c19d380 con 0x7f2a5c102790 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.525+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c890 tx=0x7f2a5000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.526+0000 7f2a597fa640 1 -- 172.21.15.52:0/2449801019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50004220 con 0x7f2a5c102790 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.526+0000 7f2a597fa640 1 -- 172.21.15.52:0/2449801019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a500043c0 con 0x7f2a5c102790 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.526+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c19d670 con 0x7f2a5c102790 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.526+0000 7f2a597fa640 1 -- 172.21.15.52:0/2449801019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a500049e0 con 0x7f2a5c102790 2024-09-19T09:31:55.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.526+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c1a4f50 con 0x7f2a5c102790 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a597fa640 1 -- 172.21.15.52:0/2449801019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2a500079b0 con 0x7f2a5c102790 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 Processor -- start 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 -- start start 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ed6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ee3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562c50e3c2f0 con 0x562c50ed7b40 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562c50de3cf0 con 0x562c50ed65d0 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a6497e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c50e382b0 con 0x562c50ee1370 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a60b42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a60b42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33350/0 (socket says 172.21.15.52:33350) 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.528+0000 7f2a60b42640 1 -- 172.21.15.52:0/3620171625 learned_addr learned my addr 172.21.15.52:0/3620171625 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ee3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a597fa640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 0x7f2a440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ed6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 -- 172.21.15.52:0/3620171625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 msgr2=0x562c50ee3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ee3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 -- 172.21.15.52:0/3620171625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 msgr2=0x562c50ed6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ed6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 -- 172.21.15.52:0/3620171625 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c50dc83a0 con 0x562c50ed7b40 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ee3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 0x7f2a440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a597fa640 1 -- 172.21.15.52:0/2449801019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a500cf9b0 con 0x7f2a5c102790 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2a540072e0 tx=0x7f2a5400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f862bef55446a462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a427fc640 1 -- 172.21.15.52:0/3620171625 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54019870 con 0x562c50ed7b40 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a60b42640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 0x7f2a440a5780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a54020000 tx=0x7f2a5401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a427fc640 1 -- 172.21.15.52:0/3620171625 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a54010430 con 0x562c50ed7b40 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.529+0000 7f2a427fc640 1 -- 172.21.15.52:0/3620171625 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5401a650 con 0x562c50ed7b40 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- 172.21.15.52:0/3620171625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 msgr2=0x562c50ed6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2a540072e0 tx=0x7f2a5400f850 comp rx=0 tx=0).stop 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- 172.21.15.52:0/3620171625 shutdown_connections 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ee3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ed6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 --2- 172.21.15.52:0/3620171625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed7b40 0x562c50ed6090 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- 172.21.15.52:0/3620171625 >> 172.21.15.52:0/3620171625 conn(0x562c50e9f310 msgr2=0x562c50ed2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- 172.21.15.52:0/3620171625 shutdown_connections 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- 172.21.15.52:0/3620171625 wait complete. 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.530+0000 7f2a6497e740 1 -- start start 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 Processor -- start 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 0x562c50ede050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ede7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562c50ee8480 con 0x562c50ed65d0 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562c50df7060 con 0x562c50ed7b40 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562c50ee8600 con 0x562c50ee1370 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a6497e740 10 client.0 _ll_register_callbacks cb 0x562c50b4a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33360/0 (socket says 172.21.15.52:33360) 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 -- 172.21.15.52:0/23346871 learned_addr learned my addr 172.21.15.52:0/23346871 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 0x562c50ede050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a60b42640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ede7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 -- 172.21.15.52:0/23346871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 msgr2=0x562c50ede7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ede7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 -- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 msgr2=0x562c50ede050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 0x562c50ede050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5bfff640 1 -- 172.21.15.52:0/23346871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c50bad3c0 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.531+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 0x562c50ede050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c02a910 tx=0x7f2a4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807256f1238cc3f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c035070 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a4c005220 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a54010430 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a4c049030 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a6497e740 10 client.19152 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562c50ef3f60 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.532+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a54010430 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a4c0035f0 con 0x562c50ed65d0 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 10 client.19152 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:55.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 10 client.19152 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 20 client.19152 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50ef5370 0x562c50ef7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 4 client.19152 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c50e49860 con 0x562c50ef5370 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50ef5370 0x562c50ef7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50ef5370 0x562c50ef7780 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1715aaaf429b7e90 server_cookie=118aa477843d04b0 in_seq=0 out_seq=0 2024-09-19T09:31:55.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.533+0000 7f2a3b7fe640 10 client.19152 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/23346871 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c50e49860 con 0x562c50ef5370 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a3b7fe640 10 client.19152 handle_command_reply: tid=0 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 client.19152 shutdown 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 msgr2=0x562c50ee0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c02a910 tx=0x7f2a4c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 shutdown_connections 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ee1370 0x562c50ede7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50ef5370 0x562c50ef7780 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed7b40 0x562c50ede050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 --2- 172.21.15.52:0/23346871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ee0da0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 >> 172.21.15.52:0/23346871 conn(0x562c50e9f310 msgr2=0x562c50ed8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a3b7fe640 0 client.19152 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 shutdown_connections 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.534+0000 7f2a6497e740 1 -- 172.21.15.52:0/23346871 wait complete. 2024-09-19T09:31:55.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.535+0000 7f2a6497e740 20 client.19152 trim_cache size 0 max 16384 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 Processor -- start 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 -- start start 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ed9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 0x562c50ed9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1add90 con 0x562c50ed65d0 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1ab660 con 0x562c50ee1370 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a6497e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1a94b0 con 0x562c50ed7b40 2024-09-19T09:31:55.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33366/0 (socket says 172.21.15.52:33366) 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 -- 172.21.15.52:0/394606517 learned_addr learned my addr 172.21.15.52:0/394606517 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 -- 172.21.15.52:0/394606517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 msgr2=0x562c50ed9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ed9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a60b42640 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 0x562c50ed9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 -- 172.21.15.52:0/394606517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 msgr2=0x562c50ed9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 0x562c50ed9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 -- 172.21.15.52:0/394606517 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c50ed2510 con 0x562c50ed65d0 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a60b42640 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 0x562c50ed9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:55.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.548+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009900 tx=0x7f2a4c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3b07ee1420ba9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a41ffb640 1 -- 172.21.15.52:0/394606517 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c035050 con 0x562c50ed65d0 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a41ffb640 1 -- 172.21.15.52:0/394606517 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4c004420 con 0x562c50ed65d0 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a41ffb640 1 -- 172.21.15.52:0/394606517 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c044bc0 con 0x562c50ed65d0 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 -- 172.21.15.52:0/394606517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 msgr2=0x562c50ed2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009900 tx=0x7f2a4c001e70 comp rx=0 tx=0).stop 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 -- 172.21.15.52:0/394606517 shutdown_connections 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ee1370 0x562c50ed9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ed9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 --2- 172.21.15.52:0/394606517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ed65d0 0x562c50ed2e10 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 -- 172.21.15.52:0/394606517 >> 172.21.15.52:0/394606517 conn(0x562c50e9f310 msgr2=0x562c50ed2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 -- 172.21.15.52:0/394606517 shutdown_connections 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.549+0000 7f2a6497e740 1 -- 172.21.15.52:0/394606517 wait complete. 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 -- start start 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 Processor -- start 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ee9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ee1370 0x562c50f5e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1a9b20 con 0x562c50ee1370 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1aaf90 con 0x562c50ed65d0 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c1aa1f0 con 0x562c50ed7b40 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.550+0000 7f2a6497e740 10 client.0 _ll_register_callbacks cb 0x7f2a4c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:36818/0 (socket says 172.21.15.52:36818) 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 -- 172.21.15.52:0/4094895291 learned_addr learned my addr 172.21.15.52:0/4094895291 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:55.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a60b42640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ee1370 0x562c50f5e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ee9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 -- 172.21.15.52:0/4094895291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 msgr2=0x562c50ee9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ee9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 -- 172.21.15.52:0/4094895291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ee1370 msgr2=0x562c50f5e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ee1370 0x562c50f5e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 -- 172.21.15.52:0/4094895291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c50f5e5d0 con 0x562c50ed65d0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a5bfff640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004330 tx=0x7f2a4c0045d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b8ed6ad4f2b7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.551+0000 7f2a3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c063060 con 0x562c50ed65d0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a4c044480 con 0x562c50ed65d0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a4c004420 con 0x562c50ed65d0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a4c035050 con 0x562c50ed65d0 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 10 client.28004 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:55.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562c50f5f7e0 con 0x562c50ed65d0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4c004420 con 0x562c50ed65d0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a4c03b790 con 0x562c50ed65d0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 10 client.28004 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 10 client.28004 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 20 client.28004 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50f5fe40 0x562c50f62230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 4 client.28004 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.552+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c50e43d70 con 0x562c50f5fe40 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50f5fe40 0x562c50f62230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a5b7fe640 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50f5fe40 0x562c50f62230 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c175334965228507 server_cookie=e40f30f23273b805 in_seq=0 out_seq=0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a3b7fe640 10 client.28004 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a3b7fe640 1 -- 172.21.15.52:0/4094895291 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c50e43d70 con 0x562c50f5fe40 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a3b7fe640 10 client.28004 handle_command_reply: tid=0 2024-09-19T09:31:55.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 client.28004 shutdown 2024-09-19T09:31:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 msgr2=0x562c50ee8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c004330 tx=0x7f2a4c0045d0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 shutdown_connections 2024-09-19T09:31:55.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562c50ee1370 0x562c50f5e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562c50ed7b40 0x562c50ee9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562c50f5fe40 0x562c50f62230 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 --2- 172.21.15.52:0/4094895291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562c50ed65d0 0x562c50ee8df0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a3b7fe640 0 client.28004 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.553+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 >> 172.21.15.52:0/4094895291 conn(0x562c50e9f310 msgr2=0x562c50ed1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 shutdown_connections 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a6497e740 1 -- 172.21.15.52:0/4094895291 wait complete. 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a6497e740 20 client.28004 trim_cache size 0 max 16384 2024-09-19T09:31:55.560 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 msgr2=0x7f2a440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 0x7f2a440a5780 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2a54020000 tx=0x7f2a5401d000 comp rx=0 tx=0).stop 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 msgr2=0x7f2a5c198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000c890 tx=0x7f2a5000cd50 comp rx=0 tx=0).stop 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 shutdown_connections 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a5c106f10 0x7f2a5c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a5c102790 0x7f2a5c198910 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a440a32c0 0x7f2a440a5780 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 --2- 172.21.15.52:0/2449801019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a5c101de0 0x7f2a5c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 >> 172.21.15.52:0/2449801019 conn(0x7f2a5c0fd8c0 msgr2=0x7f2a5c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.554+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 shutdown_connections 2024-09-19T09:31:55.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:55.555+0000 7f2a625a5640 1 -- 172.21.15.52:0/2449801019 wait complete. 2024-09-19T09:31:55.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:55 smithi169 ceph-mon[35454]: pgmap v652: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:31:55.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:55 smithi086 ceph-mon[34813]: pgmap v652: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T09:31:55.958 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ae66c313', total seconds elapsed: 35.0 2024-09-19T09:31:56.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:31:56.900 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:57.294 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:57 smithi052 ceph-mon[30947]: pgmap v653: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 -- 172.21.15.52:0/372715184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c10c170 msgr2=0x7f398c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 --2- 172.21.15.52:0/372715184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c10c170 0x7f398c10e610 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f3984009ca0 tx=0x7f398402a950 comp rx=0 tx=0).stop 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 -- 172.21.15.52:0/372715184 shutdown_connections 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 --2- 172.21.15.52:0/372715184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c10c170 0x7f398c10e610 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 --2- 172.21.15.52:0/372715184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c103660 0x7f398c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 --2- 172.21.15.52:0/372715184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c102d40 0x7f398c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 -- 172.21.15.52:0/372715184 >> 172.21.15.52:0/372715184 conn(0x7f398c0fc7a0 msgr2=0x7f398c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 -- 172.21.15.52:0/372715184 shutdown_connections 2024-09-19T09:31:57.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.376+0000 7f39916d6640 1 -- 172.21.15.52:0/372715184 wait complete. 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 Processor -- start 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 -- start start 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c103660 0x7f398c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c10c170 0x7f398c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f398c111f70 con 0x7f398c102d40 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f398c111df0 con 0x7f398c103660 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f39916d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1120f0 con 0x7f398c10c170 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f398affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f398affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33392/0 (socket says 172.21.15.52:33392) 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f398affd640 1 -- 172.21.15.52:0/391036263 learned_addr learned my addr 172.21.15.52:0/391036263 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f398b7fe640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c10c170 0x7f398c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.377+0000 7f398a7fc640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c103660 0x7f398c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 -- 172.21.15.52:0/391036263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c10c170 msgr2=0x7f398c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c10c170 0x7f398c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 -- 172.21.15.52:0/391036263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c103660 msgr2=0x7f398c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c103660 0x7f398c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 -- 172.21.15.52:0/391036263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c19d3a0 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f398affd640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e9f0 tx=0x7f397c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f3973fff640 1 -- 172.21.15.52:0/391036263 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c00cd80 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f3973fff640 1 -- 172.21.15.52:0/391036263 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f397c010910 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c19d690 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f3973fff640 1 -- 172.21.15.52:0/391036263 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c018990 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.378+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1a4f70 con 0x7f398c102d40 2024-09-19T09:31:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.380+0000 7f3973fff640 1 -- 172.21.15.52:0/391036263 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f397c010ac0 con 0x7f398c102d40 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 Processor -- start 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 -- start start 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47629b40 0x55ff47628090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 0x55ff47628a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff4758e2f0 con 0x55ff47637780 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff47535cf0 con 0x55ff47629b40 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3993aaf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff4758a2b0 con 0x55ff476285d0 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3973fff640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 0x7f39740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33408/0 (socket says 172.21.15.52:33408) 2024-09-19T09:31:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398a7fc640 1 -- 172.21.15.52:0/1476474379 learned_addr learned my addr 172.21.15.52:0/1476474379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398b7fe640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47629b40 0x55ff47628090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398b7fe640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 0x7f39740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f3973fff640 1 -- 172.21.15.52:0/391036263 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f397c0cfc60 con 0x7f398c102d40 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.381+0000 7f398affd640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 0x55ff47628a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 -- 172.21.15.52:0/1476474379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 msgr2=0x55ff47628a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 0x55ff47628a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 -- 172.21.15.52:0/1476474379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47629b40 msgr2=0x55ff47628090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47629b40 0x55ff47628090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 -- 172.21.15.52:0/1476474379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff4751a3a0 con 0x55ff47637780 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398affd640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 0x55ff47628a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f398000b680 tx=0x7f398000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3c1a4728d55295 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f398b7fe640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 0x7f39740a5780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3984009430 tx=0x7f3984005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f39717fa640 1 -- 172.21.15.52:0/1476474379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980003bd0 con 0x55ff47637780 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f39717fa640 1 -- 172.21.15.52:0/1476474379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3980015070 con 0x55ff47637780 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.382+0000 7f39717fa640 1 -- 172.21.15.52:0/1476474379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980004d90 con 0x55ff47637780 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- 172.21.15.52:0/1476474379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 msgr2=0x55ff47639b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f398000b680 tx=0x7f398000bb40 comp rx=0 tx=0).stop 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- 172.21.15.52:0/1476474379 shutdown_connections 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47639b70 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff476285d0 0x55ff47628a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1476474379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47629b40 0x55ff47628090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- 172.21.15.52:0/1476474379 >> 172.21.15.52:0/1476474379 conn(0x55ff475f1310 msgr2=0x55ff47624c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- 172.21.15.52:0/1476474379 shutdown_connections 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- 172.21.15.52:0/1476474379 wait complete. 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 -- start start 2024-09-19T09:31:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.383+0000 7f3993aaf740 1 Processor -- start 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47637130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff476343e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff4763a480 con 0x55ff47637780 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff47549060 con 0x55ff476285d0 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff4763a600 con 0x55ff47629b40 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 10 client.0 _ll_register_callbacks cb 0x55ff4729c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33424/0 (socket says 172.21.15.52:33424) 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 -- 172.21.15.52:0/694441820 learned_addr learned my addr 172.21.15.52:0/694441820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398affd640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47637130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398a7fc640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff476343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 -- 172.21.15.52:0/694441820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 msgr2=0x55ff476343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff476343e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 -- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 msgr2=0x55ff47637130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47637130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 -- 172.21.15.52:0/694441820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff472ff3c0 con 0x55ff47637780 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f398b7fe640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f3984009ca0 tx=0x7f39840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678eb29174a1c507 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f396eff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398404f030 con 0x55ff47637780 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3984004250 con 0x55ff47637780 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.384+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3980015070 con 0x55ff47637780 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3984034040 con 0x55ff47637780 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 10 client.19170 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff47645e90 con 0x55ff47637780 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3980015070 con 0x55ff47637780 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f398405c070 con 0x55ff47637780 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 10 client.19170 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 10 client.19170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 20 client.19170 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476472a0 0x55ff47649710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 4 client.19170 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff4759b860 con 0x55ff476472a0 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.385+0000 7f398affd640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476472a0 0x55ff47649710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.386+0000 7f396eff5640 10 client.19170 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.386+0000 7f398affd640 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476472a0 0x55ff47649710 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed8adb52b883363 server_cookie=cd098beba75f5761 in_seq=0 out_seq=0 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.386+0000 7f396eff5640 1 -- 172.21.15.52:0/694441820 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff4759b860 con 0x55ff476472a0 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.386+0000 7f396eff5640 10 client.19170 handle_command_reply: tid=0 2024-09-19T09:31:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.386+0000 7f3993aaf740 1 client.19170 shutdown 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 msgr2=0x55ff47634980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f3984009ca0 tx=0x7f39840095c0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 shutdown_connections 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476472a0 0x55ff47649710 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47637780 0x55ff47634980 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff476343e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f396eff5640 0 client.19170 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 --2- 172.21.15.52:0/694441820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47637130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 >> 172.21.15.52:0/694441820 conn(0x55ff475f1310 msgr2=0x55ff4762a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 shutdown_connections 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 1 -- 172.21.15.52:0/694441820 wait complete. 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.387+0000 7f3993aaf740 20 client.19170 trim_cache size 0 max 16384 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 Processor -- start 2024-09-19T09:31:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 -- start start 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47624e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47637780 0x55ff4764f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1add90 con 0x55ff47629b40 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1ab660 con 0x55ff476285d0 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f3993aaf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1a94b0 con 0x55ff47637780 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33432/0 (socket says 172.21.15.52:33432) 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 -- 172.21.15.52:0/743796798 learned_addr learned my addr 172.21.15.52:0/743796798 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398b7fe640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47637780 0x55ff4764f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398affd640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47624e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 -- 172.21.15.52:0/743796798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47637780 msgr2=0x55ff4764f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47637780 0x55ff4764f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 -- 172.21.15.52:0/743796798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 msgr2=0x55ff47624e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47624e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398a7fc640 1 -- 172.21.15.52:0/743796798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff476374a0 con 0x55ff47629b40 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.400+0000 7f398affd640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47624e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f398a7fc640 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f398000b680 tx=0x7f3980004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0818222cb0a495c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3970ff9640 1 -- 172.21.15.52:0/743796798 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980003bd0 con 0x55ff47629b40 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3970ff9640 1 -- 172.21.15.52:0/743796798 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3980028070 con 0x55ff47629b40 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3970ff9640 1 -- 172.21.15.52:0/743796798 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980019680 con 0x55ff47629b40 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 -- 172.21.15.52:0/743796798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 msgr2=0x55ff47643720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f398000b680 tx=0x7f3980004810 comp rx=0 tx=0).stop 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 -- 172.21.15.52:0/743796798 shutdown_connections 2024-09-19T09:31:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47637780 0x55ff4764f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff47629b40 0x55ff47643720 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 --2- 172.21.15.52:0/743796798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff476285d0 0x55ff47624e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.401+0000 7f3993aaf740 1 -- 172.21.15.52:0/743796798 >> 172.21.15.52:0/743796798 conn(0x55ff475f1310 msgr2=0x55ff47624700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- 172.21.15.52:0/743796798 shutdown_connections 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- 172.21.15.52:0/743796798 wait complete. 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- start start 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 Processor -- start 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff47630f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 0x55ff47631440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1a9b20 con 0x55ff476285d0 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1aaf90 con 0x55ff47637780 2024-09-19T09:31:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1aa1f0 con 0x55ff47629b40 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f3993aaf740 10 client.0 _ll_register_callbacks cb 0x7f398402fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f398affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f398affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33444/0 (socket says 172.21.15.52:33444) 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f398affd640 1 -- 172.21.15.52:0/1908609395 learned_addr learned my addr 172.21.15.52:0/1908609395 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.402+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff47630f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398b7fe640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 0x55ff47631440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 -- 172.21.15.52:0/1908609395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 msgr2=0x55ff47630f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff47630f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 -- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 msgr2=0x55ff47631440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 0x55ff47631440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 -- 172.21.15.52:0/1908609395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff476319b0 con 0x55ff476285d0 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff47630f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398b7fe640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 0x55ff47631440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f398affd640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f397c09c1e0 tx=0x7f397c098530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed199e6525793d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f396eff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c09a610 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f397c0a0170 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3980028070 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f397c0bc0b0 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f3993aaf740 10 client.19176 fetch_fsmap learned FSMap version 24 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff476b1d10 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.403+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3980028070 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f397c0cdb40 con 0x55ff476285d0 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 10 client.19176 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 10 client.19176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 20 client.19176 populate_metadata read hostname 'smithi052' 2024-09-19T09:31:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476b2480 0x55ff476b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:57.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 4 client.19176 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:31:57.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff47595d70 con 0x55ff476b2480 2024-09-19T09:31:57.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476b2480 0x55ff476b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:57.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f396eff5640 10 client.19176 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:57.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f398a7fc640 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476b2480 0x55ff476b48a0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5078f02c25dd49dc server_cookie=4af616561891ca59 in_seq=0 out_seq=0 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f396eff5640 1 -- 172.21.15.52:0/1908609395 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff47595d70 con 0x55ff476b2480 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.404+0000 7f396eff5640 10 client.19176 handle_command_reply: tid=0 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 client.19176 shutdown 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 msgr2=0x55ff4763fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f397c09c1e0 tx=0x7f397c098530 comp rx=0 tx=0).stop 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 shutdown_connections 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff476b2480 0x55ff476b48a0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff47637780 0x55ff47631440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f396eff5640 0 client.19176 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff47629b40 0x55ff47630f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 --2- 172.21.15.52:0/1908609395 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff476285d0 0x55ff4763fcf0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 >> 172.21.15.52:0/1908609395 conn(0x55ff475f1310 msgr2=0x55ff47635c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 shutdown_connections 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 1 -- 172.21.15.52:0/1908609395 wait complete. 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f3993aaf740 20 client.19176 trim_cache size 0 max 16384 2024-09-19T09:31:57.423 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 msgr2=0x7f39740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 0x7f39740a5780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3984009430 tx=0x7f3984005c50 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 msgr2=0x7f398c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e9f0 tx=0x7f397c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 shutdown_connections 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f39740a32c0 0x7f39740a5780 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f398c10c170 0x7f398c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f398c103660 0x7f398c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 --2- 172.21.15.52:0/391036263 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f398c102d40 0x7f398c1983f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.405+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 >> 172.21.15.52:0/391036263 conn(0x7f398c0fc7a0 msgr2=0x7f398c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.406+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 shutdown_connections 2024-09-19T09:31:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:57.406+0000 7f39916d6640 1 -- 172.21.15.52:0/391036263 wait complete. 2024-09-19T09:31:57.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:57 smithi169 ceph-mon[35454]: pgmap v653: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:31:57.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:57 smithi086 ceph-mon[34813]: pgmap v653: 97 pgs: 97 active+clean; 1014 KiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:31:59.231 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:31:59.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:31:59.503 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:59.624 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:31:59 smithi052 ceph-mon[30947]: pgmap v654: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:31:59.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:31:59 smithi169 ceph-mon[35454]: pgmap v654: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:31:59.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:31:59 smithi086 ceph-mon[34813]: pgmap v654: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 -- 172.21.15.52:0/2905661680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 msgr2=0x7fd164106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 --2- 172.21.15.52:0/2905661680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd164106e60 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd154009930 tx=0x7fd15402a420 comp rx=0 tx=0).stop 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 -- 172.21.15.52:0/2905661680 shutdown_connections 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 --2- 172.21.15.52:0/2905661680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164101420 0x7fd16410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 --2- 172.21.15.52:0/2905661680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164100a80 0x7fd164100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.979+0000 7fd1695ad640 1 --2- 172.21.15.52:0/2905661680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd164106e60 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- 172.21.15.52:0/2905661680 >> 172.21.15.52:0/2905661680 conn(0x7fd1640fc7a0 msgr2=0x7fd1640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- 172.21.15.52:0/2905661680 shutdown_connections 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- 172.21.15.52:0/2905661680 wait complete. 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 Processor -- start 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- start start 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164100a80 0x7fd164198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 0x7fd1641989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd164110e40 con 0x7fd164106a80 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd164110cc0 con 0x7fd164101420 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.980+0000 7fd1695ad640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd164110fc0 con 0x7fd164100a80 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53578/0 (socket says 172.21.15.52:53578) 2024-09-19T09:32:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 -- 172.21.15.52:0/4045301381 learned_addr learned my addr 172.21.15.52:0/4045301381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd162ffd640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164100a80 0x7fd164198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd15bfff640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 0x7fd1641989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 -- 172.21.15.52:0/4045301381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164100a80 msgr2=0x7fd164198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164100a80 0x7fd164198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 -- 172.21.15.52:0/4045301381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 msgr2=0x7fd1641989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 0x7fd1641989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 -- 172.21.15.52:0/4045301381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16419d410 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd15bfff640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 0x7fd1641989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1637fe640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00cad0 tx=0x7fd15c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd160ff9640 1 -- 172.21.15.52:0/4045301381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00ae20 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd160ff9640 1 -- 172.21.15.52:0/4045301381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd15c005020 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16419d700 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd160ff9640 1 -- 172.21.15.52:0/4045301381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15c00f6f0 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.981+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641a4fe0 con 0x7fd164106a80 2024-09-19T09:32:00.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd160ff9640 1 -- 172.21.15.52:0/4045301381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd15c0051d0 con 0x7fd164106a80 2024-09-19T09:32:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 Processor -- start 2024-09-19T09:32:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 -- start start 2024-09-19T09:32:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62ddd40 0x560de62e0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560de6238280 con 0x560de62d2b60 2024-09-19T09:32:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560de61dfb10 con 0x560de62ddd40 2024-09-19T09:32:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd16b986740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560de6234240 con 0x560de62d3480 2024-09-19T09:32:00.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.984+0000 7fd160ff9640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 0x7fd1500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53580/0 (socket says 172.21.15.52:53580) 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 -- 172.21.15.52:0/2696995296 learned_addr learned my addr 172.21.15.52:0/2696995296 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd1637fe640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 0x7fd1500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd160ff9640 1 -- 172.21.15.52:0/4045301381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd15c0cf9c0 con 0x7fd164106a80 2024-09-19T09:32:00.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62ddd40 0x560de62e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 -- 172.21.15.52:0/2696995296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 msgr2=0x560de62dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 -- 172.21.15.52:0/2696995296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62ddd40 msgr2=0x560de62e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62ddd40 0x560de62e0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 -- 172.21.15.52:0/2696995296 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560de61ec1f0 con 0x560de62d2b60 2024-09-19T09:32:00.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd1637fe640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 0x7fd1500a5700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0983c0 tx=0x7fd15c0669a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd14c005fd0 tx=0x7fd14c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82eb9794e6ad2042 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd1597fa640 1 -- 172.21.15.52:0/2696995296 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c005020 con 0x560de62d2b60 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd1597fa640 1 -- 172.21.15.52:0/2696995296 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14c0047a0 con 0x560de62d2b60 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.985+0000 7fd1597fa640 1 -- 172.21.15.52:0/2696995296 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c010910 con 0x560de62d2b60 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 -- 172.21.15.52:0/2696995296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 msgr2=0x560de62d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd14c005fd0 tx=0x7fd14c009630 comp rx=0 tx=0).stop 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 -- 172.21.15.52:0/2696995296 shutdown_connections 2024-09-19T09:32:00.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62ddd40 0x560de62e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 --2- 172.21.15.52:0/2696995296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d2b60 0x560de62d2f40 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 -- 172.21.15.52:0/2696995296 >> 172.21.15.52:0/2696995296 conn(0x560de62cf0f0 msgr2=0x560de62cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 -- 172.21.15.52:0/2696995296 shutdown_connections 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.986+0000 7fd16b986740 1 -- 172.21.15.52:0/2696995296 wait complete. 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 -- start start 2024-09-19T09:32:00.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 Processor -- start 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62dac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62ddd40 0x560de62db6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560de62e0910 con 0x560de62d3480 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560de61f2f10 con 0x560de62d2b60 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560de62e0a90 con 0x560de62ddd40 2024-09-19T09:32:00.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd16b986740 10 client.0 _ll_register_callbacks cb 0x560de61bba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd162ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd162ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53582/0 (socket says 172.21.15.52:53582) 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd162ffd640 1 -- 172.21.15.52:0/3661017844 learned_addr learned my addr 172.21.15.52:0/3661017844 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.987+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62ddd40 0x560de62db6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 -- 172.21.15.52:0/3661017844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62ddd40 msgr2=0x560de62db6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62ddd40 0x560de62db6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 -- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 msgr2=0x560de62dac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62dac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 -- 172.21.15.52:0/3661017844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560de5fa96a0 con 0x560de62d3480 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd162ffd640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd15402a940 tx=0x7fd1540319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebab0790a48b4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154035040 con 0x560de62d3480 2024-09-19T09:32:00.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd154005020 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14c0047a0 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd15404a020 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd16b986740 10 client.19188 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560de62ec520 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14c0047a0 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.988+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd1540035f0 con 0x560de62d3480 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 10 client.19188 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:00.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 10 client.19188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 20 client.19188 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de62efd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 4 client.19188 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560de62457f0 con 0x560de62ed930 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de62efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de62efd20 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71606ab71c7c3a70 server_cookie=132832679b69ddb8 in_seq=0 out_seq=0 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.989+0000 7fd14a7fc640 10 client.19188 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:00.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd14a7fc640 1 -- 172.21.15.52:0/3661017844 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560de62457f0 con 0x560de62ed930 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd14a7fc640 10 client.19188 handle_command_reply: tid=0 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 client.19188 shutdown 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 msgr2=0x560de62db170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd15402a940 tx=0x7fd1540319b0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 shutdown_connections 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de62efd20 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62ddd40 0x560de62db6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd14a7fc640 0 client.19188 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62d3480 0x560de62db170 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 --2- 172.21.15.52:0/3661017844 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62dac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 >> 172.21.15.52:0/3661017844 conn(0x560de62cf0f0 msgr2=0x560de62d4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 shutdown_connections 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 1 -- 172.21.15.52:0/3661017844 wait complete. 2024-09-19T09:32:00.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:31:59.990+0000 7fd16b986740 20 client.19188 trim_cache size 0 max 16384 2024-09-19T09:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.007+0000 7fd16b986740 1 Processor -- start 2024-09-19T09:32:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.007+0000 7fd16b986740 1 -- start start 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d2b60 0x560de62d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 0x560de62d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641b0130 con 0x560de62ddd40 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641ada00 con 0x560de62d3480 2024-09-19T09:32:00.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd16b986740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641ab850 con 0x560de62d2b60 2024-09-19T09:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53588/0 (socket says 172.21.15.52:53588) 2024-09-19T09:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 -- 172.21.15.52:0/3159655078 learned_addr learned my addr 172.21.15.52:0/3159655078 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd162ffd640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 0x560de62d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d2b60 0x560de62d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 -- 172.21.15.52:0/3159655078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d2b60 msgr2=0x560de62d9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d2b60 0x560de62d9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 -- 172.21.15.52:0/3159655078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 msgr2=0x560de62d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 0x560de62d55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd15bfff640 1 -- 172.21.15.52:0/3159655078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560de62d5b00 con 0x560de62ddd40 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.008+0000 7fd162ffd640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 0x560de62d55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd15bfff640 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd14c005fd0 tx=0x7fd14c017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d161818c6b7dbf60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd158ff9640 1 -- 172.21.15.52:0/3159655078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0150d0 con 0x560de62ddd40 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd158ff9640 1 -- 172.21.15.52:0/3159655078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14c015270 con 0x560de62ddd40 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd158ff9640 1 -- 172.21.15.52:0/3159655078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0106e0 con 0x560de62ddd40 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 -- 172.21.15.52:0/3159655078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 msgr2=0x560de62f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd14c005fd0 tx=0x7fd14c017040 comp rx=0 tx=0).stop 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 -- 172.21.15.52:0/3159655078 shutdown_connections 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62f55f0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d3480 0x560de62d55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 --2- 172.21.15.52:0/3159655078 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d2b60 0x560de62d9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 -- 172.21.15.52:0/3159655078 >> 172.21.15.52:0/3159655078 conn(0x560de62cf0f0 msgr2=0x560de62dcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.009+0000 7fd16b986740 1 -- 172.21.15.52:0/3159655078 shutdown_connections 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 -- 172.21.15.52:0/3159655078 wait complete. 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 -- start start 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 Processor -- start 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62d7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62d8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641abec0 con 0x560de62ddd40 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641ad330 con 0x560de62d2b60 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1641ac590 con 0x560de62d3480 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd16b986740 10 client.0 _ll_register_callbacks cb 0x7fd154009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.010+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd15bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53594/0 (socket says 172.21.15.52:53594) 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd15bfff640 1 -- 172.21.15.52:0/2084233556 learned_addr learned my addr 172.21.15.52:0/2084233556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:00.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62d8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62d7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 -- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 msgr2=0x560de62d7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62d7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 -- 172.21.15.52:0/2084233556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 msgr2=0x560de62d88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 -- 172.21.15.52:0/2084233556 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560de6357810 con 0x560de62d3480 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd162ffd640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62d8370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd154005940 tx=0x7fd15402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea81e7bb43256fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd14a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154035070 con 0x560de62d3480 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd14c015270 con 0x560de62d3480 2024-09-19T09:32:00.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.011+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd154005230 con 0x560de62d3480 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd154060050 con 0x560de62d3480 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 10 client.27751 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560de6358ab0 con 0x560de62d3480 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd14c015270 con 0x560de62d3480 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd154005430 con 0x560de62d3480 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 10 client.27751 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 10 client.27751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 20 client.27751 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de635b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 4 client.27751 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560de623fd00 con 0x560de62ed930 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.012+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de635b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.013+0000 7fd15bfff640 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de635b2a0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b47950c03f79db2 server_cookie=15c23d4baf83f3f1 in_seq=0 out_seq=0 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.013+0000 7fd14a7fc640 10 client.27751 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd14a7fc640 1 -- 172.21.15.52:0/2084233556 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560de623fd00 con 0x560de62ed930 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd14a7fc640 10 client.27751 handle_command_reply: tid=0 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 client.27751 shutdown 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 msgr2=0x560de62d8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62d8370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd154005940 tx=0x7fd15402a420 comp rx=0 tx=0).stop 2024-09-19T09:32:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 shutdown_connections 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560de62ed930 0x560de635b2a0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560de62ddd40 0x560de62d88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560de62d3480 0x560de62d8370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 --2- 172.21.15.52:0/2084233556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560de62d2b60 0x560de62d7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd14a7fc640 0 client.27751 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:00.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 >> 172.21.15.52:0/2084233556 conn(0x560de62cf0f0 msgr2=0x560de62dabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 shutdown_connections 2024-09-19T09:32:00.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 1 -- 172.21.15.52:0/2084233556 wait complete. 2024-09-19T09:32:00.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.014+0000 7fd16b986740 20 client.27751 trim_cache size 0 max 16384 2024-09-19T09:32:00.046 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:00.047 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:32:00.047 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "0ef2d6f6-c0e0-4a0d-a9db-f365f0cbc1c6", 2024-09-19T09:32:00.047 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:32:00.047 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 msgr2=0x7fd1500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 0x7fd1500a5700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0983c0 tx=0x7fd15c0669a0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 msgr2=0x7fd16419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00cad0 tx=0x7fd15c00cf90 comp rx=0 tx=0).stop 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 shutdown_connections 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd164106a80 0x7fd16419cd30 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd164101420 0x7fd1641989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd1500a3240 0x7fd1500a5700 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 --2- 172.21.15.52:0/4045301381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd164100a80 0x7fd164198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 >> 172.21.15.52:0/4045301381 conn(0x7fd1640fc7a0 msgr2=0x7fd1641048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:00.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 shutdown_connections 2024-09-19T09:32:00.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:00.015+0000 7fd1695ad640 1 -- 172.21.15.52:0/4045301381 wait complete. 2024-09-19T09:32:00.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:32:00.955 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:01.328 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:01 smithi052 ceph-mon[30947]: pgmap v655: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:32:01.328 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:01 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:32:01.328 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:01 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:01.328 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:01 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:32:01.328 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:01 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:01.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 -- 172.21.15.52:0/3541333340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 msgr2=0x7f7b1c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/3541333340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c10e600 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009ca0 tx=0x7f7b1402a950 comp rx=0 tx=0).stop 2024-09-19T09:32:01.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 -- 172.21.15.52:0/3541333340 shutdown_connections 2024-09-19T09:32:01.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/3541333340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c10e600 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/3541333340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 0x7f7b1c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/3541333340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 0x7f7b1c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 -- 172.21.15.52:0/3541333340 >> 172.21.15.52:0/3541333340 conn(0x7f7b1c0fc7a0 msgr2=0x7f7b1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 -- 172.21.15.52:0/3541333340 shutdown_connections 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.410+0000 7f7b22a4d640 1 -- 172.21.15.52:0/3541333340 wait complete. 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 Processor -- start 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 -- start start 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 0x7f7b1c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 0x7f7b1c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c111f40 con 0x7f7b1c10c180 2024-09-19T09:32:01.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c111dc0 con 0x7f7b1c102da0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b22a4d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1120c0 con 0x7f7b1c1036c0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.411+0000 7f7b20fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53616/0 (socket says 172.21.15.52:53616) 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 -- 172.21.15.52:0/126818809 learned_addr learned my addr 172.21.15.52:0/126818809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 0x7f7b1c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 0x7f7b1c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 -- 172.21.15.52:0/126818809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 msgr2=0x7f7b1c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 0x7f7b1c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 -- 172.21.15.52:0/126818809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 msgr2=0x7f7b1c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 0x7f7b1c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 -- 172.21.15.52:0/126818809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c19d380 con 0x7f7b1c10c180 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b20fea640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402ae70 tx=0x7f7b1402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b197fa640 1 -- 172.21.15.52:0/126818809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14034040 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b197fa640 1 -- 172.21.15.52:0/126818809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b14030920 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c19d610 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b197fa640 1 -- 172.21.15.52:0/126818809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14045480 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.412+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1a4f50 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.414+0000 7f7b197fa640 1 -- 172.21.15.52:0/126818809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7b14037020 con 0x7f7b1c10c180 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 Processor -- start 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 -- start start 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d8b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 0x559ee2d98a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559ee2cf12e0 con 0x559ee2d8bdc0 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559ee2c98ce0 con 0x559ee2d8b4a0 2024-09-19T09:32:01.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b24e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559ee2ced2a0 con 0x559ee2d96680 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b197fa640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 0x7f7b040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b1bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53628/0 (socket says 172.21.15.52:53628) 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b1bfff640 1 -- 172.21.15.52:0/3919862458 learned_addr learned my addr 172.21.15.52:0/3919862458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d8b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.415+0000 7f7b197fa640 1 -- 172.21.15.52:0/126818809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b140f0810 con 0x7f7b1c10c180 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b20fea640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 0x7f7b040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 0x559ee2d98a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 -- 172.21.15.52:0/3919862458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 msgr2=0x559ee2d98a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 0x559ee2d98a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 -- 172.21.15.52:0/3919862458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 msgr2=0x559ee2d8b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d8b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 -- 172.21.15.52:0/3919862458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2c7d440 con 0x559ee2d8bdc0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 0x559ee2d98a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00ac20 tx=0x7f7b0c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885546f48bf7f790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b20fea640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 0x7f7b040a5780 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402fde0 tx=0x7f7b14004360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b027fc640 1 -- 172.21.15.52:0/3919862458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c01d070 con 0x559ee2d8bdc0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b027fc640 1 -- 172.21.15.52:0/3919862458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b0c018b20 con 0x559ee2d8bdc0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.416+0000 7f7b027fc640 1 -- 172.21.15.52:0/3919862458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c010ba0 con 0x559ee2d8bdc0 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- 172.21.15.52:0/3919862458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 msgr2=0x559ee2d96140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00ac20 tx=0x7f7b0c00f790 comp rx=0 tx=0).stop 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- 172.21.15.52:0/3919862458 shutdown_connections 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d96680 0x559ee2d98a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d8bdc0 0x559ee2d96140 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 --2- 172.21.15.52:0/3919862458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d8b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- 172.21.15.52:0/3919862458 >> 172.21.15.52:0/3919862458 conn(0x559ee2d87a30 msgr2=0x559ee2d87e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- 172.21.15.52:0/3919862458 shutdown_connections 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- 172.21.15.52:0/3919862458 wait complete. 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.417+0000 7f7b24e26740 1 -- start start 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 Processor -- start 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d95f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8bdc0 0x559ee2d931f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559ee2d99250 con 0x559ee2d96680 2024-09-19T09:32:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559ee2cac050 con 0x559ee2d8b4a0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559ee2d993d0 con 0x559ee2d8bdc0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b24e26740 10 client.0 _ll_register_callbacks cb 0x559ee2cec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53636/0 (socket says 172.21.15.52:53636) 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1402878593 learned_addr learned my addr 172.21.15.52:0/1402878593 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d95f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8bdc0 0x559ee2d931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1402878593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8bdc0 msgr2=0x559ee2d931f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8bdc0 0x559ee2d931f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 msgr2=0x559ee2d95f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d95f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.418+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1402878593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee2a623c0 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f7b10012cd0 tx=0x7f7b10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1450b8212f896e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10010e70 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b1001b040 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b0c018b20 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b10025030 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 10 client.19206 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ee2da4ba0 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b0c018b20 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b10003b50 con 0x559ee2d96680 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 10 client.19206 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 10 client.19206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:01.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 20 client.19206 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2da6060 0x559ee2da8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 4 client.19206 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.419+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ee2cfe850 con 0x559ee2da6060 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.420+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2da6060 0x559ee2da8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.420+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2da6060 0x559ee2da8450 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e435f747953feef server_cookie=4f5c2e731c6d283 in_seq=0 out_seq=0 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.420+0000 7f7afb7fe640 10 client.19206 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1402878593 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ee2cfe850 con 0x559ee2da6060 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7afb7fe640 10 client.19206 handle_command_reply: tid=0 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 client.19206 shutdown 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 msgr2=0x559ee2d93730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f7b10012cd0 tx=0x7f7b10004730 comp rx=0 tx=0).stop 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 shutdown_connections 2024-09-19T09:32:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2da6060 0x559ee2da8450 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d96680 0x559ee2d93730 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8bdc0 0x559ee2d931f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1402878593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d95f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7afb7fe640 0 client.19206 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 >> 172.21.15.52:0/1402878593 conn(0x559ee2d87a30 msgr2=0x559ee2d86b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 shutdown_connections 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 1 -- 172.21.15.52:0/1402878593 wait complete. 2024-09-19T09:32:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.421+0000 7f7b24e26740 20 client.19206 trim_cache size 0 max 16384 2024-09-19T09:32:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 Processor -- start 2024-09-19T09:32:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 -- start start 2024-09-19T09:32:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d87a30 0x559ee2dadcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8b4a0 0x559ee2dae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1b0020 con 0x559ee2d93890 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ad8f0 con 0x559ee2d87a30 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b24e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ab740 con 0x559ee2d8b4a0 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.439+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53646/0 (socket says 172.21.15.52:53646) 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/2142037465 learned_addr learned my addr 172.21.15.52:0/2142037465 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d87a30 0x559ee2dadcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/2142037465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8b4a0 msgr2=0x559ee2dae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8b4a0 0x559ee2dae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/2142037465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d87a30 msgr2=0x559ee2dadcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d87a30 0x559ee2dadcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/2142037465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ee2da8a80 con 0x559ee2d93890 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7b10003f20 tx=0x7f7b10012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f2ed9947cea373 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b01ffb640 1 -- 172.21.15.52:0/2142037465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10012070 con 0x559ee2d93890 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b01ffb640 1 -- 172.21.15.52:0/2142037465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1002e070 con 0x559ee2d93890 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.440+0000 7f7b01ffb640 1 -- 172.21.15.52:0/2142037465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10003950 con 0x559ee2d93890 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- 172.21.15.52:0/2142037465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 msgr2=0x559ee2da24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7b10003f20 tx=0x7f7b10012500 comp rx=0 tx=0).stop 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- 172.21.15.52:0/2142037465 shutdown_connections 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d8b4a0 0x559ee2dae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d87a30 0x559ee2dadcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 --2- 172.21.15.52:0/2142037465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2da24e0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- 172.21.15.52:0/2142037465 >> 172.21.15.52:0/2142037465 conn(0x559ee2d8ebe0 msgr2=0x559ee2d91ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- 172.21.15.52:0/2142037465 shutdown_connections 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- 172.21.15.52:0/2142037465 wait complete. 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.441+0000 7f7b24e26740 1 -- start start 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 Processor -- start 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d87a30 0x559ee2d9aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d9af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1abdb0 con 0x559ee2d93890 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ad220 con 0x559ee2d8b4a0 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c1ac480 con 0x559ee2d87a30 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b24e26740 10 client.0 _ll_register_callbacks cb 0x7f7b1000bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53648/0 (socket says 172.21.15.52:53648) 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1253053853 learned_addr learned my addr 172.21.15.52:0/1253053853 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d9af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d87a30 0x559ee2d9aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1253053853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d87a30 msgr2=0x559ee2d9aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d87a30 0x559ee2d9aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 msgr2=0x559ee2d9af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d9af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.442+0000 7f7b1b7fe640 1 -- 172.21.15.52:0/1253053853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ee2d8c330 con 0x559ee2d93890 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b1b7fe640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000b9c0 tx=0x7f7b10012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609f08434f61bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10003c20 con 0x559ee2d93890 2024-09-19T09:32:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b10026070 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1002e070 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b10005070 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 10 client.19212 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559ee2e11260 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1002e070 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b10020c90 con 0x559ee2d93890 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 10 client.19212 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 10 client.19212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 20 client.19212 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2d8bdc0 0x559ee2e13820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 4 client.19212 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.443+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559ee2cf8d60 con 0x559ee2d8bdc0 2024-09-19T09:32:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2d8bdc0 0x559ee2e13820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b1bfff640 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2d8bdc0 0x559ee2e13820 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e05d6acba8aab99a server_cookie=421472c890a711d6 in_seq=0 out_seq=0 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7afb7fe640 10 client.19212 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7afb7fe640 1 -- 172.21.15.52:0/1253053853 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559ee2cf8d60 con 0x559ee2d8bdc0 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7afb7fe640 10 client.19212 handle_command_reply: tid=0 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 client.19212 shutdown 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 msgr2=0x559ee2e0fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000b9c0 tx=0x7f7b10012c50 comp rx=0 tx=0).stop 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 shutdown_connections 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559ee2d8bdc0 0x559ee2e13820 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559ee2d93890 0x559ee2e0fc80 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559ee2d8b4a0 0x559ee2d9af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7afb7fe640 0 client.19212 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 --2- 172.21.15.52:0/1253053853 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559ee2d87a30 0x559ee2d9aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.444+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 >> 172.21.15.52:0/1253053853 conn(0x559ee2d8ebe0 msgr2=0x559ee2d91ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 shutdown_connections 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b24e26740 1 -- 172.21.15.52:0/1253053853 wait complete. 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b24e26740 20 client.19212 trim_cache size 0 max 16384 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "0ef2d6f6-c0e0-4a0d-a9db-f365f0cbc1c6": { 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "0ef2d6f6-c0e0-4a0d-a9db-f365f0cbc1c6", 2024-09-19T09:32:01.460 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:32:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:32:01.461 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:32:01.461 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:01.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 msgr2=0x7f7b040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 0x7f7b040a5780 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402fde0 tx=0x7f7b14004360 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 msgr2=0x7f7b1c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402ae70 tx=0x7f7b1402f5b0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 shutdown_connections 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b1c10c180 0x7f7b1c19cca0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b040a32c0 0x7f7b040a5780 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b1c1036c0 0x7f7b1c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 --2- 172.21.15.52:0/126818809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b1c102da0 0x7f7b1c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 >> 172.21.15.52:0/126818809 conn(0x7f7b1c0fc7a0 msgr2=0x7f7b1c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 shutdown_connections 2024-09-19T09:32:01.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:01.445+0000 7f7b22a4d640 1 -- 172.21.15.52:0/126818809 wait complete. 2024-09-19T09:32:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:01 smithi169 ceph-mon[35454]: pgmap v655: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:32:01.697 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:01 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:32:01.697 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:01 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:01.697 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:01 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:32:01.697 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:01 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:01.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:01 smithi086 ceph-mon[34813]: pgmap v655: 97 pgs: 97 active+clean; 1.0 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:32:01.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:01 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:32:01.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:01 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:01.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:01 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:32:01.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:01 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:02.092 INFO:tasks.cephfs.filesystem:scrub status for tag:0ef2d6f6-c0e0-4a0d-a9db-f365f0cbc1c6 - {'path': '/', 'tag': '0ef2d6f6-c0e0-4a0d-a9db-f365f0cbc1c6', 'options': 'recursive,force'} 2024-09-19T09:32:03.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:03 smithi052 ceph-mon[30947]: pgmap v656: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:03.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:03 smithi169 ceph-mon[35454]: pgmap v656: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:03 smithi086 ceph-mon[34813]: pgmap v656: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 -- 172.21.15.52:0/3679667091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 msgr2=0x7fc6881020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 --2- 172.21.15.52:0/3679667091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc6881020b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc670009900 tx=0x7fc67002a410 comp rx=0 tx=0).stop 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 -- 172.21.15.52:0/3679667091 shutdown_connections 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 --2- 172.21.15.52:0/3679667091 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6881025f0 0x7fc688108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 --2- 172.21.15.52:0/3679667091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc6881020b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 --2- 172.21.15.52:0/3679667091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688100a40 0x7fc688100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 -- 172.21.15.52:0/3679667091 >> 172.21.15.52:0/3679667091 conn(0x7fc6880fc1e0 msgr2=0x7fc6880fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 -- 172.21.15.52:0/3679667091 shutdown_connections 2024-09-19T09:32:04.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.672+0000 7fc68e227640 1 -- 172.21.15.52:0/3679667091 wait complete. 2024-09-19T09:32:04.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.673+0000 7fc68e227640 1 Processor -- start 2024-09-19T09:32:04.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.673+0000 7fc68e227640 1 -- start start 2024-09-19T09:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.673+0000 7fc68e227640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc688100a40 0x7fc68806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.673+0000 7fc68e227640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.673+0000 7fc68e227640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6881025f0 0x7fc6881a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc68e227640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810c6a0 con 0x7fc688101c30 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc68e227640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810c520 con 0x7fc6881025f0 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc68e227640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810c820 con 0x7fc688100a40 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53666/0 (socket says 172.21.15.52:53666) 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 -- 172.21.15.52:0/1666083310 learned_addr learned my addr 172.21.15.52:0/1666083310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc6877fe640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc688100a40 0x7fc68806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc687fff640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6881025f0 0x7fc6881a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 -- 172.21.15.52:0/1666083310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc688100a40 msgr2=0x7fc68806a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc688100a40 0x7fc68806a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 -- 172.21.15.52:0/1666083310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6881025f0 msgr2=0x7fc6881a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6881025f0 0x7fc6881a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 -- 172.21.15.52:0/1666083310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6881a1ba0 con 0x7fc688101c30 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc67effd640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fc670009230 tx=0x7fc670004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc6857fa640 1 -- 172.21.15.52:0/1666083310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67003f030 con 0x7fc688101c30 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc6857fa640 1 -- 172.21.15.52:0/1666083310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc670003ce0 con 0x7fc688101c30 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6881a1dd0 con 0x7fc688101c30 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.674+0000 7fc6857fa640 1 -- 172.21.15.52:0/1666083310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc670035070 con 0x7fc688101c30 2024-09-19T09:32:04.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.675+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881a2260 con 0x7fc688101c30 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc6857fa640 1 -- 172.21.15.52:0/1666083310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc670042030 con 0x7fc688101c30 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 Processor -- start 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 -- start start 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdfada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edcdffda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce02830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564edcd5e2f0 con 0x564edce00370 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564edcd06270 con 0x564edcdfb2e0 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.677+0000 7fc690fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564edcd5a2b0 con 0x564edcdfa9a0 2024-09-19T09:32:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc67effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce02830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc67effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce02830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53670/0 (socket says 172.21.15.52:53670) 2024-09-19T09:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc687fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdfada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc67effd640 1 -- 172.21.15.52:0/1743138479 learned_addr learned my addr 172.21.15.52:0/1743138479 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edcdffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6857fa640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 0x7fc6740a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.683 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:04 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:32:04.688 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 -- 172.21.15.52:0/1743138479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 msgr2=0x564edcdfada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdfada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc687fff640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 0x7fc6740a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 -- 172.21.15.52:0/1743138479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 msgr2=0x564edce02830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce02830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 -- 172.21.15.52:0/1743138479 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edcd05340 con 0x564edcdfb2e0 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6857fa640 1 -- 172.21.15.52:0/1666083310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc6700effe0 con 0x7fc688101c30 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.678+0000 7fc6877fe640 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edcdffda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc67800aba0 tx=0x7fc67800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4330b6235977801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc687fff640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 0x7fc6740a57e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc680005fd0 tx=0x7fc680004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc67dffb640 1 -- 172.21.15.52:0/1743138479 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678005220 con 0x564edcdfb2e0 2024-09-19T09:32:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc67dffb640 1 -- 172.21.15.52:0/1743138479 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc678004c80 con 0x564edcdfb2e0 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc67dffb640 1 -- 172.21.15.52:0/1743138479 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6780188f0 con 0x564edcdfb2e0 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 -- 172.21.15.52:0/1743138479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 msgr2=0x564edcdffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edcdffda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc67800aba0 tx=0x7fc67800f790 comp rx=0 tx=0).stop 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 -- 172.21.15.52:0/1743138479 shutdown_connections 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce02830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edcdffda0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 --2- 172.21.15.52:0/1743138479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdfada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 -- 172.21.15.52:0/1743138479 >> 172.21.15.52:0/1743138479 conn(0x564edcdf6010 msgr2=0x564edcdf6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 -- 172.21.15.52:0/1743138479 shutdown_connections 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.679+0000 7fc690fc3740 1 -- 172.21.15.52:0/1743138479 wait complete. 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 -- start start 2024-09-19T09:32:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 Processor -- start 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce05130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edce00370 0x564edce0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564edce03340 con 0x564edcdfa9a0 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564edcce7290 con 0x564edcdfb2e0 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564edce034c0 con 0x564edce00370 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc690fc3740 10 client.0 _ll_register_callbacks cb 0x564edcd18140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc6877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc6877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53684/0 (socket says 172.21.15.52:53684) 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc6877fe640 1 -- 172.21.15.52:0/910416621 learned_addr learned my addr 172.21.15.52:0/910416621 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.680+0000 7fc67effd640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce05130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc687fff640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edce00370 0x564edce0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 -- 172.21.15.52:0/910416621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edce00370 msgr2=0x564edce0c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edce00370 0x564edce0c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 -- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 msgr2=0x564edce05130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce05130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 -- 172.21.15.52:0/910416621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edca71210 con 0x564edcdfa9a0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc6877fe640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fc678005670 tx=0x7fc6780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3211273ec00b4bde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc666ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678027020 con 0x564edcdfa9a0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc678005040 con 0x564edcdfa9a0 2024-09-19T09:32:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc678004c80 con 0x564edcdfa9a0 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc678032050 con 0x564edcdfa9a0 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc690fc3740 10 client.19224 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564edcb3d620 con 0x564edcdfa9a0 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.681+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc678004c80 con 0x564edcdfa9a0 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc678018bc0 con 0x564edcdfa9a0 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 10 client.19224 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 10 client.19224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 20 client.19224 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce105e0 0x564edce129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.693 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 4 client.19224 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564edcd6ba20 con 0x564edce105e0 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.682+0000 7fc67effd640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce105e0 0x564edce129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc67effd640 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce105e0 0x564edce129d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deda873bbe62406d server_cookie=d8fd81c172b0f580 in_seq=0 out_seq=0 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc666ffd640 10 client.19224 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc666ffd640 1 -- 172.21.15.52:0/910416621 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564edcd6ba20 con 0x564edce105e0 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc666ffd640 10 client.19224 handle_command_reply: tid=0 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc690fc3740 1 client.19224 shutdown 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 msgr2=0x564edce04bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fc678005670 tx=0x7fc6780042f0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.683+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 shutdown_connections 2024-09-19T09:32:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce105e0 0x564edce129d0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edce00370 0x564edce0c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce05130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc666ffd640 0 client.19224 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 --2- 172.21.15.52:0/910416621 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edcdfa9a0 0x564edce04bf0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 >> 172.21.15.52:0/910416621 conn(0x564edcdf6010 msgr2=0x564edcdf7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 shutdown_connections 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 1 -- 172.21.15.52:0/910416621 wait complete. 2024-09-19T09:32:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.684+0000 7fc690fc3740 20 client.19224 trim_cache size 0 max 16384 2024-09-19T09:32:04.695 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:04 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:32:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 Processor -- start 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 -- start start 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdf6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.698+0000 7fc690fc3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881adc30 con 0x564edce00370 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc690fc3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881ab500 con 0x564edcdfb2e0 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc690fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881a9350 con 0x564edcdfa9a0 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53692/0 (socket says 172.21.15.52:53692) 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 -- 172.21.15.52:0/900975187 learned_addr learned my addr 172.21.15.52:0/900975187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc6877fe640 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdf6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc67effd640 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 -- 172.21.15.52:0/900975187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 msgr2=0x564edcdf6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdf6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 -- 172.21.15.52:0/900975187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 msgr2=0x564edce0c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce0c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 -- 172.21.15.52:0/900975187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564edcdf12d0 con 0x564edce00370 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc687fff640 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc6800145b0 tx=0x7fc680009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9e81d29640f177 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc67d7fa640 1 -- 172.21.15.52:0/900975187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68001a070 con 0x564edce00370 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc67d7fa640 1 -- 172.21.15.52:0/900975187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc680011e90 con 0x564edce00370 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.699+0000 7fc67d7fa640 1 -- 172.21.15.52:0/900975187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680029e50 con 0x564edce00370 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- 172.21.15.52:0/900975187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 msgr2=0x564edcdf73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fc6800145b0 tx=0x7fc680009840 comp rx=0 tx=0).stop 2024-09-19T09:32:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- 172.21.15.52:0/900975187 shutdown_connections 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edcdf73d0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce0c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 --2- 172.21.15.52:0/900975187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edcdf6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- 172.21.15.52:0/900975187 >> 172.21.15.52:0/900975187 conn(0x564edcdf6010 msgr2=0x564edce049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- 172.21.15.52:0/900975187 shutdown_connections 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- 172.21.15.52:0/900975187 wait complete. 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 -- start start 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.700+0000 7fc690fc3740 1 Processor -- start 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edce096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce09bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881a99c0 con 0x564edce00370 2024-09-19T09:32:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881aae30 con 0x564edcdfb2e0 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6881aa090 con 0x564edcdfa9a0 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 10 client.0 _ll_register_callbacks cb 0x7fc6700b8610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53696/0 (socket says 172.21.15.52:53696) 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 -- 172.21.15.52:0/3913005819 learned_addr learned my addr 172.21.15.52:0/3913005819 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc67effd640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce09bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 -- 172.21.15.52:0/3913005819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 msgr2=0x564edce096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edce096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 -- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 msgr2=0x564edce09bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce09bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 -- 172.21.15.52:0/3913005819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564edce0b210 con 0x564edce00370 2024-09-19T09:32:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc67effd640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce09bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc687fff640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc680004a80 tx=0x7fc680012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8db3ba0df0d091 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc666ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68001a050 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc680029dd0 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.701+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc680011e90 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc680029610 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 10 client.19230 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564edce7b250 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc680011e90 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc680031070 con 0x564edce00370 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 10 client.19230 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 10 client.19230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 20 client.19230 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce7baa0 0x564edce7dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 4 client.19230 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564edcd65d70 con 0x564edce7baa0 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.702+0000 7fc6877fe640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce7baa0 0x564edce7dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.703+0000 7fc6877fe640 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce7baa0 0x564edce7dec0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7dfacd09c4235b server_cookie=6d1a415e790bf8f9 in_seq=0 out_seq=0 2024-09-19T09:32:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.703+0000 7fc666ffd640 10 client.19230 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc666ffd640 1 -- 172.21.15.52:0/3913005819 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564edcd65d70 con 0x564edce7baa0 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc666ffd640 10 client.19230 handle_command_reply: tid=0 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 client.19230 shutdown 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 msgr2=0x564edce0ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc680004a80 tx=0x7fc680012f50 comp rx=0 tx=0).stop 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 shutdown_connections 2024-09-19T09:32:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564edce7baa0 0x564edce7dec0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564edce00370 0x564edce0ac00 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc666ffd640 0 client.19230 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564edcdfb2e0 0x564edce09bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 --2- 172.21.15.52:0/3913005819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564edcdfa9a0 0x564edce096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 >> 172.21.15.52:0/3913005819 conn(0x564edcdf6010 msgr2=0x564edcdf49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 shutdown_connections 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 1 -- 172.21.15.52:0/3913005819 wait complete. 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.714+0000 7fc690fc3740 20 client.19230 trim_cache size 0 max 16384 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:32:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:32:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:32:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:32:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 msgr2=0x7fc6740a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 0x7fc6740a57e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc680005fd0 tx=0x7fc680004ab0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 msgr2=0x7fc68819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fc670009230 tx=0x7fc670004360 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 shutdown_connections 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6881025f0 0x7fc6881a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc688101c30 0x7fc68819ee60 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6740a3320 0x7fc6740a57e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 --2- 172.21.15.52:0/1666083310 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc688100a40 0x7fc68806a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 >> 172.21.15.52:0/1666083310 conn(0x7fc6880fc1e0 msgr2=0x7fc688104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 shutdown_connections 2024-09-19T09:32:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:04.715+0000 7fc68e227640 1 -- 172.21.15.52:0/1666083310 wait complete. 2024-09-19T09:32:04.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:04 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:32:05.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:05 smithi052 ceph-mon[30947]: pgmap v657: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:05.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:05 smithi169 ceph-mon[35454]: pgmap v657: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:05 smithi086 ceph-mon[34813]: pgmap v657: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.2 KiB/s wr, 10 op/s 2024-09-19T09:32:07.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:07 smithi052 ceph-mon[30947]: pgmap v658: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.3 KiB/s wr, 10 op/s 2024-09-19T09:32:07.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:07 smithi169 ceph-mon[35454]: pgmap v658: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.3 KiB/s wr, 10 op/s 2024-09-19T09:32:07.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:07 smithi086 ceph-mon[34813]: pgmap v658: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.3 KiB/s wr, 10 op/s 2024-09-19T09:32:09.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:09 smithi052 ceph-mon[30947]: pgmap v659: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:32:09.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:09 smithi169 ceph-mon[35454]: pgmap v659: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:32:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:09 smithi086 ceph-mon[34813]: pgmap v659: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-19T09:32:11.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:11 smithi052 ceph-mon[30947]: pgmap v660: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:11.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:11 smithi169 ceph-mon[35454]: pgmap v660: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:11.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:11 smithi086 ceph-mon[34813]: pgmap v660: 97 pgs: 97 active+clean; 1.1 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:13.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:13 smithi052 ceph-mon[30947]: pgmap v661: 97 pgs: 97 active+clean; 1.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:13.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:13 smithi169 ceph-mon[35454]: pgmap v661: 97 pgs: 97 active+clean; 1.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:13 smithi086 ceph-mon[34813]: pgmap v661: 97 pgs: 97 active+clean; 1.2 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:15.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:15 smithi052 ceph-mon[30947]: pgmap v662: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:15.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:15 smithi169 ceph-mon[35454]: pgmap v662: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:15.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:15 smithi086 ceph-mon[34813]: pgmap v662: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:17.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:17 smithi086 ceph-mon[34813]: pgmap v663: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:32:17.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:17 smithi052 ceph-mon[30947]: pgmap v663: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:32:17.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:17 smithi169 ceph-mon[35454]: pgmap v663: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.815+0000 7fc180378640 1 -- 172.21.15.52:0/2497776974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178102d50 msgr2=0x7fc1781031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.815+0000 7fc180378640 1 --2- 172.21.15.52:0/2497776974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178102d50 0x7fc1781031d0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc174009900 tx=0x7fc17402a410 comp rx=0 tx=0).stop 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- 172.21.15.52:0/2497776974 shutdown_connections 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- 172.21.15.52:0/2497776974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178103710 0x7fc178109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- 172.21.15.52:0/2497776974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178102d50 0x7fc1781031d0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- 172.21.15.52:0/2497776974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178101b60 0x7fc178101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- 172.21.15.52:0/2497776974 >> 172.21.15.52:0/2497776974 conn(0x7fc1780fd2e0 msgr2=0x7fc1780ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- 172.21.15.52:0/2497776974 shutdown_connections 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- 172.21.15.52:0/2497776974 wait complete. 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 Processor -- start 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- start start 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178101b60 0x7fc178197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178102d50 0x7fc178198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810d7e0 con 0x7fc178103710 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810d660 con 0x7fc178101b60 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.816+0000 7fc180378640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810d960 con 0x7fc178102d50 2024-09-19T09:32:17.821 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37168/0 (socket says 172.21.15.52:37168) 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 -- 172.21.15.52:0/2503456038 learned_addr learned my addr 172.21.15.52:0/2503456038 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17d913640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178102d50 0x7fc178198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e114640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178101b60 0x7fc178197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 -- 172.21.15.52:0/2503456038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178102d50 msgr2=0x7fc178198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178102d50 0x7fc178198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 -- 172.21.15.52:0/2503456038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178101b60 msgr2=0x7fc178197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178101b60 0x7fc178197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 -- 172.21.15.52:0/2503456038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17819f9f0 con 0x7fc178103710 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc17e915640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc17000eaa0 tx=0x7fc17000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc16f7fe640 1 -- 172.21.15.52:0/2503456038 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17000cdb0 con 0x7fc178103710 2024-09-19T09:32:17.822 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17819fce0 con 0x7fc178103710 2024-09-19T09:32:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc16f7fe640 1 -- 172.21.15.52:0/2503456038 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc170005020 con 0x7fc178103710 2024-09-19T09:32:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.817+0000 7fc16f7fe640 1 -- 172.21.15.52:0/2503456038 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1700116b0 con 0x7fc178103710 2024-09-19T09:32:17.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.818+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1781a01b0 con 0x7fc178103710 2024-09-19T09:32:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.820+0000 7fc16f7fe640 1 -- 172.21.15.52:0/2503456038 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc170005560 con 0x7fc178103710 2024-09-19T09:32:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.820+0000 7fc1831ee740 1 Processor -- start 2024-09-19T09:32:17.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 -- start start 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d8081b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d80d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f58d7672f0 con 0x55f58d80d780 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f58d70f270 con 0x55f58d8086f0 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc1831ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f58d7632b0 con 0x55f58d807db0 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc16f7fe640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 0x7fc1640a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17e114640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d80d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37178/0 (socket says 172.21.15.52:37178) 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17d913640 1 -- 172.21.15.52:0/1124460958 learned_addr learned my addr 172.21.15.52:0/1124460958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17e915640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 0x7fc1640a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc16f7fe640 1 -- 172.21.15.52:0/2503456038 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc1700cfc40 con 0x7fc178103710 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.821+0000 7fc17d913640 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d8081b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 -- 172.21.15.52:0/1124460958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 msgr2=0x55f58d8081b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d8081b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 -- 172.21.15.52:0/1124460958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 msgr2=0x55f58d80fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 -- 172.21.15.52:0/1124460958 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d70e340 con 0x55f58d8086f0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17d913640 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e114640 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d80d1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc168009b40 tx=0x7fc1680113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c7517d3e53e28b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc17e915640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 0x7fc1640a57b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc1700985e0 tx=0x7fc170066bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc16cbfe640 1 -- 172.21.15.52:0/1124460958 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168011e10 con 0x55f58d8086f0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc16cbfe640 1 -- 172.21.15.52:0/1124460958 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168012930 con 0x55f58d8086f0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.822+0000 7fc16cbfe640 1 -- 172.21.15.52:0/1124460958 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16800fa50 con 0x55f58d8086f0 2024-09-19T09:32:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- 172.21.15.52:0/1124460958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 msgr2=0x55f58d80d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d80d1b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc168009b40 tx=0x7fc1680113e0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- 172.21.15.52:0/1124460958 shutdown_connections 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d80fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d80d1b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 --2- 172.21.15.52:0/1124460958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d8081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- 172.21.15.52:0/1124460958 >> 172.21.15.52:0/1124460958 conn(0x55f58d7ff010 msgr2=0x55f58d7ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- 172.21.15.52:0/1124460958 shutdown_connections 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- 172.21.15.52:0/1124460958 wait complete. 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.823+0000 7fc1831ee740 1 -- start start 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 Processor -- start 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d80d780 0x55f58d819530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f58d810750 con 0x55f58d807db0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f58d6f0290 con 0x55f58d80d780 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f58d8108d0 con 0x55f58d8086f0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc1831ee740 10 client.0 _ll_register_callbacks cb 0x55f58d721140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37188/0 (socket says 172.21.15.52:37188) 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 -- 172.21.15.52:0/4196430184 learned_addr learned my addr 172.21.15.52:0/4196430184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d80d780 0x55f58d819530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17e114640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 -- 172.21.15.52:0/4196430184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 msgr2=0x55f58d8124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 -- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d80d780 msgr2=0x55f58d819530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d80d780 0x55f58d819530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 -- 172.21.15.52:0/4196430184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58d47a210 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc17d913640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fc174005ab0 tx=0x7fc17402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b6370f5ada46e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.824+0000 7fc161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174035070 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc174004450 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc168012930 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc174047040 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 10 client.19242 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f58d546620 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168012930 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc174054070 con 0x55f58d807db0 2024-09-19T09:32:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 10 client.19242 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 10 client.19242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 20 client.19242 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d81dc20 0x55f58d820010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 4 client.19242 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.825+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58d774a20 con 0x55f58d81dc20 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.826+0000 7fc17e114640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d81dc20 0x55f58d820010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.826+0000 7fc17e114640 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d81dc20 0x55f58d820010 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d99990ea7ba51f2 server_cookie=cdf5d71956259da0 in_seq=0 out_seq=0 2024-09-19T09:32:17.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.826+0000 7fc161ffb640 10 client.19242 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc161ffb640 1 -- 172.21.15.52:0/4196430184 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f58d774a20 con 0x55f58d81dc20 2024-09-19T09:32:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc161ffb640 10 client.19242 handle_command_reply: tid=0 2024-09-19T09:32:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 client.19242 shutdown 2024-09-19T09:32:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 msgr2=0x55f58d811fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fc174005ab0 tx=0x7fc17402a410 comp rx=0 tx=0).stop 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 shutdown_connections 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d81dc20 0x55f58d820010 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d80d780 0x55f58d819530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc161ffb640 0 client.19242 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 --2- 172.21.15.52:0/4196430184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d807db0 0x55f58d811fb0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 >> 172.21.15.52:0/4196430184 conn(0x55f58d7ff010 msgr2=0x55f58d800820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 shutdown_connections 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 1 -- 172.21.15.52:0/4196430184 wait complete. 2024-09-19T09:32:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.827+0000 7fc1831ee740 20 client.19242 trim_cache size 0 max 16384 2024-09-19T09:32:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 Processor -- start 2024-09-19T09:32:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 -- start start 2024-09-19T09:32:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d807db0 0x55f58d8123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8194a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a9850 con 0x55f58d80d780 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a7120 con 0x55f58d807db0 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.842+0000 7fc1831ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a4f70 con 0x55f58d8086f0 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37192/0 (socket says 172.21.15.52:37192) 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 -- 172.21.15.52:0/3273665421 learned_addr learned my addr 172.21.15.52:0/3273665421 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17e114640 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8194a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 -- 172.21.15.52:0/3273665421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 msgr2=0x55f58d8194a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8194a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 -- 172.21.15.52:0/3273665421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d807db0 msgr2=0x55f58d8123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d807db0 0x55f58d8123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 -- 172.21.15.52:0/3273665421 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58d808bd0 con 0x55f58d80d780 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc17d913640 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc174004eb0 tx=0x7fc174032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b62d650be47620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc163fff640 1 -- 172.21.15.52:0/3273665421 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174035040 con 0x55f58d80d780 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc163fff640 1 -- 172.21.15.52:0/3273665421 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc174051070 con 0x55f58d80d780 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.843+0000 7fc163fff640 1 -- 172.21.15.52:0/3273665421 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740039c0 con 0x55f58d80d780 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- 172.21.15.52:0/3273665421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 msgr2=0x55f58d824910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fc174004eb0 tx=0x7fc174032e20 comp rx=0 tx=0).stop 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- 172.21.15.52:0/3273665421 shutdown_connections 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d824910 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d8086f0 0x55f58d8194a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3273665421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d807db0 0x55f58d8123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- 172.21.15.52:0/3273665421 >> 172.21.15.52:0/3273665421 conn(0x55f58d7ff010 msgr2=0x55f58d8006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- 172.21.15.52:0/3273665421 shutdown_connections 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- 172.21.15.52:0/3273665421 wait complete. 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- start start 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 Processor -- start 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d817170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d8176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a55e0 con 0x55f58d80d780 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a6a50 con 0x55f58d8086f0 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781a5cb0 con 0x55f58d807db0 2024-09-19T09:32:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.844+0000 7fc1831ee740 10 client.0 _ll_register_callbacks cb 0x7fc1740316b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37200/0 (socket says 172.21.15.52:37200) 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 -- 172.21.15.52:0/3612568839 learned_addr learned my addr 172.21.15.52:0/3612568839 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17e114640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d8176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d817170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 -- 172.21.15.52:0/3612568839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 msgr2=0x55f58d817170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d817170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 -- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 msgr2=0x55f58d8176b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d8176b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 -- 172.21.15.52:0/3612568839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58d818cd0 con 0x55f58d80d780 2024-09-19T09:32:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc17d913640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x55f58d816780 tx=0x7fc17402ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8cf7c5e38c5d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc161ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174035070 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc174003ba0 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc174051070 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc174031dd0 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc1831ee740 10 client.19248 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.845+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f58d888da0 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc174051070 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc174062040 con 0x55f58d80d780 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 10 client.19248 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 10 client.19248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 20 client.19248 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:17.853 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d8896a0 0x55f58d88ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 4 client.19248 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:32:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f58d76ed70 con 0x55f58d8896a0 2024-09-19T09:32:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc17e114640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d8896a0 0x55f58d88ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc17e114640 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d8896a0 0x55f58d88ba90 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668726cd4bedcfab server_cookie=d45943c50f7ed040 in_seq=0 out_seq=0 2024-09-19T09:32:17.854 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.846+0000 7fc161ffb640 10 client.19248 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc161ffb640 1 -- 172.21.15.52:0/3612568839 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f58d76ed70 con 0x55f58d8896a0 2024-09-19T09:32:17.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc161ffb640 10 client.19248 handle_command_reply: tid=0 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 client.19248 shutdown 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 msgr2=0x55f58d8186c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x55f58d816780 tx=0x7fc17402ab90 comp rx=0 tx=0).stop 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 shutdown_connections 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f58d8896a0 0x55f58d88ba90 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f58d80d780 0x55f58d8186c0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f58d8086f0 0x55f58d8176b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 --2- 172.21.15.52:0/3612568839 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f58d807db0 0x55f58d817170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc161ffb640 0 client.19248 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 >> 172.21.15.52:0/3612568839 conn(0x55f58d7ff010 msgr2=0x55f58d7fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 shutdown_connections 2024-09-19T09:32:17.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 1 -- 172.21.15.52:0/3612568839 wait complete. 2024-09-19T09:32:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.859+0000 7fc1831ee740 20 client.19248 trim_cache size 0 max 16384 2024-09-19T09:32:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:32:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:32:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:32:17.863 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 msgr2=0x7fc1640a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 0x7fc1640a57b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc1700985e0 tx=0x7fc170066bc0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 msgr2=0x7fc17819f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc17000eaa0 tx=0x7fc17000ef60 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 shutdown_connections 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc178103710 0x7fc17819f380 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1640a32f0 0x7fc1640a57b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc178102d50 0x7fc178198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 --2- 172.21.15.52:0/2503456038 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc178101b60 0x7fc178197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 >> 172.21.15.52:0/2503456038 conn(0x7fc1780fd2e0 msgr2=0x7fc178106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:17.864 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 shutdown_connections 2024-09-19T09:32:17.865 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:17.860+0000 7fc180378640 1 -- 172.21.15.52:0/2503456038 wait complete. 2024-09-19T09:32:19.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:19 smithi052 ceph-mon[30947]: pgmap v664: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:32:19.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:19 smithi169 ceph-mon[35454]: pgmap v664: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:32:19.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:19 smithi086 ceph-mon[34813]: pgmap v664: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:32:21.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:21 smithi052 ceph-mon[30947]: pgmap v665: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:32:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:21 smithi169 ceph-mon[35454]: pgmap v665: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:32:21.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:21 smithi086 ceph-mon[34813]: pgmap v665: 97 pgs: 97 active+clean; 1.2 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:32:23.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:23 smithi052 ceph-mon[30947]: pgmap v666: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:23.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:23 smithi169 ceph-mon[35454]: pgmap v666: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:23.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:23 smithi086 ceph-mon[34813]: pgmap v666: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:313/600: open fd = 3 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:314/600: open fd = 3 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.028 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:315/600: open fd = 3 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:316/600: open fd = 3 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:317/600: open fd = 3 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.029 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:318/600: open fd = 3 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:319/600: open fd = 3 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:320/600: open fd = 3 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:321/600: open fd = 3 2024-09-19T09:32:24.030 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:322/600: open fd = 3 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:323/600: open fd = 3 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:324/600: open fd = 3 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.031 INFO:tasks.workunit.client.0.smithi052.stdout:325/600: open fd = 3 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:326/600: open fd = 3 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:327/600: open fd = 3 2024-09-19T09:32:24.032 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:328/600: open fd = 3 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:329/600: open fd = 3 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:330/600: open fd = 3 2024-09-19T09:32:24.033 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:331/600: open fd = 3 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:332/600: open fd = 3 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:333/600: open fd = 3 2024-09-19T09:32:24.034 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:334/600: open fd = 3 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:335/600: open fd = 3 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:336/600: open fd = 3 2024-09-19T09:32:24.035 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:337/600: open fd = 3 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:338/600: open fd = 3 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.036 INFO:tasks.workunit.client.0.smithi052.stdout:339/600: open fd = 3 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:340/600: open fd = 3 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:341/600: open fd = 3 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:342/600: open fd = 3 2024-09-19T09:32:24.037 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:343/600: open fd = 3 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:344/600: open fd = 3 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:345/600: open fd = 3 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.038 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:346/600: open fd = 3 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:347/600: open fd = 3 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:348/600: open fd = 3 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:349/600: open fd = 3 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.039 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:350/600: open fd = 3 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:351/600: open fd = 3 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:352/600: open fd = 3 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.040 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:353/600: open fd = 3 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:354/600: open fd = 3 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:355/600: open fd = 3 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:356/600: open fd = 3 2024-09-19T09:32:24.041 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:357/600: open fd = 3 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:358/600: open fd = 3 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:359/600: open fd = 3 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.042 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:360/600: open fd = 3 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:361/600: open fd = 3 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:362/600: open fd = 3 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:363/600: open fd = 3 2024-09-19T09:32:24.043 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:364/600: open fd = 3 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:365/600: open fd = 3 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:366/600: open fd = 3 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.044 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:367/600: open fd = 3 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:368/600: open fd = 3 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:369/600: open fd = 3 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.045 INFO:tasks.workunit.client.0.smithi052.stdout:370/600: open fd = 3 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:371/600: open fd = 3 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:372/600: open fd = 3 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:373/600: open fd = 3 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.046 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.047 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:24.047 INFO:tasks.workunit.client.0.smithi052.stdout:374/600: open fd = 3 2024-09-19T09:32:24.047 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.047 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:32:24.047 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:32:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:25 smithi052 ceph-mon[30947]: pgmap v667: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:25.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:25 smithi169 ceph-mon[35454]: pgmap v667: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:25 smithi086 ceph-mon[34813]: pgmap v667: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:27.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:27 smithi052 ceph-mon[30947]: pgmap v668: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:27.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:27 smithi169 ceph-mon[35454]: pgmap v668: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:27.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:27 smithi086 ceph-mon[34813]: pgmap v668: 97 pgs: 97 active+clean; 1.3 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:29 smithi052 ceph-mon[30947]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:32:29.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:29 smithi169 ceph-mon[35454]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:32:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:29 smithi086 ceph-mon[34813]: pgmap v669: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:32:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 -- 172.21.15.52:0/4036991059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc102d50 msgr2=0x7f61fc1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 --2- 172.21.15.52:0/4036991059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc102d50 0x7f61fc1031d0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009900 tx=0x7f61ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:32:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 -- 172.21.15.52:0/4036991059 shutdown_connections 2024-09-19T09:32:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 --2- 172.21.15.52:0/4036991059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc103710 0x7f61fc109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 --2- 172.21.15.52:0/4036991059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc102d50 0x7f61fc1031d0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 --2- 172.21.15.52:0/4036991059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 0x7f61fc101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 -- 172.21.15.52:0/4036991059 >> 172.21.15.52:0/4036991059 conn(0x7f61fc0fd2e0 msgr2=0x7f61fc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 -- 172.21.15.52:0/4036991059 shutdown_connections 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.962+0000 7f6202ad0640 1 -- 172.21.15.52:0/4036991059 wait complete. 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 Processor -- start 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 -- start start 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 0x7f61fc197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 0x7f61fc1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10d7c0 con 0x7f61fc103710 2024-09-19T09:32:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10d640 con 0x7f61fc101b60 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f6202ad0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc10d940 con 0x7f61fc102d50 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50684/0 (socket says 172.21.15.52:50684) 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 -- 172.21.15.52:0/1073921277 learned_addr learned my addr 172.21.15.52:0/1073921277 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620086c640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 0x7f61fc197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f61f3fff640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 0x7f61fc1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 -- 172.21.15.52:0/1073921277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 msgr2=0x7f61fc1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 0x7f61fc1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 -- 172.21.15.52:0/1073921277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 msgr2=0x7f61fc197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 0x7f61fc197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f620106d640 1 -- 172.21.15.52:0/1073921277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc19f9d0 con 0x7f61fc103710 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.963+0000 7f61f3fff640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 0x7f61fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f620106d640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f61f400eb10 tx=0x7f61f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f61f1ffb640 1 -- 172.21.15.52:0/1073921277 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004b20 con 0x7f61fc103710 2024-09-19T09:32:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f61f1ffb640 1 -- 172.21.15.52:0/1073921277 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f4004cc0 con 0x7f61fc103710 2024-09-19T09:32:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc19fcc0 con 0x7f61fc103710 2024-09-19T09:32:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f61f1ffb640 1 -- 172.21.15.52:0/1073921277 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4010760 con 0x7f61fc103710 2024-09-19T09:32:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.964+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1a0190 con 0x7f61fc103710 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.966+0000 7f61f1ffb640 1 -- 172.21.15.52:0/1073921277 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f61f4005020 con 0x7f61fc103710 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 Processor -- start 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 -- start start 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e2634db0 0x55e7e26351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 0x55e7e263cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e7e25942f0 con 0x55e7e263a780 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e7e253c270 con 0x55e7e26356f0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620586b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7e25902b0 con 0x55e7e2634db0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f1ffb640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 0x7f61e40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 0x55e7e263cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620086c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 0x55e7e263cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50696/0 (socket says 172.21.15.52:50696) 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620086c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47160/0 (socket says 172.21.15.52:47160) 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f3fff640 1 -- 172.21.15.52:0/2961067130 learned_addr learned my addr 172.21.15.52:0/2961067130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f1ffb640 1 -- 172.21.15.52:0/1073921277 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f61f40cffd0 con 0x7f61fc103710 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f620106d640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 0x7f61e40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.967+0000 7f61f3fff640 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e2634db0 0x55e7e26351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 -- 172.21.15.52:0/2961067130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e2634db0 msgr2=0x55e7e26351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e2634db0 0x55e7e26351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 -- 172.21.15.52:0/2961067130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 msgr2=0x55e7e263cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 0x55e7e263cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 -- 172.21.15.52:0/2961067130 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e253b340 con 0x55e7e26356f0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620106d640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 0x7f61e40a5830 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f61f40cd9f0 tx=0x7f61f400efd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f620086c640 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009bf0 tx=0x7f61f8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d96e87786951b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f61e2ffd640 1 -- 172.21.15.52:0/2961067130 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8004030 con 0x55e7e26356f0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f61e2ffd640 1 -- 172.21.15.52:0/2961067130 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f8005500 con 0x55e7e26356f0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.968+0000 7f61e2ffd640 1 -- 172.21.15.52:0/2961067130 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8004e60 con 0x55e7e26356f0 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- 172.21.15.52:0/2961067130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 msgr2=0x55e7e263a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009bf0 tx=0x7f61f8011810 comp rx=0 tx=0).stop 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- 172.21.15.52:0/2961067130 shutdown_connections 2024-09-19T09:32:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e263a780 0x55e7e263cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263a1b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 --2- 172.21.15.52:0/2961067130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e2634db0 0x55e7e26351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- 172.21.15.52:0/2961067130 >> 172.21.15.52:0/2961067130 conn(0x55e7e262c010 msgr2=0x55e7e262c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- 172.21.15.52:0/2961067130 shutdown_connections 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- 172.21.15.52:0/2961067130 wait complete. 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 -- start start 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.969+0000 7f620586b740 1 Processor -- start 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2646500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e7e263d750 con 0x55e7e2634db0 2024-09-19T09:32:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e7e251d290 con 0x55e7e26356f0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7e263d8d0 con 0x55e7e263a780 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620586b740 10 client.0 _ll_register_callbacks cb 0x55e7e254e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50698/0 (socket says 172.21.15.52:50698) 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 -- 172.21.15.52:0/485970898 learned_addr learned my addr 172.21.15.52:0/485970898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620086c640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2646500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 -- 172.21.15.52:0/485970898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 msgr2=0x55e7e2646500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2646500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 -- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 msgr2=0x55e7e263f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f61f3fff640 1 -- 172.21.15.52:0/485970898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e22a7210 con 0x55e7e2634db0 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.970+0000 7f620086c640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61f3fff640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009230 tx=0x7f61ec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4ed55de3fa2f88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec035040 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61f8005500 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f61ec0042d0 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f61ec052050 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f620586b740 10 client.19260 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e7e2373620 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f8005500 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f61ec03a040 con 0x55e7e2634db0 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f620586b740 10 client.19260 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.971+0000 7f620586b740 10 client.19260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620586b740 20 client.19260 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e264ab80 0x55e7e264cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620586b740 4 client.19260 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7e25a1a20 con 0x55e7e264ab80 2024-09-19T09:32:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620086c640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e264ab80 0x55e7e264cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f61dbfff640 10 client.19260 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.972+0000 7f620086c640 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e264ab80 0x55e7e264cff0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b8a55e0604f0c server_cookie=f0fd770f5d36ac4 in_seq=0 out_seq=0 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f61dbfff640 1 -- 172.21.15.52:0/485970898 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7e25a1a20 con 0x55e7e264ab80 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f61dbfff640 10 client.19260 handle_command_reply: tid=0 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 client.19260 shutdown 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 msgr2=0x55e7e263ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f61ec009230 tx=0x7f61ec02a410 comp rx=0 tx=0).stop 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 shutdown_connections 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e264ab80 0x55e7e264cff0 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2646500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e263f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 --2- 172.21.15.52:0/485970898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e263ef80 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f61dbfff640 0 client.19260 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 >> 172.21.15.52:0/485970898 conn(0x55e7e262c010 msgr2=0x55e7e262d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 shutdown_connections 2024-09-19T09:32:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 1 -- 172.21.15.52:0/485970898 wait complete. 2024-09-19T09:32:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.973+0000 7f620586b740 20 client.19260 trim_cache size 0 max 16384 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 Processor -- start 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 -- start start 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e26464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e262aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a9870 con 0x55e7e2634db0 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a7140 con 0x55e7e26356f0 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620586b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a4f90 con 0x55e7e263a780 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f61f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50714/0 (socket says 172.21.15.52:50714) 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f61f3fff640 1 -- 172.21.15.52:0/2968305847 learned_addr learned my addr 172.21.15.52:0/2968305847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.988+0000 7f620086c640 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e26464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e262aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 -- 172.21.15.52:0/2968305847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 msgr2=0x55e7e262aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e262aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 -- 172.21.15.52:0/2968305847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 msgr2=0x55e7e26464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e26464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 -- 172.21.15.52:0/2968305847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7e2635bd0 con 0x55e7e2634db0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61f3fff640 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005ec0 tx=0x7f61ec0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c68cc44f6d30bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61e27fc640 1 -- 172.21.15.52:0/2968305847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec035070 con 0x55e7e2634db0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61e27fc640 1 -- 172.21.15.52:0/2968305847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61ec0042d0 con 0x55e7e2634db0 2024-09-19T09:32:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.989+0000 7f61e27fc640 1 -- 172.21.15.52:0/2968305847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec031e30 con 0x55e7e2634db0 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- 172.21.15.52:0/2968305847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 msgr2=0x55e7e262a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f61ec005ec0 tx=0x7f61ec0058b0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- 172.21.15.52:0/2968305847 shutdown_connections 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e262aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e26356f0 0x55e7e26464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- 172.21.15.52:0/2968305847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e2634db0 0x55e7e262a9a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- 172.21.15.52:0/2968305847 >> 172.21.15.52:0/2968305847 conn(0x55e7e262c010 msgr2=0x55e7e263ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- 172.21.15.52:0/2968305847 shutdown_connections 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- 172.21.15.52:0/2968305847 wait complete. 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- start start 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 Processor -- start 2024-09-19T09:32:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e2634db0 0x55e7e26438e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2644e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a5600 con 0x55e7e26356f0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a6a70 con 0x55e7e2634db0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc1a5cd0 con 0x55e7e263a780 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.990+0000 7f620586b740 10 client.0 _ll_register_callbacks cb 0x7f61ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50726/0 (socket says 172.21.15.52:50726) 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 -- 172.21.15.52:0/3377791369 learned_addr learned my addr 172.21.15.52:0/3377791369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61f3fff640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2644e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61f3fff640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e2634db0 0x55e7e26438e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 -- 172.21.15.52:0/3377791369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 msgr2=0x55e7e2644e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2644e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 -- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e2634db0 msgr2=0x55e7e26438e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e2634db0 0x55e7e26438e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 -- 172.21.15.52:0/3377791369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7e2645440 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620086c640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009bf0 tx=0x7f61f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc86c2f2b4ba25f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f801e040 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f61f8004e70 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61ec0042d0 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f61f8005070 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620586b740 10 client.19266 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.991+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e7e26467c0 con 0x55e7e26356f0 2024-09-19T09:32:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61ec0042d0 con 0x55e7e26356f0 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f61f8024040 con 0x55e7e26356f0 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 10 client.19266 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 10 client.19266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 20 client.19266 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e26b5de0 0x55e7e26b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 4 client.19266 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7e259bd70 con 0x55e7e26b5de0 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f61f3fff640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e26b5de0 0x55e7e26b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f61dbfff640 10 client.19266 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:30.992+0000 7f61f3fff640 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e26b5de0 0x55e7e26b8200 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f10deb67cda228c server_cookie=23cd4e3ee8634196 in_seq=0 out_seq=0 2024-09-19T09:32:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f61dbfff640 1 -- 172.21.15.52:0/3377791369 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7e259bd70 con 0x55e7e26b5de0 2024-09-19T09:32:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f61dbfff640 10 client.19266 handle_command_reply: tid=0 2024-09-19T09:32:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 client.19266 shutdown 2024-09-19T09:32:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 msgr2=0x55e7e2643e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009bf0 tx=0x7f61f8009260 comp rx=0 tx=0).stop 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 shutdown_connections 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7e26b5de0 0x55e7e26b8200 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7e263a780 0x55e7e2644e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7e26356f0 0x55e7e2643e20 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f61dbfff640 0 client.19266 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 --2- 172.21.15.52:0/3377791369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7e2634db0 0x55e7e26438e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 >> 172.21.15.52:0/3377791369 conn(0x55e7e262c010 msgr2=0x55e7e262cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 shutdown_connections 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 1 -- 172.21.15.52:0/3377791369 wait complete. 2024-09-19T09:32:31.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.006+0000 7f620586b740 20 client.19266 trim_cache size 0 max 16384 2024-09-19T09:32:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:32:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:32:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:32:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 msgr2=0x7f61e40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 0x7f61e40a5830 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f61f40cd9f0 tx=0x7f61f400efd0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 msgr2=0x7f61fc19f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f61f400eb10 tx=0x7f61f400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 shutdown_connections 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61fc103710 0x7f61fc19f360 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f61e40a3370 0x7f61e40a5830 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61fc102d50 0x7f61fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 --2- 172.21.15.52:0/1073921277 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61fc101b60 0x7f61fc197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 >> 172.21.15.52:0/1073921277 conn(0x7f61fc0fd2e0 msgr2=0x7f61fc106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 shutdown_connections 2024-09-19T09:32:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:31.007+0000 7f6202ad0640 1 -- 172.21.15.52:0/1073921277 wait complete. 2024-09-19T09:32:31.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:31 smithi052 ceph-mon[30947]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:31.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:31 smithi169 ceph-mon[35454]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:31.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:31 smithi086 ceph-mon[34813]: pgmap v670: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:32.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:32:32.364 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 -- 172.21.15.52:0/3287558737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 msgr2=0x7f6cd410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 --2- 172.21.15.52:0/3287558737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd410eaa0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009900 tx=0x7f6ccc02a410 comp rx=0 tx=0).stop 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 -- 172.21.15.52:0/3287558737 shutdown_connections 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 --2- 172.21.15.52:0/3287558737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd410eaa0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 --2- 172.21.15.52:0/3287558737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd41027a0 0x7f6cd41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 --2- 172.21.15.52:0/3287558737 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd4101df0 0x7f6cd41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 -- 172.21.15.52:0/3287558737 >> 172.21.15.52:0/3287558737 conn(0x7f6cd40fd8b0 msgr2=0x7f6cd40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 -- 172.21.15.52:0/3287558737 shutdown_connections 2024-09-19T09:32:32.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.843+0000 7f6cd945e640 1 -- 172.21.15.52:0/3287558737 wait complete. 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 Processor -- start 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 -- start start 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd4101df0 0x7f6cd4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd41027a0 0x7f6cd41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4111fd0 con 0x7f6cd4106f20 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4111e50 con 0x7f6cd4101df0 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd945e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd4112150 con 0x7f6cd41027a0 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.844+0000 7f6cd37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50746/0 (socket says 172.21.15.52:50746) 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 -- 172.21.15.52:0/4177127938 learned_addr learned my addr 172.21.15.52:0/4177127938 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd4101df0 0x7f6cd4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd41027a0 0x7f6cd41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 -- 172.21.15.52:0/4177127938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd41027a0 msgr2=0x7f6cd41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd41027a0 0x7f6cd41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 -- 172.21.15.52:0/4177127938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd4101df0 msgr2=0x7f6cd4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd4101df0 0x7f6cd4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 -- 172.21.15.52:0/4177127938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd419d320 con 0x7f6cd4106f20 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd37fe640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc004770 tx=0x7f6ccc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6ccbfff640 1 -- 172.21.15.52:0/4177127938 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc03f070 con 0x7f6cd4106f20 2024-09-19T09:32:32.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd419d5b0 con 0x7f6cd4106f20 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6ccbfff640 1 -- 172.21.15.52:0/4177127938 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc031c90 con 0x7f6cd4106f20 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6ccbfff640 1 -- 172.21.15.52:0/4177127938 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc035030 con 0x7f6cd4106f20 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.845+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd41a4ef0 con 0x7f6cd4106f20 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6ccbfff640 1 -- 172.21.15.52:0/4177127938 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ccc042070 con 0x7f6cd4106f20 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 Processor -- start 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 -- start start 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f1f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x565084e852e0 con 0x565084f1fdc0 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x565084e2cce0 con 0x565084f2a680 2024-09-19T09:32:32.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cdb837740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565084e812a0 con 0x565084f1f4a0 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50748/0 (socket says 172.21.15.52:50748) 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/3602852782 learned_addr learned my addr 172.21.15.52:0/3602852782 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.848+0000 7f6ccbfff640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 0x7f6cc00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f1f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd37fe640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 0x7f6cc00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/3602852782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 msgr2=0x565084f1f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f1f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/3602852782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 msgr2=0x565084f2ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/3602852782 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565084e11440 con 0x565084f1fdc0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6ccbfff640 1 -- 172.21.15.52:0/4177127938 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6ccc0f0040 con 0x7f6cd4106f20 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400bd10 tx=0x7f6cc40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46a894eab1474a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cd37fe640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 0x7f6cc00a5700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0b8af0 tx=0x7f6ccc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cc97fa640 1 -- 172.21.15.52:0/3602852782 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4004030 con 0x565084f1fdc0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cc97fa640 1 -- 172.21.15.52:0/3602852782 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc40041d0 con 0x565084f1fdc0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.849+0000 7f6cc97fa640 1 -- 172.21.15.52:0/3602852782 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40117e0 con 0x565084f1fdc0 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- 172.21.15.52:0/3602852782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 msgr2=0x565084f2a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400bd10 tx=0x7f6cc40107a0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- 172.21.15.52:0/3602852782 shutdown_connections 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f2a140 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 --2- 172.21.15.52:0/3602852782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f1f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- 172.21.15.52:0/3602852782 >> 172.21.15.52:0/3602852782 conn(0x565084f1ba30 msgr2=0x565084f1be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- 172.21.15.52:0/3602852782 shutdown_connections 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- 172.21.15.52:0/3602852782 wait complete. 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.850+0000 7f6cdb837740 1 -- start start 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 Processor -- start 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f29f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x565084f2d250 con 0x565084f1fdc0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x565084e40050 con 0x565084f2a680 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x565084f2d3d0 con 0x565084f1f4a0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cdb837740 10 client.0 _ll_register_callbacks cb 0x565084e80160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50756/0 (socket says 172.21.15.52:50756) 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2307893502 learned_addr learned my addr 172.21.15.52:0/2307893502 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f29f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2307893502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 msgr2=0x565084f29f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f29f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 msgr2=0x565084f276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f276f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2307893502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565084bf63c0 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.851+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f29f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4011480 tx=0x7f6cc4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6bac62fc573cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4029060 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc40041d0 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6cc40035f0 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6cc40037f0 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 10 client.19278 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565084f38b90 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc40041d0 con 0x565084f1fdc0 2024-09-19T09:32:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6cc4004880 con 0x565084f1fdc0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 10 client.19278 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 10 client.19278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 20 client.19278 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084f39fa0 0x565084f3c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 4 client.19278 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.852+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565084e92850 con 0x565084f39fa0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.853+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084f39fa0 0x565084f3c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.853+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084f39fa0 0x565084f3c390 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44cd21ecdbd0e09 server_cookie=a40bd85c7b2695b3 in_seq=0 out_seq=0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.853+0000 7f6cba7fc640 10 client.19278 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cba7fc640 1 -- 172.21.15.52:0/2307893502 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565084e92850 con 0x565084f39fa0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cba7fc640 10 client.19278 handle_command_reply: tid=0 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 client.19278 shutdown 2024-09-19T09:32:32.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 msgr2=0x565084f271b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4011480 tx=0x7f6cc4003f70 comp rx=0 tx=0).stop 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 shutdown_connections 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084f39fa0 0x565084f3c390 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f276f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f271b0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cba7fc640 0 client.19278 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2307893502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1f4a0 0x565084f29f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 >> 172.21.15.52:0/2307893502 conn(0x565084f1ba30 msgr2=0x565084f21710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 shutdown_connections 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 1 -- 172.21.15.52:0/2307893502 wait complete. 2024-09-19T09:32:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.854+0000 7f6cdb837740 20 client.19278 trim_cache size 0 max 16384 2024-09-19T09:32:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 Processor -- start 2024-09-19T09:32:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 -- start start 2024-09-19T09:32:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f1f4a0 0x565084f364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 0x565084f26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41b0060 con 0x565084f1fdc0 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41ad930 con 0x565084f1f4a0 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cdb837740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41ab780 con 0x565084f2a680 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50762/0 (socket says 172.21.15.52:50762) 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2369253640 learned_addr learned my addr 172.21.15.52:0/2369253640 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f1f4a0 0x565084f364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 0x565084f26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2369253640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 msgr2=0x565084f26190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 0x565084f26190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2369253640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f1f4a0 msgr2=0x565084f364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.872+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f1f4a0 0x565084f364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cd2ffd640 1 -- 172.21.15.52:0/2369253640 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565084f2a270 con 0x565084f1fdc0 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 0x565084f26190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4001eb0 tx=0x7f6cc4010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0e84ba0a1ef0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cc8ff9640 1 -- 172.21.15.52:0/2369253640 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4029040 con 0x565084f1fdc0 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cc8ff9640 1 -- 172.21.15.52:0/2369253640 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc4004a70 con 0x565084f1fdc0 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.873+0000 7f6cc8ff9640 1 -- 172.21.15.52:0/2369253640 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4005000 con 0x565084f1fdc0 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- 172.21.15.52:0/2369253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 msgr2=0x565084f22900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4001eb0 tx=0x7f6cc4010dd0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- 172.21.15.52:0/2369253640 shutdown_connections 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f2a680 0x565084f26190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1fdc0 0x565084f22900 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- 172.21.15.52:0/2369253640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f1f4a0 0x565084f364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- 172.21.15.52:0/2369253640 >> 172.21.15.52:0/2369253640 conn(0x565084f1ba30 msgr2=0x565084f25a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- 172.21.15.52:0/2369253640 shutdown_connections 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- 172.21.15.52:0/2369253640 wait complete. 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- start start 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 Processor -- start 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 0x565084fa15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41abdf0 con 0x565084f1f4a0 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41ad260 con 0x565084f2a680 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.874+0000 7f6cdb837740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd41ac4c0 con 0x565084f1fdc0 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cdb837740 10 client.0 _ll_register_callbacks cb 0x7f6cc400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50774/0 (socket says 172.21.15.52:50774) 2024-09-19T09:32:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 -- 172.21.15.52:0/1508170731 learned_addr learned my addr 172.21.15.52:0/1508170731 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 0x565084fa15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 -- 172.21.15.52:0/1508170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 msgr2=0x565084fa15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 0x565084fa15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 -- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 msgr2=0x565084f2dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 -- 172.21.15.52:0/1508170731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565084f2e360 con 0x565084f1f4a0 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 0x565084fa15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cd27fc640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0127d0 tx=0x7f6cbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769bd10985040b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc004b20 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6cbc004cc0 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.875+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565084e8cd60 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6cbc011810 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 10 client.19284 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565084fa88d0 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x565084e8cd60 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6cbc02c9e0 con 0x565084f1f4a0 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 10 client.19284 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 10 client.19284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 20 client.19284 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084fa9020 0x565084fab440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 4 client.19284 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565084e09210 con 0x565084fa9020 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.876+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084fa9020 0x565084fab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cd2ffd640 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084fa9020 0x565084fab440 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecec519dea1736d5 server_cookie=9c5b088647afb64e in_seq=0 out_seq=0 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cba7fc640 10 client.19284 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cba7fc640 1 -- 172.21.15.52:0/1508170731 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x565084e09210 con 0x565084fa9020 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cba7fc640 10 client.19284 handle_command_reply: tid=0 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 client.19284 shutdown 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 msgr2=0x565084fa1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0127d0 tx=0x7f6cbc004a40 comp rx=0 tx=0).stop 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 shutdown_connections 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565084fa9020 0x565084fab440 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565084f2a680 0x565084f2dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565084f1fdc0 0x565084fa15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 --2- 172.21.15.52:0/1508170731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x565084f1f4a0 0x565084fa1060 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 >> 172.21.15.52:0/1508170731 conn(0x565084f1ba30 msgr2=0x565084f28a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cba7fc640 0 client.19284 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 shutdown_connections 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 1 -- 172.21.15.52:0/1508170731 wait complete. 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.877+0000 7f6cdb837740 20 client.19284 trim_cache size 0 max 16384 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:32.885 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:32:32.886 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:32:32.886 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 msgr2=0x7f6cc00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 0x7f6cc00a5700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0b8af0 tx=0x7f6ccc009260 comp rx=0 tx=0).stop 2024-09-19T09:32:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 msgr2=0x7f6cd419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc004770 tx=0x7f6ccc003b90 comp rx=0 tx=0).stop 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 shutdown_connections 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4106f20 0x7f6cd419cc40 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6cc00a3240 0x7f6cc00a5700 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6cd41027a0 0x7f6cd41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 --2- 172.21.15.52:0/4177127938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6cd4101df0 0x7f6cd4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 >> 172.21.15.52:0/4177127938 conn(0x7f6cd40fd8b0 msgr2=0x7f6cd40fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 shutdown_connections 2024-09-19T09:32:32.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:32.878+0000 7f6cd945e640 1 -- 172.21.15.52:0/4177127938 wait complete. 2024-09-19T09:32:33.649 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:33 smithi052 ceph-mon[30947]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:33.682 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:32:33.683 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:32:33.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:33 smithi169 ceph-mon[35454]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:33 smithi086 ceph-mon[34813]: pgmap v671: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 -- 172.21.15.52:0/1795428463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60101de0 msgr2=0x7fda601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:34.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 --2- 172.21.15.52:0/1795428463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60101de0 0x7fda601021c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fda58009ca0 tx=0x7fda5802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 -- 172.21.15.52:0/1795428463 shutdown_connections 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 --2- 172.21.15.52:0/1795428463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60106f10 0x7fda6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 --2- 172.21.15.52:0/1795428463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60102790 0x7fda601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 --2- 172.21.15.52:0/1795428463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60101de0 0x7fda601021c0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 -- 172.21.15.52:0/1795428463 >> 172.21.15.52:0/1795428463 conn(0x7fda600fd8c0 msgr2=0x7fda600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 -- 172.21.15.52:0/1795428463 shutdown_connections 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.417+0000 7fda670a7640 1 -- 172.21.15.52:0/1795428463 wait complete. 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 Processor -- start 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 -- start start 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60101de0 0x7fda601983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60102790 0x7fda60198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:34.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda60111f90 con 0x7fda60106f10 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fda60111e10 con 0x7fda60102790 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.418+0000 7fda670a7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda60112110 con 0x7fda60101de0 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda64e43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60101de0 0x7fda601983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50782/0 (socket says 172.21.15.52:50782) 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 -- 172.21.15.52:0/3618024162 learned_addr learned my addr 172.21.15.52:0/3618024162 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 -- 172.21.15.52:0/3618024162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60101de0 msgr2=0x7fda601983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda5ffff640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60102790 0x7fda60198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60101de0 0x7fda601983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 -- 172.21.15.52:0/3618024162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60102790 msgr2=0x7fda60198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60102790 0x7fda60198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 -- 172.21.15.52:0/3618024162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6019d380 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda65644640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fda50009fd0 tx=0x7fda5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50011830 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda50016070 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6019d670 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5000f2e0 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.419+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda601a4f50 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.420+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda601021c0 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.421+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fda500119d0 con 0x7fda60106f10 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.422+0000 7fda5dffb640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 0x7fda480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.423+0000 7fda64e43640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 0x7fda480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:34.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.423+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fda500cf040 con 0x7fda60106f10 2024-09-19T09:32:34.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.423+0000 7fda64e43640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 0x7fda480a5700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fda58006010 tx=0x7fda58009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:34.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.427+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda5009bce0 con 0x7fda60106f10 2024-09-19T09:32:34.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.639+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda6010a150 con 0x7fda60106f10 2024-09-19T09:32:34.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.639+0000 7fda5dffb640 1 -- 172.21.15.52:0/3618024162 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fda5009b5e0 con 0x7fda60106f10 2024-09-19T09:32:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:32:34.641 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:32:34.641 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 msgr2=0x7fda480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 0x7fda480a5700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fda58006010 tx=0x7fda58009900 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 msgr2=0x7fda6019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fda50009fd0 tx=0x7fda5000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 shutdown_connections 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda60106f10 0x7fda6019cca0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda60102790 0x7fda60198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fda480a3240 0x7fda480a5700 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 --2- 172.21.15.52:0/3618024162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda60101de0 0x7fda601983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 >> 172.21.15.52:0/3618024162 conn(0x7fda600fd8c0 msgr2=0x7fda600fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 shutdown_connections 2024-09-19T09:32:34.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:34.643+0000 7fda670a7640 1 -- 172.21.15.52:0/3618024162 wait complete. 2024-09-19T09:32:35.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:32:35.630 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:35.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:35 smithi052 ceph-mon[30947]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:35.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:35 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3618024162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:35.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:35 smithi169 ceph-mon[35454]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:35 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3618024162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:35.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:35 smithi086 ceph-mon[34813]: pgmap v672: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:35.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:35 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3618024162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:36.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 -- 172.21.15.52:0/3284291982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81410c180 msgr2=0x7fd81410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/3284291982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81410c180 0x7fd81410e600 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009ca0 tx=0x7fd80c02a950 comp rx=0 tx=0).stop 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 -- 172.21.15.52:0/3284291982 shutdown_connections 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/3284291982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd81410c180 0x7fd81410e600 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/3284291982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 0x7fd81410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/3284291982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd814102da0 0x7fd814103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 -- 172.21.15.52:0/3284291982 >> 172.21.15.52:0/3284291982 conn(0x7fd8140fc7a0 msgr2=0x7fd8140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 -- 172.21.15.52:0/3284291982 shutdown_connections 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.070+0000 7fd81a7ef640 1 -- 172.21.15.52:0/3284291982 wait complete. 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 Processor -- start 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 -- start start 2024-09-19T09:32:36.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 0x7fd814198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd81410c180 0x7fd81419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd814111f60 con 0x7fd814102da0 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd814111de0 con 0x7fd8141036c0 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd81a7ef640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141120e0 con 0x7fd81410c180 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.071+0000 7fd813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50792/0 (socket says 172.21.15.52:50792) 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 -- 172.21.15.52:0/2570176486 learned_addr learned my addr 172.21.15.52:0/2570176486 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd818d8c640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd81410c180 0x7fd81419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd8137fe640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 0x7fd814198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 -- 172.21.15.52:0/2570176486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd81410c180 msgr2=0x7fd81419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd81410c180 0x7fd81419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 -- 172.21.15.52:0/2570176486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 msgr2=0x7fd814198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 0x7fd814198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 -- 172.21.15.52:0/2570176486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81419d3f0 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd813fff640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e9f0 tx=0x7fd80400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd8117fa640 1 -- 172.21.15.52:0/2570176486 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80400cd80 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd8117fa640 1 -- 172.21.15.52:0/2570176486 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd804005500 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81419d6e0 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd8117fa640 1 -- 172.21.15.52:0/2570176486 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd804010690 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.072+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8141a4fc0 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.075+0000 7fd81cbc8740 1 Processor -- start 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.075+0000 7fd8117fa640 1 -- 172.21.15.52:0/2570176486 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd8040046c0 con 0x7fd814102da0 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.075+0000 7fd81cbc8740 1 -- start start 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.075+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37e5d0 0x560e6a37ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e6a2e42f0 con 0x560e6a37fb40 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e6a28bcf0 con 0x560e6a389370 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e6a2e02b0 con 0x560e6a37e5d0 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50798/0 (socket says 172.21.15.52:50798) 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 -- 172.21.15.52:0/1210693958 learned_addr learned my addr 172.21.15.52:0/1210693958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd813fff640 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37e5d0 0x560e6a37ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 -- 172.21.15.52:0/1210693958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37e5d0 msgr2=0x560e6a37ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37e5d0 0x560e6a37ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 -- 172.21.15.52:0/1210693958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 msgr2=0x560e6a38b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 -- 172.21.15.52:0/1210693958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6a2703a0 con 0x560e6a37fb40 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd8117fa640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 0x7fd7fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fd80c035000 tx=0x7fd80c005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22bc85bc8327714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd813fff640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 0x7fd7fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd8117fa640 1 -- 172.21.15.52:0/2570176486 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd8040cfe20 con 0x7fd814102da0 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.076+0000 7fd7fa7fc640 1 -- 172.21.15.52:0/1210693958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c034040 con 0x560e6a37fb40 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd7fa7fc640 1 -- 172.21.15.52:0/1210693958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c02f940 con 0x560e6a37fb40 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd7fa7fc640 1 -- 172.21.15.52:0/1210693958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0042a0 con 0x560e6a37fb40 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1210693958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 msgr2=0x560e6a37e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd813fff640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 0x7fd7fc0a5780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e9c0 tx=0x7fd804004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fd80c035000 tx=0x7fd80c005fa0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1210693958 shutdown_connections 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37e5d0 0x560e6a37ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1210693958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a37e090 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1210693958 >> 172.21.15.52:0/1210693958 conn(0x560e6a347310 msgr2=0x560e6a37ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1210693958 shutdown_connections 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.077+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1210693958 wait complete. 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 -- start start 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 Processor -- start 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a388cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 0x560e6a386520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e6a38c010 con 0x560e6a37fb40 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e6a29f060 con 0x560e6a37e5d0 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e6a38c190 con 0x560e6a389370 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd81cbc8740 10 client.0 _ll_register_callbacks cb 0x560e69ff28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50810/0 (socket says 172.21.15.52:50810) 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.078+0000 7fd8137fe640 1 -- 172.21.15.52:0/1062629069 learned_addr learned my addr 172.21.15.52:0/1062629069 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 0x560e6a386520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a388cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 -- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 msgr2=0x560e6a386520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 0x560e6a386520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 -- 172.21.15.52:0/1062629069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 msgr2=0x560e6a388cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a388cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 -- 172.21.15.52:0/1062629069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6a0553c0 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 0x560e6a386520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fd8080103f0 tx=0x7fd8080108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9260ed3de997ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808012920 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c02f940 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd808012ac0 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd808012cc0 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd81cbc8740 10 client.19302 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e6a397af0 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.079+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c02f940 con 0x560e6a37fb40 2024-09-19T09:32:36.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd80800f040 con 0x560e6a37fb40 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 10 client.19302 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 10 client.19302 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 20 client.19302 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a399000 0x560e6a39b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 4 client.19302 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e6a2f1860 con 0x560e6a399000 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a399000 0x560e6a39b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a399000 0x560e6a39b440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29fa6884c5deb228 server_cookie=5b77bb6d35869a93 in_seq=0 out_seq=0 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.080+0000 7fd7f37fe640 10 client.19302 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1062629069 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e6a2f1860 con 0x560e6a399000 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd7f37fe640 10 client.19302 handle_command_reply: tid=0 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 client.19302 shutdown 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 msgr2=0x560e6a385fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fd8080103f0 tx=0x7fd8080108b0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 shutdown_connections 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a399000 0x560e6a39b440 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a389370 0x560e6a386520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37fb40 0x560e6a385fa0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd7f37fe640 0 client.19302 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1062629069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a388cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.081+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 >> 172.21.15.52:0/1062629069 conn(0x560e6a347310 msgr2=0x560e6a380960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.082+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 shutdown_connections 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.082+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1062629069 wait complete. 2024-09-19T09:32:36.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.082+0000 7fd81cbc8740 20 client.19302 trim_cache size 0 max 16384 2024-09-19T09:32:36.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.095+0000 7fd81cbc8740 1 Processor -- start 2024-09-19T09:32:36.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.095+0000 7fd81cbc8740 1 -- start start 2024-09-19T09:32:36.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a3882d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a381120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141aff70 con 0x560e6a389370 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141ad840 con 0x560e6a37e5d0 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141ab690 con 0x560e6a37fb40 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50812/0 (socket says 172.21.15.52:50812) 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 -- 172.21.15.52:0/1168966731 learned_addr learned my addr 172.21.15.52:0/1168966731 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a3882d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a381120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 -- 172.21.15.52:0/1168966731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 msgr2=0x560e6a381120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a381120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 -- 172.21.15.52:0/1168966731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 msgr2=0x560e6a3882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a3882d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 -- 172.21.15.52:0/1168966731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e6a381ba0 con 0x560e6a389370 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a381120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fd80c003a50 tx=0x7fd80c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5361d8d92c6ba78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.096+0000 7fd7f9ffb640 1 -- 172.21.15.52:0/1168966731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c049040 con 0x560e6a389370 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd7f9ffb640 1 -- 172.21.15.52:0/1168966731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c02f940 con 0x560e6a389370 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd7f9ffb640 1 -- 172.21.15.52:0/1168966731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c004540 con 0x560e6a389370 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1168966731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 msgr2=0x560e6a381660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fd80c003a50 tx=0x7fd80c02a950 comp rx=0 tx=0).stop 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1168966731 shutdown_connections 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a389370 0x560e6a381660 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a381120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1168966731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a37e5d0 0x560e6a3882d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1168966731 >> 172.21.15.52:0/1168966731 conn(0x560e6a347310 msgr2=0x560e6a379d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1168966731 shutdown_connections 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.097+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1168966731 wait complete. 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 -- start start 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 Processor -- start 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a38d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141abd00 con 0x560e6a37e5d0 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141ad170 con 0x560e6a389370 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd8141ac3d0 con 0x560e6a37fb40 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd81cbc8740 10 client.0 _ll_register_callbacks cb 0x7fd80800e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:36.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd818d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50814/0 (socket says 172.21.15.52:50814) 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.098+0000 7fd818d8c640 1 -- 172.21.15.52:0/1513977981 learned_addr learned my addr 172.21.15.52:0/1513977981 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a38d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 -- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 msgr2=0x560e6a38d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a38d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 -- 172.21.15.52:0/1513977981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 msgr2=0x560e6a38dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 -- 172.21.15.52:0/1513977981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e6a402f80 con 0x560e6a37e5d0 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a38d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd818d8c640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fd80c02ae70 tx=0x7fd80c02fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8b8b63b4acf163 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:36.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c034040 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd80c003f00 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c02f940 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd80c067050 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd81cbc8740 10 client.19308 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.099+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e6a4041f0 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd80c02f940 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd80c04f040 con 0x560e6a37e5d0 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 10 client.19308 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 10 client.19308 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 20 client.19308 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a4043c0 0x560e6a4067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 4 client.19308 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:36.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e6a2ebd70 con 0x560e6a4043c0 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.100+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a4043c0 0x560e6a4067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd8137fe640 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a4043c0 0x560e6a4067b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f72f9094cae37ef server_cookie=cc3e58c2f174d35c in_seq=0 out_seq=0 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd7f37fe640 10 client.19308 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd7f37fe640 1 -- 172.21.15.52:0/1513977981 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e6a2ebd70 con 0x560e6a4043c0 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd7f37fe640 10 client.19308 handle_command_reply: tid=0 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 client.19308 shutdown 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 msgr2=0x560e6a38d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fd80c02ae70 tx=0x7fd80c02fec0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 shutdown_connections 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560e6a4043c0 0x560e6a4067b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e6a389370 0x560e6a38dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e6a37fb40 0x560e6a38d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 --2- 172.21.15.52:0/1513977981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e6a37e5d0 0x560e6a38d440 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 >> 172.21.15.52:0/1513977981 conn(0x560e6a347310 msgr2=0x560e6a385860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd7f37fe640 0 client.19308 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 shutdown_connections 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 1 -- 172.21.15.52:0/1513977981 wait complete. 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.101+0000 7fd81cbc8740 20 client.19308 trim_cache size 0 max 16384 2024-09-19T09:32:36.117 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 msgr2=0x7fd7fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 0x7fd7fc0a5780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e9c0 tx=0x7fd804004a40 comp rx=0 tx=0).stop 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 msgr2=0x7fd814198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fd80400e9f0 tx=0x7fd80400edf0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 shutdown_connections 2024-09-19T09:32:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd7fc0a32c0 0x7fd7fc0a5780 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd81410c180 0x7fd81419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8141036c0 0x7fd814198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 --2- 172.21.15.52:0/2570176486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd814102da0 0x7fd814198440 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 >> 172.21.15.52:0/2570176486 conn(0x7fd8140fc7a0 msgr2=0x7fd8140fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 shutdown_connections 2024-09-19T09:32:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:36.102+0000 7fd81a7ef640 1 -- 172.21.15.52:0/2570176486 wait complete. 2024-09-19T09:32:36.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:32:37.021 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:37 smithi052 ceph-mon[30947]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:37 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:37.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 -- 172.21.15.52:0/414175638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c102dd0 msgr2=0x7f9f2c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 --2- 172.21.15.52:0/414175638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c1031b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009930 tx=0x7f9f2802a420 comp rx=0 tx=0).stop 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 -- 172.21.15.52:0/414175638 shutdown_connections 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 --2- 172.21.15.52:0/414175638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 --2- 172.21.15.52:0/414175638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c103780 0x7f9f2c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 --2- 172.21.15.52:0/414175638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c1031b0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 -- 172.21.15.52:0/414175638 >> 172.21.15.52:0/414175638 conn(0x7f9f2c0fc7d0 msgr2=0x7f9f2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.522+0000 7f9f34160640 1 -- 172.21.15.52:0/414175638 shutdown_connections 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.523+0000 7f9f34160640 1 -- 172.21.15.52:0/414175638 wait complete. 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.523+0000 7f9f34160640 1 Processor -- start 2024-09-19T09:32:37.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.523+0000 7f9f34160640 1 -- start start 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1120b0 con 0x7f9f2c103780 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c111f30 con 0x7f9f2c102dd0 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f34160640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c112230 con 0x7f9f2c108300 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50834/0 (socket says 172.21.15.52:50834) 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 -- 172.21.15.52:0/1327782348 learned_addr learned my addr 172.21.15.52:0/1327782348 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f326fd640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 -- 172.21.15.52:0/1327782348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 msgr2=0x7f9f2c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 -- 172.21.15.52:0/1327782348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c102dd0 msgr2=0x7f9f2c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 -- 172.21.15.52:0/1327782348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c19d620 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f326fd640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.524+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00d950 tx=0x7f9f1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.525+0000 7f9f22ffd640 1 -- 172.21.15.52:0/1327782348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c017070 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.525+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c19d910 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.525+0000 7f9f22ffd640 1 -- 172.21.15.52:0/1327782348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f1c009c30 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.525+0000 7f9f22ffd640 1 -- 172.21.15.52:0/1327782348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0047a0 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.525+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c1a51f0 con 0x7f9f2c103780 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.527+0000 7f9f36539740 1 Processor -- start 2024-09-19T09:32:37.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.527+0000 7f9f22ffd640 1 -- 172.21.15.52:0/1327782348 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9f1c004020 con 0x7f9f2c103780 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 -- start start 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56068920b2f0 con 0x5606892a55d0 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5606891b2cf0 con 0x5606892a6b40 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f36539740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5606892072b0 con 0x5606892b0370 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50836/0 (socket says 172.21.15.52:50836) 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f31efc640 1 -- 172.21.15.52:0/428250912 learned_addr learned my addr 172.21.15.52:0/428250912 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f316fb640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 -- 172.21.15.52:0/428250912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 msgr2=0x5606892b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 -- 172.21.15.52:0/428250912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 msgr2=0x5606892a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f326fd640 1 -- 172.21.15.52:0/428250912 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606891973a0 con 0x5606892a6b40 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.528+0000 7f9f31efc640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f22ffd640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 0x7f9f180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f326fd640 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a5090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009f10 tx=0x7f9f240107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f72e79f03be04ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 0x7f9f180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f22ffd640 1 -- 172.21.15.52:0/1327782348 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f1c0cf660 con 0x7f9f2c103780 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f17fff640 1 -- 172.21.15.52:0/428250912 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2401c680 con 0x5606892a6b40 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f17fff640 1 -- 172.21.15.52:0/428250912 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2401cd00 con 0x5606892a6b40 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.529+0000 7f9f17fff640 1 -- 172.21.15.52:0/428250912 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2401a380 con 0x5606892a6b40 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- 172.21.15.52:0/428250912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 msgr2=0x5606892a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 0x7f9f180a5700 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f28006010 tx=0x7f9f280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a5090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009f10 tx=0x7f9f240107a0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- 172.21.15.52:0/428250912 shutdown_connections 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 --2- 172.21.15.52:0/428250912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a5090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- 172.21.15.52:0/428250912 >> 172.21.15.52:0/428250912 conn(0x56068926e310 msgr2=0x5606892a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- 172.21.15.52:0/428250912 shutdown_connections 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- 172.21.15.52:0/428250912 wait complete. 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 -- start start 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.530+0000 7f9f36539740 1 Processor -- start 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5606892b3070 con 0x5606892a6b40 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5606891c6060 con 0x5606892a55d0 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5606892b31f0 con 0x5606892b0370 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f36539740 10 client.0 _ll_register_callbacks cb 0x560688f198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50844/0 (socket says 172.21.15.52:50844) 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 -- 172.21.15.52:0/1163139259 learned_addr learned my addr 172.21.15.52:0/1163139259 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f326fd640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 -- 172.21.15.52:0/1163139259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 msgr2=0x5606892ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 -- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 msgr2=0x5606892afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f316fb640 1 -- 172.21.15.52:0/1163139259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560688f7c3c0 con 0x5606892a6b40 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.531+0000 7f9f326fd640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f316fb640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09b8a0 tx=0x7f9f1c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24af33d2c22a5b46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c09b970 con 0x5606892a6b40 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f1c098210 con 0x5606892a6b40 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2401cd00 con 0x5606892a6b40 2024-09-19T09:32:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f1c09b500 con 0x5606892a6b40 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 10 client.19320 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5606892beb50 con 0x5606892a6b40 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2401cd00 con 0x5606892a6b40 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9f1c0860b0 con 0x5606892a6b40 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 10 client.19320 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 10 client.19320 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 20 client.19320 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5606892c0010 0x5606892c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 4 client.19320 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.532+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560689218860 con 0x5606892c0010 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.533+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5606892c0010 0x5606892c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.533+0000 7f9f31efc640 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5606892c0010 0x5606892c2420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=521a34de24a23cfc server_cookie=c305f22f6aa9671e in_seq=0 out_seq=0 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.533+0000 7f9f157fa640 10 client.19320 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.533+0000 7f9f157fa640 1 -- 172.21.15.52:0/1163139259 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560689218860 con 0x5606892c0010 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f157fa640 10 client.19320 handle_command_reply: tid=0 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 client.19320 shutdown 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 msgr2=0x5606892ad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c09b8a0 tx=0x7f9f1c005d30 comp rx=0 tx=0).stop 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 shutdown_connections 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a6b40 0x5606892ad070 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5606892c0010 0x5606892c2420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 --2- 172.21.15.52:0/1163139259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f157fa640 0 client.19320 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 >> 172.21.15.52:0/1163139259 conn(0x56068926e310 msgr2=0x5606892a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 shutdown_connections 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 1 -- 172.21.15.52:0/1163139259 wait complete. 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.534+0000 7f9f36539740 20 client.19320 trim_cache size 0 max 16384 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 Processor -- start 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 -- start start 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892a8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1b00b0 con 0x5606892a55d0 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1ad980 con 0x5606892a6b40 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f36539740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1ab7d0 con 0x5606892b0370 2024-09-19T09:32:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.547+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50850/0 (socket says 172.21.15.52:50850) 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 -- 172.21.15.52:0/569405175 learned_addr learned my addr 172.21.15.52:0/569405175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f316fb640 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f326fd640 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 -- 172.21.15.52:0/569405175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 msgr2=0x5606892a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 -- 172.21.15.52:0/569405175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 msgr2=0x5606892a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 -- 172.21.15.52:0/569405175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606892a1ed0 con 0x5606892a55d0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f31efc640 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9f28004770 tx=0x7f9f2803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d41b4b6571b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f177fe640 1 -- 172.21.15.52:0/569405175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28035040 con 0x5606892a55d0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f177fe640 1 -- 172.21.15.52:0/569405175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f28004490 con 0x5606892a55d0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.548+0000 7f9f177fe640 1 -- 172.21.15.52:0/569405175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2803d450 con 0x5606892a55d0 2024-09-19T09:32:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- 172.21.15.52:0/569405175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 msgr2=0x5606892bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9f28004770 tx=0x7f9f2803f070 comp rx=0 tx=0).stop 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- 172.21.15.52:0/569405175 shutdown_connections 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892b0370 0x5606892a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a6b40 0x5606892a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 --2- 172.21.15.52:0/569405175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892a55d0 0x5606892bc310 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- 172.21.15.52:0/569405175 >> 172.21.15.52:0/569405175 conn(0x56068926e310 msgr2=0x5606892ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- 172.21.15.52:0/569405175 shutdown_connections 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- 172.21.15.52:0/569405175 wait complete. 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.549+0000 7f9f36539740 1 -- start start 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 Processor -- start 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892a6b40 0x5606892b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892b0370 0x5606892b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1abe40 con 0x5606892b0370 2024-09-19T09:32:37.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1ad2b0 con 0x5606892a55d0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c1ac510 con 0x5606892a6b40 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f36539740 10 client.0 _ll_register_callbacks cb 0x7f9f1c0d2d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47358/0 (socket says 172.21.15.52:47358) 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f326fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892b0370 0x5606892b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 -- 172.21.15.52:0/2585964665 learned_addr learned my addr 172.21.15.52:0/2585964665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f316fb640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892a6b40 0x5606892b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 -- 172.21.15.52:0/2585964665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892a6b40 msgr2=0x5606892b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892a6b40 0x5606892b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 -- 172.21.15.52:0/2585964665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892b0370 msgr2=0x5606892b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892b0370 0x5606892b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.550+0000 7f9f31efc640 1 -- 172.21.15.52:0/2585964665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606892b4720 con 0x5606892a55d0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f31efc640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f28005940 tx=0x7f9f28054c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=836a20e54b850389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:37.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f280545b0 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f28004490 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9f28059040 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9f28054750 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 10 client.28142 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56068932aa20 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f28004490 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9f2805d070 con 0x5606892a55d0 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 10 client.28142 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 10 client.28142 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 20 client.28142 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56068932b110 0x56068932d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:37.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 4 client.28142 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.551+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560689212d70 con 0x56068932b110 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f316fb640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56068932b110 0x56068932d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f157fa640 10 client.28142 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f316fb640 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56068932b110 0x56068932d530 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c0c4dd1e76259b8 server_cookie=54d8d96b7df3818 in_seq=0 out_seq=0 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f157fa640 1 -- 172.21.15.52:0/2585964665 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560689212d70 con 0x56068932b110 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f157fa640 10 client.28142 handle_command_reply: tid=0 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 client.28142 shutdown 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 msgr2=0x5606892b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f28005940 tx=0x7f9f28054c90 comp rx=0 tx=0).stop 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 shutdown_connections 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5606892b0370 0x5606892b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5606892a6b40 0x5606892b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x56068932b110 0x56068932d530 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 --2- 172.21.15.52:0/2585964665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5606892a55d0 0x5606892b8940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f157fa640 0 client.28142 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 >> 172.21.15.52:0/2585964665 conn(0x56068926e310 msgr2=0x5606892a04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 shutdown_connections 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.552+0000 7f9f36539740 1 -- 172.21.15.52:0/2585964665 wait complete. 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f36539740 20 client.28142 trim_cache size 0 max 16384 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:37.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 msgr2=0x7f9f180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 0x7f9f180a5700 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9f28006010 tx=0x7f9f280058d0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 msgr2=0x7f9f2c198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00d950 tx=0x7f9f1c00de10 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 shutdown_connections 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9f180a3240 0x7f9f180a5700 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f2c108300 0x7f9f2c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f2c103780 0x7f9f2c198bb0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 --2- 172.21.15.52:0/1327782348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f2c102dd0 0x7f9f2c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 >> 172.21.15.52:0/1327782348 conn(0x7f9f2c0fc7d0 msgr2=0x7f9f2c105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 shutdown_connections 2024-09-19T09:32:37.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:37.553+0000 7f9f34160640 1 -- 172.21.15.52:0/1327782348 wait complete. 2024-09-19T09:32:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:37 smithi169 ceph-mon[35454]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:37 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:37.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:37 smithi086 ceph-mon[34813]: pgmap v673: 97 pgs: 97 active+clean; 1.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:32:37.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:37 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:38.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:32:38.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:38 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.594 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:38.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:38 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:38.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:38 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 -- 172.21.15.52:0/2266135278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584101420 msgr2=0x7f958410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 --2- 172.21.15.52:0/2266135278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584101420 0x7f958410d950 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f957c009cd0 tx=0x7f957c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 -- 172.21.15.52:0/2266135278 shutdown_connections 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 --2- 172.21.15.52:0/2266135278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584101420 0x7f958410d950 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 --2- 172.21.15.52:0/2266135278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584100a80 0x7f9584100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 --2- 172.21.15.52:0/2266135278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9584106a80 0x7f9584106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 -- 172.21.15.52:0/2266135278 >> 172.21.15.52:0/2266135278 conn(0x7f95840fc7a0 msgr2=0x7f95840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 -- 172.21.15.52:0/2266135278 shutdown_connections 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 -- 172.21.15.52:0/2266135278 wait complete. 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.064+0000 7f958987c640 1 Processor -- start 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 -- start start 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584101420 0x7f95841996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9584106a80 0x7f95841a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9584110e80 con 0x7f9584100a80 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9584110d00 con 0x7f9584101420 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f958987c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9584111000 con 0x7f9584106a80 2024-09-19T09:32:39.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37350/0 (socket says 172.21.15.52:37350) 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 -- 172.21.15.52:0/1000114651 learned_addr learned my addr 172.21.15.52:0/1000114651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f95827fc640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584101420 0x7f95841996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 -- 172.21.15.52:0/1000114651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9584106a80 msgr2=0x7f95841a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9584106a80 0x7f95841a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 -- 172.21.15.52:0/1000114651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584101420 msgr2=0x7f95841996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584101420 0x7f95841996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 -- 172.21.15.52:0/1000114651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95841a4770 con 0x7f9584100a80 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.065+0000 7f9582ffd640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f957400c920 tx=0x7f957400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.066+0000 7f958887a640 1 -- 172.21.15.52:0/1000114651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574007c70 con 0x7f9584100a80 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.066+0000 7f958887a640 1 -- 172.21.15.52:0/1000114651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9574007e10 con 0x7f9584100a80 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.066+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95841a4940 con 0x7f9584100a80 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.066+0000 7f958887a640 1 -- 172.21.15.52:0/1000114651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574018890 con 0x7f9584100a80 2024-09-19T09:32:39.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.066+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95841a4e80 con 0x7f9584100a80 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958887a640 1 -- 172.21.15.52:0/1000114651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9574018a70 con 0x7f9584100a80 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 Processor -- start 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 -- start start 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72ece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559af724e2f0 con 0x559af72f7780 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559af71f5cf0 con 0x559af72edf50 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f958bc55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559af724a2b0 con 0x559af72ec9e0 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f95827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f95837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f9582ffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f95837fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:40210/0 (socket says 172.21.15.52:40210) 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.069+0000 7f95837fe640 1 -- 172.21.15.52:0/3688912243 learned_addr learned my addr 172.21.15.52:0/3688912243 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:39.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f958887a640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 0x7f956c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 -- 172.21.15.52:0/3688912243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 msgr2=0x559af72ece20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72ece20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 -- 172.21.15.52:0/3688912243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 msgr2=0x559af72ec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 -- 172.21.15.52:0/3688912243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af71da3a0 con 0x559af72f7780 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95837fe640 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f958887a640 1 -- 172.21.15.52:0/1000114651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f95740cfb10 con 0x7f9584100a80 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95837fe640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 0x7f956c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f95827fc640 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9b70 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f95780058c0 tx=0x7f957800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00e17dfba4d9a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f9569ffb640 1 -- 172.21.15.52:0/3688912243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578004020 con 0x559af72f7780 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f9569ffb640 1 -- 172.21.15.52:0/3688912243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95780041c0 con 0x559af72f7780 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.070+0000 7f9569ffb640 1 -- 172.21.15.52:0/3688912243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780107d0 con 0x559af72f7780 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- 172.21.15.52:0/3688912243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 msgr2=0x559af72f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f95837fe640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 0x7f956c0a5700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f957c006010 tx=0x7f957c031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9b70 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f95780058c0 tx=0x7f957800e350 comp rx=0 tx=0).stop 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- 172.21.15.52:0/3688912243 shutdown_connections 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9b70 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72ece20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 --2- 172.21.15.52:0/3688912243 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- 172.21.15.52:0/3688912243 >> 172.21.15.52:0/3688912243 conn(0x559af72b1310 msgr2=0x559af72e9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- 172.21.15.52:0/3688912243 shutdown_connections 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- 172.21.15.52:0/3688912243 wait complete. 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.071+0000 7f958bc55740 1 -- start start 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 Processor -- start 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 0x559af72f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559af72fa480 con 0x559af72ec9e0 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559af7209060 con 0x559af72edf50 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559af72fa600 con 0x559af72f7780 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f9582ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f958bc55740 10 client.0 _ll_register_callbacks cb 0x559af6f5c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f9582ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37370/0 (socket says 172.21.15.52:37370) 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f9582ffd640 1 -- 172.21.15.52:0/4077634270 learned_addr learned my addr 172.21.15.52:0/4077634270 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f95827fc640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f95837fe640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 0x559af72f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f9582ffd640 1 -- 172.21.15.52:0/4077634270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 msgr2=0x559af72f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.072+0000 7f9582ffd640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 0x559af72f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9582ffd640 1 -- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 msgr2=0x559af72f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9582ffd640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9582ffd640 1 -- 172.21.15.52:0/4077634270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af6fbf3c0 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f95837fe640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 0x559af72f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9582ffd640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9574098510 tx=0x7f957409bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff00a7498bcf1119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740d5070 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9574018d60 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95780041c0 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f957409c0b0 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f958bc55740 10 client.19338 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559af7305f40 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95780041c0 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.073+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9574098720 con 0x559af72ec9e0 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 10 client.19338 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 10 client.19338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 20 client.19338 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:39.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af7307350 0x559af7309760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 4 client.19338 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559af725b860 con 0x559af7307350 2024-09-19T09:32:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f95827fc640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af7307350 0x559af7309760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f95827fc640 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af7307350 0x559af7309760 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c39dab663a58ea server_cookie=c3b198a572762990 in_seq=0 out_seq=0 2024-09-19T09:32:39.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.074+0000 7f9562ffd640 10 client.19338 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f9562ffd640 1 -- 172.21.15.52:0/4077634270 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559af725b860 con 0x559af7307350 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f9562ffd640 10 client.19338 handle_command_reply: tid=0 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 client.19338 shutdown 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 msgr2=0x559af72f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9574098510 tx=0x7f957409bf00 comp rx=0 tx=0).stop 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 shutdown_connections 2024-09-19T09:32:39.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af7307350 0x559af7309760 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72f7780 0x559af72f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 --2- 172.21.15.52:0/4077634270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72ec9e0 0x559af72f70d0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 >> 172.21.15.52:0/4077634270 conn(0x559af72b1310 msgr2=0x559af72eed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f9562ffd640 0 client.19338 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 shutdown_connections 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.075+0000 7f958bc55740 1 -- 172.21.15.52:0/4077634270 wait complete. 2024-09-19T09:32:39.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.076+0000 7f958bc55740 20 client.19338 trim_cache size 0 max 16384 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 Processor -- start 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 -- start start 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 0x559af7303720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72edf50 0x559af7309360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95841ade60 con 0x559af72f7780 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f95841ab730 con 0x559af72ec9e0 2024-09-19T09:32:39.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.088+0000 7f958bc55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95841a9580 con 0x559af72edf50 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37384/0 (socket says 172.21.15.52:37384) 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 -- 172.21.15.52:0/616701376 learned_addr learned my addr 172.21.15.52:0/616701376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f9582ffd640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 0x559af7303720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95827fc640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72edf50 0x559af7309360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 -- 172.21.15.52:0/616701376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72edf50 msgr2=0x559af7309360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72edf50 0x559af7309360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 -- 172.21.15.52:0/616701376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 msgr2=0x559af7303720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 0x559af7303720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 -- 172.21.15.52:0/616701376 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af72ed940 con 0x559af72f7780 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f9582ffd640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 0x559af7303720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95837fe640 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f957c009dc0 tx=0x7f957c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d864b8481786acd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95697fa640 1 -- 172.21.15.52:0/616701376 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c004300 con 0x559af72f7780 2024-09-19T09:32:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95697fa640 1 -- 172.21.15.52:0/616701376 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f957c036040 con 0x559af72f7780 2024-09-19T09:32:39.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.089+0000 7f95697fa640 1 -- 172.21.15.52:0/616701376 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c03d420 con 0x559af72f7780 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- 172.21.15.52:0/616701376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 msgr2=0x559af72f8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f957c009dc0 tx=0x7f957c040000 comp rx=0 tx=0).stop 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- 172.21.15.52:0/616701376 shutdown_connections 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f8b70 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72edf50 0x559af7309360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 --2- 172.21.15.52:0/616701376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72ec9e0 0x559af7303720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- 172.21.15.52:0/616701376 >> 172.21.15.52:0/616701376 conn(0x559af72b1310 msgr2=0x559af72ef720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- 172.21.15.52:0/616701376 shutdown_connections 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- 172.21.15.52:0/616701376 wait complete. 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.090+0000 7f958bc55740 1 -- start start 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 Processor -- start 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95841a9bf0 con 0x559af72f7780 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f95841ab060 con 0x559af72edf50 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f95841aa2c0 con 0x559af72ec9e0 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f958bc55740 10 client.0 _ll_register_callbacks cb 0x7f957400c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37400/0 (socket says 172.21.15.52:37400) 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95827fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 -- 172.21.15.52:0/3005166480 learned_addr learned my addr 172.21.15.52:0/3005166480 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f9582ffd640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 -- 172.21.15.52:0/3005166480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 msgr2=0x559af72f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 -- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 msgr2=0x559af72f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.091+0000 7f95837fe640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f95837fe640 1 -- 172.21.15.52:0/3005166480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af72ef530 con 0x559af72f7780 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f9582ffd640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f95837fe640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f957c031eb0 tx=0x7f957c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e085beb9586fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f9562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c004510 con 0x559af72f7780 2024-09-19T09:32:39.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f957c0046b0 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f957c036040 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f957c05f030 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f958bc55740 10 client.19344 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.092+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559af7372090 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f957c036040 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f957c030070 con 0x559af72f7780 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 10 client.19344 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 10 client.19344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 20 client.19344 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af73727a0 0x559af7374b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 4 client.19344 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559af7255d70 con 0x559af73727a0 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f9582ffd640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af73727a0 0x559af7374b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f9582ffd640 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af73727a0 0x559af7374b90 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27a2522b852bb72 server_cookie=59dc792f4bbfb901 in_seq=0 out_seq=0 2024-09-19T09:32:39.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.093+0000 7f9562ffd640 10 client.19344 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f9562ffd640 1 -- 172.21.15.52:0/3005166480 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559af7255d70 con 0x559af73727a0 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f9562ffd640 10 client.19344 handle_command_reply: tid=0 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 client.19344 shutdown 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 msgr2=0x559af72f9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f957c031eb0 tx=0x7f957c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 shutdown_connections 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559af73727a0 0x559af7374b90 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559af72f7780 0x559af72f9730 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559af72edf50 0x559af72f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 --2- 172.21.15.52:0/3005166480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559af72ec9e0 0x559af72f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 >> 172.21.15.52:0/3005166480 conn(0x559af72b1310 msgr2=0x559af72ee520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f9562ffd640 0 client.19344 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:39.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 shutdown_connections 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 1 -- 172.21.15.52:0/3005166480 wait complete. 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.094+0000 7f958bc55740 20 client.19344 trim_cache size 0 max 16384 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 msgr2=0x7f956c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 0x7f956c0a5700 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f957c006010 tx=0x7f957c031430 comp rx=0 tx=0).stop 2024-09-19T09:32:39.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 msgr2=0x7f95841991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f957400c920 tx=0x7f957400cde0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 shutdown_connections 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f956c0a3240 0x7f956c0a5700 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9584106a80 0x7f95841a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9584101420 0x7f95841996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 --2- 172.21.15.52:0/1000114651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9584100a80 0x7f95841991b0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 >> 172.21.15.52:0/1000114651 conn(0x7f95840fc7a0 msgr2=0x7f95840fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 shutdown_connections 2024-09-19T09:32:39.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:39.095+0000 7f958987c640 1 -- 172.21.15.52:0/1000114651 wait complete. 2024-09-19T09:32:39.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:39 smithi052 ceph-mon[30947]: pgmap v674: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:39.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:39 smithi169 ceph-mon[35454]: pgmap v674: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:39.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:39 smithi086 ceph-mon[34813]: pgmap v674: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:32:40.913 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:32:40.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:32:41.185 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:41.591 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:41 smithi052 ceph-mon[30947]: pgmap v675: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:41.692 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:41 smithi169 ceph-mon[35454]: pgmap v675: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:41.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 -- 172.21.15.52:0/2763772337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 msgr2=0x7f408c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 --2- 172.21.15.52:0/2763772337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c106e60 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f407c009930 tx=0x7f407c02a420 comp rx=0 tx=0).stop 2024-09-19T09:32:41.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 -- 172.21.15.52:0/2763772337 shutdown_connections 2024-09-19T09:32:41.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 --2- 172.21.15.52:0/2763772337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c101420 0x7f408c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 --2- 172.21.15.52:0/2763772337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c100a80 0x7f408c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 --2- 172.21.15.52:0/2763772337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c106e60 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 -- 172.21.15.52:0/2763772337 >> 172.21.15.52:0/2763772337 conn(0x7f408c0fc7a0 msgr2=0x7f408c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 -- 172.21.15.52:0/2763772337 shutdown_connections 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.677+0000 7f4091ac9640 1 -- 172.21.15.52:0/2763772337 wait complete. 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 Processor -- start 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 -- start start 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c100a80 0x7f408c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c101420 0x7f408c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f408c110e40 con 0x7f408c106a80 2024-09-19T09:32:41.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f408c110cc0 con 0x7f408c101420 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.678+0000 7f4091ac9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f408c110fc0 con 0x7f408c100a80 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37420/0 (socket says 172.21.15.52:37420) 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 -- 172.21.15.52:0/634342972 learned_addr learned my addr 172.21.15.52:0/634342972 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408b7fe640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c100a80 0x7f408c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408affd640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c101420 0x7f408c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 -- 172.21.15.52:0/634342972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c100a80 msgr2=0x7f408c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c100a80 0x7f408c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 -- 172.21.15.52:0/634342972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c101420 msgr2=0x7f408c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c101420 0x7f408c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 -- 172.21.15.52:0/634342972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408c19d3c0 con 0x7f408c106a80 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f408bfff640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f408400eaa0 tx=0x7f408400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f4088ff9640 1 -- 172.21.15.52:0/634342972 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408400cdb0 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408c19d6b0 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f4088ff9640 1 -- 172.21.15.52:0/634342972 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4084005020 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f4088ff9640 1 -- 172.21.15.52:0/634342972 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40840116b0 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.679+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408c1a4f90 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4088ff9640 1 -- 172.21.15.52:0/634342972 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4084005560 con 0x7f408c106a80 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 Processor -- start 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 -- start start 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55aacf3ff280 con 0x55aacf499b60 2024-09-19T09:32:41.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55aacf3a6b10 con 0x55aacf4a4d40 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4093ea2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aacf3fb240 con 0x55aacf49a480 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f4088ff9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 0x7f40740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.682+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408bfff640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 0x7f40740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37430/0 (socket says 172.21.15.52:37430) 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408affd640 1 -- 172.21.15.52:0/1690542220 learned_addr learned my addr 172.21.15.52:0/1690542220 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f4088ff9640 1 -- 172.21.15.52:0/634342972 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f40840cfad0 con 0x7f408c106a80 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 -- 172.21.15.52:0/1690542220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 msgr2=0x55aacf4a7130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:32:41.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a7130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 -- 172.21.15.52:0/1690542220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 msgr2=0x55aacf499f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 -- 172.21.15.52:0/1690542220 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aacf3b31f0 con 0x55aacf49a480 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408affd640 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408bfff640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 0x7f40740a5700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4084098af0 tx=0x7f40840bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a4800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f407c005940 tx=0x7f407c005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=998f282f24f4554a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.683+0000 7f4071ffb640 1 -- 172.21.15.52:0/1690542220 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c040070 con 0x55aacf49a480 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4071ffb640 1 -- 172.21.15.52:0/1690542220 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c0319f0 con 0x55aacf49a480 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4071ffb640 1 -- 172.21.15.52:0/1690542220 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c035040 con 0x55aacf49a480 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 -- 172.21.15.52:0/1690542220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 msgr2=0x55aacf4a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a4800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f407c005940 tx=0x7f407c005c00 comp rx=0 tx=0).stop 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 -- 172.21.15.52:0/1690542220 shutdown_connections 2024-09-19T09:32:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a4800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1690542220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf499f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 -- 172.21.15.52:0/1690542220 >> 172.21.15.52:0/1690542220 conn(0x55aacf4960f0 msgr2=0x55aacf4964d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 -- 172.21.15.52:0/1690542220 shutdown_connections 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.684+0000 7f4093ea2740 1 -- 172.21.15.52:0/1690542220 wait complete. 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 -- start start 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 Processor -- start 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55aacf4a7910 con 0x55aacf499b60 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55aacf3b9f10 con 0x55aacf4a4d40 2024-09-19T09:32:41.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55aacf4a7a90 con 0x55aacf49a480 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f4093ea2740 10 client.0 _ll_register_callbacks cb 0x55aacf382a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37446/0 (socket says 172.21.15.52:37446) 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f408affd640 1 -- 172.21.15.52:0/2730210910 learned_addr learned my addr 172.21.15.52:0/2730210910 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.685+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 -- 172.21.15.52:0/2730210910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 msgr2=0x55aacf4a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 -- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 msgr2=0x55aacf4a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 -- 172.21.15.52:0/2730210910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aacf1706a0 con 0x55aacf499b60 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f408affd640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f408000bf40 tx=0x7f4080004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a352fbe2b05758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f406affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080011990 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4080011b30 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f407c0319f0 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4080010460 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f4093ea2740 10 client.19356 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aacf4b3570 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.686+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c0319f0 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f408000f770 con 0x55aacf499b60 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 10 client.19356 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 10 client.19356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 20 client.19356 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf4b4980 0x55aacf4b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 4 client.19356 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aacf40c7f0 con 0x55aacf4b4980 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf4b4980 0x55aacf4b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f406affd640 10 client.19356 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.687+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf4b4980 0x55aacf4b6d70 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e45fccdb0bac85 server_cookie=84f1753bfccbeb41 in_seq=0 out_seq=0 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f406affd640 1 -- 172.21.15.52:0/2730210910 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aacf40c7f0 con 0x55aacf4b4980 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f406affd640 10 client.19356 handle_command_reply: tid=0 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 client.19356 shutdown 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 msgr2=0x55aacf4a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f408000bf40 tx=0x7f4080004210 comp rx=0 tx=0).stop 2024-09-19T09:32:41.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 shutdown_connections 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf4b4980 0x55aacf4b6d70 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf4a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf4a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2730210910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf4a1c20 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f406affd640 0 client.19356 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 >> 172.21.15.52:0/2730210910 conn(0x55aacf4960f0 msgr2=0x55aacf49be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 shutdown_connections 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.688+0000 7f4093ea2740 1 -- 172.21.15.52:0/2730210910 wait complete. 2024-09-19T09:32:41.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.689+0000 7f4093ea2740 20 client.19356 trim_cache size 0 max 16384 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 Processor -- start 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 -- start start 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 0x55aacf4a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf4a4d40 0x55aacf4bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1b0060 con 0x55aacf49a480 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1ad930 con 0x55aacf499b60 2024-09-19T09:32:41.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f4093ea2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1ab780 con 0x55aacf4a4d40 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f408b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f408b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37448/0 (socket says 172.21.15.52:37448) 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f408b7fe640 1 -- 172.21.15.52:0/1621117469 learned_addr learned my addr 172.21.15.52:0/1621117469 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.706+0000 7f408affd640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 0x55aacf4a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408affd640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf4a4d40 0x55aacf4bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 -- 172.21.15.52:0/1621117469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf4a4d40 msgr2=0x55aacf4bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf4a4d40 0x55aacf4bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 -- 172.21.15.52:0/1621117469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 msgr2=0x55aacf4a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 0x55aacf4a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 -- 172.21.15.52:0/1621117469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aacf4a4200 con 0x55aacf49a480 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408affd640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 0x55aacf4a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f408b7fe640 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f407c005940 tx=0x7f407c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86b28b424d0ec09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f40717fa640 1 -- 172.21.15.52:0/1621117469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c040050 con 0x55aacf49a480 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f40717fa640 1 -- 172.21.15.52:0/1621117469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c009520 con 0x55aacf49a480 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.707+0000 7f40717fa640 1 -- 172.21.15.52:0/1621117469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c035040 con 0x55aacf49a480 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- 172.21.15.52:0/1621117469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 msgr2=0x55aacf4a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f407c005940 tx=0x7f407c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- 172.21.15.52:0/1621117469 shutdown_connections 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf4a4d40 0x55aacf4bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf49a480 0x55aacf4a0ad0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 --2- 172.21.15.52:0/1621117469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf499b60 0x55aacf4a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- 172.21.15.52:0/1621117469 >> 172.21.15.52:0/1621117469 conn(0x55aacf4960f0 msgr2=0x55aacf4a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- 172.21.15.52:0/1621117469 shutdown_connections 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- 172.21.15.52:0/1621117469 wait complete. 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.708+0000 7f4093ea2740 1 -- start start 2024-09-19T09:32:41.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 Processor -- start 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf49f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf49f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1abdf0 con 0x55aacf499b60 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1ad260 con 0x55aacf4a4d40 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f408c1ac4c0 con 0x55aacf49a480 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f4093ea2740 10 client.0 _ll_register_callbacks cb 0x7f408000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37450/0 (socket says 172.21.15.52:37450) 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 -- 172.21.15.52:0/2508439672 learned_addr learned my addr 172.21.15.52:0/2508439672 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf49f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf49f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 -- 172.21.15.52:0/2508439672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 msgr2=0x55aacf49f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf49f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 -- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 msgr2=0x55aacf49f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf49f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 -- 172.21.15.52:0/2508439672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aacf4ab180 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f408affd640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f408000bf40 tx=0x7f408000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637f743c7b543d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.709+0000 7f406affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080005460 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f407c009520 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f408000f3c0 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f408000f5c0 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 10 client.19362 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55aacf527f90 con 0x55aacf499b60 2024-09-19T09:32:41.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c009520 con 0x55aacf499b60 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4080037030 con 0x55aacf499b60 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 10 client.19362 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 10 client.19362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 20 client.19362 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf528730 0x55aacf52ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 4 client.19362 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.710+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aacf406d00 con 0x55aacf528730 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.711+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf528730 0x55aacf52ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.711+0000 7f408b7fe640 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf528730 0x55aacf52ab50 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df193e42682b7c0e server_cookie=f04b69780cc8ad4e in_seq=0 out_seq=0 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.711+0000 7f406affd640 10 client.19362 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f406affd640 1 -- 172.21.15.52:0/2508439672 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aacf406d00 con 0x55aacf528730 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f406affd640 10 client.19362 handle_command_reply: tid=0 2024-09-19T09:32:41.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 client.19362 shutdown 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 msgr2=0x55aacf49ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f408000bf40 tx=0x7f408000b8f0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 shutdown_connections 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55aacf528730 0x55aacf52ab50 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55aacf4a4d40 0x55aacf49f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55aacf49a480 0x55aacf49f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 --2- 172.21.15.52:0/2508439672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55aacf499b60 0x55aacf49ebd0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 >> 172.21.15.52:0/2508439672 conn(0x55aacf4960f0 msgr2=0x55aacf4a0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f406affd640 0 client.19362 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.712+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 shutdown_connections 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4093ea2740 1 -- 172.21.15.52:0/2508439672 wait complete. 2024-09-19T09:32:41.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4093ea2740 20 client.19362 trim_cache size 0 max 16384 2024-09-19T09:32:41.722 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:41.722 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:32:41.722 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "ba00f3b1-5729-4326-a8d7-8db80ba96eb4", 2024-09-19T09:32:41.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:32:41.722 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 msgr2=0x7f40740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 0x7f40740a5700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4084098af0 tx=0x7f40840bc040 comp rx=0 tx=0).stop 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 msgr2=0x7f408c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f408400eaa0 tx=0x7f408400ef60 comp rx=0 tx=0).stop 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 shutdown_connections 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f408c106a80 0x7f408c19cce0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f408c101420 0x7f408c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f40740a3240 0x7f40740a5700 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 --2- 172.21.15.52:0/634342972 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f408c100a80 0x7f408c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 >> 172.21.15.52:0/634342972 conn(0x7f408c0fc7a0 msgr2=0x7f408c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 shutdown_connections 2024-09-19T09:32:41.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:41.713+0000 7f4091ac9640 1 -- 172.21.15.52:0/634342972 wait complete. 2024-09-19T09:32:41.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:41 smithi086 ceph-mon[34813]: pgmap v675: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:32:42.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:32:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:43.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- 172.21.15.52:0/684174990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 msgr2=0x7f9b141150b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/684174990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b141150b0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009ca0 tx=0x7f9b0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- 172.21.15.52:0/684174990 shutdown_connections 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/684174990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b141150b0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/684174990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 0x7f9b1410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/684174990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 0x7f9b14108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- 172.21.15.52:0/684174990 >> 172.21.15.52:0/684174990 conn(0x7f9b14077ba0 msgr2=0x7f9b14079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- 172.21.15.52:0/684174990 shutdown_connections 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- 172.21.15.52:0/684174990 wait complete. 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 Processor -- start 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.325+0000 7f9b1bb43640 1 -- start start 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 0x7f9b141a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 0x7f9b141a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141185d0 con 0x7f9b1410d530 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14118450 con 0x7f9b14108e00 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1bb43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14118750 con 0x7f9b14108450 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37482/0 (socket says 172.21.15.52:37482) 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 -- 172.21.15.52:0/2053607982 learned_addr learned my addr 172.21.15.52:0/2053607982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b198df640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 0x7f9b141a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b190de640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 0x7f9b141a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 -- 172.21.15.52:0/2053607982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 msgr2=0x7f9b141a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 0x7f9b141a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 -- 172.21.15.52:0/2053607982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 msgr2=0x7f9b141a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 0x7f9b141a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 -- 172.21.15.52:0/2053607982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1419ef90 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.326+0000 7f9b1a0e0640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c031a20 tx=0x7f9b0c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.327+0000 7f9b0affd640 1 -- 172.21.15.52:0/2053607982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c003c30 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.327+0000 7f9b0affd640 1 -- 172.21.15.52:0/2053607982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b0c003dd0 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.327+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1419f220 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.327+0000 7f9b0affd640 1 -- 172.21.15.52:0/2053607982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c02fc40 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.327+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141ab570 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.329+0000 7f9b0affd640 1 -- 172.21.15.52:0/2053607982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9b0c004050 con 0x7f9b1410d530 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.329+0000 7f9b1df1c740 1 Processor -- start 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.329+0000 7f9b1df1c740 1 -- start start 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be73e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be740a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5590be6992e0 con 0x5590be7334a0 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5590be640ce0 con 0x5590be73e680 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5590be6952a0 con 0x5590be733dc0 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37486/0 (socket says 172.21.15.52:37486) 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 -- 172.21.15.52:0/4091223890 learned_addr learned my addr 172.21.15.52:0/4091223890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b198df640 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be73e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b0affd640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 0x7f9b000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be740a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 -- 172.21.15.52:0/4091223890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 msgr2=0x5590be73e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be73e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 -- 172.21.15.52:0/4091223890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 msgr2=0x5590be740a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be740a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 -- 172.21.15.52:0/4091223890 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590be625440 con 0x5590be7334a0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b1a0e0640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 0x7f9b000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9b0affd640 1 -- 172.21.15.52:0/2053607982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9b0c0f0c50 con 0x7f9b1410d530 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.330+0000 7f9b190de640 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f9b04006e10 tx=0x7f9b0400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83dd3f76559b638 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9afffff640 1 -- 172.21.15.52:0/4091223890 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0401a070 con 0x5590be7334a0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9afffff640 1 -- 172.21.15.52:0/4091223890 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b04010040 con 0x5590be7334a0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9afffff640 1 -- 172.21.15.52:0/4091223890 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04013570 con 0x5590be7334a0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9b1df1c740 1 -- 172.21.15.52:0/4091223890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 msgr2=0x5590be733880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9b1a0e0640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 0x7f9b000a5780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0b9680 tx=0x7f9b0c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f9b04006e10 tx=0x7f9b0400b400 comp rx=0 tx=0).stop 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.331+0000 7f9b1df1c740 1 -- 172.21.15.52:0/4091223890 shutdown_connections 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be740a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be73e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/4091223890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be733880 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 -- 172.21.15.52:0/4091223890 >> 172.21.15.52:0/4091223890 conn(0x5590be72fa30 msgr2=0x5590be72fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 -- 172.21.15.52:0/4091223890 shutdown_connections 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 -- 172.21.15.52:0/4091223890 wait complete. 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 -- start start 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 Processor -- start 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.332+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 0x5590be73b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be73e680 0x5590be73b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5590be741250 con 0x5590be7334a0 2024-09-19T09:32:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5590be654050 con 0x5590be733dc0 2024-09-19T09:32:43.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5590be7413d0 con 0x5590be73e680 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 10 client.0 _ll_register_callbacks cb 0x5590be694160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37502/0 (socket says 172.21.15.52:37502) 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 -- 172.21.15.52:0/566524730 learned_addr learned my addr 172.21.15.52:0/566524730 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be73e680 0x5590be73b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b198df640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 0x5590be73b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 -- 172.21.15.52:0/566524730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be73e680 msgr2=0x5590be73b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be73e680 0x5590be73b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 -- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 msgr2=0x5590be73b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 0x5590be73b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 -- 172.21.15.52:0/566524730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590be40a3c0 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b198df640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 0x5590be73b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b190de640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c010 tx=0x7f9b04015f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d8e2733893ec7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0401a040 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9b04015900 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.333+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b04010040 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b04023420 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 10 client.19374 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5590be74ccb0 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b04010040 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9b04020070 con 0x5590be7334a0 2024-09-19T09:32:43.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 10 client.19374 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 10 client.19374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 20 client.19374 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be74e060 0x5590be750450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 4 client.19374 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590be6a6850 con 0x5590be74e060 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.334+0000 7f9b198df640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be74e060 0x5590be750450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9afd7fa640 10 client.19374 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9b198df640 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be74e060 0x5590be750450 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95747480cb4a1523 server_cookie=f5bf2d9d5d9e963d in_seq=0 out_seq=0 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9afd7fa640 1 -- 172.21.15.52:0/566524730 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590be6a6850 con 0x5590be74e060 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9afd7fa640 10 client.19374 handle_command_reply: tid=0 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9b1df1c740 1 client.19374 shutdown 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 msgr2=0x5590be73e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.335+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c010 tx=0x7f9b04015f20 comp rx=0 tx=0).stop 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 shutdown_connections 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be74e060 0x5590be750450 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be73e680 0x5590be73b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be733dc0 0x5590be73b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/566524730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be73e070 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 >> 172.21.15.52:0/566524730 conn(0x5590be72fa30 msgr2=0x5590be735760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9afd7fa640 0 client.19374 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 shutdown_connections 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 1 -- 172.21.15.52:0/566524730 wait complete. 2024-09-19T09:32:43.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.336+0000 7f9b1df1c740 20 client.19374 trim_cache size 0 max 16384 2024-09-19T09:32:43.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.353+0000 7f9b1df1c740 1 Processor -- start 2024-09-19T09:32:43.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.353+0000 7f9b1df1c740 1 -- start start 2024-09-19T09:32:43.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be755b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be756040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b6680 con 0x5590be7334a0 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b3f50 con 0x5590be73e680 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b1da0 con 0x5590be733dc0 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37510/0 (socket says 172.21.15.52:37510) 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 -- 172.21.15.52:0/1356981104 learned_addr learned my addr 172.21.15.52:0/1356981104 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b198df640 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be755b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 -- 172.21.15.52:0/1356981104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 msgr2=0x5590be755b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be755b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 -- 172.21.15.52:0/1356981104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 msgr2=0x5590be756040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be756040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 -- 172.21.15.52:0/1356981104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590be740de0 con 0x5590be7334a0 2024-09-19T09:32:43.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.354+0000 7f9b190de640 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400bb90 tx=0x7f9b04004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d65e9cdc61b765c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9aff7fe640 1 -- 172.21.15.52:0/1356981104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400f9e0 con 0x5590be7334a0 2024-09-19T09:32:43.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9aff7fe640 1 -- 172.21.15.52:0/1356981104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b04028070 con 0x5590be7334a0 2024-09-19T09:32:43.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9aff7fe640 1 -- 172.21.15.52:0/1356981104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040235c0 con 0x5590be7334a0 2024-09-19T09:32:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1356981104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 msgr2=0x5590be72f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400bb90 tx=0x7f9b04004660 comp rx=0 tx=0).stop 2024-09-19T09:32:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1356981104 shutdown_connections 2024-09-19T09:32:43.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be73e680 0x5590be756040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be755b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1356981104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be7334a0 0x5590be72f380 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1356981104 >> 172.21.15.52:0/1356981104 conn(0x5590be72fa30 msgr2=0x5590be73d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1356981104 shutdown_connections 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.355+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1356981104 wait complete. 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 -- start start 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 Processor -- start 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be7334a0 0x5590be746d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be7440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b2410 con 0x5590be73e680 2024-09-19T09:32:43.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b3880 con 0x5590be7334a0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141b2ae0 con 0x5590be733dc0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b1df1c740 10 client.0 _ll_register_callbacks cb 0x7f9b04018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b190de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37526/0 (socket says 172.21.15.52:37526) 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b190de640 1 -- 172.21.15.52:0/1366679372 learned_addr learned my addr 172.21.15.52:0/1366679372 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.356+0000 7f9b190de640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be7334a0 0x5590be746d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b198df640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be7440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 -- 172.21.15.52:0/1366679372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 msgr2=0x5590be7440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be7440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 -- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be7334a0 msgr2=0x5590be746d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be7334a0 0x5590be746d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 -- 172.21.15.52:0/1366679372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590be73bc80 con 0x5590be73e680 2024-09-19T09:32:43.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b190de640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b480 tx=0x7f9b04025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f259b25f743838d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9afd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0401a070 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9b04021e10 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b04028070 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b040235c0 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b1df1c740 10 client.19380 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.357+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5590be7b8920 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b04028070 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9b0404c070 con 0x5590be73e680 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 10 client.19380 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 10 client.19380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:43.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 20 client.19380 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be7b8f20 0x5590be7bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 4 client.19380 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590be6a0d60 con 0x5590be7b8f20 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.358+0000 7f9b198df640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be7b8f20 0x5590be7bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b198df640 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be7b8f20 0x5590be7bb310 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b87d17335726cd8 server_cookie=baec388de93bcff9 in_seq=0 out_seq=0 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9afd7fa640 10 client.19380 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9afd7fa640 1 -- 172.21.15.52:0/1366679372 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5590be6a0d60 con 0x5590be7b8f20 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9afd7fa640 10 client.19380 handle_command_reply: tid=0 2024-09-19T09:32:43.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 client.19380 shutdown 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 msgr2=0x5590be7445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b480 tx=0x7f9b04025040 comp rx=0 tx=0).stop 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 shutdown_connections 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5590be7b8f20 0x5590be7bb310 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5590be73e680 0x5590be7445e0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5590be733dc0 0x5590be7440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9afd7fa640 0 client.19380 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 --2- 172.21.15.52:0/1366679372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5590be7334a0 0x5590be746d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 >> 172.21.15.52:0/1366679372 conn(0x5590be72fa30 msgr2=0x5590be72e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 shutdown_connections 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 1 -- 172.21.15.52:0/1366679372 wait complete. 2024-09-19T09:32:43.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.359+0000 7f9b1df1c740 20 client.19380 trim_cache size 0 max 16384 2024-09-19T09:32:43.366 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:43.366 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:32:43.366 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:32:43.366 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 msgr2=0x7f9b000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 0x7f9b000a5780 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0b9680 tx=0x7f9b0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 msgr2=0x7f9b1419e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c031a20 tx=0x7f9b0c031a50 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 shutdown_connections 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b1410d530 0x7f9b1419e860 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b14108e00 0x7f9b141a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9b000a32c0 0x7f9b000a5780 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 --2- 172.21.15.52:0/2053607982 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b14108450 0x7f9b141a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 >> 172.21.15.52:0/2053607982 conn(0x7f9b14077ba0 msgr2=0x7f9b14079f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 shutdown_connections 2024-09-19T09:32:43.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:43.360+0000 7f9b1bb43640 1 -- 172.21.15.52:0/2053607982 wait complete. 2024-09-19T09:32:43.671 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:43 smithi052 ceph-mon[30947]: pgmap v676: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:43.671 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:43 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:32:43.671 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:43 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:43.671 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:43 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:32:43.671 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:43 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:43 smithi169 ceph-mon[35454]: pgmap v676: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:43 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:32:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:43 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:43 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:32:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:43 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:43 smithi086 ceph-mon[34813]: pgmap v676: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:32:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:43 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:32:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:43 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:43 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:32:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:43 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- 172.21.15.52:0/393989569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158103710 msgr2=0x7fc158109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 --2- 172.21.15.52:0/393989569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158103710 0x7fc158109fa0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc15002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- 172.21.15.52:0/393989569 shutdown_connections 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 --2- 172.21.15.52:0/393989569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158103710 0x7fc158109fa0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 --2- 172.21.15.52:0/393989569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158102d50 0x7fc1581031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 --2- 172.21.15.52:0/393989569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158101b60 0x7fc158101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- 172.21.15.52:0/393989569 >> 172.21.15.52:0/393989569 conn(0x7fc1580fd2e0 msgr2=0x7fc1580ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- 172.21.15.52:0/393989569 shutdown_connections 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- 172.21.15.52:0/393989569 wait complete. 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 Processor -- start 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.103+0000 7fc160503640 1 -- start start 2024-09-19T09:32:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158102d50 0x7fc158198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158103710 0x7fc15819f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc15810d810 con 0x7fc158101b60 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc15810d690 con 0x7fc158102d50 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc160503640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc15810d990 con 0x7fc158103710 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37538/0 (socket says 172.21.15.52:37538) 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 -- 172.21.15.52:0/2252147290 learned_addr learned my addr 172.21.15.52:0/2252147290 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15da9e640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158102d50 0x7fc158198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158103710 0x7fc15819f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 -- 172.21.15.52:0/2252147290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158103710 msgr2=0x7fc15819f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158103710 0x7fc15819f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 -- 172.21.15.52:0/2252147290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158102d50 msgr2=0x7fc158198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158102d50 0x7fc158198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 -- 172.21.15.52:0/2252147290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15819f960 con 0x7fc158101b60 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.104+0000 7fc15e29f640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc15400e9c0 tx=0x7fc15400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.105+0000 7fc14f7fe640 1 -- 172.21.15.52:0/2252147290 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15400cd80 con 0x7fc158101b60 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.105+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15819fc50 con 0x7fc158101b60 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.105+0000 7fc14f7fe640 1 -- 172.21.15.52:0/2252147290 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1540035f0 con 0x7fc158101b60 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.105+0000 7fc14f7fe640 1 -- 172.21.15.52:0/2252147290 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154010690 con 0x7fc158101b60 2024-09-19T09:32:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.105+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1581a01a0 con 0x7fc158101b60 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 Processor -- start 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 -- start start 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc14f7fe640 1 -- 172.21.15.52:0/2252147290 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1540037a0 con 0x7fc158101b60 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de71da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 0x55944de74830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55944ddd02f0 con 0x55944de6c9a0 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55944dd78270 con 0x55944de72370 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc163298740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55944ddcc2b0 con 0x55944de6d2e0 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.108+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37552/0 (socket says 172.21.15.52:37552) 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 -- 172.21.15.52:0/324822199 learned_addr learned my addr 172.21.15.52:0/324822199 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15e29f640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de71da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15da9e640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 0x55944de74830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 -- 172.21.15.52:0/324822199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 msgr2=0x55944de71da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de71da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 -- 172.21.15.52:0/324822199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 msgr2=0x55944de74830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 0x55944de74830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 -- 172.21.15.52:0/324822199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944dd77340 con 0x55944de6c9a0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15da9e640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 0x55944de74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc14f7fe640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 0x7fc1440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc150005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15132421e3062f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc15e29f640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 0x7fc1440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc14cbfe640 1 -- 172.21.15.52:0/324822199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150031650 con 0x55944de6c9a0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc14f7fe640 1 -- 172.21.15.52:0/2252147290 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc1540cfe00 con 0x7fc158101b60 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc14cbfe640 1 -- 172.21.15.52:0/324822199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc150036030 con 0x55944de6c9a0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.109+0000 7fc14cbfe640 1 -- 172.21.15.52:0/324822199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150004850 con 0x55944de6c9a0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 -- 172.21.15.52:0/324822199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 msgr2=0x55944de6cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc15e29f640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 0x7fc1440a57b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc1540cdbf0 tx=0x7fc1540d38e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc150005fa0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 -- 172.21.15.52:0/324822199 shutdown_connections 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de72370 0x55944de74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de71da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 --2- 172.21.15.52:0/324822199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de6cda0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 -- 172.21.15.52:0/324822199 >> 172.21.15.52:0/324822199 conn(0x55944de68010 msgr2=0x55944de68410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 -- 172.21.15.52:0/324822199 shutdown_connections 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.110+0000 7fc163298740 1 -- 172.21.15.52:0/324822199 wait complete. 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 -- start start 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 Processor -- start 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6c9a0 0x55944de769c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de76f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55944de75160 con 0x55944de72370 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55944dd59290 con 0x55944de6c9a0 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55944de752e0 con 0x55944de6d2e0 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc163298740 10 client.0 _ll_register_callbacks cb 0x55944dd8a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37560/0 (socket says 172.21.15.52:37560) 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc15eaa0640 1 -- 172.21.15.52:0/3909029183 learned_addr learned my addr 172.21.15.52:0/3909029183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6c9a0 0x55944de769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.111+0000 7fc15da9e640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de76f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 -- 172.21.15.52:0/3909029183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 msgr2=0x55944de76f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de76f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 -- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6c9a0 msgr2=0x55944de769c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6c9a0 0x55944de769c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 -- 172.21.15.52:0/3909029183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944dae3210 con 0x55944de72370 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc15002f470 tx=0x7fc150004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b530e9e669a6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150059060 con 0x55944de72370 2024-09-19T09:32:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc150003d80 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc150036030 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc150004b40 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc163298740 10 client.19392 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55944dbaf620 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc150036030 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc150043070 con 0x55944de72370 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.112+0000 7fc163298740 10 client.19392 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc163298740 10 client.19392 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc163298740 20 client.19392 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944de84640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc163298740 4 client.19392 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55944dddda20 con 0x55944de82250 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc15da9e640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944de84640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc15da9e640 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944de84640 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fee86b609e41fba server_cookie=87ed30972a6fa79e in_seq=0 out_seq=0 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.113+0000 7fc141ffb640 10 client.19392 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc141ffb640 1 -- 172.21.15.52:0/3909029183 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55944dddda20 con 0x55944de82250 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc141ffb640 10 client.19392 handle_command_reply: tid=0 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 client.19392 shutdown 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 msgr2=0x55944de7df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fc15002f470 tx=0x7fc150004040 comp rx=0 tx=0).stop 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 shutdown_connections 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944de84640 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de72370 0x55944de7df40 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de6d2e0 0x55944de76f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc141ffb640 0 client.19392 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 --2- 172.21.15.52:0/3909029183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6c9a0 0x55944de769c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 >> 172.21.15.52:0/3909029183 conn(0x55944de68010 msgr2=0x55944de69820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 shutdown_connections 2024-09-19T09:32:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 1 -- 172.21.15.52:0/3909029183 wait complete. 2024-09-19T09:32:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.114+0000 7fc163298740 20 client.19392 trim_cache size 0 max 16384 2024-09-19T09:32:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.128+0000 7fc163298740 1 Processor -- start 2024-09-19T09:32:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 -- start start 2024-09-19T09:32:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de88eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581ab9d0 con 0x55944de6c9a0 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581a92a0 con 0x55944de6d2e0 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc163298740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581a70f0 con 0x55944de72370 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37574/0 (socket says 172.21.15.52:37574) 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4201385697 learned_addr learned my addr 172.21.15.52:0/4201385697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4201385697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 msgr2=0x55944de88eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de88eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4201385697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 msgr2=0x55944de7ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15da9e640 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4201385697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55944de84c20 con 0x55944de6c9a0 2024-09-19T09:32:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc1500099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f68c4fb7116678a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.129+0000 7fc143fff640 1 -- 172.21.15.52:0/4201385697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150004260 con 0x55944de6c9a0 2024-09-19T09:32:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc143fff640 1 -- 172.21.15.52:0/4201385697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc150036070 con 0x55944de6c9a0 2024-09-19T09:32:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc143fff640 1 -- 172.21.15.52:0/4201385697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150003de0 con 0x55944de6c9a0 2024-09-19T09:32:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 -- 172.21.15.52:0/4201385697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 msgr2=0x55944de670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc150009ca0 tx=0x7fc1500099c0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 -- 172.21.15.52:0/4201385697 shutdown_connections 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de88eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 --2- 172.21.15.52:0/4201385697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de670b0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 -- 172.21.15.52:0/4201385697 >> 172.21.15.52:0/4201385697 conn(0x55944de68010 msgr2=0x55944de669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 -- 172.21.15.52:0/4201385697 shutdown_connections 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.130+0000 7fc163298740 1 -- 172.21.15.52:0/4201385697 wait complete. 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 -- start start 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 Processor -- start 2024-09-19T09:32:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de7cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581a7760 con 0x55944de6c9a0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581a8bd0 con 0x55944de6d2e0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc1581a7e30 con 0x55944de72370 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc163298740 10 client.0 _ll_register_callbacks cb 0x7fc1540d37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc15eaa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37576/0 (socket says 172.21.15.52:37576) 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4204884635 learned_addr learned my addr 172.21.15.52:0/4204884635 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc15da9e640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.131+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de7cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4204884635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 msgr2=0x55944de7cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de7cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 msgr2=0x55944de7bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 -- 172.21.15.52:0/4204884635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55944de7d1d0 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc15eaa0640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fc150002230 tx=0x7fc150031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663aa59b8ff1af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150030e50 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc15002f610 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc150036070 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc150030840 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc163298740 10 client.19398 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55944deece90 con 0x55944de6c9a0 2024-09-19T09:32:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.132+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc150036070 con 0x55944de6c9a0 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc150043040 con 0x55944de6c9a0 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 10 client.19398 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 10 client.19398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 20 client.19398 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944deef820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 4 client.19398 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55944ddd7d70 con 0x55944de82250 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc15da9e640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944deef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc141ffb640 10 client.19398 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.133+0000 7fc15da9e640 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944deef820 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9f118c91f6312ab server_cookie=69dc721068191f1a in_seq=0 out_seq=0 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc141ffb640 1 -- 172.21.15.52:0/4204884635 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55944ddd7d70 con 0x55944de82250 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc141ffb640 10 client.19398 handle_command_reply: tid=0 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 client.19398 shutdown 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 msgr2=0x55944de7b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fc150002230 tx=0x7fc150031780 comp rx=0 tx=0).stop 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 shutdown_connections 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55944de82250 0x55944deef820 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55944de72370 0x55944de7cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55944de6d2e0 0x55944de7bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc141ffb640 0 client.19398 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 --2- 172.21.15.52:0/4204884635 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55944de6c9a0 0x55944de7b670 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.147 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.145+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 >> 172.21.15.52:0/4204884635 conn(0x55944de68010 msgr2=0x55944de671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 shutdown_connections 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc163298740 1 -- 172.21.15.52:0/4204884635 wait complete. 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc163298740 20 client.19398 trim_cache size 0 max 16384 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:32:44.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 msgr2=0x7fc1440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 0x7fc1440a57b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc1540cdbf0 tx=0x7fc1540d38e0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 msgr2=0x7fc158197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc15400e9c0 tx=0x7fc15400ee80 comp rx=0 tx=0).stop 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 shutdown_connections 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc1440a32f0 0x7fc1440a57b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc158103710 0x7fc15819f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc158102d50 0x7fc158198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 --2- 172.21.15.52:0/2252147290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc158101b60 0x7fc158197d50 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 >> 172.21.15.52:0/2252147290 conn(0x7fc1580fd2e0 msgr2=0x7fc158106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 shutdown_connections 2024-09-19T09:32:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:44.146+0000 7fc160503640 1 -- 172.21.15.52:0/2252147290 wait complete. 2024-09-19T09:32:44.163 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:32:44.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:32:44.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:44 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:32:44.458 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:44.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:44 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:32:44.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:44 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:32:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/1017992451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0102570 msgr2=0x7fcfe01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/1017992451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0102570 0x7fcfe01029b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009900 tx=0x7fcfd402a480 comp rx=0 tx=0).stop 2024-09-19T09:32:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/1017992451 shutdown_connections 2024-09-19T09:32:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/1017992451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102ef0 0x7fcfe010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/1017992451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0102570 0x7fcfe01029b0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/1017992451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0100e20 0x7fcfe0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/1017992451 >> 172.21.15.52:0/1017992451 conn(0x7fcfe00fc7d0 msgr2=0x7fcfe00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.914+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/1017992451 shutdown_connections 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.915+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/1017992451 wait complete. 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.915+0000 7fcfe4f8c640 1 Processor -- start 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.915+0000 7fcfe4f8c640 1 -- start start 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102570 0x7fcfe01998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 0x7fcfe01a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe0110fa0 con 0x7fcfe0100e20 2024-09-19T09:32:44.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe0110e20 con 0x7fcfe0102570 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfe4f8c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe0111120 con 0x7fcfe0102ef0 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37592/0 (socket says 172.21.15.52:37592) 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 -- 172.21.15.52:0/3475290047 learned_addr learned my addr 172.21.15.52:0/3475290047 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfddd9b640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102570 0x7fcfe01998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfded9d640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 0x7fcfe01a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 -- 172.21.15.52:0/3475290047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 msgr2=0x7fcfe01a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 0x7fcfe01a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 -- 172.21.15.52:0/3475290047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102570 msgr2=0x7fcfe01998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102570 0x7fcfe01998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 -- 172.21.15.52:0/3475290047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe01a4930 con 0x7fcfe0100e20 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfded9d640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 0x7fcfe01a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfde59c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b4a0 tx=0x7fcfd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.916+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0014070 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.917+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe01a4b00 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.917+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfd0010af0 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.917+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0017d10 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.917+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe01a4fc0 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.917+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe0101200 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.919+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcfd0017070 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.919+0000 7fcfcf7fe640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 0x7fcfc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.919+0000 7fcfddd9b640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 0x7fcfc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.920+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcfd00cf050 con 0x7fcfe0100e20 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.920+0000 7fcfddd9b640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 0x7fcfc80a5700 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000c00 tx=0x7fcfd40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:44.923+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfd009bd90 con 0x7fcfe0100e20 2024-09-19T09:32:45.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.135+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfe006a560 con 0x7fcfe0100e20 2024-09-19T09:32:45.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.136+0000 7fcfcf7fe640 1 -- 172.21.15.52:0/3475290047 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fcfe006a560 con 0x7fcfe0100e20 2024-09-19T09:32:45.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:32:45.137 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:32:45.137 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:32:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 msgr2=0x7fcfc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 0x7fcfc80a5700 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4000c00 tx=0x7fcfd40058d0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 msgr2=0x7fcfe0199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b4a0 tx=0x7fcfd000b960 comp rx=0 tx=0).stop 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 shutdown_connections 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfc80a3240 0x7fcfc80a5700 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0102ef0 0x7fcfe01a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfe0102570 0x7fcfe01998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 --2- 172.21.15.52:0/3475290047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfe0100e20 0x7fcfe0199370 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 >> 172.21.15.52:0/3475290047 conn(0x7fcfe00fc7d0 msgr2=0x7fcfe01068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 shutdown_connections 2024-09-19T09:32:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:45.138+0000 7fcfe4f8c640 1 -- 172.21.15.52:0/3475290047 wait complete. 2024-09-19T09:32:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:45 smithi052 ceph-mon[30947]: pgmap v677: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:45 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3475290047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:45.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:45 smithi169 ceph-mon[35454]: pgmap v677: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:45.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:45 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3475290047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:45 smithi086 ceph-mon[34813]: pgmap v677: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:45 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3475290047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:45.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:32:46.177 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:46.585 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:46 smithi052 ceph-mon[30947]: pgmap v678: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:46 smithi169 ceph-mon[35454]: pgmap v678: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:46.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 -- 172.21.15.52:0/2445954847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 msgr2=0x7efe881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 --2- 172.21.15.52:0/2445954847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe881021c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7efe78009900 tx=0x7efe7802a410 comp rx=0 tx=0).stop 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 -- 172.21.15.52:0/2445954847 shutdown_connections 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 --2- 172.21.15.52:0/2445954847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 --2- 172.21.15.52:0/2445954847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 0x7efe881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 --2- 172.21.15.52:0/2445954847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe881021c0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 -- 172.21.15.52:0/2445954847 >> 172.21.15.52:0/2445954847 conn(0x7efe880fd8c0 msgr2=0x7efe880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 -- 172.21.15.52:0/2445954847 shutdown_connections 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.668+0000 7efe8ca66640 1 -- 172.21.15.52:0/2445954847 wait complete. 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 Processor -- start 2024-09-19T09:32:46.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 -- start start 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 0x7efe88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe88111f70 con 0x7efe88101de0 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe88111df0 con 0x7efe88102790 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8ca66640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe881120f0 con 0x7efe88106f10 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37612/0 (socket says 172.21.15.52:37612) 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 -- 172.21.15.52:0/4145244001 learned_addr learned my addr 172.21.15.52:0/4145244001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe86d9d640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe7ffff640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 0x7efe88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 -- 172.21.15.52:0/4145244001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 msgr2=0x7efe88074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe88074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 -- 172.21.15.52:0/4145244001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 msgr2=0x7efe88074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 0x7efe88074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe8659c640 1 -- 172.21.15.52:0/4145244001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe881a68f0 con 0x7efe88101de0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.669+0000 7efe86d9d640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe8659c640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe7f7fe640 1 -- 172.21.15.52:0/4145244001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7803f030 con 0x7efe88101de0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe881a6b80 con 0x7efe88101de0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe7f7fe640 1 -- 172.21.15.52:0/4145244001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe78003ce0 con 0x7efe88101de0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe881a70b0 con 0x7efe88101de0 2024-09-19T09:32:46.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.670+0000 7efe7f7fe640 1 -- 172.21.15.52:0/4145244001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78049060 con 0x7efe88101de0 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.672+0000 7efe7f7fe640 1 -- 172.21.15.52:0/4145244001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efe78042030 con 0x7efe88101de0 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.672+0000 7efe8ee3f740 1 Processor -- start 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 -- start start 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928c5d0 0x56167928ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x561679299760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5616791f22f0 con 0x56167928db40 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561679199cf0 con 0x56167928c5d0 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5616791ee2b0 con 0x561679297370 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe7f7fe640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 0x7efe740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37614/0 (socket says 172.21.15.52:37614) 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 -- 172.21.15.52:0/679593512 learned_addr learned my addr 172.21.15.52:0/679593512 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 0x7efe740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe7f7fe640 1 -- 172.21.15.52:0/4145244001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efe780f0320 con 0x7efe88101de0 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe8659c640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928c5d0 0x56167928ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe7ffff640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x561679299760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 -- 172.21.15.52:0/679593512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 msgr2=0x561679299760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x561679299760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 -- 172.21.15.52:0/679593512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928c5d0 msgr2=0x56167928ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928c5d0 0x56167928ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe86d9d640 1 -- 172.21.15.52:0/679593512 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56167917e3a0 con 0x56167928db40 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.673+0000 7efe7ffff640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x561679299760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:46.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.674+0000 7efe86d9d640 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7efe80013e40 tx=0x7efe800107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdec1823369bf4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.674+0000 7efe86d9d640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 0x7efe740a5700 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efe80010ca0 tx=0x7efe8001b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.674+0000 7efe7cff9640 1 -- 172.21.15.52:0/679593512 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8000bd50 con 0x56167928db40 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.674+0000 7efe7cff9640 1 -- 172.21.15.52:0/679593512 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe80003e50 con 0x56167928db40 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.674+0000 7efe7cff9640 1 -- 172.21.15.52:0/679593512 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800047a0 con 0x56167928db40 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- 172.21.15.52:0/679593512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 msgr2=0x56167928c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7efe80013e40 tx=0x7efe800107a0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- 172.21.15.52:0/679593512 shutdown_connections 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x561679299760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928c5d0 0x56167928ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/679593512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x56167928c090 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- 172.21.15.52:0/679593512 >> 172.21.15.52:0/679593512 conn(0x561679255310 msgr2=0x561679288c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- 172.21.15.52:0/679593512 shutdown_connections 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- 172.21.15.52:0/679593512 wait complete. 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- start start 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 Processor -- start 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x561679296d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679297370 0x561679294610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56167929a010 con 0x56167928db40 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5616791ad060 con 0x561679297370 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56167929a190 con 0x56167928c5d0 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.675+0000 7efe8ee3f740 10 client.0 _ll_register_callbacks cb 0x561678f008c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37630/0 (socket says 172.21.15.52:37630) 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 -- 172.21.15.52:0/1757473927 learned_addr learned my addr 172.21.15.52:0/1757473927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe8659c640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x561679296d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe86d9d640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679297370 0x561679294610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 -- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 msgr2=0x561679296d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x561679296d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 -- 172.21.15.52:0/1757473927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679297370 msgr2=0x561679294610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679297370 0x561679294610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 -- 172.21.15.52:0/1757473927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561678f633c0 con 0x56167928db40 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe7ffff640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7efe7000be10 tx=0x7efe700117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a1655e0d88cb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70012650 con 0x56167928db40 2024-09-19T09:32:46.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efe700127f0 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe80003e50 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efe70011e80 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe8ee3f740 10 client.19416 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.676+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5616792a5b10 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe80003e50 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efe70025c70 con 0x56167928db40 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 10 client.19416 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 10 client.19416 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 20 client.19416 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616792a6fc0 0x5616792a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 4 client.19416 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:46.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616791ff860 con 0x5616792a6fc0 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.677+0000 7efe8659c640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616792a6fc0 0x5616792a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.678+0000 7efe8659c640 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616792a6fc0 0x5616792a93e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bbe9aacae3f40d9f server_cookie=94388164c28e79c7 in_seq=0 out_seq=0 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.678+0000 7efe6dffb640 10 client.19416 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.678+0000 7efe6dffb640 1 -- 172.21.15.52:0/1757473927 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616791ff860 con 0x5616792a6fc0 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe6dffb640 10 client.19416 handle_command_reply: tid=0 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 client.19416 shutdown 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 msgr2=0x561679294020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7efe7000be10 tx=0x7efe700117b0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 shutdown_connections 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616792a6fc0 0x5616792a93e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561679297370 0x561679294610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928db40 0x561679294020 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe6dffb640 0 client.19416 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/1757473927 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x561679296d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 >> 172.21.15.52:0/1757473927 conn(0x561679255310 msgr2=0x56167928e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 shutdown_connections 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 1 -- 172.21.15.52:0/1757473927 wait complete. 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.679+0000 7efe8ee3f740 20 client.19416 trim_cache size 0 max 16384 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 Processor -- start 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 -- start start 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x561679293000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x5616792aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe881b2230 con 0x56167928c5d0 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe881afb00 con 0x56167928db40 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe881ad950 con 0x561679297370 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37632/0 (socket says 172.21.15.52:37632) 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 -- 172.21.15.52:0/2848794630 learned_addr learned my addr 172.21.15.52:0/2848794630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe86d9d640 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x5616792aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 -- 172.21.15.52:0/2848794630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 msgr2=0x5616792aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x5616792aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 -- 172.21.15.52:0/2848794630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 msgr2=0x561679293000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x561679293000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 -- 172.21.15.52:0/2848794630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616792a9a60 con 0x56167928c5d0 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.692+0000 7efe8659c640 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7efe78000c00 tx=0x7efe78005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1800e538658e861b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe6ffff640 1 -- 172.21.15.52:0/2848794630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78086070 con 0x56167928c5d0 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe6ffff640 1 -- 172.21.15.52:0/2848794630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe780bc980 con 0x56167928c5d0 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe6ffff640 1 -- 172.21.15.52:0/2848794630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78035040 con 0x56167928c5d0 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- 172.21.15.52:0/2848794630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 msgr2=0x5616792a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7efe78000c00 tx=0x7efe78005b70 comp rx=0 tx=0).stop 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- 172.21.15.52:0/2848794630 shutdown_connections 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561679297370 0x5616792aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x561679293000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/2848794630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56167928c5d0 0x5616792a32b0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- 172.21.15.52:0/2848794630 >> 172.21.15.52:0/2848794630 conn(0x561679255310 msgr2=0x5616792928f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- 172.21.15.52:0/2848794630 shutdown_connections 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- 172.21.15.52:0/2848794630 wait complete. 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.693+0000 7efe8ee3f740 1 -- start start 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 Processor -- start 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x56167929b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x56167929ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efe881adfc0 con 0x561679297370 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe881af430 con 0x56167928db40 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efe881ae690 con 0x56167928c5d0 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8ee3f740 10 client.0 _ll_register_callbacks cb 0x7efe70005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37640/0 (socket says 172.21.15.52:37640) 2024-09-19T09:32:46.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 -- 172.21.15.52:0/3725881002 learned_addr learned my addr 172.21.15.52:0/3725881002 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe8659c640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x56167929b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe7ffff640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x56167929ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 -- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 msgr2=0x56167929b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x56167929b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 -- 172.21.15.52:0/3725881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 msgr2=0x56167929ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x56167929ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 -- 172.21.15.52:0/3725881002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561679310f50 con 0x561679297370 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe7ffff640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x56167929ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe86d9d640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7efe800042f0 tx=0x7efe800043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e40b3aedaa7e4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.694+0000 7efe6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80033060 con 0x561679297370 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efe800139b0 con 0x561679297370 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe780bc980 con 0x561679297370 2024-09-19T09:32:46.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efe80013050 con 0x561679297370 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 10 client.19422 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561679312250 con 0x561679297370 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe780bc980 con 0x561679297370 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efe8001c050 con 0x561679297370 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 10 client.19422 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 10 client.19422 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 20 client.19422 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616793126f0 0x561679314ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 4 client.19422 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616791f9d70 con 0x5616793126f0 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.695+0000 7efe8659c640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616793126f0 0x561679314ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8659c640 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616793126f0 0x561679314ae0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b3afd078e895ed8 server_cookie=bc8a798e5c3ddd47 in_seq=0 out_seq=0 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe6dffb640 10 client.19422 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:46.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe6dffb640 1 -- 172.21.15.52:0/3725881002 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616791f9d70 con 0x5616793126f0 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe6dffb640 10 client.19422 handle_command_reply: tid=0 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 client.19422 shutdown 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 msgr2=0x56167929bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7efe800042f0 tx=0x7efe800043c0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 shutdown_connections 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5616793126f0 0x561679314ae0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561679297370 0x56167929bfb0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.761 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56167928db40 0x56167929ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe6dffb640 0 client.19422 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 --2- 172.21.15.52:0/3725881002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56167928c5d0 0x56167929b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 >> 172.21.15.52:0/3725881002 conn(0x561679255310 msgr2=0x561679293110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 shutdown_connections 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 1 -- 172.21.15.52:0/3725881002 wait complete. 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.696+0000 7efe8ee3f740 20 client.19422 trim_cache size 0 max 16384 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 msgr2=0x7efe740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 0x7efe740a5700 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efe80010ca0 tx=0x7efe8001b000 comp rx=0 tx=0).stop 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 msgr2=0x7efe880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:46.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7efe78006010 tx=0x7efe780042f0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 shutdown_connections 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efe740a3240 0x7efe740a5700 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efe88106f10 0x7efe88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe88102790 0x7efe88074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 --2- 172.21.15.52:0/4145244001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe88101de0 0x7efe880744f0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 >> 172.21.15.52:0/4145244001 conn(0x7efe880fd8c0 msgr2=0x7efe880fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 shutdown_connections 2024-09-19T09:32:46.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:46.697+0000 7efe8ca66640 1 -- 172.21.15.52:0/4145244001 wait complete. 2024-09-19T09:32:46.763 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:46 smithi086 ceph-mon[34813]: pgmap v678: 97 pgs: 97 active+clean; 1.5 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:32:47.500 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:32:47.762 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 -- 172.21.15.52:0/2478990022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102570 msgr2=0x7fc0901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 --2- 172.21.15.52:0/2478990022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102570 0x7fc0901029b0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fc078009900 tx=0x7fc07802a480 comp rx=0 tx=0).stop 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 -- 172.21.15.52:0/2478990022 shutdown_connections 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 --2- 172.21.15.52:0/2478990022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090102ef0 0x7fc09010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 --2- 172.21.15.52:0/2478990022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102570 0x7fc0901029b0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 --2- 172.21.15.52:0/2478990022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090100e20 0x7fc090101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 -- 172.21.15.52:0/2478990022 >> 172.21.15.52:0/2478990022 conn(0x7fc0900fc7d0 msgr2=0x7fc0900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 -- 172.21.15.52:0/2478990022 shutdown_connections 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.227+0000 7fc094fd1640 1 -- 172.21.15.52:0/2478990022 wait complete. 2024-09-19T09:32:48.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 Processor -- start 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 -- start start 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 0x7fc090198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 0x7fc090198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc090110f80 con 0x7fc090102ef0 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc090110e00 con 0x7fc090100e20 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc094fd1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc090111100 con 0x7fc090102570 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57430/0 (socket says 172.21.15.52:57430) 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 -- 172.21.15.52:0/1627686471 learned_addr learned my addr 172.21.15.52:0/1627686471 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 0x7fc090198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08e59c640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 0x7fc090198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 -- 172.21.15.52:0/1627686471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 msgr2=0x7fc090198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 0x7fc090198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 -- 172.21.15.52:0/1627686471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 msgr2=0x7fc090198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 0x7fc090198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08ed9d640 1 -- 172.21.15.52:0/1627686471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09019d4b0 con 0x7fc090102ef0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08e59c640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 0x7fc090198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.228+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 0x7fc090198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc08ed9d640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc08000eaa0 tx=0x7fc08000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc0877fe640 1 -- 172.21.15.52:0/1627686471 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08000cdb0 con 0x7fc090102ef0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09019d7a0 con 0x7fc090102ef0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc0877fe640 1 -- 172.21.15.52:0/1627686471 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc080005020 con 0x7fc090102ef0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc0877fe640 1 -- 172.21.15.52:0/1627686471 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800116b0 con 0x7fc090102ef0 2024-09-19T09:32:48.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.229+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0901a5080 con 0x7fc090102ef0 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.231+0000 7fc0973aa740 1 Processor -- start 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.231+0000 7fc0877fe640 1 -- 172.21.15.52:0/1627686471 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc080005560 con 0x7fc090102ef0 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 -- start start 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 0x5559e2a78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a85760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5559e29de2f0 con 0x5559e2a785d0 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5559e2985cf0 con 0x5559e2a79b40 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0973aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559e29da2b0 con 0x5559e2a83370 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57438/0 (socket says 172.21.15.52:57438) 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 -- 172.21.15.52:0/1653521863 learned_addr learned my addr 172.21.15.52:0/1653521863 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 0x5559e2a78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a85760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc0877fe640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 0x7fc07c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 -- 172.21.15.52:0/1653521863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 msgr2=0x5559e2a85760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a85760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 -- 172.21.15.52:0/1653521863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 msgr2=0x5559e2a78090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 0x5559e2a78090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08e59c640 1 -- 172.21.15.52:0/1653521863 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e296a3a0 con 0x5559e2a785d0 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.232+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 0x5559e2a78090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:48.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc0877fe640 1 -- 172.21.15.52:0/1627686471 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc0800cfd20 con 0x7fc090102ef0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc08ed9d640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 0x7fc07c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc08e59c640 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fc08800bd40 tx=0x7fc08800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a09a84ed7ed6cf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc084ff9640 1 -- 172.21.15.52:0/1653521863 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088015070 con 0x5559e2a785d0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc084ff9640 1 -- 172.21.15.52:0/1653521863 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc08800be30 con 0x5559e2a785d0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc084ff9640 1 -- 172.21.15.52:0/1653521863 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088011a10 con 0x5559e2a785d0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc08ed9d640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 0x7fc07c0a5700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc08009bf60 tx=0x7fc0800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.233+0000 7fc0973aa740 1 -- 172.21.15.52:0/1653521863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 msgr2=0x5559e2a78a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fc08800bd40 tx=0x7fc08800f730 comp rx=0 tx=0).stop 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- 172.21.15.52:0/1653521863 shutdown_connections 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a85760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a785d0 0x5559e2a78a10 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- 172.21.15.52:0/1653521863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a79b40 0x5559e2a78090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- 172.21.15.52:0/1653521863 >> 172.21.15.52:0/1653521863 conn(0x5559e2a41310 msgr2=0x5559e2a74c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- 172.21.15.52:0/1653521863 shutdown_connections 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- 172.21.15.52:0/1653521863 wait complete. 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- start start 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 Processor -- start 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a82d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a79b40 0x5559e2a80000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5559e2a86070 con 0x5559e2a83370 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5559e2999060 con 0x5559e2a785d0 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5559e2a861f0 con 0x5559e2a79b40 2024-09-19T09:32:48.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc0973aa740 10 client.0 _ll_register_callbacks cb 0x5559e26ec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.234+0000 7fc08dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57446/0 (socket says 172.21.15.52:57446) 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 -- 172.21.15.52:0/3682004086 learned_addr learned my addr 172.21.15.52:0/3682004086 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a79b40 0x5559e2a80000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a82d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 -- 172.21.15.52:0/3682004086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a79b40 msgr2=0x5559e2a80000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a79b40 0x5559e2a80000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 -- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 msgr2=0x5559e2a82d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a82d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 -- 172.21.15.52:0/3682004086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e274f3c0 con 0x5559e2a83370 2024-09-19T09:32:48.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc078005ec0 tx=0x7fc0780058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2e119224527c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078035040 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc078004230 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc08800be30 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc078051050 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc0973aa740 10 client.19434 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.235+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559e2a91a60 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc08800be30 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc07803a040 con 0x5559e2a83370 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 10 client.19434 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:48.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 10 client.19434 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 20 client.19434 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2a92f10 0x5559e2a95300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 4 client.19434 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559e29eb860 con 0x5559e2a92f10 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.236+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2a92f10 0x5559e2a95300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2a92f10 0x5559e2a95300 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e70a42a309146b3e server_cookie=b4d13f3457d6e957 in_seq=0 out_seq=0 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc075ffb640 10 client.19434 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc075ffb640 1 -- 172.21.15.52:0/3682004086 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559e29eb860 con 0x5559e2a92f10 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc075ffb640 10 client.19434 handle_command_reply: tid=0 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 client.19434 shutdown 2024-09-19T09:32:48.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 msgr2=0x5559e2a805d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fc078005ec0 tx=0x7fc0780058d0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 shutdown_connections 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a83370 0x5559e2a805d0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a79b40 0x5559e2a80000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2a92f10 0x5559e2a95300 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3682004086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a82d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.237+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 >> 172.21.15.52:0/3682004086 conn(0x5559e2a41310 msgr2=0x5559e2a7a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.238+0000 7fc075ffb640 0 client.19434 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.238+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 shutdown_connections 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.238+0000 7fc0973aa740 1 -- 172.21.15.52:0/3682004086 wait complete. 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.238+0000 7fc0973aa740 20 client.19434 trim_cache size 0 max 16384 2024-09-19T09:32:48.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 Processor -- start 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 -- start start 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a74e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901b00b0 con 0x5559e2a79b40 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901ad980 con 0x5559e2a785d0 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc0973aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901ab7d0 con 0x5559e2a83370 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57456/0 (socket says 172.21.15.52:57456) 2024-09-19T09:32:48.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 -- 172.21.15.52:0/3036113004 learned_addr learned my addr 172.21.15.52:0/3036113004 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 -- 172.21.15.52:0/3036113004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 msgr2=0x5559e2a7b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a74e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 -- 172.21.15.52:0/3036113004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 msgr2=0x5559e2a74e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a74e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 -- 172.21.15.52:0/3036113004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559e2a830c0 con 0x5559e2a79b40 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.251+0000 7fc08e59c640 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc08800bd40 tx=0x7fc08800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed512e93a450b6b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc077fff640 1 -- 172.21.15.52:0/3036113004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088015040 con 0x5559e2a79b40 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc077fff640 1 -- 172.21.15.52:0/3036113004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc088005520 con 0x5559e2a79b40 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc077fff640 1 -- 172.21.15.52:0/3036113004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088011660 con 0x5559e2a79b40 2024-09-19T09:32:48.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 -- 172.21.15.52:0/3036113004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 msgr2=0x5559e2a8f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fc08800bd40 tx=0x7fc08800b660 comp rx=0 tx=0).stop 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 -- 172.21.15.52:0/3036113004 shutdown_connections 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a8f310 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 --2- 172.21.15.52:0/3036113004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a74e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 -- 172.21.15.52:0/3036113004 >> 172.21.15.52:0/3036113004 conn(0x5559e2a41310 msgr2=0x5559e2a74700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 -- 172.21.15.52:0/3036113004 shutdown_connections 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.252+0000 7fc0973aa740 1 -- 172.21.15.52:0/3036113004 wait complete. 2024-09-19T09:32:48.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 -- start start 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 Processor -- start 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a8b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901abe40 con 0x5559e2a79b40 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901ad2b0 con 0x5559e2a785d0 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901ac510 con 0x5559e2a83370 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc0973aa740 10 client.0 _ll_register_callbacks cb 0x7fc078009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57458/0 (socket says 172.21.15.52:57458) 2024-09-19T09:32:48.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 -- 172.21.15.52:0/2831914498 learned_addr learned my addr 172.21.15.52:0/2831914498 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a8b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 -- 172.21.15.52:0/2831914498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 msgr2=0x5559e2a7cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 -- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 msgr2=0x5559e2a8b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a8b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08e59c640 1 -- 172.21.15.52:0/2831914498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559e2a7d5d0 con 0x5559e2a79b40 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.253+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc08e59c640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc08800b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a729265a61f1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc088004880 con 0x5559e2a79b40 2024-09-19T09:32:48.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc088005520 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc088005040 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc088043050 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 10 client.19440 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5559e2afd910 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc088005520 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc088030470 con 0x5559e2a79b40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 10 client.19440 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 10 client.19440 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 20 client.19440 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2afde40 0x5559e2b00260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 4 client.19440 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.254+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559e29e5d70 con 0x5559e2afde40 2024-09-19T09:32:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2afde40 0x5559e2b00260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc075ffb640 10 client.19440 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc08dd9b640 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2afde40 0x5559e2b00260 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a4b8448be85f4ba server_cookie=85dc739f80e65f75 in_seq=0 out_seq=0 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc075ffb640 1 -- 172.21.15.52:0/2831914498 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559e29e5d70 con 0x5559e2afde40 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc075ffb640 10 client.19440 handle_command_reply: tid=0 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 client.19440 shutdown 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 msgr2=0x5559e2a7caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc088000c00 tx=0x7fc08800b540 comp rx=0 tx=0).stop 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 shutdown_connections 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5559e2a83370 0x5559e2a7cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5559e2a79b40 0x5559e2a7caa0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5559e2afde40 0x5559e2b00260 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 --2- 172.21.15.52:0/2831914498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5559e2a785d0 0x5559e2a8b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc075ffb640 0 client.19440 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 >> 172.21.15.52:0/2831914498 conn(0x5559e2a41310 msgr2=0x5559e2a82080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.255+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 shutdown_connections 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc0973aa740 1 -- 172.21.15.52:0/2831914498 wait complete. 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:48.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc0973aa740 20 client.19440 trim_cache size 0 max 16384 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 msgr2=0x7fc07c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 0x7fc07c0a5700 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc08009bf60 tx=0x7fc0800058d0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 msgr2=0x7fc09019cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fc08000eaa0 tx=0x7fc08000ef60 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 shutdown_connections 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc090102ef0 0x7fc09019cdd0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc07c0a3240 0x7fc07c0a5700 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc090102570 0x7fc090198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 --2- 172.21.15.52:0/1627686471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc090100e20 0x7fc090198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 >> 172.21.15.52:0/1627686471 conn(0x7fc0900fc7d0 msgr2=0x7fc09006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 shutdown_connections 2024-09-19T09:32:48.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:48.256+0000 7fc094fd1640 1 -- 172.21.15.52:0/1627686471 wait complete. 2024-09-19T09:32:48.906 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:48 smithi052 ceph-mon[30947]: pgmap v679: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:32:48.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:32:48.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:48 smithi169 ceph-mon[35454]: pgmap v679: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:32:49.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:48 smithi086 ceph-mon[34813]: pgmap v679: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:32:49.197 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 -- 172.21.15.52:0/4285118144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 msgr2=0x7fbd8410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 --2- 172.21.15.52:0/4285118144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8410ec40 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009930 tx=0x7fbd7402a420 comp rx=0 tx=0).stop 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 -- 172.21.15.52:0/4285118144 shutdown_connections 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 --2- 172.21.15.52:0/4285118144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8410ec40 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 --2- 172.21.15.52:0/4285118144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd841036e0 0x7fbd84107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 --2- 172.21.15.52:0/4285118144 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd84102d30 0x7fbd84103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 -- 172.21.15.52:0/4285118144 >> 172.21.15.52:0/4285118144 conn(0x7fbd840fc7d0 msgr2=0x7fbd840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 -- 172.21.15.52:0/4285118144 shutdown_connections 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 -- 172.21.15.52:0/4285118144 wait complete. 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.651+0000 7fbd898ec640 1 Processor -- start 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 -- start start 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd84102d30 0x7fbd841984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 0x7fbd84198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841120a0 con 0x7fbd841082a0 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84111f20 con 0x7fbd84102d30 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd898ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84112220 con 0x7fbd841036e0 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57470/0 (socket says 172.21.15.52:57470) 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 -- 172.21.15.52:0/3857009948 learned_addr learned my addr 172.21.15.52:0/3857009948 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:49.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd84102d30 0x7fbd841984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd827fc640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 0x7fbd84198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 -- 172.21.15.52:0/3857009948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 msgr2=0x7fbd84198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 0x7fbd84198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 -- 172.21.15.52:0/3857009948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd84102d30 msgr2=0x7fbd841984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd84102d30 0x7fbd841984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd837fe640 1 -- 172.21.15.52:0/3857009948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8419d470 con 0x7fbd841082a0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.652+0000 7fbd827fc640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 0x7fbd84198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd837fe640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbd74005ab0 tx=0x7fbd740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd888ea640 1 -- 172.21.15.52:0/3857009948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403f030 con 0x7fbd841082a0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8419d700 con 0x7fbd841082a0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd888ea640 1 -- 172.21.15.52:0/3857009948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd74003ce0 con 0x7fbd841082a0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd888ea640 1 -- 172.21.15.52:0/3857009948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74035070 con 0x7fbd841082a0 2024-09-19T09:32:49.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.653+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd841a5040 con 0x7fbd841082a0 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.655+0000 7fbd888ea640 1 -- 172.21.15.52:0/3857009948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbd74042030 con 0x7fbd841082a0 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.655+0000 7fbd8bcc5740 1 Processor -- start 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.655+0000 7fbd8bcc5740 1 -- start start 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114377a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114382370 0x55d114384760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d1142dd2f0 con 0x55d114378b40 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d114284cf0 con 0x55d114382370 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d1142d92b0 con 0x55d1143775d0 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57476/0 (socket says 172.21.15.52:57476) 2024-09-19T09:32:49.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd827fc640 1 -- 172.21.15.52:0/1484412251 learned_addr learned my addr 172.21.15.52:0/1484412251 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114377a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114382370 0x55d114384760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd888ea640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 0x7fbd700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 -- 172.21.15.52:0/1484412251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114382370 msgr2=0x55d114384760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd837fe640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 0x7fbd700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114382370 0x55d114384760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 -- 172.21.15.52:0/1484412251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 msgr2=0x55d114377090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd82ffd640 1 -- 172.21.15.52:0/1484412251 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1142693a0 con 0x55d1143775d0 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.656+0000 7fbd888ea640 1 -- 172.21.15.52:0/3857009948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd740eff50 con 0x7fbd841082a0 2024-09-19T09:32:49.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114377a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005c40 tx=0x7fbd7c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9191ab7f9f13ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd837fe640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 0x7fbd700a5700 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbd740bc1f0 tx=0x7fbd740b19d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd79ffb640 1 -- 172.21.15.52:0/1484412251 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003b70 con 0x55d1143775d0 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd79ffb640 1 -- 172.21.15.52:0/1484412251 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd7c003d10 con 0x55d1143775d0 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd79ffb640 1 -- 172.21.15.52:0/1484412251 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c010b00 con 0x55d1143775d0 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1484412251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 msgr2=0x55d114377a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114377a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c005c40 tx=0x7fbd7c00f790 comp rx=0 tx=0).stop 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1484412251 shutdown_connections 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114382370 0x55d114384760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114377a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.657+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1484412251 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114378b40 0x55d114377090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1484412251 >> 172.21.15.52:0/1484412251 conn(0x55d114340310 msgr2=0x55d114373c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1484412251 shutdown_connections 2024-09-19T09:32:49.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1484412251 wait complete. 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- start start 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 Processor -- start 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114381ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d11437ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d114385070 con 0x55d114382370 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d114298060 con 0x55d114378b40 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d1143851f0 con 0x55d1143775d0 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.658+0000 7fbd8bcc5740 10 client.0 _ll_register_callbacks cb 0x55d113feb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57486/0 (socket says 172.21.15.52:57486) 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 -- 172.21.15.52:0/1831867335 learned_addr learned my addr 172.21.15.52:0/1831867335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:49.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d11437ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114381ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 -- 172.21.15.52:0/1831867335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 msgr2=0x55d114381ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114381ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 -- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 msgr2=0x55d11437ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d11437ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 -- 172.21.15.52:0/1831867335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d11404e3c0 con 0x55d114382370 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c013ed0 tx=0x7fbd6c00ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f766d50022bca38e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c005020 con 0x55d114382370 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c003d10 con 0x55d114382370 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd6c0051c0 con 0x55d114382370 2024-09-19T09:32:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd6c025020 con 0x55d114382370 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd8bcc5740 10 client.19452 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.659+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d114390a80 con 0x55d114382370 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd7c003d10 con 0x55d114382370 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd6c00f040 con 0x55d114382370 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 10 client.19452 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 10 client.19452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 20 client.19452 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d114391e90 0x55d114394280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 4 client.19452 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1142ea860 con 0x55d114391e90 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.660+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d114391e90 0x55d114394280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.661+0000 7fbd62ffd640 10 client.19452 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.661+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d114391e90 0x55d114394280 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d818645af43aa6 server_cookie=7186bd6543df6c89 in_seq=0 out_seq=0 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.661+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1831867335 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1142ea860 con 0x55d114391e90 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.661+0000 7fbd62ffd640 10 client.19452 handle_command_reply: tid=0 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 client.19452 shutdown 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 msgr2=0x55d11437f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c013ed0 tx=0x7fbd6c00ab70 comp rx=0 tx=0).stop 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 shutdown_connections 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d114391e90 0x55d114394280 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11437f4f0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d11437ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1831867335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d1143775d0 0x55d114381ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 >> 172.21.15.52:0/1831867335 conn(0x55d114340310 msgr2=0x55d114379960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd62ffd640 0 client.19452 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 shutdown_connections 2024-09-19T09:32:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1831867335 wait complete. 2024-09-19T09:32:49.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.662+0000 7fbd8bcc5740 20 client.19452 trim_cache size 0 max 16384 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.675+0000 7fbd8bcc5740 1 Processor -- start 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.675+0000 7fbd8bcc5740 1 -- start start 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d114383760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114382370 0x55d114383ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841addb0 con 0x55d1143775d0 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841ab680 con 0x55d114378b40 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841a94d0 con 0x55d114382370 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57502/0 (socket says 172.21.15.52:57502) 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 -- 172.21.15.52:0/794614533 learned_addr learned my addr 172.21.15.52:0/794614533 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114382370 0x55d114383ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d114383760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 -- 172.21.15.52:0/794614533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114382370 msgr2=0x55d114383ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114382370 0x55d114383ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 -- 172.21.15.52:0/794614533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 msgr2=0x55d114383760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d114383760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 -- 172.21.15.52:0/794614533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1143948b0 con 0x55d1143775d0 2024-09-19T09:32:49.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d114383760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd827fc640 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c011fe0 tx=0x7fbd6c013b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360d46f7eb28266e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.676+0000 7fbd797fa640 1 -- 172.21.15.52:0/794614533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0054a0 con 0x55d1143775d0 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd797fa640 1 -- 172.21.15.52:0/794614533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd6c005640 con 0x55d1143775d0 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd797fa640 1 -- 172.21.15.52:0/794614533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c004620 con 0x55d1143775d0 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/794614533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 msgr2=0x55d11438e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c011fe0 tx=0x7fbd6c013b90 comp rx=0 tx=0).stop 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/794614533 shutdown_connections 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114382370 0x55d114383ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d114378b40 0x55d114383760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/794614533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d1143775d0 0x55d11438e310 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/794614533 >> 172.21.15.52:0/794614533 conn(0x55d114340310 msgr2=0x55d11437ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/794614533 shutdown_connections 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.677+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/794614533 wait complete. 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 -- start start 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 Processor -- start 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d1143775d0 0x55d11437cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114378b40 0x55d11438a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841a9b40 con 0x55d114382370 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841aafb0 con 0x55d1143775d0 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841aa210 con 0x55d114378b40 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd8bcc5740 10 client.0 _ll_register_callbacks cb 0x7fbd6c013ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:49.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57510/0 (socket says 172.21.15.52:57510) 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.678+0000 7fbd827fc640 1 -- 172.21.15.52:0/1491833118 learned_addr learned my addr 172.21.15.52:0/1491833118 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114378b40 0x55d11438a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d1143775d0 0x55d11437cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 -- 172.21.15.52:0/1491833118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114378b40 msgr2=0x55d11438a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114378b40 0x55d11438a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 -- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d1143775d0 msgr2=0x55d11437cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d1143775d0 0x55d11437cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 -- 172.21.15.52:0/1491833118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d114399620 con 0x55d114382370 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd827fc640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c010550 tx=0x7fbd6c00ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7b490f7e06cc44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0109a0 con 0x55d114382370 2024-09-19T09:32:49.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbd6c010b40 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6c005640 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd6c010d40 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd8bcc5740 10 client.19458 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d1143fcc70 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.679+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd6c005640 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbd6c01c070 con 0x55d114382370 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 10 client.19458 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 10 client.19458 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 20 client.19458 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d1143fd1d0 0x55d1143ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 4 client.19458 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1142e4d70 con 0x55d1143fd1d0 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d1143fd1d0 0x55d1143ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:49.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd82ffd640 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d1143fd1d0 0x55d1143ff5c0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d9a4da2c456a333 server_cookie=3d98632548c99bd2 in_seq=0 out_seq=0 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.680+0000 7fbd62ffd640 10 client.19458 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd62ffd640 1 -- 172.21.15.52:0/1491833118 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1142e4d70 con 0x55d1143fd1d0 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd62ffd640 10 client.19458 handle_command_reply: tid=0 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 client.19458 shutdown 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 msgr2=0x55d11438aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c010550 tx=0x7fbd6c00ac80 comp rx=0 tx=0).stop 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 shutdown_connections 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d1143fd1d0 0x55d1143ff5c0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d114382370 0x55d11438aa20 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d114378b40 0x55d11438a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 --2- 172.21.15.52:0/1491833118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d1143775d0 0x55d11437cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 >> 172.21.15.52:0/1491833118 conn(0x55d114340310 msgr2=0x55d1143807f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd62ffd640 0 client.19458 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 shutdown_connections 2024-09-19T09:32:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 1 -- 172.21.15.52:0/1491833118 wait complete. 2024-09-19T09:32:49.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.681+0000 7fbd8bcc5740 20 client.19458 trim_cache size 0 max 16384 2024-09-19T09:32:49.692 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 msgr2=0x7fbd700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 0x7fbd700a5700 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbd740bc1f0 tx=0x7fbd740b19d0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 msgr2=0x7fbd8419cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fbd74005ab0 tx=0x7fbd740042f0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 shutdown_connections 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbd841082a0 0x7fbd8419cd90 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbd700a3240 0x7fbd700a5700 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd841036e0 0x7fbd84198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 --2- 172.21.15.52:0/3857009948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbd84102d30 0x7fbd841984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 >> 172.21.15.52:0/3857009948 conn(0x7fbd840fc7d0 msgr2=0x7fbd840fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:49.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 shutdown_connections 2024-09-19T09:32:49.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:49.682+0000 7fbd898ec640 1 -- 172.21.15.52:0/3857009948 wait complete. 2024-09-19T09:32:50.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:50 smithi052 ceph-mon[30947]: pgmap v680: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:50.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:50 smithi169 ceph-mon[35454]: pgmap v680: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:51.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:50 smithi086 ceph-mon[34813]: pgmap v680: 97 pgs: 97 active+clean; 1.6 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:32:51.526 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:32:51.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:32:51.800 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 -- 172.21.15.52:0/3999730012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 msgr2=0x7f023010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 --2- 172.21.15.52:0/3999730012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023010eaf0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0228009cd0 tx=0x7f022802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 -- 172.21.15.52:0/3999730012 shutdown_connections 2024-09-19T09:32:52.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 --2- 172.21.15.52:0/3999730012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023010eaf0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 --2- 172.21.15.52:0/3999730012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230100ca0 0x7f0230106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 --2- 172.21.15.52:0/3999730012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02301002f0 0x7f02301006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 -- 172.21.15.52:0/3999730012 >> 172.21.15.52:0/3999730012 conn(0x7f0230077210 msgr2=0x7f02300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 -- 172.21.15.52:0/3999730012 shutdown_connections 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.330+0000 7f023659f640 1 -- 172.21.15.52:0/3999730012 wait complete. 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 Processor -- start 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 -- start start 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02301002f0 0x7f0230198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0230100ca0 0x7f0230198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0230112000 con 0x7f0230106f50 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0230111e80 con 0x7f02301002f0 2024-09-19T09:32:52.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f023659f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0230112180 con 0x7f0230100ca0 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.331+0000 7f0234b3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57536/0 (socket says 172.21.15.52:57536) 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 -- 172.21.15.52:0/3486199463 learned_addr learned my addr 172.21.15.52:0/3486199463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f022f7fe640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0230100ca0 0x7f0230198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f022ffff640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02301002f0 0x7f0230198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 -- 172.21.15.52:0/3486199463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0230100ca0 msgr2=0x7f0230198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0230100ca0 0x7f0230198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 -- 172.21.15.52:0/3486199463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02301002f0 msgr2=0x7f0230198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02301002f0 0x7f0230198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 -- 172.21.15.52:0/3486199463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023019d3f0 con 0x7f0230106f50 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0228006010 tx=0x7f0228003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f022d7fa640 1 -- 172.21.15.52:0/3486199463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228004450 con 0x7f0230106f50 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f022d7fa640 1 -- 172.21.15.52:0/3486199463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0228003e10 con 0x7f0230106f50 2024-09-19T09:32:52.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023019d680 con 0x7f0230106f50 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f022d7fa640 1 -- 172.21.15.52:0/3486199463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228046480 con 0x7f0230106f50 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.332+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02301a4fc0 con 0x7f0230106f50 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022d7fa640 1 -- 172.21.15.52:0/3486199463 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f02280045f0 con 0x7f0230106f50 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 Processor -- start 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 -- start start 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c343ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3449800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8c33a4280 con 0x55b8c3449d40 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b8c334bb10 con 0x55b8c343f480 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f0238978740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8c33a0240 con 0x55b8c343eb60 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57540/0 (socket says 172.21.15.52:57540) 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022f7fe640 1 -- 172.21.15.52:0/4166067662 learned_addr learned my addr 172.21.15.52:0/4166067662 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022ffff640 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3449800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.335+0000 7f022f7fe640 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c343ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 -- 172.21.15.52:0/4166067662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 msgr2=0x55b8c343ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c343ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 -- 172.21.15.52:0/4166067662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 msgr2=0x55b8c3449800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3449800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 -- 172.21.15.52:0/4166067662 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8c33581f0 con 0x55b8c3449d40 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022d7fa640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 0x7f02180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022f7fe640 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f022400afa0 tx=0x7f022400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5208be86302dfa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022ffff640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 0x7f02180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f022d7fa640 1 -- 172.21.15.52:0/3486199463 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f022802e030 con 0x7f0230106f50 2024-09-19T09:32:52.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f02167fc640 1 -- 172.21.15.52:0/4166067662 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224019070 con 0x55b8c3449d40 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f02167fc640 1 -- 172.21.15.52:0/4166067662 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02240047a0 con 0x55b8c3449d40 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.336+0000 7f02167fc640 1 -- 172.21.15.52:0/4166067662 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224011b50 con 0x55b8c3449d40 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- 172.21.15.52:0/4166067662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 msgr2=0x55b8c344c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f022ffff640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 0x7f02180a5700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55b8c343bf50 tx=0x7f0220008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f022400afa0 tx=0x7f022400a7d0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- 172.21.15.52:0/4166067662 shutdown_connections 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344c130 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3449800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 --2- 172.21.15.52:0/4166067662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c343ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- 172.21.15.52:0/4166067662 >> 172.21.15.52:0/4166067662 conn(0x55b8c343b0f0 msgr2=0x55b8c343b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- 172.21.15.52:0/4166067662 shutdown_connections 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- 172.21.15.52:0/4166067662 wait complete. 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 -- start start 2024-09-19T09:32:52.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.337+0000 7f0238978740 1 Processor -- start 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3446cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 0x55b8c3447750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b8c344c910 con 0x55b8c343f480 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b8c335ef10 con 0x55b8c3449d40 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b8c344ca90 con 0x55b8c343eb60 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 10 client.0 _ll_register_callbacks cb 0x55b8c3327a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57552/0 (socket says 172.21.15.52:57552) 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 -- 172.21.15.52:0/1594681697 learned_addr learned my addr 172.21.15.52:0/1594681697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022ffff640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3446cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0234b3c640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 0x55b8c3447750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 -- 172.21.15.52:0/1594681697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 msgr2=0x55b8c3446cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3446cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 -- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 msgr2=0x55b8c3447750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 0x55b8c3447750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 -- 172.21.15.52:0/1594681697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8c31156a0 con 0x55b8c343f480 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022ffff640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3446cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0234b3c640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 0x55b8c3447750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f022f7fe640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f022400a8b0 tx=0x7f022400a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4443eb887d65786 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f020f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224019070 con 0x55b8c343f480 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02240047a0 con 0x55b8c343f480 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.338+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0224005430 con 0x55b8c343f480 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02240118d0 con 0x55b8c343f480 2024-09-19T09:32:52.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 10 client.19470 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8c34585c0 con 0x55b8c343f480 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02240047a0 con 0x55b8c343f480 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0224024070 con 0x55b8c343f480 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 10 client.19470 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 10 client.19470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 20 client.19470 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34599d0 0x55b8c345bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 4 client.19470 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8c33b17f0 con 0x55b8c34599d0 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.339+0000 7f022ffff640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34599d0 0x55b8c345bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.340+0000 7f022ffff640 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34599d0 0x55b8c345bdc0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fc6f3a9de56a5d server_cookie=57da1707fed52106 in_seq=0 out_seq=0 2024-09-19T09:32:52.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.340+0000 7f020f7fe640 10 client.19470 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.340+0000 7f020f7fe640 1 -- 172.21.15.52:0/1594681697 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8c33b17f0 con 0x55b8c34599d0 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.340+0000 7f020f7fe640 10 client.19470 handle_command_reply: tid=0 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.340+0000 7f0238978740 1 client.19470 shutdown 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 msgr2=0x55b8c3447210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f022400a8b0 tx=0x7f022400a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 shutdown_connections 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34599d0 0x55b8c345bdc0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c3449d40 0x55b8c3447750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3447210 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f020f7fe640 0 client.19470 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 --2- 172.21.15.52:0/1594681697 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3446cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 >> 172.21.15.52:0/1594681697 conn(0x55b8c343b0f0 msgr2=0x55b8c3440dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 shutdown_connections 2024-09-19T09:32:52.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 1 -- 172.21.15.52:0/1594681697 wait complete. 2024-09-19T09:32:52.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.341+0000 7f0238978740 20 client.19470 trim_cache size 0 max 16384 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 Processor -- start 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 -- start start 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343eb60 0x55b8c34475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 0x55b8c3461a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02301affa0 con 0x55b8c343f480 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ad870 con 0x55b8c343eb60 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0238978740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ab6c0 con 0x55b8c3449d40 2024-09-19T09:32:52.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57558/0 (socket says 172.21.15.52:57558) 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 -- 172.21.15.52:0/141382763 learned_addr learned my addr 172.21.15.52:0/141382763 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022ffff640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343eb60 0x55b8c34475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f0234b3c640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 0x55b8c3461a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 -- 172.21.15.52:0/141382763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 msgr2=0x55b8c3461a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 0x55b8c3461a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 -- 172.21.15.52:0/141382763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343eb60 msgr2=0x55b8c34475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.358+0000 7f022f7fe640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343eb60 0x55b8c34475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f022f7fe640 1 -- 172.21.15.52:0/141382763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8c34492d0 con 0x55b8c343f480 2024-09-19T09:32:52.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f0234b3c640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 0x55b8c3461a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:52.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f022f7fe640 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f0224013550 tx=0x7f0224005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aed2dbb870f992 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f0215ffb640 1 -- 172.21.15.52:0/141382763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224034030 con 0x55b8c343f480 2024-09-19T09:32:52.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f0215ffb640 1 -- 172.21.15.52:0/141382763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f022400a630 con 0x55b8c343f480 2024-09-19T09:32:52.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.359+0000 7f0215ffb640 1 -- 172.21.15.52:0/141382763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224019040 con 0x55b8c343f480 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- 172.21.15.52:0/141382763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 msgr2=0x55b8c3461500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f0224013550 tx=0x7f0224005850 comp rx=0 tx=0).stop 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- 172.21.15.52:0/141382763 shutdown_connections 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c3449d40 0x55b8c3461a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c343f480 0x55b8c3461500 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- 172.21.15.52:0/141382763 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343eb60 0x55b8c34475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- 172.21.15.52:0/141382763 >> 172.21.15.52:0/141382763 conn(0x55b8c343b0f0 msgr2=0x55b8c3445c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- 172.21.15.52:0/141382763 shutdown_connections 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- 172.21.15.52:0/141382763 wait complete. 2024-09-19T09:32:52.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 -- start start 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 Processor -- start 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3451ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3452220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.360+0000 7f0238978740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0238978740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02301abd30 con 0x55b8c3449d40 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0238978740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ad1a0 con 0x55b8c343f480 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0238978740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02301ac400 con 0x55b8c343eb60 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0238978740 10 client.0 _ll_register_callbacks cb 0x7f022000b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57570/0 (socket says 172.21.15.52:57570) 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 -- 172.21.15.52:0/3555818658 learned_addr learned my addr 172.21.15.52:0/3555818658 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:52.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f022ffff640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3451ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f022f7fe640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3452220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 -- 172.21.15.52:0/3555818658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 msgr2=0x55b8c3451ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3451ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 -- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 msgr2=0x55b8c3452220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3452220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 -- 172.21.15.52:0/3555818658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8c344f1f0 con 0x55b8c3449d40 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0234b3c640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f02280c5d70 tx=0x7f02280bd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedc601110dfdc97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f020f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02280d5070 con 0x55b8c3449d40 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02280d1d50 con 0x55b8c3449d40 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.361+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f022400a630 con 0x55b8c3449d40 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02280bd630 con 0x55b8c3449d40 2024-09-19T09:32:52.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 10 client.19476 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8c34c9000 con 0x55b8c3449d40 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f022400a630 con 0x55b8c3449d40 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f022804e070 con 0x55b8c3449d40 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 10 client.19476 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 10 client.19476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 20 client.19476 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34c9770 0x55b8c34cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 4 client.19476 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b8c33abd00 con 0x55b8c34c9770 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.362+0000 7f022ffff640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34c9770 0x55b8c34cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:52.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.363+0000 7f022ffff640 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34c9770 0x55b8c34cbb90 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cadc24c54a800be server_cookie=39dfe12f4af324e5 in_seq=0 out_seq=0 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.363+0000 7f020f7fe640 10 client.19476 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f020f7fe640 1 -- 172.21.15.52:0/3555818658 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b8c33abd00 con 0x55b8c34c9770 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f020f7fe640 10 client.19476 handle_command_reply: tid=0 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 client.19476 shutdown 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 msgr2=0x55b8c344ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f02280c5d70 tx=0x7f02280bd050 comp rx=0 tx=0).stop 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 shutdown_connections 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b8c34c9770 0x55b8c34cbb90 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b8c3449d40 0x55b8c344ecb0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b8c343f480 0x55b8c3452220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f020f7fe640 0 client.19476 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 --2- 172.21.15.52:0/3555818658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b8c343eb60 0x55b8c3451ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 >> 172.21.15.52:0/3555818658 conn(0x55b8c343b0f0 msgr2=0x55b8c3439a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 shutdown_connections 2024-09-19T09:32:52.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 1 -- 172.21.15.52:0/3555818658 wait complete. 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.364+0000 7f0238978740 20 client.19476 trim_cache size 0 max 16384 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "7cc65486-5994-4452-8945-662768b33104", 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:32:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 msgr2=0x7f02180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 0x7f02180a5700 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x55b8c343bf50 tx=0x7f0220008040 comp rx=0 tx=0).stop 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 msgr2=0x7f023019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f0228006010 tx=0x7f0228003c20 comp rx=0 tx=0).stop 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 shutdown_connections 2024-09-19T09:32:52.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0230106f50 0x7f023019cd10 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02180a3240 0x7f02180a5700 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0230100ca0 0x7f0230198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 --2- 172.21.15.52:0/3486199463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02301002f0 0x7f0230198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 >> 172.21.15.52:0/3486199463 conn(0x7f0230077210 msgr2=0x7f0230105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 shutdown_connections 2024-09-19T09:32:52.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:52.365+0000 7f023659f640 1 -- 172.21.15.52:0/3486199463 wait complete. 2024-09-19T09:32:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:52 smithi052 ceph-mon[30947]: pgmap v681: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:52 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:32:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:52 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:52 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:32:52.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:52 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:52.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:52 smithi169 ceph-mon[35454]: pgmap v681: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:52.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:52 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:32:52.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:52 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:52.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:52 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:32:52.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:52 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:52 smithi086 ceph-mon[34813]: pgmap v681: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:32:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:52 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:32:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:52 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:52 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:32:53.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:52 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:32:53.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:32:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:53.769 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:53 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 -- 172.21.15.52:0/489557674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0102790 msgr2=0x7feea01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 --2- 172.21.15.52:0/489557674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0102790 0x7feea01067e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009900 tx=0x7fee8c02a410 comp rx=0 tx=0).stop 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 -- 172.21.15.52:0/489557674 shutdown_connections 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 --2- 172.21.15.52:0/489557674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0106f10 0x7feea010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 --2- 172.21.15.52:0/489557674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0102790 0x7feea01067e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 --2- 172.21.15.52:0/489557674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0101de0 0x7feea01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 -- 172.21.15.52:0/489557674 >> 172.21.15.52:0/489557674 conn(0x7feea00fd8c0 msgr2=0x7feea00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 -- 172.21.15.52:0/489557674 shutdown_connections 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.855+0000 7feea6ee5640 1 -- 172.21.15.52:0/489557674 wait complete. 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 Processor -- start 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 -- start start 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0101de0 0x7feea00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 0x7feea0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feea0111f70 con 0x7feea0106f10 2024-09-19T09:32:53.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feea0111df0 con 0x7feea0101de0 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea6ee5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feea01120f0 con 0x7feea0102790 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea5482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea5482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57580/0 (socket says 172.21.15.52:57580) 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea5482640 1 -- 172.21.15.52:0/2518894932 learned_addr learned my addr 172.21.15.52:0/2518894932 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7feea4c81640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0101de0 0x7feea00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.856+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 0x7feea0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 -- 172.21.15.52:0/2518894932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 msgr2=0x7feea0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 0x7feea0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 -- 172.21.15.52:0/2518894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0101de0 msgr2=0x7feea00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0101de0 0x7feea00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 -- 172.21.15.52:0/2518894932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea01a6890 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 0x7feea0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea5482640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cce0 tx=0x7fee9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7fee9dffb640 1 -- 172.21.15.52:0/2518894932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9800f450 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7fee9dffb640 1 -- 172.21.15.52:0/2518894932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee9800fad0 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea01a6b80 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7fee9dffb640 1 -- 172.21.15.52:0/2518894932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee98018c10 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.857+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea01a7070 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.859+0000 7fee9dffb640 1 -- 172.21.15.52:0/2518894932 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fee9800f5f0 con 0x7feea0106f10 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 Processor -- start 2024-09-19T09:32:53.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 -- start start 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48b4a0 0x55a5ed48b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed496140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed3f12e0 con 0x55a5ed496680 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed398ce0 con 0x55a5ed48bdc0 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea92be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed3ed2a0 con 0x55a5ed48b4a0 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9dffb640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 0x7fee900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57590/0 (socket says 172.21.15.52:57590) 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9ffff640 1 -- 172.21.15.52:0/2473271184 learned_addr learned my addr 172.21.15.52:0/2473271184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:53.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea5482640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 0x7fee900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7feea4c81640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed496140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48b4a0 0x55a5ed48b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.860+0000 7fee9dffb640 1 -- 172.21.15.52:0/2518894932 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fee980d0070 con 0x7feea0106f10 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 -- 172.21.15.52:0/2473271184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48b4a0 msgr2=0x55a5ed48b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48b4a0 0x55a5ed48b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 -- 172.21.15.52:0/2473271184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 msgr2=0x55a5ed496140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed496140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 -- 172.21.15.52:0/2473271184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ed37d440 con 0x55a5ed496680 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7feea4c81640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed496140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:53.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fee8c02a930 tx=0x7fee8c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6935381225151f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7feea5482640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 0x7fee900a5700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fee98098a10 tx=0x7fee980186b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee8affd640 1 -- 172.21.15.52:0/2473271184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c043020 con 0x55a5ed496680 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee8affd640 1 -- 172.21.15.52:0/2473271184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c031930 con 0x55a5ed496680 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.861+0000 7fee8affd640 1 -- 172.21.15.52:0/2473271184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c035040 con 0x55a5ed496680 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- 172.21.15.52:0/2473271184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 msgr2=0x55a5ed498a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fee8c02a930 tx=0x7fee8c005750 comp rx=0 tx=0).stop 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- 172.21.15.52:0/2473271184 shutdown_connections 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed498a70 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed496140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 --2- 172.21.15.52:0/2473271184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48b4a0 0x55a5ed48b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- 172.21.15.52:0/2473271184 >> 172.21.15.52:0/2473271184 conn(0x55a5ed487a30 msgr2=0x55a5ed487e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- 172.21.15.52:0/2473271184 shutdown_connections 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- 172.21.15.52:0/2473271184 wait complete. 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 -- start start 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.862+0000 7feea92be740 1 Processor -- start 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed4932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed496680 0x55a5ed493830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed499250 con 0x55a5ed48b4a0 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed3ac050 con 0x55a5ed48bdc0 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5ed4993d0 con 0x55a5ed496680 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea92be740 10 client.0 _ll_register_callbacks cb 0x55a5ed3ec160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57602/0 (socket says 172.21.15.52:57602) 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 -- 172.21.15.52:0/2852673001 learned_addr learned my addr 172.21.15.52:0/2852673001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed496680 0x55a5ed493830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea4c81640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed4932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 -- 172.21.15.52:0/2852673001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed496680 msgr2=0x55a5ed493830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed496680 0x55a5ed493830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 -- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 msgr2=0x55a5ed4932b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed4932b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 -- 172.21.15.52:0/2852673001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ed1623c0 con 0x55a5ed48b4a0 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7feea4c81640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed4932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fee8c001eb0 tx=0x7fee8c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d98b9521525275 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.863+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c050020 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fee8c03ddc0 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee8c031930 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee8c05b050 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 10 client.19488 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5ed4a4c70 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c031930 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fee8c03a040 con 0x55a5ed48b4a0 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 10 client.19488 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 10 client.19488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 20 client.19488 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed4a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 4 client.19488 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ed3fe850 con 0x55a5ed4a5fc0 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.864+0000 7feea4c81640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed4a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.865+0000 7feea4c81640 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed4a83b0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c52d12a28f93e537 server_cookie=f78ed3b5a5a5739 in_seq=0 out_seq=0 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.865+0000 7fee7ffff640 10 client.19488 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7fee7ffff640 1 -- 172.21.15.52:0/2852673001 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5ed3fe850 con 0x55a5ed4a5fc0 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7fee7ffff640 10 client.19488 handle_command_reply: tid=0 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 client.19488 shutdown 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 msgr2=0x55a5ed496000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fee8c001eb0 tx=0x7fee8c0054e0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 shutdown_connections 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed4a83b0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7fee7ffff640 0 client.19488 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed496680 0x55a5ed493830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48bdc0 0x55a5ed4932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 --2- 172.21.15.52:0/2852673001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed48b4a0 0x55a5ed496000 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 >> 172.21.15.52:0/2852673001 conn(0x55a5ed487a30 msgr2=0x55a5ed48d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 shutdown_connections 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 1 -- 172.21.15.52:0/2852673001 wait complete. 2024-09-19T09:32:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.866+0000 7feea92be740 20 client.19488 trim_cache size 0 max 16384 2024-09-19T09:32:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.883+0000 7feea92be740 1 Processor -- start 2024-09-19T09:32:53.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.883+0000 7feea92be740 1 -- start start 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.883+0000 7feea92be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed4a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea92be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed492b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea92be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea92be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feea01b2120 con 0x55a5ed496680 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea92be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feea01af9f0 con 0x55a5ed48b4a0 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea92be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feea01ad840 con 0x55a5ed48bdc0 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57612/0 (socket says 172.21.15.52:57612) 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 -- 172.21.15.52:0/4276807508 learned_addr learned my addr 172.21.15.52:0/4276807508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed4a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7feea4c81640 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed492b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 -- 172.21.15.52:0/4276807508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 msgr2=0x55a5ed492b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed492b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 -- 172.21.15.52:0/4276807508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 msgr2=0x55a5ed4a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed4a24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 -- 172.21.15.52:0/4276807508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ed493ba0 con 0x55a5ed496680 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee9ffff640 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fee8c031550 tx=0x7fee8c005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f492ad2bc1224cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee8a7fc640 1 -- 172.21.15.52:0/4276807508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c050040 con 0x55a5ed496680 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee8a7fc640 1 -- 172.21.15.52:0/4276807508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c049e50 con 0x55a5ed496680 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.884+0000 7fee8a7fc640 1 -- 172.21.15.52:0/4276807508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c043070 con 0x55a5ed496680 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- 172.21.15.52:0/4276807508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 msgr2=0x55a5ed48e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fee8c031550 tx=0x7fee8c005970 comp rx=0 tx=0).stop 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- 172.21.15.52:0/4276807508 shutdown_connections 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed48e8b0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed492b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 --2- 172.21.15.52:0/4276807508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed4a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- 172.21.15.52:0/4276807508 >> 172.21.15.52:0/4276807508 conn(0x55a5ed487a30 msgr2=0x55a5ed487e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- 172.21.15.52:0/4276807508 shutdown_connections 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- 172.21.15.52:0/4276807508 wait complete. 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 -- start start 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.885+0000 7feea92be740 1 Processor -- start 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed499d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed49a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feea01adeb0 con 0x55a5ed496680 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feea01af320 con 0x55a5ed48b4a0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feea01ae580 con 0x55a5ed48bdc0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea92be740 10 client.0 _ll_register_callbacks cb 0x7fee94004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57618/0 (socket says 172.21.15.52:57618) 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 -- 172.21.15.52:0/2058990128 learned_addr learned my addr 172.21.15.52:0/2058990128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed499d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7feea4c81640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed49a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 -- 172.21.15.52:0/2058990128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 msgr2=0x55a5ed49a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed49a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 -- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 msgr2=0x55a5ed499d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed499d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.886+0000 7fee9ffff640 1 -- 172.21.15.52:0/2058990128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ed4a8720 con 0x55a5ed496680 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee9ffff640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fee8c006010 tx=0x7fee8c03dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4189ad79659259cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c050050 con 0x55a5ed496680 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee8c049e50 con 0x55a5ed496680 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fee8c005020 con 0x55a5ed496680 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee8c043040 con 0x55a5ed496680 2024-09-19T09:32:53.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 10 client.19494 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5ed510100 con 0x55a5ed496680 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c049e50 con 0x55a5ed496680 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fee8c004d00 con 0x55a5ed496680 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 10 client.19494 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 10 client.19494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 20 client.19494 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed5125b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 4 client.19494 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.887+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5ed3f8d60 con 0x55a5ed4a5fc0 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea4c81640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed5125b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:53.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea4c81640 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed5125b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8af3ca15eae4066f server_cookie=3e7a4d8f250b9d5e in_seq=0 out_seq=0 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7fee7ffff640 10 client.19494 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7fee7ffff640 1 -- 172.21.15.52:0/2058990128 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a5ed3f8d60 con 0x55a5ed4a5fc0 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7fee7ffff640 10 client.19494 handle_command_reply: tid=0 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 client.19494 shutdown 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 msgr2=0x55a5ed5088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fee8c006010 tx=0x7fee8c03dce0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 shutdown_connections 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5ed4a5fc0 0x55a5ed5125b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5ed496680 0x55a5ed5088e0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5ed48bdc0 0x55a5ed49a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7fee7ffff640 0 client.19494 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 --2- 172.21.15.52:0/2058990128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5ed48b4a0 0x55a5ed499d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.888+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 >> 172.21.15.52:0/2058990128 conn(0x55a5ed487a30 msgr2=0x55a5ed48e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 shutdown_connections 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea92be740 1 -- 172.21.15.52:0/2058990128 wait complete. 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea92be740 20 client.19494 trim_cache size 0 max 16384 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:32:53.903 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:32:53.904 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:32:53.904 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:32:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 msgr2=0x7fee900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 0x7fee900a5700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fee98098a10 tx=0x7fee980186b0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 msgr2=0x7feea0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fee9800cce0 tx=0x7fee9800a620 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 shutdown_connections 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feea0106f10 0x7feea0074f70 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fee900a3240 0x7fee900a5700 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feea0102790 0x7feea0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 --2- 172.21.15.52:0/2518894932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feea0101de0 0x7feea00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 >> 172.21.15.52:0/2518894932 conn(0x7feea00fd8c0 msgr2=0x7feea00fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 shutdown_connections 2024-09-19T09:32:53.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:53.889+0000 7feea6ee5640 1 -- 172.21.15.52:0/2518894932 wait complete. 2024-09-19T09:32:53.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:53 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:32:54.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:53 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:32:54.645 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:32:54.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:32:54.909 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:54.929 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:54 smithi052 ceph-mon[30947]: pgmap v682: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:54.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:54 smithi169 ceph-mon[35454]: pgmap v682: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:55.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:54 smithi086 ceph-mon[34813]: pgmap v682: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 -- 172.21.15.52:0/2803592161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 msgr2=0x7fd4f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/2803592161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f410da40 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009ca0 tx=0x7fd4ec02a950 comp rx=0 tx=0).stop 2024-09-19T09:32:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 -- 172.21.15.52:0/2803592161 shutdown_connections 2024-09-19T09:32:55.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/2803592161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f410da40 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/2803592161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/2803592161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 0x7fd4f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.384+0000 7fd4fb9af640 1 -- 172.21.15.52:0/2803592161 >> 172.21.15.52:0/2803592161 conn(0x7fd4f40fc7d0 msgr2=0x7fd4f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- 172.21.15.52:0/2803592161 shutdown_connections 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- 172.21.15.52:0/2803592161 wait complete. 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 Processor -- start 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- start start 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 0x7fd4f41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41120a0 con 0x7fd4f4102ef0 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4111f20 con 0x7fd4f4102570 2024-09-19T09:32:55.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.385+0000 7fd4fb9af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4112220 con 0x7fd4f4100e20 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57636/0 (socket says 172.21.15.52:57636) 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 -- 172.21.15.52:0/3874524205 learned_addr learned my addr 172.21.15.52:0/3874524205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f974b640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 0x7fd4f41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f8f4a640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 -- 172.21.15.52:0/3874524205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 msgr2=0x7fd4f41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 0x7fd4f41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 -- 172.21.15.52:0/3874524205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 msgr2=0x7fd4f4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f4198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 -- 172.21.15.52:0/3874524205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f419d490 con 0x7fd4f4102ef0 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f8f4a640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4f9f4c640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec006010 tx=0x7fd4ec02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:55.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec034040 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4ec003e00 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f419d720 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec045480 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.386+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f41a5060 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.387+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f4101200 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.388+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd4ec037020 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.389+0000 7fd4e67fc640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 0x7fd4e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.389+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd4ec0f0b20 con 0x7fd4f4102ef0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.389+0000 7fd4f974b640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 0x7fd4e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.390+0000 7fd4f974b640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 0x7fd4e00a5700 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00058c0 tx=0x7fd4f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:55.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.392+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4ec0bd850 con 0x7fd4f4102ef0 2024-09-19T09:32:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.607+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f41a5290 con 0x7fd4f4102ef0 2024-09-19T09:32:55.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.607+0000 7fd4e67fc640 1 -- 172.21.15.52:0/3874524205 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fd4ec0bd150 con 0x7fd4f4102ef0 2024-09-19T09:32:55.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:32:55.609 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:32:55.609 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:32:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 msgr2=0x7fd4e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 0x7fd4e00a5700 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00058c0 tx=0x7fd4f000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 msgr2=0x7fd4f419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec006010 tx=0x7fd4ec02f6f0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 shutdown_connections 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f4102ef0 0x7fd4f419cdb0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4f4102570 0x7fd4f4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd4e00a3240 0x7fd4e00a5700 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 --2- 172.21.15.52:0/3874524205 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd4f4100e20 0x7fd4f41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 >> 172.21.15.52:0/3874524205 conn(0x7fd4f40fc7d0 msgr2=0x7fd4f4106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 shutdown_connections 2024-09-19T09:32:55.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:55.610+0000 7fd4fb9af640 1 -- 172.21.15.52:0/3874524205 wait complete. 2024-09-19T09:32:56.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:32:56.552 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:56.825 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:56 smithi052 ceph-mon[30947]: pgmap v683: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:56.825 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:56 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3874524205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:56 smithi169 ceph-mon[35454]: pgmap v683: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:56.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:56 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3874524205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:56 smithi086 ceph-mon[34813]: pgmap v683: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:32:57.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:56 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3874524205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 -- 172.21.15.52:0/1351055533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 msgr2=0x7f02d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1351055533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d01029b0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f02c0009900 tx=0x7f02c002a480 comp rx=0 tx=0).stop 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 -- 172.21.15.52:0/1351055533 shutdown_connections 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1351055533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 0x7f02d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1351055533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d01029b0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1351055533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 -- 172.21.15.52:0/1351055533 >> 172.21.15.52:0/1351055533 conn(0x7f02d00fc7d0 msgr2=0x7f02d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 -- 172.21.15.52:0/1351055533 shutdown_connections 2024-09-19T09:32:57.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.088+0000 7f02d86fa640 1 -- 172.21.15.52:0/1351055533 wait complete. 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 Processor -- start 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 -- start start 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 0x7f02d00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0110fa0 con 0x7f02d0102570 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0110e20 con 0x7f02d0102ef0 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d86fa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0111120 con 0x7f02d0100e20 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d5c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d5c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57654/0 (socket says 172.21.15.52:57654) 2024-09-19T09:32:57.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d5c95640 1 -- 172.21.15.52:0/1058662544 learned_addr learned my addr 172.21.15.52:0/1058662544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 0x7f02d00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.089+0000 7f02d6496640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 -- 172.21.15.52:0/1058662544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 msgr2=0x7f02d00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 -- 172.21.15.52:0/1058662544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 msgr2=0x7f02d00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 0x7f02d00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 -- 172.21.15.52:0/1058662544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d01a6a80 con 0x7f02d0102570 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d6496640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f02c0006010 tx=0x7f02c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02c77fe640 1 -- 172.21.15.52:0/1058662544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c003f070 con 0x7f02d0102570 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02c77fe640 1 -- 172.21.15.52:0/1058662544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c0031c30 con 0x7f02d0102570 2024-09-19T09:32:57.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02c77fe640 1 -- 172.21.15.52:0/1058662544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0035030 con 0x7f02d0102570 2024-09-19T09:32:57.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d01a6d10 con 0x7f02d0102570 2024-09-19T09:32:57.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.090+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d01a71e0 con 0x7f02d0102570 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02c77fe640 1 -- 172.21.15.52:0/1058662544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f02c0042070 con 0x7f02d0102570 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 Processor -- start 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 -- start start 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5579e92342f0 con 0x5579e92ce5d0 2024-09-19T09:32:57.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5579e91dbcf0 con 0x5579e92d9370 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.093+0000 7f02daad3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5579e92302b0 con 0x5579e92cfb40 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02c77fe640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 0x7f02bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57666/0 (socket says 172.21.15.52:57666) 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6496640 1 -- 172.21.15.52:0/4163049554 learned_addr learned my addr 172.21.15.52:0/4163049554 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02c77fe640 1 -- 172.21.15.52:0/1058662544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02c00efe60 con 0x7f02d0102570 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 0x7f02bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d5c95640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 -- 172.21.15.52:0/4163049554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 msgr2=0x5579e92db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 -- 172.21.15.52:0/4163049554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 msgr2=0x5579e92cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 -- 172.21.15.52:0/4163049554 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e91c03a0 con 0x5579e92cfb40 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6496640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 0x7f02bc0a5780 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f02c8010c40 tx=0x7f02c800c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.094+0000 7f02d6c97640 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ce090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02c8005fd0 tx=0x7f02c8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cf8a5621cbbcb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.095+0000 7f02c4ff9640 1 -- 172.21.15.52:0/4163049554 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8012e70 con 0x5579e92cfb40 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.095+0000 7f02c4ff9640 1 -- 172.21.15.52:0/4163049554 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c8009ce0 con 0x5579e92cfb40 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.095+0000 7f02c4ff9640 1 -- 172.21.15.52:0/4163049554 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8005020 con 0x5579e92cfb40 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- 172.21.15.52:0/4163049554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 msgr2=0x5579e92ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ce090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02c8005fd0 tx=0x7f02c8010740 comp rx=0 tx=0).stop 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- 172.21.15.52:0/4163049554 shutdown_connections 2024-09-19T09:32:57.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 --2- 172.21.15.52:0/4163049554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ce090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- 172.21.15.52:0/4163049554 >> 172.21.15.52:0/4163049554 conn(0x5579e9297310 msgr2=0x5579e92cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- 172.21.15.52:0/4163049554 shutdown_connections 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- 172.21.15.52:0/4163049554 wait complete. 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 -- start start 2024-09-19T09:32:57.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.096+0000 7f02daad3740 1 Processor -- start 2024-09-19T09:32:57.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5579e92dc010 con 0x5579e92d9370 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5579e91ef060 con 0x5579e92ce5d0 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5579e92dc190 con 0x5579e92cfb40 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02daad3740 10 client.0 _ll_register_callbacks cb 0x5579e8f428c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6496640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57682/0 (socket says 172.21.15.52:57682) 2024-09-19T09:32:57.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 -- 172.21.15.52:0/1115009601 learned_addr learned my addr 172.21.15.52:0/1115009601 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6496640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:43224/0 (socket says 172.21.15.52:43224) 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 -- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 msgr2=0x5579e92d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92d6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 -- 172.21.15.52:0/1115009601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 msgr2=0x5579e92d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 -- 172.21.15.52:0/1115009601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e8fa53c0 con 0x5579e92d9370 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f02c800a010 tx=0x7f02c8012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786cb743f136896d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.097+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c802b070 con 0x5579e92d9370 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02c8012270 con 0x5579e92d9370 2024-09-19T09:32:57.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5579e9241860 con 0x5579e92d9370 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02c8035020 con 0x5579e92d9370 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02daad3740 10 client.19512 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579e92e7ab0 con 0x5579e92d9370 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.098+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5579e9241860 con 0x5579e92d9370 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02c800f040 con 0x5579e92d9370 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 10 client.19512 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 10 client.19512 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 20 client.19512 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:57.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e92eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 4 client.19512 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579e923bd70 con 0x5579e92e8e60 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02d6496640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e92eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02d6496640 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e92eb250 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb14409e70ee9667 server_cookie=ceb6c1c4c5ff3679 in_seq=0 out_seq=0 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.099+0000 7f02b9ffb640 10 client.19512 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1115009601 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5579e923bd70 con 0x5579e92e8e60 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02b9ffb640 10 client.19512 handle_command_reply: tid=0 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 client.19512 shutdown 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 msgr2=0x5579e92d6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f02c800a010 tx=0x7f02c8012ef0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 shutdown_connections 2024-09-19T09:32:57.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e92eb250 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02b9ffb640 0 client.19512 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92d9370 0x5579e92d6600 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92d6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 --2- 172.21.15.52:0/1115009601 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 >> 172.21.15.52:0/1115009601 conn(0x5579e9297310 msgr2=0x5579e92d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 shutdown_connections 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.100+0000 7f02daad3740 1 -- 172.21.15.52:0/1115009601 wait complete. 2024-09-19T09:32:57.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.101+0000 7f02daad3740 20 client.19512 trim_cache size 0 max 16384 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.113+0000 7f02daad3740 1 Processor -- start 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.113+0000 7f02daad3740 1 -- start start 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92d9370 0x5579e92d3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01b2230 con 0x5579e92cfb40 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01afb00 con 0x5579e92ce5d0 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02daad3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01ad950 con 0x5579e92d9370 2024-09-19T09:32:57.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57696/0 (socket says 172.21.15.52:57696) 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 -- 172.21.15.52:0/506131688 learned_addr learned my addr 172.21.15.52:0/506131688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d6c97640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92d9370 0x5579e92d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d6496640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 -- 172.21.15.52:0/506131688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92d9370 msgr2=0x5579e92d3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92d9370 0x5579e92d3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 -- 172.21.15.52:0/506131688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 msgr2=0x5579e92d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 -- 172.21.15.52:0/506131688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e92dc0b0 con 0x5579e92cfb40 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d6496640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02d5c95640 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f02c00bc0a0 tx=0x7f02c0005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5690917b01f902 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02bbfff640 1 -- 172.21.15.52:0/506131688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0049040 con 0x5579e92cfb40 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02bbfff640 1 -- 172.21.15.52:0/506131688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c00bc3a0 con 0x5579e92cfb40 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.114+0000 7f02bbfff640 1 -- 172.21.15.52:0/506131688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c00bc600 con 0x5579e92cfb40 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- 172.21.15.52:0/506131688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 msgr2=0x5579e92d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f02c00bc0a0 tx=0x7f02c0005b50 comp rx=0 tx=0).stop 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- 172.21.15.52:0/506131688 shutdown_connections 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92d9370 0x5579e92d3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92cfb40 0x5579e92d1660 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 --2- 172.21.15.52:0/506131688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92ce5d0 0x5579e92d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- 172.21.15.52:0/506131688 >> 172.21.15.52:0/506131688 conn(0x5579e9297310 msgr2=0x5579e92d8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- 172.21.15.52:0/506131688 shutdown_connections 2024-09-19T09:32:57.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- 172.21.15.52:0/506131688 wait complete. 2024-09-19T09:32:57.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.115+0000 7f02daad3740 1 -- start start 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 Processor -- start 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ec520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01adfc0 con 0x5579e92ce5d0 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01af430 con 0x5579e92d9370 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02d01ae690 con 0x5579e92cfb40 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02daad3740 10 client.0 _ll_register_callbacks cb 0x7f02cc0072a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57704/0 (socket says 172.21.15.52:57704) 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 -- 172.21.15.52:0/1970402297 learned_addr learned my addr 172.21.15.52:0/1970402297 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 -- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 msgr2=0x5579e92ec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ec520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 -- 172.21.15.52:0/1970402297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 msgr2=0x5579e92eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6496640 1 -- 172.21.15.52:0/1970402297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e93527a0 con 0x5579e92ce5d0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.116+0000 7f02d6c97640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02d6496640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006fd0 tx=0x7f02cc01a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b690872f3af72ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc022480 con 0x5579e92ce5d0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02cc022620 con 0x5579e92ce5d0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c00bc3a0 con 0x5579e92ce5d0 2024-09-19T09:32:57.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02cc022820 con 0x5579e92ce5d0 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 10 client.19518 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5579e93539f0 con 0x5579e92ce5d0 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c00bc3a0 con 0x5579e92ce5d0 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02cc01bc20 con 0x5579e92ce5d0 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 10 client.19518 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 10 client.19518 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 20 client.19518 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e9356130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 4 client.19518 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.117+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579e91b8170 con 0x5579e92e8e60 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e9356130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02d5c95640 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e9356130 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7770adfbaf9c019b server_cookie=8b212fd533142cd3 in_seq=0 out_seq=0 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02b9ffb640 10 client.19518 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02b9ffb640 1 -- 172.21.15.52:0/1970402297 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579e91b8170 con 0x5579e92e8e60 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02b9ffb640 10 client.19518 handle_command_reply: tid=0 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 client.19518 shutdown 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 msgr2=0x5579e92ebfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f02cc006fd0 tx=0x7f02cc01a460 comp rx=0 tx=0).stop 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 shutdown_connections 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5579e92e8e60 0x5579e9356130 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5579e92d9370 0x5579e92eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5579e92cfb40 0x5579e92ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 --2- 172.21.15.52:0/1970402297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5579e92ce5d0 0x5579e92ebfe0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 >> 172.21.15.52:0/1970402297 conn(0x5579e9297310 msgr2=0x5579e92d7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.118+0000 7f02b9ffb640 0 client.19518 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:32:57.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 shutdown_connections 2024-09-19T09:32:57.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02daad3740 1 -- 172.21.15.52:0/1970402297 wait complete. 2024-09-19T09:32:57.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02daad3740 20 client.19518 trim_cache size 0 max 16384 2024-09-19T09:32:57.126 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 msgr2=0x7f02bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 0x7f02bc0a5780 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f02c8010c40 tx=0x7f02c800c000 comp rx=0 tx=0).stop 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 msgr2=0x7f02d00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f02c0006010 tx=0x7f02c0003c10 comp rx=0 tx=0).stop 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 shutdown_connections 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02d0102ef0 0x7f02d00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02d0102570 0x7f02d00fd1c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02bc0a32c0 0x7f02bc0a5780 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 --2- 172.21.15.52:0/1058662544 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02d0100e20 0x7f02d00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 >> 172.21.15.52:0/1058662544 conn(0x7f02d00fc7d0 msgr2=0x7f02d006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 shutdown_connections 2024-09-19T09:32:57.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:57.119+0000 7f02d86fa640 1 -- 172.21.15.52:0/1058662544 wait complete. 2024-09-19T09:32:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 -- 172.21.15.52:0/673792523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4100a60 msgr2=0x7f5dd4100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 --2- 172.21.15.52:0/673792523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4100a60 0x7f5dd4100e60 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009900 tx=0x7f5dc402a410 comp rx=0 tx=0).stop 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 -- 172.21.15.52:0/673792523 shutdown_connections 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 --2- 172.21.15.52:0/673792523 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4102610 0x7f5dd4108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 --2- 172.21.15.52:0/673792523 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4101c50 0x7f5dd41020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 --2- 172.21.15.52:0/673792523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4100a60 0x7f5dd4100e60 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 -- 172.21.15.52:0/673792523 >> 172.21.15.52:0/673792523 conn(0x7f5dd40fc1e0 msgr2=0x7f5dd40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 -- 172.21.15.52:0/673792523 shutdown_connections 2024-09-19T09:32:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.237+0000 7f5dd921e640 1 -- 172.21.15.52:0/673792523 wait complete. 2024-09-19T09:32:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 Processor -- start 2024-09-19T09:32:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 -- start start 2024-09-19T09:32:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4100a60 0x7f5dd4197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4101c50 0x7f5dd4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410c6c0 con 0x7f5dd4102610 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410c540 con 0x7f5dd4100a60 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.238+0000 7f5dd921e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410c840 con 0x7f5dd4101c50 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57714/0 (socket says 172.21.15.52:57714) 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 -- 172.21.15.52:0/1933567239 learned_addr learned my addr 172.21.15.52:0/1933567239 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd259c640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4101c50 0x7f5dd4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4100a60 0x7f5dd4197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 -- 172.21.15.52:0/1933567239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4101c50 msgr2=0x7f5dd4198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4101c50 0x7f5dd4198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 -- 172.21.15.52:0/1933567239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4100a60 msgr2=0x7f5dd4197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4100a60 0x7f5dd4197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 -- 172.21.15.52:0/1933567239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd419f960 con 0x7f5dd4102610 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd359e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cce0 tx=0x7f5dcc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dbbfff640 1 -- 172.21.15.52:0/1933567239 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00f450 con 0x7f5dd4102610 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd419fc50 con 0x7f5dd4102610 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dbbfff640 1 -- 172.21.15.52:0/1933567239 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc00fad0 con 0x7f5dd4102610 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dbbfff640 1 -- 172.21.15.52:0/1933567239 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc018b60 con 0x7f5dd4102610 2024-09-19T09:32:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.239+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd41a01a0 con 0x7f5dd4102610 2024-09-19T09:32:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.241+0000 7f5dbbfff640 1 -- 172.21.15.52:0/1933567239 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5dcc00fc80 con 0x7f5dd4102610 2024-09-19T09:32:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 Processor -- start 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 -- start start 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606fae2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae32e0 0x55606fae7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55606fa462f0 con 0x55606fae8370 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55606f9ee270 con 0x55606fae29a0 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5ddc090740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55606fa422b0 con 0x55606fae32e0 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dbbfff640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 0x7f5dbc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57730/0 (socket says 172.21.15.52:57730) 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 -- 172.21.15.52:0/3481071191 learned_addr learned my addr 172.21.15.52:0/3481071191 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606fae2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae32e0 0x55606fae7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd359e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 0x7f5dbc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dbbfff640 1 -- 172.21.15.52:0/1933567239 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5dcc0cff50 con 0x7f5dd4102610 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 -- 172.21.15.52:0/3481071191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae32e0 msgr2=0x55606fae7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae32e0 0x55606fae7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 -- 172.21.15.52:0/3481071191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 msgr2=0x55606fae2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606fae2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.242+0000 7f5dd259c640 1 -- 172.21.15.52:0/3481071191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606f9ed340 con 0x55606fae8370 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.243+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8011810 tx=0x7f5dc800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d5715c5cb5d6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.243+0000 7f5dd359e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 0x7f5dbc0a57b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc09c1f0 tx=0x7f5dcc091940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.243+0000 7f5db97fa640 1 -- 172.21.15.52:0/3481071191 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8011e50 con 0x55606fae8370 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.243+0000 7f5db97fa640 1 -- 172.21.15.52:0/3481071191 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc8005020 con 0x55606fae8370 2024-09-19T09:32:57.251 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.243+0000 7f5db97fa640 1 -- 172.21.15.52:0/3481071191 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8004b20 con 0x55606fae8370 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- 172.21.15.52:0/3481071191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 msgr2=0x55606faea830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8011810 tx=0x7f5dc800a780 comp rx=0 tx=0).stop 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- 172.21.15.52:0/3481071191 shutdown_connections 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606faea830 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae32e0 0x55606fae7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3481071191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606fae2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- 172.21.15.52:0/3481071191 >> 172.21.15.52:0/3481071191 conn(0x55606fade010 msgr2=0x55606fade410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- 172.21.15.52:0/3481071191 shutdown_connections 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- 172.21.15.52:0/3481071191 wait complete. 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- start start 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 Processor -- start 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.252 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606faf4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55606faeb340 con 0x55606fae29a0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55606f9cf290 con 0x55606fae32e0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55606faeb4c0 con 0x55606fae8370 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5ddc090740 10 client.0 _ll_register_callbacks cb 0x55606fa00140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57736/0 (socket says 172.21.15.52:57736) 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.244+0000 7f5dd259c640 1 -- 172.21.15.52:0/3896738949 learned_addr learned my addr 172.21.15.52:0/3896738949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606faf4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 -- 172.21.15.52:0/3896738949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 msgr2=0x55606faf4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.253 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606faf4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 -- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 msgr2=0x55606faed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faed1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 -- 172.21.15.52:0/3896738949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606f759210 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8010010 tx=0x7f5dc800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4de4618076a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5db6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8012e60 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5dc8004aa0 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc8005020 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5dc8030030 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5ddc090740 10 client.19530 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55606f825620 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.245+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc8005020 con 0x55606fae29a0 2024-09-19T09:32:57.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5dc802d4a0 con 0x55606fae29a0 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 10 client.19530 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 10 client.19530 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 20 client.19530 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606faf8600 0x55606fafa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 4 client.19530 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55606fa53a20 con 0x55606faf8600 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606faf8600 0x55606fafa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5db6ff5640 10 client.19530 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.246+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606faf8600 0x55606fafa9f0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0b6750d12a6d2ec server_cookie=f349b6db0be4b7fe in_seq=0 out_seq=0 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3896738949 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55606fa53a20 con 0x55606faf8600 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5db6ff5640 10 client.19530 handle_command_reply: tid=0 2024-09-19T09:32:57.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 client.19530 shutdown 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 msgr2=0x55606faecc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8010010 tx=0x7f5dc800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 shutdown_connections 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606faf8600 0x55606fafa9f0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606faf4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3896738949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae29a0 0x55606faecc80 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5db6ff5640 0 client.19530 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 >> 172.21.15.52:0/3896738949 conn(0x55606fade010 msgr2=0x55606fadf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 shutdown_connections 2024-09-19T09:32:57.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 1 -- 172.21.15.52:0/3896738949 wait complete. 2024-09-19T09:32:57.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.247+0000 7f5ddc090740 20 client.19530 trim_cache size 0 max 16384 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 Processor -- start 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 -- start start 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae29a0 0x55606fadd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faf4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41ab990 con 0x55606fae8370 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41a9260 con 0x55606fae32e0 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5ddc090740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41a70b0 con 0x55606fae29a0 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57740/0 (socket says 172.21.15.52:57740) 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 -- 172.21.15.52:0/30994022 learned_addr learned my addr 172.21.15.52:0/30994022 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faf4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 -- 172.21.15.52:0/30994022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae29a0 msgr2=0x55606fadd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae29a0 0x55606fadd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 -- 172.21.15.52:0/30994022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 msgr2=0x55606faf4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faf4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 -- 172.21.15.52:0/30994022 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55606faead50 con 0x55606fae8370 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.262+0000 7f5dd259c640 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005580 tx=0x7f5dc8011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bacd917733a40e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5db8ff9640 1 -- 172.21.15.52:0/30994022 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800a340 con 0x55606fae8370 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5db8ff9640 1 -- 172.21.15.52:0/30994022 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc8004ee0 con 0x55606fae8370 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5db8ff9640 1 -- 172.21.15.52:0/30994022 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc802dc50 con 0x55606fae8370 2024-09-19T09:32:57.268 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- 172.21.15.52:0/30994022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 msgr2=0x55606fadf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8005580 tx=0x7f5dc8011790 comp rx=0 tx=0).stop 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- 172.21.15.52:0/30994022 shutdown_connections 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae8370 0x55606fadf400 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae32e0 0x55606faf4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 --2- 172.21.15.52:0/30994022 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae29a0 0x55606fadd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- 172.21.15.52:0/30994022 >> 172.21.15.52:0/30994022 conn(0x55606fade010 msgr2=0x55606fadc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- 172.21.15.52:0/30994022 shutdown_connections 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- 172.21.15.52:0/30994022 wait complete. 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.263+0000 7f5ddc090740 1 -- start start 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 Processor -- start 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606faf1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606fb61280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41a7720 con 0x55606fae32e0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41a8b90 con 0x55606fae29a0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd41a7df0 con 0x55606fae8370 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5ddc090740 10 client.0 _ll_register_callbacks cb 0x7f5dc800ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57748/0 (socket says 172.21.15.52:57748) 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 -- 172.21.15.52:0/3056678249 learned_addr learned my addr 172.21.15.52:0/3056678249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606faf1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606fb61280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 -- 172.21.15.52:0/3056678249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 msgr2=0x55606fb61280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606fb61280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.270 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 -- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 msgr2=0x55606faf1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606faf1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 -- 172.21.15.52:0/3056678249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606fb61870 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606fb61280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5dd2d9d640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4031610 tx=0x7f5dc4031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edb0598df2f474e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5db6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.264+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4048070 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5dc40035f0 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc8004ee0 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5dc4054050 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 10 client.19536 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55606fb62bf0 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc8004ee0 con 0x55606fae32e0 2024-09-19T09:32:57.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5dc403c8b0 con 0x55606fae32e0 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 10 client.19536 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 10 client.19536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 20 client.19536 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606fb635a0 0x55606fb659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 4 client.19536 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55606fa4dd70 con 0x55606fb635a0 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.265+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606fb635a0 0x55606fb659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.266+0000 7f5dd259c640 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606fb635a0 0x55606fb659c0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f54405c8b6c9e9 server_cookie=22aabf60654a189b in_seq=0 out_seq=0 2024-09-19T09:32:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.266+0000 7f5db6ff5640 10 client.19536 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.280+0000 7f5db6ff5640 1 -- 172.21.15.52:0/3056678249 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55606fa4dd70 con 0x55606fb635a0 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.280+0000 7f5db6ff5640 10 client.19536 handle_command_reply: tid=0 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.280+0000 7f5ddc090740 1 client.19536 shutdown 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.280+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 msgr2=0x55606faf1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.280+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4031610 tx=0x7f5dc4031b20 comp rx=0 tx=0).stop 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 shutdown_connections 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55606fb635a0 0x55606fb659c0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55606fae8370 0x55606fb61280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55606fae32e0 0x55606faf1670 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5db6ff5640 0 client.19536 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 --2- 172.21.15.52:0/3056678249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55606fae29a0 0x55606faf1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 >> 172.21.15.52:0/3056678249 conn(0x55606fade010 msgr2=0x55606fadd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 shutdown_connections 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 1 -- 172.21.15.52:0/3056678249 wait complete. 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5ddc090740 20 client.19536 trim_cache size 0 max 16384 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:32:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:32:57.284 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 msgr2=0x7f5dbc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 0x7f5dbc0a57b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc09c1f0 tx=0x7f5dcc091940 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 msgr2=0x7f5dd419f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00cce0 tx=0x7f5dcc00a620 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 shutdown_connections 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102610 0x7f5dd419f2c0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5dbc0a32f0 0x7f5dbc0a57b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5dd4101c50 0x7f5dd4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 --2- 172.21.15.52:0/1933567239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5dd4100a60 0x7f5dd4197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 >> 172.21.15.52:0/1933567239 conn(0x7f5dd40fc1e0 msgr2=0x7f5dd40fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 shutdown_connections 2024-09-19T09:32:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:32:57.281+0000 7f5dd921e640 1 -- 172.21.15.52:0/1933567239 wait complete. 2024-09-19T09:32:57.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:32:58.060 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.563+0000 7f4658d85640 1 -- 172.21.15.52:0/2408165773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 msgr2=0x7f465410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.563+0000 7f4658d85640 1 --2- 172.21.15.52:0/2408165773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465410d950 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f464c009cd0 tx=0x7f464c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 -- 172.21.15.52:0/2408165773 shutdown_connections 2024-09-19T09:32:58.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 --2- 172.21.15.52:0/2408165773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465410d950 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 --2- 172.21.15.52:0/2408165773 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f4654100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 --2- 172.21.15.52:0/2408165773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 0x7f4654106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 -- 172.21.15.52:0/2408165773 >> 172.21.15.52:0/2408165773 conn(0x7f46540fc7a0 msgr2=0x7f46540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 -- 172.21.15.52:0/2408165773 shutdown_connections 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 -- 172.21.15.52:0/2408165773 wait complete. 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 Processor -- start 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.564+0000 7f4658d85640 1 -- start start 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f465419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 0x7f465419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4654110ef0 con 0x7f4654101420 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4654110d70 con 0x7f4654106a80 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4658d85640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4654111070 con 0x7f4654100a80 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34768/0 (socket says 172.21.15.52:34768) 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 -- 172.21.15.52:0/1063128327 learned_addr learned my addr 172.21.15.52:0/1063128327 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4652d9d640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 0x7f465419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f465259c640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f465419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 -- 172.21.15.52:0/1063128327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 msgr2=0x7f465419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f465419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 -- 172.21.15.52:0/1063128327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 msgr2=0x7f465419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 0x7f465419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 -- 172.21.15.52:0/1063128327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465419f600 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f465259c640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f465419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.565+0000 7f4651d9b640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f464800c890 tx=0x7f464800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.566+0000 7f46437fe640 1 -- 172.21.15.52:0/1063128327 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648004220 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.566+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465419f8f0 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.566+0000 7f46437fe640 1 -- 172.21.15.52:0/1063128327 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46480043c0 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.566+0000 7f46437fe640 1 -- 172.21.15.52:0/1063128327 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480049e0 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.566+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46541a71d0 con 0x7f4654101420 2024-09-19T09:32:58.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.568+0000 7f46437fe640 1 -- 172.21.15.52:0/1063128327 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f46480079b0 con 0x7f4654101420 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.568+0000 7f465b15e740 1 Processor -- start 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 -- start start 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbbe42f0 con 0x55c2fbc89370 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbb8bcf0 con 0x55c2fbc7fb40 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465b15e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbbe02b0 con 0x55c2fbc7e5d0 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34782/0 (socket says 172.21.15.52:34782) 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 -- 172.21.15.52:0/3345272883 learned_addr learned my addr 172.21.15.52:0/3345272883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f465259c640 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4652d9d640 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f46437fe640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 0x7f463c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4652d9d640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 0x7f463c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 -- 172.21.15.52:0/3345272883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 msgr2=0x55c2fbc7ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc7ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 -- 172.21.15.52:0/3345272883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7fb40 msgr2=0x55c2fbc7e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.569+0000 7f4651d9b640 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc7e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f46437fe640 1 -- 172.21.15.52:0/1063128327 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f46480cfaa0 con 0x7f4654101420 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4651d9b640 1 -- 172.21.15.52:0/3345272883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fbb703a0 con 0x55c2fbc89370 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4651d9b640 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f46480cd520 tx=0x7f4648005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcf6b98b60682a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4652d9d640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 0x7f463c0a5700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f464c005fe0 tx=0x7f464c02a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4640ff9640 1 -- 172.21.15.52:0/3345272883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464801d030 con 0x55c2fbc89370 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4640ff9640 1 -- 172.21.15.52:0/3345272883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f464809c740 con 0x55c2fbc89370 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.570+0000 7f4640ff9640 1 -- 172.21.15.52:0/3345272883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480a03f0 con 0x55c2fbc89370 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- 172.21.15.52:0/3345272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 msgr2=0x55c2fbc8b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f46480cd520 tx=0x7f4648005300 comp rx=0 tx=0).stop 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- 172.21.15.52:0/3345272883 shutdown_connections 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc8b760 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc7ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 --2- 172.21.15.52:0/3345272883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc7e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- 172.21.15.52:0/3345272883 >> 172.21.15.52:0/3345272883 conn(0x55c2fbc47310 msgr2=0x55c2fbc7ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- 172.21.15.52:0/3345272883 shutdown_connections 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- 172.21.15.52:0/3345272883 wait complete. 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 -- start start 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.571+0000 7f465b15e740 1 Processor -- start 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc88df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc860a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbc8c010 con 0x55c2fbc89370 2024-09-19T09:32:58.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbb9f060 con 0x55c2fbc7e5d0 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c2fbc8c190 con 0x55c2fbc7fb40 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465b15e740 10 client.0 _ll_register_callbacks cb 0x55c2fb8f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34796/0 (socket says 172.21.15.52:34796) 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 -- 172.21.15.52:0/2744192363 learned_addr learned my addr 172.21.15.52:0/2744192363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465259c640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc88df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc860a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 -- 172.21.15.52:0/2744192363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7fb40 msgr2=0x55c2fbc860a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc860a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 -- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 msgr2=0x55c2fbc88df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc88df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 -- 172.21.15.52:0/2744192363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fb9553c0 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f465259c640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc88df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f464c009cd0 tx=0x7f464c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64634a1a53a068bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.572+0000 7f4639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.575+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c0043c0 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.575+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464809c740 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.575+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f464c004560 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f464c004760 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 10 client.19548 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2fbc97b90 con 0x55c2fbc89370 2024-09-19T09:32:58.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f464809c740 con 0x55c2fbc89370 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f464c047070 con 0x55c2fbc89370 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 10 client.19548 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 10 client.19548 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 20 client.19548 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbc98ff0 0x55c2fbc9b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 4 client.19548 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2fbbf1860 con 0x55c2fbc98ff0 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.576+0000 7f465259c640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbc98ff0 0x55c2fbc9b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.577+0000 7f465259c640 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbc98ff0 0x55c2fbc9b420 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=298bbeee0519a8b6 server_cookie=8439f5d2618dd7e0 in_seq=0 out_seq=0 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.577+0000 7f4639ffb640 10 client.19548 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:58.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.577+0000 7f4639ffb640 1 -- 172.21.15.52:0/2744192363 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2fbbf1860 con 0x55c2fbc98ff0 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.577+0000 7f4639ffb640 10 client.19548 handle_command_reply: tid=0 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.577+0000 7f465b15e740 1 client.19548 shutdown 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 msgr2=0x55c2fbc867e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f464c009cd0 tx=0x7f464c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 shutdown_connections 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc89370 0x55c2fbc867e0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc860a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbc98ff0 0x55c2fbc9b420 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 --2- 172.21.15.52:0/2744192363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc88df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f4639ffb640 0 client.19548 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 >> 172.21.15.52:0/2744192363 conn(0x55c2fbc47310 msgr2=0x55c2fbc80990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 shutdown_connections 2024-09-19T09:32:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 1 -- 172.21.15.52:0/2744192363 wait complete. 2024-09-19T09:32:58.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.578+0000 7f465b15e740 20 client.19548 trim_cache size 0 max 16384 2024-09-19T09:32:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 Processor -- start 2024-09-19T09:32:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 -- start start 2024-09-19T09:32:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbca0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46541b2340 con 0x55c2fbc7fb40 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46541afc10 con 0x55c2fbc89370 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.591+0000 7f465b15e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ada60 con 0x55c2fbc7e5d0 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34810/0 (socket says 172.21.15.52:34810) 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 -- 172.21.15.52:0/2356966791 learned_addr learned my addr 172.21.15.52:0/2356966791 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f465259c640 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbca0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 -- 172.21.15.52:0/2356966791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 msgr2=0x55c2fbc952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 -- 172.21.15.52:0/2356966791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 msgr2=0x55c2fbca0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbca0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 -- 172.21.15.52:0/2356966791 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2fbc957f0 con 0x55c2fbc7fb40 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f46480cd570 tx=0x7f4648020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cf6300579c491b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f463bfff640 1 -- 172.21.15.52:0/2356966791 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464801d040 con 0x55c2fbc7fb40 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f463bfff640 1 -- 172.21.15.52:0/2356966791 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f464809c740 con 0x55c2fbc7fb40 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.592+0000 7f463bfff640 1 -- 172.21.15.52:0/2356966791 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480a03f0 con 0x55c2fbc7fb40 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- 172.21.15.52:0/2356966791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 msgr2=0x55c2fbc88010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f46480cd570 tx=0x7f4648020000 comp rx=0 tx=0).stop 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- 172.21.15.52:0/2356966791 shutdown_connections 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbca0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc88010 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 --2- 172.21.15.52:0/2356966791 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- 172.21.15.52:0/2356966791 >> 172.21.15.52:0/2356966791 conn(0x55c2fbc47310 msgr2=0x55c2fbc87900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- 172.21.15.52:0/2356966791 shutdown_connections 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- 172.21.15.52:0/2356966791 wait complete. 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 -- start start 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.593+0000 7f465b15e740 1 Processor -- start 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc91ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbc8d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ae0d0 con 0x55c2fbc7fb40 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46541af540 con 0x55c2fbc89370 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f46541ae7a0 con 0x55c2fbc7e5d0 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 10 client.0 _ll_register_callbacks cb 0x7f464c0316c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:32:58.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34814/0 (socket says 172.21.15.52:34814) 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 -- 172.21.15.52:0/2539332226 learned_addr learned my addr 172.21.15.52:0/2539332226 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465259c640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc91ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbc8d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 -- 172.21.15.52:0/2539332226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 msgr2=0x55c2fbc91ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc91ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 -- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 msgr2=0x55c2fbc8d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbc8d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 -- 172.21.15.52:0/2539332226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2fbc8dbb0 con 0x55c2fbc7fb40 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4652d9d640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbc8d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4651d9b640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f464809bd40 tx=0x7f4648061150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d9a47df2166bd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:58.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464801d040 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4648097d90 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.594+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464809c740 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f46480b5020 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 10 client.19554 fetch_fsmap learned FSMap version 24 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c2fbd03c30 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f464809c740 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f46480d3210 con 0x55c2fbc7fb40 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 10 client.19554 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 10 client.19554 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 20 client.19554 populate_metadata read hostname 'smithi052' 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbd03f50 0x55c2fbd06340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 4 client.19554 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:32:58.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2fbbebd70 con 0x55c2fbd03f50 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465259c640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbd03f50 0x55c2fbd06340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.595+0000 7f465259c640 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbd03f50 0x55c2fbd06340 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ab6ac76530ff1d0 server_cookie=35d489c451f01ad1 in_seq=0 out_seq=0 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f4639ffb640 10 client.19554 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f4639ffb640 1 -- 172.21.15.52:0/2539332226 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2fbbebd70 con 0x55c2fbd03f50 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f4639ffb640 10 client.19554 handle_command_reply: tid=0 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 client.19554 shutdown 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 msgr2=0x55c2fbc8ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f464809bd40 tx=0x7f4648061150 comp rx=0 tx=0).stop 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 shutdown_connections 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55c2fbd03f50 0x55c2fbd06340 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c2fbc89370 0x55c2fbc8d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c2fbc7fb40 0x55c2fbc8ce60 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 --2- 172.21.15.52:0/2539332226 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2fbc7e5d0 0x55c2fbc91ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 >> 172.21.15.52:0/2539332226 conn(0x55c2fbc47310 msgr2=0x55c2fbc88120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f4639ffb640 0 client.19554 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 shutdown_connections 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 1 -- 172.21.15.52:0/2539332226 wait complete. 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.596+0000 7f465b15e740 20 client.19554 trim_cache size 0 max 16384 2024-09-19T09:32:58.613 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 msgr2=0x7f463c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 0x7f463c0a5700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f464c005fe0 tx=0x7f464c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 msgr2=0x7f465419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f464800c890 tx=0x7f464800cd50 comp rx=0 tx=0).stop 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 shutdown_connections 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4654106a80 0x7f465419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4654101420 0x7f465419ab90 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f463c0a3240 0x7f463c0a5700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 --2- 172.21.15.52:0/1063128327 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4654100a80 0x7f465419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 >> 172.21.15.52:0/1063128327 conn(0x7f46540fc7a0 msgr2=0x7f46540fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 shutdown_connections 2024-09-19T09:32:58.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:32:58.597+0000 7f4658d85640 1 -- 172.21.15.52:0/1063128327 wait complete. 2024-09-19T09:32:58.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:32:58 smithi052 ceph-mon[30947]: pgmap v684: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:32:58.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:32:58 smithi169 ceph-mon[35454]: pgmap v684: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:32:59.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:32:58 smithi086 ceph-mon[34813]: pgmap v684: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:32:59.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:32:59.594 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 -- 172.21.15.52:0/2330880960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102570 msgr2=0x7f5d2c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 --2- 172.21.15.52:0/2330880960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102570 0x7f5d2c1029b0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009900 tx=0x7f5d2002a480 comp rx=0 tx=0).stop 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 -- 172.21.15.52:0/2330880960 shutdown_connections 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 --2- 172.21.15.52:0/2330880960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 --2- 172.21.15.52:0/2330880960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102570 0x7f5d2c1029b0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 --2- 172.21.15.52:0/2330880960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c100e20 0x7f5d2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 -- 172.21.15.52:0/2330880960 >> 172.21.15.52:0/2330880960 conn(0x7f5d2c0fc7d0 msgr2=0x7f5d2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 -- 172.21.15.52:0/2330880960 shutdown_connections 2024-09-19T09:33:00.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.039+0000 7f5d32f49640 1 -- 172.21.15.52:0/2330880960 wait complete. 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 Processor -- start 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 -- start start 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c100e20 0x7f5d2c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 0x7f5d2c109700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c10fe70 con 0x7f5d2c102ef0 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c10fcf0 con 0x7f5d2c100e20 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d32f49640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c10fff0 con 0x7f5d2c102570 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34840/0 (socket says 172.21.15.52:34840) 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 -- 172.21.15.52:0/430772008 learned_addr learned my addr 172.21.15.52:0/430772008 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c100e20 0x7f5d2c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 0x7f5d2c109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 -- 172.21.15.52:0/430772008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 msgr2=0x7f5d2c109700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 0x7f5d2c109700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 -- 172.21.15.52:0/430772008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c100e20 msgr2=0x7f5d2c10d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c100e20 0x7f5d2c10d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 -- 172.21.15.52:0/430772008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c10a370 con 0x7f5d2c102ef0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 0x7f5d2c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.040+0000 7f5d314e6640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400cce0 tx=0x7f5d2400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.041+0000 7f5d29ffb640 1 -- 172.21.15.52:0/430772008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400f450 con 0x7f5d2c102ef0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.041+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c1ab250 con 0x7f5d2c102ef0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.041+0000 7f5d29ffb640 1 -- 172.21.15.52:0/430772008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2400fad0 con 0x7f5d2c102ef0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.041+0000 7f5d29ffb640 1 -- 172.21.15.52:0/430772008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24018b70 con 0x7f5d2c102ef0 2024-09-19T09:33:00.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.041+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c1ab5f0 con 0x7f5d2c102ef0 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.043+0000 7f5d29ffb640 1 -- 172.21.15.52:0/430772008 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5d2400fc80 con 0x7f5d2c102ef0 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 Processor -- start 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 -- start start 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab152b40 0x55f8ab151090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab0b72f0 con 0x55f8ab15c370 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab05ecf0 con 0x55f8ab1515d0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d35322740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab0b32b0 con 0x55f8ab152b40 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d29ffb640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 0x7f5d140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34852/0 (socket says 172.21.15.52:34852) 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d2bfff640 1 -- 172.21.15.52:0/297956797 learned_addr learned my addr 172.21.15.52:0/297956797 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d314e6640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 0x7f5d140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab152b40 0x55f8ab151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.044+0000 7f5d29ffb640 1 -- 172.21.15.52:0/430772008 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5d240cfd80 con 0x7f5d2c102ef0 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 -- 172.21.15.52:0/297956797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab152b40 msgr2=0x55f8ab151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab152b40 0x55f8ab151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 -- 172.21.15.52:0/297956797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 msgr2=0x55f8ab151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 -- 172.21.15.52:0/297956797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ab0433a0 con 0x55f8ab15c370 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f5d20005770 tx=0x7f5d20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79d812ccca4799b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d314e6640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 0x7f5d140a5780 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5d2401de80 tx=0x7f5d2406bf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d12ffd640 1 -- 172.21.15.52:0/297956797 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20035040 con 0x55f8ab15c370 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d12ffd640 1 -- 172.21.15.52:0/297956797 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d200038c0 con 0x55f8ab15c370 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.045+0000 7f5d12ffd640 1 -- 172.21.15.52:0/297956797 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004920 con 0x55f8ab15c370 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- 172.21.15.52:0/297956797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 msgr2=0x55f8ab15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f5d20005770 tx=0x7f5d20000bc0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- 172.21.15.52:0/297956797 shutdown_connections 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab15e760 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 --2- 172.21.15.52:0/297956797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab152b40 0x55f8ab151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- 172.21.15.52:0/297956797 >> 172.21.15.52:0/297956797 conn(0x55f8ab11a310 msgr2=0x55f8ab14dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- 172.21.15.52:0/297956797 shutdown_connections 2024-09-19T09:33:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- 172.21.15.52:0/297956797 wait complete. 2024-09-19T09:33:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 -- start start 2024-09-19T09:33:00.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.046+0000 7f5d35322740 1 Processor -- start 2024-09-19T09:33:00.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab152b40 0x55f8ab159030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab15f010 con 0x55f8ab15c370 2024-09-19T09:33:00.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab072060 con 0x55f8ab152b40 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f8ab15f190 con 0x55f8ab1515d0 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d35322740 10 client.0 _ll_register_callbacks cb 0x55f8aadc58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34858/0 (socket says 172.21.15.52:34858) 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 -- 172.21.15.52:0/2236243203 learned_addr learned my addr 172.21.15.52:0/2236243203 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab152b40 0x55f8ab159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 -- 172.21.15.52:0/2236243203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 msgr2=0x55f8ab15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 -- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab152b40 msgr2=0x55f8ab159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab152b40 0x55f8ab159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 -- 172.21.15.52:0/2236243203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8aae283c0 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001eb0 tx=0x7f5d20004510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fef3a7fc6171d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.047+0000 7f5d0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20035070 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5d20032b90 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d200038c0 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5d20051020 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 10 client.19566 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f8ab16ab10 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d200038c0 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5d2003a040 con 0x55f8ab15c370 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 10 client.19566 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 10 client.19566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 20 client.19566 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab16be60 0x55f8ab16e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 4 client.19566 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.048+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8ab0c4860 con 0x55f8ab16be60 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.049+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab16be60 0x55f8ab16e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.049+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab16be60 0x55f8ab16e250 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9227bbc296d9e server_cookie=a3da33aa8585e40c in_seq=0 out_seq=0 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.049+0000 7f5d0bfff640 10 client.19566 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d0bfff640 1 -- 172.21.15.52:0/2236243203 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8ab0c4860 con 0x55f8ab16be60 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d0bfff640 10 client.19566 handle_command_reply: tid=0 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 client.19566 shutdown 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 msgr2=0x55f8ab159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001eb0 tx=0x7f5d20004510 comp rx=0 tx=0).stop 2024-09-19T09:33:00.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 shutdown_connections 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab16be60 0x55f8ab16e250 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab15c370 0x55f8ab159640 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab152b40 0x55f8ab159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d0bfff640 0 client.19566 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 --2- 172.21.15.52:0/2236243203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 >> 172.21.15.52:0/2236243203 conn(0x55f8ab11a310 msgr2=0x55f8ab153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 shutdown_connections 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 1 -- 172.21.15.52:0/2236243203 wait complete. 2024-09-19T09:33:00.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.050+0000 7f5d35322740 20 client.19566 trim_cache size 0 max 16384 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 Processor -- start 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 -- start start 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab168460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab15c370 0x55f8ab1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b6640 con 0x55f8ab152b40 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b3f10 con 0x55f8ab1515d0 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d35322740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b1d60 con 0x55f8ab15c370 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34872/0 (socket says 172.21.15.52:34872) 2024-09-19T09:33:00.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 -- 172.21.15.52:0/1816232197 learned_addr learned my addr 172.21.15.52:0/1816232197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 -- 172.21.15.52:0/1816232197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab15c370 msgr2=0x55f8ab1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab15c370 0x55f8ab1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 -- 172.21.15.52:0/1816232197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 msgr2=0x55f8ab168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.063+0000 7f5d30ce5640 1 -- 172.21.15.52:0/1816232197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ab158020 con 0x55f8ab152b40 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x55f8ab1588c0 tx=0x7f5d1c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f492009f688c2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d127fc640 1 -- 172.21.15.52:0/1816232197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c003e20 con 0x55f8ab152b40 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d127fc640 1 -- 172.21.15.52:0/1816232197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d1c026920 con 0x55f8ab152b40 2024-09-19T09:33:00.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d127fc640 1 -- 172.21.15.52:0/1816232197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011a70 con 0x55f8ab152b40 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 -- 172.21.15.52:0/1816232197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 msgr2=0x55f8ab14de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x55f8ab1588c0 tx=0x7f5d1c00b390 comp rx=0 tx=0).stop 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 -- 172.21.15.52:0/1816232197 shutdown_connections 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab15c370 0x55f8ab1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab14de10 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 --2- 172.21.15.52:0/1816232197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab1515d0 0x55f8ab168460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.064+0000 7f5d35322740 1 -- 172.21.15.52:0/1816232197 >> 172.21.15.52:0/1816232197 conn(0x55f8ab11a310 msgr2=0x55f8ab14d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- 172.21.15.52:0/1816232197 shutdown_connections 2024-09-19T09:33:00.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- 172.21.15.52:0/1816232197 wait complete. 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- start start 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 Processor -- start 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab171850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab15c370 0x55f8ab16f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b23d0 con 0x55f8ab152b40 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b3840 con 0x55f8ab15c370 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c1b2aa0 con 0x55f8ab1515d0 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d35322740 10 client.0 _ll_register_callbacks cb 0x7f5d1c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.065+0000 7f5d30ce5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34884/0 (socket says 172.21.15.52:34884) 2024-09-19T09:33:00.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 -- 172.21.15.52:0/3901341181 learned_addr learned my addr 172.21.15.52:0/3901341181 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab171850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 -- 172.21.15.52:0/3901341181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 msgr2=0x55f8ab171850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab171850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 -- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab15c370 msgr2=0x55f8ab16f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab15c370 0x55f8ab16f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 -- 172.21.15.52:0/3901341181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ab15c0f0 con 0x55f8ab152b40 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab171850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d30ce5640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x55f8ab1588c0 tx=0x7f5d1c003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624fc5b3bd3bad79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c003e90 con 0x55f8ab152b40 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5d1c026ad0 con 0x55f8ab152b40 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d1c026920 con 0x55f8ab152b40 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5d1c034030 con 0x55f8ab152b40 2024-09-19T09:33:00.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d35322740 10 client.19572 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.066+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f8ab1d6440 con 0x55f8ab152b40 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d1c026920 con 0x55f8ab152b40 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5d1c024020 con 0x55f8ab152b40 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 10 client.19572 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 10 client.19572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 20 client.19572 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab1d6b30 0x55f8ab1d8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 4 client.19572 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8ab0bed70 con 0x55f8ab1d6b30 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab1d6b30 0x55f8ab1d8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d2bfff640 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab1d6b30 0x55f8ab1d8f50 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=738677f6b443d125 server_cookie=9c3b52e2849248c5 in_seq=0 out_seq=0 2024-09-19T09:33:00.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.067+0000 7f5d0bfff640 10 client.19572 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d0bfff640 1 -- 172.21.15.52:0/3901341181 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8ab0bed70 con 0x55f8ab1d6b30 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d0bfff640 10 client.19572 handle_command_reply: tid=0 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 client.19572 shutdown 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 msgr2=0x55f8ab16ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x55f8ab1588c0 tx=0x7f5d1c003ca0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 shutdown_connections 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f8ab1d6b30 0x55f8ab1d8f50 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f8ab15c370 0x55f8ab16f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f8ab152b40 0x55f8ab16ebf0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d0bfff640 0 client.19572 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 --2- 172.21.15.52:0/3901341181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f8ab1515d0 0x55f8ab171850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 >> 172.21.15.52:0/3901341181 conn(0x55f8ab11a310 msgr2=0x55f8ab14c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 shutdown_connections 2024-09-19T09:33:00.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 1 -- 172.21.15.52:0/3901341181 wait complete. 2024-09-19T09:33:00.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.068+0000 7f5d35322740 20 client.19572 trim_cache size 0 max 16384 2024-09-19T09:33:00.075 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 msgr2=0x7f5d140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 0x7f5d140a5780 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5d2401de80 tx=0x7f5d2406bf90 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 msgr2=0x7f5d2c109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400cce0 tx=0x7f5d2400a620 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 shutdown_connections 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5d2c102ef0 0x7f5d2c109c40 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5d140a32c0 0x7f5d140a5780 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d2c102570 0x7f5d2c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 --2- 172.21.15.52:0/430772008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5d2c100e20 0x7f5d2c10d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 >> 172.21.15.52:0/430772008 conn(0x7f5d2c0fc7d0 msgr2=0x7f5d2c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 shutdown_connections 2024-09-19T09:33:00.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:00.069+0000 7f5d32f49640 1 -- 172.21.15.52:0/430772008 wait complete. 2024-09-19T09:33:00.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:00 smithi052 ceph-mon[30947]: pgmap v685: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:00.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:00 smithi169 ceph-mon[35454]: pgmap v685: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:00 smithi086 ceph-mon[34813]: pgmap v685: 97 pgs: 97 active+clean; 1.7 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:01.802 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:33:01.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:33:02.076 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:02.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- 172.21.15.52:0/671672690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68101de0 msgr2=0x7faf681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 --2- 172.21.15.52:0/671672690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68101de0 0x7faf681021c0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7faf58009900 tx=0x7faf5802a410 comp rx=0 tx=0).stop 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- 172.21.15.52:0/671672690 shutdown_connections 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 --2- 172.21.15.52:0/671672690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68106f10 0x7faf6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 --2- 172.21.15.52:0/671672690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 0x7faf681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 --2- 172.21.15.52:0/671672690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68101de0 0x7faf681021c0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- 172.21.15.52:0/671672690 >> 172.21.15.52:0/671672690 conn(0x7faf680fd8c0 msgr2=0x7faf680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- 172.21.15.52:0/671672690 shutdown_connections 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- 172.21.15.52:0/671672690 wait complete. 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 Processor -- start 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.559+0000 7faf6edfc640 1 -- start start 2024-09-19T09:33:02.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 0x7faf6819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 0x7faf6819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf68111f70 con 0x7faf68106f10 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf68111df0 con 0x7faf68101de0 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6edfc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf681120f0 con 0x7faf68102790 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34894/0 (socket says 172.21.15.52:34894) 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 -- 172.21.15.52:0/3824671497 learned_addr learned my addr 172.21.15.52:0/3824671497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf67fff640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 0x7faf6819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6cb98640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 0x7faf6819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 -- 172.21.15.52:0/3824671497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 msgr2=0x7faf6819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 0x7faf6819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 -- 172.21.15.52:0/3824671497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 msgr2=0x7faf6819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 0x7faf6819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 -- 172.21.15.52:0/3824671497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6819f620 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6cb98640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 0x7faf6819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf6d399640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7faf6000cce0 tx=0x7faf6000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.560+0000 7faf65ffb640 1 -- 172.21.15.52:0/3824671497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6000f450 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.561+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6819f910 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.561+0000 7faf65ffb640 1 -- 172.21.15.52:0/3824671497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf6000fad0 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.561+0000 7faf65ffb640 1 -- 172.21.15.52:0/3824671497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60018c10 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.561+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf681a71f0 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.563+0000 7faf65ffb640 1 -- 172.21.15.52:0/3824671497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faf6000f5f0 con 0x7faf68106f10 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 Processor -- start 2024-09-19T09:33:02.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 -- start start 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f83c865280 con 0x55f83c8ffb60 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f83c80cb10 con 0x55f83c90ad40 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf711d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f83c861240 con 0x55f83c900480 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf65ffb640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 0x7faf500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34902/0 (socket says 172.21.15.52:34902) 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 -- 172.21.15.52:0/876572196 learned_addr learned my addr 172.21.15.52:0/876572196 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf6d399640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 0x7faf500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf6cb98640 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf65ffb640 1 -- 172.21.15.52:0/3824671497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf600d0010 con 0x7faf68106f10 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 -- 172.21.15.52:0/876572196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 msgr2=0x55f83c90a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.564+0000 7faf67fff640 1 -- 172.21.15.52:0/876572196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 msgr2=0x55f83c90d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf67fff640 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf67fff640 1 -- 172.21.15.52:0/876572196 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c8191f0 con 0x55f83c8ffb60 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf67fff640 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004650 tx=0x7faf5c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69052ab5805aecef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf6d399640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 0x7faf500a5700 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf6009c2b0 tx=0x7faf60066f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf4effd640 1 -- 172.21.15.52:0/876572196 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c005020 con 0x55f83c8ffb60 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf4effd640 1 -- 172.21.15.52:0/876572196 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5c0056a0 con 0x55f83c8ffb60 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.565+0000 7faf4effd640 1 -- 172.21.15.52:0/876572196 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0106c0 con 0x55f83c8ffb60 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- 172.21.15.52:0/876572196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 msgr2=0x55f83c8fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004650 tx=0x7faf5c004250 comp rx=0 tx=0).stop 2024-09-19T09:33:02.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- 172.21.15.52:0/876572196 shutdown_connections 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 --2- 172.21.15.52:0/876572196 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c8fff40 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- 172.21.15.52:0/876572196 >> 172.21.15.52:0/876572196 conn(0x55f83c8fc0f0 msgr2=0x55f83c8fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- 172.21.15.52:0/876572196 shutdown_connections 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- 172.21.15.52:0/876572196 wait complete. 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 -- start start 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.566+0000 7faf711d5740 1 Processor -- start 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 0x55f83c907c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c908690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f83c90d910 con 0x55f83c900480 2024-09-19T09:33:02.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f83c81ff10 con 0x55f83c90ad40 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f83c90da90 con 0x55f83c8ffb60 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 10 client.0 _ll_register_callbacks cb 0x55f83c7e8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34916/0 (socket says 172.21.15.52:34916) 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 -- 172.21.15.52:0/1686504634 learned_addr learned my addr 172.21.15.52:0/1686504634 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf67fff640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 0x55f83c907c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf67fff640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c908690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 -- 172.21.15.52:0/1686504634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 msgr2=0x55f83c907c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 0x55f83c907c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 -- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 msgr2=0x55f83c908690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c908690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 -- 172.21.15.52:0/1686504634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83c5d66a0 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf67fff640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 0x55f83c907c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf6cb98640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7faf5802a930 tx=0x7faf580319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae1cdb6318aec04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf47fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58035030 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5c0056a0 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.567+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf58004460 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf58048030 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 10 client.19584 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f83c919510 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5c0056a0 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf58004c70 con 0x55f83c900480 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 10 client.19584 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:02.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 10 client.19584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 20 client.19584 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c91a9d0 0x55f83c91cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 4 client.19584 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f83c8727f0 con 0x55f83c91a9d0 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.568+0000 7faf67fff640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c91a9d0 0x55f83c91cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.569+0000 7faf67fff640 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c91a9d0 0x55f83c91cdf0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f76933be5b64d6 server_cookie=2727aec49fe9061 in_seq=0 out_seq=0 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.569+0000 7faf47fff640 10 client.19584 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.569+0000 7faf47fff640 1 -- 172.21.15.52:0/1686504634 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f83c8727f0 con 0x55f83c91a9d0 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.569+0000 7faf47fff640 10 client.19584 handle_command_reply: tid=0 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 client.19584 shutdown 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 msgr2=0x55f83c908150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7faf5802a930 tx=0x7faf580319a0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 shutdown_connections 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c91a9d0 0x55f83c91cdf0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c908690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c900480 0x55f83c908150 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 --2- 172.21.15.52:0/1686504634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c8ffb60 0x55f83c907c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 >> 172.21.15.52:0/1686504634 conn(0x55f83c8fc0f0 msgr2=0x55f83c901dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf47fff640 0 client.19584 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 shutdown_connections 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 1 -- 172.21.15.52:0/1686504634 wait complete. 2024-09-19T09:33:02.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.570+0000 7faf711d5740 20 client.19584 trim_cache size 0 max 16384 2024-09-19T09:33:02.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 Processor -- start 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 -- start start 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c9226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c922c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf681b2160 con 0x55f83c8ffb60 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf681afa30 con 0x55f83c90ad40 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf711d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf681ad880 con 0x55f83c900480 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34928/0 (socket says 172.21.15.52:34928) 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 -- 172.21.15.52:0/3915624314 learned_addr learned my addr 172.21.15.52:0/3915624314 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf6cb98640 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c9226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c922c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 -- 172.21.15.52:0/3915624314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 msgr2=0x55f83c9226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c9226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 -- 172.21.15.52:0/3915624314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 msgr2=0x55f83c922c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c922c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.588+0000 7faf67fff640 1 -- 172.21.15.52:0/3915624314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83c9029d0 con 0x55f83c8ffb60 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf67fff640 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004c80 tx=0x7faf5c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d330f56b99c05cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf4e7fc640 1 -- 172.21.15.52:0/3915624314 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c032070 con 0x55f83c8ffb60 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf4e7fc640 1 -- 172.21.15.52:0/3915624314 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5c004680 con 0x55f83c8ffb60 2024-09-19T09:33:02.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf4e7fc640 1 -- 172.21.15.52:0/3915624314 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c02c550 con 0x55f83c8ffb60 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf711d5740 1 -- 172.21.15.52:0/3915624314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 msgr2=0x55f83c9084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.589+0000 7faf711d5740 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7faf5c004c80 tx=0x7faf5c00b5b0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- 172.21.15.52:0/3915624314 shutdown_connections 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c922c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c9226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- 172.21.15.52:0/3915624314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c9084e0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- 172.21.15.52:0/3915624314 >> 172.21.15.52:0/3915624314 conn(0x55f83c8fc0f0 msgr2=0x55f83c909b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- 172.21.15.52:0/3915624314 shutdown_connections 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- 172.21.15.52:0/3915624314 wait complete. 2024-09-19T09:33:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- start start 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 Processor -- start 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf681adef0 con 0x55f83c8ffb60 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf681af360 con 0x55f83c90ad40 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.590+0000 7faf711d5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf681ae5c0 con 0x55f83c900480 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf711d5740 10 client.0 _ll_register_callbacks cb 0x7faf58009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34944/0 (socket says 172.21.15.52:34944) 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 -- 172.21.15.52:0/2330961859 learned_addr learned my addr 172.21.15.52:0/2330961859 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf6cb98640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 -- 172.21.15.52:0/2330961859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 msgr2=0x55f83c90ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 -- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 msgr2=0x55f83c90f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 -- 172.21.15.52:0/2330961859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f83c984690 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf67fff640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005650 tx=0x7faf5c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b35c5180167f727 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf47fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5c032070 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf5c004eb0 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.591+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5c004680 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf5c03c020 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 10 client.19590 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f83c985950 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5c004680 con 0x55f83c8ffb60 2024-09-19T09:33:02.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf5c036030 con 0x55f83c8ffb60 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 10 client.19590 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 10 client.19590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 20 client.19590 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c985d90 0x55f83c988180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 4 client.19590 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f83c86cd00 con 0x55f83c985d90 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.592+0000 7faf6cb98640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c985d90 0x55f83c988180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.593+0000 7faf6cb98640 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c985d90 0x55f83c988180 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166399b1f070dc12 server_cookie=e89f7a2cd9a4eaf in_seq=0 out_seq=0 2024-09-19T09:33:02.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.593+0000 7faf47fff640 10 client.19590 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf47fff640 1 -- 172.21.15.52:0/2330961859 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f83c86cd00 con 0x55f83c985d90 2024-09-19T09:33:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf47fff640 10 client.19590 handle_command_reply: tid=0 2024-09-19T09:33:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 client.19590 shutdown 2024-09-19T09:33:02.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 msgr2=0x55f83c90e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7faf5c005650 tx=0x7faf5c00b4f0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 shutdown_connections 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f83c985d90 0x55f83c988180 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf47fff640 0 client.19590 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f83c90ad40 0x55f83c90f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f83c900480 0x55f83c90ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 --2- 172.21.15.52:0/2330961859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f83c8ffb60 0x55f83c90e9e0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 >> 172.21.15.52:0/2330961859 conn(0x55f83c8fc0f0 msgr2=0x55f83c9015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 shutdown_connections 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 1 -- 172.21.15.52:0/2330961859 wait complete. 2024-09-19T09:33:02.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.594+0000 7faf711d5740 20 client.19590 trim_cache size 0 max 16384 2024-09-19T09:33:02.600 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:02.600 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:33:02.600 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "994ccefd-dcae-4373-8313-f5a00b0070f0", 2024-09-19T09:33:02.600 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:33:02.600 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 msgr2=0x7faf500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 0x7faf500a5700 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf6009c2b0 tx=0x7faf60066f40 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 msgr2=0x7faf6819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7faf6000cce0 tx=0x7faf6000a620 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 shutdown_connections 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf68106f10 0x7faf6819ef40 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf500a3240 0x7faf500a5700 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf68102790 0x7faf6819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 --2- 172.21.15.52:0/3824671497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf68101de0 0x7faf6819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 >> 172.21.15.52:0/3824671497 conn(0x7faf680fd8c0 msgr2=0x7faf680feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 shutdown_connections 2024-09-19T09:33:02.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:02.595+0000 7faf6edfc640 1 -- 172.21.15.52:0/3824671497 wait complete. 2024-09-19T09:33:02.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:02 smithi052 ceph-mon[30947]: pgmap v686: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:02.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:02 smithi169 ceph-mon[35454]: pgmap v686: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:03.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:02 smithi086 ceph-mon[34813]: pgmap v686: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:03.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:33:03.708 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:03.829 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:03 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:33:03.829 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:03 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:03.829 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:03 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:33:03.829 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:03 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:03.829 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:03 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:33:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:03 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:33:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:03 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:03 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:33:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:03 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:03.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:03 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:33:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:03 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:33:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:03 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:03 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:33:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:03 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:03 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 -- 172.21.15.52:0/418383759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100eb0 msgr2=0x7ff76c1067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 --2- 172.21.15.52:0/418383759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100eb0 0x7ff76c1067a0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff760009900 tx=0x7ff76002a410 comp rx=0 tx=0).stop 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 -- 172.21.15.52:0/418383759 shutdown_connections 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 --2- 172.21.15.52:0/418383759 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 --2- 172.21.15.52:0/418383759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100eb0 0x7ff76c1067a0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 --2- 172.21.15.52:0/418383759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100500 0x7ff76c1008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 -- 172.21.15.52:0/418383759 >> 172.21.15.52:0/418383759 conn(0x7ff76c0fc5c0 msgr2=0x7ff76c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 -- 172.21.15.52:0/418383759 shutdown_connections 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.215+0000 7ff772084640 1 -- 172.21.15.52:0/418383759 wait complete. 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 Processor -- start 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 -- start start 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100eb0 0x7ff76c1019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c111f80 con 0x7ff76c100500 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c111e00 con 0x7ff76c100eb0 2024-09-19T09:33:04.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.216+0000 7ff772084640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c112100 con 0x7ff76c106ed0 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34970/0 (socket says 172.21.15.52:34970) 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 -- 172.21.15.52:0/3096434390 learned_addr learned my addr 172.21.15.52:0/3096434390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76affd640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100eb0 0x7ff76c1019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 -- 172.21.15.52:0/3096434390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 msgr2=0x7ff76c101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 -- 172.21.15.52:0/3096434390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100eb0 msgr2=0x7ff76c1019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100eb0 0x7ff76c1019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 -- 172.21.15.52:0/3096434390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c1a68e0 con 0x7ff76c100500 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:04.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00d950 tx=0x7ff75c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff768ff9640 1 -- 172.21.15.52:0/3096434390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c017070 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c1a6bd0 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff768ff9640 1 -- 172.21.15.52:0/3096434390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c009c30 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff768ff9640 1 -- 172.21.15.52:0/3096434390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00f6b0 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.217+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1a7130 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.219+0000 7ff768ff9640 1 -- 172.21.15.52:0/3096434390 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff75c0109d0 con 0x7ff76c100500 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 Processor -- start 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 -- start start 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a26880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 0x5644a3a33a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644a398c2e0 con 0x5644a3a26dc0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5644a3933ce0 con 0x5644a3a31680 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff77445d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644a39882a0 con 0x5644a3a264a0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34972/0 (socket says 172.21.15.52:34972) 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 -- 172.21.15.52:0/943973397 learned_addr learned my addr 172.21.15.52:0/943973397 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff768ff9640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 0x7ff7540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76affd640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 0x5644a3a33a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76bfff640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a26880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 0x7ff7540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 -- 172.21.15.52:0/943973397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 msgr2=0x5644a3a26880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a26880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 -- 172.21.15.52:0/943973397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 msgr2=0x5644a3a33a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.220+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 0x5644a3a33a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff76b7fe640 1 -- 172.21.15.52:0/943973397 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3918440 con 0x5644a3a26dc0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff76affd640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 0x5644a3a33a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff768ff9640 1 -- 172.21.15.52:0/3096434390 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff75c0cf600 con 0x7ff76c100500 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff75c097fa0 tx=0x7ff75c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fcbfc2df32a80b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 0x7ff7540a5700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff76400af20 tx=0x7ff764005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff751ffb640 1 -- 172.21.15.52:0/943973397 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c015110 con 0x5644a3a26dc0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff751ffb640 1 -- 172.21.15.52:0/943973397 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c0a3270 con 0x5644a3a26dc0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.221+0000 7ff751ffb640 1 -- 172.21.15.52:0/943973397 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c01fb90 con 0x5644a3a26dc0 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- 172.21.15.52:0/943973397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 msgr2=0x5644a3a31140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7ff75c097fa0 tx=0x7ff75c010d70 comp rx=0 tx=0).stop 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- 172.21.15.52:0/943973397 shutdown_connections 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a31680 0x5644a3a33a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a26dc0 0x5644a3a31140 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 --2- 172.21.15.52:0/943973397 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a26880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- 172.21.15.52:0/943973397 >> 172.21.15.52:0/943973397 conn(0x5644a3a22a30 msgr2=0x5644a3a22e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- 172.21.15.52:0/943973397 shutdown_connections 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- 172.21.15.52:0/943973397 wait complete. 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 -- start start 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.222+0000 7ff77445d740 1 Processor -- start 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 0x5644a3a30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a26dc0 0x5644a3a2e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5644a3a341f0 con 0x5644a3a31680 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5644a3947050 con 0x5644a3a264a0 2024-09-19T09:33:04.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5644a3a34370 con 0x5644a3a26dc0 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff77445d740 10 client.0 _ll_register_callbacks cb 0x5644a3987160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34984/0 (socket says 172.21.15.52:34984) 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 -- 172.21.15.52:0/3257537377 learned_addr learned my addr 172.21.15.52:0/3257537377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 0x5644a3a30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76affd640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a26dc0 0x5644a3a2e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 -- 172.21.15.52:0/3257537377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a26dc0 msgr2=0x5644a3a2e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a26dc0 0x5644a3a2e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 -- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 msgr2=0x5644a3a30ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 0x5644a3a30ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 -- 172.21.15.52:0/3257537377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a36fd3c0 con 0x5644a3a31680 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 0x5644a3a30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:04.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff764010e80 tx=0x7ff764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fdf563edfcdf42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.223+0000 7ff74affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76401c610 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff76401c7b0 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5644a3999850 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff764029030 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 10 client.19602 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644a3a3fb70 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5644a3999850 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff764018070 con 0x5644a3a31680 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 10 client.19602 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 10 client.19602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 20 client.19602 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3a41030 0x5644a3a43420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 4 client.19602 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.224+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644a3993d60 con 0x5644a3a41030 2024-09-19T09:33:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.225+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3a41030 0x5644a3a43420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.225+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3a41030 0x5644a3a43420 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8abc504077b6de5 server_cookie=e6319a2cec3f5644 in_seq=0 out_seq=0 2024-09-19T09:33:04.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.225+0000 7ff74affd640 10 client.19602 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff74affd640 1 -- 172.21.15.52:0/3257537377 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644a3993d60 con 0x5644a3a41030 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff74affd640 10 client.19602 handle_command_reply: tid=0 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 client.19602 shutdown 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 msgr2=0x5644a3a2e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff764010e80 tx=0x7ff764004a40 comp rx=0 tx=0).stop 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 shutdown_connections 2024-09-19T09:33:04.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3a41030 0x5644a3a43420 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a2e6c0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a26dc0 0x5644a3a2e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 --2- 172.21.15.52:0/3257537377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a264a0 0x5644a3a30ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 >> 172.21.15.52:0/3257537377 conn(0x5644a3a22a30 msgr2=0x5644a3a28760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff74affd640 0 client.19602 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 shutdown_connections 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 1 -- 172.21.15.52:0/3257537377 wait complete. 2024-09-19T09:33:04.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.226+0000 7ff77445d740 20 client.19602 trim_cache size 0 max 16384 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.243+0000 7ff77445d740 1 Processor -- start 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 -- start start 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a3d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b2270 con 0x5644a3a31680 2024-09-19T09:33:04.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1afb40 con 0x5644a3a26dc0 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff77445d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ad990 con 0x5644a3a264a0 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34986/0 (socket says 172.21.15.52:34986) 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 -- 172.21.15.52:0/3970774777 learned_addr learned my addr 172.21.15.52:0/3970774777 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a3d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 -- 172.21.15.52:0/3970774777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 msgr2=0x5644a3a3d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76affd640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a3d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 -- 172.21.15.52:0/3970774777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 msgr2=0x5644a3a22e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a22e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 -- 172.21.15.52:0/3970774777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a3a31240 con 0x5644a3a31680 2024-09-19T09:33:04.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76affd640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:04.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.244+0000 7ff76bfff640 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff764010bd0 tx=0x7ff76400a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da460970ef16fe0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff7517fa640 1 -- 172.21.15.52:0/3970774777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76400a750 con 0x5644a3a31680 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff7517fa640 1 -- 172.21.15.52:0/3970774777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff764015070 con 0x5644a3a31680 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff7517fa640 1 -- 172.21.15.52:0/3970774777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764005280 con 0x5644a3a31680 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 -- 172.21.15.52:0/3970774777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 msgr2=0x5644a3a48ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff764010bd0 tx=0x7ff76400a5e0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 -- 172.21.15.52:0/3970774777 shutdown_connections 2024-09-19T09:33:04.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a31680 0x5644a3a48ca0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a22e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 --2- 172.21.15.52:0/3970774777 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a264a0 0x5644a3a3d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 -- 172.21.15.52:0/3970774777 >> 172.21.15.52:0/3970774777 conn(0x5644a3a22a30 msgr2=0x5644a3a2ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 -- 172.21.15.52:0/3970774777 shutdown_connections 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.245+0000 7ff77445d740 1 -- 172.21.15.52:0/3970774777 wait complete. 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 -- start start 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 Processor -- start 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a35240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a31680 0x5644a3aa9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ae000 con 0x5644a3a264a0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1af470 con 0x5644a3a26dc0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ae6d0 con 0x5644a3a31680 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff77445d740 10 client.0 _ll_register_callbacks cb 0x7ff764011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34998/0 (socket says 172.21.15.52:34998) 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.246+0000 7ff76b7fe640 1 -- 172.21.15.52:0/1490683595 learned_addr learned my addr 172.21.15.52:0/1490683595 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76affd640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a35240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76bfff640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a31680 0x5644a3aa9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 -- 172.21.15.52:0/1490683595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a31680 msgr2=0x5644a3aa9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a31680 0x5644a3aa9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 -- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 msgr2=0x5644a3a35240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a35240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 -- 172.21.15.52:0/1490683595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a3aaa270 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff76b7fe640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0976e0 tx=0x7ff75c0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edb46d1a0a25d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff74affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c014070 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff75c099e40 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff764015070 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff75c0a47b0 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff77445d740 10 client.19608 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644a3aab4b0 con 0x5644a3a264a0 2024-09-19T09:33:04.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.247+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff764015070 con 0x5644a3a264a0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff75c0a4320 con 0x5644a3a264a0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 10 client.19608 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 10 client.19608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 20 client.19608 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3aab7a0 0x5644a3aadb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 4 client.19608 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644a3910210 con 0x5644a3aab7a0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff76affd640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3aab7a0 0x5644a3aadb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff76affd640 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3aab7a0 0x5644a3aadb90 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6e994c7c6a9d091 server_cookie=8baea834c091d77f in_seq=0 out_seq=0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.248+0000 7ff74affd640 10 client.19608 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff74affd640 1 -- 172.21.15.52:0/1490683595 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5644a3910210 con 0x5644a3aab7a0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff74affd640 10 client.19608 handle_command_reply: tid=0 2024-09-19T09:33:04.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 client.19608 shutdown 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 msgr2=0x5644a3a34d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0976e0 tx=0x7ff75c0cf040 comp rx=0 tx=0).stop 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 shutdown_connections 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5644a3aab7a0 0x5644a3aadb90 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5644a3a31680 0x5644a3aa9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5644a3a26dc0 0x5644a3a35240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 --2- 172.21.15.52:0/1490683595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5644a3a264a0 0x5644a3a34d00 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 >> 172.21.15.52:0/1490683595 conn(0x5644a3a22a30 msgr2=0x5644a3a2f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff74affd640 0 client.19608 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 shutdown_connections 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 1 -- 172.21.15.52:0/1490683595 wait complete. 2024-09-19T09:33:04.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff77445d740 20 client.19608 trim_cache size 0 max 16384 2024-09-19T09:33:04.257 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:04.257 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:33:04.257 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:33:04.257 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 msgr2=0x7ff7540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 0x7ff7540a5700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff76400af20 tx=0x7ff764005c60 comp rx=0 tx=0).stop 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 msgr2=0x7ff76c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.249+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00d950 tx=0x7ff75c00de10 comp rx=0 tx=0).stop 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 shutdown_connections 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7540a3240 0x7ff7540a5700 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff76c106ed0 0x7ff76c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff76c100eb0 0x7ff76c1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 --2- 172.21.15.52:0/3096434390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff76c100500 0x7ff76c101480 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:04.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 >> 172.21.15.52:0/3096434390 conn(0x7ff76c0fc5c0 msgr2=0x7ff76c1057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:04.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 shutdown_connections 2024-09-19T09:33:04.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:04.250+0000 7ff772084640 1 -- 172.21.15.52:0/3096434390 wait complete. 2024-09-19T09:33:04.895 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:04 smithi052 ceph-mon[30947]: pgmap v687: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:33:04.925 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:33:04.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:33:04.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:04 smithi169 ceph-mon[35454]: pgmap v687: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:33:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:04 smithi086 ceph-mon[34813]: pgmap v687: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-19T09:33:05.183 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:05.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/2291579770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc102790 msgr2=0x7fc9bc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:05.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/2291579770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc102790 0x7fc9bc1067e0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009900 tx=0x7fc9a402a410 comp rx=0 tx=0).stop 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/2291579770 shutdown_connections 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/2291579770 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc106f10 0x7fc9bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/2291579770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc102790 0x7fc9bc1067e0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/2291579770 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc101de0 0x7fc9bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/2291579770 >> 172.21.15.52:0/2291579770 conn(0x7fc9bc0fd8c0 msgr2=0x7fc9bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/2291579770 shutdown_connections 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.681+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/2291579770 wait complete. 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 Processor -- start 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 -- start start 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc102790 0x7fc9bc06ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 0x7fc9bc06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc111f90 con 0x7fc9bc101de0 2024-09-19T09:33:05.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc111e10 con 0x7fc9bc106f10 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9c2a1f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112110 con 0x7fc9bc102790 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35018/0 (socket says 172.21.15.52:35018) 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.682+0000 7fc9bbfff640 1 -- 172.21.15.52:0/659233817 learned_addr learned my addr 172.21.15.52:0/659233817 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9b3fff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc102790 0x7fc9bc06ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9c0fbc640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 0x7fc9bc06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 -- 172.21.15.52:0/659233817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc102790 msgr2=0x7fc9bc06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc102790 0x7fc9bc06ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 -- 172.21.15.52:0/659233817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 msgr2=0x7fc9bc06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 0x7fc9bc06cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 -- 172.21.15.52:0/659233817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc06d4f0 con 0x7fc9bc101de0 2024-09-19T09:33:05.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9c0fbc640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 0x7fc9bc06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9bbfff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00b4a0 tx=0x7fc9ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac014070 con 0x7fc9bc101de0 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc06d7e0 con 0x7fc9bc101de0 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9ac010af0 con 0x7fc9bc101de0 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac017d10 con 0x7fc9bc101de0 2024-09-19T09:33:05.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.683+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc071810 con 0x7fc9bc101de0 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.684+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc1032c0 con 0x7fc9bc101de0 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.686+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc9ac017070 con 0x7fc9bc101de0 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.686+0000 7fc9b9ffb640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 0x7fc9a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.687+0000 7fc9b3fff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 0x7fc9a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.687+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc9ac0cf150 con 0x7fc9bc101de0 2024-09-19T09:33:05.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.687+0000 7fc9b3fff640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 0x7fc9a80a5700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009230 tx=0x7fc9a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:05.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.690+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9ac09bd90 con 0x7fc9bc101de0 2024-09-19T09:33:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.901+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9bc109b60 con 0x7fc9bc101de0 2024-09-19T09:33:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.901+0000 7fc9b9ffb640 1 -- 172.21.15.52:0/659233817 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fc9ac09b690 con 0x7fc9bc101de0 2024-09-19T09:33:05.903 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:33:05.903 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:33:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 msgr2=0x7fc9a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 0x7fc9a80a5700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009230 tx=0x7fc9a40058d0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 msgr2=0x7fc9bc0739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00b4a0 tx=0x7fc9ac00b960 comp rx=0 tx=0).stop 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 shutdown_connections 2024-09-19T09:33:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9bc106f10 0x7fc9bc06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9a80a3240 0x7fc9a80a5700 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9bc102790 0x7fc9bc06ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 --2- 172.21.15.52:0/659233817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc101de0 0x7fc9bc0739b0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 >> 172.21.15.52:0/659233817 conn(0x7fc9bc0fd8c0 msgr2=0x7fc9bc0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 shutdown_connections 2024-09-19T09:33:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:05.904+0000 7fc9c2a1f640 1 -- 172.21.15.52:0/659233817 wait complete. 2024-09-19T09:33:06.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:33:06.809 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:06.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:06 smithi052 ceph-mon[30947]: pgmap v688: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:06.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/659233817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:06 smithi169 ceph-mon[35454]: pgmap v688: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:06.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/659233817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:06 smithi086 ceph-mon[34813]: pgmap v688: 97 pgs: 97 active+clean; 1.8 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/659233817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 -- 172.21.15.52:0/4203908233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 msgr2=0x7faf3c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 --2- 172.21.15.52:0/4203908233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c103110 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009cd0 tx=0x7faf2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 -- 172.21.15.52:0/4203908233 shutdown_connections 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 --2- 172.21.15.52:0/4203908233 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1082a0 0x7faf3c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 --2- 172.21.15.52:0/4203908233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1036e0 0x7faf3c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 --2- 172.21.15.52:0/4203908233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c103110 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 -- 172.21.15.52:0/4203908233 >> 172.21.15.52:0/4203908233 conn(0x7faf3c0fc7d0 msgr2=0x7faf3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 -- 172.21.15.52:0/4203908233 shutdown_connections 2024-09-19T09:33:07.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.282+0000 7faf40ef7640 1 -- 172.21.15.52:0/4203908233 wait complete. 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 Processor -- start 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 -- start start 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1036e0 0x7faf3c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1082a0 0x7faf3c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1120e0 con 0x7faf3c102d30 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c111f60 con 0x7faf3c1036e0 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf40ef7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c112260 con 0x7faf3c1082a0 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf3a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf3a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35040/0 (socket says 172.21.15.52:35040) 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf3a59c640 1 -- 172.21.15.52:0/3928768163 learned_addr learned my addr 172.21.15.52:0/3928768163 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf39d9b640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1036e0 0x7faf3c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.283+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1082a0 0x7faf3c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 -- 172.21.15.52:0/3928768163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1082a0 msgr2=0x7faf3c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1082a0 0x7faf3c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 -- 172.21.15.52:0/3928768163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1036e0 msgr2=0x7faf3c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1036e0 0x7faf3c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 -- 172.21.15.52:0/3928768163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c19d4d0 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf3a59c640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7faf2c033040 tx=0x7faf2c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf2b7fe640 1 -- 172.21.15.52:0/3928768163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004040 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf2b7fe640 1 -- 172.21.15.52:0/3928768163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf2c0046c0 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3c19d760 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf2b7fe640 1 -- 172.21.15.52:0/3928768163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c046480 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.284+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c1a50a0 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.286+0000 7faf2b7fe640 1 -- 172.21.15.52:0/3928768163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faf2c030710 con 0x7faf3c102d30 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 Processor -- start 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 -- start start 2024-09-19T09:33:07.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e91e00f2f0 con 0x55e91e0aab40 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e91dfb6cf0 con 0x55e91e0b4370 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf432d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e91e00b2b0 con 0x55e91e0a95d0 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf3ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf3ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35046/0 (socket says 172.21.15.52:35046) 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf3ad9d640 1 -- 172.21.15.52:0/50280436 learned_addr learned my addr 172.21.15.52:0/50280436 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.287+0000 7faf3a59c640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf39d9b640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 -- 172.21.15.52:0/50280436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 msgr2=0x55e91e0a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 -- 172.21.15.52:0/50280436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 msgr2=0x55e91e0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf2b7fe640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 0x7faf240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 -- 172.21.15.52:0/50280436 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91df9b3a0 con 0x55e91e0aab40 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf39d9b640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 0x7faf240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf2b7fe640 1 -- 172.21.15.52:0/3928768163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf2c02e030 con 0x7faf3c102d30 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7faf3400cb40 tx=0x7faf3400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cef49a3500295f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf28ff9640 1 -- 172.21.15.52:0/50280436 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf34010870 con 0x55e91e0aab40 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf28ff9640 1 -- 172.21.15.52:0/50280436 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf3400ee50 con 0x55e91e0aab40 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.288+0000 7faf28ff9640 1 -- 172.21.15.52:0/50280436 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3400fc30 con 0x55e91e0aab40 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 -- 172.21.15.52:0/50280436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 msgr2=0x55e91e0a9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 0x7faf240a5780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf3401d000 tx=0x7faf34020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7faf3400cb40 tx=0x7faf3400e350 comp rx=0 tx=0).stop 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 -- 172.21.15.52:0/50280436 shutdown_connections 2024-09-19T09:33:07.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 --2- 172.21.15.52:0/50280436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0a9090 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 -- 172.21.15.52:0/50280436 >> 172.21.15.52:0/50280436 conn(0x55e91e072310 msgr2=0x55e91e0a5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 -- 172.21.15.52:0/50280436 shutdown_connections 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.289+0000 7faf432d0740 1 -- 172.21.15.52:0/50280436 wait complete. 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 -- start start 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 Processor -- start 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e91e0b7070 con 0x55e91e0aab40 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e91dfca060 con 0x55e91e0b4370 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e91e0b71f0 con 0x55e91e0a95d0 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf432d0740 10 client.0 _ll_register_callbacks cb 0x55e91dd1d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:07.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35060/0 (socket says 172.21.15.52:35060) 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 -- 172.21.15.52:0/2670264595 learned_addr learned my addr 172.21.15.52:0/2670264595 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf3a59c640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 -- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 msgr2=0x55e91e0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 -- 172.21.15.52:0/2670264595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 msgr2=0x55e91e0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf39d9b640 1 -- 172.21.15.52:0/2670264595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91dd803c0 con 0x55e91e0aab40 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.290+0000 7faf3a59c640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0697d0 tx=0x7faf30012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d266262f9714c089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:07.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30004220 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e91e01c860 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf300043c0 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf30010710 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 10 client.19626 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e91e0c2b70 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e91e01c860 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf30019070 con 0x55e91e0aab40 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 10 client.19626 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 10 client.19626 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 20 client.19626 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e0c3fd0 0x55e91e0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 4 client.19626 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.291+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e91e016d70 con 0x55e91e0c3fd0 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.292+0000 7faf3a59c640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e0c3fd0 0x55e91e0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.292+0000 7faf3a59c640 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e0c3fd0 0x55e91e0c6430 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9a42d814cc2904 server_cookie=482b0db7e4786fd0 in_seq=0 out_seq=0 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.292+0000 7faf21ffb640 10 client.19626 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf21ffb640 1 -- 172.21.15.52:0/2670264595 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e91e016d70 con 0x55e91e0c3fd0 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf21ffb640 10 client.19626 handle_command_reply: tid=0 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 client.19626 shutdown 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 msgr2=0x55e91e0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0697d0 tx=0x7faf30012820 comp rx=0 tx=0).stop 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 shutdown_connections 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e0c3fd0 0x55e91e0c6430 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0b0fd0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf21ffb640 0 client.19626 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 --2- 172.21.15.52:0/2670264595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 >> 172.21.15.52:0/2670264595 conn(0x55e91e072310 msgr2=0x55e91e0ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 shutdown_connections 2024-09-19T09:33:07.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 1 -- 172.21.15.52:0/2670264595 wait complete. 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.293+0000 7faf432d0740 20 client.19626 trim_cache size 0 max 16384 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 Processor -- start 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 -- start start 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1b0000 con 0x55e91e0aab40 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1ad8d0 con 0x55e91e0b4370 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.306+0000 7faf432d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1ab720 con 0x55e91e0a95d0 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35062/0 (socket says 172.21.15.52:35062) 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 -- 172.21.15.52:0/2972437235 learned_addr learned my addr 172.21.15.52:0/2972437235 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:07.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf3a59c640 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 -- 172.21.15.52:0/2972437235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 msgr2=0x55e91e0b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 -- 172.21.15.52:0/2972437235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 msgr2=0x55e91e0ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 -- 172.21.15.52:0/2972437235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91e0c6ab0 con 0x55e91e0aab40 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf39d9b640 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7faf30003d80 tx=0x7faf30005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da32ac5300ee4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf23fff640 1 -- 172.21.15.52:0/2972437235 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30000e60 con 0x55e91e0aab40 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf23fff640 1 -- 172.21.15.52:0/2972437235 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf30003ad0 con 0x55e91e0aab40 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.307+0000 7faf23fff640 1 -- 172.21.15.52:0/2972437235 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30024480 con 0x55e91e0aab40 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- 172.21.15.52:0/2972437235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 msgr2=0x55e91e0ac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7faf30003d80 tx=0x7faf30005770 comp rx=0 tx=0).stop 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- 172.21.15.52:0/2972437235 shutdown_connections 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0ac120 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 --2- 172.21.15.52:0/2972437235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- 172.21.15.52:0/2972437235 >> 172.21.15.52:0/2972437235 conn(0x55e91e072310 msgr2=0x55e91e0b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- 172.21.15.52:0/2972437235 shutdown_connections 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- 172.21.15.52:0/2972437235 wait complete. 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 -- start start 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.308+0000 7faf432d0740 1 Processor -- start 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1abd90 con 0x55e91e0aab40 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1ad200 con 0x55e91e0b4370 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1ac460 con 0x55e91e0a95d0 2024-09-19T09:33:07.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf432d0740 10 client.0 _ll_register_callbacks cb 0x7faf3000ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35076/0 (socket says 172.21.15.52:35076) 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 -- 172.21.15.52:0/740946623 learned_addr learned my addr 172.21.15.52:0/740946623 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf3a59c640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf3ad9d640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 -- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 msgr2=0x55e91e0bcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0bcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 -- 172.21.15.52:0/740946623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 msgr2=0x55e91e0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 -- 172.21.15.52:0/740946623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91e0aeaa0 con 0x55e91e0aab40 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf39d9b640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faf30006010 tx=0x7faf3000b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1848c4a841ab6cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.309+0000 7faf21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3000b410 con 0x55e91e0aab40 2024-09-19T09:33:07.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf30003f70 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf30003ad0 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf3003c050 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 10 client.19632 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e91e12ece0 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf30003ad0 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf30019040 con 0x55e91e0aab40 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 10 client.19632 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 10 client.19632 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 20 client.19632 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e12f3c0 0x55e91e1317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 4 client.19632 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.310+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e91df93170 con 0x55e91e12f3c0 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf3a59c640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e12f3c0 0x55e91e1317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:07.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf21ffb640 10 client.19632 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf3a59c640 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e12f3c0 0x55e91e1317e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80460e0eed73cacf server_cookie=603573f4a9cb4d1b in_seq=0 out_seq=0 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf21ffb640 1 -- 172.21.15.52:0/740946623 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e91df93170 con 0x55e91e12f3c0 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf21ffb640 10 client.19632 handle_command_reply: tid=0 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 client.19632 shutdown 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 msgr2=0x55e91e0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faf30006010 tx=0x7faf3000b9b0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 shutdown_connections 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55e91e12f3c0 0x55e91e1317e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e91e0b4370 0x55e91e0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e91e0aab40 0x55e91e0add80 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf21ffb640 0 client.19632 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 --2- 172.21.15.52:0/740946623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e91e0a95d0 0x55e91e0bcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 >> 172.21.15.52:0/740946623 conn(0x55e91e072310 msgr2=0x55e91e0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 shutdown_connections 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.311+0000 7faf432d0740 1 -- 172.21.15.52:0/740946623 wait complete. 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf432d0740 20 client.19632 trim_cache size 0 max 16384 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 msgr2=0x7faf240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 0x7faf240a5780 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf3401d000 tx=0x7faf34020000 comp rx=0 tx=0).stop 2024-09-19T09:33:07.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 msgr2=0x7faf3c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7faf2c033040 tx=0x7faf2c0039f0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 shutdown_connections 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf240a32c0 0x7faf240a5780 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf3c1082a0 0x7faf3c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf3c1036e0 0x7faf3c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 --2- 172.21.15.52:0/3928768163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf3c102d30 0x7faf3c198520 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 >> 172.21.15.52:0/3928768163 conn(0x7faf3c0fc7d0 msgr2=0x7faf3c105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 shutdown_connections 2024-09-19T09:33:07.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:07.312+0000 7faf40ef7640 1 -- 172.21.15.52:0/3928768163 wait complete. 2024-09-19T09:33:08.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:33:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:08.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:08 smithi052 ceph-mon[30947]: pgmap v689: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-19T09:33:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- 172.21.15.52:0/1580913413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 msgr2=0x7fd83c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 --2- 172.21.15.52:0/1580913413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c10d930 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd834009c10 tx=0x7fd83402a6e0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- 172.21.15.52:0/1580913413 shutdown_connections 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 --2- 172.21.15.52:0/1580913413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c10d930 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 --2- 172.21.15.52:0/1580913413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c100a60 0x7fd83c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 --2- 172.21.15.52:0/1580913413 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c106a60 0x7fd83c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- 172.21.15.52:0/1580913413 >> 172.21.15.52:0/1580913413 conn(0x7fd83c0fc780 msgr2=0x7fd83c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- 172.21.15.52:0/1580913413 shutdown_connections 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- 172.21.15.52:0/1580913413 wait complete. 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 Processor -- start 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 -- start start 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.792+0000 7fd842503640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c100a60 0x7fd83c0fce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c106a60 0x7fd83c0fd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c110e10 con 0x7fd83c101400 2024-09-19T09:33:08.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c110c90 con 0x7fd83c100a60 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c110f90 con 0x7fd83c106a60 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47876/0 (socket says 172.21.15.52:47876) 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 -- 172.21.15.52:0/507367522 learned_addr learned my addr 172.21.15.52:0/507367522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd840aa0640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c106a60 0x7fd83c0fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd83bfff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c100a60 0x7fd83c0fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 -- 172.21.15.52:0/507367522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c106a60 msgr2=0x7fd83c0fd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c106a60 0x7fd83c0fd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 -- 172.21.15.52:0/507367522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c100a60 msgr2=0x7fd83c0fce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c100a60 0x7fd83c0fce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 -- 172.21.15.52:0/507367522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c1a68f0 con 0x7fd83c101400 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd833fff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9f0 tx=0x7fd82400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd839ffb640 1 -- 172.21.15.52:0/507367522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82400ccc0 con 0x7fd83c101400 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.793+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c1a6be0 con 0x7fd83c101400 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.794+0000 7fd839ffb640 1 -- 172.21.15.52:0/507367522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd824005500 con 0x7fd83c101400 2024-09-19T09:33:08.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.794+0000 7fd839ffb640 1 -- 172.21.15.52:0/507367522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824010690 con 0x7fd83c101400 2024-09-19T09:33:08.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.794+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c1a7120 con 0x7fd83c101400 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd839ffb640 1 -- 172.21.15.52:0/507367522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd8240046c0 con 0x7fd83c101400 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 Processor -- start 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 -- start start 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb984a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb991760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562deb8ea2f0 con 0x562deb985b40 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562deb891cf0 con 0x562deb98f370 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.796+0000 7fd8448dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562deb8e62b0 con 0x562deb9845d0 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47884/0 (socket says 172.21.15.52:47884) 2024-09-19T09:33:08.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 -- 172.21.15.52:0/3224053674 learned_addr learned my addr 172.21.15.52:0/3224053674 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd83bfff640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb984a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd833fff640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb991760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 -- 172.21.15.52:0/3224053674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 msgr2=0x562deb984a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb984a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 -- 172.21.15.52:0/3224053674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 msgr2=0x562deb991760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb991760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 -- 172.21.15.52:0/3224053674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deb8763a0 con 0x562deb985b40 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd83bfff640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb984a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd839ffb640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 0x7fd8280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd83bfff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 0x7fd8280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd839ffb640 1 -- 172.21.15.52:0/507367522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd8240cfca0 con 0x7fd83c101400 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd840aa0640 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fd834009be0 tx=0x7fd834005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366fe010fc00330d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.797+0000 7fd8327fc640 1 -- 172.21.15.52:0/3224053674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834042030 con 0x562deb985b40 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8327fc640 1 -- 172.21.15.52:0/3224053674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834037040 con 0x562deb985b40 2024-09-19T09:33:08.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8327fc640 1 -- 172.21.15.52:0/3224053674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834036070 con 0x562deb985b40 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 -- 172.21.15.52:0/3224053674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 msgr2=0x562deb984090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd83bfff640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 0x7fd8280a5700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x562deb981ac0 tx=0x7fd82c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fd834009be0 tx=0x7fd834005c60 comp rx=0 tx=0).stop 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 -- 172.21.15.52:0/3224053674 shutdown_connections 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb991760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb984a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3224053674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb984090 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 -- 172.21.15.52:0/3224053674 >> 172.21.15.52:0/3224053674 conn(0x562deb94d310 msgr2=0x562deb980c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 -- 172.21.15.52:0/3224053674 shutdown_connections 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.798+0000 7fd8448dc740 1 -- 172.21.15.52:0/3224053674 wait complete. 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 -- start start 2024-09-19T09:33:08.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 Processor -- start 2024-09-19T09:33:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb98ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb98f370 0x562deb98c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562deb992010 con 0x562deb985b40 2024-09-19T09:33:08.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562deb8a5060 con 0x562deb9845d0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562deb992190 con 0x562deb98f370 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd8448dc740 10 client.0 _ll_register_callbacks cb 0x562deb5f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.799+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47890/0 (socket says 172.21.15.52:47890) 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 -- 172.21.15.52:0/1300601956 learned_addr learned my addr 172.21.15.52:0/1300601956 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd840aa0640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb98f370 0x562deb98c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd83bfff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb98ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 -- 172.21.15.52:0/1300601956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb98f370 msgr2=0x562deb98c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb98f370 0x562deb98c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 -- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 msgr2=0x562deb98ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb98ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 -- 172.21.15.52:0/1300601956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deb65b3c0 con 0x562deb985b40 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd833fff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fd82409bee0 tx=0x7fd824009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2746a0ff7ecdf3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd81b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:08.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8240a0320 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd82409c440 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd834037040 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd82409c8e0 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd8448dc740 10 client.19644 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.800+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562deb99dae0 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834037040 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd8240a49c0 con 0x562deb985b40 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 10 client.19644 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 10 client.19644 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 20 client.19644 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deb99eff0 0x562deb9a1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 4 client.19644 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562deb8f7860 con 0x562deb99eff0 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.801+0000 7fd83bfff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deb99eff0 0x562deb9a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.802+0000 7fd83bfff640 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deb99eff0 0x562deb9a1420 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f3003a575c11cc2 server_cookie=a294a0468cfd1bd6 in_seq=0 out_seq=0 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.802+0000 7fd81b7fe640 10 client.19644 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.802+0000 7fd81b7fe640 1 -- 172.21.15.52:0/1300601956 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562deb8f7860 con 0x562deb99eff0 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.802+0000 7fd81b7fe640 10 client.19644 handle_command_reply: tid=0 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.802+0000 7fd8448dc740 1 client.19644 shutdown 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 msgr2=0x562deb98bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fd82409bee0 tx=0x7fd824009f50 comp rx=0 tx=0).stop 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 shutdown_connections 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb98f370 0x562deb98c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb98bf80 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deb99eff0 0x562deb9a1420 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 --2- 172.21.15.52:0/1300601956 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb98ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd81b7fe640 0 client.19644 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 >> 172.21.15.52:0/1300601956 conn(0x562deb94d310 msgr2=0x562deb986930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 shutdown_connections 2024-09-19T09:33:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 1 -- 172.21.15.52:0/1300601956 wait complete. 2024-09-19T09:33:08.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.803+0000 7fd8448dc740 20 client.19644 trim_cache size 0 max 16384 2024-09-19T09:33:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 Processor -- start 2024-09-19T09:33:08.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 -- start start 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb99b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 0x562deb98b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1b21f0 con 0x562deb98f370 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1afac0 con 0x562deb9845d0 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd8448dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1ad910 con 0x562deb985b40 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd840aa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd83bfff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb99b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd840aa0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47900/0 (socket says 172.21.15.52:47900) 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd840aa0640 1 -- 172.21.15.52:0/452139925 learned_addr learned my addr 172.21.15.52:0/452139925 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.816+0000 7fd833fff640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 0x562deb98b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 -- 172.21.15.52:0/452139925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 msgr2=0x562deb98b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 0x562deb98b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 -- 172.21.15.52:0/452139925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 msgr2=0x562deb99b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb99b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 -- 172.21.15.52:0/452139925 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562deb98c850 con 0x562deb98f370 2024-09-19T09:33:08.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd833fff640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 0x562deb98b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:08.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd83bfff640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb99b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:08.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd840aa0640 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fd83402ac00 tx=0x7fd834009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08dc55754fa3835 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd831ffb640 1 -- 172.21.15.52:0/452139925 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834042040 con 0x562deb98f370 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd831ffb640 1 -- 172.21.15.52:0/452139925 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834003970 con 0x562deb98f370 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.817+0000 7fd831ffb640 1 -- 172.21.15.52:0/452139925 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834036040 con 0x562deb98f370 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- 172.21.15.52:0/452139925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 msgr2=0x562deb98af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fd83402ac00 tx=0x7fd834009480 comp rx=0 tx=0).stop 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- 172.21.15.52:0/452139925 shutdown_connections 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb98f370 0x562deb98af60 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb985b40 0x562deb98b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- 172.21.15.52:0/452139925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb9845d0 0x562deb99b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- 172.21.15.52:0/452139925 >> 172.21.15.52:0/452139925 conn(0x562deb94d310 msgr2=0x562deb98a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- 172.21.15.52:0/452139925 shutdown_connections 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- 172.21.15.52:0/452139925 wait complete. 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- start start 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 Processor -- start 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb9930f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb993b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1adf80 con 0x562deb985b40 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1af3f0 con 0x562deb98f370 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.818+0000 7fd8448dc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1ae650 con 0x562deb9845d0 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd8448dc740 10 client.0 _ll_register_callbacks cb 0x7fd82409bfb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47916/0 (socket says 172.21.15.52:47916) 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 -- 172.21.15.52:0/3814844453 learned_addr learned my addr 172.21.15.52:0/3814844453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd83bfff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb9930f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd840aa0640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb993b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 -- 172.21.15.52:0/3814844453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 msgr2=0x562deb9930f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb9930f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 -- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 msgr2=0x562deb993b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb993b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 -- 172.21.15.52:0/3814844453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deba08cc0 con 0x562deb985b40 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd840aa0640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb993b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd833fff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9c0 tx=0x7fd8240a4bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4a6ca2411c073a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd81b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82409bb40 con 0x562deb985b40 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd82409b630 con 0x562deb985b40 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.819+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd834003970 con 0x562deb985b40 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd82409c1e0 con 0x562deb985b40 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 10 client.19650 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:08.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562deba09e30 con 0x562deb985b40 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834003970 con 0x562deb985b40 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd82409b0a0 con 0x562deb985b40 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 10 client.19650 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 10 client.19650 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 20 client.19650 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deba0a5a0 0x562deba0c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 4 client.19650 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562deb8f1d70 con 0x562deba0a5a0 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.820+0000 7fd83bfff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deba0a5a0 0x562deba0c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd83bfff640 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deba0a5a0 0x562deba0c9c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eaec48afd1829456 server_cookie=9cef42734c2cbc68 in_seq=0 out_seq=0 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd81b7fe640 10 client.19650 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd81b7fe640 1 -- 172.21.15.52:0/3814844453 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562deb8f1d70 con 0x562deba0a5a0 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd81b7fe640 10 client.19650 handle_command_reply: tid=0 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 client.19650 shutdown 2024-09-19T09:33:08.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 msgr2=0x562deb993630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9c0 tx=0x7fd8240a4bf0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 shutdown_connections 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562deba0a5a0 0x562deba0c9c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562deb98f370 0x562deb993b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562deb985b40 0x562deb993630 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd81b7fe640 0 client.19650 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 --2- 172.21.15.52:0/3814844453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562deb9845d0 0x562deb9930f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 >> 172.21.15.52:0/3814844453 conn(0x562deb94d310 msgr2=0x562deb98b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 shutdown_connections 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 1 -- 172.21.15.52:0/3814844453 wait complete. 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.821+0000 7fd8448dc740 20 client.19650 trim_cache size 0 max 16384 2024-09-19T09:33:08.827 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 msgr2=0x7fd8280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 0x7fd8280a5700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x562deb981ac0 tx=0x7fd82c005f90 comp rx=0 tx=0).stop 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 msgr2=0x7fd83c0fd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd82400e9f0 tx=0x7fd82400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 shutdown_connections 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd8280a3240 0x7fd8280a5700 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd83c106a60 0x7fd83c0fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd83c101400 0x7fd83c0fd350 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 --2- 172.21.15.52:0/507367522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd83c100a60 0x7fd83c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 >> 172.21.15.52:0/507367522 conn(0x7fd83c0fc780 msgr2=0x7fd83c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 shutdown_connections 2024-09-19T09:33:08.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:08.822+0000 7fd842503640 1 -- 172.21.15.52:0/507367522 wait complete. 2024-09-19T09:33:08.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:08 smithi169 ceph-mon[35454]: pgmap v689: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-19T09:33:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:08 smithi086 ceph-mon[34813]: pgmap v689: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 18 op/s 2024-09-19T09:33:09.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:33:09.900 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 -- 172.21.15.52:0/3920803445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc01036e0 msgr2=0x7f4fc0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 --2- 172.21.15.52:0/3920803445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc01036e0 0x7f4fc0107b90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009930 tx=0x7f4fbc02a420 comp rx=0 tx=0).stop 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 -- 172.21.15.52:0/3920803445 shutdown_connections 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 --2- 172.21.15.52:0/3920803445 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 --2- 172.21.15.52:0/3920803445 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc01036e0 0x7f4fc0107b90 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 --2- 172.21.15.52:0/3920803445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc0102d30 0x7f4fc0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.342+0000 7f4fc8191640 1 -- 172.21.15.52:0/3920803445 >> 172.21.15.52:0/3920803445 conn(0x7f4fc00fc7d0 msgr2=0x7f4fc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.343+0000 7f4fc8191640 1 -- 172.21.15.52:0/3920803445 shutdown_connections 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.343+0000 7f4fc8191640 1 -- 172.21.15.52:0/3920803445 wait complete. 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 Processor -- start 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 -- start start 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc01036e0 0x7f4fc0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01120a0 con 0x7f4fc0102d30 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0111f20 con 0x7f4fc01036e0 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.344+0000 7f4fc8191640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc0112220 con 0x7f4fc01082a0 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47930/0 (socket says 172.21.15.52:47930) 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2267324571 learned_addr learned my addr 172.21.15.52:0/2267324571 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc572c640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc01036e0 0x7f4fc0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2267324571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 msgr2=0x7f4fc0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2267324571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc01036e0 msgr2=0x7f4fc0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc01036e0 0x7f4fc0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2267324571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc01a6b00 con 0x7f4fc0102d30 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:10.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400db80 tx=0x7f4fb400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fb2ffd640 1 -- 172.21.15.52:0/2267324571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4017070 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fb2ffd640 1 -- 172.21.15.52:0/2267324571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb4003b70 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc01a6df0 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fb2ffd640 1 -- 172.21.15.52:0/2267324571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40106c0 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.345+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc01a7250 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.348+0000 7f4fb2ffd640 1 -- 172.21.15.52:0/2267324571 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4fb4004020 con 0x7f4fc0102d30 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.348+0000 7f4fca56a740 1 Processor -- start 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.348+0000 7f4fca56a740 1 -- start start 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.348+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84ba5d0 0x5556c84baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fca56a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556c84202f0 con 0x5556c84bbb40 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fca56a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5556c83c7cf0 con 0x5556c84c5370 2024-09-19T09:33:10.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fca56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556c841c2b0 con 0x5556c84ba5d0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fb2ffd640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 0x7f4fac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47942/0 (socket says 172.21.15.52:47942) 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 -- 172.21.15.52:0/3454332217 learned_addr learned my addr 172.21.15.52:0/3454332217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84ba5d0 0x5556c84baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 0x7f4fac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc572c640 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fb2ffd640 1 -- 172.21.15.52:0/2267324571 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fb40cf7f0 con 0x7f4fc0102d30 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 -- 172.21.15.52:0/3454332217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84ba5d0 msgr2=0x5556c84baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84ba5d0 0x5556c84baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 -- 172.21.15.52:0/3454332217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 msgr2=0x5556c84c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.349+0000 7f4fc672e640 1 -- 172.21.15.52:0/3454332217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c83ac3a0 con 0x5556c84bbb40 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.350+0000 7f4fc672e640 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8013ab0 tx=0x7f4fb8013f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b1a1dca12e5f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.350+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 0x7f4fac0a5700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8010800 tx=0x7f4fb801b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.350+0000 7f4fabfff640 1 -- 172.21.15.52:0/3454332217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8021070 con 0x5556c84bbb40 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.350+0000 7f4fabfff640 1 -- 172.21.15.52:0/3454332217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb800b890 con 0x5556c84bbb40 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.350+0000 7f4fabfff640 1 -- 172.21.15.52:0/3454332217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb801d610 con 0x5556c84bbb40 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- 172.21.15.52:0/3454332217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 msgr2=0x5556c84ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8013ab0 tx=0x7f4fb8013f70 comp rx=0 tx=0).stop 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- 172.21.15.52:0/3454332217 shutdown_connections 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84ba5d0 0x5556c84baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3454332217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84bbb40 0x5556c84ba090 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- 172.21.15.52:0/3454332217 >> 172.21.15.52:0/3454332217 conn(0x5556c8483310 msgr2=0x5556c84b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- 172.21.15.52:0/3454332217 shutdown_connections 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- 172.21.15.52:0/3454332217 wait complete. 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 -- start start 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.351+0000 7f4fca56a740 1 Processor -- start 2024-09-19T09:33:10.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 0x5556c84c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556c84c8010 con 0x5556c84ba5d0 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5556c83db060 con 0x5556c84c5370 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5556c84c8190 con 0x5556c84bbb40 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fca56a740 10 client.0 _ll_register_callbacks cb 0x5556c812e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47948/0 (socket says 172.21.15.52:47948) 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/3185383734 learned_addr learned my addr 172.21.15.52:0/3185383734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc572c640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 0x5556c84c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc672e640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/3185383734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 msgr2=0x5556c84c2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 0x5556c84c2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 msgr2=0x5556c84c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/3185383734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c81913c0 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc572c640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 0x5556c84c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bb30 tx=0x7f4fb4066bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdcbaa84153f581 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.352+0000 7f4fa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a0140 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fb4099e30 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb800b890 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fb40a4a00 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 10 client.19662 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5556c84d3af0 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb800b890 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fb4098400 con 0x5556c84ba5d0 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 10 client.19662 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:10.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 10 client.19662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 20 client.19662 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c84d4fb0 0x5556c84d7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 4 client.19662 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556c842d860 con 0x5556c84d4fb0 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.353+0000 7f4fc572c640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c84d4fb0 0x5556c84d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.354+0000 7f4fc572c640 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c84d4fb0 0x5556c84d7420 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbf9a09353575744 server_cookie=29a5a5f5cdcf477b in_seq=0 out_seq=0 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.354+0000 7f4fa97fa640 10 client.19662 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fa97fa640 1 -- 172.21.15.52:0/3185383734 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556c842d860 con 0x5556c84d4fb0 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fa97fa640 10 client.19662 handle_command_reply: tid=0 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 client.19662 shutdown 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 msgr2=0x5556c84c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bb30 tx=0x7f4fb4066bc0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 shutdown_connections 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c84d4fb0 0x5556c84d7420 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84c5370 0x5556c84c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84bbb40 0x5556c84c2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fa97fa640 0 client.19662 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 --2- 172.21.15.52:0/3185383734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84c4da0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 >> 172.21.15.52:0/3185383734 conn(0x5556c8483310 msgr2=0x5556c84bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 shutdown_connections 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 1 -- 172.21.15.52:0/3185383734 wait complete. 2024-09-19T09:33:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.355+0000 7f4fca56a740 20 client.19662 trim_cache size 0 max 16384 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 Processor -- start 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 -- start start 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01b23a0 con 0x5556c84ba5d0 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01afc70 con 0x5556c84bbb40 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fca56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01adac0 con 0x5556c84c5370 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47960/0 (socket says 172.21.15.52:47960) 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/284922491 learned_addr learned my addr 172.21.15.52:0/284922491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc672e640 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc572c640 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/284922491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 msgr2=0x5556c84dcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84dcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/284922491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 msgr2=0x5556c84bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.369+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/284922491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556c84b7960 con 0x5556c84ba5d0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.370+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4098760 tx=0x7f4fb40a45d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a885e7893c4adda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.370+0000 7f4fab7fe640 1 -- 172.21.15.52:0/284922491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb409bd90 con 0x5556c84ba5d0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.370+0000 7f4fab7fe640 1 -- 172.21.15.52:0/284922491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb4003d20 con 0x5556c84ba5d0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.370+0000 7f4fab7fe640 1 -- 172.21.15.52:0/284922491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb409c0c0 con 0x5556c84ba5d0 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- 172.21.15.52:0/284922491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 msgr2=0x5556c84bd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4098760 tx=0x7f4fb40a45d0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- 172.21.15.52:0/284922491 shutdown_connections 2024-09-19T09:33:10.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84dcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 --2- 172.21.15.52:0/284922491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84bd120 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- 172.21.15.52:0/284922491 >> 172.21.15.52:0/284922491 conn(0x5556c8483310 msgr2=0x5556c84c11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- 172.21.15.52:0/284922491 shutdown_connections 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- 172.21.15.52:0/284922491 wait complete. 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 -- start start 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.371+0000 7f4fca56a740 1 Processor -- start 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01ae130 con 0x5556c84ba5d0 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01af5a0 con 0x5556c84bbb40 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc01ae800 con 0x5556c84c5370 2024-09-19T09:33:10.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fca56a740 10 client.0 _ll_register_callbacks cb 0x7f4fb40099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47966/0 (socket says 172.21.15.52:47966) 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2365358348 learned_addr learned my addr 172.21.15.52:0/2365358348 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc572c640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2365358348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 msgr2=0x5556c84bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 msgr2=0x5556c84bee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 -- 172.21.15.52:0/2365358348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556c84bfc20 con 0x5556c84ba5d0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc672e640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fc5f2d640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bfb0 tx=0x7f4fb400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d34173b18f38fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.372+0000 7f4fa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a4640 con 0x5556c84ba5d0 2024-09-19T09:33:10.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fb4066340 con 0x5556c84ba5d0 2024-09-19T09:33:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb4003d20 con 0x5556c84ba5d0 2024-09-19T09:33:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fb407f030 con 0x5556c84ba5d0 2024-09-19T09:33:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 10 client.19668 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5556c853fd50 con 0x5556c84ba5d0 2024-09-19T09:33:10.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb4003d20 con 0x5556c84ba5d0 2024-09-19T09:33:10.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fb4097ae0 con 0x5556c84ba5d0 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 10 client.19668 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 10 client.19668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 20 client.19668 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c8540180 0x5556c8542570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 4 client.19668 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.373+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556c8427d70 con 0x5556c8540180 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fc572c640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c8540180 0x5556c8542570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fc572c640 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c8540180 0x5556c8542570 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28002c6fa6ca930f server_cookie=8b98cb778a4b51c7 in_seq=0 out_seq=0 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fa97fa640 10 client.19668 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fa97fa640 1 -- 172.21.15.52:0/2365358348 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556c8427d70 con 0x5556c8540180 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fa97fa640 10 client.19668 handle_command_reply: tid=0 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.374+0000 7f4fca56a740 1 client.19668 shutdown 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 msgr2=0x5556c84cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400bfb0 tx=0x7f4fb400be60 comp rx=0 tx=0).stop 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 shutdown_connections 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5556c8540180 0x5556c8542570 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5556c84c5370 0x5556c84bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5556c84bbb40 0x5556c84bee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 --2- 172.21.15.52:0/2365358348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556c84ba5d0 0x5556c84cdc10 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 >> 172.21.15.52:0/2365358348 conn(0x5556c8483310 msgr2=0x5556c84b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fa97fa640 0 client.19668 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 shutdown_connections 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 1 -- 172.21.15.52:0/2365358348 wait complete. 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.375+0000 7f4fca56a740 20 client.19668 trim_cache size 0 max 16384 2024-09-19T09:33:10.382 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:10.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 msgr2=0x7f4fac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 0x7f4fac0a5700 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8010800 tx=0x7f4fb801b000 comp rx=0 tx=0).stop 2024-09-19T09:33:10.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 msgr2=0x7f4fc0100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400db80 tx=0x7f4fb400b630 comp rx=0 tx=0).stop 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 -- 172.21.15.52:0/3763710081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84103710 msgr2=0x7fdb84109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 --2- 172.21.15.52:0/3763710081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84103710 0x7fdb84109fa0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009ca0 tx=0x7fdb7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 -- 172.21.15.52:0/3763710081 shutdown_connections 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 --2- 172.21.15.52:0/3763710081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84103710 0x7fdb84109fa0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 --2- 172.21.15.52:0/3763710081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84102d50 0x7fdb841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 --2- 172.21.15.52:0/3763710081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84101b60 0x7fdb84101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 -- 172.21.15.52:0/3763710081 >> 172.21.15.52:0/3763710081 conn(0x7fdb840fd320 msgr2=0x7fdb840ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 shutdown_connections 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fac0a3240 0x7f4fac0a5700 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc01082a0 0x7f4fc0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.385 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 -- 172.21.15.52:0/3763710081 shutdown_connections 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc01036e0 0x7f4fc0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 --2- 172.21.15.52:0/2267324571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc0102d30 0x7f4fc0100990 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 >> 172.21.15.52:0/2267324571 conn(0x7f4fc00fc7d0 msgr2=0x7f4fc0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.386 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.376+0000 7fdb8a318640 1 -- 172.21.15.52:0/3763710081 wait complete. 2024-09-19T09:33:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 shutdown_connections 2024-09-19T09:33:10.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:10.376+0000 7f4fc8191640 1 -- 172.21.15.52:0/2267324571 wait complete. 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 Processor -- start 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 -- start start 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84102d50 0x7fdb84198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84103710 0x7fdb8419f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d7c0 con 0x7fdb84101b60 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d640 con 0x7fdb84103710 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb8a318640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8410d940 con 0x7fdb84102d50 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47978/0 (socket says 172.21.15.52:47978) 2024-09-19T09:33:10.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb83fff640 1 -- 172.21.15.52:0/768492122 learned_addr learned my addr 172.21.15.52:0/768492122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb888b5640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84103710 0x7fdb8419f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.377+0000 7fdb837fe640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84102d50 0x7fdb84198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 -- 172.21.15.52:0/768492122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84102d50 msgr2=0x7fdb84198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84102d50 0x7fdb84198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 -- 172.21.15.52:0/768492122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84103710 msgr2=0x7fdb8419f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84103710 0x7fdb8419f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 -- 172.21.15.52:0/768492122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8419f970 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb83fff640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400e9c0 tx=0x7fdb7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb817fa640 1 -- 172.21.15.52:0/768492122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400cd80 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8419fc60 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb817fa640 1 -- 172.21.15.52:0/768492122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb740035f0 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb817fa640 1 -- 172.21.15.52:0/768492122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74010690 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.378+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841a01b0 con 0x7fdb84101b60 2024-09-19T09:33:10.395 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.380+0000 7fdb817fa640 1 -- 172.21.15.52:0/768492122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdb740037a0 con 0x7fdb84101b60 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.381+0000 7fdb817fa640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 0x7fdb6c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.381+0000 7fdb817fa640 1 -- 172.21.15.52:0/768492122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdb740cfe10 con 0x7fdb84101b60 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.381+0000 7fdb837fe640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 0x7fdb6c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 Processor -- start 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb837fe640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 0x7fdb6c0a57b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdb780095f0 tx=0x7fdb78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 -- start start 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2d4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2d9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564f1f2382f0 con 0x564f1f2da370 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564f1f1e0270 con 0x564f1f2d52e0 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f1f2342b0 con 0x564f1f2d49a0 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47994/0 (socket says 172.21.15.52:47994) 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 -- 172.21.15.52:0/1519446628 learned_addr learned my addr 172.21.15.52:0/1519446628 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb837fe640 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2d9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb83fff640 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2d4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 -- 172.21.15.52:0/1519446628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 msgr2=0x564f1f2d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2d4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 -- 172.21.15.52:0/1519446628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 msgr2=0x564f1f2d9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2d9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.382+0000 7fdb888b5640 1 -- 172.21.15.52:0/1519446628 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1f1df340 con 0x564f1f2da370 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.383+0000 7fdb888b5640 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009ca0 tx=0x7fdb7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0191621bdad1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.383+0000 7fdb6a7fc640 1 -- 172.21.15.52:0/1519446628 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0098c0 con 0x564f1f2da370 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.383+0000 7fdb6a7fc640 1 -- 172.21.15.52:0/1519446628 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7c036040 con 0x564f1f2da370 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.383+0000 7fdb6a7fc640 1 -- 172.21.15.52:0/1519446628 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c004290 con 0x564f1f2da370 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1519446628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 msgr2=0x564f1f2dc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009ca0 tx=0x7fdb7c004a40 comp rx=0 tx=0).stop 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1519446628 shutdown_connections 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2dc830 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2d9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1519446628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2d4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1519446628 >> 172.21.15.52:0/1519446628 conn(0x564f1f2d0010 msgr2=0x564f1f2d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1519446628 shutdown_connections 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1519446628 wait complete. 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 -- start start 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.384+0000 7fdb8d0b1740 1 Processor -- start 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2de960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2deea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564f1f2dd100 con 0x564f1f2da370 2024-09-19T09:33:10.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564f1f1c1290 con 0x564f1f2d52e0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564f1f2dd280 con 0x564f1f2d49a0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb8d0b1740 10 client.0 _ll_register_callbacks cb 0x564f1f1f2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48000/0 (socket says 172.21.15.52:48000) 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 -- 172.21.15.52:0/183024905 learned_addr learned my addr 172.21.15.52:0/183024905 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb83fff640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb837fe640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2deea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 -- 172.21.15.52:0/183024905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 msgr2=0x564f1f2de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2de960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 -- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 msgr2=0x564f1f2deea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2deea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 -- 172.21.15.52:0/183024905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1ef4b210 con 0x564f1f2da370 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb888b5640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009bf0 tx=0x7fdb7c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295162f0972858b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb637fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.385+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c053060 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdb7c041040 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb7c036040 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb7c0098c0 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 10 client.19680 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f1f017620 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb7c036040 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb7c04d070 con 0x564f1f2da370 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 10 client.19680 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 10 client.19680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 20 client.19680 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f2ea250 0x564f1f2ec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 4 client.19680 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f1f245a20 con 0x564f1f2ea250 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.386+0000 7fdb83fff640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f2ea250 0x564f1f2ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.387+0000 7fdb637fe640 10 client.19680 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.387+0000 7fdb83fff640 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f2ea250 0x564f1f2ec640 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc00c4e2fcfc84c6 server_cookie=bba308cf2aa58824 in_seq=0 out_seq=0 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.387+0000 7fdb637fe640 1 -- 172.21.15.52:0/183024905 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f1f245a20 con 0x564f1f2ea250 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.387+0000 7fdb637fe640 10 client.19680 handle_command_reply: tid=0 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.387+0000 7fdb8d0b1740 1 client.19680 shutdown 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 msgr2=0x564f1f2e5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009bf0 tx=0x7fdb7c0319b0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 shutdown_connections 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f2ea250 0x564f1f2ec640 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2da370 0x564f1f2e5ee0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d52e0 0x564f1f2deea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/183024905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d49a0 0x564f1f2de960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb637fe640 0 client.19680 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 >> 172.21.15.52:0/183024905 conn(0x564f1f2d0010 msgr2=0x564f1f2d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 shutdown_connections 2024-09-19T09:33:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/183024905 wait complete. 2024-09-19T09:33:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.388+0000 7fdb8d0b1740 20 client.19680 trim_cache size 0 max 16384 2024-09-19T09:33:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.403+0000 7fdb8d0b1740 1 Processor -- start 2024-09-19T09:33:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.403+0000 7fdb8d0b1740 1 -- start start 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d52e0 0x564f1f2e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2da370 0x564f1f2d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841ab990 con 0x564f1f2d49a0 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841a9260 con 0x564f1f2da370 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841a70b0 con 0x564f1f2d52e0 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48016/0 (socket says 172.21.15.52:48016) 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 -- 172.21.15.52:0/1050916575 learned_addr learned my addr 172.21.15.52:0/1050916575 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb837fe640 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d52e0 0x564f1f2e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb888b5640 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2da370 0x564f1f2d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 -- 172.21.15.52:0/1050916575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d52e0 msgr2=0x564f1f2e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.407 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d52e0 0x564f1f2e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 -- 172.21.15.52:0/1050916575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2da370 msgr2=0x564f1f2d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2da370 0x564f1f2d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.404+0000 7fdb83fff640 1 -- 172.21.15.52:0/1050916575 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f1f2d5f70 con 0x564f1f2d49a0 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.405+0000 7fdb83fff640 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdb740cd890 tx=0x7fdb7409bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e35863e9f3737b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.405+0000 7fdb69ffb640 1 -- 172.21.15.52:0/1050916575 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b9020 con 0x564f1f2d49a0 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.405+0000 7fdb69ffb640 1 -- 172.21.15.52:0/1050916575 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb740a5020 con 0x564f1f2d49a0 2024-09-19T09:33:10.408 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.405+0000 7fdb69ffb640 1 -- 172.21.15.52:0/1050916575 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb740a4b90 con 0x564f1f2d49a0 2024-09-19T09:33:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1050916575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 msgr2=0x564f1f2cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdb740cd890 tx=0x7fdb7409bef0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1050916575 shutdown_connections 2024-09-19T09:33:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2da370 0x564f1f2d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2d52e0 0x564f1f2e5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/1050916575 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d49a0 0x564f1f2cf0b0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1050916575 >> 172.21.15.52:0/1050916575 conn(0x564f1f2d0010 msgr2=0x564f1f2ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1050916575 shutdown_connections 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/1050916575 wait complete. 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 -- start start 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.406+0000 7fdb8d0b1740 1 Processor -- start 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 0x564f1f2e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2da370 0x564f1f2e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841a7720 con 0x564f1f2d52e0 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841a8b90 con 0x564f1f2d49a0 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdb841a7df0 con 0x564f1f2da370 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb8d0b1740 10 client.0 _ll_register_callbacks cb 0x7fdb780097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48030/0 (socket says 172.21.15.52:48030) 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 -- 172.21.15.52:0/3194241608 learned_addr learned my addr 172.21.15.52:0/3194241608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb83fff640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 0x564f1f2e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb888b5640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2da370 0x564f1f2e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 -- 172.21.15.52:0/3194241608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2da370 msgr2=0x564f1f2e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2da370 0x564f1f2e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 -- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 msgr2=0x564f1f2e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 0x564f1f2e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb837fe640 1 -- 172.21.15.52:0/3194241608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f1f2e5430 con 0x564f1f2d52e0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.407+0000 7fdb83fff640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 0x564f1f2e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb837fe640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fdb78012c80 tx=0x7fdb78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be71f18ddb8e4d96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78005020 con 0x564f1f2d52e0 2024-09-19T09:33:10.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdb780051c0 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb740a5020 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb780053c0 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 10 client.19686 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564f1f355240 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb740a5020 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb78029070 con 0x564f1f2d52e0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 10 client.19686 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 10 client.19686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 20 client.19686 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f355c70 0x564f1f358090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 4 client.19686 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.408+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f1f23fd70 con 0x564f1f355c70 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.409+0000 7fdb83fff640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f355c70 0x564f1f358090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.409+0000 7fdb637fe640 10 client.19686 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.415 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.409+0000 7fdb83fff640 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f355c70 0x564f1f358090 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d593a5d84bafa5 server_cookie=4189c5ec721d4ab in_seq=0 out_seq=0 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb637fe640 1 -- 172.21.15.52:0/3194241608 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f1f23fd70 con 0x564f1f355c70 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb637fe640 10 client.19686 handle_command_reply: tid=0 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 client.19686 shutdown 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 msgr2=0x564f1f2e3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fdb78012c80 tx=0x7fdb78004730 comp rx=0 tx=0).stop 2024-09-19T09:33:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 shutdown_connections 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564f1f355c70 0x564f1f358090 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564f1f2da370 0x564f1f2e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564f1f2d52e0 0x564f1f2e3e10 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb637fe640 0 client.19686 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 --2- 172.21.15.52:0/3194241608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564f1f2d49a0 0x564f1f2e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 >> 172.21.15.52:0/3194241608 conn(0x564f1f2d0010 msgr2=0x564f1f2cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 shutdown_connections 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 1 -- 172.21.15.52:0/3194241608 wait complete. 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.421+0000 7fdb8d0b1740 20 client.19686 trim_cache size 0 max 16384 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:33:10.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 msgr2=0x7fdb6c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 0x7fdb6c0a57b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdb780095f0 tx=0x7fdb78005f90 comp rx=0 tx=0).stop 2024-09-19T09:33:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 msgr2=0x7fdb84197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400e9c0 tx=0x7fdb7400ee80 comp rx=0 tx=0).stop 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 shutdown_connections 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdb84103710 0x7fdb8419f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdb6c0a32f0 0x7fdb6c0a57b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdb84102d50 0x7fdb84198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 --2- 172.21.15.52:0/768492122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb84101b60 0x7fdb84197d50 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 >> 172.21.15.52:0/768492122 conn(0x7fdb840fd320 msgr2=0x7fdb84106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 shutdown_connections 2024-09-19T09:33:10.426 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:10.422+0000 7fdb8a318640 1 -- 172.21.15.52:0/768492122 wait complete. 2024-09-19T09:33:10.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:10 smithi052 ceph-mon[30947]: pgmap v690: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-19T09:33:10.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:10 smithi169 ceph-mon[35454]: pgmap v690: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-19T09:33:11.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:10 smithi086 ceph-mon[34813]: pgmap v690: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-19T09:33:12.146 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:33:12.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:33:12.419 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:12.793 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:12 smithi052 ceph-mon[30947]: pgmap v691: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 -- 172.21.15.52:0/2191771619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 msgr2=0x7f57f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 --2- 172.21.15.52:0/2191771619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f01021c0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009900 tx=0x7f57e002a410 comp rx=0 tx=0).stop 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 -- 172.21.15.52:0/2191771619 shutdown_connections 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 --2- 172.21.15.52:0/2191771619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 0x7f57f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 --2- 172.21.15.52:0/2191771619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 0x7f57f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 --2- 172.21.15.52:0/2191771619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f01021c0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 -- 172.21.15.52:0/2191771619 >> 172.21.15.52:0/2191771619 conn(0x7f57f00fd8c0 msgr2=0x7f57f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 -- 172.21.15.52:0/2191771619 shutdown_connections 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.872+0000 7f57f4b22640 1 -- 172.21.15.52:0/2191771619 wait complete. 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 Processor -- start 2024-09-19T09:33:12.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 -- start start 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 0x7f57f0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 0x7f57f019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111f70 con 0x7f57f0101de0 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0111df0 con 0x7f57f0102790 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57f4b22640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01120f0 con 0x7f57f0106f10 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48056/0 (socket says 172.21.15.52:48056) 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.873+0000 7f57ee59c640 1 -- 172.21.15.52:0/135693821 learned_addr learned my addr 172.21.15.52:0/135693821 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 0x7f57f0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57eed9d640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 0x7f57f019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 -- 172.21.15.52:0/135693821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 msgr2=0x7f57f019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 0x7f57f019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 -- 172.21.15.52:0/135693821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 msgr2=0x7f57f0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 0x7f57f0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 -- 172.21.15.52:0/135693821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f019d3e0 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57ee59c640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006010 tx=0x7f57e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57e7fff640 1 -- 172.21.15.52:0/135693821 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e003f030 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f019d670 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57e7fff640 1 -- 172.21.15.52:0/135693821 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e0003ce0 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57e7fff640 1 -- 172.21.15.52:0/135693821 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0035070 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.874+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f01a4fb0 con 0x7f57f0101de0 2024-09-19T09:33:12.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57e7fff640 1 -- 172.21.15.52:0/135693821 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f57e0042030 con 0x7f57f0101de0 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 Processor -- start 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 -- start start 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dcbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcc360 0x5626a7ddac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5626a7d31280 con 0x5626a7ddb150 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5626a7cd8b10 con 0x5626a7dcc360 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.877+0000 7f57f6efb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5626a7d2d240 con 0x5626a7dcba40 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48064/0 (socket says 172.21.15.52:48064) 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 -- 172.21.15.52:0/338084605 learned_addr learned my addr 172.21.15.52:0/338084605 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e7fff640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 0x7f57dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57ee59c640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcc360 0x5626a7ddac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57eed9d640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dcbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57eed9d640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 0x7f57dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 -- 172.21.15.52:0/338084605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 msgr2=0x5626a7dcbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dcbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 -- 172.21.15.52:0/338084605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcc360 msgr2=0x5626a7ddac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcc360 0x5626a7ddac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 -- 172.21.15.52:0/338084605 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a7ce51f0 con 0x5626a7ddb150 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57eed9d640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dcbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e7fff640 1 -- 172.21.15.52:0/135693821 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f57e00f0060 con 0x7f57f0101de0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f57d800dc80 tx=0x7f57d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7a2d565489e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57eed9d640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 0x7f57dc0a5700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009fd0 tx=0x7f57e8005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e4d99640 1 -- 172.21.15.52:0/338084605 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8015070 con 0x5626a7ddb150 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e4d99640 1 -- 172.21.15.52:0/338084605 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d8011920 con 0x5626a7ddb150 2024-09-19T09:33:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.878+0000 7f57e4d99640 1 -- 172.21.15.52:0/338084605 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8010a00 con 0x5626a7ddb150 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 -- 172.21.15.52:0/338084605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 msgr2=0x5626a7ddd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f57d800dc80 tx=0x7f57d800f730 comp rx=0 tx=0).stop 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 -- 172.21.15.52:0/338084605 shutdown_connections 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7ddb150 0x5626a7ddd540 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcc360 0x5626a7ddac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 --2- 172.21.15.52:0/338084605 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dcbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 -- 172.21.15.52:0/338084605 >> 172.21.15.52:0/338084605 conn(0x5626a7dc80f0 msgr2=0x5626a7dc84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 -- 172.21.15.52:0/338084605 shutdown_connections 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.879+0000 7f57f6efb740 1 -- 172.21.15.52:0/338084605 wait complete. 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 -- start start 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 Processor -- start 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dd8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5626a7dddd20 con 0x5626a7dcc360 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5626a7cebf10 con 0x5626a7ddb150 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5626a7dddea0 con 0x5626a7dcba40 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57f6efb740 10 client.0 _ll_register_callbacks cb 0x5626a7cb4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48068/0 (socket says 172.21.15.52:48068) 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 -- 172.21.15.52:0/765736007 learned_addr learned my addr 172.21.15.52:0/765736007 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57ee59c640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dd8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57eed9d640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 -- 172.21.15.52:0/765736007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 msgr2=0x5626a7dd8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dd8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 -- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 msgr2=0x5626a7dd8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57e5d9b640 1 -- 172.21.15.52:0/765736007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a7aa26a0 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57ee59c640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dd8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.880+0000 7f57eed9d640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f57d8005de0 tx=0x7f57d800dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d0a692b1902a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8015070 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f57d8011710 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57d8011920 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57d8011ad0 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 10 client.19698 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5626a7de9990 con 0x5626a7dcc360 2024-09-19T09:33:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d8011920 con 0x5626a7dcc360 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f57d80109a0 con 0x5626a7dcc360 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 10 client.19698 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 10 client.19698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 20 client.19698 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7deadf0 0x5626a7ded1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 4 client.19698 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.881+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626a7d3e7f0 con 0x5626a7deadf0 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.882+0000 7f57ee59c640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7deadf0 0x5626a7ded1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.882+0000 7f57ee59c640 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7deadf0 0x5626a7ded1e0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47116b94751765ec server_cookie=6cedb682a11d4133 in_seq=0 out_seq=0 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.882+0000 7f57d5ffb640 10 client.19698 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57d5ffb640 1 -- 172.21.15.52:0/765736007 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626a7d3e7f0 con 0x5626a7deadf0 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57d5ffb640 10 client.19698 handle_command_reply: tid=0 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 client.19698 shutdown 2024-09-19T09:33:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 msgr2=0x5626a7dd85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f57d8005de0 tx=0x7f57d800dfa0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 shutdown_connections 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7deadf0 0x5626a7ded1e0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7dd85a0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57d5ffb640 0 client.19698 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 --2- 172.21.15.52:0/765736007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7dd8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 >> 172.21.15.52:0/765736007 conn(0x5626a7dc80f0 msgr2=0x5626a7dcde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 shutdown_connections 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 1 -- 172.21.15.52:0/765736007 wait complete. 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.883+0000 7f57f6efb740 20 client.19698 trim_cache size 0 max 16384 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 Processor -- start 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 -- start start 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7df2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01aded0 con 0x5626a7dcc360 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01ab7a0 con 0x5626a7ddb150 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57f6efb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01a95f0 con 0x5626a7dcba40 2024-09-19T09:33:12.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48078/0 (socket says 172.21.15.52:48078) 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57e5d9b640 1 -- 172.21.15.52:0/1518482918 learned_addr learned my addr 172.21.15.52:0/1518482918 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.901+0000 7f57eed9d640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57ee59c640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7df2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 -- 172.21.15.52:0/1518482918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 msgr2=0x5626a7df2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7df2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 -- 172.21.15.52:0/1518482918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 msgr2=0x5626a7dd52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 -- 172.21.15.52:0/1518482918 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626a7dda930 con 0x5626a7dcc360 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57ee59c640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7df2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e010 tx=0x7f57d800fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e0460fecb126f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57d7fff640 1 -- 172.21.15.52:0/1518482918 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8030070 con 0x5626a7dcc360 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57d7fff640 1 -- 172.21.15.52:0/1518482918 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d800db00 con 0x5626a7dcc360 2024-09-19T09:33:12.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.902+0000 7f57d7fff640 1 -- 172.21.15.52:0/1518482918 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8015040 con 0x5626a7dcc360 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- 172.21.15.52:0/1518482918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 msgr2=0x5626a7df2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f57d800e010 tx=0x7f57d800fd60 comp rx=0 tx=0).stop 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- 172.21.15.52:0/1518482918 shutdown_connections 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7ddb150 0x5626a7dd52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7df2d80 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 --2- 172.21.15.52:0/1518482918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7dcba40 0x5626a7df2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- 172.21.15.52:0/1518482918 >> 172.21.15.52:0/1518482918 conn(0x5626a7dc80f0 msgr2=0x5626a7dd7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- 172.21.15.52:0/1518482918 shutdown_connections 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- 172.21.15.52:0/1518482918 wait complete. 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 -- start start 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.903+0000 7f57f6efb740 1 Processor -- start 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcba40 0x5626a7ddf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7ddb150 0x5626a7e54810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01a9c60 con 0x5626a7dcc360 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01ab0d0 con 0x5626a7dcba40 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f57f01aa330 con 0x5626a7ddb150 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57f6efb740 10 client.0 _ll_register_callbacks cb 0x7f57e00b7120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57ee59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcba40 0x5626a7ddf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48088/0 (socket says 172.21.15.52:48088) 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 -- 172.21.15.52:0/2081797039 learned_addr learned my addr 172.21.15.52:0/2081797039 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57eed9d640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7ddb150 0x5626a7e54810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 -- 172.21.15.52:0/2081797039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7ddb150 msgr2=0x5626a7e54810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7ddb150 0x5626a7e54810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 -- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcba40 msgr2=0x5626a7ddf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcba40 0x5626a7ddf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 -- 172.21.15.52:0/2081797039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626a7e54d50 con 0x5626a7dcc360 2024-09-19T09:33:12.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57e5d9b640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f57d80045c0 tx=0x7f57d80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8375ab4336a91cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.904+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8039030 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57d800db00 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f57d8020040 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f57d8043030 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 10 client.19704 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5626a7e55fd0 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57d800db00 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f57d80037b0 con 0x5626a7dcc360 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 10 client.19704 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 10 client.19704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 20 client.19704 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7e566e0 0x5626a7e58b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 4 client.19704 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5626a7d38d00 con 0x5626a7e566e0 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.905+0000 7f57ee59c640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7e566e0 0x5626a7e58b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.906+0000 7f57ee59c640 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7e566e0 0x5626a7e58b00 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf068d2632263af server_cookie=7782aa90e90f43bf in_seq=0 out_seq=0 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.906+0000 7f57d5ffb640 10 client.19704 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57d5ffb640 1 -- 172.21.15.52:0/2081797039 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5626a7d38d00 con 0x5626a7e566e0 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57d5ffb640 10 client.19704 handle_command_reply: tid=0 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 client.19704 shutdown 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 msgr2=0x5626a7ddfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f57d80045c0 tx=0x7f57d80045f0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 shutdown_connections 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5626a7e566e0 0x5626a7e58b00 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5626a7ddb150 0x5626a7e54810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5626a7dcc360 0x5626a7ddfa40 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 --2- 172.21.15.52:0/2081797039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5626a7dcba40 0x5626a7ddf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57d5ffb640 0 client.19704 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 >> 172.21.15.52:0/2081797039 conn(0x5626a7dc80f0 msgr2=0x5626a7dd6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 shutdown_connections 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 1 -- 172.21.15.52:0/2081797039 wait complete. 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.907+0000 7f57f6efb740 20 client.19704 trim_cache size 0 max 16384 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "0cd27849-9c9e-4a17-984b-c39d23ac3330", 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:33:12.922 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 msgr2=0x7f57dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 0x7f57dc0a5700 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009fd0 tx=0x7f57e8005bd0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 msgr2=0x7f57f0198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f57e0006010 tx=0x7f57e00042f0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 shutdown_connections 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f57dc0a3240 0x7f57dc0a5700 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f57f0106f10 0x7f57f019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57f0102790 0x7f57f0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 --2- 172.21.15.52:0/135693821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57f0101de0 0x7f57f0198430 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 >> 172.21.15.52:0/135693821 conn(0x7f57f00fd8c0 msgr2=0x7f57f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 shutdown_connections 2024-09-19T09:33:12.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:12.908+0000 7f57f4b22640 1 -- 172.21.15.52:0/135693821 wait complete. 2024-09-19T09:33:12.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:12 smithi169 ceph-mon[35454]: pgmap v691: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:33:13.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:12 smithi086 ceph-mon[34813]: pgmap v691: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T09:33:13.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:33:13.852 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:13 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:33:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:13 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:13 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:33:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:13 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:13.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:13 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:33:13.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:13 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:33:13.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:13 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:13 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:33:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:13 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:13.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:13 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:33:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:13 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:33:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:13 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:13 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:33:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:13 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:14.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:13 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 -- 172.21.15.52:0/3635015451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c40102d40 msgr2=0x7f4c40103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/3635015451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c40102d40 0x7f4c40103120 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009900 tx=0x7f4c3002a480 comp rx=0 tx=0).stop 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 -- 172.21.15.52:0/3635015451 shutdown_connections 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/3635015451 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c4010c170 0x7f4c4010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/3635015451 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c4010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/3635015451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c40102d40 0x7f4c40103120 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 -- 172.21.15.52:0/3635015451 >> 172.21.15.52:0/3635015451 conn(0x7f4c400fc7a0 msgr2=0x7f4c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 -- 172.21.15.52:0/3635015451 shutdown_connections 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.334+0000 7f4c46a8a640 1 -- 172.21.15.52:0/3635015451 wait complete. 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 Processor -- start 2024-09-19T09:33:14.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 -- start start 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c40102d40 0x7f4c40198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c40198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40111f70 con 0x7f4c4010c170 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40111df0 con 0x7f4c40103660 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c46a8a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401120f0 con 0x7f4c40102d40 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c45027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c45027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48106/0 (socket says 172.21.15.52:48106) 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.335+0000 7f4c45027640 1 -- 172.21.15.52:0/1605333710 learned_addr learned my addr 172.21.15.52:0/1605333710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c44826640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c40102d40 0x7f4c40198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 -- 172.21.15.52:0/1605333710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c40102d40 msgr2=0x7f4c40198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c40102d40 0x7f4c40198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 -- 172.21.15.52:0/1605333710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 msgr2=0x7f4c40198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c40198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c40198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 -- 172.21.15.52:0/1605333710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4019d3e0 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c40198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c45027640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d750 tx=0x7f4c3800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c3dffb640 1 -- 172.21.15.52:0/1605333710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38017070 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4019d6d0 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c3dffb640 1 -- 172.21.15.52:0/1605333710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c38005500 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c3dffb640 1 -- 172.21.15.52:0/1605333710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38004d90 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.336+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c401a4fb0 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.338+0000 7f4c3dffb640 1 -- 172.21.15.52:0/1605333710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4c38004f30 con 0x7f4c4010c170 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 Processor -- start 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 -- start start 2024-09-19T09:33:14.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c3dffb640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bc052d2e0 con 0x562bc05c7dc0 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bc04d4ce0 con 0x562bc05c74a0 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c48e63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562bc05292a0 con 0x562bc05d2680 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c44826640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c44826640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48122/0 (socket says 172.21.15.52:48122) 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c44826640 1 -- 172.21.15.52:0/3835857100 learned_addr learned my addr 172.21.15.52:0/3835857100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c3dffb640 1 -- 172.21.15.52:0/1605333710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4c380cf410 con 0x7f4c4010c170 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.339+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c45027640 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 -- 172.21.15.52:0/3835857100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 msgr2=0x562bc05d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 -- 172.21.15.52:0/3835857100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 msgr2=0x562bc05c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 -- 172.21.15.52:0/3835857100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc04b9440 con 0x562bc05c7dc0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009fd0 tx=0x7f4c28009ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c44826640 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009900 tx=0x7f4c30005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce71174c8ba045dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c36ffd640 1 -- 172.21.15.52:0/3835857100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3003f070 con 0x562bc05c7dc0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c36ffd640 1 -- 172.21.15.52:0/3835857100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c30004030 con 0x562bc05c7dc0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.340+0000 7f4c36ffd640 1 -- 172.21.15.52:0/3835857100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30035070 con 0x562bc05c7dc0 2024-09-19T09:33:14.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- 172.21.15.52:0/3835857100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 msgr2=0x562bc05d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009900 tx=0x7f4c30005e80 comp rx=0 tx=0).stop 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- 172.21.15.52:0/3835857100 shutdown_connections 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05d4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05d2140 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3835857100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- 172.21.15.52:0/3835857100 >> 172.21.15.52:0/3835857100 conn(0x562bc05c3a30 msgr2=0x562bc05c3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- 172.21.15.52:0/3835857100 shutdown_connections 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- 172.21.15.52:0/3835857100 wait complete. 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 -- start start 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.341+0000 7f4c48e63740 1 Processor -- start 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 0x562bc05d1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c7dc0 0x562bc05cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562bc05d5250 con 0x562bc05d2680 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562bc04e8050 con 0x562bc05c7dc0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562bc05d53d0 con 0x562bc05c74a0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c48e63740 10 client.0 _ll_register_callbacks cb 0x562bc0528160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48132/0 (socket says 172.21.15.52:48132) 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 -- 172.21.15.52:0/4020823664 learned_addr learned my addr 172.21.15.52:0/4020823664 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c7dc0 0x562bc05cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 -- 172.21.15.52:0/4020823664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 msgr2=0x562bc05d1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c44826640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 0x562bc05d1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 0x562bc05d1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 -- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c7dc0 msgr2=0x562bc05cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c7dc0 0x562bc05cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 -- 172.21.15.52:0/4020823664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc029e3c0 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c44826640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 0x562bc05d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c45027640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4c3809b8e0 tx=0x7f4c38060c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99841c157a9187ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.342+0000 7f4c1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38020040 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4c380ccf40 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c30004030 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4c380b4030 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 10 client.19716 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562bc05e0bc0 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c30004030 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4c380ce070 con 0x562bc05d2680 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 10 client.19716 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:14.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 10 client.19716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 20 client.19716 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc05e2040 0x562bc05e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 4 client.19716 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.343+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bc053a850 con 0x562bc05e2040 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.344+0000 7f4c44826640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc05e2040 0x562bc05e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.344+0000 7f4c1ffff640 10 client.19716 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.344+0000 7f4c44826640 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc05e2040 0x562bc05e44d0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c71402b8cc76dd server_cookie=a05e8de73df4eb76 in_seq=0 out_seq=0 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c1ffff640 1 -- 172.21.15.52:0/4020823664 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f4c3004ee80 con 0x562bc05e2040 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c1ffff640 10 client.19716 handle_command_reply: tid=0 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 client.19716 shutdown 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 msgr2=0x562bc05cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4c3809b8e0 tx=0x7f4c38060c60 comp rx=0 tx=0).stop 2024-09-19T09:33:14.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 shutdown_connections 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc05e2040 0x562bc05e44d0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05d2680 0x562bc05cf760 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c7dc0 0x562bc05cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 --2- 172.21.15.52:0/4020823664 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c74a0 0x562bc05d1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c1ffff640 0 client.19716 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 >> 172.21.15.52:0/4020823664 conn(0x562bc05c3a30 msgr2=0x562bc05c2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 shutdown_connections 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 1 -- 172.21.15.52:0/4020823664 wait complete. 2024-09-19T09:33:14.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.345+0000 7f4c48e63740 20 client.19716 trim_cache size 0 max 16384 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 Processor -- start 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 -- start start 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401b0030 con 0x562bc05c7dc0 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401ad900 con 0x562bc05c74a0 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.362+0000 7f4c48e63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401ab750 con 0x562bc05d2680 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48138/0 (socket says 172.21.15.52:48138) 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 -- 172.21.15.52:0/3992855136 learned_addr learned my addr 172.21.15.52:0/3992855136 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c44826640 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c45027640 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 -- 172.21.15.52:0/3992855136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 msgr2=0x562bc05ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 -- 172.21.15.52:0/3992855136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 msgr2=0x562bc05de4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05de4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 -- 172.21.15.52:0/3992855136 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bc05c46c0 con 0x562bc05c7dc0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4c28005fd0 tx=0x7f4c28004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3b37b90aa268c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c367fc640 1 -- 172.21.15.52:0/3992855136 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28004240 con 0x562bc05c7dc0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c367fc640 1 -- 172.21.15.52:0/3992855136 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c28024070 con 0x562bc05c7dc0 2024-09-19T09:33:14.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.363+0000 7f4c367fc640 1 -- 172.21.15.52:0/3992855136 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c28029b70 con 0x562bc05c7dc0 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- 172.21.15.52:0/3992855136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 msgr2=0x562bc05e9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4c28005fd0 tx=0x7f4c28004ab0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- 172.21.15.52:0/3992855136 shutdown_connections 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05d2680 0x562bc05ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c7dc0 0x562bc05e9da0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 --2- 172.21.15.52:0/3992855136 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05c74a0 0x562bc05de4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- 172.21.15.52:0/3992855136 >> 172.21.15.52:0/3992855136 conn(0x562bc05c3a30 msgr2=0x562bc05cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- 172.21.15.52:0/3992855136 shutdown_connections 2024-09-19T09:33:14.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- 172.21.15.52:0/3992855136 wait complete. 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 -- start start 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.364+0000 7f4c48e63740 1 Processor -- start 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c7dc0 0x562bc05d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05d2680 0x562bc064bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401abdc0 con 0x562bc05c74a0 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401ad230 con 0x562bc05d2680 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4c401ac490 con 0x562bc05c7dc0 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c48e63740 10 client.0 _ll_register_callbacks cb 0x7f4c38009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48146/0 (socket says 172.21.15.52:48146) 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 -- 172.21.15.52:0/389324586 learned_addr learned my addr 172.21.15.52:0/389324586 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c45027640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05d2680 0x562bc064bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c7dc0 0x562bc05d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 -- 172.21.15.52:0/389324586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c7dc0 msgr2=0x562bc05d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c7dc0 0x562bc05d70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 -- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05d2680 msgr2=0x562bc064bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05d2680 0x562bc064bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.365+0000 7f4c44826640 1 -- 172.21.15.52:0/389324586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bc064c3b0 con 0x562bc05c74a0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c44826640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005c40 tx=0x7f4c30005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7da694fe912664 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30052070 con 0x562bc05c74a0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4c300317b0 con 0x562bc05c74a0 2024-09-19T09:33:14.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c28024070 con 0x562bc05c74a0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4c3005e050 con 0x562bc05c74a0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 10 client.19722 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562bc064d6a0 con 0x562bc05c74a0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c28024070 con 0x562bc05c74a0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4c30003850 con 0x562bc05c74a0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 10 client.19722 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 10 client.19722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 20 client.19722 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc064d990 0x562bc064fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 4 client.19722 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.366+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562bc05cfaf0 con 0x562bc064d990 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc064d990 0x562bc064fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:14.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c3ffff640 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc064d990 0x562bc064fd80 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b27fefbb128f6d server_cookie=3aa3a61ab150a18 in_seq=0 out_seq=0 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c1ffff640 10 client.19722 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c1ffff640 1 -- 172.21.15.52:0/389324586 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562bc05cfaf0 con 0x562bc064d990 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c1ffff640 10 client.19722 handle_command_reply: tid=0 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c48e63740 1 client.19722 shutdown 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.367+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 msgr2=0x562bc05d6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005c40 tx=0x7f4c30005bd0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 shutdown_connections 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562bc064d990 0x562bc064fd80 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562bc05d2680 0x562bc064bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562bc05c7dc0 0x562bc05d70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 --2- 172.21.15.52:0/389324586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562bc05c74a0 0x562bc05d6ba0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c1ffff640 0 client.19722 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 >> 172.21.15.52:0/389324586 conn(0x562bc05c3a30 msgr2=0x562bc05d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 shutdown_connections 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 1 -- 172.21.15.52:0/389324586 wait complete. 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c48e63740 20 client.19722 trim_cache size 0 max 16384 2024-09-19T09:33:14.382 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:14.383 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:33:14.383 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:33:14.383 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 msgr2=0x7f4c2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4c28009fd0 tx=0x7f4c28009ec0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 msgr2=0x7f4c4019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.368+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d750 tx=0x7f4c3800dc10 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 shutdown_connections 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c4010c170 0x7f4c4019cd00 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c40103660 0x7f4c40198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4c2c0a3240 0x7f4c2c0a5700 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 --2- 172.21.15.52:0/1605333710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4c40102d40 0x7f4c40198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 >> 172.21.15.52:0/1605333710 conn(0x7f4c400fc7a0 msgr2=0x7f4c400fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 shutdown_connections 2024-09-19T09:33:14.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:14.369+0000 7f4c46a8a640 1 -- 172.21.15.52:0/1605333710 wait complete. 2024-09-19T09:33:14.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:14 smithi052 ceph-mon[30947]: pgmap v692: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:14.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:14 smithi169 ceph-mon[35454]: pgmap v692: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:15.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:14 smithi086 ceph-mon[34813]: pgmap v692: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:15.143 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:33:15.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:33:15.409 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:15.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- 172.21.15.52:0/985470325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 msgr2=0x7f0a38106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/985470325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a38106e40 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009930 tx=0x7f0a3402a420 comp rx=0 tx=0).stop 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- 172.21.15.52:0/985470325 shutdown_connections 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/985470325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38101400 0x7f0a3810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/985470325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38100a60 0x7f0a38100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/985470325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a38106e40 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- 172.21.15.52:0/985470325 >> 172.21.15.52:0/985470325 conn(0x7f0a380fc780 msgr2=0x7f0a380feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- 172.21.15.52:0/985470325 shutdown_connections 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- 172.21.15.52:0/985470325 wait complete. 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 Processor -- start 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.867+0000 7f0a3f98b640 1 -- start start 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 0x7f0a38198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38101400 0x7f0a38198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38110ed0 con 0x7f0a38106a60 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38110d50 con 0x7f0a38101400 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3f98b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38111050 con 0x7f0a38100a60 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48172/0 (socket says 172.21.15.52:48172) 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 -- 172.21.15.52:0/3987436035 learned_addr learned my addr 172.21.15.52:0/3987436035 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3d727640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 0x7f0a38198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3cf26640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38101400 0x7f0a38198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 -- 172.21.15.52:0/3987436035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 msgr2=0x7f0a38198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 0x7f0a38198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 -- 172.21.15.52:0/3987436035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38101400 msgr2=0x7f0a38198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38101400 0x7f0a38198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:15.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 -- 172.21.15.52:0/3987436035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3819d3f0 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3d727640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 0x7f0a38198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.868+0000 7f0a3df28640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000b970 tx=0x7f0a3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.869+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30019070 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.869+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3819d6e0 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.869+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a3000cb40 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.869+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30007650 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.869+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a381a4fc0 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.870+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a38100ec0 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.871+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a3001c070 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.871+0000 7f0a2e7fc640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 0x7f0a240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.872+0000 7f0a3d727640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 0x7f0a240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.872+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0a300cf500 con 0x7f0a38106a60 2024-09-19T09:33:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.872+0000 7f0a3d727640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 0x7f0a240a5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0a34006010 tx=0x7f0a34005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:15.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:15.875+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a3009c140 con 0x7f0a38106a60 2024-09-19T09:33:16.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.089+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a381997a0 con 0x7f0a38106a60 2024-09-19T09:33:16.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.090+0000 7f0a2e7fc640 1 -- 172.21.15.52:0/3987436035 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f0a381997a0 con 0x7f0a38106a60 2024-09-19T09:33:16.092 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:33:16.092 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:33:16.092 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 msgr2=0x7f0a240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 0x7f0a240a5700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0a34006010 tx=0x7f0a34005a20 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 msgr2=0x7f0a3819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000b970 tx=0x7f0a3000be30 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 shutdown_connections 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a38106a60 0x7f0a3819cd10 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a38101400 0x7f0a38198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0a240a3240 0x7f0a240a5700 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 --2- 172.21.15.52:0/3987436035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a38100a60 0x7f0a38198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 >> 172.21.15.52:0/3987436035 conn(0x7f0a380fc780 msgr2=0x7f0a381047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 shutdown_connections 2024-09-19T09:33:16.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:16.093+0000 7f0a3f98b640 1 -- 172.21.15.52:0/3987436035 wait complete. 2024-09-19T09:33:16.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:33:16.859 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:16 smithi052 ceph-mon[30947]: pgmap v693: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:16.859 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:16 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3987436035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:16.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:16 smithi169 ceph-mon[35454]: pgmap v693: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:16.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:16 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3987436035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:17.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:16 smithi086 ceph-mon[34813]: pgmap v693: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:17.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:16 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3987436035' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:17.095 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 -- 172.21.15.52:0/4288072448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708106a80 msgr2=0x7f3708106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 --2- 172.21.15.52:0/4288072448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708106a80 0x7f3708106e60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009930 tx=0x7f36f802a420 comp rx=0 tx=0).stop 2024-09-19T09:33:17.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 -- 172.21.15.52:0/4288072448 shutdown_connections 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 --2- 172.21.15.52:0/4288072448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 0x7f370810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 --2- 172.21.15.52:0/4288072448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708100a80 0x7f3708100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 --2- 172.21.15.52:0/4288072448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708106a80 0x7f3708106e60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 -- 172.21.15.52:0/4288072448 >> 172.21.15.52:0/4288072448 conn(0x7f37080fc7a0 msgr2=0x7f37080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 -- 172.21.15.52:0/4288072448 shutdown_connections 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.576+0000 7f370c902640 1 -- 172.21.15.52:0/4288072448 wait complete. 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 Processor -- start 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 -- start start 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 0x7f37081989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708106a80 0x7f370819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3708110ea0 con 0x7f3708100a80 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3708110d20 con 0x7f3708106a80 2024-09-19T09:33:17.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370c902640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3708111020 con 0x7f3708101420 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48204/0 (socket says 172.21.15.52:48204) 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f370659c640 1 -- 172.21.15.52:0/3434730449 learned_addr learned my addr 172.21.15.52:0/3434730449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.577+0000 7f3705d9b640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 0x7f37081989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708106a80 0x7f370819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 -- 172.21.15.52:0/3434730449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 msgr2=0x7f37081989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 0x7f37081989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 -- 172.21.15.52:0/3434730449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708106a80 msgr2=0x7f370819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708106a80 0x7f370819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 -- 172.21.15.52:0/3434730449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370819d430 con 0x7f3708100a80 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370659c640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009230 tx=0x7f36f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f36ff7fe640 1 -- 172.21.15.52:0/3434730449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f803f030 con 0x7f3708100a80 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f36ff7fe640 1 -- 172.21.15.52:0/3434730449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8003ad0 con 0x7f3708100a80 2024-09-19T09:33:17.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370819d6c0 con 0x7f3708100a80 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f36ff7fe640 1 -- 172.21.15.52:0/3434730449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8035070 con 0x7f3708100a80 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.578+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37081a5000 con 0x7f3708100a80 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.581+0000 7f36ff7fe640 1 -- 172.21.15.52:0/3434730449 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f36f8042030 con 0x7f3708100a80 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.581+0000 7f370ecdb740 1 Processor -- start 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.581+0000 7f370ecdb740 1 -- start start 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55725f8192f0 con 0x55725f8b35d0 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55725f7c0cf0 con 0x55725f8b4b40 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370ecdb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55725f8152b0 con 0x55725f8c2780 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48216/0 (socket says 172.21.15.52:48216) 2024-09-19T09:33:17.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 -- 172.21.15.52:0/2185873316 learned_addr learned my addr 172.21.15.52:0/2185873316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f3705d9b640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f3706d9d640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f36ff7fe640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 0x7f36f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 -- 172.21.15.52:0/2185873316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 msgr2=0x55725f8c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 -- 172.21.15.52:0/2185873316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 msgr2=0x55725f8b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 -- 172.21.15.52:0/2185873316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725f7a53a0 con 0x55725f8b35d0 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f3705d9b640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 0x7f36f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f36ff7fe640 1 -- 172.21.15.52:0/3434730449 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36f80eff90 con 0x7f3708100a80 2024-09-19T09:33:17.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.582+0000 7f370659c640 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f36f8098040 tx=0x7f36f8086e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847a779e769f02c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f36fcff9640 1 -- 172.21.15.52:0/2185873316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80bbe30 con 0x55725f8b35d0 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f36fcff9640 1 -- 172.21.15.52:0/2185873316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8087370 con 0x55725f8b35d0 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f36fcff9640 1 -- 172.21.15.52:0/2185873316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80b8040 con 0x55725f8b35d0 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 -- 172.21.15.52:0/2185873316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 msgr2=0x55725f8b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 0x7f36f40a5700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3700009eb0 tx=0x7f370000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f36f8098040 tx=0x7f36f8086e60 comp rx=0 tx=0).stop 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 -- 172.21.15.52:0/2185873316 shutdown_connections 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b35d0 0x55725f8b3a10 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 --2- 172.21.15.52:0/2185873316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.583+0000 7f370ecdb740 1 -- 172.21.15.52:0/2185873316 >> 172.21.15.52:0/2185873316 conn(0x55725f87c310 msgr2=0x55725f8afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- 172.21.15.52:0/2185873316 shutdown_connections 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- 172.21.15.52:0/2185873316 wait complete. 2024-09-19T09:33:17.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- start start 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 Processor -- start 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b4b40 0x55725f8bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55725f8c5240 con 0x55725f8c2780 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55725f7d4060 con 0x55725f8b35d0 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55725f8c53c0 con 0x55725f8b4b40 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f370ecdb740 10 client.0 _ll_register_callbacks cb 0x55725f5278c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f3706d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f3706d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48220/0 (socket says 172.21.15.52:48220) 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.584+0000 7f3706d9d640 1 -- 172.21.15.52:0/1888982135 learned_addr learned my addr 172.21.15.52:0/1888982135 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3705d9b640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b4b40 0x55725f8bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f370659c640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 -- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b4b40 msgr2=0x55725f8bf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b4b40 0x55725f8bf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 -- 172.21.15.52:0/1888982135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 msgr2=0x55725f8c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 -- 172.21.15.52:0/1888982135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55725f58a3c0 con 0x55725f8c2780 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f3706d9d640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3700016a70 tx=0x7f37000093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639a7ed1598f49d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f36edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370000ae50 con 0x55725f8c2780 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3700020410 con 0x55725f8c2780 2024-09-19T09:33:17.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36f8087370 con 0x55725f8c2780 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3700020610 con 0x55725f8c2780 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f370ecdb740 10 client.19740 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.585+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55725f8d0b90 con 0x55725f8c2780 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f8087370 con 0x55725f8c2780 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3700029a50 con 0x55725f8c2780 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 10 client.19740 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 10 client.19740 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 20 client.19740 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f8d4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 4 client.19740 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55725f826860 con 0x55725f8d1ff0 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.586+0000 7f370659c640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f8d4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.587+0000 7f370659c640 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f8d4470 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd1834008b9f610a server_cookie=857c65ab3dfe38e5 in_seq=0 out_seq=0 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.587+0000 7f36edffb640 10 client.19740 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.587+0000 7f36edffb640 1 -- 172.21.15.52:0/1888982135 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55725f826860 con 0x55725f8d1ff0 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.587+0000 7f36edffb640 10 client.19740 handle_command_reply: tid=0 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.587+0000 7f370ecdb740 1 client.19740 shutdown 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 msgr2=0x55725f8bf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f3700016a70 tx=0x7f37000093d0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 shutdown_connections 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f8d4470 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8bf9e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f36edffb640 0 client.19740 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b4b40 0x55725f8bf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 --2- 172.21.15.52:0/1888982135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 >> 172.21.15.52:0/1888982135 conn(0x55725f87c310 msgr2=0x55725f8b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 shutdown_connections 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 1 -- 172.21.15.52:0/1888982135 wait complete. 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.588+0000 7f370ecdb740 20 client.19740 trim_cache size 0 max 16384 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 Processor -- start 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 -- start start 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b35d0 0x55725f8ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37081adea0 con 0x55725f8c2780 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ab770 con 0x55725f8b4b40 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f370ecdb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37081a95c0 con 0x55725f8b35d0 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48226/0 (socket says 172.21.15.52:48226) 2024-09-19T09:33:17.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 -- 172.21.15.52:0/3013471298 learned_addr learned my addr 172.21.15.52:0/3013471298 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 -- 172.21.15.52:0/3013471298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b35d0 msgr2=0x55725f8ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3705d9b640 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b35d0 0x55725f8ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 -- 172.21.15.52:0/3013471298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 msgr2=0x55725f8af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 -- 172.21.15.52:0/3013471298 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725f8b6120 con 0x55725f8c2780 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.602+0000 7f3706d9d640 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f370000c040 tx=0x7f3700004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17751709b2d835e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.603+0000 7f36effff640 1 -- 172.21.15.52:0/3013471298 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700037070 con 0x55725f8c2780 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.603+0000 7f36effff640 1 -- 172.21.15.52:0/3013471298 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3700025070 con 0x55725f8c2780 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.603+0000 7f36effff640 1 -- 172.21.15.52:0/3013471298 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700029660 con 0x55725f8c2780 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- 172.21.15.52:0/3013471298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 msgr2=0x55725f8afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f370000c040 tx=0x7f3700004a40 comp rx=0 tx=0).stop 2024-09-19T09:33:17.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- 172.21.15.52:0/3013471298 shutdown_connections 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8c2780 0x55725f8afc40 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b4b40 0x55725f8af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- 172.21.15.52:0/3013471298 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8b35d0 0x55725f8ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- 172.21.15.52:0/3013471298 >> 172.21.15.52:0/3013471298 conn(0x55725f87c310 msgr2=0x55725f8bf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- 172.21.15.52:0/3013471298 shutdown_connections 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- 172.21.15.52:0/3013471298 wait complete. 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- start start 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 Processor -- start 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37081a9c30 con 0x55725f8b4b40 2024-09-19T09:33:17.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f37081ab0a0 con 0x55725f8b35d0 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.604+0000 7f370ecdb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37081aa300 con 0x55725f8c2780 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f370ecdb740 10 client.0 _ll_register_callbacks cb 0x7f3700009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48228/0 (socket says 172.21.15.52:48228) 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 -- 172.21.15.52:0/264664385 learned_addr learned my addr 172.21.15.52:0/264664385 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f370659c640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3706d9d640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 -- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 msgr2=0x55725f8c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 -- 172.21.15.52:0/264664385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 msgr2=0x55725f8cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:17.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8cab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 -- 172.21.15.52:0/264664385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55725f8c6bc0 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f3705d9b640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x55725f8b4070 tx=0x7f36f0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b20a6664c974d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.605+0000 7f36edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.606+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0004240 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.606+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36f00043e0 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.606+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3700025070 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.606+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f36f00035f0 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 10 client.19746 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55725f93cc80 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3700025070 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f36f0027a70 con 0x55725f8b4b40 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 10 client.19746 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:17.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 10 client.19746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 20 client.19746 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f93f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 4 client.19746 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55725f820d70 con 0x55725f8d1ff0 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.607+0000 7f370659c640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f93f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f36edffb640 10 client.19746 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370659c640 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f93f440 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cc8072f6d8023e0 server_cookie=7f5dc7454e15f57b in_seq=0 out_seq=0 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f36edffb640 1 -- 172.21.15.52:0/264664385 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55725f820d70 con 0x55725f8d1ff0 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f36edffb640 10 client.19746 handle_command_reply: tid=0 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 client.19746 shutdown 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 msgr2=0x55725f8c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x55725f8b4070 tx=0x7f36f0013830 comp rx=0 tx=0).stop 2024-09-19T09:33:17.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 shutdown_connections 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55725f8d1ff0 0x55725f93f440 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55725f8c2780 0x55725f8c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55725f8b4b40 0x55725f8c5e50 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f36edffb640 0 client.19746 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 --2- 172.21.15.52:0/264664385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55725f8b35d0 0x55725f8cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 >> 172.21.15.52:0/264664385 conn(0x55725f87c310 msgr2=0x55725f8af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 shutdown_connections 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 1 -- 172.21.15.52:0/264664385 wait complete. 2024-09-19T09:33:17.636 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.608+0000 7f370ecdb740 20 client.19746 trim_cache size 0 max 16384 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 msgr2=0x7f36f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 0x7f36f40a5700 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3700009eb0 tx=0x7f370000e040 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 msgr2=0x7f3708198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009230 tx=0x7f36f8004270 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 shutdown_connections 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3708106a80 0x7f370819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36f40a3240 0x7f36f40a5700 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3708101420 0x7f37081989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 --2- 172.21.15.52:0/3434730449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3708100a80 0x7f3708198480 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:17.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 >> 172.21.15.52:0/3434730449 conn(0x7f37080fc7a0 msgr2=0x7f370806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:17.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 shutdown_connections 2024-09-19T09:33:17.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:17.609+0000 7f370c902640 1 -- 172.21.15.52:0/3434730449 wait complete. 2024-09-19T09:33:18.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:33:18.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:18 smithi052 ceph-mon[30947]: pgmap v694: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:33:18.708 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:18.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:18 smithi169 ceph-mon[35454]: pgmap v694: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:33:19.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:18 smithi086 ceph-mon[34813]: pgmap v694: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:33:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- 172.21.15.52:0/90941479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0101de0 msgr2=0x7f06a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 --2- 172.21.15.52:0/90941479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0101de0 0x7f06a01021c0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f0690009900 tx=0x7f069002a410 comp rx=0 tx=0).stop 2024-09-19T09:33:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- 172.21.15.52:0/90941479 shutdown_connections 2024-09-19T09:33:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 --2- 172.21.15.52:0/90941479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 0x7f06a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 --2- 172.21.15.52:0/90941479 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0102790 0x7f06a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 --2- 172.21.15.52:0/90941479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0101de0 0x7f06a01021c0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- 172.21.15.52:0/90941479 >> 172.21.15.52:0/90941479 conn(0x7f06a00fd8c0 msgr2=0x7f06a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- 172.21.15.52:0/90941479 shutdown_connections 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- 172.21.15.52:0/90941479 wait complete. 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 Processor -- start 2024-09-19T09:33:19.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.210+0000 7f06a6162640 1 -- start start 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 0x7f06a019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 0x7f06a019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06a0111f70 con 0x7f06a0102790 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06a0111df0 con 0x7f06a0101de0 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f06a6162640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01120f0 con 0x7f06a0106f10 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46820/0 (socket says 172.21.15.52:46820) 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 -- 172.21.15.52:0/2210785466 learned_addr learned my addr 172.21.15.52:0/2210785466 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069ffff640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 0x7f06a019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069f7fe640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 0x7f06a019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 -- 172.21.15.52:0/2210785466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 msgr2=0x7f06a019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 0x7f06a019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 -- 172.21.15.52:0/2210785466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 msgr2=0x7f06a019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 0x7f06a019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 -- 172.21.15.52:0/2210785466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a019f680 con 0x7f06a0102790 2024-09-19T09:33:19.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069f7fe640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 0x7f06a019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.211+0000 7f069effd640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f069400d950 tx=0x7f069400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.212+0000 7f069cff9640 1 -- 172.21.15.52:0/2210785466 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694017070 con 0x7f06a0102790 2024-09-19T09:33:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.212+0000 7f069cff9640 1 -- 172.21.15.52:0/2210785466 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0694009c30 con 0x7f06a0102790 2024-09-19T09:33:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.212+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a019f970 con 0x7f06a0102790 2024-09-19T09:33:19.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.212+0000 7f069cff9640 1 -- 172.21.15.52:0/2210785466 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069400f6b0 con 0x7f06a0102790 2024-09-19T09:33:19.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.212+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a01a7250 con 0x7f06a0102790 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.214+0000 7f069cff9640 1 -- 172.21.15.52:0/2210785466 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f06940109d0 con 0x7f06a0102790 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.214+0000 7f06a853b740 1 Processor -- start 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.214+0000 7f06a853b740 1 -- start start 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359bda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd359232f0 con 0x55dd359beb40 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dd358cacf0 con 0x55dd359c8370 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f06a853b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dd3591f2b0 con 0x55dd359bd5d0 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069cff9640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 0x7f06880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46826/0 (socket says 172.21.15.52:46826) 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069ffff640 1 -- 172.21.15.52:0/3283576642 learned_addr learned my addr 172.21.15.52:0/3283576642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359bda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069ffff640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 0x7f06880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069cff9640 1 -- 172.21.15.52:0/2210785466 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f06940cf680 con 0x7f06a0102790 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069effd640 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 -- 172.21.15.52:0/3283576642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 msgr2=0x55dd359ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 -- 172.21.15.52:0/3283576642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 msgr2=0x55dd359bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 -- 172.21.15.52:0/3283576642 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd358af3a0 con 0x55dd359bd5d0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069ffff640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 0x7f06880a5700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f06980098b0 tx=0x7f0698009b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.215+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359bda10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0690006010 tx=0x7f0690032cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6884083e4663cf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f0685ffb640 1 -- 172.21.15.52:0/3283576642 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690035070 con 0x55dd359bd5d0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f0685ffb640 1 -- 172.21.15.52:0/3283576642 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06900317b0 con 0x55dd359bd5d0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f0685ffb640 1 -- 172.21.15.52:0/3283576642 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06900046c0 con 0x55dd359bd5d0 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 -- 172.21.15.52:0/3283576642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 msgr2=0x55dd359bda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359bda10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0690006010 tx=0x7f0690032cb0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 -- 172.21.15.52:0/3283576642 shutdown_connections 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359bda10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 --2- 172.21.15.52:0/3283576642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 -- 172.21.15.52:0/3283576642 >> 172.21.15.52:0/3283576642 conn(0x55dd35986310 msgr2=0x55dd359b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.216+0000 7f06a853b740 1 -- 172.21.15.52:0/3283576642 shutdown_connections 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 -- 172.21.15.52:0/3283576642 wait complete. 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 -- start start 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 Processor -- start 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 0x55dd359c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd359cb010 con 0x55dd359bd5d0 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dd358de060 con 0x55dd359beb40 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dd359cb190 con 0x55dd359c8370 2024-09-19T09:33:19.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f06a853b740 10 client.0 _ll_register_callbacks cb 0x55dd356318c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.217+0000 7f069f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46832/0 (socket says 172.21.15.52:46832) 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069ffff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 -- 172.21.15.52:0/3565030557 learned_addr learned my addr 172.21.15.52:0/3565030557 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069effd640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 0x55dd359c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 -- 172.21.15.52:0/3565030557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 msgr2=0x55dd359c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 -- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 msgr2=0x55dd359c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 0x55dd359c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 -- 172.21.15.52:0/3565030557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd356943c0 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069effd640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 0x55dd359c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f0690000c00 tx=0x7f069002ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac92da0188048724 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f067effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0690051060 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f069003b460 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.218+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06900317b0 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0690035070 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 10 client.19758 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd359d6a60 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06900317b0 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0690004860 con 0x55dd359bd5d0 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 10 client.19758 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:19.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 10 client.19758 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 20 client.19758 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd359d7db0 0x55dd359da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 4 client.19758 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd35930860 con 0x55dd359d7db0 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.219+0000 7f069effd640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd359d7db0 0x55dd359da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.220+0000 7f069effd640 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd359d7db0 0x55dd359da1a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46b6a168656470d7 server_cookie=211ceeb4e08402f0 in_seq=0 out_seq=0 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.220+0000 7f067effd640 10 client.19758 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f067effd640 1 -- 172.21.15.52:0/3565030557 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd35930860 con 0x55dd359d7db0 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f067effd640 10 client.19758 handle_command_reply: tid=0 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 client.19758 shutdown 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 msgr2=0x55dd359c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f0690000c00 tx=0x7f069002ab40 comp rx=0 tx=0).stop 2024-09-19T09:33:19.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 shutdown_connections 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd359d7db0 0x55dd359da1a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359beb40 0x55dd359c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 --2- 172.21.15.52:0/3565030557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359bd5d0 0x55dd359c7d10 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 >> 172.21.15.52:0/3565030557 conn(0x55dd35986310 msgr2=0x55dd359bf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f067effd640 0 client.19758 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 shutdown_connections 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 1 -- 172.21.15.52:0/3565030557 wait complete. 2024-09-19T09:33:19.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.221+0000 7f06a853b740 20 client.19758 trim_cache size 0 max 16384 2024-09-19T09:33:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 Processor -- start 2024-09-19T09:33:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 -- start start 2024-09-19T09:33:19.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359d42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359c0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01b2250 con 0x55dd359beb40 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01afb20 con 0x55dd359c8370 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f06a853b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01ad970 con 0x55dd359bd5d0 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.234+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46844/0 (socket says 172.21.15.52:46844) 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 -- 172.21.15.52:0/3510496847 learned_addr learned my addr 172.21.15.52:0/3510496847 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069ffff640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069f7fe640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359d42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 -- 172.21.15.52:0/3510496847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 msgr2=0x55dd359d42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359d42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 -- 172.21.15.52:0/3510496847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 msgr2=0x55dd359c0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359c0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 -- 172.21.15.52:0/3510496847 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd359c58d0 con 0x55dd359beb40 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069ffff640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f069effd640 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f069400dfe0 tx=0x7f0694010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d88f0399ca932 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f06857fa640 1 -- 172.21.15.52:0/3510496847 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694020040 con 0x55dd359beb40 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f06857fa640 1 -- 172.21.15.52:0/3510496847 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0694099ec0 con 0x55dd359beb40 2024-09-19T09:33:19.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.235+0000 7f06857fa640 1 -- 172.21.15.52:0/3510496847 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940863a0 con 0x55dd359beb40 2024-09-19T09:33:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- 172.21.15.52:0/3510496847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 msgr2=0x55dd359c0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f069400dfe0 tx=0x7f0694010d70 comp rx=0 tx=0).stop 2024-09-19T09:33:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- 172.21.15.52:0/3510496847 shutdown_connections 2024-09-19T09:33:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359c8370 0x55dd359c0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c0010 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 --2- 172.21.15.52:0/3510496847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359bd5d0 0x55dd359d42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- 172.21.15.52:0/3510496847 >> 172.21.15.52:0/3510496847 conn(0x55dd35986310 msgr2=0x55dd359c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- 172.21.15.52:0/3510496847 shutdown_connections 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- 172.21.15.52:0/3510496847 wait complete. 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.236+0000 7f06a853b740 1 -- start start 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 Processor -- start 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359bd5d0 0x55dd359d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01adfe0 con 0x55dd359beb40 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01af450 con 0x55dd359bd5d0 2024-09-19T09:33:19.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f06a01ae6b0 con 0x55dd359c8370 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f06a853b740 10 client.0 _ll_register_callbacks cb 0x7f06980123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46854/0 (socket says 172.21.15.52:46854) 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 -- 172.21.15.52:0/256972134 learned_addr learned my addr 172.21.15.52:0/256972134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069f7fe640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359bd5d0 0x55dd359d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069ffff640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 -- 172.21.15.52:0/256972134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 msgr2=0x55dd359c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 -- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359bd5d0 msgr2=0x55dd359d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359bd5d0 0x55dd359d0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 -- 172.21.15.52:0/256972134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd359c2b70 con 0x55dd359beb40 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069ffff640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:19.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f069effd640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f069409bb00 tx=0x7f06940a49b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c95bd82e346855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.237+0000 7f067effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069407f060 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0694098230 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0694099ec0 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0694020070 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 10 client.19764 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd35a42810 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0694099ec0 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0694086250 con 0x55dd359beb40 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 10 client.19764 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 10 client.19764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 20 client.19764 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd35a42ee0 0x55dd35a45300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 4 client.19764 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:19.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.238+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd3592ad70 con 0x55dd35a42ee0 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f069f7fe640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd35a42ee0 0x55dd35a45300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f069f7fe640 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd35a42ee0 0x55dd35a45300 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc4d60d006ec410f server_cookie=8eac00f1c2363832 in_seq=0 out_seq=0 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f067effd640 10 client.19764 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f067effd640 1 -- 172.21.15.52:0/256972134 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd3592ad70 con 0x55dd35a42ee0 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f067effd640 10 client.19764 handle_command_reply: tid=0 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 client.19764 shutdown 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 msgr2=0x55dd359c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f069409bb00 tx=0x7f06940a49b0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 shutdown_connections 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd359c8370 0x55dd359c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd359beb40 0x55dd359c1dc0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55dd35a42ee0 0x55dd35a45300 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 --2- 172.21.15.52:0/256972134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd359bd5d0 0x55dd359d0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 >> 172.21.15.52:0/256972134 conn(0x55dd35986310 msgr2=0x55dd359b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.239+0000 7f067effd640 0 client.19764 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 shutdown_connections 2024-09-19T09:33:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a853b740 1 -- 172.21.15.52:0/256972134 wait complete. 2024-09-19T09:33:19.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a853b740 20 client.19764 trim_cache size 0 max 16384 2024-09-19T09:33:19.248 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 msgr2=0x7f06880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 0x7f06880a5700 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f06980098b0 tx=0x7f0698009b50 comp rx=0 tx=0).stop 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 msgr2=0x7f06a019ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f069400d950 tx=0x7f069400de10 comp rx=0 tx=0).stop 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 shutdown_connections 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f06880a3240 0x7f06880a5700 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f06a0106f10 0x7f06a019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06a0102790 0x7f06a019ac10 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 --2- 172.21.15.52:0/2210785466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06a0101de0 0x7f06a019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 >> 172.21.15.52:0/2210785466 conn(0x7f06a00fd8c0 msgr2=0x7f06a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 shutdown_connections 2024-09-19T09:33:19.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:19.240+0000 7f06a6162640 1 -- 172.21.15.52:0/2210785466 wait complete. 2024-09-19T09:33:19.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:33:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:20.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1561652002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 msgr2=0x7f7b2010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1561652002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b2010bc00 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009900 tx=0x7f7b0802a480 comp rx=0 tx=0).stop 2024-09-19T09:33:20.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1561652002 shutdown_connections 2024-09-19T09:33:20.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1561652002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1561652002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b2010bc00 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.525+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1561652002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 0x7f7b201031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.526+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1561652002 >> 172.21.15.52:0/1561652002 conn(0x7f7b200fc790 msgr2=0x7f7b200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.526+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1561652002 shutdown_connections 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.526+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1561652002 wait complete. 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 Processor -- start 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 -- start start 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 0x7f7b20198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b20112020 con 0x7f7b20103710 2024-09-19T09:33:20.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b20111ea0 con 0x7f7b2010c190 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b24dfb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201121a0 con 0x7f7b20102df0 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46878/0 (socket says 172.21.15.52:46878) 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.527+0000 7f7b15d9b640 1 -- 172.21.15.52:0/1275813042 learned_addr learned my addr 172.21.15.52:0/1275813042 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 0x7f7b20198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 -- 172.21.15.52:0/1275813042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 msgr2=0x7f7b20198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 0x7f7b20198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 -- 172.21.15.52:0/1275813042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 msgr2=0x7f7b2019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 -- 172.21.15.52:0/1275813042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2019d5c0 con 0x7f7b20103710 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:20.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005ab0 tx=0x7f7b080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b17fff640 1 -- 172.21.15.52:0/1275813042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0803f030 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2019d850 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b17fff640 1 -- 172.21.15.52:0/1275813042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b08003ce0 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b17fff640 1 -- 172.21.15.52:0/1275813042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08035070 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.528+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b201a5190 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b17fff640 1 -- 172.21.15.52:0/1275813042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7b08042030 con 0x7f7b20103710 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 Processor -- start 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 -- start start 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc2b40 0x55cafadc1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadd0780 0x55cafadd2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cafad272f0 con 0x55cafadc15d0 2024-09-19T09:33:20.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55cafaccecf0 con 0x55cafadc2b40 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b271d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cafad232b0 con 0x55cafadd0780 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b1e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46880/0 (socket says 172.21.15.52:46880) 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.531+0000 7f7b1e59c640 1 -- 172.21.15.52:0/3819920199 learned_addr learned my addr 172.21.15.52:0/3819920199 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc2b40 0x55cafadc1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadd0780 0x55cafadd2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b17fff640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 0x7f7b0c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 -- 172.21.15.52:0/3819920199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadd0780 msgr2=0x55cafadd2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 0x7f7b0c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadd0780 0x55cafadd2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 -- 172.21.15.52:0/3819920199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc2b40 msgr2=0x55cafadc1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc2b40 0x55cafadc1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 -- 172.21.15.52:0/3819920199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafacb33a0 con 0x55cafadc15d0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009a70 tx=0x7f7b10009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1221e378a4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b17fff640 1 -- 172.21.15.52:0/1275813042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b080f0290 con 0x7f7b20103710 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b14d99640 1 -- 172.21.15.52:0/3819920199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10017070 con 0x55cafadc15d0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 0x7f7b0c0a5780 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800a5a0 tx=0x7f7b18004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b14d99640 1 -- 172.21.15.52:0/3819920199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b10013470 con 0x55cafadc15d0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.532+0000 7f7b14d99640 1 -- 172.21.15.52:0/3819920199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10012630 con 0x55cafadc15d0 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- 172.21.15.52:0/3819920199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 msgr2=0x55cafadc1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009a70 tx=0x7f7b10009f30 comp rx=0 tx=0).stop 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- 172.21.15.52:0/3819920199 shutdown_connections 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadd0780 0x55cafadd2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc15d0 0x55cafadc1a10 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3819920199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc2b40 0x55cafadc1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- 172.21.15.52:0/3819920199 >> 172.21.15.52:0/3819920199 conn(0x55cafad8a310 msgr2=0x55cafadbdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- 172.21.15.52:0/3819920199 shutdown_connections 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- 172.21.15.52:0/3819920199 wait complete. 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.533+0000 7f7b271d4740 1 -- start start 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 Processor -- start 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc15d0 0x55cafadd00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 0x55cafadcd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55cafadd3480 con 0x55cafadc2b40 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55caface2060 con 0x55cafadd0780 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55cafadd3600 con 0x55cafadc15d0 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b271d4740 10 client.0 _ll_register_callbacks cb 0x55cafaa358c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46888/0 (socket says 172.21.15.52:46888) 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 -- 172.21.15.52:0/3360092801 learned_addr learned my addr 172.21.15.52:0/3360092801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc15d0 0x55cafadd00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 0x55cafadcd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 -- 172.21.15.52:0/3360092801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc15d0 msgr2=0x55cafadd00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc15d0 0x55cafadd00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 -- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 msgr2=0x55cafadcd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 0x55cafadcd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b15d9b640 1 -- 172.21.15.52:0/3360092801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafaa983c0 con 0x55cafadc2b40 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.534+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 0x55cafadcd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ee080 tx=0x7f7b08005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ffa3a9f8a8e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08049070 con 0x55cafadc2b40 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b0803bd00 con 0x55cafadc2b40 2024-09-19T09:33:20.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b10013470 con 0x55cafadc2b40 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b080bc600 con 0x55cafadc2b40 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 10 client.19776 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cafaddee70 con 0x55cafadc2b40 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b10013470 con 0x55cafadc2b40 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b080b8ea0 con 0x55cafadc2b40 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 10 client.19776 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 10 client.19776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 20 client.19776 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafade03b0 0x55cafade27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 4 client.19776 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.535+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cafad34860 con 0x55cafade03b0 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.536+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafade03b0 0x55cafade27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.536+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafade03b0 0x55cafade27e0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edebbe6468963cbc server_cookie=f95843263de3ee88 in_seq=0 out_seq=0 2024-09-19T09:33:20.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.536+0000 7f7b05ffb640 10 client.19776 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3360092801 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cafad34860 con 0x55cafade03b0 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b05ffb640 10 client.19776 handle_command_reply: tid=0 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 client.19776 shutdown 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 msgr2=0x55cafadcd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ee080 tx=0x7f7b08005d50 comp rx=0 tx=0).stop 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 shutdown_connections 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafade03b0 0x55cafade27e0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadd0780 0x55cafadcd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadc2b40 0x55cafadcd370 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b05ffb640 0 client.19776 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3360092801 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc15d0 0x55cafadd00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 >> 172.21.15.52:0/3360092801 conn(0x55cafad8a310 msgr2=0x55cafadc3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 shutdown_connections 2024-09-19T09:33:20.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 1 -- 172.21.15.52:0/3360092801 wait complete. 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.537+0000 7f7b271d4740 20 client.19776 trim_cache size 0 max 16384 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 Processor -- start 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 -- start start 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadbde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafaddc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201ade70 con 0x55cafadd0780 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201ab740 con 0x55cafadc15d0 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b271d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201a9590 con 0x55cafadc2b40 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46898/0 (socket says 172.21.15.52:46898) 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.550+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/98309896 learned_addr learned my addr 172.21.15.52:0/98309896 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadbde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafaddc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/98309896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 msgr2=0x55cafaddc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafaddc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/98309896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 msgr2=0x55cafadbde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadbde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/98309896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafadc2760 con 0x55cafadd0780 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafaddc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f7b18007900 tx=0x7f7b18009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ef186944d766f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b07fff640 1 -- 172.21.15.52:0/98309896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18015070 con 0x55cafadd0780 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b07fff640 1 -- 172.21.15.52:0/98309896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1801ddd0 con 0x55cafadd0780 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.551+0000 7f7b07fff640 1 -- 172.21.15.52:0/98309896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18025620 con 0x55cafadd0780 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- 172.21.15.52:0/98309896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 msgr2=0x55cafade80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f7b18007900 tx=0x7f7b18009730 comp rx=0 tx=0).stop 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- 172.21.15.52:0/98309896 shutdown_connections 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafade80c0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafaddc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 --2- 172.21.15.52:0/98309896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadbde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- 172.21.15.52:0/98309896 >> 172.21.15.52:0/98309896 conn(0x55cafad8a310 msgr2=0x55cafadbd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- 172.21.15.52:0/98309896 shutdown_connections 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- 172.21.15.52:0/98309896 wait complete. 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 -- start start 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.552+0000 7f7b271d4740 1 Processor -- start 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadd9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafadd44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201a9c00 con 0x55cafadd0780 2024-09-19T09:33:20.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201ab070 con 0x55cafadc15d0 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7b201aa2d0 con 0x55cafadc2b40 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b271d4740 10 client.0 _ll_register_callbacks cb 0x7f7b08005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46914/0 (socket says 172.21.15.52:46914) 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/3814411096 learned_addr learned my addr 172.21.15.52:0/3814411096 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafadd44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/3814411096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 msgr2=0x55cafadd44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafadd44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 msgr2=0x55cafadd9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadd9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 -- 172.21.15.52:0/3814411096 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafae4a090 con 0x55cafadd0780 2024-09-19T09:33:20.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b15d9b640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafadd44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b1ed9d640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f7b18004b90 tx=0x7f7b18026670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c70e971e044345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.553+0000 7f7b05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18035060 con 0x55cafadd0780 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7b18026a70 con 0x55cafadd0780 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1801ddd0 con 0x55cafadd0780 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7b18015050 con 0x55cafadd0780 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b271d4740 10 client.19782 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:20.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cafae4b230 con 0x55cafadd0780 2024-09-19T09:33:20.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b1801ddd0 con 0x55cafadd0780 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.554+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7b18024070 con 0x55cafadd0780 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 10 client.19782 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 10 client.19782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 20 client.19782 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafae4b920 0x55cafae4dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 4 client.19782 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cafad2ed70 con 0x55cafae4b920 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafae4b920 0x55cafae4dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b1e59c640 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafae4b920 0x55cafae4dd40 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2e7562677f85583 server_cookie=29ce7f92c0f98607 in_seq=0 out_seq=0 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b05ffb640 10 client.19782 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:20.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b05ffb640 1 -- 172.21.15.52:0/3814411096 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cafad2ed70 con 0x55cafae4b920 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b05ffb640 10 client.19782 handle_command_reply: tid=0 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 client.19782 shutdown 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 msgr2=0x55cafadd4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f7b18004b90 tx=0x7f7b18026670 comp rx=0 tx=0).stop 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 shutdown_connections 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.555+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55cafae4b920 0x55cafae4dd40 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55cafadd0780 0x55cafadd4bf0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55cafadc2b40 0x55cafadd44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b05ffb640 0 client.19782 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 --2- 172.21.15.52:0/3814411096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55cafadc15d0 0x55cafadd9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 >> 172.21.15.52:0/3814411096 conn(0x55cafad8a310 msgr2=0x55cafadcebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 shutdown_connections 2024-09-19T09:33:20.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 1 -- 172.21.15.52:0/3814411096 wait complete. 2024-09-19T09:33:20.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b271d4740 20 client.19782 trim_cache size 0 max 16384 2024-09-19T09:33:20.574 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:20.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 msgr2=0x7f7b0c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 0x7f7b0c0a5780 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800a5a0 tx=0x7f7b18004a40 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 msgr2=0x7f7b20198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005ab0 tx=0x7f7b080042f0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 shutdown_connections 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7b2010c190 0x7f7b2019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b20103710 0x7f7b20198b50 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7b0c0a32c0 0x7f7b0c0a5780 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 --2- 172.21.15.52:0/1275813042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7b20102df0 0x7f7b20198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.556+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 >> 172.21.15.52:0/1275813042 conn(0x7f7b200fc790 msgr2=0x7f7b200fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.557+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 shutdown_connections 2024-09-19T09:33:20.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:20.557+0000 7f7b24dfb640 1 -- 172.21.15.52:0/1275813042 wait complete. 2024-09-19T09:33:20.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:20 smithi052 ceph-mon[30947]: pgmap v695: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:20.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:20 smithi169 ceph-mon[35454]: pgmap v695: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:21.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:20 smithi086 ceph-mon[34813]: pgmap v695: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:22.189 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:33:22.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:33:22.463 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:22.902 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:22 smithi052 ceph-mon[30947]: pgmap v696: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2951215738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a81082a0 msgr2=0x7fe6a810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2951215738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a81082a0 0x7fe6a810ec40 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009cd0 tx=0x7fe6a002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2951215738 shutdown_connections 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2951215738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a81082a0 0x7fe6a810ec40 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2951215738 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 0x7fe6a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2951215738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a8102d30 0x7fe6a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2951215738 >> 172.21.15.52:0/2951215738 conn(0x7fe6a80fc7d0 msgr2=0x7fe6a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2951215738 shutdown_connections 2024-09-19T09:33:22.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.904+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2951215738 wait complete. 2024-09-19T09:33:22.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 Processor -- start 2024-09-19T09:33:22.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 -- start start 2024-09-19T09:33:22.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 0x7fe6a8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 0x7fe6a819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81120a0 con 0x7fe6a8102d30 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a8111f20 con 0x7fe6a81082a0 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6aefaf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a8112220 con 0x7fe6a81036e0 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46938/0 (socket says 172.21.15.52:46938) 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 -- 172.21.15.52:0/2195779584 learned_addr learned my addr 172.21.15.52:0/2195779584 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 0x7fe6a819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 0x7fe6a8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 -- 172.21.15.52:0/2195779584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 msgr2=0x7fe6a8198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 0x7fe6a8198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 -- 172.21.15.52:0/2195779584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 msgr2=0x7fe6a819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 0x7fe6a819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.905+0000 7fe6acd4b640 1 -- 172.21.15.52:0/2195779584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a819d4f0 con 0x7fe6a8102d30 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 0x7fe6a819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:22.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c890 tx=0x7fe69c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6a5ffb640 1 -- 172.21.15.52:0/2195779584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c004220 con 0x7fe6a8102d30 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6a5ffb640 1 -- 172.21.15.52:0/2195779584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe69c0043c0 con 0x7fe6a8102d30 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a819d7e0 con 0x7fe6a8102d30 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6a5ffb640 1 -- 172.21.15.52:0/2195779584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c0049e0 con 0x7fe6a8102d30 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.906+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a81a50c0 con 0x7fe6a8102d30 2024-09-19T09:33:22.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.908+0000 7fe6a5ffb640 1 -- 172.21.15.52:0/2195779584 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe69c0079b0 con 0x7fe6a8102d30 2024-09-19T09:33:22.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 Processor -- start 2024-09-19T09:33:22.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 -- start start 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 0x55f9cdac4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdac4d40 0x55f9cdac7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f9cda1f280 con 0x55f9cdab9b60 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f9cd9c6b10 con 0x55f9cdaba480 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.909+0000 7fe6b1388740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f9cda1b240 con 0x55f9cdac4d40 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46948/0 (socket says 172.21.15.52:46948) 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 -- 172.21.15.52:0/3881711047 learned_addr learned my addr 172.21.15.52:0/3881711047 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:22.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6a5ffb640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 0x7fe6980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdac4d40 0x55f9cdac7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 0x55f9cdac4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 0x7fe6980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6a5ffb640 1 -- 172.21.15.52:0/2195779584 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe69c0cfb00 con 0x7fe6a8102d30 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 -- 172.21.15.52:0/3881711047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdac4d40 msgr2=0x55f9cdac7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdac4d40 0x55f9cdac7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 -- 172.21.15.52:0/3881711047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 msgr2=0x55f9cdac4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 0x55f9cdac4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 -- 172.21.15.52:0/3881711047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cd9d31f0 con 0x55f9cdab9b60 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 0x55f9cdac4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.910+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0031b50 tx=0x7fe6a0031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd478368eef4420 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe692ffd640 1 -- 172.21.15.52:0/3881711047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0004240 con 0x55f9cdab9b60 2024-09-19T09:33:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 0x7fe6980a5700 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe6a004d000 tx=0x7fe6a004b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe692ffd640 1 -- 172.21.15.52:0/3881711047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0036040 con 0x55f9cdab9b60 2024-09-19T09:33:22.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe692ffd640 1 -- 172.21.15.52:0/3881711047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0030c60 con 0x55f9cdab9b60 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 -- 172.21.15.52:0/3881711047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 msgr2=0x55f9cdab9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0031b50 tx=0x7fe6a0031b80 comp rx=0 tx=0).stop 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 -- 172.21.15.52:0/3881711047 shutdown_connections 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdac4d40 0x55f9cdac7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdaba480 0x55f9cdac4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3881711047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdab9f40 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 -- 172.21.15.52:0/3881711047 >> 172.21.15.52:0/3881711047 conn(0x55f9cdab60f0 msgr2=0x55f9cdab64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 -- 172.21.15.52:0/3881711047 shutdown_connections 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.911+0000 7fe6b1388740 1 -- 172.21.15.52:0/3881711047 wait complete. 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 -- start start 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 Processor -- start 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdac21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdac2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f9cdac7910 con 0x55f9cdab9b60 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f9cd9d9f10 con 0x55f9cdac4d40 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f9cdac7a90 con 0x55f9cdaba480 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6b1388740 10 client.0 _ll_register_callbacks cb 0x55f9cd9a2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6acd4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6acd4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46962/0 (socket says 172.21.15.52:46962) 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.912+0000 7fe6acd4b640 1 -- 172.21.15.52:0/3919681916 learned_addr learned my addr 172.21.15.52:0/3919681916 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdac21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdac2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 -- 172.21.15.52:0/3919681916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 msgr2=0x55f9cdac21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdac21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 -- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 msgr2=0x55f9cdac2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdac2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 -- 172.21.15.52:0/3919681916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cd7906a0 con 0x55f9cdab9b60 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe69c098a10 tx=0x7fe69c01eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336452a1b1493f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe687fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c01d040 con 0x55f9cdab9b60 2024-09-19T09:33:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a0036040 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe69c016db0 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe69c09c740 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6b1388740 10 client.19794 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.913+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9cdad3640 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0036040 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe69c007ca0 con 0x55f9cdab9b60 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 10 client.19794 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 10 client.19794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 20 client.19794 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdad4e30 0x55f9cdad72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 4 client.19794 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9cda2c7f0 con 0x55f9cdad4e30 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.914+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdad4e30 0x55f9cdad72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe687fff640 10 client.19794 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdad4e30 0x55f9cdad72d0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64cce275fb4440b server_cookie=fc89b64b781aa64 in_seq=0 out_seq=0 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe687fff640 1 -- 172.21.15.52:0/3919681916 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9cda2c7f0 con 0x55f9cdad4e30 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe687fff640 10 client.19794 handle_command_reply: tid=0 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 client.19794 shutdown 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 msgr2=0x55f9cdac1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe69c098a10 tx=0x7fe69c01eef0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 shutdown_connections 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdad4e30 0x55f9cdad72d0 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdac2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdac21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.915+0000 7fe6b1388740 1 --2- 172.21.15.52:0/3919681916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdab9b60 0x55f9cdac1c90 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.916+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 >> 172.21.15.52:0/3919681916 conn(0x55f9cdab60f0 msgr2=0x55f9cdab5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.916+0000 7fe687fff640 0 client.19794 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.916+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 shutdown_connections 2024-09-19T09:33:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.916+0000 7fe6b1388740 1 -- 172.21.15.52:0/3919681916 wait complete. 2024-09-19T09:33:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.916+0000 7fe6b1388740 20 client.19794 trim_cache size 0 max 16384 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 Processor -- start 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 -- start start 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdab9b60 0x55f9cdacd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdacd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81b0180 con 0x55f9cdac4d40 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81ada50 con 0x55f9cdab9b60 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6b1388740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81ab8a0 con 0x55f9cdaba480 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6ad54c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6ad54c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46978/0 (socket says 172.21.15.52:46978) 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6ad54c640 1 -- 172.21.15.52:0/2091565969 learned_addr learned my addr 172.21.15.52:0/2091565969 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.933+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdab9b60 0x55f9cdacd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdacd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 -- 172.21.15.52:0/2091565969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 msgr2=0x55f9cdacd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdacd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 -- 172.21.15.52:0/2091565969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdab9b60 msgr2=0x55f9cdacd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdab9b60 0x55f9cdacd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 -- 172.21.15.52:0/2091565969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cdac01e0 con 0x55f9cdac4d40 2024-09-19T09:33:22.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdacd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0031bf0 tx=0x7fe6a0009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfa33e1b2e10c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6927fc640 1 -- 172.21.15.52:0/2091565969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00305a0 con 0x55f9cdac4d40 2024-09-19T09:33:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6927fc640 1 -- 172.21.15.52:0/2091565969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0057070 con 0x55f9cdac4d40 2024-09-19T09:33:22.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.934+0000 7fe6927fc640 1 -- 172.21.15.52:0/2091565969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0004330 con 0x55f9cdac4d40 2024-09-19T09:33:22.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- 172.21.15.52:0/2091565969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 msgr2=0x55f9cdac33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0031bf0 tx=0x7fe6a0009a00 comp rx=0 tx=0).stop 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- 172.21.15.52:0/2091565969 shutdown_connections 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdac4d40 0x55f9cdac33e0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdaba480 0x55f9cdacd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2091565969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdab9b60 0x55f9cdacd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- 172.21.15.52:0/2091565969 >> 172.21.15.52:0/2091565969 conn(0x55f9cdab60f0 msgr2=0x55f9cdac0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- 172.21.15.52:0/2091565969 shutdown_connections 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- 172.21.15.52:0/2091565969 wait complete. 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 -- start start 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.935+0000 7fe6b1388740 1 Processor -- start 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdab9b60 0x55f9cdabdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdabe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81abf10 con 0x55f9cdaba480 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81ad380 con 0x55f9cdac4d40 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a81ac5e0 con 0x55f9cdab9b60 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6b1388740 10 client.0 _ll_register_callbacks cb 0x7fe69c01ef60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46988/0 (socket says 172.21.15.52:46988) 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 -- 172.21.15.52:0/2089143711 learned_addr learned my addr 172.21.15.52:0/2089143711 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdabe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdab9b60 0x55f9cdabdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 -- 172.21.15.52:0/2089143711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdab9b60 msgr2=0x55f9cdabdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdab9b60 0x55f9cdabdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 -- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 msgr2=0x55f9cdabe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdabe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 -- 172.21.15.52:0/2089143711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cdabf1f0 con 0x55f9cdaba480 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6ad54c640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdabe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:22.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe6a7fff640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fe6940057c0 tx=0x7fe694012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fd6487f3b1aeed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.936+0000 7fe687fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694005460 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe694004730 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a0057070 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe694029030 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 10 client.19800 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f9cdb44280 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6a0057070 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe69402e960 con 0x55f9cdaba480 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 10 client.19800 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 10 client.19800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:22.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 20 client.19800 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdb44a00 0x55f9cdb46e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 4 client.19800 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.937+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f9cda26d00 con 0x55f9cdb44a00 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.938+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdb44a00 0x55f9cdb46e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.938+0000 7fe6acd4b640 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdb44a00 0x55f9cdb46e20 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89600f53ddd040f server_cookie=2a93af45e1622b35 in_seq=0 out_seq=0 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.938+0000 7fe687fff640 10 client.19800 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe687fff640 1 -- 172.21.15.52:0/2089143711 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f9cda26d00 con 0x55f9cdb44a00 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe687fff640 10 client.19800 handle_command_reply: tid=0 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 client.19800 shutdown 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 msgr2=0x55f9cdabe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fe6940057c0 tx=0x7fe694012820 comp rx=0 tx=0).stop 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 shutdown_connections 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f9cdb44a00 0x55f9cdb46e20 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f9cdac4d40 0x55f9cdabe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f9cdaba480 0x55f9cdabe440 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 --2- 172.21.15.52:0/2089143711 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f9cdab9b60 0x55f9cdabdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 >> 172.21.15.52:0/2089143711 conn(0x55f9cdab60f0 msgr2=0x55f9cdab4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe687fff640 0 client.19800 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 shutdown_connections 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 1 -- 172.21.15.52:0/2089143711 wait complete. 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.939+0000 7fe6b1388740 20 client.19800 trim_cache size 0 max 16384 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "740cca9c-3eb4-4ce0-8fca-f9995d8af2f8", 2024-09-19T09:33:22.946 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 msgr2=0x7fe6980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 0x7fe6980a5700 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe6a004d000 tx=0x7fe6a004b000 comp rx=0 tx=0).stop 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 msgr2=0x7fe6a8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00c890 tx=0x7fe69c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 shutdown_connections 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a81082a0 0x7fe6a819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6980a3240 0x7fe6980a5700 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6a81036e0 0x7fe6a8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 --2- 172.21.15.52:0/2195779584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6a8102d30 0x7fe6a8198540 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 >> 172.21.15.52:0/2195779584 conn(0x7fe6a80fc7d0 msgr2=0x7fe6a8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 shutdown_connections 2024-09-19T09:33:22.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:22.940+0000 7fe6aefaf640 1 -- 172.21.15.52:0/2195779584 wait complete. 2024-09-19T09:33:22.948 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:22 smithi169 ceph-mon[35454]: pgmap v696: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:23.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:22 smithi086 ceph-mon[34813]: pgmap v696: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- 172.21.15.52:0/1352930808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960103710 msgr2=0x7fc960109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 --2- 172.21.15.52:0/1352930808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960103710 0x7fc960109fa0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ca0 tx=0x7fc95802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- 172.21.15.52:0/1352930808 shutdown_connections 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 --2- 172.21.15.52:0/1352930808 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960103710 0x7fc960109fa0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 --2- 172.21.15.52:0/1352930808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960102d50 0x7fc9601031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 --2- 172.21.15.52:0/1352930808 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960101b60 0x7fc960101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- 172.21.15.52:0/1352930808 >> 172.21.15.52:0/1352930808 conn(0x7fc9600fd2e0 msgr2=0x7fc9600ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.517 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- 172.21.15.52:0/1352930808 shutdown_connections 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- 172.21.15.52:0/1352930808 wait complete. 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 Processor -- start 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.513+0000 7fc9671c4640 1 -- start start 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 0x7fc960197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960103710 0x7fc96019f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc96010d7e0 con 0x7fc960102d50 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc96010d660 con 0x7fc960101b60 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc96010d960 con 0x7fc960103710 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47008/0 (socket says 172.21.15.52:47008) 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 -- 172.21.15.52:0/4287376741 learned_addr learned my addr 172.21.15.52:0/4287376741 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc964f60640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 0x7fc960197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc965761640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960103710 0x7fc96019f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 -- 172.21.15.52:0/4287376741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960103710 msgr2=0x7fc96019f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960103710 0x7fc96019f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 -- 172.21.15.52:0/4287376741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 msgr2=0x7fc960197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 0x7fc960197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 -- 172.21.15.52:0/4287376741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96019f970 con 0x7fc960102d50 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc964f60640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 0x7fc960197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95ffff640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00d950 tx=0x7fc94c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95dffb640 1 -- 172.21.15.52:0/4287376741 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c017070 con 0x7fc960102d50 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96019fc60 con 0x7fc960102d50 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95dffb640 1 -- 172.21.15.52:0/4287376741 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94c009c30 con 0x7fc960102d50 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.514+0000 7fc95dffb640 1 -- 172.21.15.52:0/4287376741 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00f6b0 con 0x7fc960102d50 2024-09-19T09:33:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.515+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601a01b0 con 0x7fc960102d50 2024-09-19T09:33:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 Processor -- start 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc95dffb640 1 -- 172.21.15.52:0/4287376741 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc94c0109d0 con 0x7fc960102d50 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 -- start start 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3ef6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 0x55a5f3ef9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3e552f0 con 0x55a5f3ef19a0 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3dfd270 con 0x55a5f3ef22e0 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc96a040740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3e512b0 con 0x55a5f3ef7370 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47022/0 (socket says 172.21.15.52:47022) 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 -- 172.21.15.52:0/410929426 learned_addr learned my addr 172.21.15.52:0/410929426 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc964f60640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3ef6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc95ffff640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 0x55a5f3ef9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 -- 172.21.15.52:0/410929426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 msgr2=0x55a5f3ef9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 0x55a5f3ef9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 -- 172.21.15.52:0/410929426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 msgr2=0x55a5f3ef6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3ef6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc965761640 1 -- 172.21.15.52:0/410929426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f3dfc340 con 0x55a5f3ef19a0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc95ffff640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 0x55a5f3ef9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.518+0000 7fc95dffb640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 0x7fc9500a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc964f60640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 0x7fc9500a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc95dffb640 1 -- 172.21.15.52:0/4287376741 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc94c0cf650 con 0x7fc960102d50 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc965761640 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fc958035000 tx=0x7fc9580093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53453f92018d7237 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc94affd640 1 -- 172.21.15.52:0/410929426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958031cb0 con 0x55a5f3ef19a0 2024-09-19T09:33:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc94affd640 1 -- 172.21.15.52:0/410929426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc958036070 con 0x55a5f3ef19a0 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc94affd640 1 -- 172.21.15.52:0/410929426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958004300 con 0x55a5f3ef19a0 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc96a040740 1 -- 172.21.15.52:0/410929426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 msgr2=0x55a5f3ef1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc964f60640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 0x7fc9500a57b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55a5f3ef2d10 tx=0x7fc95400b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.519+0000 7fc96a040740 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fc958035000 tx=0x7fc9580093e0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- 172.21.15.52:0/410929426 shutdown_connections 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef7370 0x55a5f3ef9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3ef6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- 172.21.15.52:0/410929426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef19a0 0x55a5f3ef1da0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- 172.21.15.52:0/410929426 >> 172.21.15.52:0/410929426 conn(0x55a5f3eed010 msgr2=0x55a5f3eed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- 172.21.15.52:0/410929426 shutdown_connections 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- 172.21.15.52:0/410929426 wait complete. 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- start start 2024-09-19T09:33:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 Processor -- start 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3efb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3f02f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3efa160 con 0x55a5f3ef22e0 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3dde290 con 0x55a5f3ef7370 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5f3efa2e0 con 0x55a5f3ef19a0 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.520+0000 7fc96a040740 10 client.0 _ll_register_callbacks cb 0x55a5f3e0f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47024/0 (socket says 172.21.15.52:47024) 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 -- 172.21.15.52:0/3814138928 learned_addr learned my addr 172.21.15.52:0/3814138928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc964f60640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3efb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc965761640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3f02f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 -- 172.21.15.52:0/3814138928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 msgr2=0x55a5f3efb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3efb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 -- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 msgr2=0x55a5f3f02f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3f02f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 -- 172.21.15.52:0/3814138928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f3b68210 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc95ffff640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0a4330 tx=0x7fc94c09b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7aa5c3f2478729 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc93ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c020070 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc94c09b040 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc958036070 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc94c0b2070 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc96a040740 10 client.19812 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.521+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5f3c34620 con 0x55a5f3ef22e0 2024-09-19T09:33:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc958036070 con 0x55a5f3ef22e0 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc94c0cfb00 con 0x55a5f3ef22e0 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 10 client.19812 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 10 client.19812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 20 client.19812 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f07580 0x55a5f3f09970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 4 client.19812 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5f3e62a20 con 0x55a5f3f07580 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc964f60640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f07580 0x55a5f3f09970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc93ffff640 10 client.19812 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.522+0000 7fc964f60640 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f07580 0x55a5f3f09970 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a2e0eaee2e014c server_cookie=1ce023470ad7e6cb in_seq=0 out_seq=0 2024-09-19T09:33:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc93ffff640 1 -- 172.21.15.52:0/3814138928 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5f3e62a20 con 0x55a5f3f07580 2024-09-19T09:33:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc93ffff640 10 client.19812 handle_command_reply: tid=0 2024-09-19T09:33:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 client.19812 shutdown 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 msgr2=0x55a5f3efbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0a4330 tx=0x7fc94c09b550 comp rx=0 tx=0).stop 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 shutdown_connections 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f07580 0x55a5f3f09970 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3f02f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc93ffff640 0 client.19812 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3efbf30 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 --2- 172.21.15.52:0/3814138928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3efb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.523+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 >> 172.21.15.52:0/3814138928 conn(0x55a5f3eed010 msgr2=0x55a5f3eee820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.524+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 shutdown_connections 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.524+0000 7fc96a040740 1 -- 172.21.15.52:0/3814138928 wait complete. 2024-09-19T09:33:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.524+0000 7fc96a040740 20 client.19812 trim_cache size 0 max 16384 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 Processor -- start 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 -- start start 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3eedec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3eee400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601ab9f0 con 0x55a5f3ef22e0 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601a92c0 con 0x55a5f3ef7370 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc96a040740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601a7110 con 0x55a5f3ef19a0 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47036/0 (socket says 172.21.15.52:47036) 2024-09-19T09:33:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 -- 172.21.15.52:0/1214696975 learned_addr learned my addr 172.21.15.52:0/1214696975 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc965761640 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3eee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc964f60640 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3eedec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 -- 172.21.15.52:0/1214696975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 msgr2=0x55a5f3eedec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3eedec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 -- 172.21.15.52:0/1214696975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 msgr2=0x55a5f3eee400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3eee400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.540+0000 7fc95ffff640 1 -- 172.21.15.52:0/1214696975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f3f09fd0 con 0x55a5f3ef22e0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.541+0000 7fc95ffff640 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc94c09bb80 tx=0x7fc94c09a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431f3162dd4af96b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.541+0000 7fc94a7fc640 1 -- 172.21.15.52:0/1214696975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c020070 con 0x55a5f3ef22e0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.541+0000 7fc94a7fc640 1 -- 172.21.15.52:0/1214696975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94c09bbf0 con 0x55a5f3ef22e0 2024-09-19T09:33:23.544 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.541+0000 7fc94a7fc640 1 -- 172.21.15.52:0/1214696975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c0983d0 con 0x55a5f3ef22e0 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- 172.21.15.52:0/1214696975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 msgr2=0x55a5f3f02f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc94c09bb80 tx=0x7fc94c09a100 comp rx=0 tx=0).stop 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- 172.21.15.52:0/1214696975 shutdown_connections 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef7370 0x55a5f3eee400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f02f30 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- 172.21.15.52:0/1214696975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3eedec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- 172.21.15.52:0/1214696975 >> 172.21.15.52:0/1214696975 conn(0x55a5f3eed010 msgr2=0x55a5f3efb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- 172.21.15.52:0/1214696975 shutdown_connections 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- 172.21.15.52:0/1214696975 wait complete. 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- start start 2024-09-19T09:33:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 Processor -- start 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3f004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f00a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601a7780 con 0x55a5f3ef7370 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601a8bf0 con 0x55a5f3ef22e0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.542+0000 7fc96a040740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601a7e50 con 0x55a5f3ef19a0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc96a040740 10 client.0 _ll_register_callbacks cb 0x7fc94c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47040/0 (socket says 172.21.15.52:47040) 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 -- 172.21.15.52:0/733017849 learned_addr learned my addr 172.21.15.52:0/733017849 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc95ffff640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f00a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc964f60640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3f004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 -- 172.21.15.52:0/733017849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 msgr2=0x55a5f3f004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3f004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 -- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 msgr2=0x55a5f3f00a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f00a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 -- 172.21.15.52:0/733017849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f3f02030 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc965761640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ca0 tx=0x7fc958031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd88aa53b8cddaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc93ffff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958049040 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc958003b70 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc94c09bbf0 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc95805b050 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc96a040740 10 client.19818 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.543+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5f3f72230 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc94c09bbf0 con 0x55a5f3ef7370 2024-09-19T09:33:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc958042020 con 0x55a5f3ef7370 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 10 client.19818 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 10 client.19818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 20 client.19818 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f72840 0x55a5f3f74c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 4 client.19818 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5f3e5cd70 con 0x55a5f3f72840 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc964f60640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f72840 0x55a5f3f74c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc93ffff640 10 client.19818 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.544+0000 7fc964f60640 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f72840 0x55a5f3f74c60 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f4c4e40d84704 server_cookie=ef9ffb7aa1f228d7 in_seq=0 out_seq=0 2024-09-19T09:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc93ffff640 1 -- 172.21.15.52:0/733017849 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5f3e5cd70 con 0x55a5f3f72840 2024-09-19T09:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc93ffff640 10 client.19818 handle_command_reply: tid=0 2024-09-19T09:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 client.19818 shutdown 2024-09-19T09:33:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 msgr2=0x55a5f3f01a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc958009ca0 tx=0x7fc958031a00 comp rx=0 tx=0).stop 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 shutdown_connections 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5f3f72840 0x55a5f3f74c60 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5f3ef7370 0x55a5f3f01a20 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5f3ef22e0 0x55a5f3f00a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc93ffff640 0 client.19818 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 --2- 172.21.15.52:0/733017849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5f3ef19a0 0x55a5f3f004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 >> 172.21.15.52:0/733017849 conn(0x55a5f3eed010 msgr2=0x55a5f3eeb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 shutdown_connections 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 1 -- 172.21.15.52:0/733017849 wait complete. 2024-09-19T09:33:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.555+0000 7fc96a040740 20 client.19818 trim_cache size 0 max 16384 2024-09-19T09:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:33:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 msgr2=0x7fc9500a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 0x7fc9500a57b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55a5f3ef2d10 tx=0x7fc95400b5a0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 msgr2=0x7fc960198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00d950 tx=0x7fc94c00de10 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 shutdown_connections 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc9500a32f0 0x7fc9500a57b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc960103710 0x7fc96019f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc960102d50 0x7fc960198290 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 --2- 172.21.15.52:0/4287376741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc960101b60 0x7fc960197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 >> 172.21.15.52:0/4287376741 conn(0x7fc9600fd2e0 msgr2=0x7fc960106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 shutdown_connections 2024-09-19T09:33:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:23.556+0000 7fc9671c4640 1 -- 172.21.15.52:0/4287376741 wait complete. 2024-09-19T09:33:23.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:33:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:23 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:33:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:23 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:23 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:33:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:23 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:23.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:23 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:33:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:23 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:33:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:23 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:23 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:33:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:23 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:23.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:23 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:33:23.958 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:23 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:33:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:23 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:23 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:33:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:23 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:24.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:23 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.393+0000 7f87ae2e9640 1 -- 172.21.15.52:0/3536434162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101440 msgr2=0x7f87a8101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.393+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/3536434162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101440 0x7f87a8101820 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f8798009900 tx=0x7f879802a410 comp rx=0 tx=0).stop 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 -- 172.21.15.52:0/3536434162 shutdown_connections 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/3536434162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 0x7f87a810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/3536434162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101df0 0x7f87a8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/3536434162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101440 0x7f87a8101820 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 -- 172.21.15.52:0/3536434162 >> 172.21.15.52:0/3536434162 conn(0x7f87a8077210 msgr2=0x7f87a80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 -- 172.21.15.52:0/3536434162 shutdown_connections 2024-09-19T09:33:24.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 -- 172.21.15.52:0/3536434162 wait complete. 2024-09-19T09:33:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 Processor -- start 2024-09-19T09:33:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.394+0000 7f87ae2e9640 1 -- start start 2024-09-19T09:33:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101440 0x7f87a81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 0x7f87a81a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8111070 con 0x7f87a8101df0 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f87a8110ef0 con 0x7f87a8101440 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ae2e9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81111f0 con 0x7f87a8106050 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47058/0 (socket says 172.21.15.52:47058) 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 -- 172.21.15.52:0/285006225 learned_addr learned my addr 172.21.15.52:0/285006225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87ac886640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 0x7f87a81a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f87a7fff640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101440 0x7f87a81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 -- 172.21.15.52:0/285006225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 msgr2=0x7f87a81a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 0x7f87a81a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 -- 172.21.15.52:0/285006225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101440 msgr2=0x7f87a81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101440 0x7f87a81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.395+0000 7f879ffff640 1 -- 172.21.15.52:0/285006225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81a4aa0 con 0x7f87a8101df0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f879ffff640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f879000e9f0 tx=0x7f879000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f87a5ffb640 1 -- 172.21.15.52:0/285006225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879000cd80 con 0x7f87a8101df0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f87a5ffb640 1 -- 172.21.15.52:0/285006225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8790010910 con 0x7f87a8101df0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a81a4c70 con 0x7f87a8101df0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f87a5ffb640 1 -- 172.21.15.52:0/285006225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790018990 con 0x7f87a8101df0 2024-09-19T09:33:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.396+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a81a51b0 con 0x7f87a8101df0 2024-09-19T09:33:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.398+0000 7f87a5ffb640 1 -- 172.21.15.52:0/285006225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8790010ac0 con 0x7f87a8101df0 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.398+0000 7f87b06c2740 1 Processor -- start 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 -- start start 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937521880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693752c680 0x55693752ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5569374872e0 con 0x556937521dc0 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55693742ece0 con 0x5569375214a0 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87b06c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5569374832a0 con 0x55693752c680 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a5ffb640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 0x7f87940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47064/0 (socket says 172.21.15.52:47064) 2024-09-19T09:33:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 -- 172.21.15.52:0/3728162887 learned_addr learned my addr 172.21.15.52:0/3728162887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87ac886640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 0x7f87940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87ac886640 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937521880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a5ffb640 1 -- 172.21.15.52:0/285006225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f87900cfc00 con 0x7f87a8101df0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f879ffff640 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693752c680 0x55693752ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 -- 172.21.15.52:0/3728162887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693752c680 msgr2=0x55693752ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693752c680 0x55693752ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 -- 172.21.15.52:0/3728162887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 msgr2=0x556937521880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937521880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.399+0000 7f87a7fff640 1 -- 172.21.15.52:0/3728162887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556937413440 con 0x556937521dc0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.400+0000 7f87ac886640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 0x7f87940a5780 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005fd0 tx=0x7f87a0009e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.400+0000 7f87a7fff640 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8798009900 tx=0x7f8798005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6864f394d5d519c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.400+0000 7f879e7fc640 1 -- 172.21.15.52:0/3728162887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798040070 con 0x556937521dc0 2024-09-19T09:33:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.400+0000 7f879e7fc640 1 -- 172.21.15.52:0/3728162887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8798031870 con 0x556937521dc0 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.400+0000 7f879e7fc640 1 -- 172.21.15.52:0/3728162887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8798035040 con 0x556937521dc0 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- 172.21.15.52:0/3728162887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 msgr2=0x55693752c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f8798009900 tx=0x7f8798005be0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- 172.21.15.52:0/3728162887 shutdown_connections 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693752c680 0x55693752ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x55693752c140 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3728162887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937521880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- 172.21.15.52:0/3728162887 >> 172.21.15.52:0/3728162887 conn(0x55693751da30 msgr2=0x55693751de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- 172.21.15.52:0/3728162887 shutdown_connections 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- 172.21.15.52:0/3728162887 wait complete. 2024-09-19T09:33:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 -- start start 2024-09-19T09:33:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.401+0000 7f87b06c2740 1 Processor -- start 2024-09-19T09:33:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569375214a0 0x55693752bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693752c680 0x5569375296f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55693752f250 con 0x556937521dc0 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556937442050 con 0x55693752c680 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55693752f3d0 con 0x5569375214a0 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 10 client.0 _ll_register_callbacks cb 0x556937482160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47070/0 (socket says 172.21.15.52:47070) 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 -- 172.21.15.52:0/2968590518 learned_addr learned my addr 172.21.15.52:0/2968590518 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569375214a0 0x55693752bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 -- 172.21.15.52:0/2968590518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569375214a0 msgr2=0x55693752bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569375214a0 0x55693752bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 -- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693752c680 msgr2=0x5569375296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693752c680 0x5569375296f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 -- 172.21.15.52:0/2968590518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569371f83c0 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f879ffff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f87900cd680 tx=0x7f879009c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d22040cf3e98af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87877fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900a0120 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f87900a02c0 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.402+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8798031870 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f87900a4980 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 10 client.19830 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55693753abf0 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8798031870 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8790018b30 con 0x556937521dc0 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 10 client.19830 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 10 client.19830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 20 client.19830 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693753c000 0x55693753e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 4 client.19830 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556937494850 con 0x55693753c000 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.403+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693753c000 0x55693753e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.404+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693753c000 0x55693753e470 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210e72fcf30517b1 server_cookie=d92606693a49463a in_seq=0 out_seq=0 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.404+0000 7f87877fe640 10 client.19830 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.404+0000 7f87877fe640 1 -- 172.21.15.52:0/2968590518 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556937494850 con 0x55693753c000 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.404+0000 7f87877fe640 10 client.19830 handle_command_reply: tid=0 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.404+0000 7f87b06c2740 1 client.19830 shutdown 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 msgr2=0x5569375291b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f87900cd680 tx=0x7f879009c390 comp rx=0 tx=0).stop 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 shutdown_connections 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693753c000 0x55693753e470 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693752c680 0x5569375296f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x5569375291b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2968590518 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5569375214a0 0x55693752bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 >> 172.21.15.52:0/2968590518 conn(0x55693751da30 msgr2=0x556937523760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87877fe640 0 client.19830 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 shutdown_connections 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 1 -- 172.21.15.52:0/2968590518 wait complete. 2024-09-19T09:33:24.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.405+0000 7f87b06c2740 20 client.19830 trim_cache size 0 max 16384 2024-09-19T09:33:24.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.422+0000 7f87b06c2740 1 Processor -- start 2024-09-19T09:33:24.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.422+0000 7f87b06c2740 1 -- start start 2024-09-19T09:33:24.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 0x556937543d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937544280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81b0120 con 0x556937521dc0 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ad9f0 con 0x5569375214a0 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87b06c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ab840 con 0x55693751da30 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47082/0 (socket says 172.21.15.52:47082) 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 -- 172.21.15.52:0/3187790781 learned_addr learned my addr 172.21.15.52:0/3187790781 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87a7fff640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 0x556937543d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 -- 172.21.15.52:0/3187790781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 msgr2=0x556937543d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f879ffff640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937544280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 0x556937543d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 -- 172.21.15.52:0/3187790781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 msgr2=0x556937544280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937544280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 -- 172.21.15.52:0/3187790781 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55693751d860 con 0x556937521dc0 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87a7fff640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 0x556937543d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f879ffff640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937544280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f87ac886640 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f87a0011820 tx=0x7f87a0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672809ee4ea95ada server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.423+0000 7f879dffb640 1 -- 172.21.15.52:0/3187790781 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0024070 con 0x556937521dc0 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f879dffb640 1 -- 172.21.15.52:0/3187790781 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87a0004030 con 0x556937521dc0 2024-09-19T09:33:24.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f879dffb640 1 -- 172.21.15.52:0/3187790781 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0005280 con 0x556937521dc0 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- 172.21.15.52:0/3187790781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 msgr2=0x556937526410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f87a0011820 tx=0x7f87a0021000 comp rx=0 tx=0).stop 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- 172.21.15.52:0/3187790781 shutdown_connections 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556937521dc0 0x556937526410 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5569375214a0 0x556937544280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 --2- 172.21.15.52:0/3187790781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55693751da30 0x556937543d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- 172.21.15.52:0/3187790781 >> 172.21.15.52:0/3187790781 conn(0x556937529850 msgr2=0x556937527a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- 172.21.15.52:0/3187790781 shutdown_connections 2024-09-19T09:33:24.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- 172.21.15.52:0/3187790781 wait complete. 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.424+0000 7f87b06c2740 1 -- start start 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 Processor -- start 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 0x556937532560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 0x556937532fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81abeb0 con 0x5569375214a0 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ad320 con 0x55693751da30 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f87a81ac580 con 0x556937521dc0 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87b06c2740 10 client.0 _ll_register_callbacks cb 0x7f879009bbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f879ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47092/0 (socket says 172.21.15.52:47092) 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f879ffff640 1 -- 172.21.15.52:0/2315366306 learned_addr learned my addr 172.21.15.52:0/2315366306 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:24.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 0x556937532560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.425+0000 7f87ac886640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 0x556937532fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 -- 172.21.15.52:0/2315366306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 msgr2=0x556937532fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 0x556937532fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 -- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 msgr2=0x556937532560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 0x556937532560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 -- 172.21.15.52:0/2315366306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569375aa2d0 con 0x5569375214a0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87ac886640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 0x556937532fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 0x556937532560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f879ffff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f87900cd9f0 tx=0x7f8790098620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4aa81b619d164f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87900cdd40 con 0x5569375214a0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f879009b6a0 con 0x5569375214a0 2024-09-19T09:33:24.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a0004030 con 0x5569375214a0 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f87900a0330 con 0x5569375214a0 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87b06c2740 10 client.19836 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5569375ab530 con 0x5569375214a0 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87a0004030 con 0x5569375214a0 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.426+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f87900b00d0 con 0x5569375214a0 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 10 client.19836 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 10 client.19836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 20 client.19836 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693752c680 0x5569375adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 4 client.19836 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55693748ed60 con 0x55693752c680 2024-09-19T09:33:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693752c680 0x5569375adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87a7fff640 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693752c680 0x5569375adc90 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1463a3606167f1f6 server_cookie=ca9f50109808f699 in_seq=0 out_seq=0 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87877fe640 10 client.19836 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87877fe640 1 -- 172.21.15.52:0/2315366306 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55693748ed60 con 0x55693752c680 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87877fe640 10 client.19836 handle_command_reply: tid=0 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.427+0000 7f87b06c2740 1 client.19836 shutdown 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 msgr2=0x556937532aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f87900cd9f0 tx=0x7f8790098620 comp rx=0 tx=0).stop 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 shutdown_connections 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55693752c680 0x5569375adc90 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556937521dc0 0x556937532fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5569375214a0 0x556937532aa0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 --2- 172.21.15.52:0/2315366306 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55693751da30 0x556937532560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 >> 172.21.15.52:0/2315366306 conn(0x556937529850 msgr2=0x556937527e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87877fe640 0 client.19836 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 shutdown_connections 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 1 -- 172.21.15.52:0/2315366306 wait complete. 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87b06c2740 20 client.19836 trim_cache size 0 max 16384 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:33:24.436 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 msgr2=0x7f87940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 0x7f87940a5780 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005fd0 tx=0x7f87a0009e80 comp rx=0 tx=0).stop 2024-09-19T09:33:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 msgr2=0x7f87a8199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f879000e9f0 tx=0x7f879000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 shutdown_connections 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f87940a32c0 0x7f87940a5780 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f87a8106050 0x7f87a81a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87a8101df0 0x7f87a8199a20 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 --2- 172.21.15.52:0/285006225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f87a8101440 0x7f87a81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.428+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 >> 172.21.15.52:0/285006225 conn(0x7f87a8077210 msgr2=0x7f87a81042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.429+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 shutdown_connections 2024-09-19T09:33:24.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:24.429+0000 7f87ae2e9640 1 -- 172.21.15.52:0/285006225 wait complete. 2024-09-19T09:33:24.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:24 smithi052 ceph-mon[30947]: pgmap v697: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:33:24.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:24 smithi169 ceph-mon[35454]: pgmap v697: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:33:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:24 smithi086 ceph-mon[34813]: pgmap v697: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:33:25.149 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:33:25.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:33:25.413 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 -- 172.21.15.52:0/2999964517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134100a80 msgr2=0x7f4134100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 --2- 172.21.15.52:0/2999964517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134100a80 0x7f4134100ee0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4128009930 tx=0x7f412802a420 comp rx=0 tx=0).stop 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 -- 172.21.15.52:0/2999964517 shutdown_connections 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 --2- 172.21.15.52:0/2999964517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134101420 0x7f413410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 --2- 172.21.15.52:0/2999964517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134100a80 0x7f4134100ee0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 --2- 172.21.15.52:0/2999964517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134106a80 0x7f4134106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 -- 172.21.15.52:0/2999964517 >> 172.21.15.52:0/2999964517 conn(0x7f41340fc7a0 msgr2=0x7f41340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 -- 172.21.15.52:0/2999964517 shutdown_connections 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.859+0000 7f413a60c640 1 -- 172.21.15.52:0/2999964517 wait complete. 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 Processor -- start 2024-09-19T09:33:25.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 -- start start 2024-09-19T09:33:25.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134100a80 0x7f41341992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:25.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134101420 0x7f41341997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:25.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:25.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4134110e80 con 0x7f4134106a80 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4134110d00 con 0x7f4134101420 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f413a60c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4134111000 con 0x7f4134100a80 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f4138ba9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f4138ba9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47102/0 (socket says 172.21.15.52:47102) 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f4138ba9640 1 -- 172.21.15.52:0/421299688 learned_addr learned my addr 172.21.15.52:0/421299688 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.860+0000 7f4133fff640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134100a80 0x7f41341992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f41337fe640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134101420 0x7f41341997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 -- 172.21.15.52:0/421299688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134100a80 msgr2=0x7f41341992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134100a80 0x7f41341992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 -- 172.21.15.52:0/421299688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134101420 msgr2=0x7f41341997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134101420 0x7f41341997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 -- 172.21.15.52:0/421299688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41341a4860 con 0x7f4134106a80 2024-09-19T09:33:25.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f4138ba9640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f412c00eb10 tx=0x7f412c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c004b20 con 0x7f4134106a80 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f412c004cc0 con 0x7f4134106a80 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41341a4a30 con 0x7f4134106a80 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c010760 con 0x7f4134106a80 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.861+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41341a4f40 con 0x7f4134106a80 2024-09-19T09:33:25.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.862+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4134100ee0 con 0x7f4134106a80 2024-09-19T09:33:25.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.864+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f412c005020 con 0x7f4134106a80 2024-09-19T09:33:25.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.864+0000 7f41317fa640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 0x7f411c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:25.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.864+0000 7f4133fff640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 0x7f411c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:25.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.864+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f412c0d00c0 con 0x7f4134106a80 2024-09-19T09:33:25.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.865+0000 7f4133fff640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 0x7f411c0a5800 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4124005d00 tx=0x7f412400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:25.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:25.869+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f412c09cd00 con 0x7f4134106a80 2024-09-19T09:33:26.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.081+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4134109010 con 0x7f4134106a80 2024-09-19T09:33:26.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.082+0000 7f41317fa640 1 -- 172.21.15.52:0/421299688 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f412c09c600 con 0x7f4134106a80 2024-09-19T09:33:26.084 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:33:26.084 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:33:26.084 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:33:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 msgr2=0x7f411c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 0x7f411c0a5800 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4124005d00 tx=0x7f412400b410 comp rx=0 tx=0).stop 2024-09-19T09:33:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 msgr2=0x7f41341a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f412c00eb10 tx=0x7f412c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:33:26.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 shutdown_connections 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4134106a80 0x7f41341a4320 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4134101420 0x7f41341997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f411c0a3340 0x7f411c0a5800 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 --2- 172.21.15.52:0/421299688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4134100a80 0x7f41341992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 >> 172.21.15.52:0/421299688 conn(0x7f41340fc7a0 msgr2=0x7f41340fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 shutdown_connections 2024-09-19T09:33:26.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:26.084+0000 7f413a60c640 1 -- 172.21.15.52:0/421299688 wait complete. 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:375/600: open fd = 3 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:376/600: open fd = 3 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:377/600: open fd = 3 2024-09-19T09:33:26.476 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:378/600: open fd = 3 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:379/600: open fd = 3 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:380/600: open fd = 3 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.477 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:381/600: open fd = 3 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:382/600: open fd = 3 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:383/600: open fd = 3 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.478 INFO:tasks.workunit.client.0.smithi052.stdout:384/600: open fd = 3 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:385/600: open fd = 3 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:386/600: open fd = 3 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:387/600: open fd = 3 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.479 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:388/600: open fd = 3 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:389/600: open fd = 3 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:390/600: open fd = 3 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.480 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:391/600: open fd = 3 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:392/600: open fd = 3 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:393/600: open fd = 3 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.481 INFO:tasks.workunit.client.0.smithi052.stdout:394/600: open fd = 3 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:395/600: open fd = 3 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:396/600: open fd = 3 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:397/600: open fd = 3 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.482 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:398/600: open fd = 3 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:399/600: open fd = 3 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:400/600: open fd = 3 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.483 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:401/600: open fd = 3 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:402/600: open fd = 3 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:403/600: open fd = 3 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.484 INFO:tasks.workunit.client.0.smithi052.stdout:404/600: open fd = 3 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:405/600: open fd = 3 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:406/600: open fd = 3 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:407/600: open fd = 3 2024-09-19T09:33:26.485 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:408/600: open fd = 3 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:409/600: open fd = 3 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:410/600: open fd = 3 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.486 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:411/600: open fd = 3 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:412/600: open fd = 3 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:413/600: open fd = 3 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.487 INFO:tasks.workunit.client.0.smithi052.stdout:414/600: open fd = 3 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:415/600: open fd = 3 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:416/600: open fd = 3 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:417/600: open fd = 3 2024-09-19T09:33:26.488 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:418/600: open fd = 3 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:419/600: open fd = 3 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:420/600: open fd = 3 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.489 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:421/600: open fd = 3 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:422/600: open fd = 3 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:423/600: open fd = 3 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.490 INFO:tasks.workunit.client.0.smithi052.stdout:424/600: open fd = 3 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:425/600: open fd = 3 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:426/600: open fd = 3 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:427/600: open fd = 3 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.491 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:428/600: open fd = 3 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:429/600: open fd = 3 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:430/600: open fd = 3 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:431/600: open fd = 3 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.492 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:432/600: open fd = 3 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:433/600: open fd = 3 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:434/600: open fd = 3 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:435/600: open fd = 3 2024-09-19T09:33:26.493 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:436/600: open fd = 3 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:33:26.494 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:33:26.783 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:26 smithi052 ceph-mon[30947]: pgmap v698: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:26.784 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:26 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/421299688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:26.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:33:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:26 smithi169 ceph-mon[35454]: pgmap v698: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:26 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/421299688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:26 smithi086 ceph-mon[34813]: pgmap v698: 97 pgs: 97 active+clean; 2.0 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:26 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/421299688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:27.071 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:27.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- 172.21.15.52:0/1571001173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594106f50 msgr2=0x7fc59410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1571001173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594106f50 0x7fc59410eaf0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009cd0 tx=0x7fc58c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- 172.21.15.52:0/1571001173 shutdown_connections 2024-09-19T09:33:27.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1571001173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594106f50 0x7fc59410eaf0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1571001173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594100d00 0x7fc594106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1571001173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100350 0x7fc594100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- 172.21.15.52:0/1571001173 >> 172.21.15.52:0/1571001173 conn(0x7fc594077210 msgr2=0x7fc5940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- 172.21.15.52:0/1571001173 shutdown_connections 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- 172.21.15.52:0/1571001173 wait complete. 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 Processor -- start 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.561+0000 7fc59a5af640 1 -- start start 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 0x7fc594101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 0x7fc594101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc594112080 con 0x7fc594100350 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc594111f00 con 0x7fc594100d00 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc594112200 con 0x7fc594106f50 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47116/0 (socket says 172.21.15.52:47116) 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 -- 172.21.15.52:0/1488189494 learned_addr learned my addr 172.21.15.52:0/1488189494 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 0x7fc594101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc58bfff640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 0x7fc594101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 -- 172.21.15.52:0/1488189494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 msgr2=0x7fc594101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 0x7fc594101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 -- 172.21.15.52:0/1488189494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 msgr2=0x7fc594101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 0x7fc594101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 -- 172.21.15.52:0/1488189494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5941a6aa0 con 0x7fc594100350 2024-09-19T09:33:27.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 0x7fc594101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc58bfff640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 0x7fc594101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc593fff640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b4a0 tx=0x7fc58400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc591ffb640 1 -- 172.21.15.52:0/1488189494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584014070 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc591ffb640 1 -- 172.21.15.52:0/1488189494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc584010af0 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.562+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5941a6d90 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.563+0000 7fc591ffb640 1 -- 172.21.15.52:0/1488189494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584017d10 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.563+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5941a7270 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.565+0000 7fc591ffb640 1 -- 172.21.15.52:0/1488189494 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc584017070 con 0x7fc594100350 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.565+0000 7fc59c988740 1 Processor -- start 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.565+0000 7fc59c988740 1 -- start start 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb335d0 0x55a7ebb33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7eba992f0 con 0x55a7ebb34b40 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a7eba40cf0 con 0x55a7ebb335d0 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc59c988740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7eba952b0 con 0x55a7ebb3e370 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47120/0 (socket says 172.21.15.52:47120) 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 -- 172.21.15.52:0/3958541390 learned_addr learned my addr 172.21.15.52:0/3958541390 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc593fff640 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb335d0 0x55a7ebb33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc591ffb640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 0x7fc5800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 -- 172.21.15.52:0/3958541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 msgr2=0x55a7ebb40760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc58bfff640 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb40760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 -- 172.21.15.52:0/3958541390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb335d0 msgr2=0x55a7ebb33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb335d0 0x55a7ebb33a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 -- 172.21.15.52:0/3958541390 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7eba253a0 con 0x55a7ebb34b40 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc591ffb640 1 -- 172.21.15.52:0/1488189494 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc5840cee10 con 0x7fc594100350 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 0x7fc5800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.566+0000 7fc598b4c640 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0315f0 tx=0x7fc58c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad583ceec2b26770 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc58a7fc640 1 -- 172.21.15.52:0/3958541390 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c04c070 con 0x55a7ebb34b40 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc58a7fc640 1 -- 172.21.15.52:0/3958541390 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc58c036040 con 0x55a7ebb34b40 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc58a7fc640 1 -- 172.21.15.52:0/3958541390 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58c030d70 con 0x55a7ebb34b40 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc59c988740 1 -- 172.21.15.52:0/3958541390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 msgr2=0x55a7ebb33090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc59c988740 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0315f0 tx=0x7fc58c009a20 comp rx=0 tx=0).stop 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 0x7fc5800a5700 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc58c049000 tx=0x7fc58c04a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.567+0000 7fc59c988740 1 -- 172.21.15.52:0/3958541390 shutdown_connections 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb40760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb335d0 0x55a7ebb33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- 172.21.15.52:0/3958541390 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb33090 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- 172.21.15.52:0/3958541390 >> 172.21.15.52:0/3958541390 conn(0x55a7ebafc310 msgr2=0x55a7ebb2fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- 172.21.15.52:0/3958541390 shutdown_connections 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- 172.21.15.52:0/3958541390 wait complete. 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- start start 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 Processor -- start 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb3aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb3b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7ebb41070 con 0x55a7ebb335d0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.568+0000 7fc59c988740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a7eba54060 con 0x55a7ebb34b40 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc59c988740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7ebb411f0 con 0x55a7ebb3e370 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc59c988740 10 client.0 _ll_register_callbacks cb 0x55a7eb7a78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47132/0 (socket says 172.21.15.52:47132) 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 -- 172.21.15.52:0/2365810024 learned_addr learned my addr 172.21.15.52:0/2365810024 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc598b4c640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb3b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc58bfff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb3aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 -- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 msgr2=0x55a7ebb3b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb3b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 -- 172.21.15.52:0/2365810024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 msgr2=0x55a7ebb3aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb3aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 -- 172.21.15.52:0/2365810024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7eb80a3c0 con 0x55a7ebb335d0 2024-09-19T09:33:27.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc598b4c640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb3b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc593fff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc58400be60 tx=0x7fc58409ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c91f70b73b4842 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc5737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58401e070 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc584010ca0 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.569+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc58c036040 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc58409b350 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 10 client.19854 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7ebb4cb40 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc58c036040 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc5840979c0 con 0x55a7ebb335d0 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 10 client.19854 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 10 client.19854 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:27.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 20 client.19854 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:27.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebb4e050 0x55a7ebb50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 4 client.19854 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:27.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7ebaa6860 con 0x55a7ebb4e050 2024-09-19T09:33:27.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.570+0000 7fc58bfff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebb4e050 0x55a7ebb50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.571+0000 7fc58bfff640 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebb4e050 0x55a7ebb50480 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a19cc119ee44ac2 server_cookie=4d17658d41bbd76e in_seq=0 out_seq=0 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.571+0000 7fc5737fe640 10 client.19854 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc5737fe640 1 -- 172.21.15.52:0/2365810024 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7ebaa6860 con 0x55a7ebb4e050 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc5737fe640 10 client.19854 handle_command_reply: tid=0 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 client.19854 shutdown 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 msgr2=0x55a7ebb3dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc58400be60 tx=0x7fc58409ae90 comp rx=0 tx=0).stop 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 shutdown_connections 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebb4e050 0x55a7ebb50480 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb3b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb3aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 --2- 172.21.15.52:0/2365810024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3dd40 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc5737fe640 0 client.19854 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 >> 172.21.15.52:0/2365810024 conn(0x55a7ebafc310 msgr2=0x55a7ebb35930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 shutdown_connections 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 1 -- 172.21.15.52:0/2365810024 wait complete. 2024-09-19T09:33:27.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.572+0000 7fc59c988740 20 client.19854 trim_cache size 0 max 16384 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 Processor -- start 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 -- start start 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb36120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb36660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941b2410 con 0x55a7ebb335d0 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941afce0 con 0x55a7ebb34b40 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc59c988740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941adb30 con 0x55a7ebb3e370 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47134/0 (socket says 172.21.15.52:47134) 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.585+0000 7fc593fff640 1 -- 172.21.15.52:0/1001500184 learned_addr learned my addr 172.21.15.52:0/1001500184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb36660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc58bfff640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb36120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 -- 172.21.15.52:0/1001500184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 msgr2=0x55a7ebb36660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb36660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 -- 172.21.15.52:0/1001500184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 msgr2=0x55a7ebb36120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb36120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 -- 172.21.15.52:0/1001500184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ebb39fa0 con 0x55a7ebb335d0 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc598b4c640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb36660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc58bfff640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb36120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc593fff640 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fc584097d20 tx=0x7fc5840047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6316c3d34c991b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc589ffb640 1 -- 172.21.15.52:0/1001500184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58401e020 con 0x55a7ebb335d0 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc589ffb640 1 -- 172.21.15.52:0/1001500184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5840bb0b0 con 0x55a7ebb335d0 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.586+0000 7fc589ffb640 1 -- 172.21.15.52:0/1001500184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584010dc0 con 0x55a7ebb335d0 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- 172.21.15.52:0/1001500184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 msgr2=0x55a7ebb3a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fc584097d20 tx=0x7fc5840047d0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- 172.21.15.52:0/1001500184 shutdown_connections 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb3e370 0x55a7ebb36660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb34b40 0x55a7ebb36120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 --2- 172.21.15.52:0/1001500184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb335d0 0x55a7ebb3a8b0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- 172.21.15.52:0/1001500184 >> 172.21.15.52:0/1001500184 conn(0x55a7ebafc310 msgr2=0x55a7ebb3d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- 172.21.15.52:0/1001500184 shutdown_connections 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- 172.21.15.52:0/1001500184 wait complete. 2024-09-19T09:33:27.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 -- start start 2024-09-19T09:33:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.587+0000 7fc59c988740 1 Processor -- start 2024-09-19T09:33:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 0x55a7ebb42420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb3e370 0x55a7ebb42ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941ae1a0 con 0x55a7ebb34b40 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941af610 con 0x55a7ebb3e370 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5941ae870 con 0x55a7ebb335d0 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc59c988740 10 client.0 _ll_register_callbacks cb 0x7fc58400b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47140/0 (socket says 172.21.15.52:47140) 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 -- 172.21.15.52:0/3599339648 learned_addr learned my addr 172.21.15.52:0/3599339648 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc593fff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 0x55a7ebb42420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc598b4c640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb3e370 0x55a7ebb42ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 -- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 msgr2=0x55a7ebb42420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 0x55a7ebb42420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 -- 172.21.15.52:0/3599339648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb3e370 msgr2=0x55a7ebb42ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb3e370 0x55a7ebb42ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 -- 172.21.15.52:0/3599339648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7ebbb7f70 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc593fff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 0x55a7ebb42420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc58bfff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c7e0 tx=0x7fc57c018450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684eabe068b343a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc5737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.588+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00f040 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc57c01e610 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5840bb0b0 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc57c02c050 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 10 client.19860 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7ebbb9220 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5840bb0b0 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc57c015900 con 0x55a7ebb34b40 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 10 client.19860 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 10 client.19860 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:33:27.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 20 client.19860 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebbb99d0 0x55a7ebbbbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 4 client.19860 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.589+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7ebaa0d70 con 0x55a7ebbb99d0 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc593fff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebbb99d0 0x55a7ebbbbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc593fff640 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebbb99d0 0x55a7ebbbbdf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6d874b25e4c7ff7 server_cookie=74ec2b09a64c0d6c in_seq=0 out_seq=0 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc5737fe640 10 client.19860 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc5737fe640 1 -- 172.21.15.52:0/3599339648 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7ebaa0d70 con 0x55a7ebbb99d0 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc5737fe640 10 client.19860 handle_command_reply: tid=0 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 client.19860 shutdown 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 msgr2=0x55a7ebb42960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00c7e0 tx=0x7fc57c018450 comp rx=0 tx=0).stop 2024-09-19T09:33:27.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 shutdown_connections 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7ebbb99d0 0x55a7ebbbbdf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7ebb3e370 0x55a7ebb42ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7ebb34b40 0x55a7ebb42960 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc5737fe640 0 client.19860 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 --2- 172.21.15.52:0/3599339648 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7ebb335d0 0x55a7ebb42420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.590+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 >> 172.21.15.52:0/3599339648 conn(0x55a7ebafc310 msgr2=0x55a7ebb2e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 shutdown_connections 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59c988740 1 -- 172.21.15.52:0/3599339648 wait complete. 2024-09-19T09:33:27.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59c988740 20 client.19860 trim_cache size 0 max 16384 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 msgr2=0x7fc5800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 0x7fc5800a5700 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc58c049000 tx=0x7fc58c04a000 comp rx=0 tx=0).stop 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 msgr2=0x7fc5941012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b4a0 tx=0x7fc58400b960 comp rx=0 tx=0).stop 2024-09-19T09:33:27.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 shutdown_connections 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5800a3240 0x7fc5800a5700 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc594106f50 0x7fc594101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc594100d00 0x7fc594101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 --2- 172.21.15.52:0/1488189494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc594100350 0x7fc5941012d0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 >> 172.21.15.52:0/1488189494 conn(0x7fc594077210 msgr2=0x7fc594105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 shutdown_connections 2024-09-19T09:33:27.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:27.591+0000 7fc59a5af640 1 -- 172.21.15.52:0/1488189494 wait complete. 2024-09-19T09:33:28.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:33:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:28.920 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:28 smithi052 ceph-mon[30947]: pgmap v699: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:33:28.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:28 smithi169 ceph-mon[35454]: pgmap v699: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:33:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:28 smithi086 ceph-mon[34813]: pgmap v699: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 -- 172.21.15.52:0/4151156563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608106f10 msgr2=0x7f360810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 --2- 172.21.15.52:0/4151156563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608106f10 0x7f360810ea90 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3600009ca0 tx=0x7f360002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 -- 172.21.15.52:0/4151156563 shutdown_connections 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 --2- 172.21.15.52:0/4151156563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608106f10 0x7f360810ea90 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 --2- 172.21.15.52:0/4151156563 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608102790 0x7f36081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 --2- 172.21.15.52:0/4151156563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608101de0 0x7f36081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 -- 172.21.15.52:0/4151156563 >> 172.21.15.52:0/4151156563 conn(0x7f36080fd8c0 msgr2=0x7f36080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 -- 172.21.15.52:0/4151156563 shutdown_connections 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.003+0000 7f360fe7c640 1 -- 172.21.15.52:0/4151156563 wait complete. 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 Processor -- start 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 -- start start 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608101de0 0x7f36081983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 0x7f360819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3608111f70 con 0x7f3608102790 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3608111df0 con 0x7f3608106f10 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360fe7c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36081120f0 con 0x7f3608101de0 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360d417640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360d417640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41312/0 (socket says 172.21.15.52:41312) 2024-09-19T09:33:29.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360d417640 1 -- 172.21.15.52:0/2577791881 learned_addr learned my addr 172.21.15.52:0/2577791881 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.004+0000 7f360dc18640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608101de0 0x7f36081983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360e419640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 0x7f360819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 -- 172.21.15.52:0/2577791881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608101de0 msgr2=0x7f36081983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608101de0 0x7f36081983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 -- 172.21.15.52:0/2577791881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 msgr2=0x7f360819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 0x7f360819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 -- 172.21.15.52:0/2577791881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360819d360 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360e419640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 0x7f360819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360d417640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d950 tx=0x7f35f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f35feffd640 1 -- 172.21.15.52:0/2577791881 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8017070 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f360819d650 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f35feffd640 1 -- 172.21.15.52:0/2577791881 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f8009c30 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f35feffd640 1 -- 172.21.15.52:0/2577791881 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f800f6b0 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.005+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081a4f30 con 0x7f3608102790 2024-09-19T09:33:29.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.007+0000 7f35feffd640 1 -- 172.21.15.52:0/2577791881 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f35f80109d0 con 0x7f3608102790 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 Processor -- start 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 -- start start 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9235090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9246b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559fb919b2f0 con 0x559fb92355d0 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559fb9142cf0 con 0x559fb9236b40 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f3612255740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559fb91972b0 con 0x559fb9244780 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41324/0 (socket says 172.21.15.52:41324) 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 -- 172.21.15.52:0/3772922420 learned_addr learned my addr 172.21.15.52:0/3772922420 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f35feffd640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360e419640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9235090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360d417640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9246b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 -- 172.21.15.52:0/3772922420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 msgr2=0x559fb9246b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9246b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 -- 172.21.15.52:0/3772922420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 msgr2=0x559fb9235090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.008+0000 7f360dc18640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9235090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f360dc18640 1 -- 172.21.15.52:0/3772922420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb91273a0 con 0x559fb92355d0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f360e419640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9235090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f360e419640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f35feffd640 1 -- 172.21.15.52:0/2577791881 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35f80cf5f0 con 0x7f3608102790 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f360dc18640 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f360400bd10 tx=0x7f36040107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bb9e62744b8c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f35f3fff640 1 -- 172.21.15.52:0/3772922420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604004030 con 0x559fb92355d0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f35f3fff640 1 -- 172.21.15.52:0/3772922420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36040041d0 con 0x559fb92355d0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.009+0000 7f35f3fff640 1 -- 172.21.15.52:0/3772922420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604011840 con 0x559fb92355d0 2024-09-19T09:33:29.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- 172.21.15.52:0/3772922420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 msgr2=0x559fb9235a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f360e419640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 0x7f35f40a5700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3600006010 tx=0x7f360003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f360400bd10 tx=0x7f36040107a0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- 172.21.15.52:0/3772922420 shutdown_connections 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9246b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb9235a10 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 --2- 172.21.15.52:0/3772922420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9235090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- 172.21.15.52:0/3772922420 >> 172.21.15.52:0/3772922420 conn(0x559fb91fe310 msgr2=0x559fb9231c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- 172.21.15.52:0/3772922420 shutdown_connections 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- 172.21.15.52:0/3772922420 wait complete. 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 -- start start 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.010+0000 7f3612255740 1 Processor -- start 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb92441b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9241460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559fb9247480 con 0x559fb9244780 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559fb9156060 con 0x559fb9236b40 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559fb9247600 con 0x559fb92355d0 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f3612255740 10 client.0 _ll_register_callbacks cb 0x559fb8ea98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41326/0 (socket says 172.21.15.52:41326) 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 -- 172.21.15.52:0/1465287102 learned_addr learned my addr 172.21.15.52:0/1465287102 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360dc18640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb92441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360d417640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9241460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 -- 172.21.15.52:0/1465287102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 msgr2=0x559fb92441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb92441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 -- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 msgr2=0x559fb9241460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9241460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360e419640 1 -- 172.21.15.52:0/1465287102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb8f0c3c0 con 0x559fb9244780 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.011+0000 7f360dc18640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb92441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:29.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f360e419640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f3600004ac0 tx=0x7f36000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca233ca4f63b5687 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600004450 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36000045f0 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36040041d0 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3600056070 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 10 client.19872 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559fb9252f60 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36040041d0 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f360004f020 con 0x559fb9244780 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 10 client.19872 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 10 client.19872 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 20 client.19872 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:29.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb9254370 0x559fb92567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 4 client.19872 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.012+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fb91a8860 con 0x559fb9254370 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.013+0000 7f360dc18640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb9254370 0x559fb92567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.013+0000 7f360dc18640 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb9254370 0x559fb92567d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=659d3320d09c195e server_cookie=f6ef6a48649ba1e3 in_seq=0 out_seq=0 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.013+0000 7f35f17fa640 10 client.19872 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f35f17fa640 1 -- 172.21.15.52:0/1465287102 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fb91a8860 con 0x559fb9254370 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f35f17fa640 10 client.19872 handle_command_reply: tid=0 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 client.19872 shutdown 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 msgr2=0x559fb9241bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f3600004ac0 tx=0x7f36000095c0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 shutdown_connections 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb9241bf0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb9254370 0x559fb92567d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb9241460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f35f17fa640 0 client.19872 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 --2- 172.21.15.52:0/1465287102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb92441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 >> 172.21.15.52:0/1465287102 conn(0x559fb91fe310 msgr2=0x559fb9237960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 shutdown_connections 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 1 -- 172.21.15.52:0/1465287102 wait complete. 2024-09-19T09:33:29.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.014+0000 7f3612255740 20 client.19872 trim_cache size 0 max 16384 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 Processor -- start 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 -- start start 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb9231e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb925c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36081ade90 con 0x559fb9244780 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36081ab760 con 0x559fb9236b40 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f3612255740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36081a95b0 con 0x559fb92355d0 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41342/0 (socket says 172.21.15.52:41342) 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 -- 172.21.15.52:0/507798295 learned_addr learned my addr 172.21.15.52:0/507798295 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360d417640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb925c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 -- 172.21.15.52:0/507798295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 msgr2=0x559fb9231e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360dc18640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb9231e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb9231e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 -- 172.21.15.52:0/507798295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 msgr2=0x559fb925c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb925c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360e419640 1 -- 172.21.15.52:0/507798295 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb9250c00 con 0x559fb9244780 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.028+0000 7f360d417640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb925c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.029+0000 7f360e419640 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f3600004a90 tx=0x7f3600009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75638a3dde857094 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.029+0000 7f35f37fe640 1 -- 172.21.15.52:0/507798295 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600004250 con 0x559fb9244780 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.029+0000 7f35f37fe640 1 -- 172.21.15.52:0/507798295 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3600036040 con 0x559fb9244780 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.029+0000 7f35f37fe640 1 -- 172.21.15.52:0/507798295 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360002f870 con 0x559fb9244780 2024-09-19T09:33:29.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- 172.21.15.52:0/507798295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 msgr2=0x559fb925c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f3600004a90 tx=0x7f3600009940 comp rx=0 tx=0).stop 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- 172.21.15.52:0/507798295 shutdown_connections 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb9244780 0x559fb925c5e0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb925c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- 172.21.15.52:0/507798295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb92355d0 0x559fb9231e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- 172.21.15.52:0/507798295 >> 172.21.15.52:0/507798295 conn(0x559fb91fe310 msgr2=0x559fb9231700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- 172.21.15.52:0/507798295 shutdown_connections 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- 172.21.15.52:0/507798295 wait complete. 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 -- start start 2024-09-19T09:33:29.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 Processor -- start 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.030+0000 7f3612255740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb924cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9249860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36081a9c20 con 0x559fb92355d0 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36081ab090 con 0x559fb9236b40 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36081aa2f0 con 0x559fb9244780 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 10 client.0 _ll_register_callbacks cb 0x7f3600009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41354/0 (socket says 172.21.15.52:41354) 2024-09-19T09:33:29.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 -- 172.21.15.52:0/3276065589 learned_addr learned my addr 172.21.15.52:0/3276065589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360e419640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9249860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360d417640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb924cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 -- 172.21.15.52:0/3276065589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 msgr2=0x559fb9249860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9249860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 -- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 msgr2=0x559fb924cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb924cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 -- 172.21.15.52:0/3276065589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb9249da0 con 0x559fb92355d0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f360dc18640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f3604011010 tx=0x7f3604005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6d95939538589f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f35f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604003a00 con 0x559fb92355d0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3600036040 con 0x559fb92355d0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.031+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3604005040 con 0x559fb92355d0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3604037050 con 0x559fb92355d0 2024-09-19T09:33:29.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 10 client.19878 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559fb92bf860 con 0x559fb92355d0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3600036040 con 0x559fb92355d0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f36040119f0 con 0x559fb92355d0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 10 client.19878 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 10 client.19878 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 20 client.19878 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb92bfca0 0x559fb92c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 4 client.19878 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fb91a2d70 con 0x559fb92bfca0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.032+0000 7f360d417640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb92bfca0 0x559fb92c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f360d417640 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb92bfca0 0x559fb92c20c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ddd0d955fda200f server_cookie=64b56b94f280079e in_seq=0 out_seq=0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f35f17fa640 10 client.19878 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f35f17fa640 1 -- 172.21.15.52:0/3276065589 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fb91a2d70 con 0x559fb92bfca0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f35f17fa640 10 client.19878 handle_command_reply: tid=0 2024-09-19T09:33:29.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 client.19878 shutdown 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 msgr2=0x559fb924c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f3604011010 tx=0x7f3604005850 comp rx=0 tx=0).stop 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 shutdown_connections 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559fb9244780 0x559fb9249860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x559fb92bfca0 0x559fb92c20c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559fb9236b40 0x559fb924cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 --2- 172.21.15.52:0/3276065589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559fb92355d0 0x559fb924c890 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f35f17fa640 0 client.19878 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 >> 172.21.15.52:0/3276065589 conn(0x559fb91fe310 msgr2=0x559fb92434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 shutdown_connections 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 1 -- 172.21.15.52:0/3276065589 wait complete. 2024-09-19T09:33:29.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.033+0000 7f3612255740 20 client.19878 trim_cache size 0 max 16384 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 msgr2=0x7f35f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 0x7f35f40a5700 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3600006010 tx=0x7f360003e040 comp rx=0 tx=0).stop 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 msgr2=0x7f36081988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f35f800d950 tx=0x7f35f800de10 comp rx=0 tx=0).stop 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 shutdown_connections 2024-09-19T09:33:29.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3608106f10 0x7f360819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3608102790 0x7f36081988f0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 --2- 172.21.15.52:0/2577791881 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3608101de0 0x7f36081983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 >> 172.21.15.52:0/2577791881 conn(0x7f36080fd8c0 msgr2=0x7f36080fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 shutdown_connections 2024-09-19T09:33:29.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:29.034+0000 7f360fe7c640 1 -- 172.21.15.52:0/2577791881 wait complete. 2024-09-19T09:33:29.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:33:30.131 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:30.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 -- 172.21.15.52:0/3681073930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 msgr2=0x7fb830112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 --2- 172.21.15.52:0/3681073930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb830112650 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb818009900 tx=0x7fb81802a480 comp rx=0 tx=0).stop 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 -- 172.21.15.52:0/3681073930 shutdown_connections 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 --2- 172.21.15.52:0/3681073930 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830112b90 0x7fb830114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 --2- 172.21.15.52:0/3681073930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb830112650 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 --2- 172.21.15.52:0/3681073930 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830074590 0x7fb830074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 -- 172.21.15.52:0/3681073930 >> 172.21.15.52:0/3681073930 conn(0x7fb8300fd8c0 msgr2=0x7fb8300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 -- 172.21.15.52:0/3681073930 shutdown_connections 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.613+0000 7fb834ada640 1 -- 172.21.15.52:0/3681073930 wait complete. 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 Processor -- start 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 -- start start 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830074590 0x7fb8301a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 0x7fb83019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb830118540 con 0x7fb830074eb0 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301183c0 con 0x7fb830112b90 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb834ada640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301186c0 con 0x7fb830074590 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb827fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb827fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41376/0 (socket says 172.21.15.52:41376) 2024-09-19T09:33:30.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb827fff640 1 -- 172.21.15.52:0/3890600503 learned_addr learned my addr 172.21.15.52:0/3890600503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb82e59c640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830074590 0x7fb8301a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.614+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 0x7fb83019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 -- 172.21.15.52:0/3890600503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830074590 msgr2=0x7fb8301a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830074590 0x7fb8301a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 -- 172.21.15.52:0/3890600503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 msgr2=0x7fb83019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 0x7fb83019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 -- 172.21.15.52:0/3890600503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83019ef70 con 0x7fb830074eb0 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 0x7fb83019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb827fff640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fb818005ab0 tx=0x7fb8180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb8277fe640 1 -- 172.21.15.52:0/3890600503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81803f030 con 0x7fb830074eb0 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb8277fe640 1 -- 172.21.15.52:0/3890600503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb818003ce0 con 0x7fb830074eb0 2024-09-19T09:33:30.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb8277fe640 1 -- 172.21.15.52:0/3890600503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818035070 con 0x7fb830074eb0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83019f200 con 0x7fb830074eb0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.615+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8301ab4b0 con 0x7fb830074eb0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb8277fe640 1 -- 172.21.15.52:0/3890600503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb818042030 con 0x7fb830074eb0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 Processor -- start 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 -- start start 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8ac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f4d8122f0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555f4d7b9cf0 con 0x555f4d8b7370 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb836eb3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f4d80e2b0 con 0x555f4d8adb40 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.618+0000 7fb8277fe640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 0x7fb81c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41390/0 (socket says 172.21.15.52:41390) 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82ed9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 0x7fb81c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 -- 172.21.15.52:0/953280341 learned_addr learned my addr 172.21.15.52:0/953280341 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb827fff640 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb8277fe640 1 -- 172.21.15.52:0/3890600503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb8180f0310 con 0x7fb830074eb0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 -- 172.21.15.52:0/953280341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 msgr2=0x555f4d8ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 -- 172.21.15.52:0/953280341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 msgr2=0x555f4d8b9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 -- 172.21.15.52:0/953280341 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4d79e3a0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 0x7fb81c0a5700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb828007330 tx=0x7fb828007610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb82e59c640 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fb82000ad00 tx=0x7fb82000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911a945a8b9b920b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb824ff9640 1 -- 172.21.15.52:0/953280341 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82001d070 con 0x555f4d8ac5d0 2024-09-19T09:33:30.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb824ff9640 1 -- 172.21.15.52:0/953280341 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb820018b20 con 0x555f4d8ac5d0 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.619+0000 7fb824ff9640 1 -- 172.21.15.52:0/953280341 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820010be0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 -- 172.21.15.52:0/953280341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 msgr2=0x555f4d8aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fb82000ad00 tx=0x7fb82000f790 comp rx=0 tx=0).stop 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 -- 172.21.15.52:0/953280341 shutdown_connections 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8aca10 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 --2- 172.21.15.52:0/953280341 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 -- 172.21.15.52:0/953280341 >> 172.21.15.52:0/953280341 conn(0x555f4d875310 msgr2=0x555f4d8a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 -- 172.21.15.52:0/953280341 shutdown_connections 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.620+0000 7fb836eb3740 1 -- 172.21.15.52:0/953280341 wait complete. 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 -- start start 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 Processor -- start 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f4d8ba070 con 0x555f4d8ac5d0 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555f4d7cd060 con 0x555f4d8b7370 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f4d8ba1f0 con 0x555f4d8adb40 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb836eb3740 10 client.0 _ll_register_callbacks cb 0x555f4d5208c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb82e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb82e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41400/0 (socket says 172.21.15.52:41400) 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb82e59c640 1 -- 172.21.15.52:0/3061172524 learned_addr learned my addr 172.21.15.52:0/3061172524 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.621+0000 7fb827fff640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 -- 172.21.15.52:0/3061172524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 msgr2=0x555f4d8b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 -- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 msgr2=0x555f4d8b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 -- 172.21.15.52:0/3061172524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4d5833c0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb82e59c640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb8200108a0 tx=0x7fb820019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1158b22966f91e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82001d040 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb8200109c0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb820018b20 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb820010bc0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb836eb3740 10 client.19890 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f4d8c5ae0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.622+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb820018b20 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb820020030 con 0x555f4d8ac5d0 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 10 client.19890 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:30.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 10 client.19890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 20 client.19890 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d8c6f80 0x555f4d8c9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 4 client.19890 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:30.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f4d81f860 con 0x555f4d8c6f80 2024-09-19T09:33:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb827fff640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d8c6f80 0x555f4d8c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb827fff640 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d8c6f80 0x555f4d8c9370 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ac5472210763c4 server_cookie=7d36df6dc633a87b in_seq=0 out_seq=0 2024-09-19T09:33:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.623+0000 7fb815ffb640 10 client.19890 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:30.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb815ffb640 1 -- 172.21.15.52:0/3061172524 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f4d81f860 con 0x555f4d8c6f80 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb815ffb640 10 client.19890 handle_command_reply: tid=0 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 client.19890 shutdown 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 msgr2=0x555f4d8b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fb8200108a0 tx=0x7fb820019f10 comp rx=0 tx=0).stop 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 shutdown_connections 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d8c6f80 0x555f4d8c9370 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8b7370 0x555f4d8b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8adb40 0x555f4d8b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 --2- 172.21.15.52:0/3061172524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8ac5d0 0x555f4d8b6d40 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 >> 172.21.15.52:0/3061172524 conn(0x555f4d875310 msgr2=0x555f4d8ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb815ffb640 0 client.19890 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 shutdown_connections 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.624+0000 7fb836eb3740 1 -- 172.21.15.52:0/3061172524 wait complete. 2024-09-19T09:33:30.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.625+0000 7fb836eb3740 20 client.19890 trim_cache size 0 max 16384 2024-09-19T09:33:30.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 Processor -- start 2024-09-19T09:33:30.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 -- start start 2024-09-19T09:33:30.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8ac5d0 0x555f4d8a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8b7370 0x555f4d8af660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b6610 con 0x555f4d8adb40 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b3ee0 con 0x555f4d8ac5d0 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb836eb3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b1d30 con 0x555f4d8b7370 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb827fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb827fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41416/0 (socket says 172.21.15.52:41416) 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.638+0000 7fb827fff640 1 -- 172.21.15.52:0/1531431964 learned_addr learned my addr 172.21.15.52:0/1531431964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb82e59c640 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8ac5d0 0x555f4d8a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8b7370 0x555f4d8af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 -- 172.21.15.52:0/1531431964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8b7370 msgr2=0x555f4d8af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8b7370 0x555f4d8af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 -- 172.21.15.52:0/1531431964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8ac5d0 msgr2=0x555f4d8a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8ac5d0 0x555f4d8a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 -- 172.21.15.52:0/1531431964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4d8b2560 con 0x555f4d8adb40 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb827fff640 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb8180045b0 tx=0x7fb81803b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c655a3a9279ab6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb817fff640 1 -- 172.21.15.52:0/1531431964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818049040 con 0x555f4d8adb40 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb817fff640 1 -- 172.21.15.52:0/1531431964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8180a70b0 con 0x555f4d8adb40 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.639+0000 7fb817fff640 1 -- 172.21.15.52:0/1531431964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8180babb0 con 0x555f4d8adb40 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- 172.21.15.52:0/1531431964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 msgr2=0x555f4d8af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fb8180045b0 tx=0x7fb81803b790 comp rx=0 tx=0).stop 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- 172.21.15.52:0/1531431964 shutdown_connections 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8b7370 0x555f4d8af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8adb40 0x555f4d8af120 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 --2- 172.21.15.52:0/1531431964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8ac5d0 0x555f4d8a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- 172.21.15.52:0/1531431964 >> 172.21.15.52:0/1531431964 conn(0x555f4d875310 msgr2=0x555f4d8b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- 172.21.15.52:0/1531431964 shutdown_connections 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- 172.21.15.52:0/1531431964 wait complete. 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.640+0000 7fb836eb3740 1 -- start start 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 Processor -- start 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 0x555f4d8cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8adb40 0x555f4d8c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b23a0 con 0x555f4d8b7370 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b3810 con 0x555f4d8adb40 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8301b2a70 con 0x555f4d8ac5d0 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb836eb3740 10 client.0 _ll_register_callbacks cb 0x7fb82001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41430/0 (socket says 172.21.15.52:41430) 2024-09-19T09:33:30.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 -- 172.21.15.52:0/2146448600 learned_addr learned my addr 172.21.15.52:0/2146448600 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb827fff640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8adb40 0x555f4d8c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82e59c640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 0x555f4d8cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 -- 172.21.15.52:0/2146448600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 msgr2=0x555f4d8cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 0x555f4d8cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 -- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8adb40 msgr2=0x555f4d8c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8adb40 0x555f4d8c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82ed9d640 1 -- 172.21.15.52:0/2146448600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4d8ca680 con 0x555f4d8b7370 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.641+0000 7fb82e59c640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 0x555f4d8cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb82ed9d640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fb828010ff0 tx=0x7fb828005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71020693b3f51d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:30.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828003e00 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb828004750 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8180a70b0 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb82802f020 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 10 client.19896 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f4d931830 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8180a70b0 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb828005810 con 0x555f4d8b7370 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 10 client.19896 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 10 client.19896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 20 client.19896 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d931fb0 0x555f4d9343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 4 client.19896 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:33:30.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.642+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f4d819d70 con 0x555f4d931fb0 2024-09-19T09:33:30.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb82e59c640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d931fb0 0x555f4d9343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb82e59c640 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d931fb0 0x555f4d9343d0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf27806c1825c832 server_cookie=c9ab517476378887 in_seq=0 out_seq=0 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb815ffb640 10 client.19896 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb815ffb640 1 -- 172.21.15.52:0/2146448600 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f4d819d70 con 0x555f4d931fb0 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb815ffb640 10 client.19896 handle_command_reply: tid=0 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 client.19896 shutdown 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 msgr2=0x555f4d8c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fb828010ff0 tx=0x7fb828005c50 comp rx=0 tx=0).stop 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 shutdown_connections 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555f4d931fb0 0x555f4d9343d0 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f4d8b7370 0x555f4d8c9e70 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f4d8adb40 0x555f4d8c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 --2- 172.21.15.52:0/2146448600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f4d8ac5d0 0x555f4d8cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 >> 172.21.15.52:0/2146448600 conn(0x555f4d875310 msgr2=0x555f4d8c2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb815ffb640 0 client.19896 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 shutdown_connections 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.643+0000 7fb836eb3740 1 -- 172.21.15.52:0/2146448600 wait complete. 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb836eb3740 20 client.19896 trim_cache size 0 max 16384 2024-09-19T09:33:30.651 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 msgr2=0x7fb81c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 0x7fb81c0a5700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb828007330 tx=0x7fb828007610 comp rx=0 tx=0).stop 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 msgr2=0x7fb8301a4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fb818005ab0 tx=0x7fb8180042f0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 shutdown_connections 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb830112b90 0x7fb83019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb830074eb0 0x7fb8301a4b90 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb81c0a3240 0x7fb81c0a5700 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 --2- 172.21.15.52:0/3890600503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb830074590 0x7fb8301a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 >> 172.21.15.52:0/3890600503 conn(0x7fb8300fd8c0 msgr2=0x7fb8300fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 shutdown_connections 2024-09-19T09:33:30.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:30.644+0000 7fb834ada640 1 -- 172.21.15.52:0/3890600503 wait complete. 2024-09-19T09:33:30.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:30 smithi052 ceph-mon[30947]: pgmap v700: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:30.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:30 smithi169 ceph-mon[35454]: pgmap v700: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:30 smithi086 ceph-mon[34813]: pgmap v700: 97 pgs: 97 active+clean; 2.1 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:32.562 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:33:32.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:33:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:32 smithi052 ceph-mon[30947]: pgmap v701: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:32.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:32 smithi169 ceph-mon[35454]: pgmap v701: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:33.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:32 smithi086 ceph-mon[34813]: pgmap v701: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 -- 172.21.15.52:0/3433036293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 msgr2=0x7ff4c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/3433036293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c810ea90 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009ca0 tx=0x7ff4c002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 -- 172.21.15.52:0/3433036293 shutdown_connections 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/3433036293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c810ea90 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/3433036293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/3433036293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 0x7ff4c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 -- 172.21.15.52:0/3433036293 >> 172.21.15.52:0/3433036293 conn(0x7ff4c80fd8c0 msgr2=0x7ff4c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 -- 172.21.15.52:0/3433036293 shutdown_connections 2024-09-19T09:33:33.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.298+0000 7ff4ceddd640 1 -- 172.21.15.52:0/3433036293 wait complete. 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 Processor -- start 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 -- start start 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 0x7ff4c8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8111f90 con 0x7ff4c8106f10 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8111e10 con 0x7ff4c8101de0 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ceddd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8112110 con 0x7ff4c8102790 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4cd37a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4cd37a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41446/0 (socket says 172.21.15.52:41446) 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4cd37a640 1 -- 172.21.15.52:0/27254855 learned_addr learned my addr 172.21.15.52:0/27254855 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.299+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 0x7ff4c8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 -- 172.21.15.52:0/27254855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 msgr2=0x7ff4c8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 -- 172.21.15.52:0/27254855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 msgr2=0x7ff4c8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 0x7ff4c8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 -- 172.21.15.52:0/27254855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c819d3c0 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4cd37a640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0031a60 tx=0x7ff4c0031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4c5ffb640 1 -- 172.21.15.52:0/27254855 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0003b70 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4c5ffb640 1 -- 172.21.15.52:0/27254855 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4c0003d10 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c819d650 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4c5ffb640 1 -- 172.21.15.52:0/27254855 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0004770 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.300+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81a4f90 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c5ffb640 1 -- 172.21.15.52:0/27254855 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff4c002f790 con 0x7ff4c8106f10 2024-09-19T09:33:33.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 Processor -- start 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 -- start start 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556267dd5280 con 0x556267e7ad40 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556267d7cb10 con 0x556267e6fb60 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556267dd1240 con 0x556267e70480 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c5ffb640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 0x7ff4b80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4ccb79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:44560/0 (socket says 172.21.15.52:44560) 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c7fff640 1 -- 172.21.15.52:0/351093626 learned_addr learned my addr 172.21.15.52:0/351093626 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:33.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.303+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4cd37a640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 0x7ff4b80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c5ffb640 1 -- 172.21.15.52:0/27254855 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff4c00f0ce0 con 0x7ff4c8106f10 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 -- 172.21.15.52:0/351093626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 msgr2=0x556267e7a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 -- 172.21.15.52:0/351093626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 msgr2=0x556267e7d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 -- 172.21.15.52:0/351093626 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556267d891f0 con 0x556267e6fb60 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400bfd0 tx=0x7ff4b400b500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e91f5611ec1dd877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4cd37a640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 0x7ff4b80a5700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00c59c0 tx=0x7ff4c0044f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4b2ffd640 1 -- 172.21.15.52:0/351093626 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4004030 con 0x556267e6fb60 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4b2ffd640 1 -- 172.21.15.52:0/351093626 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b400ee40 con 0x556267e6fb60 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.304+0000 7ff4b2ffd640 1 -- 172.21.15.52:0/351093626 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40039d0 con 0x556267e6fb60 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- 172.21.15.52:0/351093626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 msgr2=0x556267e6ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400bfd0 tx=0x7ff4b400b500 comp rx=0 tx=0).stop 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- 172.21.15.52:0/351093626 shutdown_connections 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/351093626 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e6ff40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- 172.21.15.52:0/351093626 >> 172.21.15.52:0/351093626 conn(0x556267e6c0f0 msgr2=0x556267e6c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- 172.21.15.52:0/351093626 shutdown_connections 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- 172.21.15.52:0/351093626 wait complete. 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.305+0000 7ff4d11b6740 1 -- start start 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 Processor -- start 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 0x556267e78160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e7ad40 0x556267e786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556267e7d910 con 0x556267e6fb60 2024-09-19T09:33:33.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556267d8ff10 con 0x556267e70480 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556267e7da90 con 0x556267e7ad40 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4d11b6740 10 client.0 _ll_register_callbacks cb 0x556267d58a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4ccb79640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 0x556267e78160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41462/0 (socket says 172.21.15.52:41462) 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3374734713 learned_addr learned my addr 172.21.15.52:0/3374734713 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.306+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e7ad40 0x556267e786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3374734713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e7ad40 msgr2=0x556267e786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e7ad40 0x556267e786a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 msgr2=0x556267e78160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 0x556267e78160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3374734713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556267b466a0 con 0x556267e6fb60 2024-09-19T09:33:33.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 0x556267e78160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40057c0 tx=0x7ff4b4003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad65f0e7c9c0d878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400eb60 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff4b4003770 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b400ee40 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4b4003970 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4d11b6740 10 client.19908 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556267e89510 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b400ee40 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.307+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff4b40116a0 con 0x556267e6fb60 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 10 client.19908 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 10 client.19908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 20 client.19908 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267e8a8c0 0x556267e8ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 4 client.19908 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556267de27f0 con 0x556267e8a8c0 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267e8a8c0 0x556267e8ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267e8a8c0 0x556267e8ccb0 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62442bf74a35c770 server_cookie=a9f0122bf8b48039 in_seq=0 out_seq=0 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.308+0000 7ff4a7fff640 10 client.19908 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4a7fff640 1 -- 172.21.15.52:0/3374734713 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556267de27f0 con 0x556267e8a8c0 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4a7fff640 10 client.19908 handle_command_reply: tid=0 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 client.19908 shutdown 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 msgr2=0x556267e77c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff4b40057c0 tx=0x7ff4b4003690 comp rx=0 tx=0).stop 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 shutdown_connections 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267e8a8c0 0x556267e8ccb0 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e7ad40 0x556267e786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e70480 0x556267e78160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4a7fff640 0 client.19908 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3374734713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e77c20 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 >> 172.21.15.52:0/3374734713 conn(0x556267e6c0f0 msgr2=0x556267e71dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 shutdown_connections 2024-09-19T09:33:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3374734713 wait complete. 2024-09-19T09:33:33.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.309+0000 7ff4d11b6740 20 client.19908 trim_cache size 0 max 16384 2024-09-19T09:33:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 Processor -- start 2024-09-19T09:33:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 -- start start 2024-09-19T09:33:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e923f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e7ad40 0x556267e92930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81affd0 con 0x556267e6fb60 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81ad8a0 con 0x556267e7ad40 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81ab6f0 con 0x556267e70480 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41470/0 (socket says 172.21.15.52:41470) 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3924460757 learned_addr learned my addr 172.21.15.52:0/3924460757 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3924460757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 msgr2=0x556267e923f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e923f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3924460757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e7ad40 msgr2=0x556267e92930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e7ad40 0x556267e92930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.327+0000 7ff4c7fff640 1 -- 172.21.15.52:0/3924460757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556267e6bf20 con 0x556267e6fb60 2024-09-19T09:33:33.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4011aa0 tx=0x7ff4b40134e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fd94ecde851b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4b27fc640 1 -- 172.21.15.52:0/3924460757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011440 con 0x556267e6fb60 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4b27fc640 1 -- 172.21.15.52:0/3924460757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b400ee40 con 0x556267e6fb60 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4b27fc640 1 -- 172.21.15.52:0/3924460757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40118b0 con 0x556267e6fb60 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3924460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 msgr2=0x556267e76ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.328+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4011aa0 tx=0x7ff4b40134e0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3924460757 shutdown_connections 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e7ad40 0x556267e92930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e923f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/3924460757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e6fb60 0x556267e76ad0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3924460757 >> 172.21.15.52:0/3924460757 conn(0x556267e6c0f0 msgr2=0x556267e763c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3924460757 shutdown_connections 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 -- 172.21.15.52:0/3924460757 wait complete. 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 -- start start 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.329+0000 7ff4d11b6740 1 Processor -- start 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e83310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81abd60 con 0x556267e7ad40 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81ad1d0 con 0x556267e6fb60 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81ac430 con 0x556267e70480 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 10 client.0 _ll_register_callbacks cb 0x7ff4b400bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41484/0 (socket says 172.21.15.52:41484) 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 -- 172.21.15.52:0/2102216268 learned_addr learned my addr 172.21.15.52:0/2102216268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e83310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 -- 172.21.15.52:0/2102216268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 msgr2=0x556267e7e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 -- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 msgr2=0x556267e83310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e83310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 -- 172.21.15.52:0/2102216268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556267e7f270 con 0x556267e7ad40 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4c7fff640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4013580 tx=0x7ff4b40116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6070cdcd19ed0f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4011790 con 0x556267e7ad40 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff4b400e960 con 0x556267e7ad40 2024-09-19T09:33:33.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.330+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4b400ee40 con 0x556267e7ad40 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff4b4048020 con 0x556267e7ad40 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 10 client.19914 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556267ef52e0 con 0x556267e7ad40 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4b400ee40 con 0x556267e7ad40 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff4b4042040 con 0x556267e7ad40 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 10 client.19914 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 10 client.19914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 20 client.19914 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267ef58f0 0x556267ef7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 4 client.19914 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556267ddcd00 con 0x556267ef58f0 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.331+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267ef58f0 0x556267ef7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:33.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.332+0000 7ff4ccb79640 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267ef58f0 0x556267ef7ce0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a11feb0fe88f107 server_cookie=d96f9302f27e7764 in_seq=0 out_seq=0 2024-09-19T09:33:33.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.332+0000 7ff4a7fff640 10 client.19914 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4a7fff640 1 -- 172.21.15.52:0/2102216268 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556267ddcd00 con 0x556267ef58f0 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4a7fff640 10 client.19914 handle_command_reply: tid=0 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 client.19914 shutdown 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 msgr2=0x556267e7eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4013580 tx=0x7ff4b40116f0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 shutdown_connections 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556267ef58f0 0x556267ef7ce0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556267e7ad40 0x556267e7eb80 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556267e70480 0x556267e7e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 --2- 172.21.15.52:0/2102216268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556267e6fb60 0x556267e83310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4a7fff640 0 client.19914 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 >> 172.21.15.52:0/2102216268 conn(0x556267e6c0f0 msgr2=0x556267e78400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 shutdown_connections 2024-09-19T09:33:33.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 1 -- 172.21.15.52:0/2102216268 wait complete. 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.333+0000 7ff4d11b6740 20 client.19914 trim_cache size 0 max 16384 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "4316ff06-810c-4724-b8c6-bda23f728ebf", 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:33:33.340 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 msgr2=0x7ff4b80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 0x7ff4b80a5700 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00c59c0 tx=0x7ff4c0044f90 comp rx=0 tx=0).stop 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 msgr2=0x7ff4c819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0031a60 tx=0x7ff4c0031a90 comp rx=0 tx=0).stop 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 shutdown_connections 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4c8106f10 0x7ff4c819cce0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4b80a3240 0x7ff4b80a5700 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff4c8102790 0x7ff4c8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 --2- 172.21.15.52:0/27254855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4c8101de0 0x7ff4c8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 >> 172.21.15.52:0/27254855 conn(0x7ff4c80fd8c0 msgr2=0x7ff4c80ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 shutdown_connections 2024-09-19T09:33:33.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:33.334+0000 7ff4ceddd640 1 -- 172.21.15.52:0/27254855 wait complete. 2024-09-19T09:33:33.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:33 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:33:33.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:33 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:33.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:33 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:33:33.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:33 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:33.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:33 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:33:33.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:33 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:33.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:33 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:33:33.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:33 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:34.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:33 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:33:34.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:33 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:34.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:33 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:33:34.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:33 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:33:34.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:33:34.491 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:34.899 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:34 smithi052 ceph-mon[30947]: pgmap v702: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:34.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:34 smithi169 ceph-mon[35454]: pgmap v702: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:35.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 -- 172.21.15.52:0/1692924659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80101de0 msgr2=0x7f9e801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 --2- 172.21.15.52:0/1692924659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80101de0 0x7f9e801021c0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009900 tx=0x7f9e7c02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 -- 172.21.15.52:0/1692924659 shutdown_connections 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 --2- 172.21.15.52:0/1692924659 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80106f10 0x7f9e8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 --2- 172.21.15.52:0/1692924659 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80102790 0x7f9e801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 --2- 172.21.15.52:0/1692924659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80101de0 0x7f9e801021c0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 -- 172.21.15.52:0/1692924659 >> 172.21.15.52:0/1692924659 conn(0x7f9e800fd8c0 msgr2=0x7f9e800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 -- 172.21.15.52:0/1692924659 shutdown_connections 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.981+0000 7f9e878e3640 1 -- 172.21.15.52:0/1692924659 wait complete. 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 Processor -- start 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 -- start start 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 0x7f9e801983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80106f10 0x7f9e8019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80111f70 con 0x7f9e80102790 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e80111df0 con 0x7f9e80106f10 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e878e3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801120f0 con 0x7f9e80101de0 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e84e7e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e84e7e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41500/0 (socket says 172.21.15.52:41500) 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e84e7e640 1 -- 172.21.15.52:0/3945222203 learned_addr learned my addr 172.21.15.52:0/3945222203 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e85e80640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80106f10 0x7f9e8019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.982+0000 7f9e8567f640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 0x7f9e801983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 -- 172.21.15.52:0/3945222203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 msgr2=0x7f9e801983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 0x7f9e801983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 -- 172.21.15.52:0/3945222203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80106f10 msgr2=0x7f9e8019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80106f10 0x7f9e8019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 -- 172.21.15.52:0/3945222203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8019d380 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e8567f640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 0x7f9e801983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000d950 tx=0x7f9e7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e767fc640 1 -- 172.21.15.52:0/3945222203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70017070 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8019d670 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e767fc640 1 -- 172.21.15.52:0/3945222203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e70009c30 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e767fc640 1 -- 172.21.15.52:0/3945222203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000f6b0 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.983+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e801a4f50 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.986+0000 7f9e767fc640 1 -- 172.21.15.52:0/3945222203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e700109d0 con 0x7f9e80102790 2024-09-19T09:33:35.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.986+0000 7f9e89cbc740 1 Processor -- start 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.986+0000 7f9e89cbc740 1 -- start start 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 0x55f2594dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f2594362e0 con 0x55f2594d0dc0 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f2593ddce0 con 0x55f2594db680 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f2594322a0 con 0x55f2594d04a0 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41504/0 (socket says 172.21.15.52:41504) 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 -- 172.21.15.52:0/3042920795 learned_addr learned my addr 172.21.15.52:0/3042920795 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e767fc640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 0x55f2594dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e85e80640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 -- 172.21.15.52:0/3042920795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 msgr2=0x55f2594d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 -- 172.21.15.52:0/3042920795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 msgr2=0x55f2594dda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e767fc640 1 -- 172.21.15.52:0/3945222203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9e700cf600 con 0x7f9e80102790 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 0x55f2594dda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 -- 172.21.15.52:0/3042920795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2593c2440 con 0x55f2594d0dc0 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e85e80640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 0x55f2594dda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e85e80640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.987+0000 7f9e8567f640 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c031550 tx=0x7f9e7c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4874ce4ab78920a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e6b7fe640 1 -- 172.21.15.52:0/3042920795 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c03f070 con 0x55f2594d0dc0 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e6b7fe640 1 -- 172.21.15.52:0/3042920795 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e7c0317b0 con 0x55f2594d0dc0 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e6b7fe640 1 -- 172.21.15.52:0/3042920795 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c035070 con 0x55f2594d0dc0 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 -- 172.21.15.52:0/3042920795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 msgr2=0x55f2594db140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e85e80640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007e90 tx=0x7f9e78004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c031550 tx=0x7f9e7c032cd0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 -- 172.21.15.52:0/3042920795 shutdown_connections 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594db680 0x55f2594dda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594db140 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/3042920795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 -- 172.21.15.52:0/3042920795 >> 172.21.15.52:0/3042920795 conn(0x55f2594cca30 msgr2=0x55f2594cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 -- 172.21.15.52:0/3042920795 shutdown_connections 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.988+0000 7f9e89cbc740 1 -- 172.21.15.52:0/3042920795 wait complete. 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 -- start start 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 Processor -- start 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594db680 0x55f2594d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f2594de250 con 0x55f2594d04a0 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55f2593f1050 con 0x55f2594d0dc0 2024-09-19T09:33:35.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55f2594de3d0 con 0x55f2594db680 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e89cbc740 10 client.0 _ll_register_callbacks cb 0x55f259431160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41516/0 (socket says 172.21.15.52:41516) 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.989+0000 7f9e8567f640 1 -- 172.21.15.52:0/2595730080 learned_addr learned my addr 172.21.15.52:0/2595730080 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e85e80640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594db680 0x55f2594d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 -- 172.21.15.52:0/2595730080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594db680 msgr2=0x55f2594d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594db680 0x55f2594d8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 -- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 msgr2=0x55f2594d8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 -- 172.21.15.52:0/2595730080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2591a73c0 con 0x55f2594d04a0 2024-09-19T09:33:35.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e8567f640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005400 tx=0x7f9e7c02ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae19377cbab17f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c035030 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e7c0317b0 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9e7c0048c0 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e7c03f070 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e89cbc740 10 client.19926 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2594e9a50 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.990+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e7c0317b0 con 0x55f2594d04a0 2024-09-19T09:33:35.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e7c03bbc0 con 0x55f2594d04a0 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 10 client.19926 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 10 client.19926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 20 client.19926 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594eada0 0x55f2594ed190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 4 client.19926 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f259443850 con 0x55f2594eada0 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594eada0 0x55f2594ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594eada0 0x55f2594ed190 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a577910e83cd109c server_cookie=65231c9ab3cb0425 in_seq=0 out_seq=0 2024-09-19T09:33:35.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.991+0000 7f9e68ff9640 10 client.19926 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:35.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e68ff9640 1 -- 172.21.15.52:0/2595730080 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f259443850 con 0x55f2594eada0 2024-09-19T09:33:35.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e68ff9640 10 client.19926 handle_command_reply: tid=0 2024-09-19T09:33:35.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 client.19926 shutdown 2024-09-19T09:33:35.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 msgr2=0x55f2594dae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c005400 tx=0x7f9e7c02ab80 comp rx=0 tx=0).stop 2024-09-19T09:33:35.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 shutdown_connections 2024-09-19T09:33:35.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594eada0 0x55f2594ed190 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594db680 0x55f2594d8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/2595730080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d04a0 0x55f2594dae60 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 >> 172.21.15.52:0/2595730080 conn(0x55f2594cca30 msgr2=0x55f2594cbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e68ff9640 0 client.19926 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:35.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.992+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 shutdown_connections 2024-09-19T09:33:35.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.993+0000 7f9e89cbc740 1 -- 172.21.15.52:0/2595730080 wait complete. 2024-09-19T09:33:35.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:34.993+0000 7f9e89cbc740 20 client.19926 trim_cache size 0 max 16384 2024-09-19T09:33:35.023 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:34 smithi086 ceph-mon[34813]: pgmap v702: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 Processor -- start 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 -- start start 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801b0000 con 0x55f2594cca30 2024-09-19T09:33:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801ad8d0 con 0x55f2594d0dc0 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801ab720 con 0x55f2594d04a0 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e8567f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41530/0 (socket says 172.21.15.52:41530) 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e8567f640 1 -- 172.21.15.52:0/4071859727 learned_addr learned my addr 172.21.15.52:0/4071859727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.010+0000 7f9e85e80640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 -- 172.21.15.52:0/4071859727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 msgr2=0x55f2594ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 -- 172.21.15.52:0/4071859727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 msgr2=0x55f2594d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 -- 172.21.15.52:0/4071859727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2594db1d0 con 0x55f2594cca30 2024-09-19T09:33:35.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e85e80640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e8567f640 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c000c00 tx=0x7f9e7c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e18a0460d243178 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e6affd640 1 -- 172.21.15.52:0/4071859727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c035070 con 0x55f2594cca30 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e6affd640 1 -- 172.21.15.52:0/4071859727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e7c04c070 con 0x55f2594cca30 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.011+0000 7f9e6affd640 1 -- 172.21.15.52:0/4071859727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c004e80 con 0x55f2594cca30 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- 172.21.15.52:0/4071859727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 msgr2=0x55f2594d3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c000c00 tx=0x7f9e7c005b50 comp rx=0 tx=0).stop 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- 172.21.15.52:0/4071859727 shutdown_connections 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594d0dc0 0x55f2594d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/4071859727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594cca30 0x55f2594d3900 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- 172.21.15.52:0/4071859727 >> 172.21.15.52:0/4071859727 conn(0x55f2594d87b0 msgr2=0x55f2594d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- 172.21.15.52:0/4071859727 shutdown_connections 2024-09-19T09:33:35.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- 172.21.15.52:0/4071859727 wait complete. 2024-09-19T09:33:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 -- start start 2024-09-19T09:33:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.012+0000 7f9e89cbc740 1 Processor -- start 2024-09-19T09:33:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 0x55f2594e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801abd90 con 0x55f2594d0dc0 2024-09-19T09:33:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801ad200 con 0x55f2594cca30 2024-09-19T09:33:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e801ac460 con 0x55f2594d04a0 2024-09-19T09:33:35.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e89cbc740 10 client.0 _ll_register_callbacks cb 0x7f9e7c005180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41532/0 (socket says 172.21.15.52:41532) 2024-09-19T09:33:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 -- 172.21.15.52:0/1616176019 learned_addr learned my addr 172.21.15.52:0/1616176019 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e84e7e640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e8567f640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 0x55f2594e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 -- 172.21.15.52:0/1616176019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 msgr2=0x55f2594e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 -- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 msgr2=0x55f2594e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 0x55f2594e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 -- 172.21.15.52:0/1616176019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2594dc890 con 0x55f2594d0dc0 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e8567f640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 0x55f2594e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:35.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e85e80640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f9e78012d20 tx=0x7f9e78007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e6adc7339d1567 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.013+0000 7f9e68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78012e10 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9e78012260 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e7c04c070 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e78011440 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 10 client.19932 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2594e3200 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e7c04c070 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9e78018040 con 0x55f2594d0dc0 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 10 client.19932 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 10 client.19932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 20 client.19932 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594db680 0x55f259557a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 4 client.19932 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:33:35.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.014+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f2594ed580 con 0x55f2594db680 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e8567f640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594db680 0x55f259557a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e68ff9640 10 client.19932 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e8567f640 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594db680 0x55f259557a60 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c207538e55e3288f server_cookie=f2a33349a66f3ac4 in_seq=0 out_seq=0 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e68ff9640 1 -- 172.21.15.52:0/1616176019 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f2594ed580 con 0x55f2594db680 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e68ff9640 10 client.19932 handle_command_reply: tid=0 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 client.19932 shutdown 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 msgr2=0x55f2594dc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f9e78012d20 tx=0x7f9e78007520 comp rx=0 tx=0).stop 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 shutdown_connections 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55f2594db680 0x55f259557a60 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f2594d0dc0 0x55f2594dc060 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55f2594d04a0 0x55f2594e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 --2- 172.21.15.52:0/1616176019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55f2594cca30 0x55f2594e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e68ff9640 0 client.19932 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 >> 172.21.15.52:0/1616176019 conn(0x55f2594d87b0 msgr2=0x55f2594d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 shutdown_connections 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.015+0000 7f9e89cbc740 1 -- 172.21.15.52:0/1616176019 wait complete. 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e89cbc740 20 client.19932 trim_cache size 0 max 16384 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:35.038 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: "4316ff06-810c-4724-b8c6-bda23f728ebf": { 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "4316ff06-810c-4724-b8c6-bda23f728ebf", 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:35.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 msgr2=0x7f9e6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007e90 tx=0x7f9e78004a40 comp rx=0 tx=0).stop 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 msgr2=0x7f9e80198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000d950 tx=0x7f9e7000de10 comp rx=0 tx=0).stop 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 shutdown_connections 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e80106f10 0x7f9e8019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e80102790 0x7f9e80198910 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e6c0a3240 0x7f9e6c0a5700 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 --2- 172.21.15.52:0/3945222203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e80101de0 0x7f9e801983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:35.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 >> 172.21.15.52:0/3945222203 conn(0x7f9e800fd8c0 msgr2=0x7f9e800febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:35.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 shutdown_connections 2024-09-19T09:33:35.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:35.016+0000 7f9e878e3640 1 -- 172.21.15.52:0/3945222203 wait complete. 2024-09-19T09:33:35.633 INFO:tasks.cephfs.filesystem:scrub status for tag:4316ff06-810c-4724-b8c6-bda23f728ebf - {'path': '/', 'tag': '4316ff06-810c-4724-b8c6-bda23f728ebf', 'options': 'recursive,force'} 2024-09-19T09:33:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 -- 172.21.15.52:0/3140072264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a41025d0 msgr2=0x7f56a41049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 --2- 172.21.15.52:0/3140072264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a41025d0 0x7f56a41049c0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009900 tx=0x7f56a002a410 comp rx=0 tx=0).stop 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 -- 172.21.15.52:0/3140072264 shutdown_connections 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 --2- 172.21.15.52:0/3140072264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a4107830 0x7f56a4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 --2- 172.21.15.52:0/3140072264 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 0x7f56a41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 --2- 172.21.15.52:0/3140072264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a41025d0 0x7f56a41049c0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 -- 172.21.15.52:0/3140072264 >> 172.21.15.52:0/3140072264 conn(0x7f56a40fc1b0 msgr2=0x7f56a40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 -- 172.21.15.52:0/3140072264 shutdown_connections 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.659+0000 7f56abeac640 1 -- 172.21.15.52:0/3140072264 wait complete. 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 Processor -- start 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 -- start start 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a41025d0 0x7f56a4101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 0x7f56a4100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56a410d830 con 0x7f56a4107830 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56a410d6b0 con 0x7f56a41025d0 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56abeac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56a410d9b0 con 0x7f56a4104f00 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41542/0 (socket says 172.21.15.52:41542) 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56aa449640 1 -- 172.21.15.52:0/904794150 learned_addr learned my addr 172.21.15.52:0/904794150 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56a9c48640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a41025d0 0x7f56a4101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.660+0000 7f56a9447640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 0x7f56a4100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 -- 172.21.15.52:0/904794150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 msgr2=0x7f56a4100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 0x7f56a4100580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 -- 172.21.15.52:0/904794150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a41025d0 msgr2=0x7f56a4101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a41025d0 0x7f56a4101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 -- 172.21.15.52:0/904794150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4101350 con 0x7f56a4107830 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56aa449640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ccb0 tx=0x7f569c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f569affd640 1 -- 172.21.15.52:0/904794150 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c00f450 con 0x7f56a4107830 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f569affd640 1 -- 172.21.15.52:0/904794150 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f569c00fad0 con 0x7f56a4107830 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a41a1f20 con 0x7f56a4107830 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f569affd640 1 -- 172.21.15.52:0/904794150 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c018bf0 con 0x7f56a4107830 2024-09-19T09:33:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.661+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a41a2330 con 0x7f56a4107830 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f569affd640 1 -- 172.21.15.52:0/904794150 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f569c00f5f0 con 0x7f56a4107830 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 Processor -- start 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 -- start start 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef5907ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59082830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ef58fde2f0 con 0x55ef5907b2e0 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ef58f86270 con 0x55ef5907a9a0 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56aec4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ef58fda2b0 con 0x55ef59080370 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41554/0 (socket says 172.21.15.52:41554) 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 -- 172.21.15.52:0/1055212793 learned_addr learned my addr 172.21.15.52:0/1055212793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9447640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59082830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9447640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef5907ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 -- 172.21.15.52:0/1055212793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 msgr2=0x55ef59082830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59082830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 -- 172.21.15.52:0/1055212793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 msgr2=0x55ef5907ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef5907ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.674 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 -- 172.21.15.52:0/1055212793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef58f85340 con 0x55ef5907b2e0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9447640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef5907ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f569affd640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 0x7f56900a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9447640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 0x7f56900a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f56a9c48640 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f56a0031610 tx=0x7f56a0032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cd535086ffb6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f569affd640 1 -- 172.21.15.52:0/904794150 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f569c0d00b0 con 0x7f56a4107830 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f568ffff640 1 -- 172.21.15.52:0/1055212793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0040070 con 0x55ef5907b2e0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f568ffff640 1 -- 172.21.15.52:0/1055212793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a00318b0 con 0x55ef5907b2e0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.665+0000 7f568ffff640 1 -- 172.21.15.52:0/1055212793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0035040 con 0x55ef5907b2e0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 -- 172.21.15.52:0/1055212793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 msgr2=0x55ef5907fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56a9447640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 0x7f56900a57b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f569400efd0 tx=0x7f5694004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f56a0031610 tx=0x7f56a0032d70 comp rx=0 tx=0).stop 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 -- 172.21.15.52:0/1055212793 shutdown_connections 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59082830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907b2e0 0x55ef5907fda0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 --2- 172.21.15.52:0/1055212793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef5907ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 -- 172.21.15.52:0/1055212793 >> 172.21.15.52:0/1055212793 conn(0x55ef59076010 msgr2=0x55ef59076410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 -- 172.21.15.52:0/1055212793 shutdown_connections 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.666+0000 7f56aec4a740 1 -- 172.21.15.52:0/1055212793 wait complete. 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 -- start start 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 Processor -- start 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef59084b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef590850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ef590832e0 con 0x55ef59080370 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ef58f67290 con 0x55ef5907a9a0 2024-09-19T09:33:36.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ef59083460 con 0x55ef5907b2e0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aec4a740 10 client.0 _ll_register_callbacks cb 0x55ef58f98140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41556/0 (socket says 172.21.15.52:41556) 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56aa449640 1 -- 172.21.15.52:0/884732669 learned_addr learned my addr 172.21.15.52:0/884732669 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56a9447640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef590850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.667+0000 7f56a9c48640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef59084b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 -- 172.21.15.52:0/884732669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 msgr2=0x55ef590850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef590850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 -- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 msgr2=0x55ef59084b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef59084b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 -- 172.21.15.52:0/884732669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef58cf1210 con 0x55ef59080370 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aa449640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f569c098ab0 tx=0x7f569c09ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ec50154f4c9a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f568d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c0b4020 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f569c00fc80 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a00318b0 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f569c066050 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aec4a740 10 client.19944 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef58dbd620 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.668+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a00318b0 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f569c067240 con 0x55ef59080370 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 10 client.19944 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 10 client.19944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 20 client.19944 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef59090890 0x55ef59092d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.678 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 4 client.19944 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef58feba20 con 0x55ef59090890 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.669+0000 7f56a9c48640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef59090890 0x55ef59092d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56a9c48640 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef59090890 0x55ef59092d00 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69fddea80c540987 server_cookie=579f256ac427f268 in_seq=0 out_seq=0 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f568d7fa640 10 client.19944 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f568d7fa640 1 -- 172.21.15.52:0/884732669 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef58feba20 con 0x55ef59090890 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f568d7fa640 10 client.19944 handle_command_reply: tid=0 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 client.19944 shutdown 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 msgr2=0x55ef5908c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f569c098ab0 tx=0x7f569c09ce10 comp rx=0 tx=0).stop 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 shutdown_connections 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef59090890 0x55ef59092d00 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908c0f0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.679 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef590850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f568d7fa640 0 client.19944 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 --2- 172.21.15.52:0/884732669 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef59084b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 >> 172.21.15.52:0/884732669 conn(0x55ef59076010 msgr2=0x55ef59077820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 shutdown_connections 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 1 -- 172.21.15.52:0/884732669 wait complete. 2024-09-19T09:33:36.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.671+0000 7f56aec4a740 20 client.19944 trim_cache size 0 max 16384 2024-09-19T09:33:36.688 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 Processor -- start 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 -- start start 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907b2e0 0x55ef5908c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59077400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41adc30 con 0x55ef5907a9a0 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41ab500 con 0x55ef5907b2e0 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56aec4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41a9350 con 0x55ef59080370 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41570/0 (socket says 172.21.15.52:41570) 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 -- 172.21.15.52:0/4042819974 learned_addr learned my addr 172.21.15.52:0/4042819974 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 -- 172.21.15.52:0/4042819974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 msgr2=0x55ef59077400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59077400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9447640 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907b2e0 0x55ef5908c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 -- 172.21.15.52:0/4042819974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907b2e0 msgr2=0x55ef5908c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907b2e0 0x55ef5908c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 -- 172.21.15.52:0/4042819974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef590712d0 con 0x55ef5907a9a0 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f56a9c48640 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009900 tx=0x7f56a0032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3275bf26d717726 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.686+0000 7f568f7fe640 1 -- 172.21.15.52:0/4042819974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0035040 con 0x55ef5907a9a0 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f568f7fe640 1 -- 172.21.15.52:0/4042819974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a00035f0 con 0x55ef5907a9a0 2024-09-19T09:33:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f568f7fe640 1 -- 172.21.15.52:0/4042819974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0040040 con 0x55ef5907a9a0 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- 172.21.15.52:0/4042819974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 msgr2=0x55ef59076ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009900 tx=0x7f56a0032f60 comp rx=0 tx=0).stop 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- 172.21.15.52:0/4042819974 shutdown_connections 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef59080370 0x55ef59077400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907b2e0 0x55ef5908c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 --2- 172.21.15.52:0/4042819974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef5907a9a0 0x55ef59076ec0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- 172.21.15.52:0/4042819974 >> 172.21.15.52:0/4042819974 conn(0x55ef59076010 msgr2=0x55ef59084b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- 172.21.15.52:0/4042819974 shutdown_connections 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- 172.21.15.52:0/4042819974 wait complete. 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.687+0000 7f56aec4a740 1 -- start start 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 Processor -- start 2024-09-19T09:33:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef590894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef59089a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41a99c0 con 0x55ef59080370 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41aae30 con 0x55ef5907a9a0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41aa090 con 0x55ef5907b2e0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aec4a740 10 client.0 _ll_register_callbacks cb 0x7f569c098230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41584/0 (socket says 172.21.15.52:41584) 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 -- 172.21.15.52:0/2165446429 learned_addr learned my addr 172.21.15.52:0/2165446429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56a9c48640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef590894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56a9447640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef59089a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 -- 172.21.15.52:0/2165446429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 msgr2=0x55ef59089a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef59089a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 -- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 msgr2=0x55ef590894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.688+0000 7f56aa449640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef590894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aa449640 1 -- 172.21.15.52:0/2165446429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef5908b020 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aa449640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f569c09c5e0 tx=0x7f569c0a0ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eed712f918fc042 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c0b4070 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f569c0b0b70 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a00035f0 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f569c00f8e0 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 10 client.19950 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef5908c3a0 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56a00035f0 con 0x55ef59080370 2024-09-19T09:33:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f569c09bbc0 con 0x55ef59080370 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 10 client.19950 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 10 client.19950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 20 client.19950 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef590fbba0 0x55ef590fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 4 client.19950 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.689+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ef58fe5d70 con 0x55ef590fbba0 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.690+0000 7f56a9c48640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef590fbba0 0x55ef590fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.690+0000 7f56a9c48640 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef590fbba0 0x55ef590fdf90 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781eab4e6a8873a6 server_cookie=d62c0d4a738c6336 in_seq=0 out_seq=0 2024-09-19T09:33:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.690+0000 7f568d7fa640 10 client.19950 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f568d7fa640 1 -- 172.21.15.52:0/2165446429 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ef58fe5d70 con 0x55ef590fbba0 2024-09-19T09:33:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f568d7fa640 10 client.19950 handle_command_reply: tid=0 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 client.19950 shutdown 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 msgr2=0x55ef5908aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f569c09c5e0 tx=0x7f569c0a0ac0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 shutdown_connections 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ef590fbba0 0x55ef590fdf90 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ef59080370 0x55ef5908aa10 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ef5907b2e0 0x55ef59089a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f568d7fa640 0 client.19950 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 --2- 172.21.15.52:0/2165446429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ef5907a9a0 0x55ef590894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 >> 172.21.15.52:0/2165446429 conn(0x55ef59076010 msgr2=0x55ef590749a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 shutdown_connections 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 1 -- 172.21.15.52:0/2165446429 wait complete. 2024-09-19T09:33:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.703+0000 7f56aec4a740 20 client.19950 trim_cache size 0 max 16384 2024-09-19T09:33:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:33:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:33:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:33:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 msgr2=0x7f56900a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 0x7f56900a57b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f569400efd0 tx=0x7f5694004730 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 msgr2=0x7f56a4100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f569c00ccb0 tx=0x7f569c00a620 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 shutdown_connections 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56a4107830 0x7f56a4100ac0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f56900a32f0 0x7f56900a57b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f56a4104f00 0x7f56a4100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 --2- 172.21.15.52:0/904794150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56a41025d0 0x7f56a4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:36.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 >> 172.21.15.52:0/904794150 conn(0x7f56a40fc1b0 msgr2=0x7f56a4102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 shutdown_connections 2024-09-19T09:33:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:36.704+0000 7f56abeac640 1 -- 172.21.15.52:0/904794150 wait complete. 2024-09-19T09:33:36.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:36 smithi052 ceph-mon[30947]: pgmap v703: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:36.942 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:36 smithi169 ceph-mon[35454]: pgmap v703: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:36 smithi086 ceph-mon[34813]: pgmap v703: 97 pgs: 97 active+clean; 2.2 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: pgmap v704: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:39.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:39.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: pgmap v704: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:39.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:39.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: pgmap v704: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:33:41.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:41 smithi086 ceph-mon[34813]: pgmap v705: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:41.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:41 smithi052 ceph-mon[30947]: pgmap v705: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:41.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:41 smithi169 ceph-mon[35454]: pgmap v705: 97 pgs: 97 active+clean; 2.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:43.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:43 smithi086 ceph-mon[34813]: pgmap v706: 97 pgs: 97 active+clean; 2.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:43.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:43 smithi052 ceph-mon[30947]: pgmap v706: 97 pgs: 97 active+clean; 2.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:43.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:43 smithi169 ceph-mon[35454]: pgmap v706: 97 pgs: 97 active+clean; 2.3 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:45 smithi052 ceph-mon[30947]: pgmap v707: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:45.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:45 smithi169 ceph-mon[35454]: pgmap v707: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:45 smithi086 ceph-mon[34813]: pgmap v707: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:47.387 INFO:tasks.quiescer.fs.[cephfs]:Total duration (44.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:33:47.387 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T09:33:47.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:33:47.416 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:47 smithi052 ceph-mon[30947]: pgmap v708: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:47.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:47 smithi169 ceph-mon[35454]: pgmap v708: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:47 smithi086 ceph-mon[34813]: pgmap v708: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:33:47.659 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 -- 172.21.15.52:0/2261281880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc100e20 msgr2=0x7efdbc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 --2- 172.21.15.52:0/2261281880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc100e20 0x7efdbc101200 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009900 tx=0x7efdb002a480 comp rx=0 tx=0).stop 2024-09-19T09:33:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 -- 172.21.15.52:0/2261281880 shutdown_connections 2024-09-19T09:33:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 --2- 172.21.15.52:0/2261281880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc102ef0 0x7efdbc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 --2- 172.21.15.52:0/2261281880 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102570 0x7efdbc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 --2- 172.21.15.52:0/2261281880 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc100e20 0x7efdbc101200 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 -- 172.21.15.52:0/2261281880 >> 172.21.15.52:0/2261281880 conn(0x7efdbc0fc7d0 msgr2=0x7efdbc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 -- 172.21.15.52:0/2261281880 shutdown_connections 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 -- 172.21.15.52:0/2261281880 wait complete. 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.156+0000 7efdc301f640 1 Processor -- start 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 -- start start 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc100e20 0x7efdbc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102ef0 0x7efdbc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc1120a0 con 0x7efdbc102570 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc111f20 con 0x7efdbc100e20 2024-09-19T09:33:48.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc301f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc112220 con 0x7efdbc102ef0 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59260/0 (socket says 172.21.15.52:59260) 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 -- 172.21.15.52:0/4198625268 learned_addr learned my addr 172.21.15.52:0/4198625268 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc15bc640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102ef0 0x7efdbc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdc0dbb640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc100e20 0x7efdbc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 -- 172.21.15.52:0/4198625268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102ef0 msgr2=0x7efdbc19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102ef0 0x7efdbc19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 -- 172.21.15.52:0/4198625268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc100e20 msgr2=0x7efdbc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc100e20 0x7efdbc1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 -- 172.21.15.52:0/4198625268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc19d570 con 0x7efdbc102570 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.157+0000 7efdbbfff640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7efda800b4a0 tx=0x7efda800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.158+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8014070 con 0x7efdbc102570 2024-09-19T09:33:48.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.158+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc19d860 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.158+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efda8010af0 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.158+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda8017d10 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.158+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc1a5140 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.159+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc101200 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.160+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efda8017070 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.161+0000 7efdb9ffb640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 0x7efdac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.161+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efda80cecb0 con 0x7efdbc102570 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.161+0000 7efdc0dbb640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 0x7efdac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.161+0000 7efdc0dbb640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 0x7efdac0a5700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009230 tx=0x7efdb00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:48.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.165+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efda809b300 con 0x7efdbc102570 2024-09-19T09:33:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.380+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdbc1090c0 con 0x7efdbc102570 2024-09-19T09:33:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.381+0000 7efdb9ffb640 1 -- 172.21.15.52:0/4198625268 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7efda809f600 con 0x7efdbc102570 2024-09-19T09:33:48.382 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:33:48.382 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:33:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:33:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 msgr2=0x7efdac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 0x7efdac0a5700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009230 tx=0x7efdb00058d0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 msgr2=0x7efdbc198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7efda800b4a0 tx=0x7efda800b960 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 shutdown_connections 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7efdac0a3240 0x7efdac0a5700 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efdbc102ef0 0x7efdbc19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efdbc102570 0x7efdbc198b00 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 --2- 172.21.15.52:0/4198625268 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdbc100e20 0x7efdbc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 >> 172.21.15.52:0/4198625268 conn(0x7efdbc0fc7d0 msgr2=0x7efdbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 shutdown_connections 2024-09-19T09:33:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:48.383+0000 7efdc301f640 1 -- 172.21.15.52:0/4198625268 wait complete. 2024-09-19T09:33:49.078 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:49 smithi052 ceph-mon[30947]: pgmap v709: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:49.078 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:49 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4198625268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.112 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T09:33:49.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T09:33:49.309 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:49 smithi086 ceph-mon[34813]: pgmap v709: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:49.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:49 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4198625268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.416 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:49.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:49 smithi169 ceph-mon[35454]: pgmap v709: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:33:49.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:49 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4198625268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:33:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.795+0000 7f0edb6e6640 1 -- 172.21.15.52:0/1623853948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 msgr2=0x7f0ed4101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/1623853948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed4101bc0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009ca0 tx=0x7f0ec402a950 comp rx=0 tx=0).stop 2024-09-19T09:33:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 -- 172.21.15.52:0/1623853948 shutdown_connections 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/1623853948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed4101bc0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/1623853948 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100d70 0x7f0ed41011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/1623853948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100430 0x7f0ed4100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 -- 172.21.15.52:0/1623853948 >> 172.21.15.52:0/1623853948 conn(0x7f0ed40fc1e0 msgr2=0x7f0ed40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 -- 172.21.15.52:0/1623853948 shutdown_connections 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 -- 172.21.15.52:0/1623853948 wait complete. 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 Processor -- start 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 -- start start 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.796+0000 7f0edb6e6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100430 0x7f0ed4199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0edb6e6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100d70 0x7f0ed419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0edb6e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0edb6e6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410f9c0 con 0x7f0ed4101710 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0edb6e6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410f840 con 0x7f0ed4100d70 2024-09-19T09:33:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0edb6e6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410fb40 con 0x7f0ed4100430 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59276/0 (socket says 172.21.15.52:59276) 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 -- 172.21.15.52:0/748691322 learned_addr learned my addr 172.21.15.52:0/748691322 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100d70 0x7f0ed419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9482640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100430 0x7f0ed4199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 -- 172.21.15.52:0/748691322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100430 msgr2=0x7f0ed4199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100430 0x7f0ed4199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 -- 172.21.15.52:0/748691322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100d70 msgr2=0x7f0ed419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100d70 0x7f0ed419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 -- 172.21.15.52:0/748691322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed41a1be0 con 0x7f0ed4101710 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006010 tx=0x7f0ec402fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.797+0000 7f0ed27fc640 1 -- 172.21.15.52:0/748691322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4034040 con 0x7f0ed4101710 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.798+0000 7f0ed27fc640 1 -- 172.21.15.52:0/748691322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4003e00 con 0x7f0ed4101710 2024-09-19T09:33:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.798+0000 7f0ed27fc640 1 -- 172.21.15.52:0/748691322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4045480 con 0x7f0ed4101710 2024-09-19T09:33:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.798+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed41a1e70 con 0x7f0ed4101710 2024-09-19T09:33:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.798+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed41a22d0 con 0x7f0ed4101710 2024-09-19T09:33:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.800+0000 7f0ede47f740 1 Processor -- start 2024-09-19T09:33:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.800+0000 7f0ed27fc640 1 -- 172.21.15.52:0/748691322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0ec4037020 con 0x7f0ed4101710 2024-09-19T09:33:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 -- start start 2024-09-19T09:33:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726542da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e72654a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e7264a62f0 con 0x55e7265432e0 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e72644e270 con 0x55e726548370 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ede47f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e7264a22b0 con 0x55e7265429a0 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59292/0 (socket says 172.21.15.52:59292) 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 -- 172.21.15.52:0/3451542401 learned_addr learned my addr 172.21.15.52:0/3451542401 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e72654a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726542da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 -- 172.21.15.52:0/3451542401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 msgr2=0x55e726542da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726542da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 -- 172.21.15.52:0/3451542401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 msgr2=0x55e72654a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.808 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e72654a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed9482640 1 -- 172.21.15.52:0/3451542401 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72644d340 con 0x55e7265432e0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed27fc640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 0x7f0ebc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.801+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 0x7f0ebc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.802+0000 7f0ed27fc640 1 -- 172.21.15.52:0/748691322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0ec40f08e0 con 0x7f0ed4101710 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.802+0000 7f0ed9482640 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00bd50 tx=0x7f0ecc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b0ffdc5a1ae1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.802+0000 7f0ebb7fe640 1 -- 172.21.15.52:0/3451542401 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc005220 con 0x55e7265432e0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.802+0000 7f0ebb7fe640 1 -- 172.21.15.52:0/3451542401 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ecc00be40 con 0x55e7265432e0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.802+0000 7f0ebb7fe640 1 -- 172.21.15.52:0/3451542401 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0118a0 con 0x55e7265432e0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- 172.21.15.52:0/3451542401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 msgr2=0x55e726547da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 0x7f0ebc0a57b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ed419b4d0 tx=0x7f0ec8014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00bd50 tx=0x7f0ecc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- 172.21.15.52:0/3451542401 shutdown_connections 2024-09-19T09:33:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e72654a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e726547da0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3451542401 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726542da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- 172.21.15.52:0/3451542401 >> 172.21.15.52:0/3451542401 conn(0x55e72653e010 msgr2=0x55e72653e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- 172.21.15.52:0/3451542401 shutdown_connections 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- 172.21.15.52:0/3451542401 wait complete. 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 -- start start 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.803+0000 7f0ede47f740 1 Processor -- start 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e72654d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 0x55e726554180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e72654b340 con 0x55e7265429a0 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e72642f290 con 0x55e7265432e0 2024-09-19T09:33:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e72654b4c0 con 0x55e726548370 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ede47f740 10 client.0 _ll_register_callbacks cb 0x55e726460140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59298/0 (socket says 172.21.15.52:59298) 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 -- 172.21.15.52:0/415396073 learned_addr learned my addr 172.21.15.52:0/415396073 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e72654d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 0x55e726554180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 -- 172.21.15.52:0/415396073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 msgr2=0x55e726554180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 0x55e726554180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 -- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 msgr2=0x55e72654d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e72654d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 -- 172.21.15.52:0/415396073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7261b9210 con 0x55e7265429a0 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 0x55e726554180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:33:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0ed9482640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc010ca0 tx=0x7f0ecc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a14a6d21b564cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.804+0000 7f0eb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc011c10 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0ecc011db0 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7264b3a20 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ecc01b430 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 10 client.19968 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e726285620 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e7264b3a20 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ecc030780 con 0x55e7265429a0 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 10 client.19968 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 10 client.19968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 20 client.19968 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e726558680 0x55e72655ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 4 client.19968 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.805+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7264add70 con 0x55e726558680 2024-09-19T09:33:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.806+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e726558680 0x55e72655ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.806+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e726558680 0x55e72655ab00 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e0e4d7361eedc5 server_cookie=59f1908e9cce5932 in_seq=0 out_seq=0 2024-09-19T09:33:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.806+0000 7f0eb8ff9640 10 client.19968 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/415396073 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7264add70 con 0x55e726558680 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0eb8ff9640 10 client.19968 handle_command_reply: tid=0 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 client.19968 shutdown 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 msgr2=0x55e72654cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc010ca0 tx=0x7f0ecc011810 comp rx=0 tx=0).stop 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 shutdown_connections 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e726558680 0x55e72655ab00 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e726548370 0x55e726554180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e72654d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 --2- 172.21.15.52:0/415396073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265429a0 0x55e72654cc00 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 >> 172.21.15.52:0/415396073 conn(0x55e72653e010 msgr2=0x55e72653f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0eb8ff9640 0 client.19968 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 shutdown_connections 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 1 -- 172.21.15.52:0/415396073 wait complete. 2024-09-19T09:33:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.807+0000 7f0ede47f740 20 client.19968 trim_cache size 0 max 16384 2024-09-19T09:33:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.839+0000 7f0ede47f740 1 Processor -- start 2024-09-19T09:33:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.839+0000 7f0ede47f740 1 -- start start 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.839+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e72654d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ede47f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41adc60 con 0x55e726548370 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ede47f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41ab530 con 0x55e7265432e0 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ede47f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41a9380 con 0x55e7265429a0 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed9c83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed9c83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59306/0 (socket says 172.21.15.52:59306) 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed9c83640 1 -- 172.21.15.52:0/3816655350 learned_addr learned my addr 172.21.15.52:0/3816655350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:40154/0 (socket says 172.21.15.52:40154) 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed9482640 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e72654d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 -- 172.21.15.52:0/3816655350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 msgr2=0x55e72654d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e72654d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 -- 172.21.15.52:0/3816655350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 msgr2=0x55e72653f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 -- 172.21.15.52:0/3816655350 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72653de30 con 0x55e7265432e0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.840+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55e72655b310 tx=0x7f0ec800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea71f3ff14cfc754 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ebaffd640 1 -- 172.21.15.52:0/3816655350 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8024a10 con 0x55e7265432e0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ebaffd640 1 -- 172.21.15.52:0/3816655350 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8005500 con 0x55e7265432e0 2024-09-19T09:33:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ebaffd640 1 -- 172.21.15.52:0/3816655350 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8004e00 con 0x55e7265432e0 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 -- 172.21.15.52:0/3816655350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 msgr2=0x55e726554140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55e72655b310 tx=0x7f0ec800b390 comp rx=0 tx=0).stop 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 -- 172.21.15.52:0/3816655350 shutdown_connections 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e726548370 0x55e72653f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e7265432e0 0x55e726554140 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 --2- 172.21.15.52:0/3816655350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e72654d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.841+0000 7f0ede47f740 1 -- 172.21.15.52:0/3816655350 >> 172.21.15.52:0/3816655350 conn(0x55e72653e010 msgr2=0x55e72653d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- 172.21.15.52:0/3816655350 shutdown_connections 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- 172.21.15.52:0/3816655350 wait complete. 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- start start 2024-09-19T09:33:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 Processor -- start 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726551360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e7265528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41a99f0 con 0x55e7265432e0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41aae60 con 0x55e726548370 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed41aa0c0 con 0x55e7265429a0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ede47f740 10 client.0 _ll_register_callbacks cb 0x7f0ec800b750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ed8c81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ed8c81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59322/0 (socket says 172.21.15.52:59322) 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ed8c81640 1 -- 172.21.15.52:0/380816167 learned_addr learned my addr 172.21.15.52:0/380816167 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.842+0000 7f0ed9482640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726551360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed9c83640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e7265528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 -- 172.21.15.52:0/380816167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 msgr2=0x55e726551360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726551360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 -- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 msgr2=0x55e7265528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e7265528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 -- 172.21.15.52:0/380816167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e726552ec0 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ed8c81640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b720 tx=0x7f0ec8005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc42f3ee6e3100dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0eb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8037030 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0ec80242c0 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ec8005500 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0ec8003d20 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ede47f740 10 client.19974 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e7265541d0 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.843+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec8005500 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0ec802b030 con 0x55e7265432e0 2024-09-19T09:33:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 10 client.19974 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 10 client.19974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 20 client.19974 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7265c3950 0x55e7265c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 4 client.19974 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e72642a900 con 0x55e7265c3950 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.844+0000 7f0ed9482640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7265c3950 0x55e7265c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.845+0000 7f0ed9482640 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7265c3950 0x55e7265c5d70 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c08d323be98e33a server_cookie=8682342382539247 in_seq=0 out_seq=0 2024-09-19T09:33:49.850 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.845+0000 7f0eb8ff9640 10 client.19974 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0eb8ff9640 1 -- 172.21.15.52:0/380816167 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e72642a900 con 0x55e7265c3950 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0eb8ff9640 10 client.19974 handle_command_reply: tid=0 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 client.19974 shutdown 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 msgr2=0x55e7265518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b720 tx=0x7f0ec8005cf0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 shutdown_connections 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e7265c3950 0x55e7265c5d70 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e726548370 0x55e7265528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e7265432e0 0x55e7265518a0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 --2- 172.21.15.52:0/380816167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e7265429a0 0x55e726551360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0eb8ff9640 0 client.19974 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 >> 172.21.15.52:0/380816167 conn(0x55e72653e010 msgr2=0x55e72653e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 shutdown_connections 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.857+0000 7f0ede47f740 1 -- 172.21.15.52:0/380816167 wait complete. 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0ede47f740 20 client.19974 trim_cache size 0 max 16384 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:33:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:33:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 msgr2=0x7f0ebc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 0x7f0ebc0a57b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ed419b4d0 tx=0x7f0ec8014040 comp rx=0 tx=0).stop 2024-09-19T09:33:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 msgr2=0x7f0ed41a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006010 tx=0x7f0ec402fcf0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 shutdown_connections 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ed4101710 0x7f0ed41a1570 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed4100d70 0x7f0ed419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f0ebc0a32f0 0x7f0ebc0a57b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 --2- 172.21.15.52:0/748691322 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ed4100430 0x7f0ed4199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 >> 172.21.15.52:0/748691322 conn(0x7f0ed40fc1e0 msgr2=0x7f0ed40fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 shutdown_connections 2024-09-19T09:33:49.862 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:33:49.858+0000 7f0edb6e6640 1 -- 172.21.15.52:0/748691322 wait complete. 2024-09-19T09:33:49.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 -- 172.21.15.52:0/3175881877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac102d50 msgr2=0x7f58ac103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 --2- 172.21.15.52:0/3175881877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac102d50 0x7f58ac103130 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f589c009900 tx=0x7f589c02a480 comp rx=0 tx=0).stop 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 -- 172.21.15.52:0/3175881877 shutdown_connections 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 --2- 172.21.15.52:0/3175881877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 0x7f58ac10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 --2- 172.21.15.52:0/3175881877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac103670 0x7f58ac10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 --2- 172.21.15.52:0/3175881877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac102d50 0x7f58ac103130 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 -- 172.21.15.52:0/3175881877 >> 172.21.15.52:0/3175881877 conn(0x7f58ac0fc7d0 msgr2=0x7f58ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 -- 172.21.15.52:0/3175881877 shutdown_connections 2024-09-19T09:33:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.865+0000 7f58b258c640 1 -- 172.21.15.52:0/3175881877 wait complete. 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.866+0000 7f58b258c640 1 Processor -- start 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.866+0000 7f58b258c640 1 -- start start 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 0x7f58ac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 0x7f58ac19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac111f80 con 0x7f58ac103670 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac111e00 con 0x7f58ac10c180 2024-09-19T09:33:49.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b258c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac112100 con 0x7f58ac102d50 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59340/0 (socket says 172.21.15.52:59340) 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58abfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 0x7f58ac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3787600958 learned_addr learned my addr 172.21.15.52:0/3787600958 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58b0b29640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 0x7f58ac19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3787600958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 msgr2=0x7f58ac198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 0x7f58ac198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3787600958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 msgr2=0x7f58ac19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 0x7f58ac19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3787600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac19d410 con 0x7f58ac103670 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58abfff640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 0x7f58ac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.867+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9f0 tx=0x7f58a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.868+0000 7f58a97fa640 1 -- 172.21.15.52:0/3787600958 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a000ccc0 con 0x7f58ac103670 2024-09-19T09:33:49.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.868+0000 7f58a97fa640 1 -- 172.21.15.52:0/3787600958 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a0010910 con 0x7f58ac103670 2024-09-19T09:33:49.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.868+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac19d700 con 0x7f58ac103670 2024-09-19T09:33:49.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.868+0000 7f58a97fa640 1 -- 172.21.15.52:0/3787600958 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0018920 con 0x7f58ac103670 2024-09-19T09:33:49.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.868+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac1a4fe0 con 0x7f58ac103670 2024-09-19T09:33:49.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.870+0000 7f58a97fa640 1 -- 172.21.15.52:0/3787600958 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58a0010430 con 0x7f58ac103670 2024-09-19T09:33:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 Processor -- start 2024-09-19T09:33:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 -- start start 2024-09-19T09:33:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58a97fa640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 0x7f58940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b0b29640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 0x7f58940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bac80082a0 con 0x55bac80b1d50 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bac7fafb10 con 0x55bac80a2660 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b4965740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bac8004260 con 0x55bac80a2f80 2024-09-19T09:33:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58a97fa640 1 -- 172.21.15.52:0/3787600958 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58a00cfc00 con 0x7f58ac103670 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b0b29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b0b29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59352/0 (socket says 172.21.15.52:59352) 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58b0b29640 1 -- 172.21.15.52:0/1530556751 learned_addr learned my addr 172.21.15.52:0/1530556751 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.871+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58abfff640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 0x7f58940a5700 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f58a4012780 tx=0x7f58a4012b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 -- 172.21.15.52:0/1530556751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 msgr2=0x55bac80b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 -- 172.21.15.52:0/1530556751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 msgr2=0x55bac80a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 -- 172.21.15.52:0/1530556751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac7d79b90 con 0x55bac80b1d50 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58b0b29640 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009d90 tx=0x7f58a401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd02760ee535967 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58927fc640 1 -- 172.21.15.52:0/1530556751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4003b70 con 0x55bac80b1d50 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58927fc640 1 -- 172.21.15.52:0/1530556751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a4023070 con 0x55bac80b1d50 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.872+0000 7f58927fc640 1 -- 172.21.15.52:0/1530556751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a4004590 con 0x55bac80b1d50 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- 172.21.15.52:0/1530556751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 msgr2=0x55bac80b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f58a4009d90 tx=0x7f58a401e000 comp rx=0 tx=0).stop 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- 172.21.15.52:0/1530556751 shutdown_connections 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80b1d50 0x55bac80b4140 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 --2- 172.21.15.52:0/1530556751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- 172.21.15.52:0/1530556751 >> 172.21.15.52:0/1530556751 conn(0x55bac809ecf0 msgr2=0x55bac809f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- 172.21.15.52:0/1530556751 shutdown_connections 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- 172.21.15.52:0/1530556751 wait complete. 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.873+0000 7f58b4965740 1 -- start start 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 Processor -- start 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80b1d50 0x55bac80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bac80b4920 con 0x55bac80a2f80 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bac7f906e0 con 0x55bac80a2660 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bac80b4aa0 con 0x55bac80b1d50 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b4965740 10 client.0 _ll_register_callbacks cb 0x55bac7fb4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59362/0 (socket says 172.21.15.52:59362) 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3672889126 learned_addr learned my addr 172.21.15.52:0/3672889126 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58abfff640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58b0b29640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80b1d50 0x55bac80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.874+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3672889126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80b1d50 msgr2=0x55bac80af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80b1d50 0x55bac80af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 msgr2=0x55bac80aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58ab7fe640 1 -- 172.21.15.52:0/3672889126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac80bde80 con 0x55bac80a2f80 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f58a00cd680 tx=0x7f58a00a0690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69217aa485715522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a00b5060 con 0x55bac80a2f80 2024-09-19T09:33:49.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58a00bc0b0 con 0x55bac80a2f80 2024-09-19T09:33:49.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a4023070 con 0x55bac80a2f80 2024-09-19T09:33:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58a009a610 con 0x55bac80a2f80 2024-09-19T09:33:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58b4965740 10 client.19986 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:49.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bac80c0810 con 0x55bac80a2f80 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a4023070 con 0x55bac80a2f80 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.875+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58a009b6a0 con 0x55bac80a2f80 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 10 client.19986 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 10 client.19986 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 20 client.19986 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac80c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 4 client.19986 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac80159d0 con 0x55bac80c1cd0 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58abfff640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac80c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f588b7fe640 10 client.19986 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.876+0000 7f58abfff640 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac80c40c0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6a1af6cc784e928 server_cookie=8086c72d9ee42b08 in_seq=0 out_seq=0 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f588b7fe640 1 -- 172.21.15.52:0/3672889126 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bac80159d0 con 0x55bac80c1cd0 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f588b7fe640 10 client.19986 handle_command_reply: tid=0 2024-09-19T09:33:49.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 client.19986 shutdown 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 msgr2=0x55bac80af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f58a00cd680 tx=0x7f58a00a0690 comp rx=0 tx=0).stop 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 shutdown_connections 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac80c40c0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f588b7fe640 0 client.19986 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80b1d50 0x55bac80af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80af1a0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 --2- 172.21.15.52:0/3672889126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80a2660 0x55bac80aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 >> 172.21.15.52:0/3672889126 conn(0x55bac809ecf0 msgr2=0x55bac80a4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 shutdown_connections 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.877+0000 7f58b4965740 1 -- 172.21.15.52:0/3672889126 wait complete. 2024-09-19T09:33:49.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.878+0000 7f58b4965740 20 client.19986 trim_cache size 0 max 16384 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 Processor -- start 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 -- start start 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2660 0x55bac80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1adea0 con 0x55bac80a2f80 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1ab770 con 0x55bac80b1d50 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b4965740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1a95c0 con 0x55bac80a2660 2024-09-19T09:33:49.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59378/0 (socket says 172.21.15.52:59378) 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 -- 172.21.15.52:0/2514806491 learned_addr learned my addr 172.21.15.52:0/2514806491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58abfff640 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2660 0x55bac80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58b0b29640 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 -- 172.21.15.52:0/2514806491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2660 msgr2=0x55bac80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2660 0x55bac80b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 -- 172.21.15.52:0/2514806491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 msgr2=0x55bac80c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 -- 172.21.15.52:0/2514806491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac809eb20 con 0x55bac80a2f80 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.895+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a48e0 tx=0x7f58a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f88fc8ab6d6905e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f5891ffb640 1 -- 172.21.15.52:0/2514806491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a0170 con 0x55bac80a2f80 2024-09-19T09:33:49.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f5891ffb640 1 -- 172.21.15.52:0/2514806491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a00a0310 con 0x55bac80a2f80 2024-09-19T09:33:49.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f5891ffb640 1 -- 172.21.15.52:0/2514806491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a00cde30 con 0x55bac80a2f80 2024-09-19T09:33:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 -- 172.21.15.52:0/2514806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 msgr2=0x55bac80c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a48e0 tx=0x7f58a0009f90 comp rx=0 tx=0).stop 2024-09-19T09:33:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 -- 172.21.15.52:0/2514806491 shutdown_connections 2024-09-19T09:33:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2f80 0x55bac80c9970 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 --2- 172.21.15.52:0/2514806491 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2660 0x55bac80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 -- 172.21.15.52:0/2514806491 >> 172.21.15.52:0/2514806491 conn(0x55bac809ecf0 msgr2=0x55bac80b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 -- 172.21.15.52:0/2514806491 shutdown_connections 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.896+0000 7f58b4965740 1 -- 172.21.15.52:0/2514806491 wait complete. 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 -- start start 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 Processor -- start 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1a9c30 con 0x55bac80a2660 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1ab0a0 con 0x55bac80b1d50 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac1aa300 con 0x55bac80a2f80 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59394/0 (socket says 172.21.15.52:59394) 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58abfff640 1 -- 172.21.15.52:0/3380404046 learned_addr learned my addr 172.21.15.52:0/3380404046 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.897+0000 7f58b4965740 10 client.0 _ll_register_callbacks cb 0x7f58a009c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58b0b29640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 -- 172.21.15.52:0/3380404046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 msgr2=0x55bac80ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 -- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 msgr2=0x55bac80b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 -- 172.21.15.52:0/3380404046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac80b7240 con 0x55bac80a2660 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58abfff640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f589c02a9a0 tx=0x7f589c004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28940e3f7e4c5f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f588b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c035040 con 0x55bac80a2660 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f589c003a00 con 0x55bac80a2660 2024-09-19T09:33:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a00a0310 con 0x55bac80a2660 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f589c059050 con 0x55bac80a2660 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58b4965740 10 client.19992 fetch_fsmap learned FSMap version 24 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.898+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bac812d010 con 0x55bac80a2660 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a00a0310 con 0x55bac80a2660 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f589c050070 con 0x55bac80a2660 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 10 client.19992 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 10 client.19992 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 20 client.19992 populate_metadata read hostname 'smithi052' 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac812f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 4 client.19992 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x55bac800fd20 con 0x55bac80c1cd0 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac812f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f58ab7fe640 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac812f7c0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91919917156f6682 server_cookie=e53848270f348d88 in_seq=0 out_seq=0 2024-09-19T09:33:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.899+0000 7f588b7fe640 10 client.19992 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.909+0000 7f588b7fe640 1 -- 172.21.15.52:0/3380404046 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55bac800fd20 con 0x55bac80c1cd0 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.909+0000 7f588b7fe640 10 client.19992 handle_command_reply: tid=0 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.909+0000 7f58b4965740 1 client.19992 shutdown 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 msgr2=0x55bac80b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f589c02a9a0 tx=0x7f589c004490 comp rx=0 tx=0).stop 2024-09-19T09:33:49.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 shutdown_connections 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bac80c1cd0 0x55bac812f7c0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bac80b1d50 0x55bac80b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bac80a2f80 0x55bac80ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 --2- 172.21.15.52:0/3380404046 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bac80a2660 0x55bac80b9d30 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 >> 172.21.15.52:0/3380404046 conn(0x55bac809ecf0 msgr2=0x55bac809de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f588b7fe640 0 client.19992 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 shutdown_connections 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 1 -- 172.21.15.52:0/3380404046 wait complete. 2024-09-19T09:33:49.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b4965740 20 client.19992 trim_cache size 0 max 16384 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 42, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "c34bac4f": { 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 42, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:33:49.913 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 142.2, 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:33:49.914 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 msgr2=0x7f58940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 0x7f58940a5700 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f58a4012780 tx=0x7f58a4012b80 comp rx=0 tx=0).stop 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 msgr2=0x7f58ac1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9f0 tx=0x7f58a000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 shutdown_connections 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58ac10c180 0x7f58ac19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac103670 0x7f58ac1989a0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58940a3240 0x7f58940a5700 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 --2- 172.21.15.52:0/3787600958 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58ac102d50 0x7f58ac198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.910+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 >> 172.21.15.52:0/3787600958 conn(0x7f58ac0fc7d0 msgr2=0x7f58ac0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.911+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 shutdown_connections 2024-09-19T09:33:49.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:33:49.911+0000 7f58b258c640 1 -- 172.21.15.52:0/3787600958 wait complete. 2024-09-19T09:33:50.645 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c34bac4f', quiesce took 3.3 seconds. Will release after: 18.9 2024-09-19T09:33:51.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:51 smithi052 ceph-mon[30947]: pgmap v710: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:33:51.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:51 smithi169 ceph-mon[35454]: pgmap v710: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:33:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:51 smithi086 ceph-mon[34813]: pgmap v710: 97 pgs: 97 active+clean; 2.3 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:33:53.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:53 smithi052 ceph-mon[30947]: pgmap v711: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:33:53.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:53 smithi169 ceph-mon[35454]: pgmap v711: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:33:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:53 smithi086 ceph-mon[34813]: pgmap v711: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:33:55.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:55 smithi052 ceph-mon[30947]: pgmap v712: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:33:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:55 smithi169 ceph-mon[35454]: pgmap v712: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:33:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:55 smithi086 ceph-mon[34813]: pgmap v712: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-19T09:33:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:57 smithi052 ceph-mon[30947]: pgmap v713: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:33:57.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:57 smithi169 ceph-mon[35454]: pgmap v713: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:33:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:57 smithi086 ceph-mon[34813]: pgmap v713: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:33:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:33:59 smithi052 ceph-mon[30947]: pgmap v714: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:33:59 smithi169 ceph-mon[35454]: pgmap v714: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:33:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:33:59 smithi086 ceph-mon[34813]: pgmap v714: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:34:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:01 smithi052 ceph-mon[30947]: pgmap v715: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-19T09:34:01.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:01 smithi169 ceph-mon[35454]: pgmap v715: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-19T09:34:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:01 smithi086 ceph-mon[34813]: pgmap v715: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.2 KiB/s wr, 10 op/s 2024-09-19T09:34:02.965 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.962+0000 7f1ad283c640 1 -- 172.21.15.52:0/1840594762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 msgr2=0x7f1acc109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.962+0000 7f1ad283c640 1 --2- 172.21.15.52:0/1840594762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc109ce0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009ca0 tx=0x7f1ac402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 -- 172.21.15.52:0/1840594762 shutdown_connections 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 --2- 172.21.15.52:0/1840594762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc109ce0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 --2- 172.21.15.52:0/1840594762 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc104fc0 0x7f1acc1073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 --2- 172.21.15.52:0/1840594762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc102690 0x7f1acc104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 -- 172.21.15.52:0/1840594762 >> 172.21.15.52:0/1840594762 conn(0x7f1acc0fc1b0 msgr2=0x7f1acc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 -- 172.21.15.52:0/1840594762 shutdown_connections 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 -- 172.21.15.52:0/1840594762 wait complete. 2024-09-19T09:34:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 Processor -- start 2024-09-19T09:34:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.963+0000 7f1ad283c640 1 -- start start 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc102690 0x7f1acc197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc104fc0 0x7f1acc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10d800 con 0x7f1acc1078f0 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10d680 con 0x7f1acc104fc0 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad283c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10d980 con 0x7f1acc102690 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55902/0 (socket says 172.21.15.52:55902) 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 -- 172.21.15.52:0/3993980203 learned_addr learned my addr 172.21.15.52:0/3993980203 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc102690 0x7f1acc197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc104fc0 0x7f1acc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 -- 172.21.15.52:0/3993980203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc102690 msgr2=0x7f1acc197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc102690 0x7f1acc197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 -- 172.21.15.52:0/3993980203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc104fc0 msgr2=0x7f1acc198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc104fc0 0x7f1acc198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.964+0000 7f1ad0dd9640 1 -- 172.21.15.52:0/3993980203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc19fa00 con 0x7f1acc1078f0 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ad0dd9640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4031ae0 tx=0x7f1ac4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ac97fa640 1 -- 172.21.15.52:0/3993980203 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4003c30 con 0x7f1acc1078f0 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ac97fa640 1 -- 172.21.15.52:0/3993980203 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac4003dd0 con 0x7f1acc1078f0 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc19fc90 con 0x7f1acc1078f0 2024-09-19T09:34:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ac97fa640 1 -- 172.21.15.52:0/3993980203 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac402fcb0 con 0x7f1acc1078f0 2024-09-19T09:34:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.965+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc1a0190 con 0x7f1acc1078f0 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ac97fa640 1 -- 172.21.15.52:0/3993980203 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ac4004050 con 0x7f1acc1078f0 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 Processor -- start 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 -- start start 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a78657c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a786583c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7864db2f0 con 0x55a78657c6f0 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a786483270 con 0x55a78657bdb0 2024-09-19T09:34:02.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7864d72b0 con 0x55a786581780 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.968+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55910/0 (socket says 172.21.15.52:55910) 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 -- 172.21.15.52:0/3029692955 learned_addr learned my addr 172.21.15.52:0/3029692955 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a78657c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a786583c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ac97fa640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 0x7f1ab40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 -- 172.21.15.52:0/3029692955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 msgr2=0x55a786583c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a786583c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 -- 172.21.15.52:0/3029692955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 msgr2=0x55a78657c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a78657c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 -- 172.21.15.52:0/3029692955 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a786482340 con 0x55a78657c6f0 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a78657c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:02.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ad0dd9640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 0x7f1ab40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ac97fa640 1 -- 172.21.15.52:0/3993980203 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1ac40f0be0 con 0x7f1acc1078f0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009cf0 tx=0x7f1abc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8da0baf03398c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ab27fc640 1 -- 172.21.15.52:0/3029692955 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004230 con 0x55a78657c6f0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ab27fc640 1 -- 172.21.15.52:0/3029692955 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc0043d0 con 0x55a78657c6f0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.969+0000 7f1ab27fc640 1 -- 172.21.15.52:0/3029692955 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0198c0 con 0x55a78657c6f0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3029692955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 msgr2=0x55a7865811b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad0dd9640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 0x7f1ab40a57b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40bcfa0 tx=0x7f1ac4087e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009cf0 tx=0x7f1abc011810 comp rx=0 tx=0).stop 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3029692955 shutdown_connections 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a786583c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a7865811b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3029692955 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a78657c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3029692955 >> 172.21.15.52:0/3029692955 conn(0x55a786577420 msgr2=0x55a786577820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3029692955 shutdown_connections 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.970+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3029692955 wait complete. 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 -- start start 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 Processor -- start 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657c6f0 0x55a786586520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a78658d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a786584750 con 0x55a78657bdb0 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a786464290 con 0x55a78657c6f0 2024-09-19T09:34:02.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7865848d0 con 0x55a786581780 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1ad55d6740 10 client.0 _ll_register_callbacks cb 0x55a786495140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55912/0 (socket says 172.21.15.52:55912) 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1acb7fe640 1 -- 172.21.15.52:0/1940437590 learned_addr learned my addr 172.21.15.52:0/1940437590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657c6f0 0x55a786586520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.971+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a78658d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 -- 172.21.15.52:0/1940437590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 msgr2=0x55a78658d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a78658d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 -- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657c6f0 msgr2=0x55a786586520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657c6f0 0x55a786586520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 -- 172.21.15.52:0/1940437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7861ee210 con 0x55a78657bdb0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00126b0 tx=0x7f1ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b180082fd34827e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1aab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:02.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011a60 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1abc0043d0 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1ac0011c00 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1ac0025020 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1ad55d6740 10 client.20004 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7862ba620 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.972+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc0043d0 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1ac002a4a0 con 0x55a78657bdb0 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 10 client.20004 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 10 client.20004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 20 client.20004 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a786591c90 0x55a7865940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 4 client.20004 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7864e8a20 con 0x55a786591c90 2024-09-19T09:34:02.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.973+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a786591c90 0x55a7865940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a786591c90 0x55a7865940f0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88535a060f2b6f1d server_cookie=1235b5d9bf957359 in_seq=0 out_seq=0 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1aab7fe640 10 client.20004 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1aab7fe640 1 -- 172.21.15.52:0/1940437590 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7864e8a20 con 0x55a786591c90 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1aab7fe640 10 client.20004 handle_command_reply: tid=0 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1ad55d6740 1 client.20004 shutdown 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.974+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 msgr2=0x55a786585fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00126b0 tx=0x7f1ac00046c0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 shutdown_connections 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a786591c90 0x55a7865940f0 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a78658d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657c6f0 0x55a786586520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1940437590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a786585fe0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1aab7fe640 0 client.20004 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:02.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 >> 172.21.15.52:0/1940437590 conn(0x55a786577420 msgr2=0x55a7865721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 shutdown_connections 2024-09-19T09:34:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1940437590 wait complete. 2024-09-19T09:34:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.975+0000 7f1ad55d6740 20 client.20004 trim_cache size 0 max 16384 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.989+0000 7f1ad55d6740 1 Processor -- start 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.989+0000 7f1ad55d6740 1 -- start start 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a786586400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a7865989f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a9820 con 0x55a78657c6f0 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a70f0 con 0x55a78657bdb0 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a4f40 con 0x55a786581780 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55928/0 (socket says 172.21.15.52:55928) 2024-09-19T09:34:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 -- 172.21.15.52:0/1745537589 learned_addr learned my addr 172.21.15.52:0/1745537589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a786586400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 -- 172.21.15.52:0/1745537589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 msgr2=0x55a7865989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a7865989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 -- 172.21.15.52:0/1745537589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 msgr2=0x55a786586400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a786586400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 -- 172.21.15.52:0/1745537589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a786585b20 con 0x55a78657c6f0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a786586400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1acbfff640 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f1abc014040 tx=0x7f1abc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdcf70388494527 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ab1ffb640 1 -- 172.21.15.52:0/1745537589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc031070 con 0x55a78657c6f0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ab1ffb640 1 -- 172.21.15.52:0/1745537589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc003ad0 con 0x55a78657c6f0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.990+0000 7f1ab1ffb640 1 -- 172.21.15.52:0/1745537589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc019930 con 0x55a78657c6f0 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1745537589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 msgr2=0x55a78658d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f1abc014040 tx=0x7f1abc011810 comp rx=0 tx=0).stop 2024-09-19T09:34:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1745537589 shutdown_connections 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a786581780 0x55a7865989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657c6f0 0x55a78658d410 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/1745537589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a78657bdb0 0x55a786586400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1745537589 >> 172.21.15.52:0/1745537589 conn(0x55a786577420 msgr2=0x55a7865721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1745537589 shutdown_connections 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- 172.21.15.52:0/1745537589 wait complete. 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 -- start start 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.991+0000 7f1ad55d6740 1 Processor -- start 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 0x55a78658b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a786581780 0x55a78658c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a55b0 con 0x55a78657bdb0 2024-09-19T09:34:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a6a20 con 0x55a786581780 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc1a5c80 con 0x55a78657c6f0 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1ad55d6740 10 client.0 _ll_register_callbacks cb 0x7f1ac0012500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55936/0 (socket says 172.21.15.52:55936) 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 -- 172.21.15.52:0/3782603426 learned_addr learned my addr 172.21.15.52:0/3782603426 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 0x55a78658b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 -- 172.21.15.52:0/3782603426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 msgr2=0x55a78658b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 0x55a78658b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 -- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a786581780 msgr2=0x55a78658c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a786581780 0x55a78658c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 -- 172.21.15.52:0/3782603426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a786584990 con 0x55a78657bdb0 2024-09-19T09:34:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 0x55a78658b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1acb7fe640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002ae10 tx=0x7f1ac000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac0ef79b6537405 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1aab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000b920 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.992+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1ac0011860 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1abc003ad0 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1ac0039070 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 10 client.20010 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7865fcf70 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1abc003ad0 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1ac00047c0 con 0x55a78657bdb0 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 10 client.20010 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 10 client.20010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 20 client.20010 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a7865fd8c0 0x55a7865ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 4 client.20010 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7864e2d70 con 0x55a7865fd8c0 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.993+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a7865fd8c0 0x55a7865ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.994+0000 7f1acbfff640 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a7865fd8c0 0x55a7865ffce0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff7d00ccd198fac server_cookie=86cba5b7acad235a in_seq=0 out_seq=0 2024-09-19T09:34:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:02.994+0000 7f1aab7fe640 10 client.20010 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1aab7fe640 1 -- 172.21.15.52:0/3782603426 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7864e2d70 con 0x55a7865fd8c0 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1aab7fe640 10 client.20010 handle_command_reply: tid=0 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 client.20010 shutdown 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 msgr2=0x55a78658b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f1ac002ae10 tx=0x7f1ac000be70 comp rx=0 tx=0).stop 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 shutdown_connections 2024-09-19T09:34:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a7865fd8c0 0x55a7865ffce0 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a786581780 0x55a78658c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a78657c6f0 0x55a78658b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1aab7fe640 0 client.20010 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 --2- 172.21.15.52:0/3782603426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a78657bdb0 0x55a78658b270 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 >> 172.21.15.52:0/3782603426 conn(0x55a786577420 msgr2=0x55a7865782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 shutdown_connections 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 1 -- 172.21.15.52:0/3782603426 wait complete. 2024-09-19T09:34:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.006+0000 7f1ad55d6740 20 client.20010 trim_cache size 0 max 16384 2024-09-19T09:34:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:34:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:34:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:34:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 msgr2=0x7f1ab40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 0x7f1ab40a57b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40bcfa0 tx=0x7f1ac4087e00 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 msgr2=0x7f1acc19f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4031ae0 tx=0x7f1ac4031ee0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 shutdown_connections 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1acc1078f0 0x7f1acc19f390 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1acc104fc0 0x7f1acc198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1ab40a32f0 0x7f1ab40a57b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 --2- 172.21.15.52:0/3993980203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1acc102690 0x7f1acc197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 >> 172.21.15.52:0/3993980203 conn(0x7f1acc0fc1b0 msgr2=0x7f1acc103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 shutdown_connections 2024-09-19T09:34:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:03.007+0000 7f1ad283c640 1 -- 172.21.15.52:0/3993980203 wait complete. 2024-09-19T09:34:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:03 smithi052 ceph-mon[30947]: pgmap v716: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 10 op/s 2024-09-19T09:34:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:03 smithi169 ceph-mon[35454]: pgmap v716: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 10 op/s 2024-09-19T09:34:03.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:03 smithi086 ceph-mon[34813]: pgmap v716: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 KiB/s wr, 10 op/s 2024-09-19T09:34:05.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:05 smithi052 ceph-mon[30947]: pgmap v717: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:34:05.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:05 smithi169 ceph-mon[35454]: pgmap v717: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:34:05.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:05 smithi086 ceph-mon[34813]: pgmap v717: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:34:05.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:34:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 -- 172.21.15.52:0/2188839530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c102570 msgr2=0x7f532c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 --2- 172.21.15.52:0/2188839530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c102570 0x7f532c1029b0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f5320009900 tx=0x7f532002a480 comp rx=0 tx=0).stop 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 -- 172.21.15.52:0/2188839530 shutdown_connections 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 --2- 172.21.15.52:0/2188839530 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102ef0 0x7f532c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 --2- 172.21.15.52:0/2188839530 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c102570 0x7f532c1029b0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 --2- 172.21.15.52:0/2188839530 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c100e20 0x7f532c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 -- 172.21.15.52:0/2188839530 >> 172.21.15.52:0/2188839530 conn(0x7f532c0fc7d0 msgr2=0x7f532c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 -- 172.21.15.52:0/2188839530 shutdown_connections 2024-09-19T09:34:06.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.539+0000 7f533278c640 1 -- 172.21.15.52:0/2188839530 wait complete. 2024-09-19T09:34:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 Processor -- start 2024-09-19T09:34:06.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 -- start start 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102570 0x7f532c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 0x7f532c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f532c110f50 con 0x7f532c100e20 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f532c110dd0 con 0x7f532c102570 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f533278c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1110d0 con 0x7f532c102ef0 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55946/0 (socket says 172.21.15.52:55946) 2024-09-19T09:34:06.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532bfff640 1 -- 172.21.15.52:0/1079781289 learned_addr learned my addr 172.21.15.52:0/1079781289 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532b7fe640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102570 0x7f532c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f5330d29640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 0x7f532c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532bfff640 1 -- 172.21.15.52:0/1079781289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 msgr2=0x7f532c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.540+0000 7f532bfff640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 0x7f532c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f532bfff640 1 -- 172.21.15.52:0/1079781289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102570 msgr2=0x7f532c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f532bfff640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102570 0x7f532c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f532bfff640 1 -- 172.21.15.52:0/1079781289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c1a69b0 con 0x7f532c100e20 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f5330d29640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 0x7f532c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f532bfff640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c920 tx=0x7f531c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f53297fa640 1 -- 172.21.15.52:0/1079781289 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c007c70 con 0x7f532c100e20 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532c1a6ca0 con 0x7f532c100e20 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f53297fa640 1 -- 172.21.15.52:0/1079781289 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f531c007e10 con 0x7f532c100e20 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f53297fa640 1 -- 172.21.15.52:0/1079781289 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c018890 con 0x7f532c100e20 2024-09-19T09:34:06.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.541+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532c1a71d0 con 0x7f532c100e20 2024-09-19T09:34:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.543+0000 7f53297fa640 1 -- 172.21.15.52:0/1079781289 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f531c018a70 con 0x7f532c100e20 2024-09-19T09:34:06.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 Processor -- start 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 -- start start 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85046880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85051680 0x555a85053a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555a84fac2e0 con 0x555a85046dc0 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555a84f53ce0 con 0x555a850464a0 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5334b65740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555a84fa82a0 con 0x555a85051680 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f53297fa640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 0x7f53140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55960/0 (socket says 172.21.15.52:55960) 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 -- 172.21.15.52:0/3566472832 learned_addr learned my addr 172.21.15.52:0/3566472832 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5330d29640 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85046880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f5330d29640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 0x7f53140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532b7fe640 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85051680 0x555a85053a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f53297fa640 1 -- 172.21.15.52:0/1079781289 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f531c0cfbf0 con 0x7f532c100e20 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 -- 172.21.15.52:0/3566472832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85051680 msgr2=0x555a85053a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85051680 0x555a85053a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 -- 172.21.15.52:0/3566472832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 msgr2=0x555a85046880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.544+0000 7f532bfff640 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85046880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f532bfff640 1 -- 172.21.15.52:0/3566472832 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a84f38440 con 0x555a85046dc0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f532bfff640 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f531c007590 tx=0x7f531c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bf4495336415c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f5330d29640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 0x7f53140a5700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5324005fd0 tx=0x7f5324005c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f53127fc640 1 -- 172.21.15.52:0/3566472832 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c09c830 con 0x555a85046dc0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f53127fc640 1 -- 172.21.15.52:0/3566472832 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f531c0b3020 con 0x555a85046dc0 2024-09-19T09:34:06.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.545+0000 7f53127fc640 1 -- 172.21.15.52:0/3566472832 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0cd720 con 0x555a85046dc0 2024-09-19T09:34:06.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- 172.21.15.52:0/3566472832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 msgr2=0x555a85051140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f531c007590 tx=0x7f531c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- 172.21.15.52:0/3566472832 shutdown_connections 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85051680 0x555a85053a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85046dc0 0x555a85051140 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 --2- 172.21.15.52:0/3566472832 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85046880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- 172.21.15.52:0/3566472832 >> 172.21.15.52:0/3566472832 conn(0x555a85042a30 msgr2=0x555a85042e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- 172.21.15.52:0/3566472832 shutdown_connections 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- 172.21.15.52:0/3566472832 wait complete. 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 -- start start 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.546+0000 7f5334b65740 1 Processor -- start 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85050fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a8504e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555a850541f0 con 0x555a85051680 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555a84f67050 con 0x555a850464a0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555a85054370 con 0x555a85046dc0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 10 client.0 _ll_register_callbacks cb 0x555a84fa7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55964/0 (socket says 172.21.15.52:55964) 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 -- 172.21.15.52:0/2172252868 learned_addr learned my addr 172.21.15.52:0/2172252868 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f532bfff640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85050fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f532b7fe640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a8504e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 -- 172.21.15.52:0/2172252868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 msgr2=0x555a8504e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a8504e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 -- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 msgr2=0x555a85050fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85050fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 -- 172.21.15.52:0/2172252868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a84d1d3c0 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5330d29640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f532400fb80 tx=0x7f5324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4572358185b6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f530b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532400de50 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f532401e450 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.547+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f531c0b3020 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f532402d030 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 10 client.20022 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555a8505fc30 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f531c0b3020 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f532401b040 con 0x555a85051680 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 10 client.20022 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 10 client.20022 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:06.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 20 client.20022 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850610f0 0x555a85063520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 4 client.20022 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.548+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a84fb9850 con 0x555a850610f0 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.549+0000 7f532bfff640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850610f0 0x555a85063520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.549+0000 7f532bfff640 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850610f0 0x555a85063520 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b6739ae7e5bb82c server_cookie=548048fa926ea52f in_seq=0 out_seq=0 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.549+0000 7f530b7fe640 10 client.20022 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f530b7fe640 1 -- 172.21.15.52:0/2172252868 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a84fb9850 con 0x555a850610f0 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f530b7fe640 10 client.20022 handle_command_reply: tid=0 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 client.20022 shutdown 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 msgr2=0x555a8504e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f532400fb80 tx=0x7f5324004a40 comp rx=0 tx=0).stop 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 shutdown_connections 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850610f0 0x555a85063520 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a8504e7a0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a8504e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 --2- 172.21.15.52:0/2172252868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85050fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f530b7fe640 0 client.20022 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 >> 172.21.15.52:0/2172252868 conn(0x555a85042a30 msgr2=0x555a85048760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 shutdown_connections 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 1 -- 172.21.15.52:0/2172252868 wait complete. 2024-09-19T09:34:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.550+0000 7f5334b65740 20 client.20022 trim_cache size 0 max 16384 2024-09-19T09:34:06.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 Processor -- start 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 -- start start 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a850464a0 0x555a850501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a85046dc0 0x555a85068df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1b2350 con 0x555a85051680 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1afc20 con 0x555a85046dc0 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5334b65740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1ada70 con 0x555a850464a0 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.567+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55972/0 (socket says 172.21.15.52:55972) 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 -- 172.21.15.52:0/2034545372 learned_addr learned my addr 172.21.15.52:0/2034545372 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f532b7fe640 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a85046dc0 0x555a85068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f532bfff640 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a850464a0 0x555a850501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 -- 172.21.15.52:0/2034545372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a850464a0 msgr2=0x555a850501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a850464a0 0x555a850501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 -- 172.21.15.52:0/2034545372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a85046dc0 msgr2=0x555a85068df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a85046dc0 0x555a85068df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 -- 172.21.15.52:0/2034545372 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a85042860 con 0x555a85051680 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5330d29640 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f5324000f80 tx=0x7f5324012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b914a98692bb9f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5311ffb640 1 -- 172.21.15.52:0/2034545372 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324041070 con 0x555a85051680 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5311ffb640 1 -- 172.21.15.52:0/2034545372 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5324032b90 con 0x555a85051680 2024-09-19T09:34:06.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.568+0000 7f5311ffb640 1 -- 172.21.15.52:0/2034545372 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324029940 con 0x555a85051680 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- 172.21.15.52:0/2034545372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 msgr2=0x555a85069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f5324000f80 tx=0x7f5324012820 comp rx=0 tx=0).stop 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- 172.21.15.52:0/2034545372 shutdown_connections 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a85069330 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a85046dc0 0x555a85068df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 --2- 172.21.15.52:0/2034545372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a850464a0 0x555a850501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- 172.21.15.52:0/2034545372 >> 172.21.15.52:0/2034545372 conn(0x555a85042a30 msgr2=0x555a8504fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- 172.21.15.52:0/2034545372 shutdown_connections 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- 172.21.15.52:0/2034545372 wait complete. 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.569+0000 7f5334b65740 1 -- start start 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 Processor -- start 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85059d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a85057080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1ae0e0 con 0x555a85051680 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1af550 con 0x555a850464a0 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f532c1ae7b0 con 0x555a85046dc0 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5334b65740 10 client.0 _ll_register_callbacks cb 0x7f532400f800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55986/0 (socket says 172.21.15.52:55986) 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 -- 172.21.15.52:0/1759354090 learned_addr learned my addr 172.21.15.52:0/1759354090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:06.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f532b7fe640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a85057080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f532bfff640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85059d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 -- 172.21.15.52:0/1759354090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 msgr2=0x555a85057080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a85057080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 -- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 msgr2=0x555a85059d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.570+0000 7f5330d29640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85059d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f5330d29640 1 -- 172.21.15.52:0/1759354090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a85057df0 con 0x555a85051680 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f5330d29640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f532400f7d0 tx=0x7f5324032640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b849d3958c9f73f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f530b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324041070 con 0x555a85051680 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5324029670 con 0x555a85051680 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5324032b90 con 0x555a85051680 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f532404b020 con 0x555a85051680 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f5334b65740 10 client.20028 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:06.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555a850cbdd0 con 0x555a85051680 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.571+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5324032b90 con 0x555a85051680 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5324046840 con 0x555a85051680 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 10 client.20028 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 10 client.20028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 20 client.20028 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850cc2e0 0x555a850ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 4 client.20028 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a8504eb30 con 0x555a850cc2e0 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f532bfff640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850cc2e0 0x555a850ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f530b7fe640 10 client.20028 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f532bfff640 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850cc2e0 0x555a850ce6d0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c38daf1a09d96a server_cookie=54ab08bdfeeb1e5e in_seq=0 out_seq=0 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f530b7fe640 1 -- 172.21.15.52:0/1759354090 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555a8504eb30 con 0x555a850cc2e0 2024-09-19T09:34:06.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f530b7fe640 10 client.20028 handle_command_reply: tid=0 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.572+0000 7f5334b65740 1 client.20028 shutdown 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 msgr2=0x555a850575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f532400f7d0 tx=0x7f5324032640 comp rx=0 tx=0).stop 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 shutdown_connections 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555a850cc2e0 0x555a850ce6d0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555a85051680 0x555a850575c0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555a85046dc0 0x555a85057080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f530b7fe640 0 client.20028 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 --2- 172.21.15.52:0/1759354090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555a850464a0 0x555a85059d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 >> 172.21.15.52:0/1759354090 conn(0x555a85042a30 msgr2=0x555a8504c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 shutdown_connections 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 1 -- 172.21.15.52:0/1759354090 wait complete. 2024-09-19T09:34:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f5334b65740 20 client.20028 trim_cache size 0 max 16384 2024-09-19T09:34:06.581 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:06.581 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:34:06.581 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:34:06.581 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 msgr2=0x7f53140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 0x7f53140a5700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5324005fd0 tx=0x7f5324005c80 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 msgr2=0x7f532c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.573+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c920 tx=0x7f531c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 shutdown_connections 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f53140a3240 0x7f53140a5700 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f532c102ef0 0x7f532c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f532c102570 0x7f532c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 --2- 172.21.15.52:0/1079781289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f532c100e20 0x7f532c0fcc80 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 >> 172.21.15.52:0/1079781289 conn(0x7f532c0fc7d0 msgr2=0x7f532c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 shutdown_connections 2024-09-19T09:34:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:06.574+0000 7f533278c640 1 -- 172.21.15.52:0/1079781289 wait complete. 2024-09-19T09:34:07.252 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:07 smithi052 ceph-mon[30947]: pgmap v718: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:34:07.285 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:34:07.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:34:07.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:07 smithi169 ceph-mon[35454]: pgmap v718: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:34:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:07 smithi086 ceph-mon[34813]: pgmap v718: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-09-19T09:34:07.547 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 -- 172.21.15.52:0/521074437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f101027a0 msgr2=0x7f2f101067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 --2- 172.21.15.52:0/521074437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f101027a0 0x7f2f101067f0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f2f00009900 tx=0x7f2f0002a410 comp rx=0 tx=0).stop 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 -- 172.21.15.52:0/521074437 shutdown_connections 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 --2- 172.21.15.52:0/521074437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f10106f20 0x7f2f1010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 --2- 172.21.15.52:0/521074437 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f101027a0 0x7f2f101067f0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 --2- 172.21.15.52:0/521074437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 0x7f2f101021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 -- 172.21.15.52:0/521074437 >> 172.21.15.52:0/521074437 conn(0x7f2f100fd8b0 msgr2=0x7f2f100ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 -- 172.21.15.52:0/521074437 shutdown_connections 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.035+0000 7f2f1845b640 1 -- 172.21.15.52:0/521074437 wait complete. 2024-09-19T09:34:08.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 Processor -- start 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 -- start start 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 0x7f2f10198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 0x7f2f10198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111f80 con 0x7f2f10106f20 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10111e00 con 0x7f2f101027a0 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f1845b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2f10112100 con 0x7f2f10101df0 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f169f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f169f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56014/0 (socket says 172.21.15.52:56014) 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f169f8640 1 -- 172.21.15.52:0/1219219432 learned_addr learned my addr 172.21.15.52:0/1219219432 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f161f7640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 0x7f2f10198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:08.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.036+0000 7f2f159f6640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 0x7f2f10198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 -- 172.21.15.52:0/1219219432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 msgr2=0x7f2f10198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 0x7f2f10198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 -- 172.21.15.52:0/1219219432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 msgr2=0x7f2f10198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 0x7f2f10198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 -- 172.21.15.52:0/1219219432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1019d2b0 con 0x7f2f10106f20 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f159f6640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 0x7f2f10198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f169f8640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c970 tx=0x7f2f0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08007bb0 con 0x7f2f10106f20 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08007d50 con 0x7f2f10106f20 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1019d5a0 con 0x7f2f10106f20 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08018800 con 0x7f2f10106f20 2024-09-19T09:34:08.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.037+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f101a4e80 con 0x7f2f10106f20 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.038+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f101021d0 con 0x7f2f10106f20 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.039+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2f0800fa50 con 0x7f2f10106f20 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.040+0000 7f2f077fe640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 0x7f2efc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.040+0000 7f2f161f7640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 0x7f2efc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.040+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2f080cfc20 con 0x7f2f10106f20 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.041+0000 7f2f161f7640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 0x7f2efc0a5700 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007ec0 tx=0x7f2f0c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:08.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.043+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f08014030 con 0x7f2f10106f20 2024-09-19T09:34:08.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.257+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f101a50b0 con 0x7f2f10106f20 2024-09-19T09:34:08.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.258+0000 7f2f077fe640 1 -- 172.21.15.52:0/1219219432 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f2f0809c860 con 0x7f2f10106f20 2024-09-19T09:34:08.260 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:34:08.260 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:34:08.261 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:34:08.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 msgr2=0x7f2efc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:08.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 0x7f2efc0a5700 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c007ec0 tx=0x7f2f0c0075b0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 msgr2=0x7f2f1019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800c970 tx=0x7f2f0800ce30 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 shutdown_connections 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f10106f20 0x7f2f1019cbd0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f101027a0 0x7f2f10198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2efc0a3240 0x7f2efc0a5700 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 --2- 172.21.15.52:0/1219219432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2f10101df0 0x7f2f10198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 >> 172.21.15.52:0/1219219432 conn(0x7f2f100fd8b0 msgr2=0x7f2f100ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 shutdown_connections 2024-09-19T09:34:08.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:08.260+0000 7f2f1845b640 1 -- 172.21.15.52:0/1219219432 wait complete. 2024-09-19T09:34:08.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:34:09.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:09 smithi052 ceph-mon[30947]: pgmap v719: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:34:09.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:09 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1219219432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:09.188 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:09.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:09 smithi169 ceph-mon[35454]: pgmap v719: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:34:09.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:09 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1219219432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:09 smithi086 ceph-mon[34813]: pgmap v719: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T09:34:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:09 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1219219432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:09.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 -- 172.21.15.52:0/983121795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 msgr2=0x7f7ff81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 --2- 172.21.15.52:0/983121795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff81029b0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f7fec009900 tx=0x7f7fec02a480 comp rx=0 tx=0).stop 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 -- 172.21.15.52:0/983121795 shutdown_connections 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 --2- 172.21.15.52:0/983121795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8102ef0 0x7f7ff810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 --2- 172.21.15.52:0/983121795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff81029b0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 --2- 172.21.15.52:0/983121795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8100e20 0x7f7ff8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 -- 172.21.15.52:0/983121795 >> 172.21.15.52:0/983121795 conn(0x7f7ff80fc7d0 msgr2=0x7f7ff80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 -- 172.21.15.52:0/983121795 shutdown_connections 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.645+0000 7f7ffd002640 1 -- 172.21.15.52:0/983121795 wait complete. 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 Processor -- start 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 -- start start 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8100e20 0x7f7ff819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8102ef0 0x7f7ff819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8110f80 con 0x7f7ff8102570 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8110e00 con 0x7f7ff8100e20 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ffd002640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff8111100 con 0x7f7ff8102ef0 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.646+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49572/0 (socket says 172.21.15.52:49572) 2024-09-19T09:34:09.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 -- 172.21.15.52:0/2484045373 learned_addr learned my addr 172.21.15.52:0/2484045373 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff759e640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8102ef0 0x7f7ff819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8100e20 0x7f7ff819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 -- 172.21.15.52:0/2484045373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8102ef0 msgr2=0x7f7ff819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8102ef0 0x7f7ff819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 -- 172.21.15.52:0/2484045373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8100e20 msgr2=0x7f7ff819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8100e20 0x7f7ff819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 -- 172.21.15.52:0/2484045373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff819f660 con 0x7f7ff8102570 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ff659c640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f7fec006010 tx=0x7f7fec003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7fdffff640 1 -- 172.21.15.52:0/2484045373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec03f070 con 0x7f7ff8102570 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff819f8f0 con 0x7f7ff8102570 2024-09-19T09:34:09.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7fdffff640 1 -- 172.21.15.52:0/2484045373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fec031c30 con 0x7f7ff8102570 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7fdffff640 1 -- 172.21.15.52:0/2484045373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec035030 con 0x7f7ff8102570 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.647+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff81a7230 con 0x7f7ff8102570 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.650+0000 7f7fdffff640 1 -- 172.21.15.52:0/2484045373 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7fec042070 con 0x7f7ff8102570 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.650+0000 7f7fff3db740 1 Processor -- start 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.650+0000 7f7fff3db740 1 -- start start 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.650+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 0x55b1154a0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fff3db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1154062f0 con 0x55b1154ab370 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fff3db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b1153adcf0 con 0x55b1154a1b40 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fff3db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1154022b0 con 0x55b1154a05d0 2024-09-19T09:34:09.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff759e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 0x55b1154a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49580/0 (socket says 172.21.15.52:49580) 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 -- 172.21.15.52:0/3908049900 learned_addr learned my addr 172.21.15.52:0/3908049900 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fdffff640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 0x7f7fe00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 -- 172.21.15.52:0/3908049900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 msgr2=0x55b1154a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154a0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 -- 172.21.15.52:0/3908049900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 msgr2=0x55b1154a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 0x55b1154a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff659c640 1 -- 172.21.15.52:0/3908049900 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1153923a0 con 0x55b1154ab370 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7fdffff640 1 -- 172.21.15.52:0/2484045373 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7fec0efff0 con 0x7f7ff8102570 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff759e640 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 0x55b1154a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:09.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.651+0000 7f7ff759e640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 0x7f7fe00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.652+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f7fec03a750 tx=0x7f7fec0b1b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1425f9d7c1d416c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.652+0000 7f7fdd7fa640 1 -- 172.21.15.52:0/3908049900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0bbfa0 con 0x55b1154ab370 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.652+0000 7f7fdd7fa640 1 -- 172.21.15.52:0/3908049900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fec0bc640 con 0x55b1154ab370 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.652+0000 7f7fdd7fa640 1 -- 172.21.15.52:0/3908049900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec042360 con 0x55b1154ab370 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- 172.21.15.52:0/3908049900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 msgr2=0x55b1154ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7ff759e640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 0x7f7fe00a5700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f7fec03a750 tx=0x7f7fec0b1b20 comp rx=0 tx=0).stop 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- 172.21.15.52:0/3908049900 shutdown_connections 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154ad760 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154a0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3908049900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a1b40 0x55b1154a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- 172.21.15.52:0/3908049900 >> 172.21.15.52:0/3908049900 conn(0x55b115469310 msgr2=0x55b11549cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- 172.21.15.52:0/3908049900 shutdown_connections 2024-09-19T09:34:09.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- 172.21.15.52:0/3908049900 wait complete. 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 -- start start 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 Processor -- start 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.653+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154a8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b1154ade30 con 0x55b1154a1b40 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b1153c1060 con 0x55b1154ab370 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1154adfb0 con 0x55b1154a05d0 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 10 client.0 _ll_register_callbacks cb 0x55b1151148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49582/0 (socket says 172.21.15.52:49582) 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 -- 172.21.15.52:0/3640630668 learned_addr learned my addr 172.21.15.52:0/3640630668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:09.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff759e640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 -- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 msgr2=0x55b1154aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 -- 172.21.15.52:0/3640630668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 msgr2=0x55b1154a8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154a8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 -- 172.21.15.52:0/3640630668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1151773c0 con 0x55b1154a1b40 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7ff659c640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ace92af74c69261 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fec049040 con 0x55b1154a1b40 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7fec0f3760 con 0x55b1154a1b40 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.654+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fec0bc640 con 0x55b1154a1b40 2024-09-19T09:34:09.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fec0bbfa0 con 0x55b1154a1b40 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 10 client.20046 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b1154ade30 con 0x55b1154a1b40 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fec0bc640 con 0x55b1154a1b40 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7fec0b8cb0 con 0x55b1154a1b40 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 10 client.20046 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 10 client.20046 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 20 client.20046 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b1154baaa0 0x55b1154bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 4 client.20046 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b115413860 con 0x55b1154baaa0 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.655+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b1154baaa0 0x55b1154bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.656+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b1154baaa0 0x55b1154bcec0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=911b892f092b14f9 server_cookie=ea33271bdfd06476 in_seq=0 out_seq=0 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.656+0000 7f7fdaff5640 10 client.20046 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:09.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.656+0000 7f7fdaff5640 1 -- 172.21.15.52:0/3640630668 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b115413860 con 0x55b1154baaa0 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.656+0000 7f7fdaff5640 10 client.20046 handle_command_reply: tid=0 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 client.20046 shutdown 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 msgr2=0x55b1154a7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f7fec000c00 tx=0x7f7fec005b70 comp rx=0 tx=0).stop 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 shutdown_connections 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b1154baaa0 0x55b1154bcec0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154a8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a1b40 0x55b1154a7fd0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 --2- 172.21.15.52:0/3640630668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a05d0 0x55b1154aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 >> 172.21.15.52:0/3640630668 conn(0x55b115469310 msgr2=0x55b1154a2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fdaff5640 0 client.20046 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:09.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 shutdown_connections 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 1 -- 172.21.15.52:0/3640630668 wait complete. 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.657+0000 7f7fff3db740 20 client.20046 trim_cache size 0 max 16384 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 Processor -- start 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 -- start start 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154a6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81b2280 con 0x55b1154a05d0 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81afb50 con 0x55b1154ab370 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7fff3db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81ad9a0 con 0x55b1154a1b40 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49586/0 (socket says 172.21.15.52:49586) 2024-09-19T09:34:09.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 -- 172.21.15.52:0/1712776891 learned_addr learned my addr 172.21.15.52:0/1712776891 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff759e640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff659c640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154a6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 -- 172.21.15.52:0/1712776891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 msgr2=0x55b1154a6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154a6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 -- 172.21.15.52:0/1712776891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 msgr2=0x55b1154c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.670+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7ff6d9d640 1 -- 172.21.15.52:0/1712776891 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1154a3bd0 con 0x55b1154a05d0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7ff659c640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7ff759e640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8004610 tx=0x7f7fe800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4cfbc3fd17cb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7fdcff9640 1 -- 172.21.15.52:0/1712776891 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8003e10 con 0x55b1154a05d0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7fdcff9640 1 -- 172.21.15.52:0/1712776891 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe8026920 con 0x55b1154a05d0 2024-09-19T09:34:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.671+0000 7f7fdcff9640 1 -- 172.21.15.52:0/1712776891 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe80118e0 con 0x55b1154a05d0 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- 172.21.15.52:0/1712776891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 msgr2=0x55b1154b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8004610 tx=0x7f7fe800b390 comp rx=0 tx=0).stop 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- 172.21.15.52:0/1712776891 shutdown_connections 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154ab370 0x55b1154c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154a6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- 172.21.15.52:0/1712776891 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154a05d0 0x55b1154b7000 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- 172.21.15.52:0/1712776891 >> 172.21.15.52:0/1712776891 conn(0x55b115469310 msgr2=0x55b1154a68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- 172.21.15.52:0/1712776891 shutdown_connections 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- 172.21.15.52:0/1712776891 wait complete. 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- start start 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 Processor -- start 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 0x55b1154b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81ae010 con 0x55b1154ab370 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81af480 con 0x55b1154a05d0 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.672+0000 7f7fff3db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff81ae6e0 con 0x55b1154a1b40 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7fff3db740 10 client.0 _ll_register_callbacks cb 0x7f7ff0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49602/0 (socket says 172.21.15.52:49602) 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 -- 172.21.15.52:0/607791670 learned_addr learned my addr 172.21.15.52:0/607791670 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff6d9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 0x55b1154b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff659c640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 -- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 msgr2=0x55b1154aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 -- 172.21.15.52:0/607791670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 msgr2=0x55b1154b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 0x55b1154b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 -- 172.21.15.52:0/607791670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b11549c4f0 con 0x55b1154ab370 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 0x55b1154b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7ff759e640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00209a0 tx=0x7f7ff0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f5bd4d82e80c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7fdaff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff002f060 con 0x55b1154ab370 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7ff001edc0 con 0x55b1154ab370 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.673+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fe8026920 con 0x55b1154ab370 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7ff002a450 con 0x55b1154ab370 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 10 client.20052 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b1155253e0 con 0x55b1154ab370 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7fe8026920 con 0x55b1154ab370 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7ff00107f0 con 0x55b1154ab370 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 10 client.20052 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 10 client.20052 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 20 client.20052 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b115525b60 0x55b115527f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 4 client.20052 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b11540dd70 con 0x55b115525b60 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.674+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b115525b60 0x55b115527f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fdaff5640 10 client.20052 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7ff6d9d640 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b115525b60 0x55b115527f80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7216d8deabd1444 server_cookie=5289aa724e0537dc in_seq=0 out_seq=0 2024-09-19T09:34:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fdaff5640 1 -- 172.21.15.52:0/607791670 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b11540dd70 con 0x55b115525b60 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fdaff5640 10 client.20052 handle_command_reply: tid=0 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 client.20052 shutdown 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 msgr2=0x55b1154af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00209a0 tx=0x7f7ff0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 shutdown_connections 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b115525b60 0x55b115527f80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b1154ab370 0x55b1154af090 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1154a1b40 0x55b1154aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 --2- 172.21.15.52:0/607791670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b1154a05d0 0x55b1154b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 >> 172.21.15.52:0/607791670 conn(0x55b115469310 msgr2=0x55b1154a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fdaff5640 0 client.20052 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 shutdown_connections 2024-09-19T09:34:09.731 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 1 -- 172.21.15.52:0/607791670 wait complete. 2024-09-19T09:34:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.675+0000 7f7fff3db740 20 client.20052 trim_cache size 0 max 16384 2024-09-19T09:34:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 msgr2=0x7f7fe00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 0x7f7fe00a5700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0004a40 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 msgr2=0x7f7ff819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f7fec006010 tx=0x7f7fec003c10 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 shutdown_connections 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7fe00a3240 0x7f7fe00a5700 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ff8102ef0 0x7f7ff819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ff8102570 0x7f7ff819abf0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 --2- 172.21.15.52:0/2484045373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ff8100e20 0x7f7ff819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 >> 172.21.15.52:0/2484045373 conn(0x7f7ff80fc7d0 msgr2=0x7f7ff80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 shutdown_connections 2024-09-19T09:34:09.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:09.676+0000 7f7ffd002640 1 -- 172.21.15.52:0/2484045373 wait complete. 2024-09-19T09:34:10.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:34:10.534 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- 172.21.15.52:0/3659436274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378102790 msgr2=0x7f23781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 --2- 172.21.15.52:0/3659436274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378102790 0x7f23781067e0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f2368009900 tx=0x7f236802a410 comp rx=0 tx=0).stop 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- 172.21.15.52:0/3659436274 shutdown_connections 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 --2- 172.21.15.52:0/3659436274 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 0x7f237810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 --2- 172.21.15.52:0/3659436274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378102790 0x7f23781067e0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 --2- 172.21.15.52:0/3659436274 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378101de0 0x7f23781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- 172.21.15.52:0/3659436274 >> 172.21.15.52:0/3659436274 conn(0x7f23780fd8c0 msgr2=0x7f23780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- 172.21.15.52:0/3659436274 shutdown_connections 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- 172.21.15.52:0/3659436274 wait complete. 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 Processor -- start 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.000+0000 7f238070d640 1 -- start start 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378102790 0x7f2378074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 0x7f2378074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2378111f70 con 0x7f2378101de0 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2378111df0 con 0x7f2378106f10 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f23781120f0 con 0x7f2378102790 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49620/0 (socket says 172.21.15.52:49620) 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 -- 172.21.15.52:0/1194652358 learned_addr learned my addr 172.21.15.52:0/1194652358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237ecaa640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 0x7f2378074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237dca8640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378102790 0x7f2378074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 -- 172.21.15.52:0/1194652358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378102790 msgr2=0x7f2378074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378102790 0x7f2378074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 -- 172.21.15.52:0/1194652358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 msgr2=0x7f2378074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 0x7f2378074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 -- 172.21.15.52:0/1194652358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23781a6890 con 0x7f2378101de0 2024-09-19T09:34:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f237e4a9640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f237400c970 tx=0x7f237400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374007bb0 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23781a6b80 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.001+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2374007d50 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.002+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237400f450 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.002+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23781a70c0 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.002+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23781021c0 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.004+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2374005020 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.004+0000 7f236f7fe640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 0x7f23640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.005+0000 7f237dca8640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 0x7f23640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.005+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f23740cf7b0 con 0x7f2378101de0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.005+0000 7f237dca8640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 0x7f23640a5780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f23680096c0 tx=0x7f2368000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.009+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2374014030 con 0x7f2378101de0 2024-09-19T09:34:11.058 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:11.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:11 smithi052 ceph-mon[30947]: pgmap v720: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:34:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.236+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f237802d7c0 con 0x7f2378101de0 2024-09-19T09:34:11.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.236+0000 7f236f7fe640 1 -- 172.21.15.52:0/1194652358 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f237409c450 con 0x7f2378101de0 2024-09-19T09:34:11.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:34:11.239 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:34:11.239 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:34:11.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 msgr2=0x7f23640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:11.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 0x7f23640a5780 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f23680096c0 tx=0x7f2368000bc0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 msgr2=0x7f23780744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f237400c970 tx=0x7f237400ce30 comp rx=0 tx=0).stop 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 shutdown_connections 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2378106f10 0x7f2378074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f23640a32c0 0x7f23640a5780 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2378102790 0x7f2378074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 --2- 172.21.15.52:0/1194652358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2378101de0 0x7f23780744f0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 >> 172.21.15.52:0/1194652358 conn(0x7f23780fd8c0 msgr2=0x7f23780fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 shutdown_connections 2024-09-19T09:34:11.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:11.239+0000 7f238070d640 1 -- 172.21.15.52:0/1194652358 wait complete. 2024-09-19T09:34:11.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:11 smithi169 ceph-mon[35454]: pgmap v720: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:34:11.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:11 smithi086 ceph-mon[34813]: pgmap v720: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-19T09:34:12.023 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id c34bac4f --release --await' 2024-09-19T09:34:12.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id c34bac4f --release --await 2024-09-19T09:34:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 -- 172.21.15.52:0/1657753634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c102dd0 msgr2=0x7f164c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 --2- 172.21.15.52:0/1657753634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c102dd0 0x7f164c1031b0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f1634009930 tx=0x7f163402a440 comp rx=0 tx=0).stop 2024-09-19T09:34:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 -- 172.21.15.52:0/1657753634 shutdown_connections 2024-09-19T09:34:12.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 --2- 172.21.15.52:0/1657753634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c108300 0x7f164c10ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 --2- 172.21.15.52:0/1657753634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 0x7f164c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 --2- 172.21.15.52:0/1657753634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c102dd0 0x7f164c1031b0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 -- 172.21.15.52:0/1657753634 >> 172.21.15.52:0/1657753634 conn(0x7f164c0fc7d0 msgr2=0x7f164c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 -- 172.21.15.52:0/1657753634 shutdown_connections 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.213+0000 7f16530bf640 1 -- 172.21.15.52:0/1657753634 wait complete. 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 Processor -- start 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 -- start start 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c102dd0 0x7f164c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 0x7f164c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f164c112170 con 0x7f164c108300 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f164c111ff0 con 0x7f164c102dd0 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f16530bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1122f0 con 0x7f164c103780 2024-09-19T09:34:12.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f165165c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f165165c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49632/0 (socket says 172.21.15.52:49632) 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f165165c640 1 -- 172.21.15.52:0/4258356723 learned_addr learned my addr 172.21.15.52:0/4258356723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f164bfff640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 0x7f164c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.214+0000 7f1650e5b640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c102dd0 0x7f164c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 -- 172.21.15.52:0/4258356723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 msgr2=0x7f164c198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 0x7f164c198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 -- 172.21.15.52:0/4258356723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c102dd0 msgr2=0x7f164c198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c102dd0 0x7f164c198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 -- 172.21.15.52:0/4258356723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c19d6c0 con 0x7f164c108300 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f165165c640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1644009fd0 tx=0x7f164400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f1649ffb640 1 -- 172.21.15.52:0/4258356723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164401d070 con 0x7f164c108300 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f1649ffb640 1 -- 172.21.15.52:0/4258356723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1644018440 con 0x7f164c108300 2024-09-19T09:34:12.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c19d9b0 con 0x7f164c108300 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f1649ffb640 1 -- 172.21.15.52:0/4258356723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440165a0 con 0x7f164c108300 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.215+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c100960 con 0x7f164c108300 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.218+0000 7f1655498740 1 Processor -- start 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1649ffb640 1 -- 172.21.15.52:0/4258356723 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1644020070 con 0x7f164c108300 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 -- start start 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a678302f0 con 0x563a678ca5d0 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563a677d7cf0 con 0x563a678cbb40 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1655498740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563a6782c2b0 con 0x563a678ddb80 2024-09-19T09:34:12.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49648/0 (socket says 172.21.15.52:49648) 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f1650e5b640 1 -- 172.21.15.52:0/2493796276 learned_addr learned my addr 172.21.15.52:0/2493796276 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f164bfff640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.219+0000 7f164bfff640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1649ffb640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 0x7f16380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 -- 172.21.15.52:0/2493796276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 msgr2=0x563a678ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 -- 172.21.15.52:0/2493796276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 msgr2=0x563a678caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 -- 172.21.15.52:0/2493796276 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a677bc3a0 con 0x563a678ddb80 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1650e5b640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:12.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1649ffb640 1 -- 172.21.15.52:0/4258356723 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f16440d2ba0 con 0x7f164c108300 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f165165c640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 0x7f16380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f164bfff640 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dff70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f164c06a2d0 tx=0x7f163c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d50a08c1b98fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1642ffd640 1 -- 172.21.15.52:0/2493796276 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c014040 con 0x563a678ddb80 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1642ffd640 1 -- 172.21.15.52:0/2493796276 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c01b430 con 0x563a678ddb80 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.220+0000 7f1642ffd640 1 -- 172.21.15.52:0/2493796276 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c01a640 con 0x563a678ddb80 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 -- 172.21.15.52:0/2493796276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 msgr2=0x563a678dff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dff70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f164c06a2d0 tx=0x7f163c009b20 comp rx=0 tx=0).stop 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f165165c640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 0x7f16380a5780 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f164409b5f0 tx=0x7f16440046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 -- 172.21.15.52:0/2493796276 shutdown_connections 2024-09-19T09:34:12.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dff70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 --2- 172.21.15.52:0/2493796276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 -- 172.21.15.52:0/2493796276 >> 172.21.15.52:0/2493796276 conn(0x563a67893310 msgr2=0x563a678c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 -- 172.21.15.52:0/2493796276 shutdown_connections 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.221+0000 7f1655498740 1 -- 172.21.15.52:0/2493796276 wait complete. 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 -- start start 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 Processor -- start 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ca5d0 0x563a678dd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563a678e0820 con 0x563a678cbb40 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563a677eb060 con 0x563a678ca5d0 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563a678e09a0 con 0x563a678ddb80 2024-09-19T09:34:12.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1655498740 10 client.0 _ll_register_callbacks cb 0x563a6753e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49650/0 (socket says 172.21.15.52:49650) 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.222+0000 7f1650e5b640 1 -- 172.21.15.52:0/224505166 learned_addr learned my addr 172.21.15.52:0/224505166 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f164bfff640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ca5d0 0x563a678dd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f164bfff640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 -- 172.21.15.52:0/224505166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 msgr2=0x563a678dae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 -- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ca5d0 msgr2=0x563a678dd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ca5d0 0x563a678dd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 -- 172.21.15.52:0/224505166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a675a13c0 con 0x563a678cbb40 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f164bfff640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1650e5b640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1634009230 tx=0x7f1634031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78442cd5a6d9366 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f162bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634035040 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f16340042c0 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.223+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c01b430 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16340044c0 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 10 client.20070 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563a678ec2f0 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c01b430 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1634046940 con 0x563a678cbb40 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 10 client.20070 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 10 client.20070 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 20 client.20070 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a678ed7b0 0x563a678efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 4 client.20070 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.224+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a6783d860 con 0x563a678ed7b0 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.225+0000 7f164bfff640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a678ed7b0 0x563a678efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.225+0000 7f164bfff640 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a678ed7b0 0x563a678efbc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=27423a41bcf50700 server_cookie=87771177965d898a in_seq=0 out_seq=0 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.225+0000 7f162bfff640 10 client.20070 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f162bfff640 1 -- 172.21.15.52:0/224505166 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a6783d860 con 0x563a678ed7b0 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f162bfff640 10 client.20070 handle_command_reply: tid=0 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 client.20070 shutdown 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 msgr2=0x563a678da850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f1634009230 tx=0x7f1634031a60 comp rx=0 tx=0).stop 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 shutdown_connections 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ddb80 0x563a678dae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678cbb40 0x563a678da850 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a678ed7b0 0x563a678efbc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 --2- 172.21.15.52:0/224505166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ca5d0 0x563a678dd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 >> 172.21.15.52:0/224505166 conn(0x563a67893310 msgr2=0x563a678cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f162bfff640 0 client.20070 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 shutdown_connections 2024-09-19T09:34:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 1 -- 172.21.15.52:0/224505166 wait complete. 2024-09-19T09:34:12.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.226+0000 7f1655498740 20 client.20070 trim_cache size 0 max 16384 2024-09-19T09:34:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 Processor -- start 2024-09-19T09:34:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 -- start start 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678cbb40 0x563a678dc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ddb80 0x563a678f5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1ae020 con 0x563a678ca5d0 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1ab8f0 con 0x563a678ddb80 2024-09-19T09:34:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1655498740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1a9740 con 0x563a678cbb40 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49660/0 (socket says 172.21.15.52:49660) 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 -- 172.21.15.52:0/2197012040 learned_addr learned my addr 172.21.15.52:0/2197012040 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f1650e5b640 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678cbb40 0x563a678dc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 -- 172.21.15.52:0/2197012040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678cbb40 msgr2=0x563a678dc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678cbb40 0x563a678dc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.240+0000 7f164bfff640 1 -- 172.21.15.52:0/2197012040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ddb80 msgr2=0x563a678f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f164bfff640 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ddb80 0x563a678f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f164bfff640 1 -- 172.21.15.52:0/2197012040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a678f0240 con 0x563a678ca5d0 2024-09-19T09:34:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f164bfff640 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d010 tx=0x7f163c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd81bbdfaaa7c4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f16427fc640 1 -- 172.21.15.52:0/2197012040 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c00b040 con 0x563a678ca5d0 2024-09-19T09:34:12.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f16427fc640 1 -- 172.21.15.52:0/2197012040 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c01b910 con 0x563a678ca5d0 2024-09-19T09:34:12.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.241+0000 7f16427fc640 1 -- 172.21.15.52:0/2197012040 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c027670 con 0x563a678ca5d0 2024-09-19T09:34:12.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- 172.21.15.52:0/2197012040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 msgr2=0x563a678e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f163c00d010 tx=0x7f163c00b700 comp rx=0 tx=0).stop 2024-09-19T09:34:12.247 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:12 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1194652358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- 172.21.15.52:0/2197012040 shutdown_connections 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678ddb80 0x563a678f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678cbb40 0x563a678dc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 --2- 172.21.15.52:0/2197012040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ca5d0 0x563a678e9ac0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- 172.21.15.52:0/2197012040 >> 172.21.15.52:0/2197012040 conn(0x563a67893310 msgr2=0x563a678dc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- 172.21.15.52:0/2197012040 shutdown_connections 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- 172.21.15.52:0/2197012040 wait complete. 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.242+0000 7f1655498740 1 -- start start 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 Processor -- start 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ca5d0 0x563a678e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 0x563a67957460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1a9db0 con 0x563a678ddb80 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1ab220 con 0x563a678cbb40 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f164c1aa480 con 0x563a678ca5d0 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1655498740 10 client.0 _ll_register_callbacks cb 0x7f1634009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1650e5b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47078/0 (socket says 172.21.15.52:47078) 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.243+0000 7f1650e5b640 1 -- 172.21.15.52:0/1754355200 learned_addr learned my addr 172.21.15.52:0/1754355200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 -- 172.21.15.52:0/1754355200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ca5d0 msgr2=0x563a678e1d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ca5d0 0x563a678e1d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 -- 172.21.15.52:0/1754355200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 msgr2=0x563a67957460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f164bfff640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 0x563a67957460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 0x563a67957460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 -- 172.21.15.52:0/1754355200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a679579a0 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f164bfff640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 0x563a67957460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f1650e5b640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1634009850 tx=0x7f1634031ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d6a5e31cf0dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.244+0000 7f162bfff640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634035040 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f163403dc30 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f163c01b910 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f163403de50 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f1655498740 10 client.28712 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563a67958b00 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.245+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f163c01b910 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f16340508c0 con 0x563a678cbb40 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 10 client.28712 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 10 client.28712 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:34:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 20 client.28712 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a67959240 0x563a6795b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 4 client.28712 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a67837d70 con 0x563a67959240 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.246+0000 7f164bfff640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a67959240 0x563a6795b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f162bfff640 10 client.28712 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f164bfff640 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a67959240 0x563a6795b660 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6dd20a42b9f8b79d server_cookie=98f52583a911cc99 in_seq=0 out_seq=0 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f162bfff640 1 -- 172.21.15.52:0/1754355200 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a67837d70 con 0x563a67959240 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f162bfff640 10 client.28712 handle_command_reply: tid=0 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 client.28712 shutdown 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 msgr2=0x563a678e2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1634009850 tx=0x7f1634031ad0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 shutdown_connections 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563a678ddb80 0x563a67957460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563a67959240 0x563a6795b660 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f162bfff640 0 client.28712 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563a678cbb40 0x563a678e2290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 --2- 172.21.15.52:0/1754355200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563a678ca5d0 0x563a678e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.247+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 >> 172.21.15.52:0/1754355200 conn(0x563a67893310 msgr2=0x563a678dc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.248+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 shutdown_connections 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.248+0000 7f1655498740 1 -- 172.21.15.52:0/1754355200 wait complete. 2024-09-19T09:34:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.248+0000 7f1655498740 20 client.28712 trim_cache size 0 max 16384 2024-09-19T09:34:12.258 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.248+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 msgr2=0x7f16380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.248+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 0x7f16380a5780 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f164409b5f0 tx=0x7f16440046c0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 msgr2=0x7f164c19cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f1644009fd0 tx=0x7f164400b8e0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 shutdown_connections 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f164c108300 0x7f164c19cfe0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f16380a32c0 0x7f16380a5780 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f164c103780 0x7f164c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 --2- 172.21.15.52:0/4258356723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f164c102dd0 0x7f164c198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 >> 172.21.15.52:0/4258356723 conn(0x7f164c0fc7d0 msgr2=0x7f164c105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 shutdown_connections 2024-09-19T09:34:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:12.249+0000 7f16530bf640 1 -- 172.21.15.52:0/4258356723 wait complete. 2024-09-19T09:34:12.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:12 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1194652358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:12.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:12 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1194652358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:13.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:34:13.065 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:13.360 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:13 smithi052 ceph-mon[30947]: pgmap v721: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-19T09:34:13.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:13 smithi169 ceph-mon[35454]: pgmap v721: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-19T09:34:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:13 smithi086 ceph-mon[34813]: pgmap v721: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 -- 172.21.15.52:0/2031048549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec108290 msgr2=0x7f02ec10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 --2- 172.21.15.52:0/2031048549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec108290 0x7f02ec10ec30 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009cd0 tx=0x7f02e402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 -- 172.21.15.52:0/2031048549 shutdown_connections 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 --2- 172.21.15.52:0/2031048549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec108290 0x7f02ec10ec30 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 --2- 172.21.15.52:0/2031048549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec103740 0x7f02ec107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 --2- 172.21.15.52:0/2031048549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec102d90 0x7f02ec103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 -- 172.21.15.52:0/2031048549 >> 172.21.15.52:0/2031048549 conn(0x7f02ec0fc7d0 msgr2=0x7f02ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 -- 172.21.15.52:0/2031048549 shutdown_connections 2024-09-19T09:34:13.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.576+0000 7f02f0acc640 1 -- 172.21.15.52:0/2031048549 wait complete. 2024-09-19T09:34:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.577+0000 7f02f0acc640 1 Processor -- start 2024-09-19T09:34:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.577+0000 7f02f0acc640 1 -- start start 2024-09-19T09:34:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 0x7f02ec100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 0x7f02ec101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1120a0 con 0x7f02ec102d90 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec111f20 con 0x7f02ec108290 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02f0acc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec112220 con 0x7f02ec103740 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49682/0 (socket says 172.21.15.52:49682) 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 -- 172.21.15.52:0/1036962143 learned_addr learned my addr 172.21.15.52:0/1036962143 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 0x7f02ec101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02e3fff640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 0x7f02ec100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 -- 172.21.15.52:0/1036962143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 msgr2=0x7f02ec100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 0x7f02ec100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 -- 172.21.15.52:0/1036962143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 msgr2=0x7f02ec101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 0x7f02ec101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ea59c640 1 -- 172.21.15.52:0/1036962143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec1a6980 con 0x7f02ec102d90 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02e3fff640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 0x7f02ec100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.578+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 0x7f02ec101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02ea59c640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c920 tx=0x7f02dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02e37fe640 1 -- 172.21.15.52:0/1036962143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc007c70 con 0x7f02ec102d90 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ec1a6c70 con 0x7f02ec102d90 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02e37fe640 1 -- 172.21.15.52:0/1036962143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc007e10 con 0x7f02ec102d90 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ec1a71b0 con 0x7f02ec102d90 2024-09-19T09:34:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.579+0000 7f02e37fe640 1 -- 172.21.15.52:0/1036962143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc018890 con 0x7f02ec102d90 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02e37fe640 1 -- 172.21.15.52:0/1036962143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f02dc018b30 con 0x7f02ec102d90 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 Processor -- start 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 -- start start 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2497d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e249a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5e23f2620 con 0x55a5e248d060 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5e2399e50 con 0x55a5e248d980 2024-09-19T09:34:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.582+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5e23ee5e0 con 0x55a5e2498240 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49688/0 (socket says 172.21.15.52:49688) 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 -- 172.21.15.52:0/3415174107 learned_addr learned my addr 172.21.15.52:0/3415174107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02e37fe640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 0x7f02d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ea59c640 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2497d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02e3fff640 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e249a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 0x7f02d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 -- 172.21.15.52:0/3415174107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 msgr2=0x55a5e249a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e249a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 -- 172.21.15.52:0/3415174107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 msgr2=0x55a5e2497d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2497d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02e37fe640 1 -- 172.21.15.52:0/1036962143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02dc0cfa40 con 0x7f02ec102d90 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.583+0000 7f02ead9d640 1 -- 172.21.15.52:0/3415174107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e238ad40 con 0x55a5e248d060 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.584+0000 7f02ead9d640 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f02e4031860 tx=0x7f02e4031e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83c609766e4e096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.584+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 0x7f02d80a5780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f02e4048000 tx=0x7f02e404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.584+0000 7f02e0ff9640 1 -- 172.21.15.52:0/3415174107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4050070 con 0x55a5e248d060 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.584+0000 7f02e0ff9640 1 -- 172.21.15.52:0/3415174107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4036040 con 0x55a5e248d060 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.584+0000 7f02e0ff9640 1 -- 172.21.15.52:0/3415174107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e403b620 con 0x55a5e248d060 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- 172.21.15.52:0/3415174107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 msgr2=0x55a5e248d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f02e4031860 tx=0x7f02e4031e10 comp rx=0 tx=0).stop 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- 172.21.15.52:0/3415174107 shutdown_connections 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e249a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2497d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/3415174107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e248d440 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- 172.21.15.52:0/3415174107 >> 172.21.15.52:0/3415174107 conn(0x55a5e24895f0 msgr2=0x55a5e24899d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- 172.21.15.52:0/3415174107 shutdown_connections 2024-09-19T09:34:13.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- 172.21.15.52:0/3415174107 wait complete. 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 -- start start 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.585+0000 7f02f2ea5740 1 Processor -- start 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 0x55a5e2495150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d980 0x55a5e2495690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a5e249ae10 con 0x55a5e2498240 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a5e237af10 con 0x55a5e248d060 2024-09-19T09:34:13.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a5e249af90 con 0x55a5e248d980 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02f2ea5740 10 client.0 _ll_register_callbacks cb 0x55a5e239edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ea59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 0x55a5e2495150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49698/0 (socket says 172.21.15.52:49698) 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 -- 172.21.15.52:0/2491534888 learned_addr learned my addr 172.21.15.52:0/2491534888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02e3fff640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d980 0x55a5e2495690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 -- 172.21.15.52:0/2491534888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d980 msgr2=0x55a5e2495690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d980 0x55a5e2495690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 -- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 msgr2=0x55a5e2495150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 0x55a5e2495150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 -- 172.21.15.52:0/2491534888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e2101580 con 0x55a5e2498240 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ea59c640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 0x55a5e2495150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:13.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02ead9d640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f02e4004aa0 tx=0x7f02e4030c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1759959b986953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.586+0000 7f02d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4050040 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02e4030860 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e4036040 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02e404b450 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 10 client.20085 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5e21cb960 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4036040 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02e4030070 con 0x55a5e2498240 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 10 client.20085 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 10 client.20085 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 20 client.20085 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e24a7ca0 0x55a5e24aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 4 client.20085 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.587+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5e23ffb90 con 0x55a5e24a7ca0 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.588+0000 7f02ea59c640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e24a7ca0 0x55a5e24aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.588+0000 7f02d1ffb640 10 client.20085 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.588+0000 7f02ea59c640 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e24a7ca0 0x55a5e24aa090 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d204654af51e1098 server_cookie=701530293dc6a210 in_seq=0 out_seq=0 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02d1ffb640 1 -- 172.21.15.52:0/2491534888 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5e23ffb90 con 0x55a5e24a7ca0 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02d1ffb640 10 client.20085 handle_command_reply: tid=0 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 client.20085 shutdown 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 msgr2=0x55a5e2495bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f02e4004aa0 tx=0x7f02e4030c00 comp rx=0 tx=0).stop 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 shutdown_connections 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e24a7ca0 0x55a5e24aa090 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2495bd0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d980 0x55a5e2495690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/2491534888 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d060 0x55a5e2495150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 >> 172.21.15.52:0/2491534888 conn(0x55a5e24895f0 msgr2=0x55a5e248f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02d1ffb640 0 client.20085 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.589+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 shutdown_connections 2024-09-19T09:34:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.590+0000 7f02f2ea5740 1 -- 172.21.15.52:0/2491534888 wait complete. 2024-09-19T09:34:13.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.590+0000 7f02f2ea5740 20 client.20085 trim_cache size 0 max 16384 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.619+0000 7f02f2ea5740 1 Processor -- start 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.619+0000 7f02f2ea5740 1 -- start start 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e24940b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e24af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1b2240 con 0x55a5e248d060 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1afb10 con 0x55a5e248d980 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1ad960 con 0x55a5e2498240 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e24940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02e3fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e24af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:55184/0 (socket says 172.21.15.52:55184) 2024-09-19T09:34:13.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.620+0000 7f02ead9d640 1 -- 172.21.15.52:0/491626690 learned_addr learned my addr 172.21.15.52:0/491626690 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 -- 172.21.15.52:0/491626690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 msgr2=0x55a5e24af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e24af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 -- 172.21.15.52:0/491626690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 msgr2=0x55a5e24940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e24940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 -- 172.21.15.52:0/491626690 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5e2487bb0 con 0x55a5e2498240 2024-09-19T09:34:13.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02e3fff640 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e24af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ea59c640 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e24940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02ead9d640 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009a60 tx=0x7f02e4005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4772f511faa45d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02d3fff640 1 -- 172.21.15.52:0/491626690 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4050070 con 0x55a5e2498240 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02d3fff640 1 -- 172.21.15.52:0/491626690 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4036030 con 0x55a5e2498240 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.621+0000 7f02d3fff640 1 -- 172.21.15.52:0/491626690 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e405ce90 con 0x55a5e2498240 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 -- 172.21.15.52:0/491626690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 msgr2=0x55a5e24afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009a60 tx=0x7f02e4005da0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 -- 172.21.15.52:0/491626690 shutdown_connections 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e2498240 0x55a5e24afc80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e24af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/491626690 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e248d060 0x55a5e24940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 -- 172.21.15.52:0/491626690 >> 172.21.15.52:0/491626690 conn(0x55a5e24895f0 msgr2=0x55a5e24971d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 -- 172.21.15.52:0/491626690 shutdown_connections 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.622+0000 7f02f2ea5740 1 -- 172.21.15.52:0/491626690 wait complete. 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 -- start start 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 Processor -- start 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d060 0x55a5e2492210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2492750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1adfd0 con 0x55a5e2498240 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1af440 con 0x55a5e248d980 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f02ec1ae6a0 con 0x55a5e248d060 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02f2ea5740 10 client.0 _ll_register_callbacks cb 0x7f02e4031c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02ea59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d060 0x55a5e2492210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49712/0 (socket says 172.21.15.52:49712) 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02ead9d640 1 -- 172.21.15.52:0/1544257885 learned_addr learned my addr 172.21.15.52:0/1544257885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.623+0000 7f02e3fff640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2492750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 -- 172.21.15.52:0/1544257885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d060 msgr2=0x55a5e2492210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d060 0x55a5e2492210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 -- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 msgr2=0x55a5e2492750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2492750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 -- 172.21.15.52:0/1544257885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5e2511760 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02e3fff640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2492750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02ead9d640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f02e402ae00 tx=0x7f02e4030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5211f3bd68ebc80f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4050040 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f02e404b800 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e4036030 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f02e4030a80 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02f2ea5740 10 client.20091 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.624+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a5e2512a80 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4036030 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f02e4030050 con 0x55a5e2498240 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 10 client.20091 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:13.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 10 client.20091 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 20 client.20091 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e2512f90 0x55a5e2515380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 4 client.20091 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c34bac4f", "release": true, "await": true}] 2024-09-19T09:34:13.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c34bac4f", "release": true, "await": true}) -- 0x55a5e23fa0a0 con 0x55a5e2512f90 2024-09-19T09:34:13.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.625+0000 7f02ea59c640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e2512f90 0x55a5e2515380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.626+0000 7f02d1ffb640 10 client.20091 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.626+0000 7f02ea59c640 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e2512f90 0x55a5e2515380 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5a29e3b3813050 server_cookie=921c48a1b55a0499 in_seq=0 out_seq=0 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02d1ffb640 1 -- 172.21.15.52:0/1544257885 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a5e23fa0a0 con 0x55a5e2512f90 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02d1ffb640 10 client.20091 handle_command_reply: tid=0 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02f2ea5740 1 client.20091 shutdown 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 msgr2=0x55a5e2492c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f02e402ae00 tx=0x7f02e4030890 comp rx=0 tx=0).stop 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 shutdown_connections 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.628+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a5e2512f90 0x55a5e2515380 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02d1ffb640 0 client.20091 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a5e2498240 0x55a5e2492c90 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a5e248d980 0x55a5e2492750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 --2- 172.21.15.52:0/1544257885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a5e248d060 0x55a5e2492210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 >> 172.21.15.52:0/1544257885 conn(0x55a5e24895f0 msgr2=0x55a5e2487f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 shutdown_connections 2024-09-19T09:34:13.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 1 -- 172.21.15.52:0/1544257885 wait complete. 2024-09-19T09:34:13.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.629+0000 7f02f2ea5740 20 client.20091 trim_cache size 0 max 16384 2024-09-19T09:34:13.635 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:13.635 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 44, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "c34bac4f": { 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 44, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:34:13.636 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 142.2, 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:13.637 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 msgr2=0x7f02d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 0x7f02d80a5780 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f02e4048000 tx=0x7f02e404b000 comp rx=0 tx=0).stop 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 msgr2=0x7f02ec1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c920 tx=0x7f02dc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 shutdown_connections 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02ec108290 0x7f02ec101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f02d80a32c0 0x7f02d80a5780 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f02ec103740 0x7f02ec100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 --2- 172.21.15.52:0/1036962143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02ec102d90 0x7f02ec1009f0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 >> 172.21.15.52:0/1036962143 conn(0x7f02ec0fc7d0 msgr2=0x7f02ec0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 shutdown_connections 2024-09-19T09:34:13.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:13.630+0000 7f02f0acc640 1 -- 172.21.15.52:0/1036962143 wait complete. 2024-09-19T09:34:14.356 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c34bac4f', total seconds elapsed: 27.0 2024-09-19T09:34:14.356 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.2 2024-09-19T09:34:14.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:34:14.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 -- 172.21.15.52:0/793359672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8103740 msgr2=0x7fa8a8107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/793359672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8103740 0x7fa8a8107b80 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009930 tx=0x7fa89c02a420 comp rx=0 tx=0).stop 2024-09-19T09:34:14.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 -- 172.21.15.52:0/793359672 shutdown_connections 2024-09-19T09:34:14.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/793359672 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8108290 0x7fa8a810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/793359672 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8103740 0x7fa8a8107b80 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/793359672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 0x7fa8a8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 -- 172.21.15.52:0/793359672 >> 172.21.15.52:0/793359672 conn(0x7fa8a80fc7d0 msgr2=0x7fa8a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 -- 172.21.15.52:0/793359672 shutdown_connections 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 -- 172.21.15.52:0/793359672 wait complete. 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.851+0000 7fa8afc1a640 1 Processor -- start 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 -- start start 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 0x7fa8a81009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 0x7fa8a8100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81120a0 con 0x7fa8a8108290 2024-09-19T09:34:14.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a8111f20 con 0x7fa8a8102d90 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8afc1a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a8112220 con 0x7fa8a8103740 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49736/0 (socket says 172.21.15.52:49736) 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 -- 172.21.15.52:0/1670007800 learned_addr learned my addr 172.21.15.52:0/1670007800 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 0x7fa8a81009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 0x7fa8a8100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 -- 172.21.15.52:0/1670007800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 msgr2=0x7fa8a8100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 0x7fa8a8100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 -- 172.21.15.52:0/1670007800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 msgr2=0x7fa8a81009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 0x7fa8a81009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ae1b7640 1 -- 172.21.15.52:0/1670007800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a81a6aa0 con 0x7fa8a8108290 2024-09-19T09:34:14.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.852+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 0x7fa8a8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000d750 tx=0x7fa8a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8a6ffd640 1 -- 172.21.15.52:0/1670007800 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0017070 con 0x7fa8a8108290 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a81a6d90 con 0x7fa8a8108290 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8a6ffd640 1 -- 172.21.15.52:0/1670007800 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8a0005500 con 0x7fa8a8108290 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8a6ffd640 1 -- 172.21.15.52:0/1670007800 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004d90 con 0x7fa8a8108290 2024-09-19T09:34:14.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.853+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a81a7250 con 0x7fa8a8108290 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.855+0000 7fa8a6ffd640 1 -- 172.21.15.52:0/1670007800 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa8a0005020 con 0x7fa8a8108290 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 Processor -- start 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 -- start start 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8a6ffd640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 0x7fa8900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c59ba782f0 con 0x55c59bb13b40 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c59ba1fcf0 con 0x55c59bb125d0 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.856+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c59ba742b0 con 0x55c59bb1d370 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49748/0 (socket says 172.21.15.52:49748) 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 -- 172.21.15.52:0/1298874857 learned_addr learned my addr 172.21.15.52:0/1298874857 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8a6ffd640 1 -- 172.21.15.52:0/1670007800 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa8a00cf2f0 con 0x7fa8a8108290 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 0x7fa8900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 -- 172.21.15.52:0/1298874857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 msgr2=0x55c59bb1f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 -- 172.21.15.52:0/1298874857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 msgr2=0x55c59bb12a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb12a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 -- 172.21.15.52:0/1298874857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59ba043a0 con 0x55c59bb13b40 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 0x7fa8900a5700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009900 tx=0x7fa89c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.857+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa8980039f0 tx=0x7fa898003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b148c8aa7dbc03d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.858+0000 7fa88ffff640 1 -- 172.21.15.52:0/1298874857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898004b20 con 0x55c59bb13b40 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.858+0000 7fa88ffff640 1 -- 172.21.15.52:0/1298874857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa898004cc0 con 0x55c59bb13b40 2024-09-19T09:34:14.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.858+0000 7fa88ffff640 1 -- 172.21.15.52:0/1298874857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8980127d0 con 0x55c59bb13b40 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.858+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1298874857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 msgr2=0x55c59bb12090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.858+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fa8980039f0 tx=0x7fa898003eb0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1298874857 shutdown_connections 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb12a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1298874857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb12090 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1298874857 >> 172.21.15.52:0/1298874857 conn(0x55c59badb310 msgr2=0x55c59bb0ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1298874857 shutdown_connections 2024-09-19T09:34:14.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1298874857 wait complete. 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 -- start start 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.859+0000 7fa8b1ff3740 1 Processor -- start 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb1ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c59bb20070 con 0x55c59bb13b40 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c59ba33060 con 0x55c59bb125d0 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c59bb201f0 con 0x55c59bb1d370 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8b1ff3740 10 client.0 _ll_register_callbacks cb 0x55c59b7868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49750/0 (socket says 172.21.15.52:49750) 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/2750670522 learned_addr learned my addr 172.21.15.52:0/2750670522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:14.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb1ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/2750670522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 msgr2=0x55c59bb1a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 msgr2=0x55c59bb1ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb1ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.860+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/2750670522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59b7e93c0 con 0x55c59bb13b40 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa89c006010 tx=0x7fa89c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ff719928f96e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c04e070 con 0x55c59bb13b40 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa89c0035f0 con 0x55c59bb13b40 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa898004cc0 con 0x55c59bb13b40 2024-09-19T09:34:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa89c035040 con 0x55c59bb13b40 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa8b1ff3740 10 client.20103 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c59bb2ba80 con 0x55c59bb13b40 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa898004cc0 con 0x55c59bb13b40 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.861+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa89c03a040 con 0x55c59bb13b40 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 10 client.20103 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 10 client.20103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 20 client.20103 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bb2ce90 0x55c59bb2f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 4 client.20103 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c59ba85860 con 0x55c59bb2ce90 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bb2ce90 0x55c59bb2f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa88d7fa640 10 client.20103 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:14.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.862+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bb2ce90 0x55c59bb2f310 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca9cba1cc4c4613 server_cookie=572250143ee70367 in_seq=0 out_seq=0 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa88d7fa640 1 -- 172.21.15.52:0/2750670522 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c59ba85860 con 0x55c59bb2ce90 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa88d7fa640 10 client.20103 handle_command_reply: tid=0 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 client.20103 shutdown 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 msgr2=0x55c59bb19f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7fa89c006010 tx=0x7fa89c02a420 comp rx=0 tx=0).stop 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 shutdown_connections 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bb2ce90 0x55c59bb2f310 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb1d370 0x55c59bb1a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb19f70 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/2750670522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb125d0 0x55c59bb1ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 >> 172.21.15.52:0/2750670522 conn(0x55c59badb310 msgr2=0x55c59bb14930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.863+0000 7fa88d7fa640 0 client.20103 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:14.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.864+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 shutdown_connections 2024-09-19T09:34:14.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.864+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/2750670522 wait complete. 2024-09-19T09:34:14.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.864+0000 7fa8b1ff3740 20 client.20103 trim_cache size 0 max 16384 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 Processor -- start 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 -- start start 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb125d0 0x55c59bb15120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81b2400 con 0x55c59bb13b40 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81afcd0 con 0x55c59bb1d370 2024-09-19T09:34:14.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81adb20 con 0x55c59bb125d0 2024-09-19T09:34:14.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ae1b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49764/0 (socket says 172.21.15.52:49764) 2024-09-19T09:34:14.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1110205221 learned_addr learned my addr 172.21.15.52:0/1110205221 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:47174/0 (socket says 172.21.15.52:47174) 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb125d0 0x55c59bb15120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1110205221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb125d0 msgr2=0x55c59bb15120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb125d0 0x55c59bb15120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1110205221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 msgr2=0x55c59bb34be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1110205221 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59bb15ba0 con 0x55c59bb13b40 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.878+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.879+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009930 tx=0x7fa89c004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ef4181d3aec89a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.879+0000 7fa88f7fe640 1 -- 172.21.15.52:0/1110205221 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c04e040 con 0x55c59bb13b40 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.879+0000 7fa88f7fe640 1 -- 172.21.15.52:0/1110205221 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa89c0035f0 con 0x55c59bb13b40 2024-09-19T09:34:14.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.879+0000 7fa88f7fe640 1 -- 172.21.15.52:0/1110205221 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c03d6e0 con 0x55c59bb13b40 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1110205221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 msgr2=0x55c59bb15660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009930 tx=0x7fa89c004390 comp rx=0 tx=0).stop 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1110205221 shutdown_connections 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb34be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb13b40 0x55c59bb15660 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1110205221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb125d0 0x55c59bb15120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1110205221 >> 172.21.15.52:0/1110205221 conn(0x55c59badb310 msgr2=0x55c59bb1bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1110205221 shutdown_connections 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1110205221 wait complete. 2024-09-19T09:34:14.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 -- start start 2024-09-19T09:34:14.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.880+0000 7fa8b1ff3740 1 Processor -- start 2024-09-19T09:34:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 0x55c59bb25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 0x55c59bb259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb22450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81ae190 con 0x55c59bb125d0 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81af600 con 0x55c59bb1d370 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81ae860 con 0x55c59bb13b40 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8b1ff3740 10 client.0 _ll_register_callbacks cb 0x7fa89c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad9b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 0x55c59bb25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad9b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 0x55c59bb25480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49774/0 (socket says 172.21.15.52:49774) 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad9b6640 1 -- 172.21.15.52:0/1627431100 learned_addr learned my addr 172.21.15.52:0/1627431100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 0x55c59bb259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ae1b7640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb22450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 msgr2=0x55c59bb22450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb22450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1627431100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 msgr2=0x55c59bb25480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:14.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 0x55c59bb25480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.881+0000 7fa8ad1b5640 1 -- 172.21.15.52:0/1627431100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59bb22990 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa8ad1b5640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 0x55c59bb259c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa89c006010 tx=0x7fa89c031a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b788d6d013a031d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa88d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c04e040 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa89c0035f0 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa89c004c90 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa89c004e90 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa8b1ff3740 10 client.28453 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c59bba0bb0 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.882+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa89c0035f0 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa89c06e030 con 0x55c59bb13b40 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 10 client.28453 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 10 client.28453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:14.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 20 client.28453 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bba12d0 0x55c59bba36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 4 client.28453 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c59ba7fd70 con 0x55c59bba12d0 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bba12d0 0x55c59bba36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.883+0000 7fa88d7fa640 10 client.28453 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.884+0000 7fa8ad9b6640 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bba12d0 0x55c59bba36f0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9cf2177b402e079 server_cookie=36753875b9c7f2a in_seq=0 out_seq=0 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.884+0000 7fa88d7fa640 1 -- 172.21.15.52:0/1627431100 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c59ba7fd70 con 0x55c59bba12d0 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.884+0000 7fa88d7fa640 10 client.28453 handle_command_reply: tid=0 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.884+0000 7fa8b1ff3740 1 client.28453 shutdown 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 msgr2=0x55c59bb259c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 0x55c59bb259c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa89c006010 tx=0x7fa89c031a80 comp rx=0 tx=0).stop 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 shutdown_connections 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c59bba12d0 0x55c59bba36f0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c59bb1d370 0x55c59bb22450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c59bb13b40 0x55c59bb259c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 --2- 172.21.15.52:0/1627431100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c59bb125d0 0x55c59bb25480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 >> 172.21.15.52:0/1627431100 conn(0x55c59badb310 msgr2=0x55c59bb0d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa88d7fa640 0 client.28453 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 shutdown_connections 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 1 -- 172.21.15.52:0/1627431100 wait complete. 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.885+0000 7fa8b1ff3740 20 client.28453 trim_cache size 0 max 16384 2024-09-19T09:34:14.892 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 msgr2=0x7fa8900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 0x7fa8900a5700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009900 tx=0x7fa89c005b50 comp rx=0 tx=0).stop 2024-09-19T09:34:14.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 msgr2=0x7fa8a8101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000d750 tx=0x7fa8a000dc10 comp rx=0 tx=0).stop 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 shutdown_connections 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8a8108290 0x7fa8a8101470 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa8900a3240 0x7fa8900a5700 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8a8103740 0x7fa8a8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 --2- 172.21.15.52:0/1670007800 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8a8102d90 0x7fa8a81009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 >> 172.21.15.52:0/1670007800 conn(0x7fa8a80fc7d0 msgr2=0x7fa8a8106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 shutdown_connections 2024-09-19T09:34:14.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:14.886+0000 7fa8afc1a640 1 -- 172.21.15.52:0/1670007800 wait complete. 2024-09-19T09:34:14.895 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:15.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:15 smithi052 ceph-mon[30947]: pgmap v722: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:34:15.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:15 smithi169 ceph-mon[35454]: pgmap v722: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:34:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:15 smithi086 ceph-mon[34813]: pgmap v722: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T09:34:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- 172.21.15.52:0/4217369589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8102600 msgr2=0x7fbcf8108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 --2- 172.21.15.52:0/4217369589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8102600 0x7fbcf8108e90 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0009ca0 tx=0x7fbcf002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- 172.21.15.52:0/4217369589 shutdown_connections 2024-09-19T09:34:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 --2- 172.21.15.52:0/4217369589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8102600 0x7fbcf8108e90 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 --2- 172.21.15.52:0/4217369589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8101c40 0x7fbcf81020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 --2- 172.21.15.52:0/4217369589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8100a50 0x7fbcf8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- 172.21.15.52:0/4217369589 >> 172.21.15.52:0/4217369589 conn(0x7fbcf80fc1b0 msgr2=0x7fbcf80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- 172.21.15.52:0/4217369589 shutdown_connections 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- 172.21.15.52:0/4217369589 wait complete. 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 Processor -- start 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.107+0000 7fbcff76d640 1 -- start start 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 0x7fbcf8197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8102600 0x7fbcf819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf810d820 con 0x7fbcf8101c40 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf810d6a0 con 0x7fbcf8102600 2024-09-19T09:34:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf810d9a0 con 0x7fbcf8100a50 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49792/0 (socket says 172.21.15.52:49792) 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 -- 172.21.15.52:0/2291445116 learned_addr learned my addr 172.21.15.52:0/2291445116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8102600 0x7fbcf819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 0x7fbcf8197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 -- 172.21.15.52:0/2291445116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 msgr2=0x7fbcf8197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 0x7fbcf8197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 -- 172.21.15.52:0/2291445116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8102600 msgr2=0x7fbcf819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8102600 0x7fbcf819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 -- 172.21.15.52:0/2291445116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf819f9b0 con 0x7fbcf8101c40 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 0x7fbcf8197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fbce800d770 tx=0x7fbce800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcee7fc640 1 -- 172.21.15.52:0/2291445116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8017070 con 0x7fbcf8101c40 2024-09-19T09:34:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcee7fc640 1 -- 172.21.15.52:0/2291445116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbce8005500 con 0x7fbcf8101c40 2024-09-19T09:34:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcee7fc640 1 -- 172.21.15.52:0/2291445116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004e00 con 0x7fbcf8101c40 2024-09-19T09:34:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.108+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf819fca0 con 0x7fbcf8101c40 2024-09-19T09:34:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.109+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf81a01a0 con 0x7fbcf8101c40 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.111+0000 7fbcee7fc640 1 -- 172.21.15.52:0/2291445116 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbce8004fa0 con 0x7fbcf8101c40 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.111+0000 7fbd025e4740 1 Processor -- start 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.111+0000 7fbd025e4740 1 -- start start 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da039da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 0x55a9da03eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9d9f9d2f0 con 0x55a9da03f370 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a9d9f45270 con 0x55a9da03a2e0 2024-09-19T09:34:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbd025e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a9d9f992b0 con 0x55a9da0399a0 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49796/0 (socket says 172.21.15.52:49796) 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfcd08640 1 -- 172.21.15.52:0/2822017429 learned_addr learned my addr 172.21.15.52:0/2822017429 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 0x55a9da03eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcee7fc640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 0x7fbce40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 -- 172.21.15.52:0/2822017429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 msgr2=0x55a9da039da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da039da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcee7fc640 1 -- 172.21.15.52:0/2291445116 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbce80cf3f0 con 0x7fbcf8101c40 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 -- 172.21.15.52:0/2822017429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 msgr2=0x55a9da041830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfd509640 1 -- 172.21.15.52:0/2822017429 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d9f44340 con 0x55a9da03a2e0 2024-09-19T09:34:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da039da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.112+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 0x7fbce40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.113+0000 7fbcfd509640 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 0x55a9da03eda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8101aa0 tx=0x7fbcf400e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=798a6e8ef898e740 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.113+0000 7fbce37fe640 1 -- 172.21.15.52:0/2822017429 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4016070 con 0x55a9da03a2e0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.113+0000 7fbce37fe640 1 -- 172.21.15.52:0/2822017429 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf4011950 con 0x55a9da03a2e0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.113+0000 7fbce37fe640 1 -- 172.21.15.52:0/2822017429 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4010830 con 0x55a9da03a2e0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- 172.21.15.52:0/2822017429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 msgr2=0x55a9da03eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 0x7fbce40a5830 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0005e30 tx=0x7fbcf00095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 0x55a9da03eda0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8101aa0 tx=0x7fbcf400e6c0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- 172.21.15.52:0/2822017429 shutdown_connections 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da041830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03a2e0 0x55a9da03eda0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- 172.21.15.52:0/2822017429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da039da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- 172.21.15.52:0/2822017429 >> 172.21.15.52:0/2822017429 conn(0x55a9da035010 msgr2=0x55a9da035410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- 172.21.15.52:0/2822017429 shutdown_connections 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- 172.21.15.52:0/2822017429 wait complete. 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 -- start start 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 Processor -- start 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da043b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.114+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da04b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a9da042340 con 0x55a9da03a2e0 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a9d9f26290 con 0x55a9da03f370 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a9da0424c0 con 0x55a9da0399a0 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 10 client.0 _ll_register_callbacks cb 0x55a9d9f57140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49804/0 (socket says 172.21.15.52:49804) 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 -- 172.21.15.52:0/3462345886 learned_addr learned my addr 172.21.15.52:0/3462345886 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da04b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfd509640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da043b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 -- 172.21.15.52:0/3462345886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 msgr2=0x55a9da043b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da043b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 -- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 msgr2=0x55a9da04b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da04b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 -- 172.21.15.52:0/3462345886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d9cb0210 con 0x55a9da03a2e0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfd509640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da043b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009610 tx=0x7fbce8005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde55f2a4404185b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbce0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8020070 con 0x55a9da03a2e0 2024-09-19T09:34:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbce8009cc0 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.115+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf4011950 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbce8099ad0 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 10 client.20121 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a9d9d7c620 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf4011950 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbce8097f70 con 0x55a9da03a2e0 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 10 client.20121 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 10 client.20121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 20 client.20121 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 4 client.20121 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9d9faaa20 con 0x55a9da04f850 2024-09-19T09:34:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.116+0000 7fbcfd509640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.117+0000 7fbce0ff9640 10 client.20121 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:16.125 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.117+0000 7fbcfd509640 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da051cc0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7a3647991d5963 server_cookie=d723b8cc77e77dc8 in_seq=0 out_seq=0 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.117+0000 7fbce0ff9640 1 -- 172.21.15.52:0/3462345886 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9d9faaa20 con 0x55a9da04f850 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.117+0000 7fbce0ff9640 10 client.20121 handle_command_reply: tid=0 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.117+0000 7fbd025e4740 1 client.20121 shutdown 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 msgr2=0x55a9da044080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009610 tx=0x7fbce8005bb0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 shutdown_connections 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da051cc0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbce0ff9640 0 client.20121 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da04b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.126 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da044080 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 --2- 172.21.15.52:0/3462345886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da043b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 >> 172.21.15.52:0/3462345886 conn(0x55a9da035010 msgr2=0x55a9da036820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 shutdown_connections 2024-09-19T09:34:16.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 1 -- 172.21.15.52:0/3462345886 wait complete. 2024-09-19T09:34:16.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.118+0000 7fbd025e4740 20 client.20121 trim_cache size 0 max 16384 2024-09-19T09:34:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 Processor -- start 2024-09-19T09:34:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 -- start start 2024-09-19T09:34:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da0399a0 0x55a9da0340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da03a2e0 0x55a9da04b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81aba10 con 0x55a9da03f370 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a92e0 con 0x55a9da0399a0 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbd025e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a7130 con 0x55a9da03a2e0 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49820/0 (socket says 172.21.15.52:49820) 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 -- 172.21.15.52:0/923459286 learned_addr learned my addr 172.21.15.52:0/923459286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da03a2e0 0x55a9da04b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfd509640 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da0399a0 0x55a9da0340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 -- 172.21.15.52:0/923459286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da03a2e0 msgr2=0x55a9da04b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da03a2e0 0x55a9da04b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 -- 172.21.15.52:0/923459286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da0399a0 msgr2=0x55a9da0340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da0399a0 0x55a9da0340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fbcfdd0a640 1 -- 172.21.15.52:0/923459286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9da03a7c0 con 0x55a9da03f370 2024-09-19T09:34:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0035000 tx=0x7fbcf003e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b185643492ede0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fbce2ffd640 1 -- 172.21.15.52:0/923459286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00305c0 con 0x55a9da03f370 2024-09-19T09:34:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fbce2ffd640 1 -- 172.21.15.52:0/923459286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf0036040 con 0x55a9da03f370 2024-09-19T09:34:16.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fbce2ffd640 1 -- 172.21.15.52:0/923459286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0046be0 con 0x55a9da03f370 2024-09-19T09:34:16.140 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- 172.21.15.52:0/923459286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 msgr2=0x55a9da0565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0035000 tx=0x7fbcf003e030 comp rx=0 tx=0).stop 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- 172.21.15.52:0/923459286 shutdown_connections 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03f370 0x55a9da0565c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da03a2e0 0x55a9da04b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 --2- 172.21.15.52:0/923459286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da0399a0 0x55a9da0340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- 172.21.15.52:0/923459286 >> 172.21.15.52:0/923459286 conn(0x55a9da035010 msgr2=0x55a9da0339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- 172.21.15.52:0/923459286 shutdown_connections 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- 172.21.15.52:0/923459286 wait complete. 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fbd025e4740 1 -- start start 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 Processor -- start 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.141 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da048b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da049b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a77a0 con 0x55a9da03a2e0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a8c10 con 0x55a9da03f370 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf81a7e70 con 0x55a9da0399a0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbd025e4740 10 client.0 _ll_register_callbacks cb 0x7fbce800de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbcfd509640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbcfd509640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:55300/0 (socket says 172.21.15.52:55300) 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbcfd509640 1 -- 172.21.15.52:0/1237852560 learned_addr learned my addr 172.21.15.52:0/1237852560 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da048b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da049b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 -- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 msgr2=0x55a9da049b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da049b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 -- 172.21.15.52:0/1237852560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 msgr2=0x55a9da048b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da048b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 -- 172.21.15.52:0/1237852560 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9da04a1a0 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfdd0a640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da049b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbcfd509640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ebc0 tx=0x7fbcf4005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2861c5fd34945eda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbce0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf402c070 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcf0036040 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbcf4005450 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.138+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbcf4038050 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.138+0000 7fbd025e4740 10 client.28471 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.138+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a9da0ba5a0 con 0x55a9da0399a0 2024-09-19T09:34:16.143 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.138+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcf0036040 con 0x55a9da0399a0 2024-09-19T09:34:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.138+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbcf400f040 con 0x55a9da0399a0 2024-09-19T09:34:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 10 client.28471 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 10 client.28471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:16.144 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 20 client.28471 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da0bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 4 client.28471 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9d9fa4d70 con 0x55a9da04f850 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da0bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbcfcd08640 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da0bcb60 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f68a34affced19e6 server_cookie=6dc66dc7c58a8b03 in_seq=0 out_seq=0 2024-09-19T09:34:16.145 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fbce0ff9640 10 client.28471 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/180106524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc102570 msgr2=0x7fa7bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.133+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/180106524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc102570 0x7fa7bc1029b0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009900 tx=0x7fa7b002a480 comp rx=0 tx=0).stop 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/180106524 shutdown_connections 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/180106524 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/180106524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc102570 0x7fa7bc1029b0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/180106524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc100e20 0x7fa7bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/180106524 >> 172.21.15.52:0/180106524 conn(0x7fa7bc0fc7d0 msgr2=0x7fa7bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/180106524 shutdown_connections 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.134+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/180106524 wait complete. 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 Processor -- start 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 -- start start 2024-09-19T09:34:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102570 0x7fa7bc198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc110f80 con 0x7fa7bc100e20 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc110e00 con 0x7fa7bc102ef0 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7c0e8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc111100 con 0x7fa7bc102570 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49822/0 (socket says 172.21.15.52:49822) 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 -- 172.21.15.52:0/356168928 learned_addr learned my addr 172.21.15.52:0/356168928 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7b9d9b640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102570 0x7fa7bc198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7bad9d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 -- 172.21.15.52:0/356168928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102570 msgr2=0x7fa7bc198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102570 0x7fa7bc198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 -- 172.21.15.52:0/356168928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 msgr2=0x7fa7bc19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.135+0000 7fa7ba59c640 1 -- 172.21.15.52:0/356168928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc19d490 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7bad9d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7ba59c640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00d950 tx=0x7fa7ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac017030 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7ac004020 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc19d780 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0047a0 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.136+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a5060 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.137+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc101200 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa7ac0041d0 con 0x7fa7bc100e20 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.139+0000 7fa7ab7fe640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 0x7fa7a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.140+0000 7fa7b9d9b640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 0x7fa7a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.140+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa7ac0cfa80 con 0x7fa7bc100e20 2024-09-19T09:34:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.140+0000 7fa7b9d9b640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 0x7fa7a40a5700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009230 tx=0x7fa7b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.144+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7ac09c720 con 0x7fa7bc100e20 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.150+0000 7fbce0ff9640 1 -- 172.21.15.52:0/1237852560 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9d9fa4d70 con 0x55a9da04f850 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.150+0000 7fbce0ff9640 10 client.28471 handle_command_reply: tid=0 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.150+0000 7fbd025e4740 1 client.28471 shutdown 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 msgr2=0x55a9da048640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcf400ebc0 tx=0x7fbcf4005f80 comp rx=0 tx=0).stop 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 shutdown_connections 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a9da04f850 0x55a9da0bcb60 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a9da03f370 0x55a9da049b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbce0ff9640 0 client.28471 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:16.157 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a9da03a2e0 0x55a9da048b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 --2- 172.21.15.52:0/1237852560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a9da0399a0 0x55a9da048640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 >> 172.21.15.52:0/1237852560 conn(0x55a9da035010 msgr2=0x55a9da0339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 shutdown_connections 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 1 -- 172.21.15.52:0/1237852560 wait complete. 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.151+0000 7fbd025e4740 20 client.28471 trim_cache size 0 max 16384 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:34:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 msgr2=0x7fbce40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 0x7fbce40a5830 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0005e30 tx=0x7fbcf00095c0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 msgr2=0x7fbcf81982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fbce800d770 tx=0x7fbce800dc30 comp rx=0 tx=0).stop 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 shutdown_connections 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbcf8102600 0x7fbcf819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf8101c40 0x7fbcf81982e0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbce40a3370 0x7fbce40a5830 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 --2- 172.21.15.52:0/2291445116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbcf8100a50 0x7fbcf8197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 >> 172.21.15.52:0/2291445116 conn(0x7fbcf80fc1b0 msgr2=0x7fbcf8104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 shutdown_connections 2024-09-19T09:34:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:16.152+0000 7fbcff76d640 1 -- 172.21.15.52:0/2291445116 wait complete. 2024-09-19T09:34:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.358+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7bc199840 con 0x7fa7bc100e20 2024-09-19T09:34:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.359+0000 7fa7ab7fe640 1 -- 172.21.15.52:0/356168928 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fa7ac09c020 con 0x7fa7bc100e20 2024-09-19T09:34:16.361 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:34:16.362 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:34:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 msgr2=0x7fa7a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 0x7fa7a40a5700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009230 tx=0x7fa7b00058d0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 msgr2=0x7fa7bc1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00d950 tx=0x7fa7ac00de10 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 shutdown_connections 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7bc102ef0 0x7fa7bc19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa7a40a3240 0x7fa7a40a5700 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7bc102570 0x7fa7bc198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 --2- 172.21.15.52:0/356168928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7bc100e20 0x7fa7bc1984e0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:16.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 >> 172.21.15.52:0/356168928 conn(0x7fa7bc0fc7d0 msgr2=0x7fa7bc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 shutdown_connections 2024-09-19T09:34:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:16.361+0000 7fa7c0e8d640 1 -- 172.21.15.52:0/356168928 wait complete. 2024-09-19T09:34:16.952 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:34:16.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:34:17.021 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0' 2024-09-19T09:34:17.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 142.2 --await-for 45.0 2024-09-19T09:34:17.222 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:17.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:17 smithi052 ceph-mon[30947]: pgmap v723: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-19T09:34:17.344 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:17 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/356168928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:17.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:17 smithi169 ceph-mon[35454]: pgmap v723: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-19T09:34:17.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:17 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/356168928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:17 smithi086 ceph-mon[34813]: pgmap v723: 97 pgs: 97 active+clean; 2.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-09-19T09:34:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:17 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/356168928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 -- 172.21.15.52:0/1615727643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 msgr2=0x7f00001021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 --2- 172.21.15.52:0/1615727643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00001021c0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7efffc009900 tx=0x7efffc02a410 comp rx=0 tx=0).stop 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 -- 172.21.15.52:0/1615727643 shutdown_connections 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 --2- 172.21.15.52:0/1615727643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 0x7f000010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 --2- 172.21.15.52:0/1615727643 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 0x7f00001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 --2- 172.21.15.52:0/1615727643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00001021c0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 -- 172.21.15.52:0/1615727643 >> 172.21.15.52:0/1615727643 conn(0x7f00000fd8c0 msgr2=0x7f00000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 -- 172.21.15.52:0/1615727643 shutdown_connections 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.712+0000 7f00081a9640 1 -- 172.21.15.52:0/1615727643 wait complete. 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 Processor -- start 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 -- start start 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 0x7f0000074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 0x7f0000074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0000111f70 con 0x7f0000101de0 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0000111df0 con 0x7f0000106f10 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f00081a9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00001120f0 con 0x7f0000102790 2024-09-19T09:34:17.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49836/0 (socket says 172.21.15.52:49836) 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 -- 172.21.15.52:0/3725464715 learned_addr learned my addr 172.21.15.52:0/3725464715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0006746640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 0x7f0000074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005744640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 0x7f0000074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 -- 172.21.15.52:0/3725464715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 msgr2=0x7f0000074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 0x7f0000074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 -- 172.21.15.52:0/3725464715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 msgr2=0x7f0000074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 0x7f0000074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.713+0000 7f0005f45640 1 -- 172.21.15.52:0/3725464715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00001a68f0 con 0x7f0000101de0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7f0005f45640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efffc006010 tx=0x7efffc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7efff6ffd640 1 -- 172.21.15.52:0/3725464715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc03f030 con 0x7f0000101de0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7efff6ffd640 1 -- 172.21.15.52:0/3725464715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efffc003ce0 con 0x7f0000101de0 2024-09-19T09:34:17.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00001a6b80 con 0x7f0000101de0 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7efff6ffd640 1 -- 172.21.15.52:0/3725464715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc035070 con 0x7f0000101de0 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.714+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001a70b0 con 0x7f0000101de0 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7efff6ffd640 1 -- 172.21.15.52:0/3725464715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efffc042030 con 0x7f0000101de0 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 Processor -- start 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 -- start start 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x561770417f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770425130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56177037d280 con 0x561770418480 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561770324b10 con 0x561770422d40 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.717+0000 7f000a582740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561770379240 con 0x561770417b60 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49848/0 (socket says 172.21.15.52:49848) 2024-09-19T09:34:17.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 -- 172.21.15.52:0/3131333393 learned_addr learned my addr 172.21.15.52:0/3131333393 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005744640 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770425130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0006746640 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x561770417f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7efff6ffd640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 -- 172.21.15.52:0/3131333393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 msgr2=0x561770417f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x561770417f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 -- 172.21.15.52:0/3131333393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 msgr2=0x561770425130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770425130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 -- 172.21.15.52:0/3131333393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617703311f0 con 0x561770418480 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0006746640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7efff6ffd640 1 -- 172.21.15.52:0/3725464715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efffc0eff00 con 0x7f0000101de0 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7f0005f45640 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efffc08c840 tx=0x7efffc08b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13fffaf1c59cc4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.718+0000 7effebfff640 1 -- 172.21.15.52:0/3131333393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc049070 con 0x561770418480 2024-09-19T09:34:17.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7effebfff640 1 -- 172.21.15.52:0/3131333393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efffc03b580 con 0x561770418480 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7effebfff640 1 -- 172.21.15.52:0/3131333393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc03bcb0 con 0x561770418480 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 -- 172.21.15.52:0/3131333393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 msgr2=0x561770422800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f0006746640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 0x7effec0a5780 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efff8005fd0 tx=0x7efff8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efffc08c840 tx=0x7efffc08b360 comp rx=0 tx=0).stop 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 -- 172.21.15.52:0/3131333393 shutdown_connections 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770425130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770422800 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 --2- 172.21.15.52:0/3131333393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x561770417f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 -- 172.21.15.52:0/3131333393 >> 172.21.15.52:0/3131333393 conn(0x5617704140f0 msgr2=0x5617704144d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 -- 172.21.15.52:0/3131333393 shutdown_connections 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.719+0000 7f000a582740 1 -- 172.21.15.52:0/3131333393 wait complete. 2024-09-19T09:34:17.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 -- start start 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 Processor -- start 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770420650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5617704256d0 con 0x561770418480 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561770337f10 con 0x561770422d40 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561770425850 con 0x561770417b60 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f000a582740 10 client.0 _ll_register_callbacks cb 0x561770300a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f0005744640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f0005744640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49852/0 (socket says 172.21.15.52:49852) 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f0005744640 1 -- 172.21.15.52:0/3783390275 learned_addr learned my addr 172.21.15.52:0/3783390275 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:17.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f0005f45640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.720+0000 7f0006746640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770420650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 -- 172.21.15.52:0/3783390275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 msgr2=0x56177041fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 -- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 msgr2=0x561770420650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770420650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 -- 172.21.15.52:0/3783390275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617700ee6a0 con 0x561770418480 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0006746640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770420650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f0005744640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7efff00117c0 tx=0x7efff0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f9284745a49e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7effe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff000fdb0 con 0x561770418480 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56177038a7f0 con 0x561770418480 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efff0004020 con 0x561770418480 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efff0004220 con 0x561770418480 2024-09-19T09:34:17.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f000a582740 10 client.20145 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561770431250 con 0x561770418480 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.721+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56177038a7f0 con 0x561770418480 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efff0018030 con 0x561770418480 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 10 client.20145 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 10 client.20145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 20 client.20145 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5617704327b0 0x561770434bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 4 client.20145 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561770384d00 con 0x5617704327b0 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f0005f45640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5617704327b0 0x561770434bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7f0005f45640 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5617704327b0 0x561770434bd0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124765ddd1c46093 server_cookie=2d4f207e9680d1d7 in_seq=0 out_seq=0 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.722+0000 7effe97fa640 10 client.20145 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:17.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7effe97fa640 1 -- 172.21.15.52:0/3783390275 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561770384d00 con 0x5617704327b0 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7effe97fa640 10 client.20145 handle_command_reply: tid=0 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 client.20145 shutdown 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 msgr2=0x561770420110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7efff00117c0 tx=0x7efff0011c80 comp rx=0 tx=0).stop 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 shutdown_connections 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5617704327b0 0x561770434bd0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x561770420650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x561770420110 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 --2- 172.21.15.52:0/3783390275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7effe97fa640 0 client.20145 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 >> 172.21.15.52:0/3783390275 conn(0x5617704140f0 msgr2=0x561770419e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 shutdown_connections 2024-09-19T09:34:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.723+0000 7f000a582740 1 -- 172.21.15.52:0/3783390275 wait complete. 2024-09-19T09:34:17.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.724+0000 7f000a582740 20 client.20145 trim_cache size 0 max 16384 2024-09-19T09:34:17.738 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 Processor -- start 2024-09-19T09:34:17.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 -- start start 2024-09-19T09:34:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x5617704204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00001b2230 con 0x561770418480 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00001afb00 con 0x561770422d40 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f000a582740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00001ad950 con 0x561770417b60 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49860/0 (socket says 172.21.15.52:49860) 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 -- 172.21.15.52:0/3572696615 learned_addr learned my addr 172.21.15.52:0/3572696615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0006746640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x5617704204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005f45640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 -- 172.21.15.52:0/3572696615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 msgr2=0x56177041b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 -- 172.21.15.52:0/3572696615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 msgr2=0x5617704204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x5617704204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.749+0000 7f0005744640 1 -- 172.21.15.52:0/3572696615 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561770413f20 con 0x561770418480 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7f0005f45640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7f0006746640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x5617704204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7f0005744640 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7efff00235b0 tx=0x7efff00041b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1fc5fb8d825018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7effeb7fe640 1 -- 172.21.15.52:0/3572696615 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0030070 con 0x561770418480 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7effeb7fe640 1 -- 172.21.15.52:0/3572696615 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff0005510 con 0x561770418480 2024-09-19T09:34:17.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.750+0000 7effeb7fe640 1 -- 172.21.15.52:0/3572696615 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff00112a0 con 0x561770418480 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- 172.21.15.52:0/3572696615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 msgr2=0x56177041ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7efff00235b0 tx=0x7efff00041b0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- 172.21.15.52:0/3572696615 shutdown_connections 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770422d40 0x5617704204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770418480 0x56177041ea80 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 --2- 172.21.15.52:0/3572696615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770417b60 0x56177041b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- 172.21.15.52:0/3572696615 >> 172.21.15.52:0/3572696615 conn(0x5617704140f0 msgr2=0x56177041e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- 172.21.15.52:0/3572696615 shutdown_connections 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- 172.21.15.52:0/3572696615 wait complete. 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.751+0000 7f000a582740 1 -- start start 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 Processor -- start 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770417b60 0x56177042b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770418480 0x5617704265a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00001adfc0 con 0x561770422d40 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00001af430 con 0x561770417b60 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f00001ae690 con 0x561770418480 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f000a582740 10 client.0 _ll_register_callbacks cb 0x7efff000c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f0006746640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f0006746640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49872/0 (socket says 172.21.15.52:49872) 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f0006746640 1 -- 172.21.15.52:0/1177035260 learned_addr learned my addr 172.21.15.52:0/1177035260 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f0005f45640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770417b60 0x56177042b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.752+0000 7f0005744640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770418480 0x5617704265a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 -- 172.21.15.52:0/1177035260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770418480 msgr2=0x5617704265a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770418480 0x5617704265a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 -- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770417b60 msgr2=0x56177042b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770417b60 0x56177042b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 -- 172.21.15.52:0/1177035260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177040f830 con 0x561770422d40 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f0006746640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7efff8011c20 tx=0x7efff8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fd5e2b4e70930 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7effe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8011c50 con 0x561770422d40 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7efff8011df0 con 0x561770422d40 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff0005510 con 0x561770422d40 2024-09-19T09:34:17.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efff8030030 con 0x561770422d40 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f000a582740 10 client.20151 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.753+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56177041a9d0 con 0x561770422d40 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff8035910 con 0x561770422d40 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efff802b770 con 0x561770422d40 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 10 client.20151 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 10 client.20151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 20 client.20151 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56177049da80 0x56177049fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 4 client.20151 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7efff0005510 con 0x56177049da80 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.754+0000 7f0005f45640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56177049da80 0x56177049fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.755+0000 7f0005f45640 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56177049da80 0x56177049fea0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e30eab44240a37c server_cookie=40f4c7c008fa46ba in_seq=0 out_seq=0 2024-09-19T09:34:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.755+0000 7effe97fa640 10 client.20151 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7effe97fa640 1 -- 172.21.15.52:0/1177035260 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7efff0005510 con 0x56177049da80 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7effe97fa640 10 client.20151 handle_command_reply: tid=0 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 client.20151 shutdown 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 msgr2=0x561770426ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7efff8011c20 tx=0x7efff8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 shutdown_connections 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56177049da80 0x56177049fea0 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7effe97fa640 0 client.20151 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561770422d40 0x561770426ce0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561770418480 0x5617704265a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 --2- 172.21.15.52:0/1177035260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561770417b60 0x56177042b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 >> 172.21.15.52:0/1177035260 conn(0x5617704140f0 msgr2=0x561770419dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 shutdown_connections 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.756+0000 7f000a582740 1 -- 172.21.15.52:0/1177035260 wait complete. 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.757+0000 7f000a582740 20 client.20151 trim_cache size 0 max 16384 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "6f91fa9b-c47a-4980-b461-35bc2a925ea6", 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:34:17.763 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.757+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 msgr2=0x7effec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.757+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 0x7effec0a5780 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efff8005fd0 tx=0x7efff8004a40 comp rx=0 tx=0).stop 2024-09-19T09:34:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.757+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 msgr2=0x7f00000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.757+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7efffc006010 tx=0x7efffc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 shutdown_connections 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0000106f10 0x7f0000074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7effec0a32c0 0x7effec0a5780 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0000102790 0x7f0000074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 --2- 172.21.15.52:0/3725464715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0000101de0 0x7f00000744f0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 >> 172.21.15.52:0/3725464715 conn(0x7f00000fd8c0 msgr2=0x7f00000fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 shutdown_connections 2024-09-19T09:34:17.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:17.758+0000 7f00081a9640 1 -- 172.21.15.52:0/3725464715 wait complete. 2024-09-19T09:34:18.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2550115913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc10c160 msgr2=0x7ff5bc10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2550115913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc10c160 0x7ff5bc10e600 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009ca0 tx=0x7ff5b402a950 comp rx=0 tx=0).stop 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2550115913 shutdown_connections 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2550115913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc10c160 0x7ff5bc10e600 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2550115913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc103650 0x7ff5bc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2550115913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc102d30 0x7ff5bc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2550115913 >> 172.21.15.52:0/2550115913 conn(0x7ff5bc0fc7d0 msgr2=0x7ff5bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2550115913 shutdown_connections 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2550115913 wait complete. 2024-09-19T09:34:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.987+0000 7ff5c38f5640 1 Processor -- start 2024-09-19T09:34:18.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 -- start start 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc103650 0x7ff5bc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc10c160 0x7ff5bc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc111f90 con 0x7ff5bc102d30 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc111e10 con 0x7ff5bc103650 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c38f5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc112110 con 0x7ff5bc10c160 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56276/0 (socket says 172.21.15.52:56276) 2024-09-19T09:34:18.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 -- 172.21.15.52:0/2272710104 learned_addr learned my addr 172.21.15.52:0/2272710104 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc103650 0x7ff5bc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc10c160 0x7ff5bc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 -- 172.21.15.52:0/2272710104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc10c160 msgr2=0x7ff5bc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc10c160 0x7ff5bc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 -- 172.21.15.52:0/2272710104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc103650 msgr2=0x7ff5bc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc103650 0x7ff5bc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.988+0000 7ff5c1691640 1 -- 172.21.15.52:0/2272710104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc1a6850 con 0x7ff5bc102d30 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5c1691640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c920 tx=0x7ff5b800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5b27fc640 1 -- 172.21.15.52:0/2272710104 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8007c70 con 0x7ff5bc102d30 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5b27fc640 1 -- 172.21.15.52:0/2272710104 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b8007e10 con 0x7ff5bc102d30 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc1a6b40 con 0x7ff5bc102d30 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5b27fc640 1 -- 172.21.15.52:0/2272710104 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80189a0 con 0x7ff5bc102d30 2024-09-19T09:34:18.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.989+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc1a70d0 con 0x7ff5bc102d30 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 Processor -- start 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 -- start start 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c7031b2a0 con 0x564c703b5760 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564c702c2b10 con 0x564c703b6080 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c70317260 con 0x564c703c0940 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56292/0 (socket says 172.21.15.52:56292) 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.992+0000 7ff5c1e92640 1 -- 172.21.15.52:0/964872793 learned_addr learned my addr 172.21.15.52:0/964872793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:18.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 -- 172.21.15.52:0/964872793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 msgr2=0x564c703c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:18.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 -- 172.21.15.52:0/964872793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 msgr2=0x564c703c0400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:34:18.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c0400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 -- 172.21.15.52:0/964872793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c7008cb90 con 0x564c703b5760 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5b27fc640 1 -- 172.21.15.52:0/2272710104 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff5b8018b40 con 0x7ff5bc102d30 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ff5b402f670 tx=0x7ff5b402f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9731b7aaa55dff10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5a77fe640 1 -- 172.21.15.52:0/964872793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4034040 con 0x564c703b5760 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5a77fe640 1 -- 172.21.15.52:0/964872793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b4003e50 con 0x564c703b5760 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.993+0000 7ff5a77fe640 1 -- 172.21.15.52:0/964872793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4004520 con 0x564c703b5760 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5b27fc640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 0x7ff5a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c1691640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 0x7ff5a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5b27fc640 1 -- 172.21.15.52:0/2272710104 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5b80cfac0 con 0x7ff5bc102d30 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 -- 172.21.15.52:0/964872793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 msgr2=0x564c703b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ff5b402f670 tx=0x7ff5b402f6a0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 -- 172.21.15.52:0/964872793 shutdown_connections 2024-09-19T09:34:18.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/964872793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b5b40 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 -- 172.21.15.52:0/964872793 >> 172.21.15.52:0/964872793 conn(0x564c703b1cf0 msgr2=0x564c703b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 -- 172.21.15.52:0/964872793 shutdown_connections 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c1691640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 0x7ff5a80a5780 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007590 tx=0x7ff5b80914e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.994+0000 7ff5c5cce740 1 -- 172.21.15.52:0/964872793 wait complete. 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 -- start start 2024-09-19T09:34:18.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 Processor -- start 2024-09-19T09:34:19.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564c703c3510 con 0x564c703b5760 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x564c702a36e0 con 0x564c703c0940 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564c703c3690 con 0x564c703b6080 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.995+0000 7ff5c5cce740 10 client.0 _ll_register_callbacks cb 0x564c702c7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56296/0 (socket says 172.21.15.52:56296) 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1737566417 learned_addr learned my addr 172.21.15.52:0/1737566417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 -- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 msgr2=0x564c703be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 -- 172.21.15.52:0/1737566417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 msgr2=0x564c703bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 -- 172.21.15.52:0/1737566417 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c703cc9b0 con 0x564c703b6080 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bdd10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc102420 tx=0x7ff5ac010bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0baa3d7b7cdf8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.996+0000 7ff5a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.169:3300/0 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00fc20 con 0x564c703b6080 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mon.1 v2:172.21.15.169:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5ac010e00 con 0x564c703b6080 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5b4003e50 con 0x564c703b6080 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac00fdc0 con 0x564c703b6080 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 10 client.28492 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:19.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c703cf3d0 con 0x564c703b6080 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mon.1 v2:172.21.15.169:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ac0035f0 con 0x564c703b6080 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mon.1 v2:172.21.15.169:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5ac019410 con 0x564c703b6080 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 10 client.28492 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 10 client.28492 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 20 client.28492 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c703d0890 0x564c703d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 4 client.28492 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.997+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff5b4003e50 con 0x564c703d0890 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.998+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c703d0890 0x564c703d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.998+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c703d0890 0x564c703d2cd0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba74123e4ae60e03 server_cookie=27676f0551b758d in_seq=0 out_seq=0 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.998+0000 7ff5a4ff9640 10 client.28492 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1737566417 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff5b4003e50 con 0x564c703d0890 2024-09-19T09:34:19.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5a4ff9640 10 client.28492 handle_command_reply: tid=0 2024-09-19T09:34:19.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 client.28492 shutdown 2024-09-19T09:34:19.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 msgr2=0x564c703bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bdd10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc102420 tx=0x7ff5ac010bb0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.005 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 shutdown_connections 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c703d0890 0x564c703d2cd0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bdd10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1737566417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 >> 172.21.15.52:0/1737566417 conn(0x564c703b1cf0 msgr2=0x564c703b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5a4ff9640 0 client.28492 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 shutdown_connections 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:18.999+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1737566417 wait complete. 2024-09-19T09:34:19.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.000+0000 7ff5c5cce740 20 client.28492 trim_cache size 0 max 16384 2024-09-19T09:34:19.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 Processor -- start 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 -- start start 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b21f0 con 0x564c703b5760 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1afac0 con 0x564c703c0940 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ad910 con 0x564c703b6080 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56298/0 (socket says 172.21.15.52:56298) 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.017+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1307061204 learned_addr learned my addr 172.21.15.52:0/1307061204 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1307061204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 msgr2=0x564c703bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1307061204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 msgr2=0x564c703d85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1307061204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c703b1b20 con 0x564c703b5760 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40040b0 tx=0x7ff5b40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fede92ef918b20f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5a6ffd640 1 -- 172.21.15.52:0/1307061204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4034040 con 0x564c703b5760 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5a6ffd640 1 -- 172.21.15.52:0/1307061204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b402fe20 con 0x564c703b5760 2024-09-19T09:34:19.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.018+0000 7ff5a6ffd640 1 -- 172.21.15.52:0/1307061204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4004730 con 0x564c703b5760 2024-09-19T09:34:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1307061204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 msgr2=0x564c703b81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40040b0 tx=0x7ff5b40040e0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1307061204 shutdown_connections 2024-09-19T09:34:19.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703c0940 0x564c703d85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703b6080 0x564c703bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1307061204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703b81c0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1307061204 >> 172.21.15.52:0/1307061204 conn(0x564c703b1cf0 msgr2=0x564c703bf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1307061204 shutdown_connections 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.019+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1307061204 wait complete. 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 -- start start 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 Processor -- start 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1adf80 con 0x564c703b5760 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1af3f0 con 0x564c703b6080 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1ae650 con 0x564c703c0940 2024-09-19T09:34:19.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c5cce740 10 client.0 _ll_register_callbacks cb 0x7ff5ac00aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c1e92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56304/0 (socket says 172.21.15.52:56304) 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.020+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1381725596 learned_addr learned my addr 172.21.15.52:0/1381725596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1381725596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 msgr2=0x564c703c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 msgr2=0x564c703c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 -- 172.21.15.52:0/1381725596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c703ad260 con 0x564c703b5760 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c1e92640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4004230 tx=0x7ff5b4004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9734fb2fd58452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4034070 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff5b402fb40 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.021+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5b402fe20 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff5b4049040 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5c5cce740 10 client.20169 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564c7043ba00 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b402fe20 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff5b404f040 con 0x564c703b5760 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.022+0000 7ff5c5cce740 10 client.20169 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c5cce740 10 client.20169 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c5cce740 20 client.20169 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:19.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c7043bc80 0x564c7043e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c5cce740 4 client.20169 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}] 2024-09-19T09:34:19.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 142.2, "await_for": 45.0}) -- 0x564c703289d0 con 0x564c7043bc80 2024-09-19T09:34:19.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c7043bc80 0x564c7043e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5c0e90640 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c7043bc80 0x564c7043e070 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5276dc44a94b36f server_cookie=a61c49bcfdebbf36 in_seq=0 out_seq=0 2024-09-19T09:34:19.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.023+0000 7ff5a4ff9640 10 client.20169 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.030+0000 7ff5a4ff9640 1 -- 172.21.15.52:0/1381725596 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564c703289d0 con 0x564c7043bc80 2024-09-19T09:34:19.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.030+0000 7ff5a4ff9640 10 client.20169 handle_command_reply: tid=0 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.030+0000 7ff5c5cce740 1 client.20169 shutdown 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 msgr2=0x564c703c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4004230 tx=0x7ff5b4004330 comp rx=0 tx=0).stop 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 shutdown_connections 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x564c7043bc80 0x564c7043e070 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564c703c0940 0x564c703c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x564c703b6080 0x564c703c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 --2- 172.21.15.52:0/1381725596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564c703b5760 0x564c703c88e0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 >> 172.21.15.52:0/1381725596 conn(0x564c703b1cf0 msgr2=0x564c703b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5a4ff9640 0 client.20169 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 shutdown_connections 2024-09-19T09:34:19.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 1 -- 172.21.15.52:0/1381725596 wait complete. 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.031+0000 7ff5c5cce740 20 client.20169 trim_cache size 0 max 16384 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 46, 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "ea70e970": { 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 46, 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:34:19.035 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 142.2, 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:19.036 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 msgr2=0x7ff5a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 0x7ff5a80a5780 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007590 tx=0x7ff5b80914e0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 msgr2=0x7ff5bc100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c920 tx=0x7ff5b800cde0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 shutdown_connections 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff5a80a32c0 0x7ff5a80a5780 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5bc10c160 0x7ff5bc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5bc103650 0x7ff5bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 --2- 172.21.15.52:0/2272710104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5bc102d30 0x7ff5bc100990 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 >> 172.21.15.52:0/2272710104 conn(0x7ff5bc0fc7d0 msgr2=0x7ff5bc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 shutdown_connections 2024-09-19T09:34:19.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.032+0000 7ff5c38f5640 1 -- 172.21.15.52:0/2272710104 wait complete. 2024-09-19T09:34:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: pgmap v724: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-09-19T09:34:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:34:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:34:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:19 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: pgmap v724: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:19 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: pgmap v724: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.6 KiB/s wr, 9 op/s 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:19 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:34:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 -- 172.21.15.52:0/1157922615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102570 msgr2=0x7fb1481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 --2- 172.21.15.52:0/1157922615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102570 0x7fb1481029b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fb138009900 tx=0x7fb13802a480 comp rx=0 tx=0).stop 2024-09-19T09:34:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 -- 172.21.15.52:0/1157922615 shutdown_connections 2024-09-19T09:34:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 --2- 172.21.15.52:0/1157922615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148102ef0 0x7fb14810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 --2- 172.21.15.52:0/1157922615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102570 0x7fb1481029b0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 --2- 172.21.15.52:0/1157922615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148100e20 0x7fb148101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 -- 172.21.15.52:0/1157922615 >> 172.21.15.52:0/1157922615 conn(0x7fb1480fc7d0 msgr2=0x7fb1480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 -- 172.21.15.52:0/1157922615 shutdown_connections 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.715+0000 7fb14fe68640 1 -- 172.21.15.52:0/1157922615 wait complete. 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 Processor -- start 2024-09-19T09:34:19.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 -- start start 2024-09-19T09:34:19.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148100e20 0x7fb148198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148102570 0x7fb148198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb148110f80 con 0x7fb148102ef0 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb148110e00 con 0x7fb148102570 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14fe68640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb148111100 con 0x7fb148100e20 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56326/0 (socket says 172.21.15.52:56326) 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14e405640 1 -- 172.21.15.52:0/2159328974 learned_addr learned my addr 172.21.15.52:0/2159328974 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.716+0000 7fb14dc04640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148100e20 0x7fb148198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14d403640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148102570 0x7fb148198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 -- 172.21.15.52:0/2159328974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148100e20 msgr2=0x7fb148198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148100e20 0x7fb148198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 -- 172.21.15.52:0/2159328974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148102570 msgr2=0x7fb148198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148102570 0x7fb148198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 -- 172.21.15.52:0/2159328974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14819d480 con 0x7fb148102ef0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14e405640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb14000eb10 tx=0x7fb14000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb13effd640 1 -- 172.21.15.52:0/2159328974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140004b20 con 0x7fb148102ef0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb13effd640 1 -- 172.21.15.52:0/2159328974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb140004cc0 con 0x7fb148102ef0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14819d770 con 0x7fb148102ef0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb13effd640 1 -- 172.21.15.52:0/2159328974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140010760 con 0x7fb148102ef0 2024-09-19T09:34:19.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.717+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1481a5050 con 0x7fb148102ef0 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.719+0000 7fb13effd640 1 -- 172.21.15.52:0/2159328974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb140005020 con 0x7fb148102ef0 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 Processor -- start 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 -- start start 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384edb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb13effd640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 0x7fb1340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d384e412e0 con 0x55d384edbdc0 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d384de8ce0 con 0x55d384ee6680 2024-09-19T09:34:19.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.720+0000 7fb152241740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d384e3d2a0 con 0x55d384edb4a0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14dc04640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 0x7fb1340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb13effd640 1 -- 172.21.15.52:0/2159328974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb1400cfff0 con 0x7fb148102ef0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56328/0 (socket says 172.21.15.52:56328) 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 -- 172.21.15.52:0/4172412227 learned_addr learned my addr 172.21.15.52:0/4172412227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384edb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14e405640 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 -- 172.21.15.52:0/4172412227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 msgr2=0x55d384edb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384edb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 -- 172.21.15.52:0/4172412227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 msgr2=0x55d384ee8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 -- 172.21.15.52:0/4172412227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d384dcd440 con 0x55d384edbdc0 2024-09-19T09:34:19.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14dc04640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 0x7fb1340a5700 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb144005d00 tx=0x7fb14400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb14d403640 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb1380096c0 tx=0x7fb138000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc1c8f563da69b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb133fff640 1 -- 172.21.15.52:0/4172412227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138035030 con 0x55d384edbdc0 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb133fff640 1 -- 172.21.15.52:0/4172412227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb138031c20 con 0x55d384edbdc0 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.721+0000 7fb133fff640 1 -- 172.21.15.52:0/4172412227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138003d50 con 0x55d384edbdc0 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 -- 172.21.15.52:0/4172412227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 msgr2=0x55d384ee6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb1380096c0 tx=0x7fb138000bc0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 -- 172.21.15.52:0/4172412227 shutdown_connections 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee6140 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 --2- 172.21.15.52:0/4172412227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384edb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 -- 172.21.15.52:0/4172412227 >> 172.21.15.52:0/4172412227 conn(0x55d384ed7a30 msgr2=0x55d384ed7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 -- 172.21.15.52:0/4172412227 shutdown_connections 2024-09-19T09:34:19.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.722+0000 7fb152241740 1 -- 172.21.15.52:0/4172412227 wait complete. 2024-09-19T09:34:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 -- start start 2024-09-19T09:34:19.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 Processor -- start 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ee5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d384ee9250 con 0x55d384edbdc0 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d384dfc050 con 0x55d384ee6680 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d384ee93d0 con 0x55d384edb4a0 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb152241740 10 client.0 _ll_register_callbacks cb 0x55d384e3c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:19.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb14d403640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb14d403640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56330/0 (socket says 172.21.15.52:56330) 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb14d403640 1 -- 172.21.15.52:0/1720505002 learned_addr learned my addr 172.21.15.52:0/1720505002 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb14e405640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.723+0000 7fb14dc04640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ee5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 -- 172.21.15.52:0/1720505002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 msgr2=0x55d384ee5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ee5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 -- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 msgr2=0x55d384ee3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 -- 172.21.15.52:0/1720505002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d384bb23c0 con 0x55d384edbdc0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14e405640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb14d403640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb138009900 tx=0x7fb138004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a52c0d33498b6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb1317fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:19.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138035040 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb138031950 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb138031c20 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb138056020 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb152241740 10 client.20181 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d384ee9250 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.724+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb138031c20 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb1380046c0 con 0x55d384edbdc0 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 10 client.20181 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 10 client.20181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 20 client.20181 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384ef5d50 0x55d384ef8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 4 client.20181 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d384e4e850 con 0x55d384ef5d50 2024-09-19T09:34:19.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb14dc04640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384ef5d50 0x55d384ef8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb14dc04640 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384ef5d50 0x55d384ef8140 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c8504a44fd3e3f5 server_cookie=6602c4a8e770c316 in_seq=0 out_seq=0 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.725+0000 7fb1317fa640 10 client.20181 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb1317fa640 1 -- 172.21.15.52:0/1720505002 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d384e4e850 con 0x55d384ef5d50 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb1317fa640 10 client.20181 handle_command_reply: tid=0 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 client.20181 shutdown 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 msgr2=0x55d384ee3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb138009900 tx=0x7fb138004590 comp rx=0 tx=0).stop 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 shutdown_connections 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384ef5d50 0x55d384ef8140 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384ee6680 0x55d384ee3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384edbdc0 0x55d384ee3250 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.727+0000 7fb152241740 1 --2- 172.21.15.52:0/1720505002 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ee5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.726+0000 7fb1317fa640 0 client.20181 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.727+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 >> 172.21.15.52:0/1720505002 conn(0x55d384ed7a30 msgr2=0x55d384edd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.727+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 shutdown_connections 2024-09-19T09:34:19.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.727+0000 7fb152241740 1 -- 172.21.15.52:0/1720505002 wait complete. 2024-09-19T09:34:19.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.727+0000 7fb152241740 20 client.20181 trim_cache size 0 max 16384 2024-09-19T09:34:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.744+0000 7fb152241740 1 Processor -- start 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.744+0000 7fb152241740 1 -- start start 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.744+0000 7fb152241740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ef24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.744+0000 7fb152241740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 0x55d384ee1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb152241740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb152241740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481ade50 con 0x55d384ee6680 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb152241740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481ab720 con 0x55d384edbdc0 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb152241740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481a9570 con 0x55d384edb4a0 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56346/0 (socket says 172.21.15.52:56346) 2024-09-19T09:34:19.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14e405640 1 -- 172.21.15.52:0/1805484754 learned_addr learned my addr 172.21.15.52:0/1805484754 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14dc04640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ef24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 0x55d384ee1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 -- 172.21.15.52:0/1805484754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 msgr2=0x55d384ef24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ef24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 -- 172.21.15.52:0/1805484754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 msgr2=0x55d384efd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 -- 172.21.15.52:0/1805484754 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d384edc330 con 0x55d384edbdc0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14e405640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb14d403640 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 0x55d384ee1b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb138004a90 tx=0x7fb1380035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f91417bd481c0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb1337fe640 1 -- 172.21.15.52:0/1805484754 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138035070 con 0x55d384edbdc0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb1337fe640 1 -- 172.21.15.52:0/1805484754 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1380054e0 con 0x55d384edbdc0 2024-09-19T09:34:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.745+0000 7fb1337fe640 1 -- 172.21.15.52:0/1805484754 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138031a80 con 0x55d384edbdc0 2024-09-19T09:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 -- 172.21.15.52:0/1805484754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 msgr2=0x55d384ee1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 0x55d384ee1b20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb138004a90 tx=0x7fb1380035f0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 -- 172.21.15.52:0/1805484754 shutdown_connections 2024-09-19T09:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384efd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edbdc0 0x55d384ee1b20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 --2- 172.21.15.52:0/1805484754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edb4a0 0x55d384ef24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 -- 172.21.15.52:0/1805484754 >> 172.21.15.52:0/1805484754 conn(0x55d384ed7a30 msgr2=0x55d384ed6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 -- 172.21.15.52:0/1805484754 shutdown_connections 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.746+0000 7fb152241740 1 -- 172.21.15.52:0/1805484754 wait complete. 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 -- start start 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 Processor -- start 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edbdc0 0x55d384eea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481a9be0 con 0x55d384ee6680 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481ab050 con 0x55d384edb4a0 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1481aa2b0 con 0x55d384edbdc0 2024-09-19T09:34:19.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb152241740 10 client.0 _ll_register_callbacks cb 0x7fb138004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.747+0000 7fb14dc04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14d403640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edbdc0 0x55d384eea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56348/0 (socket says 172.21.15.52:56348) 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14dc04640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:36716/0 (socket says 172.21.15.52:36716) 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 -- 172.21.15.52:0/4252164146 learned_addr learned my addr 172.21.15.52:0/4252164146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 -- 172.21.15.52:0/4252164146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edbdc0 msgr2=0x55d384eea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edbdc0 0x55d384eea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 -- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 msgr2=0x55d384eea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 -- 172.21.15.52:0/4252164146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d384f5f7c0 con 0x55d384ee6680 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14dc04640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb14e405640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fb140098f60 tx=0x7fb14009c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61603554e11b540d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:19.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb1317fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140079ba0 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb14008fff0 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1380054e0 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb14009cc90 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb152241740 10 client.20187 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.748+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d384f60a90 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1380054e0 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb140005350 con 0x55d384ee6680 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 10 client.20187 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 10 client.20187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 20 client.20187 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384f61200 0x55d384f635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 4 client.20187 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:34:19.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d384e48d60 con 0x55d384f61200 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.749+0000 7fb14dc04640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384f61200 0x55d384f635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb14dc04640 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384f61200 0x55d384f635f0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ca910582c3e1d43 server_cookie=57cd0e26cf856cef in_seq=0 out_seq=0 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb1317fa640 10 client.20187 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb1317fa640 1 -- 172.21.15.52:0/4252164146 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d384e48d60 con 0x55d384f61200 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb1317fa640 10 client.20187 handle_command_reply: tid=0 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 client.20187 shutdown 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 msgr2=0x55d384eeadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fb140098f60 tx=0x7fb14009c0d0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 shutdown_connections 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d384f61200 0x55d384f635f0 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d384ee6680 0x55d384eeadd0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb1317fa640 0 client.20187 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d384edbdc0 0x55d384eea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 --2- 172.21.15.52:0/4252164146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d384edb4a0 0x55d384eea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 >> 172.21.15.52:0/4252164146 conn(0x55d384ed7a30 msgr2=0x55d384edce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 shutdown_connections 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 1 -- 172.21.15.52:0/4252164146 wait complete. 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.750+0000 7fb152241740 20 client.20187 trim_cache size 0 max 16384 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:34:19.758 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 msgr2=0x7fb1340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 0x7fb1340a5700 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb144005d00 tx=0x7fb14400b410 comp rx=0 tx=0).stop 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 msgr2=0x7fb14819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb14000eb10 tx=0x7fb14000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 shutdown_connections 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb148102ef0 0x7fb14819cda0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb148102570 0x7fb148198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1340a3240 0x7fb1340a5700 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 --2- 172.21.15.52:0/2159328974 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb148100e20 0x7fb148198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 >> 172.21.15.52:0/2159328974 conn(0x7fb1480fc7d0 msgr2=0x7fb14806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 shutdown_connections 2024-09-19T09:34:19.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:19.751+0000 7fb14fe68640 1 -- 172.21.15.52:0/2159328974 wait complete. 2024-09-19T09:34:20.515 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ea70e970', quiesce took 6.2 seconds. Will release after: 16.0 2024-09-19T09:34:20.980 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:34:20.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:34:21.243 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:21.364 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:21 smithi052 ceph-mon[30947]: pgmap v725: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:34:21.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:21 smithi169 ceph-mon[35454]: pgmap v725: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:34:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:21 smithi086 ceph-mon[34813]: pgmap v725: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:34:21.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1368655432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484106f10 msgr2=0x7fc48410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:21.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1368655432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484106f10 0x7fc48410ea90 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009ca0 tx=0x7fc47c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1368655432 shutdown_connections 2024-09-19T09:34:21.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1368655432 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484106f10 0x7fc48410ea90 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1368655432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1368655432 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484101de0 0x7fc4841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1368655432 >> 172.21.15.52:0/1368655432 conn(0x7fc4840fd8c0 msgr2=0x7fc4840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1368655432 shutdown_connections 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.697+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1368655432 wait complete. 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 Processor -- start 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 -- start start 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484106f10 0x7fc48419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc484111f90 con 0x7fc484101de0 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc484111e10 con 0x7fc484102790 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48c1a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc484112110 con 0x7fc484106f10 2024-09-19T09:34:21.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc489f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc489f3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56360/0 (socket says 172.21.15.52:56360) 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc489f3c640 1 -- 172.21.15.52:0/1868084194 learned_addr learned my addr 172.21.15.52:0/1868084194 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.698+0000 7fc48a73d640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484106f10 0x7fc48419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 -- 172.21.15.52:0/1868084194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484106f10 msgr2=0x7fc48419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc48973b640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484106f10 0x7fc48419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 -- 172.21.15.52:0/1868084194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 msgr2=0x7fc4841989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 -- 172.21.15.52:0/1868084194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48419d420 con 0x7fc484101de0 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc48973b640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc489f3c640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fc48000b4a0 tx=0x7fc48000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:21.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480014070 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48419d710 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc480010af0 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480017d10 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.699+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4841a4ff0 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.700+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4841021c0 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.702+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc480017070 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.703+0000 7fc47affd640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 0x7fc4700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.703+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc4800cf200 con 0x7fc484101de0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.703+0000 7fc48973b640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 0x7fc4700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.703+0000 7fc48973b640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 0x7fc4700a5700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc4841088e0 tx=0x7fc474005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:21.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.706+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc48009be40 con 0x7fc484101de0 2024-09-19T09:34:21.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.921+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc484109b60 con 0x7fc484101de0 2024-09-19T09:34:21.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.922+0000 7fc47affd640 1 -- 172.21.15.52:0/1868084194 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fc48009b740 con 0x7fc484101de0 2024-09-19T09:34:21.925 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:34:21.925 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:34:21.925 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 msgr2=0x7fc4700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 0x7fc4700a5700 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc4841088e0 tx=0x7fc474005d30 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 msgr2=0x7fc484198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fc48000b4a0 tx=0x7fc48000b960 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 shutdown_connections 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4700a3240 0x7fc4700a5700 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc484106f10 0x7fc48419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc484102790 0x7fc4841989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 --2- 172.21.15.52:0/1868084194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc484101de0 0x7fc484198470 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.924+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 >> 172.21.15.52:0/1868084194 conn(0x7fc4840fd8c0 msgr2=0x7fc4840fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:21.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.925+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 shutdown_connections 2024-09-19T09:34:21.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:21.925+0000 7fc48c1a0640 1 -- 172.21.15.52:0/1868084194 wait complete. 2024-09-19T09:34:22.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:22 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1868084194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:22 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1868084194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:22 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1868084194' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.613 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:34:22.874 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:23.301 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:23 smithi052 ceph-mon[30947]: pgmap v726: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-09-19T09:34:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 -- 172.21.15.52:0/4170083246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0101de0 msgr2=0x7fdeb01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 --2- 172.21.15.52:0/4170083246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0101de0 0x7fdeb01021c0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009900 tx=0x7fdea002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 -- 172.21.15.52:0/4170083246 shutdown_connections 2024-09-19T09:34:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 --2- 172.21.15.52:0/4170083246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0106f10 0x7fdeb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 --2- 172.21.15.52:0/4170083246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 0x7fdeb01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 --2- 172.21.15.52:0/4170083246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0101de0 0x7fdeb01021c0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 -- 172.21.15.52:0/4170083246 >> 172.21.15.52:0/4170083246 conn(0x7fdeb00fd8c0 msgr2=0x7fdeb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 -- 172.21.15.52:0/4170083246 shutdown_connections 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.383+0000 7fdeb6416640 1 -- 172.21.15.52:0/4170083246 wait complete. 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 Processor -- start 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 -- start start 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0101de0 0x7fdeb0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 0x7fdeb01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb0111f30 con 0x7fdeb0106f10 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb0111db0 con 0x7fdeb0101de0 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb6416640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01120b0 con 0x7fdeb0102790 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.384+0000 7fdeb49b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56378/0 (socket says 172.21.15.52:56378) 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 -- 172.21.15.52:0/326180337 learned_addr learned my addr 172.21.15.52:0/326180337 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 0x7fdeb01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeaffff640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0101de0 0x7fdeb0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 -- 172.21.15.52:0/326180337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 msgr2=0x7fdeb01988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 0x7fdeb01988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 -- 172.21.15.52:0/326180337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0101de0 msgr2=0x7fdeb0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0101de0 0x7fdeb0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 -- 172.21.15.52:0/326180337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb019d340 con 0x7fdeb0106f10 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb49b3640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fdea800eaa0 tx=0x7fdea800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdead7fa640 1 -- 172.21.15.52:0/326180337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8004d20 con 0x7fdeb0106f10 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb019d630 con 0x7fdeb0106f10 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdead7fa640 1 -- 172.21.15.52:0/326180337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea8005020 con 0x7fdeb0106f10 2024-09-19T09:34:23.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdead7fa640 1 -- 172.21.15.52:0/326180337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea80116d0 con 0x7fdeb0106f10 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.385+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb01a4f10 con 0x7fdeb0106f10 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdead7fa640 1 -- 172.21.15.52:0/326180337 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdea80051d0 con 0x7fdeb0106f10 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 Processor -- start 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 -- start start 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b3169e0 0x55a39b316e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b323b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a39b2782f0 con 0x55a39b317f50 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a39b21fcf0 con 0x55a39b3169e0 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a39b2742b0 con 0x55a39b321780 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.388+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56392/0 (socket says 172.21.15.52:56392) 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/2936623522 learned_addr learned my addr 172.21.15.52:0/2936623522 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:23.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdead7fa640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 0x7fde980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaffff640 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b3169e0 0x55a39b316e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/2936623522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 msgr2=0x55a39b323b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b323b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/2936623522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b3169e0 msgr2=0x55a39b316e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b3169e0 0x55a39b316e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/2936623522 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a39b2043a0 con 0x55a39b317f50 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeb49b3640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 0x7fde980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdead7fa640 1 -- 172.21.15.52:0/326180337 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdea80cfaa0 con 0x7fdeb0106f10 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fdea400ad10 tx=0x7fdea40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546bf9ffa860191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fde967fc640 1 -- 172.21.15.52:0/2936623522 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4012450 con 0x55a39b317f50 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fde967fc640 1 -- 172.21.15.52:0/2936623522 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4012ad0 con 0x55a39b317f50 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.389+0000 7fde967fc640 1 -- 172.21.15.52:0/2936623522 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea400fb90 con 0x55a39b317f50 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2936623522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 msgr2=0x55a39b3164a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb49b3640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 0x7fde980a5700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdea8098a10 tx=0x7fdea801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fdea400ad10 tx=0x7fdea40117b0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2936623522 shutdown_connections 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b323b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b3169e0 0x55a39b316e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2936623522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3164a0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2936623522 >> 172.21.15.52:0/2936623522 conn(0x55a39b2db310 msgr2=0x55a39b313070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2936623522 shutdown_connections 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.390+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2936623522 wait complete. 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 -- start start 2024-09-19T09:34:23.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 Processor -- start 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b31e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b31ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a39b324480 con 0x55a39b3169e0 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a39b233060 con 0x55a39b317f50 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a39b324600 con 0x55a39b321780 2024-09-19T09:34:23.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeb87ef740 10 client.0 _ll_register_callbacks cb 0x55a39af868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56408/0 (socket says 172.21.15.52:56408) 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/1734870809 learned_addr learned my addr 172.21.15.52:0/1734870809 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeaffff640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b31e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.391+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b31ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 msgr2=0x55a39b31ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b31ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/1734870809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 msgr2=0x55a39b31e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b31e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/1734870809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a39afe93c0 con 0x55a39b3169e0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaffff640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b31e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fdea400f870 tx=0x7fdea4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88d696715d2e6db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fde8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:23.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea400fb10 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdea400fcb0 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea4012ad0 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdea402e030 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeb87ef740 10 client.20205 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a39b32ffa0 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.392+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4012ad0 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdea402b4e0 con 0x55a39b3169e0 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 10 client.20205 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 10 client.20205 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 20 client.20205 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b3312f0 0x55a39b3336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 4 client.20205 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:23.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a39b285860 con 0x55a39b3312f0 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeaffff640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b3312f0 0x55a39b3336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fdeaffff640 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b3312f0 0x55a39b3336e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f91db014b3b376bd server_cookie=5107883c46e5b0b4 in_seq=0 out_seq=0 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.393+0000 7fde8f7fe640 10 client.20205 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.394+0000 7fde8f7fe640 1 -- 172.21.15.52:0/1734870809 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a39b285860 con 0x55a39b3312f0 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.394+0000 7fde8f7fe640 10 client.20205 handle_command_reply: tid=0 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.394+0000 7fdeb87ef740 1 client.20205 shutdown 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 msgr2=0x55a39b3211e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fdea400f870 tx=0x7fdea4005850 comp rx=0 tx=0).stop 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 shutdown_connections 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b3312f0 0x55a39b3336e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b321780 0x55a39b31ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b31e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/1734870809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b3169e0 0x55a39b3211e0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 >> 172.21.15.52:0/1734870809 conn(0x55a39b2db310 msgr2=0x55a39b318d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fde8f7fe640 0 client.20205 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 shutdown_connections 2024-09-19T09:34:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 1 -- 172.21.15.52:0/1734870809 wait complete. 2024-09-19T09:34:23.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.395+0000 7fdeb87ef740 20 client.20205 trim_cache size 0 max 16384 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 Processor -- start 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 -- start start 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b336700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b336c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01ade90 con 0x55a39b321780 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01ab760 con 0x55a39b317f50 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01a95b0 con 0x55a39b3169e0 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56424/0 (socket says 172.21.15.52:56424) 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.408+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/48808966 learned_addr learned my addr 172.21.15.52:0/48808966 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b336700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaffff640 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b336c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/48808966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 msgr2=0x55a39b336700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b336700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/48808966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 msgr2=0x55a39b336c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b336c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 -- 172.21.15.52:0/48808966 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a39b31f430 con 0x55a39b321780 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fdea4001eb0 tx=0x7fdea401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886d798374d5c1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fde95ffb640 1 -- 172.21.15.52:0/48808966 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4011cb0 con 0x55a39b321780 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fde95ffb640 1 -- 172.21.15.52:0/48808966 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4039070 con 0x55a39b321780 2024-09-19T09:34:23.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.409+0000 7fde95ffb640 1 -- 172.21.15.52:0/48808966 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea400f8a0 con 0x55a39b321780 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- 172.21.15.52:0/48808966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 msgr2=0x55a39b31b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fdea4001eb0 tx=0x7fdea401c040 comp rx=0 tx=0).stop 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- 172.21.15.52:0/48808966 shutdown_connections 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b321780 0x55a39b31b6f0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b317f50 0x55a39b336c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/48808966 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b336700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- 172.21.15.52:0/48808966 >> 172.21.15.52:0/48808966 conn(0x55a39b2db310 msgr2=0x55a39b31d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- 172.21.15.52:0/48808966 shutdown_connections 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- 172.21.15.52:0/48808966 wait complete. 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 -- start start 2024-09-19T09:34:23.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.410+0000 7fdeb87ef740 1 Processor -- start 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b3344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 0x55a39b334f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01a9c20 con 0x55a39b317f50 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01ab090 con 0x55a39b321780 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb01aa2f0 con 0x55a39b3169e0 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeb87ef740 10 client.0 _ll_register_callbacks cb 0x7fdea400ac10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56432/0 (socket says 172.21.15.52:56432) 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 -- 172.21.15.52:0/2256555231 learned_addr learned my addr 172.21.15.52:0/2256555231 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 0x55a39b334f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b3344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 -- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 msgr2=0x55a39b3344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b3344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 -- 172.21.15.52:0/2256555231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 msgr2=0x55a39b334f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 0x55a39b334f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 -- 172.21.15.52:0/2256555231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a39b319530 con 0x55a39b317f50 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 0x55a39b334f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fdeaffff640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009230 tx=0x7fdea0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544064fd4e4c46cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.411+0000 7fde8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0035040 con 0x55a39b317f50 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdea0004040 con 0x55a39b317f50 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea4039070 con 0x55a39b317f50 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdea0053020 con 0x55a39b317f50 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 10 client.20211 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:23.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a39b39bd80 con 0x55a39b317f50 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4039070 con 0x55a39b317f50 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdea00049a0 con 0x55a39b317f50 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 10 client.20211 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 10 client.20211 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 20 client.20211 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b39c480 0x55a39b39e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 4 client.20211 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a39b27fd70 con 0x55a39b39c480 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.412+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b39c480 0x55a39b39e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fde8f7fe640 10 client.20211 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeaf7fe640 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b39c480 0x55a39b39e8a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9fc8572bb4872629 server_cookie=50d3e7574ca3ff4d in_seq=0 out_seq=0 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fde8f7fe640 1 -- 172.21.15.52:0/2256555231 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a39b27fd70 con 0x55a39b39c480 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fde8f7fe640 10 client.20211 handle_command_reply: tid=0 2024-09-19T09:34:23.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 client.20211 shutdown 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 msgr2=0x55a39b3349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009230 tx=0x7fdea0005e70 comp rx=0 tx=0).stop 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 shutdown_connections 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a39b39c480 0x55a39b39e8a0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a39b321780 0x55a39b334f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a39b317f50 0x55a39b3349f0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 --2- 172.21.15.52:0/2256555231 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a39b3169e0 0x55a39b3344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 >> 172.21.15.52:0/2256555231 conn(0x55a39b2db310 msgr2=0x55a39b32c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fde8f7fe640 0 client.20211 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 shutdown_connections 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.413+0000 7fdeb87ef740 1 -- 172.21.15.52:0/2256555231 wait complete. 2024-09-19T09:34:23.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb87ef740 20 client.20211 trim_cache size 0 max 16384 2024-09-19T09:34:23.422 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 msgr2=0x7fde980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 0x7fde980a5700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdea8098a10 tx=0x7fdea801d000 comp rx=0 tx=0).stop 2024-09-19T09:34:23.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 msgr2=0x7fdeb019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fdea800eaa0 tx=0x7fdea800eea0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 shutdown_connections 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeb0106f10 0x7fdeb019cc60 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fde980a3240 0x7fde980a5700 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdeb0102790 0x7fdeb01988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 --2- 172.21.15.52:0/326180337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdeb0101de0 0x7fdeb0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.414+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 >> 172.21.15.52:0/326180337 conn(0x7fdeb00fd8c0 msgr2=0x7fdeb00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.415+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 shutdown_connections 2024-09-19T09:34:23.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:23.415+0000 7fdeb6416640 1 -- 172.21.15.52:0/326180337 wait complete. 2024-09-19T09:34:23.442 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:23 smithi169 ceph-mon[35454]: pgmap v726: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-09-19T09:34:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:23 smithi086 ceph-mon[34813]: pgmap v726: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 12 op/s 2024-09-19T09:34:24.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:34:24.434 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:24.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 -- 172.21.15.52:0/949920104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594102570 msgr2=0x7f35941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 --2- 172.21.15.52:0/949920104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594102570 0x7f35941029b0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f357c009900 tx=0x7f357c02a480 comp rx=0 tx=0).stop 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 -- 172.21.15.52:0/949920104 shutdown_connections 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 --2- 172.21.15.52:0/949920104 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 0x7f359410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 --2- 172.21.15.52:0/949920104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594102570 0x7f35941029b0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 --2- 172.21.15.52:0/949920104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594100e20 0x7f3594101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 -- 172.21.15.52:0/949920104 >> 172.21.15.52:0/949920104 conn(0x7f35940fc7d0 msgr2=0x7f35940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 -- 172.21.15.52:0/949920104 shutdown_connections 2024-09-19T09:34:24.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.849+0000 7f359a42b640 1 -- 172.21.15.52:0/949920104 wait complete. 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 Processor -- start 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 -- start start 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 0x7f35940fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 0x7f35940fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3594110f80 con 0x7f3594100e20 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3594110e00 con 0x7f3594102570 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f359a42b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3594111100 con 0x7f3594102ef0 2024-09-19T09:34:24.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56448/0 (socket says 172.21.15.52:56448) 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 -- 172.21.15.52:0/3672027111 learned_addr learned my addr 172.21.15.52:0/3672027111 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f358bfff640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 0x7f35940fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f35989c8640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 0x7f35940fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 -- 172.21.15.52:0/3672027111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 msgr2=0x7f35940fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 0x7f35940fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 -- 172.21.15.52:0/3672027111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 msgr2=0x7f35940fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 0x7f35940fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f3593fff640 1 -- 172.21.15.52:0/3672027111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35941a6910 con 0x7f3594100e20 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.850+0000 7f358bfff640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 0x7f35940fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f3593fff640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f358400c920 tx=0x7f358400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f3591ffb640 1 -- 172.21.15.52:0/3672027111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584007c70 con 0x7f3594100e20 2024-09-19T09:34:24.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f3591ffb640 1 -- 172.21.15.52:0/3672027111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3584007e10 con 0x7f3594100e20 2024-09-19T09:34:24.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35941a6c00 con 0x7f3594100e20 2024-09-19T09:34:24.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f3591ffb640 1 -- 172.21.15.52:0/3672027111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584018890 con 0x7f3594100e20 2024-09-19T09:34:24.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.851+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35941a7140 con 0x7f3594100e20 2024-09-19T09:34:24.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.853+0000 7f3591ffb640 1 -- 172.21.15.52:0/3672027111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3584018a70 con 0x7f3594100e20 2024-09-19T09:34:24.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.853+0000 7f359c804740 1 Processor -- start 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.853+0000 7f359c804740 1 -- start start 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433bb5d0 0x5629433bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5629433212f0 con 0x5629433c6370 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5629432c8cf0 con 0x5629433bb5d0 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f359c804740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56294331d2b0 con 0x5629433bcb40 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f3591ffb640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 0x7f35800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56462/0 (socket says 172.21.15.52:56462) 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 -- 172.21.15.52:0/2477557417 learned_addr learned my addr 172.21.15.52:0/2477557417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f3591ffb640 1 -- 172.21.15.52:0/3672027111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35840cfb90 con 0x7f3594100e20 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f3593fff640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433bb5d0 0x5629433bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f35989c8640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 0x7f35800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f35989c8640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 -- 172.21.15.52:0/2477557417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 msgr2=0x5629433bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 -- 172.21.15.52:0/2477557417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433bb5d0 msgr2=0x5629433bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433bb5d0 0x5629433bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f358bfff640 1 -- 172.21.15.52:0/2477557417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629432ad3a0 con 0x5629433c6370 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.854+0000 7f35989c8640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f358bfff640 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f357c0314e0 tx=0x7f357c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc2db25a67b4e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f35989c8640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 0x7f35800a5700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f358c005cc0 tx=0x7f358c00b3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f358a7fc640 1 -- 172.21.15.52:0/2477557417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c035030 con 0x5629433c6370 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f358a7fc640 1 -- 172.21.15.52:0/2477557417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f357c003ad0 con 0x5629433c6370 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f358a7fc640 1 -- 172.21.15.52:0/2477557417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c031c60 con 0x5629433c6370 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f359c804740 1 -- 172.21.15.52:0/2477557417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 msgr2=0x5629433c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.855+0000 7f359c804740 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f357c0314e0 tx=0x7f357c004200 comp rx=0 tx=0).stop 2024-09-19T09:34:24.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 -- 172.21.15.52:0/2477557417 shutdown_connections 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433c6370 0x5629433c8760 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433bb5d0 0x5629433bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- 172.21.15.52:0/2477557417 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 -- 172.21.15.52:0/2477557417 >> 172.21.15.52:0/2477557417 conn(0x562943384310 msgr2=0x5629433b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 -- 172.21.15.52:0/2477557417 shutdown_connections 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 -- 172.21.15.52:0/2477557417 wait complete. 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 -- start start 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 Processor -- start 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 0x5629433c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.856+0000 7f359c804740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f359c804740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5629433c9010 con 0x5629433bcb40 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f359c804740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5629432dc060 con 0x5629433c6370 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f359c804740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5629433c9190 con 0x5629433bb5d0 2024-09-19T09:34:24.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f359c804740 10 client.0 _ll_register_callbacks cb 0x56294302f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56464/0 (socket says 172.21.15.52:56464) 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 -- 172.21.15.52:0/2136530335 learned_addr learned my addr 172.21.15.52:0/2136530335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f3593fff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 0x5629433c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f35989c8640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 -- 172.21.15.52:0/2136530335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 msgr2=0x5629433c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 0x5629433c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 -- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 msgr2=0x5629433c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 -- 172.21.15.52:0/2136530335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629430923c0 con 0x5629433bcb40 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f3593fff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 0x5629433c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f35989c8640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f358bfff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f357c02a4c0 tx=0x7f357c031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b72554970dcb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f35737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c035070 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f357c0035f0 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.857+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f357c003ad0 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f357c053030 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 10 client.20223 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629433d4a20 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f357c003ad0 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f357c03c930 con 0x5629433bcb40 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 10 client.20223 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 10 client.20223 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 20 client.20223 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5629433d5d70 0x5629433d8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 4 client.20223 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:24.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56294332e860 con 0x5629433d5d70 2024-09-19T09:34:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.858+0000 7f3593fff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5629433d5d70 0x5629433d8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.859+0000 7f3593fff640 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5629433d5d70 0x5629433d8160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b16bc100ecec1078 server_cookie=68be105e8952ca80 in_seq=0 out_seq=0 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.859+0000 7f35737fe640 10 client.20223 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.859+0000 7f35737fe640 1 -- 172.21.15.52:0/2136530335 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56294332e860 con 0x5629433d5d70 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.859+0000 7f35737fe640 10 client.20223 handle_command_reply: tid=0 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.859+0000 7f359c804740 1 client.20223 shutdown 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 msgr2=0x5629433c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f357c02a4c0 tx=0x7f357c031680 comp rx=0 tx=0).stop 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 shutdown_connections 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5629433d5d70 0x5629433d8160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bcb40 0x5629433c3010 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 --2- 172.21.15.52:0/2136530335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bb5d0 0x5629433c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 >> 172.21.15.52:0/2136530335 conn(0x562943384310 msgr2=0x5629433bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f35737fe640 0 client.20223 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:24.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 shutdown_connections 2024-09-19T09:34:24.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 1 -- 172.21.15.52:0/2136530335 wait complete. 2024-09-19T09:34:24.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.860+0000 7f359c804740 20 client.20223 trim_cache size 0 max 16384 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 Processor -- start 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 -- start start 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433dada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35941b20c0 con 0x5629433bb5d0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35941af990 con 0x5629433c6370 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f359c804740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35941ad7e0 con 0x5629433bcb40 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56480/0 (socket says 172.21.15.52:56480) 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.873+0000 7f3593fff640 1 -- 172.21.15.52:0/2649431922 learned_addr learned my addr 172.21.15.52:0/2649431922 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f358bfff640 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433dada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 -- 172.21.15.52:0/2649431922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 msgr2=0x5629433dada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433dada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 -- 172.21.15.52:0/2649431922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 msgr2=0x5629433db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 -- 172.21.15.52:0/2649431922 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629433bc760 con 0x5629433bb5d0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3593fff640 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f358400dfd0 tx=0x7f35840d1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1784206e68ca4537 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3589ffb640 1 -- 172.21.15.52:0/2649431922 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840a4da0 con 0x5629433bb5d0 2024-09-19T09:34:24.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3589ffb640 1 -- 172.21.15.52:0/2649431922 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358409a1d0 con 0x5629433bb5d0 2024-09-19T09:34:24.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.874+0000 7f3589ffb640 1 -- 172.21.15.52:0/2649431922 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840987a0 con 0x5629433bb5d0 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- 172.21.15.52:0/2649431922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 msgr2=0x5629433b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f358400dfd0 tx=0x7f35840d1040 comp rx=0 tx=0).stop 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- 172.21.15.52:0/2649431922 shutdown_connections 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629433db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433dada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 --2- 172.21.15.52:0/2649431922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433b7e10 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- 172.21.15.52:0/2649431922 >> 172.21.15.52:0/2649431922 conn(0x562943384310 msgr2=0x5629433b7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- 172.21.15.52:0/2649431922 shutdown_connections 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- 172.21.15.52:0/2649431922 wait complete. 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 -- start start 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.875+0000 7f359c804740 1 Processor -- start 2024-09-19T09:34:24.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433d89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629434386e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35941ade50 con 0x5629433bb5d0 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f35941af2c0 con 0x5629433c6370 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35941ae520 con 0x5629433bcb40 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 10 client.0 _ll_register_callbacks cb 0x7f358400a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56484/0 (socket says 172.21.15.52:56484) 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 -- 172.21.15.52:0/1647933617 learned_addr learned my addr 172.21.15.52:0/1647933617 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f35989c8640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629434386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 -- 172.21.15.52:0/1647933617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 msgr2=0x5629433d89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433d89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 -- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 msgr2=0x5629434386e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629434386e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 -- 172.21.15.52:0/1647933617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562943438d50 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f3593fff640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f358409c0c0 tx=0x7f358400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e98062f031e3465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f35737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840a4da0 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f35840a01b0 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.876+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f358409a1d0 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3584066070 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 10 client.20229 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5629434400b0 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f358409a1d0 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f35840a4910 con 0x5629433bb5d0 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 10 client.20229 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 10 client.20229 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:34:24.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 20 client.20229 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562943440720 0x562943442b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 4 client.20229 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562943328d70 con 0x562943440720 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.877+0000 7f358bfff640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562943440720 0x562943442b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f358bfff640 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562943440720 0x562943442b10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99e1fdd5a03a4b40 server_cookie=6c984fded4e7eb19 in_seq=0 out_seq=0 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f35737fe640 10 client.20229 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f35737fe640 1 -- 172.21.15.52:0/1647933617 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562943328d70 con 0x562943440720 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f35737fe640 10 client.20229 handle_command_reply: tid=0 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 client.20229 shutdown 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 msgr2=0x5629433d8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f358409c0c0 tx=0x7f358400def0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 shutdown_connections 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562943440720 0x562943442b10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5629433c6370 0x5629434386e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5629433bcb40 0x5629433d89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 --2- 172.21.15.52:0/1647933617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5629433bb5d0 0x5629433d8460 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f35737fe640 0 client.20229 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 >> 172.21.15.52:0/1647933617 conn(0x562943384310 msgr2=0x5629433c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 shutdown_connections 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 1 -- 172.21.15.52:0/1647933617 wait complete. 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.878+0000 7f359c804740 20 client.20229 trim_cache size 0 max 16384 2024-09-19T09:34:24.885 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 msgr2=0x7f35800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 0x7f35800a5700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f358c005cc0 tx=0x7f358c00b3e0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 msgr2=0x7f35940fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f358400c920 tx=0x7f358400cde0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 shutdown_connections 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f35800a3240 0x7f35800a5700 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3594102ef0 0x7f35940fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3594102570 0x7f35940fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 --2- 172.21.15.52:0/3672027111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3594100e20 0x7f35940fcc80 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 >> 172.21.15.52:0/3672027111 conn(0x7f35940fc7d0 msgr2=0x7f359406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 shutdown_connections 2024-09-19T09:34:24.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:24.879+0000 7f359a42b640 1 -- 172.21.15.52:0/3672027111 wait complete. 2024-09-19T09:34:25.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:25 smithi052 ceph-mon[30947]: pgmap v727: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:34:25.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:25 smithi169 ceph-mon[35454]: pgmap v727: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:34:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:25 smithi086 ceph-mon[34813]: pgmap v727: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:34:25.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:34:25.844 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3284645498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc106a80 msgr2=0x7fbdcc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3284645498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc106a80 0x7fbdcc106e60 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009930 tx=0x7fbdb402a420 comp rx=0 tx=0).stop 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3284645498 shutdown_connections 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3284645498 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc101420 0x7fbdcc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3284645498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc100a80 0x7fbdcc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3284645498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc106a80 0x7fbdcc106e60 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3284645498 >> 172.21.15.52:0/3284645498 conn(0x7fbdcc0fc7a0 msgr2=0x7fbdcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3284645498 shutdown_connections 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.331+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3284645498 wait complete. 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 Processor -- start 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 -- start start 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 0x7fbdcc199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 0x7fbdcc1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc110ec0 con 0x7fbdcc100a80 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc110d40 con 0x7fbdcc106a80 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd2ff4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc111040 con 0x7fbdcc101420 2024-09-19T09:34:26.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56500/0 (socket says 172.21.15.52:56500) 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 -- 172.21.15.52:0/3686606342 learned_addr learned my addr 172.21.15.52:0/3686606342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 0x7fbdcc1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 -- 172.21.15.52:0/3686606342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 msgr2=0x7fbdcc199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 0x7fbdcc199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 0x7fbdcc199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 -- 172.21.15.52:0/3686606342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 msgr2=0x7fbdcc1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.332+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 0x7fbdcc1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdd0d90640 1 -- 172.21.15.52:0/3686606342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc1a48f0 con 0x7fbdcc100a80 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 0x7fbdcc1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 0x7fbdcc199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009230 tx=0x7fbdb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdc9ffb640 1 -- 172.21.15.52:0/3686606342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb403f030 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdc9ffb640 1 -- 172.21.15.52:0/3686606342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb4003ad0 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdcc1a4ac0 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdc9ffb640 1 -- 172.21.15.52:0/3686606342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4035070 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.333+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdcc1a4f70 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.335+0000 7fbdc9ffb640 1 -- 172.21.15.52:0/3686606342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbdb4042030 con 0x7fbdcc100a80 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 Processor -- start 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 -- start start 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b283090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b283a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56359b1e92f0 con 0x56359b28e370 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56359b190cf0 con 0x56359b284b40 2024-09-19T09:34:26.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56359b1e52b0 con 0x56359b2835d0 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdc9ffb640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 0x7fbdb80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56516/0 (socket says 172.21.15.52:56516) 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1350273232 learned_addr learned my addr 172.21.15.52:0/1350273232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 0x7fbdb80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdc9ffb640 1 -- 172.21.15.52:0/3686606342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbdb40efed0 con 0x7fbdcc100a80 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b283a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdd1591640 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b283090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1350273232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 msgr2=0x56359b283a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b283a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1350273232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 msgr2=0x56359b283090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b283090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.336+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1350273232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359b1753a0 con 0x56359b28e370 2024-09-19T09:34:26.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.337+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ef0 tx=0x7fbdbc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7e63eed3ade8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.337+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 0x7fbdb80a5780 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.337+0000 7fbdc2ffd640 1 -- 172.21.15.52:0/1350273232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004d20 con 0x56359b28e370 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.337+0000 7fbdc2ffd640 1 -- 172.21.15.52:0/1350273232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdbc005500 con 0x56359b28e370 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.337+0000 7fbdc2ffd640 1 -- 172.21.15.52:0/1350273232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0119a0 con 0x56359b28e370 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1350273232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 msgr2=0x56359b290760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ef0 tx=0x7fbdbc00f730 comp rx=0 tx=0).stop 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1350273232 shutdown_connections 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b290760 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b283a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1350273232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b283090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1350273232 >> 172.21.15.52:0/1350273232 conn(0x56359b24c310 msgr2=0x56359b27fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1350273232 shutdown_connections 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1350273232 wait complete. 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 -- start start 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 Processor -- start 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.338+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b28dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b28e370 0x56359b28b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56359b291070 con 0x56359b284b40 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56359b1a4060 con 0x56359b28e370 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56359b2911f0 con 0x56359b2835d0 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 10 client.0 _ll_register_callbacks cb 0x56359aef78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56532/0 (socket says 172.21.15.52:56532) 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1634414440 learned_addr learned my addr 172.21.15.52:0/1634414440 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b28dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd1591640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b28e370 0x56359b28b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1634414440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 msgr2=0x56359b28dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b28dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b28e370 msgr2=0x56359b28b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b28e370 0x56359b28b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 -- 172.21.15.52:0/1634414440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359af5a3c0 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc011680 tx=0x7fbdbc0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a746fee9aef9e4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdabfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc029060 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbdbc011930 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.339+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdbc005500 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbdbc011b30 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 10 client.20241 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56359b29cb10 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdbc005500 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbdbc019430 con 0x56359b284b40 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 10 client.20241 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 10 client.20241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 20 client.20241 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:26.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b29df70 0x56359b2a0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 4 client.20241 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.340+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56359b1f6860 con 0x56359b29df70 2024-09-19T09:34:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.341+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b29df70 0x56359b2a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.341+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b29df70 0x56359b2a0360 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd90d2202766d2a8 server_cookie=73fb5517a3335e81 in_seq=0 out_seq=0 2024-09-19T09:34:26.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.341+0000 7fbdabfff640 10 client.20241 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdabfff640 1 -- 172.21.15.52:0/1634414440 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56359b1f6860 con 0x56359b29df70 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdabfff640 10 client.20241 handle_command_reply: tid=0 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 client.20241 shutdown 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 msgr2=0x56359b28b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc011680 tx=0x7fbdbc0058e0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 shutdown_connections 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b29df70 0x56359b2a0360 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b28e370 0x56359b28b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b284b40 0x56359b28b010 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/1634414440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b2835d0 0x56359b28dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdabfff640 0 client.20241 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 >> 172.21.15.52:0/1634414440 conn(0x56359b24c310 msgr2=0x56359b285960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 shutdown_connections 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 1 -- 172.21.15.52:0/1634414440 wait complete. 2024-09-19T09:34:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.342+0000 7fbdd53cd740 20 client.20241 trim_cache size 0 max 16384 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 Processor -- start 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 -- start start 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b28f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b28e370 0x56359b28fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1b0080 con 0x56359b2835d0 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1ad950 con 0x56359b284b40 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1ab7a0 con 0x56359b28e370 2024-09-19T09:34:26.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56536/0 (socket says 172.21.15.52:56536) 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 -- 172.21.15.52:0/2105310473 learned_addr learned my addr 172.21.15.52:0/2105310473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd1591640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b28e370 0x56359b28fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b28f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 -- 172.21.15.52:0/2105310473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b28e370 msgr2=0x56359b28fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b28e370 0x56359b28fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 -- 172.21.15.52:0/2105310473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 msgr2=0x56359b28f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b28f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 -- 172.21.15.52:0/2105310473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359b284400 con 0x56359b2835d0 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b28f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:26.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb40ed820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37ca7bc0be16bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdc27fc640 1 -- 172.21.15.52:0/2105310473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4049040 con 0x56359b2835d0 2024-09-19T09:34:26.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdc27fc640 1 -- 172.21.15.52:0/2105310473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb40c50e0 con 0x56359b2835d0 2024-09-19T09:34:26.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.356+0000 7fbdc27fc640 1 -- 172.21.15.52:0/2105310473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4003c80 con 0x56359b2835d0 2024-09-19T09:34:26.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- 172.21.15.52:0/2105310473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 msgr2=0x56359b29a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4000c00 tx=0x7fbdb40ed820 comp rx=0 tx=0).stop 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- 172.21.15.52:0/2105310473 shutdown_connections 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b28e370 0x56359b28fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b284b40 0x56359b28f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/2105310473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b2835d0 0x56359b29a310 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- 172.21.15.52:0/2105310473 >> 172.21.15.52:0/2105310473 conn(0x56359b24c310 msgr2=0x56359b2898e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- 172.21.15.52:0/2105310473 shutdown_connections 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- 172.21.15.52:0/2105310473 wait complete. 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.357+0000 7fbdd53cd740 1 -- start start 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 Processor -- start 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 0x56359b296990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b284b40 0x56359b2a5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1abe10 con 0x56359b28e370 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1ad280 con 0x56359b2835d0 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc1ac4e0 con 0x56359b284b40 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd53cd740 10 client.0 _ll_register_callbacks cb 0x7fbdbc009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56538/0 (socket says 172.21.15.52:56538) 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 -- 172.21.15.52:0/3684415320 learned_addr learned my addr 172.21.15.52:0/3684415320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 0x56359b296990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdcbfff640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b284b40 0x56359b2a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 -- 172.21.15.52:0/3684415320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b284b40 msgr2=0x56359b2a5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b284b40 0x56359b2a5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 -- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 msgr2=0x56359b296990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:26.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 0x56359b296990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd1591640 1 -- 172.21.15.52:0/3684415320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359b2901e0 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.358+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 0x56359b296990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd1591640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40090b0 tx=0x7fbdc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc89bf62fcc96e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400f040 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb40c50e0 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fbdc4024460 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbdc40059c0 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 10 client.20247 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56359b295070 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdb40c50e0 con 0x56359b28e370 2024-09-19T09:34:26.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbdc4015070 con 0x56359b28e370 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 10 client.20247 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 10 client.20247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 20 client.20247 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b308ce0 0x56359b30b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 4 client.20247 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.359+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56359b1f0d70 con 0x56359b308ce0 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b308ce0 0x56359b30b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd0d90640 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b308ce0 0x56359b30b100 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa96498537130b9d server_cookie=7f3b5ee428ba264e in_seq=0 out_seq=0 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdabfff640 10 client.20247 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdabfff640 1 -- 172.21.15.52:0/3684415320 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56359b1f0d70 con 0x56359b308ce0 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdabfff640 10 client.20247 handle_command_reply: tid=0 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 client.20247 shutdown 2024-09-19T09:34:26.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 msgr2=0x56359b2a55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40090b0 tx=0x7fbdc40046c0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 shutdown_connections 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56359b308ce0 0x56359b30b100 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56359b28e370 0x56359b2a55a0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56359b284b40 0x56359b2a5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.360+0000 7fbdd53cd740 1 --2- 172.21.15.52:0/3684415320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56359b2835d0 0x56359b296990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 >> 172.21.15.52:0/3684415320 conn(0x56359b24c310 msgr2=0x56359b27e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdabfff640 0 client.20247 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 shutdown_connections 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd53cd740 1 -- 172.21.15.52:0/3684415320 wait complete. 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd53cd740 20 client.20247 trim_cache size 0 max 16384 2024-09-19T09:34:26.368 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:34:26.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 msgr2=0x7fbdb80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 0x7fbdb80a5780 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc4006e10 comp rx=0 tx=0).stop 2024-09-19T09:34:26.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 msgr2=0x7fbdcc199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:26.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009230 tx=0x7fbdb4004270 comp rx=0 tx=0).stop 2024-09-19T09:34:26.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 shutdown_connections 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbdcc106a80 0x7fbdcc1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fbdb80a32c0 0x7fbdb80a5780 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbdcc101420 0x7fbdcc199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 --2- 172.21.15.52:0/3686606342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdcc100a80 0x7fbdcc199330 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.361+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 >> 172.21.15.52:0/3686606342 conn(0x7fbdcc0fc7a0 msgr2=0x7fbdcc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.362+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 shutdown_connections 2024-09-19T09:34:26.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:26.362+0000 7fbdd2ff4640 1 -- 172.21.15.52:0/3686606342 wait complete. 2024-09-19T09:34:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:27 smithi052 ceph-mon[30947]: pgmap v728: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-09-19T09:34:27.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:27 smithi169 ceph-mon[35454]: pgmap v728: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-09-19T09:34:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:27 smithi086 ceph-mon[34813]: pgmap v728: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 11 op/s 2024-09-19T09:34:28.122 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:34:28.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:34:28.392 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:28.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 -- 172.21.15.52:0/959195420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474101df0 msgr2=0x7f54741021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 --2- 172.21.15.52:0/959195420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474101df0 0x7f54741021d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f5468009900 tx=0x7f546802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 -- 172.21.15.52:0/959195420 shutdown_connections 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 --2- 172.21.15.52:0/959195420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5474106f20 0x7f547410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 --2- 172.21.15.52:0/959195420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54741027a0 0x7f54741067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 --2- 172.21.15.52:0/959195420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474101df0 0x7f54741021d0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 -- 172.21.15.52:0/959195420 >> 172.21.15.52:0/959195420 conn(0x7f54740fd8f0 msgr2=0x7f54740ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 -- 172.21.15.52:0/959195420 shutdown_connections 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.860+0000 7f547bb8d640 1 -- 172.21.15.52:0/959195420 wait complete. 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 Processor -- start 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 -- start start 2024-09-19T09:34:28.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5474101df0 0x7f547419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 0x7f547419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5474111fd0 con 0x7f5474106f20 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5474111e50 con 0x7f5474101df0 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547bb8d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5474112150 con 0x7f54741027a0 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547a12a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547a12a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58548/0 (socket says 172.21.15.52:58548) 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f547a12a640 1 -- 172.21.15.52:0/1190202083 learned_addr learned my addr 172.21.15.52:0/1190202083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.861+0000 7f5479929640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5474101df0 0x7f547419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f5479128640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 0x7f547419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 -- 172.21.15.52:0/1190202083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 msgr2=0x7f547419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 0x7f547419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 -- 172.21.15.52:0/1190202083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5474101df0 msgr2=0x7f547419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5474101df0 0x7f547419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 -- 172.21.15.52:0/1190202083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547419f560 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f5479128640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 0x7f547419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547a12a640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f546c00cce0 tx=0x7f546c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f5466ffd640 1 -- 172.21.15.52:0/1190202083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c00f450 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f5466ffd640 1 -- 172.21.15.52:0/1190202083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c00fad0 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547419f850 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f5466ffd640 1 -- 172.21.15.52:0/1190202083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c018c10 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.862+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a7130 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.864+0000 7f5466ffd640 1 -- 172.21.15.52:0/1190202083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f546c00f5f0 con 0x7f5474106f20 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.864+0000 7f547df66740 1 Processor -- start 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 -- start start 2024-09-19T09:34:28.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f032130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56085ef8a280 con 0x56085f024b60 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56085ef31b10 con 0x56085f02fd40 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547df66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56085ef86240 con 0x56085f025480 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58564/0 (socket says 172.21.15.52:58564) 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 -- 172.21.15.52:0/198106012 learned_addr learned my addr 172.21.15.52:0/198106012 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5466ffd640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 0x7f54600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f032130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479929640 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 -- 172.21.15.52:0/198106012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 msgr2=0x56085f02f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 -- 172.21.15.52:0/198106012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 msgr2=0x56085f032130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f032130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f5479128640 1 -- 172.21.15.52:0/198106012 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56085ef3e1f0 con 0x56085f024b60 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.865+0000 7f547a12a640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 0x7f54600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.866+0000 7f5466ffd640 1 -- 172.21.15.52:0/1190202083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f546c0cff60 con 0x7f5474106f20 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.866+0000 7f5479128640 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5470014540 tx=0x7f547000b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5446b5378b2d2596 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.866+0000 7f545ffff640 1 -- 172.21.15.52:0/198106012 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470012710 con 0x56085f024b60 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.866+0000 7f545ffff640 1 -- 172.21.15.52:0/198106012 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547001a070 con 0x56085f024b60 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.866+0000 7f545ffff640 1 -- 172.21.15.52:0/198106012 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547000eb70 con 0x56085f024b60 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- 172.21.15.52:0/198106012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 msgr2=0x56085f024f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547a12a640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 0x7f54600a5780 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f546c098960 tx=0x7f546c0186b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5470014540 tx=0x7f547000b530 comp rx=0 tx=0).stop 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- 172.21.15.52:0/198106012 shutdown_connections 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f032130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 --2- 172.21.15.52:0/198106012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f024b60 0x56085f024f40 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- 172.21.15.52:0/198106012 >> 172.21.15.52:0/198106012 conn(0x56085f0210f0 msgr2=0x56085f0214d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- 172.21.15.52:0/198106012 shutdown_connections 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- 172.21.15.52:0/198106012 wait complete. 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 -- start start 2024-09-19T09:34:28.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.867+0000 7f547df66740 1 Processor -- start 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f024b60 0x56085f02cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56085f032910 con 0x56085f02fd40 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56085ef44f10 con 0x56085f024b60 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56085f032a90 con 0x56085f025480 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f547df66740 10 client.0 _ll_register_callbacks cb 0x56085ef0da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58574/0 (socket says 172.21.15.52:58574) 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 -- 172.21.15.52:0/2725673707 learned_addr learned my addr 172.21.15.52:0/2725673707 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:28.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479929640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f024b60 0x56085f02cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 -- 172.21.15.52:0/2725673707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 msgr2=0x56085f02d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 -- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f024b60 msgr2=0x56085f02cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f024b60 0x56085f02cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 -- 172.21.15.52:0/2725673707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56085ecfb6a0 con 0x56085f02fd40 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f5479128640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f547000b7a0 tx=0x7f547000e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963522301bdcd77e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.868+0000 7f545d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470026020 con 0x56085f02fd40 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5470012c00 con 0x56085f02fd40 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f547001a070 con 0x56085f02fd40 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5470031050 con 0x56085f02fd40 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 10 client.20259 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56085f03e520 con 0x56085f02fd40 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547001a070 con 0x56085f02fd40 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5470011b20 con 0x56085f02fd40 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 10 client.20259 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 10 client.20259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 20 client.20259 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f03f870 0x56085f041c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 4 client.20259 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.869+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56085ef977f0 con 0x56085f03f870 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.870+0000 7f5479929640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f03f870 0x56085f041c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.870+0000 7f5479929640 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f03f870 0x56085f041c60 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=365fcdd43e05f800 server_cookie=545abfab52518733 in_seq=0 out_seq=0 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.870+0000 7f545d7fa640 10 client.20259 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f545d7fa640 1 -- 172.21.15.52:0/2725673707 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56085ef977f0 con 0x56085f03f870 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f545d7fa640 10 client.20259 handle_command_reply: tid=0 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 client.20259 shutdown 2024-09-19T09:34:28.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 msgr2=0x56085f02d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f547000b7a0 tx=0x7f547000e750 comp rx=0 tx=0).stop 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 shutdown_connections 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f03f870 0x56085f041c60 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f02d6b0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f025480 0x56085f02d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 --2- 172.21.15.52:0/2725673707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f024b60 0x56085f02cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f545d7fa640 0 client.20259 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 >> 172.21.15.52:0/2725673707 conn(0x56085f0210f0 msgr2=0x56085f020270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 shutdown_connections 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 1 -- 172.21.15.52:0/2725673707 wait complete. 2024-09-19T09:34:28.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.871+0000 7f547df66740 20 client.20259 trim_cache size 0 max 16384 2024-09-19T09:34:28.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 Processor -- start 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 -- start start 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 0x56085f02ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54741b2230 con 0x56085f02fd40 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54741afb00 con 0x56085f025480 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f547df66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54741ad950 con 0x56085f024b60 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f5479128640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58586/0 (socket says 172.21.15.52:58586) 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f5479128640 1 -- 172.21.15.52:0/2667573618 learned_addr learned my addr 172.21.15.52:0/2667573618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.889+0000 7f5479128640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479929640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 0x56085f02ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 -- 172.21.15.52:0/2667573618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 msgr2=0x56085f0275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 -- 172.21.15.52:0/2667573618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 msgr2=0x56085f02ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 0x56085f02ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 -- 172.21.15.52:0/2667573618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56085f032470 con 0x56085f02fd40 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479929640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 0x56085f02ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f5479128640 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f54700127c0 tx=0x7f5470005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bb3df116d2e7be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f545f7fe640 1 -- 172.21.15.52:0/2667573618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470026040 con 0x56085f02fd40 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f545f7fe640 1 -- 172.21.15.52:0/2667573618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547001a070 con 0x56085f02fd40 2024-09-19T09:34:28.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.890+0000 7f545f7fe640 1 -- 172.21.15.52:0/2667573618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547001f800 con 0x56085f02fd40 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- 172.21.15.52:0/2667573618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 msgr2=0x56085f044c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f54700127c0 tx=0x7f5470005fc0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- 172.21.15.52:0/2667573618 shutdown_connections 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f02fd40 0x56085f044c80 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f025480 0x56085f02ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 --2- 172.21.15.52:0/2667573618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- 172.21.15.52:0/2667573618 >> 172.21.15.52:0/2667573618 conn(0x56085f0210f0 msgr2=0x56085f02e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- 172.21.15.52:0/2667573618 shutdown_connections 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- 172.21.15.52:0/2667573618 wait complete. 2024-09-19T09:34:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 -- start start 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.891+0000 7f547df66740 1 Processor -- start 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f042b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54741adfc0 con 0x56085f025480 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54741af430 con 0x56085f02fd40 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54741ae690 con 0x56085f024b60 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f547df66740 10 client.0 _ll_register_callbacks cb 0x7f547000bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58598/0 (socket says 172.21.15.52:58598) 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 -- 172.21.15.52:0/1709830667 learned_addr learned my addr 172.21.15.52:0/1709830667 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479128640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479128640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f042b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 -- 172.21.15.52:0/1709830667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 msgr2=0x56085f0452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 -- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 msgr2=0x56085f042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f042b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479929640 1 -- 172.21.15.52:0/1709830667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56085f043230 con 0x56085f025480 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.892+0000 7f5479128640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f042b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f5479929640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f54680096c0 tx=0x7f546802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49097c3df752f570 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468049030 con 0x56085f025480 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5468031880 con 0x56085f025480 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f547001a070 con 0x56085f025480 2024-09-19T09:34:28.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5468055050 con 0x56085f025480 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 10 client.20265 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56085f0aa0e0 con 0x56085f025480 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f547001a070 con 0x56085f025480 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5468004830 con 0x56085f025480 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 10 client.20265 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 10 client.20265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 20 client.20265 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f0aa890 0x56085f0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 4 client.20265 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.893+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56085ef91d00 con 0x56085f0aa890 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.894+0000 7f5479128640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f0aa890 0x56085f0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:28.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.894+0000 7f5479128640 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f0aa890 0x56085f0accb0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1afb436463ffb8 server_cookie=4e78a7786c94696c in_seq=0 out_seq=0 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.894+0000 7f545d7fa640 10 client.20265 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f545d7fa640 1 -- 172.21.15.52:0/1709830667 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56085ef91d00 con 0x56085f0aa890 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f545d7fa640 10 client.20265 handle_command_reply: tid=0 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 client.20265 shutdown 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 msgr2=0x56085f042600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f54680096c0 tx=0x7f546802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 shutdown_connections 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56085f0aa890 0x56085f0accb0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56085f02fd40 0x56085f042b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56085f025480 0x56085f042600 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f545d7fa640 0 client.20265 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:28.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 --2- 172.21.15.52:0/1709830667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56085f024b60 0x56085f0452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 >> 172.21.15.52:0/1709830667 conn(0x56085f0210f0 msgr2=0x56085f02d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 shutdown_connections 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.895+0000 7f547df66740 1 -- 172.21.15.52:0/1709830667 wait complete. 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547df66740 20 client.20265 trim_cache size 0 max 16384 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "2608a6ff-4bfb-4539-b519-6da25d0460d4", 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:34:28.905 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 msgr2=0x7f54600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 0x7f54600a5780 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f546c098960 tx=0x7f546c0186b0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 msgr2=0x7f547419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f546c00cce0 tx=0x7f546c00a620 comp rx=0 tx=0).stop 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 shutdown_connections 2024-09-19T09:34:28.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5474106f20 0x7f547419ee80 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54600a32c0 0x7f54600a5780 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54741027a0 0x7f547419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 --2- 172.21.15.52:0/1190202083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5474101df0 0x7f547419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 >> 172.21.15.52:0/1190202083 conn(0x7f54740fd8f0 msgr2=0x7f54740feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 shutdown_connections 2024-09-19T09:34:28.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:28.896+0000 7f547bb8d640 1 -- 172.21.15.52:0/1190202083 wait complete. 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 -- 172.21.15.52:0/3323496848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 msgr2=0x7f6528100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 --2- 172.21.15.52:0/3323496848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528100e50 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f6510009900 tx=0x7f651002a410 comp rx=0 tx=0).stop 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 -- 172.21.15.52:0/3323496848 shutdown_connections 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 --2- 172.21.15.52:0/3323496848 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528102600 0x7f6528108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 --2- 172.21.15.52:0/3323496848 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528101c40 0x7f65281020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 --2- 172.21.15.52:0/3323496848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528100e50 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 -- 172.21.15.52:0/3323496848 >> 172.21.15.52:0/3323496848 conn(0x7f65280fc1b0 msgr2=0x7f65280fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 -- 172.21.15.52:0/3323496848 shutdown_connections 2024-09-19T09:34:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.244+0000 7f652edc4640 1 -- 172.21.15.52:0/3323496848 wait complete. 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 Processor -- start 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 -- start start 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 0x7f6528198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528102600 0x7f652819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f652810d820 con 0x7f6528100a50 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f652810d6a0 con 0x7f6528101c40 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652edc4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f652810d9a0 con 0x7f6528102600 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58614/0 (socket says 172.21.15.52:58614) 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 -- 172.21.15.52:0/2999116552 learned_addr learned my addr 172.21.15.52:0/2999116552 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652d361640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528102600 0x7f652819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 -- 172.21.15.52:0/2999116552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528102600 msgr2=0x7f652819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f6527fff640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 0x7f6528198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528102600 0x7f652819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 -- 172.21.15.52:0/2999116552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 msgr2=0x7f6528198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 0x7f6528198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f652cb60640 1 -- 172.21.15.52:0/2999116552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652819f9f0 con 0x7f6528100a50 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.245+0000 7f6527fff640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 0x7f6528198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f652cb60640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f6510031610 tx=0x7f6510004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f6525ffb640 1 -- 172.21.15.52:0/2999116552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651003f030 con 0x7f6528100a50 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652819fc80 con 0x7f6528100a50 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f6525ffb640 1 -- 172.21.15.52:0/2999116552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6510003ad0 con 0x7f6528100a50 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f6525ffb640 1 -- 172.21.15.52:0/2999116552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510035070 con 0x7f6528100a50 2024-09-19T09:34:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.246+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65281a0170 con 0x7f6528100a50 2024-09-19T09:34:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.248+0000 7f6525ffb640 1 -- 172.21.15.52:0/2999116552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6510042030 con 0x7f6528100a50 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.248+0000 7f6531c40740 1 Processor -- start 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 -- start start 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853a9a0 0x562ca853ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 0x562ca853fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ca849e2f0 con 0x562ca8540370 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ca8446270 con 0x562ca853b2e0 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6531c40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ca849a2b0 con 0x562ca853a9a0 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58616/0 (socket says 172.21.15.52:58616) 2024-09-19T09:34:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 -- 172.21.15.52:0/1405865453 learned_addr learned my addr 172.21.15.52:0/1405865453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f652d361640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853a9a0 0x562ca853ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6525ffb640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 0x7f65140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f652cb60640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 0x562ca853fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 -- 172.21.15.52:0/1405865453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853a9a0 msgr2=0x562ca853ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853a9a0 0x562ca853ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f652d361640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 0x7f65140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 -- 172.21.15.52:0/1405865453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 msgr2=0x562ca853fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 0x562ca853fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 -- 172.21.15.52:0/1405865453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca8445340 con 0x562ca8540370 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f652cb60640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 0x562ca853fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6525ffb640 1 -- 172.21.15.52:0/2999116552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f65100f00e0 con 0x7f6528100a50 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.249+0000 7f6527fff640 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f651800f360 tx=0x7f651800f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22182a19b887de24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f651effd640 1 -- 172.21.15.52:0/1405865453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518011700 con 0x562ca8540370 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f652d361640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 0x7f65140a57b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65200041e0 tx=0x7f6520004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f651effd640 1 -- 172.21.15.52:0/1405865453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6518011d80 con 0x562ca8540370 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f651effd640 1 -- 172.21.15.52:0/1405865453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65180103d0 con 0x562ca8540370 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 -- 172.21.15.52:0/1405865453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 msgr2=0x562ca8542830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f651800f360 tx=0x7f651800f820 comp rx=0 tx=0).stop 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 -- 172.21.15.52:0/1405865453 shutdown_connections 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca8542830 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853b2e0 0x562ca853fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 --2- 172.21.15.52:0/1405865453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853a9a0 0x562ca853ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 -- 172.21.15.52:0/1405865453 >> 172.21.15.52:0/1405865453 conn(0x562ca8536010 msgr2=0x562ca8536410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 -- 172.21.15.52:0/1405865453 shutdown_connections 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.250+0000 7f6531c40740 1 -- 172.21.15.52:0/1405865453 wait complete. 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 -- start start 2024-09-19T09:34:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 Processor -- start 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca8550520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ca8543340 con 0x562ca853a9a0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ca8427290 con 0x562ca8540370 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ca85434c0 con 0x562ca853b2e0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6531c40740 10 client.0 _ll_register_callbacks cb 0x562ca8458140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58618/0 (socket says 172.21.15.52:58618) 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f652cb60640 1 -- 172.21.15.52:0/2382153162 learned_addr learned my addr 172.21.15.52:0/2382153162 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.251+0000 7f6527fff640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652d361640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca8550520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 -- 172.21.15.52:0/2382153162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 msgr2=0x562ca85494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 -- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 msgr2=0x562ca8550520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca8550520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 -- 172.21.15.52:0/2382153162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca81b1210 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f652cb60640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f65100edb00 tx=0x7f65100bc220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b303f194c56aec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510049070 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f651003b460 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6518011d80 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f651003be40 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6531c40740 10 client.20277 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ca827d620 con 0x562ca853a9a0 2024-09-19T09:34:29.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6518011d80 con 0x562ca853a9a0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f65100035f0 con 0x562ca853a9a0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6531c40740 10 client.20277 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.252+0000 7f6531c40740 10 client.20277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6531c40740 20 client.20277 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca8554bb0 0x562ca8557030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6531c40740 4 client.20277 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ca84aba20 con 0x562ca8554bb0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6527fff640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca8554bb0 0x562ca8557030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6507fff640 10 client.20277 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.253+0000 7f6527fff640 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca8554bb0 0x562ca8557030 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d192513a746360 server_cookie=f8a8dce1c9db5087 in_seq=0 out_seq=0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6507fff640 1 -- 172.21.15.52:0/2382153162 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ca84aba20 con 0x562ca8554bb0 2024-09-19T09:34:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6507fff640 10 client.20277 handle_command_reply: tid=0 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 client.20277 shutdown 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 msgr2=0x562ca8548fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f65100edb00 tx=0x7f65100bc220 comp rx=0 tx=0).stop 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 shutdown_connections 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca8554bb0 0x562ca8557030 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca8550520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 --2- 172.21.15.52:0/2382153162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca8548fa0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6507fff640 0 client.20277 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 >> 172.21.15.52:0/2382153162 conn(0x562ca8536010 msgr2=0x562ca8537820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 shutdown_connections 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 1 -- 172.21.15.52:0/2382153162 wait complete. 2024-09-19T09:34:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.254+0000 7f6531c40740 20 client.20277 trim_cache size 0 max 16384 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 Processor -- start 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 -- start start 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca855b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a97f0 con 0x562ca853a9a0 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a70c0 con 0x562ca8540370 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6531c40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a4f10 con 0x562ca853b2e0 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58620/0 (socket says 172.21.15.52:58620) 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 -- 172.21.15.52:0/433125827 learned_addr learned my addr 172.21.15.52:0/433125827 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652d361640 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca855b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f6527fff640 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 -- 172.21.15.52:0/433125827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 msgr2=0x562ca85504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 -- 172.21.15.52:0/433125827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 msgr2=0x562ca855b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca855b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 -- 172.21.15.52:0/433125827 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca8543580 con 0x562ca853a9a0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.269+0000 7f652cb60640 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f65100b8a80 tx=0x7f65100bc290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a59519e92cd11a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f651e7fc640 1 -- 172.21.15.52:0/433125827 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510049070 con 0x562ca853a9a0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f651e7fc640 1 -- 172.21.15.52:0/433125827 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65100bcd20 con 0x562ca853a9a0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f651e7fc640 1 -- 172.21.15.52:0/433125827 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65100035f0 con 0x562ca853a9a0 2024-09-19T09:34:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- 172.21.15.52:0/433125827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 msgr2=0x562ca85350b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f65100b8a80 tx=0x7f65100bc290 comp rx=0 tx=0).stop 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- 172.21.15.52:0/433125827 shutdown_connections 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca8540370 0x562ca855b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca85504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 --2- 172.21.15.52:0/433125827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca853a9a0 0x562ca85350b0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- 172.21.15.52:0/433125827 >> 172.21.15.52:0/433125827 conn(0x562ca8536010 msgr2=0x562ca85349a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- 172.21.15.52:0/433125827 shutdown_connections 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- 172.21.15.52:0/433125827 wait complete. 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.270+0000 7f6531c40740 1 -- start start 2024-09-19T09:34:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 Processor -- start 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 0x562ca854e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca854e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a5580 con 0x562ca8540370 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a69f0 con 0x562ca853a9a0 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65281a5c50 con 0x562ca853b2e0 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6531c40740 10 client.0 _ll_register_callbacks cb 0x7f6510031ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58632/0 (socket says 172.21.15.52:58632) 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 -- 172.21.15.52:0/3280696361 learned_addr learned my addr 172.21.15.52:0/3280696361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652cb60640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 0x562ca854e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f6527fff640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca854e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 -- 172.21.15.52:0/3280696361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 msgr2=0x562ca854e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca854e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 -- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 msgr2=0x562ca854e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 0x562ca854e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652d361640 1 -- 172.21.15.52:0/3280696361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca854fc80 con 0x562ca8540370 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.271+0000 7f652cb60640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 0x562ca854e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f652d361640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6520003ed0 tx=0x7f65200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9617ed8221769314 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520005220 con 0x562ca8540370 2024-09-19T09:34:29.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f65200053c0 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65100bcd20 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6520031020 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 10 client.20283 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ca85bff80 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65100bcd20 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f65200137b0 con 0x562ca8540370 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 10 client.20283 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 10 client.20283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 20 client.20283 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca85c0910 0x562ca85c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 4 client.20283 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.272+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ca84a5d70 con 0x562ca85c0910 2024-09-19T09:34:29.279 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.273+0000 7f652cb60640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca85c0910 0x562ca85c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.273+0000 7f6507fff640 10 client.20283 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:29.280 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.273+0000 7f652cb60640 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca85c0910 0x562ca85c2d30 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f600ec59954ad9b server_cookie=b0eec11951d6a08d in_seq=0 out_seq=0 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6507fff640 1 -- 172.21.15.52:0/3280696361 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ca84a5d70 con 0x562ca85c0910 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6507fff640 10 client.20283 handle_command_reply: tid=0 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 client.20283 shutdown 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 msgr2=0x562ca854f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6520003ed0 tx=0x7f65200046c0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 shutdown_connections 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ca85c0910 0x562ca85c2d30 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ca8540370 0x562ca854f670 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6507fff640 0 client.20283 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ca853b2e0 0x562ca854e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 --2- 172.21.15.52:0/3280696361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ca853a9a0 0x562ca854e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 >> 172.21.15.52:0/3280696361 conn(0x562ca8536010 msgr2=0x562ca85351c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 shutdown_connections 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 1 -- 172.21.15.52:0/3280696361 wait complete. 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.284+0000 7f6531c40740 20 client.20283 trim_cache size 0 max 16384 2024-09-19T09:34:29.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:34:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:34:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:34:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:34:29.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 msgr2=0x7f65140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 0x7f65140a57b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65200041e0 tx=0x7f6520004730 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 msgr2=0x7f6528197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f6510031610 tx=0x7f6510004270 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 shutdown_connections 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f65140a32f0 0x7f65140a57b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6528102600 0x7f652819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6528101c40 0x7f6528198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 --2- 172.21.15.52:0/2999116552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6528100a50 0x7f6528197dd0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 >> 172.21.15.52:0/2999116552 conn(0x7f65280fc1b0 msgr2=0x7f6528104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 shutdown_connections 2024-09-19T09:34:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:29.285+0000 7f652edc4640 1 -- 172.21.15.52:0/2999116552 wait complete. 2024-09-19T09:34:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:29 smithi052 ceph-mon[30947]: pgmap v729: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 13 op/s 2024-09-19T09:34:29.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:29 smithi169 ceph-mon[35454]: pgmap v729: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 13 op/s 2024-09-19T09:34:29.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:34:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:29 smithi086 ceph-mon[34813]: pgmap v729: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 13 op/s 2024-09-19T09:34:29.764 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:30.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:30 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:34:30.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:30 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:30 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:34:30.133 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:30 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- 172.21.15.52:0/269357953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 msgr2=0x7fba6410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 --2- 172.21.15.52:0/269357953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6410ea90 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009900 tx=0x7fba5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- 172.21.15.52:0/269357953 shutdown_connections 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 --2- 172.21.15.52:0/269357953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6410ea90 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 --2- 172.21.15.52:0/269357953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 0x7fba641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 --2- 172.21.15.52:0/269357953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 0x7fba641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- 172.21.15.52:0/269357953 >> 172.21.15.52:0/269357953 conn(0x7fba640fd8c0 msgr2=0x7fba640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- 172.21.15.52:0/269357953 shutdown_connections 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- 172.21.15.52:0/269357953 wait complete. 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 Processor -- start 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.215+0000 7fba6a00e640 1 -- start start 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 0x7fba64198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 0x7fba64198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba64111f70 con 0x7fba64106f10 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba64111df0 con 0x7fba64101de0 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba6a00e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba641120f0 con 0x7fba64102790 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58660/0 (socket says 172.21.15.52:58660) 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 -- 172.21.15.52:0/2757122285 learned_addr learned my addr 172.21.15.52:0/2757122285 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba637fe640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 0x7fba64198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba62ffd640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 0x7fba64198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 -- 172.21.15.52:0/2757122285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 msgr2=0x7fba64198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 0x7fba64198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 -- 172.21.15.52:0/2757122285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 msgr2=0x7fba64198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 0x7fba64198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 -- 172.21.15.52:0/2757122285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6419d2f0 con 0x7fba64106f10 2024-09-19T09:34:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.216+0000 7fba63fff640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009230 tx=0x7fba5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.217+0000 7fba60ff9640 1 -- 172.21.15.52:0/2757122285 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c03f030 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.217+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6419d580 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.217+0000 7fba60ff9640 1 -- 172.21.15.52:0/2757122285 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba5c003ce0 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.217+0000 7fba60ff9640 1 -- 172.21.15.52:0/2757122285 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c035070 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.217+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641a4ec0 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.219+0000 7fba60ff9640 1 -- 172.21.15.52:0/2757122285 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fba5c042030 con 0x7fba64106f10 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.219+0000 7fba6c3e7740 1 Processor -- start 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.219+0000 7fba6c3e7740 1 -- start start 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb799140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb799680 0x559aeb79ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559aeb6f42e0 con 0x559aeb78e4a0 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559aeb69bce0 con 0x559aeb799680 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aeb6f02a0 con 0x559aeb78edc0 2024-09-19T09:34:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58662/0 (socket says 172.21.15.52:58662) 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 -- 172.21.15.52:0/436346883 learned_addr learned my addr 172.21.15.52:0/436346883 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba60ff9640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 0x7fba4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba637fe640 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb799140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb799680 0x559aeb79ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba60ff9640 1 -- 172.21.15.52:0/2757122285 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba5c0efe80 con 0x7fba64106f10 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 -- 172.21.15.52:0/436346883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 msgr2=0x559aeb799140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb799140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 -- 172.21.15.52:0/436346883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb799680 msgr2=0x559aeb79ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba63fff640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 0x7fba4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb799680 0x559aeb79ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 -- 172.21.15.52:0/436346883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aeb680440 con 0x559aeb78e4a0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba62ffd640 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fba58007f60 tx=0x7fba58007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5cf44f61e5185e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba49ffb640 1 -- 172.21.15.52:0/436346883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58018030 con 0x559aeb78e4a0 2024-09-19T09:34:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba49ffb640 1 -- 172.21.15.52:0/436346883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba58010d50 con 0x559aeb78e4a0 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.220+0000 7fba49ffb640 1 -- 172.21.15.52:0/436346883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5801cd50 con 0x559aeb78e4a0 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- 172.21.15.52:0/436346883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 msgr2=0x559aeb78e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fba58007f60 tx=0x7fba58007830 comp rx=0 tx=0).stop 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba63fff640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 0x7fba4c0a5700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fba5c005ab0 tx=0x7fba5c0314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- 172.21.15.52:0/436346883 shutdown_connections 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb799680 0x559aeb79ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb799140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/436346883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78e4a0 0x559aeb78e880 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- 172.21.15.52:0/436346883 >> 172.21.15.52:0/436346883 conn(0x559aeb78aa30 msgr2=0x559aeb78ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- 172.21.15.52:0/436346883 shutdown_connections 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- 172.21.15.52:0/436346883 wait complete. 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.221+0000 7fba6c3e7740 1 -- start start 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 Processor -- start 2024-09-19T09:34:30.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78e4a0 0x559aeb799040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 0x559aeb7962f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x559aeb79c250 con 0x559aeb799680 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x559aeb6af050 con 0x559aeb78edc0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559aeb79c3d0 con 0x559aeb78e4a0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba6c3e7740 10 client.0 _ll_register_callbacks cb 0x559aeb6ef160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58672/0 (socket says 172.21.15.52:58672) 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba62ffd640 1 -- 172.21.15.52:0/2781301173 learned_addr learned my addr 172.21.15.52:0/2781301173 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba62ffd640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78e4a0 0x559aeb799040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.222+0000 7fba637fe640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 0x559aeb7962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 -- 172.21.15.52:0/2781301173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78e4a0 msgr2=0x559aeb799040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78e4a0 0x559aeb799040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 -- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 msgr2=0x559aeb7962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 0x559aeb7962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 -- 172.21.15.52:0/2781301173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aeb4653c0 con 0x559aeb799680 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba637fe640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 0x559aeb7962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba62ffd640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fba5801ca30 tx=0x7fba5801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72896d18ee8f11f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58018040 con 0x559aeb799680 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba58010900 con 0x559aeb799680 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba58010d50 con 0x559aeb799680 2024-09-19T09:34:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fba58010b00 con 0x559aeb799680 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 10 client.20295 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559aeb7a7c70 con 0x559aeb799680 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba58010d50 con 0x559aeb799680 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fba5802a020 con 0x559aeb799680 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 10 client.20295 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 10 client.20295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.223+0000 7fba6c3e7740 20 client.20295 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb7a9020 0x559aeb7ab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba6c3e7740 4 client.20295 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aeb701850 con 0x559aeb7a9020 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba637fe640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb7a9020 0x559aeb7ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba42ffd640 10 client.20295 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.224+0000 7fba637fe640 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb7a9020 0x559aeb7ab410 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91d26cdb548a2b12 server_cookie=5e8f91cecd22119 in_seq=0 out_seq=0 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba42ffd640 1 -- 172.21.15.52:0/2781301173 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559aeb701850 con 0x559aeb7a9020 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba42ffd640 10 client.20295 handle_command_reply: tid=0 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 client.20295 shutdown 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 msgr2=0x559aeb7968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fba5801ca30 tx=0x7fba5801c930 comp rx=0 tx=0).stop 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 shutdown_connections 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb7a9020 0x559aeb7ab410 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb7968e0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78edc0 0x559aeb7962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/2781301173 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78e4a0 0x559aeb799040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba42ffd640 0 client.20295 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 >> 172.21.15.52:0/2781301173 conn(0x559aeb78aa30 msgr2=0x559aeb790760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 shutdown_connections 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 1 -- 172.21.15.52:0/2781301173 wait complete. 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.225+0000 7fba6c3e7740 20 client.20295 trim_cache size 0 max 16384 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.242+0000 7fba6c3e7740 1 Processor -- start 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.242+0000 7fba6c3e7740 1 -- start start 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb7b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb7b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba641affa0 con 0x559aeb799680 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba641ad870 con 0x559aeb78e4a0 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba641ab6c0 con 0x559aeb78edc0 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58688/0 (socket says 172.21.15.52:58688) 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 -- 172.21.15.52:0/1314279357 learned_addr learned my addr 172.21.15.52:0/1314279357 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba637fe640 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb7b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 -- 172.21.15.52:0/1314279357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 msgr2=0x559aeb7b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb7b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 -- 172.21.15.52:0/1314279357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 msgr2=0x559aeb7b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb7b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 -- 172.21.15.52:0/1314279357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aeb791f00 con 0x559aeb799680 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba637fe640 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb7b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fba58004450 tx=0x7fba58005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bffda8d24cd0ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba497fa640 1 -- 172.21.15.52:0/1314279357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58018030 con 0x559aeb799680 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba497fa640 1 -- 172.21.15.52:0/1314279357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba58005b30 con 0x559aeb799680 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.243+0000 7fba497fa640 1 -- 172.21.15.52:0/1314279357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5801ccc0 con 0x559aeb799680 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1314279357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 msgr2=0x559aeb793590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fba58004450 tx=0x7fba58005e90 comp rx=0 tx=0).stop 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1314279357 shutdown_connections 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb799680 0x559aeb793590 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb78edc0 0x559aeb7b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1314279357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb7b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1314279357 >> 172.21.15.52:0/1314279357 conn(0x559aeb78aa30 msgr2=0x559aeb798370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1314279357 shutdown_connections 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1314279357 wait complete. 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.244+0000 7fba6c3e7740 1 -- start start 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 Processor -- start 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb79fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 0x559aeb810f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba641abd30 con 0x559aeb78edc0 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba641ad1a0 con 0x559aeb78e4a0 2024-09-19T09:34:30.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fba641ac400 con 0x559aeb799680 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba6c3e7740 10 client.0 _ll_register_callbacks cb 0x7fba5400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58694/0 (socket says 172.21.15.52:58694) 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 -- 172.21.15.52:0/1050238595 learned_addr learned my addr 172.21.15.52:0/1050238595 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb79fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 0x559aeb810f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 -- 172.21.15.52:0/1050238595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 msgr2=0x559aeb810f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 0x559aeb810f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 -- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 msgr2=0x559aeb79fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb79fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 -- 172.21.15.52:0/1050238595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aeb811550 con 0x559aeb78edc0 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 0x559aeb810f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:30.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba637fe640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x559aeb795b80 tx=0x7fba5401fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85152b3d4d410aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.245+0000 7fba42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5401fcd0 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fba54010b70 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559aeb6fbd60 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fba54010d70 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 10 client.20301 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559aeb818970 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559aeb6fbd60 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fba54004830 con 0x559aeb78edc0 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 10 client.20301 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 10 client.20301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:30.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 20 client.20301 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb819170 0x559aeb81b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 4 client.20301 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.246+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559aeb678210 con 0x559aeb819170 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb819170 0x559aeb81b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba62ffd640 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb819170 0x559aeb81b590 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e80b2ca0cd608b server_cookie=f268b1dfa54c93e4 in_seq=0 out_seq=0 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba42ffd640 10 client.20301 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba42ffd640 1 -- 172.21.15.52:0/1050238595 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559aeb678210 con 0x559aeb819170 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba42ffd640 10 client.20301 handle_command_reply: tid=0 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 client.20301 shutdown 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 msgr2=0x559aeb7a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x559aeb795b80 tx=0x7fba5401fae0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 shutdown_connections 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x559aeb819170 0x559aeb81b590 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559aeb799680 0x559aeb810f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x559aeb78edc0 0x559aeb7a0130 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba42ffd640 0 client.20301 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 --2- 172.21.15.52:0/1050238595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x559aeb78e4a0 0x559aeb79fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 >> 172.21.15.52:0/1050238595 conn(0x559aeb78aa30 msgr2=0x559aeb789350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.247+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 shutdown_connections 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6c3e7740 1 -- 172.21.15.52:0/1050238595 wait complete. 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6c3e7740 20 client.20301 trim_cache size 0 max 16384 2024-09-19T09:34:30.275 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "2608a6ff-4bfb-4539-b519-6da25d0460d4": { 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "2608a6ff-4bfb-4539-b519-6da25d0460d4", 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 msgr2=0x7fba4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 0x7fba4c0a5700 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fba5c005ab0 tx=0x7fba5c0314b0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 msgr2=0x7fba6419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009230 tx=0x7fba5c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 shutdown_connections 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba64106f10 0x7fba6419cc10 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fba4c0a3240 0x7fba4c0a5700 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fba64102790 0x7fba64198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 --2- 172.21.15.52:0/2757122285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba64101de0 0x7fba64198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 >> 172.21.15.52:0/2757122285 conn(0x7fba640fd8c0 msgr2=0x7fba640febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 shutdown_connections 2024-09-19T09:34:30.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:30.248+0000 7fba6a00e640 1 -- 172.21.15.52:0/2757122285 wait complete. 2024-09-19T09:34:30.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:30 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:34:30.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:30 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:30 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:34:30.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:30 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:30 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:34:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:30 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:30 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:34:30.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:30 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:34:30.857 INFO:tasks.cephfs.filesystem:scrub status for tag:2608a6ff-4bfb-4539-b519-6da25d0460d4 - {'path': '/', 'tag': '2608a6ff-4bfb-4539-b519-6da25d0460d4', 'options': 'recursive,force'} 2024-09-19T09:34:31.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:31 smithi052 ceph-mon[30947]: pgmap v730: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T09:34:31.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:31 smithi169 ceph-mon[35454]: pgmap v730: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T09:34:31.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:31 smithi086 ceph-mon[34813]: pgmap v730: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T09:34:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:33 smithi052 ceph-mon[30947]: pgmap v731: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-19T09:34:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:33 smithi169 ceph-mon[35454]: pgmap v731: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-19T09:34:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:33 smithi086 ceph-mon[34813]: pgmap v731: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 11 op/s 2024-09-19T09:34:34.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:34 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:34:34.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:34 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:34:34.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:34 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:34:35.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:35 smithi052 ceph-mon[30947]: pgmap v732: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:34:35.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:35 smithi169 ceph-mon[35454]: pgmap v732: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:34:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:35 smithi086 ceph-mon[34813]: pgmap v732: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-19T09:34:36.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:34:36.786 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:37.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:37 smithi052 ceph-mon[30947]: pgmap v733: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2185281420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 msgr2=0x7f7ccc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2185281420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc106e60 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8009930 tx=0x7f7cc802a420 comp rx=0 tx=0).stop 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2185281420 shutdown_connections 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2185281420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 0x7f7ccc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2185281420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 0x7f7ccc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2185281420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc106e60 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2185281420 >> 172.21.15.52:0/2185281420 conn(0x7f7ccc0fc7a0 msgr2=0x7f7ccc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2185281420 shutdown_connections 2024-09-19T09:34:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.204+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2185281420 wait complete. 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 Processor -- start 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 -- start start 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 0x7f7ccc0fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 0x7f7ccc0fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc110ed0 con 0x7f7ccc106a80 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc110d50 con 0x7f7ccc100a80 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd3cf3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc111050 con 0x7f7ccc101420 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd2290640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd2290640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58714/0 (socket says 172.21.15.52:58714) 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd2290640 1 -- 172.21.15.52:0/2435807358 learned_addr learned my addr 172.21.15.52:0/2435807358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:37.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd1a8f640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 0x7f7ccc0fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.205+0000 7f7cd128e640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 0x7f7ccc0fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 -- 172.21.15.52:0/2435807358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 msgr2=0x7f7ccc0fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 0x7f7ccc0fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 -- 172.21.15.52:0/2435807358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 msgr2=0x7f7ccc0fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 0x7f7ccc0fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 -- 172.21.15.52:0/2435807358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc1a68a0 con 0x7f7ccc106a80 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd2290640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400cad0 tx=0x7f7cc400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400ad60 con 0x7f7ccc106a80 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc1a6b90 con 0x7f7ccc106a80 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cc4005020 con 0x7f7ccc106a80 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc400f6b0 con 0x7f7ccc106a80 2024-09-19T09:34:37.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.206+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc1a70d0 con 0x7f7ccc106a80 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.207+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc100ee0 con 0x7f7ccc106a80 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.208+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7cc4005560 con 0x7f7ccc106a80 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.209+0000 7f7cc2ffd640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 0x7f7cb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.209+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7cc40cfc60 con 0x7f7ccc106a80 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.209+0000 7f7cd1a8f640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 0x7f7cb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.210+0000 7f7cd1a8f640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 0x7f7cb80a5700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8006010 tx=0x7f7cc8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:37.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.212+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cc4014030 con 0x7f7ccc106a80 2024-09-19T09:34:37.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.429+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ccc0fe2d0 con 0x7f7ccc106a80 2024-09-19T09:34:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.429+0000 7f7cc2ffd640 1 -- 172.21.15.52:0/2435807358 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f7ccc0fe2d0 con 0x7f7ccc106a80 2024-09-19T09:34:37.431 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:34:37.431 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:34:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:34:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 msgr2=0x7f7cb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 0x7f7cb80a5700 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8006010 tx=0x7f7cc8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 msgr2=0x7f7ccc0fd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400cad0 tx=0x7f7cc400ced0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 shutdown_connections 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ccc106a80 0x7f7ccc0fd820 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7cb80a3240 0x7f7cb80a5700 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ccc101420 0x7f7ccc0fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 --2- 172.21.15.52:0/2435807358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ccc100a80 0x7f7ccc0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 >> 172.21.15.52:0/2435807358 conn(0x7f7ccc0fc7a0 msgr2=0x7f7ccc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 shutdown_connections 2024-09-19T09:34:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:37.432+0000 7f7cd3cf3640 1 -- 172.21.15.52:0/2435807358 wait complete. 2024-09-19T09:34:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:37 smithi169 ceph-mon[35454]: pgmap v733: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:34:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:37 smithi086 ceph-mon[34813]: pgmap v733: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-19T09:34:38.056 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id ea70e970 --release --await' 2024-09-19T09:34:38.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id ea70e970 --release --await 2024-09-19T09:34:38.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:38 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2435807358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:38.314 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:38.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:38 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2435807358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:38.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:38 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2435807358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:34:38.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- 172.21.15.52:0/1219641512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c106a60 msgr2=0x7fd02c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 --2- 172.21.15.52:0/1219641512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c106a60 0x7fd02c106e40 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fd020009930 tx=0x7fd02002a420 comp rx=0 tx=0).stop 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- 172.21.15.52:0/1219641512 shutdown_connections 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 --2- 172.21.15.52:0/1219641512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02c101400 0x7fd02c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 --2- 172.21.15.52:0/1219641512 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c100a60 0x7fd02c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 --2- 172.21.15.52:0/1219641512 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c106a60 0x7fd02c106e40 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- 172.21.15.52:0/1219641512 >> 172.21.15.52:0/1219641512 conn(0x7fd02c0fc780 msgr2=0x7fd02c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- 172.21.15.52:0/1219641512 shutdown_connections 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- 172.21.15.52:0/1219641512 wait complete. 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 Processor -- start 2024-09-19T09:34:38.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.769+0000 7fd032db0640 1 -- start start 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02c100a60 0x7fd02c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c106a60 0x7fd02c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c110f00 con 0x7fd02c101400 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c110d80 con 0x7fd02c106a60 2024-09-19T09:34:38.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd032db0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c111080 con 0x7fd02c100a60 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41084/0 (socket says 172.21.15.52:41084) 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 -- 172.21.15.52:0/2418038339 learned_addr learned my addr 172.21.15.52:0/2418038339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd03134d640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c106a60 0x7fd02c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 -- 172.21.15.52:0/2418038339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02c100a60 msgr2=0x7fd02c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02c100a60 0x7fd02c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 -- 172.21.15.52:0/2418038339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c106a60 msgr2=0x7fd02c19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c106a60 0x7fd02c19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 -- 172.21.15.52:0/2418038339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c19d5d0 con 0x7fd02c101400 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fd01800b4a0 tx=0x7fd01800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.770+0000 7fd029ffb640 1 -- 172.21.15.52:0/2418038339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018014070 con 0x7fd02c101400 2024-09-19T09:34:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.771+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c19d8c0 con 0x7fd02c101400 2024-09-19T09:34:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.771+0000 7fd029ffb640 1 -- 172.21.15.52:0/2418038339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd018010af0 con 0x7fd02c101400 2024-09-19T09:34:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.771+0000 7fd029ffb640 1 -- 172.21.15.52:0/2418038339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018017d10 con 0x7fd02c101400 2024-09-19T09:34:38.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.771+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c1a51a0 con 0x7fd02c101400 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.773+0000 7fd029ffb640 1 -- 172.21.15.52:0/2418038339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd018017070 con 0x7fd02c101400 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.773+0000 7fd035189740 1 Processor -- start 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.773+0000 7fd035189740 1 -- start start 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8381440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa838e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562fa82e6620 con 0x562fa8381980 2024-09-19T09:34:38.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562fa828de50 con 0x562fa8381060 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd035189740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562fa82e25e0 con 0x562fa838c240 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd029ffb640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 0x7fd01c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41098/0 (socket says 172.21.15.52:41098) 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 -- 172.21.15.52:0/512599905 learned_addr learned my addr 172.21.15.52:0/512599905 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd03134d640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8381440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd029ffb640 1 -- 172.21.15.52:0/2418038339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd0180cee70 con 0x7fd02c101400 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd03134d640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 0x7fd01c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd02bfff640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa838e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 -- 172.21.15.52:0/512599905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 msgr2=0x562fa838e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa838e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 -- 172.21.15.52:0/512599905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 msgr2=0x562fa8381440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8381440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd030b4c640 1 -- 172.21.15.52:0/512599905 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa827ed40 con 0x562fa8381980 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.774+0000 7fd02bfff640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa838e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd030b4c640 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fd020005e80 tx=0x7fd0200314f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85d9a6f11182afa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd03134d640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 0x7fd01c0a5700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd0240070b0 tx=0x7fd0240093d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd016ffd640 1 -- 172.21.15.52:0/512599905 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02003e030 con 0x562fa8381980 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd016ffd640 1 -- 172.21.15.52:0/512599905 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd020032de0 con 0x562fa8381980 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd016ffd640 1 -- 172.21.15.52:0/512599905 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020035040 con 0x562fa8381980 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd035189740 1 -- 172.21.15.52:0/512599905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 msgr2=0x562fa838bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd035189740 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fd020005e80 tx=0x7fd0200314f0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd035189740 1 -- 172.21.15.52:0/512599905 shutdown_connections 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd035189740 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa838e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.775+0000 7fd035189740 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa838bd00 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 --2- 172.21.15.52:0/512599905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8381440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- 172.21.15.52:0/512599905 >> 172.21.15.52:0/512599905 conn(0x562fa837d5f0 msgr2=0x562fa837d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- 172.21.15.52:0/512599905 shutdown_connections 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- 172.21.15.52:0/512599905 wait complete. 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- start start 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 Processor -- start 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8389090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa8389b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562fa838ee10 con 0x562fa8381980 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562fa826ef10 con 0x562fa8381060 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562fa838ef90 con 0x562fa838c240 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.776+0000 7fd035189740 10 client.0 _ll_register_callbacks cb 0x562fa8292db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41112/0 (socket says 172.21.15.52:41112) 2024-09-19T09:34:38.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 -- 172.21.15.52:0/1263878241 learned_addr learned my addr 172.21.15.52:0/1263878241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd030b4c640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8389090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd03134d640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa8389b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 -- 172.21.15.52:0/1263878241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 msgr2=0x562fa8389b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa8389b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 -- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 msgr2=0x562fa8389090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8389090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 -- 172.21.15.52:0/1263878241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa7ff5580 con 0x562fa8381980 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd02bfff640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fd0180cc890 tx=0x7fd018009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bb14b8dbb002e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd00bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01801e050 con 0x562fa8381980 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd018010ca0 con 0x562fa8381980 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd020032de0 con 0x562fa8381980 2024-09-19T09:34:38.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd01809b3b0 con 0x562fa8381980 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd035189740 10 client.20319 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.777+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562fa80bf960 con 0x562fa8381980 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd020032de0 con 0x562fa8381980 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd018097a20 con 0x562fa8381980 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 10 client.20319 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 10 client.20319 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 20 client.20319 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa839bc20 0x562fa839e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 4 client.20319 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fa82f3b90 con 0x562fa839bc20 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.778+0000 7fd030b4c640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa839bc20 0x562fa839e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd00bfff640 10 client.20319 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:38.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd030b4c640 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa839bc20 0x562fa839e090 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=963615c698c94480 server_cookie=5422058d3aae604d in_seq=0 out_seq=0 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd00bfff640 1 -- 172.21.15.52:0/1263878241 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fa82f3b90 con 0x562fa839bc20 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd00bfff640 10 client.20319 handle_command_reply: tid=0 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd035189740 1 client.20319 shutdown 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 msgr2=0x562fa83895d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fd0180cc890 tx=0x7fd018009390 comp rx=0 tx=0).stop 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.779+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 shutdown_connections 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa839bc20 0x562fa839e090 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa8389b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381980 0x562fa83895d0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 --2- 172.21.15.52:0/1263878241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381060 0x562fa8389090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd00bfff640 0 client.20319 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 >> 172.21.15.52:0/1263878241 conn(0x562fa837d5f0 msgr2=0x562fa8383320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 shutdown_connections 2024-09-19T09:34:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 1 -- 172.21.15.52:0/1263878241 wait complete. 2024-09-19T09:34:38.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.780+0000 7fd035189740 20 client.20319 trim_cache size 0 max 16384 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 Processor -- start 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 -- start start 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa8381060 0x562fa83831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa83a3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1b0180 con 0x562fa838c240 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1ada50 con 0x562fa8381980 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd035189740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1ab8a0 con 0x562fa8381060 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41114/0 (socket says 172.21.15.52:41114) 2024-09-19T09:34:38.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 -- 172.21.15.52:0/189014412 learned_addr learned my addr 172.21.15.52:0/189014412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd02bfff640 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa83a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd030b4c640 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa8381060 0x562fa83831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 -- 172.21.15.52:0/189014412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa8381060 msgr2=0x562fa83831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa8381060 0x562fa83831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 -- 172.21.15.52:0/189014412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 msgr2=0x562fa83a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.797+0000 7fd03134d640 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa83a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.798+0000 7fd03134d640 1 -- 172.21.15.52:0/189014412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa83817b0 con 0x562fa838c240 2024-09-19T09:34:38.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.798+0000 7fd03134d640 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fd02400aa40 tx=0x7fd02400c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb35ead894c66f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.798+0000 7fd0167fc640 1 -- 172.21.15.52:0/189014412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024013040 con 0x562fa838c240 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.798+0000 7fd0167fc640 1 -- 172.21.15.52:0/189014412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd02402a070 con 0x562fa838c240 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.798+0000 7fd0167fc640 1 -- 172.21.15.52:0/189014412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024025b70 con 0x562fa838c240 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- 172.21.15.52:0/189014412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 msgr2=0x562fa83a3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fd02400aa40 tx=0x7fd02400c070 comp rx=0 tx=0).stop 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- 172.21.15.52:0/189014412 shutdown_connections 2024-09-19T09:34:38.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa838c240 0x562fa83a3e50 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa83a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- 172.21.15.52:0/189014412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa8381060 0x562fa83831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- 172.21.15.52:0/189014412 >> 172.21.15.52:0/189014412 conn(0x562fa837d5f0 msgr2=0x562fa8382ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- 172.21.15.52:0/189014412 shutdown_connections 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- 172.21.15.52:0/189014412 wait complete. 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 -- start start 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 Processor -- start 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.799+0000 7fd035189740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa8394720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa83911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1abf10 con 0x562fa8381060 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1ad380 con 0x562fa8381980 2024-09-19T09:34:38.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c1ac5e0 con 0x562fa838c240 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 10 client.0 _ll_register_callbacks cb 0x7fd01809ad10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41128/0 (socket says 172.21.15.52:41128) 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 -- 172.21.15.52:0/2411004668 learned_addr learned my addr 172.21.15.52:0/2411004668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa8394720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd03134d640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa83911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 -- 172.21.15.52:0/2411004668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 msgr2=0x562fa83911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa83911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 -- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 msgr2=0x562fa8394720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa8394720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 -- 172.21.15.52:0/2411004668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa8394e10 con 0x562fa8381060 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd030b4c640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fd020003660 tx=0x7fd020003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646ee9d949bb52fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:38.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd00bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020035040 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fd0200042f0 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.800+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd02402a070 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd020059030 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 10 client.20325 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562fa8406f00 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd02402a070 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd020031810 con 0x562fa8381060 2024-09-19T09:34:38.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 10 client.20325 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 10 client.20325 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 20 client.20325 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa8407240 0x562fa8409630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 4 client.20325 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ea70e970", "release": true, "await": true}] 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ea70e970", "release": true, "await": true}) -- 0x562fa82ee0a0 con 0x562fa8407240 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.801+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa8407240 0x562fa8409630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.802+0000 7fd00bfff640 10 client.20325 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:38.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.802+0000 7fd02bfff640 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa8407240 0x562fa8409630 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33cabb343666b31a server_cookie=75b9df0ca4dfa01d in_seq=0 out_seq=0 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd00bfff640 1 -- 172.21.15.52:0/2411004668 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562fa82ee0a0 con 0x562fa8407240 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd00bfff640 10 client.20325 handle_command_reply: tid=0 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 client.20325 shutdown 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 msgr2=0x562fa83941e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fd020003660 tx=0x7fd020003690 comp rx=0 tx=0).stop 2024-09-19T09:34:38.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 shutdown_connections 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562fa8407240 0x562fa8409630 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562fa838c240 0x562fa83911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562fa8381980 0x562fa8394720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 --2- 172.21.15.52:0/2411004668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562fa8381060 0x562fa83941e0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 >> 172.21.15.52:0/2411004668 conn(0x562fa837d5f0 msgr2=0x562fa837c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.804+0000 7fd00bfff640 0 client.20325 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 shutdown_connections 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd035189740 1 -- 172.21.15.52:0/2411004668 wait complete. 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd035189740 20 client.20325 trim_cache size 0 max 16384 2024-09-19T09:34:38.809 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 48, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "ea70e970": { 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 48, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:34:38.810 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 142.2, 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:34:38.811 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 msgr2=0x7fd01c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 0x7fd01c0a5700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd0240070b0 tx=0x7fd0240093d0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 msgr2=0x7fd02c198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fd01800b4a0 tx=0x7fd01800b960 comp rx=0 tx=0).stop 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 shutdown_connections 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd02c106a60 0x7fd02c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd02c101400 0x7fd02c198b60 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fd01c0a3240 0x7fd01c0a5700 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 --2- 172.21.15.52:0/2418038339 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd02c100a60 0x7fd02c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 >> 172.21.15.52:0/2418038339 conn(0x7fd02c0fc780 msgr2=0x7fd02c06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 shutdown_connections 2024-09-19T09:34:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:34:38.805+0000 7fd032db0640 1 -- 172.21.15.52:0/2418038339 wait complete. 2024-09-19T09:34:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:39 smithi052 ceph-mon[30947]: pgmap v734: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:34:39.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:39 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:39 smithi169 ceph-mon[35454]: pgmap v734: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:34:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:39 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:39 smithi086 ceph-mon[34813]: pgmap v734: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-19T09:34:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:39 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:39.538 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ea70e970', total seconds elapsed: 25.2 2024-09-19T09:34:40.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:34:40.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:34:40.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:40.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:34:41.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:41 smithi052 ceph-mon[30947]: pgmap v735: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-19T09:34:41.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:41 smithi169 ceph-mon[35454]: pgmap v735: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-19T09:34:41.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:41 smithi086 ceph-mon[34813]: pgmap v735: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 -- 172.21.15.52:0/4252578102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c102610 msgr2=0x7f145c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 --2- 172.21.15.52:0/4252578102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c102610 0x7f145c108ea0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f1454009ca0 tx=0x7f145402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 -- 172.21.15.52:0/4252578102 shutdown_connections 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 --2- 172.21.15.52:0/4252578102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c102610 0x7f145c108ea0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 --2- 172.21.15.52:0/4252578102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c101c50 0x7f145c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 --2- 172.21.15.52:0/4252578102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c100a60 0x7f145c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 -- 172.21.15.52:0/4252578102 >> 172.21.15.52:0/4252578102 conn(0x7f145c0fc1e0 msgr2=0x7f145c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 -- 172.21.15.52:0/4252578102 shutdown_connections 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.386+0000 7f146321e640 1 -- 172.21.15.52:0/4252578102 wait complete. 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 Processor -- start 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 -- start start 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 0x7f145c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 0x7f145c19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10c710 con 0x7f145c100a60 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10c590 con 0x7f145c101c50 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f146321e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f145c10c890 con 0x7f145c102610 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.391 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41150/0 (socket says 172.21.15.52:41150) 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 -- 172.21.15.52:0/1882076797 learned_addr learned my addr 172.21.15.52:0/1882076797 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f145bfff640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 0x7f145c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f14617bb640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 0x7f145c19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 -- 172.21.15.52:0/1882076797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 msgr2=0x7f145c19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 0x7f145c19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 -- 172.21.15.52:0/1882076797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 msgr2=0x7f145c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 0x7f145c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f1460fba640 1 -- 172.21.15.52:0/1882076797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145c19e8c0 con 0x7f145c100a60 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f14617bb640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 0x7f145c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.387+0000 7f145bfff640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 0x7f145c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f1460fba640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f145000d770 tx=0x7f145000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f1459ffb640 1 -- 172.21.15.52:0/1882076797 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450017070 con 0x7f145c100a60 2024-09-19T09:34:42.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f1459ffb640 1 -- 172.21.15.52:0/1882076797 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1450009c30 con 0x7f145c100a60 2024-09-19T09:34:42.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145c19ebb0 con 0x7f145c100a60 2024-09-19T09:34:42.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f1459ffb640 1 -- 172.21.15.52:0/1882076797 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450003dd0 con 0x7f145c100a60 2024-09-19T09:34:42.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.388+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f145c19f100 con 0x7f145c100a60 2024-09-19T09:34:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.391+0000 7f1459ffb640 1 -- 172.21.15.52:0/1882076797 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1450003f70 con 0x7f145c100a60 2024-09-19T09:34:42.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.391+0000 7f146608f740 1 Processor -- start 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.391+0000 7f146608f740 1 -- start start 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.391+0000 7f146608f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fbcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f146608f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 0x557f34fc1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f146608f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f146608f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557f34f202f0 con 0x557f34fc2370 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f146608f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557f34ec8270 con 0x557f34fbc9a0 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f146608f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f34f1c2b0 con 0x557f34fbd2e0 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41166/0 (socket says 172.21.15.52:41166) 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 -- 172.21.15.52:0/1579669347 learned_addr learned my addr 172.21.15.52:0/1579669347 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:42.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f1459ffb640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 0x7f144c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f14617bb640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fbcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f14617bb640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 0x7f144c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 -- 172.21.15.52:0/1579669347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 msgr2=0x557f34fc1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f1459ffb640 1 -- 172.21.15.52:0/1882076797 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f14500cf3b0 con 0x7f145c100a60 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f1460fba640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 0x557f34fc1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 0x557f34fc1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 -- 172.21.15.52:0/1579669347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 msgr2=0x557f34fbcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fbcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 -- 172.21.15.52:0/1579669347 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f34ec7340 con 0x557f34fc2370 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f14617bb640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fbcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f1460fba640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 0x557f34fc1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f145bfff640 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f144800bd30 tx=0x7f144800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69188f9b7297c97f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.392+0000 7f1446ffd640 1 -- 172.21.15.52:0/1579669347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448015070 con 0x557f34fc2370 2024-09-19T09:34:42.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f14617bb640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 0x7f144c0a5920 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1454006010 tx=0x7f14540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f1446ffd640 1 -- 172.21.15.52:0/1579669347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144800be20 con 0x557f34fc2370 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f1446ffd640 1 -- 172.21.15.52:0/1579669347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448011aa0 con 0x557f34fc2370 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 -- 172.21.15.52:0/1579669347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 msgr2=0x557f34fc4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f144800bd30 tx=0x7f144800f730 comp rx=0 tx=0).stop 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 -- 172.21.15.52:0/1579669347 shutdown_connections 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fc2370 0x557f34fc4830 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbd2e0 0x557f34fc1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 --2- 172.21.15.52:0/1579669347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fbcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 -- 172.21.15.52:0/1579669347 >> 172.21.15.52:0/1579669347 conn(0x557f34fb8010 msgr2=0x557f34fb8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 -- 172.21.15.52:0/1579669347 shutdown_connections 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.393+0000 7f146608f740 1 -- 172.21.15.52:0/1579669347 wait complete. 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 -- start start 2024-09-19T09:34:42.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 Processor -- start 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fc8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fc2370 0x557f34fc6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557f34fc5340 con 0x557f34fbd2e0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557f34ea9290 con 0x557f34fbc9a0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557f34fc54c0 con 0x557f34fc2370 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f146608f740 10 client.0 _ll_register_callbacks cb 0x557f34eda140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41176/0 (socket says 172.21.15.52:41176) 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f145bfff640 1 -- 172.21.15.52:0/3462421161 learned_addr learned my addr 172.21.15.52:0/3462421161 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.394+0000 7f14617bb640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fc2370 0x557f34fc6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f1460fba640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fc8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 -- 172.21.15.52:0/3462421161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fc2370 msgr2=0x557f34fc6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fc2370 0x557f34fc6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 -- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 msgr2=0x557f34fc8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fc8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 -- 172.21.15.52:0/3462421161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f34c33210 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f145bfff640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1448011580 tx=0x7f14480052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77199b6487ed1af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f143bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448028060 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1448011820 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144800be20 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1448015070 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f146608f740 10 client.20337 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.395+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f34cff620 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144800be20 con 0x557f34fbd2e0 2024-09-19T09:34:42.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f144801a460 con 0x557f34fbd2e0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 10 client.20337 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 10 client.20337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 20 client.20337 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f34fd68a0 0x557f34fd8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 4 client.20337 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f34f2da20 con 0x557f34fd68a0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.396+0000 7f1460fba640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f34fd68a0 0x557f34fd8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.397+0000 7f1460fba640 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f34fd68a0 0x557f34fd8c90 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7ec5299b8ceece server_cookie=d9197db24cb41c47 in_seq=0 out_seq=0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.397+0000 7f143bfff640 10 client.20337 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.397+0000 7f143bfff640 1 -- 172.21.15.52:0/3462421161 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f34f2da20 con 0x557f34fd68a0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.397+0000 7f143bfff640 10 client.20337 handle_command_reply: tid=0 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.397+0000 7f146608f740 1 client.20337 shutdown 2024-09-19T09:34:42.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 msgr2=0x557f34fc68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f1448011580 tx=0x7f14480052e0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 shutdown_connections 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f34fd68a0 0x557f34fd8c90 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fc2370 0x557f34fc6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fc68a0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 --2- 172.21.15.52:0/3462421161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fbc9a0 0x557f34fc8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f143bfff640 0 client.20337 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 >> 172.21.15.52:0/3462421161 conn(0x557f34fb8010 msgr2=0x557f34fb9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 shutdown_connections 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 1 -- 172.21.15.52:0/3462421161 wait complete. 2024-09-19T09:34:42.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.398+0000 7f146608f740 20 client.20337 trim_cache size 0 max 16384 2024-09-19T09:34:42.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.412+0000 7f146608f740 1 Processor -- start 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.412+0000 7f146608f740 1 -- start start 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fc5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fb8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a9830 con 0x557f34fbd2e0 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a7100 con 0x557f34fc2370 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f146608f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a4f50 con 0x557f34fbc9a0 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41178/0 (socket says 172.21.15.52:41178) 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 -- 172.21.15.52:0/759847371 learned_addr learned my addr 172.21.15.52:0/759847371 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f14617bb640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fb8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.419 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f1460fba640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fc5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 -- 172.21.15.52:0/759847371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 msgr2=0x557f34fc5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fc5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 -- 172.21.15.52:0/759847371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 msgr2=0x557f34fb8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fb8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 -- 172.21.15.52:0/759847371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f34fc16b0 con 0x557f34fbd2e0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f14617bb640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f145bfff640 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1448005bc0 tx=0x7f14480115b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd51936e182db50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f14467fc640 1 -- 172.21.15.52:0/759847371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448028070 con 0x557f34fbd2e0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f14467fc640 1 -- 172.21.15.52:0/759847371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144800b3a0 con 0x557f34fbd2e0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.413+0000 7f14467fc640 1 -- 172.21.15.52:0/759847371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14480116f0 con 0x557f34fbd2e0 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- 172.21.15.52:0/759847371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 msgr2=0x557f34fb83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.420 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f1448005bc0 tx=0x7f14480115b0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- 172.21.15.52:0/759847371 shutdown_connections 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fb83f0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 --2- 172.21.15.52:0/759847371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fc5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- 172.21.15.52:0/759847371 >> 172.21.15.52:0/759847371 conn(0x557f34fb8010 msgr2=0x557f34fc58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- 172.21.15.52:0/759847371 shutdown_connections 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- 172.21.15.52:0/759847371 wait complete. 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.414+0000 7f146608f740 1 -- start start 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 Processor -- start 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fcf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fd0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a55c0 con 0x557f34fbd2e0 2024-09-19T09:34:42.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a6a30 con 0x557f34fc2370 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f145c1a5c90 con 0x557f34fbc9a0 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f146608f740 10 client.0 _ll_register_callbacks cb 0x7f144800bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41192/0 (socket says 172.21.15.52:41192) 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 -- 172.21.15.52:0/3515506224 learned_addr learned my addr 172.21.15.52:0/3515506224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f1460fba640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fcf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f14617bb640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fd0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 -- 172.21.15.52:0/3515506224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 msgr2=0x557f34fcf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fcf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 -- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 msgr2=0x557f34fd0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fd0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f145bfff640 1 -- 172.21.15.52:0/3515506224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f34fd1360 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.415+0000 7f14617bb640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fd0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f145bfff640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f144800b880 tx=0x7f144800b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1e64f4ee766291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448028040 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1448004250 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144800b3a0 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f144800be20 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 10 client.20343 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f34fd2670 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f144800b3a0 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f14480048f0 con 0x557f34fbd2e0 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 10 client.20343 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 10 client.20343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:42.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 20 client.20343 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f35041730 0x557f35043b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 4 client.20343 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.416+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f34f27d70 con 0x557f35041730 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.417+0000 7f1460fba640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f35041730 0x557f35043b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.417+0000 7f1460fba640 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f35041730 0x557f35043b50 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a559cab0beb7927 server_cookie=794a006eed9eb1be in_seq=0 out_seq=0 2024-09-19T09:34:42.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.417+0000 7f143bfff640 10 client.20343 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f143bfff640 1 -- 172.21.15.52:0/3515506224 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f34f27d70 con 0x557f35041730 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f143bfff640 10 client.20343 handle_command_reply: tid=0 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 client.20343 shutdown 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 msgr2=0x557f34fcfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f144800b880 tx=0x7f144800b980 comp rx=0 tx=0).stop 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 shutdown_connections 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557f35041730 0x557f35043b50 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557f34fc2370 0x557f34fd0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557f34fbd2e0 0x557f34fcfd40 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f143bfff640 0 client.20343 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 --2- 172.21.15.52:0/3515506224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557f34fbc9a0 0x557f34fcf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 >> 172.21.15.52:0/3515506224 conn(0x557f34fb8010 msgr2=0x557f34fc60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.429 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 shutdown_connections 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 1 -- 172.21.15.52:0/3515506224 wait complete. 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.427+0000 7f146608f740 20 client.20343 trim_cache size 0 max 16384 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:34:42.430 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 msgr2=0x7f144c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 0x7f144c0a5920 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1454006010 tx=0x7f14540095c0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 msgr2=0x7f145c196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f145000d770 tx=0x7f145000dc30 comp rx=0 tx=0).stop 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 shutdown_connections 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f144c0a3460 0x7f144c0a5920 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f145c102610 0x7f145c19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f145c101c50 0x7f145c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.431 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 --2- 172.21.15.52:0/1882076797 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f145c100a60 0x7f145c196c80 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 >> 172.21.15.52:0/1882076797 conn(0x7f145c0fc1e0 msgr2=0x7f145c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 shutdown_connections 2024-09-19T09:34:42.432 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:42.428+0000 7f146321e640 1 -- 172.21.15.52:0/1882076797 wait complete. 2024-09-19T09:34:43.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:43 smithi052 ceph-mon[30947]: pgmap v736: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-19T09:34:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:43 smithi169 ceph-mon[35454]: pgmap v736: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-19T09:34:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:43 smithi086 ceph-mon[34813]: pgmap v736: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.3 KiB/s wr, 10 op/s 2024-09-19T09:34:45.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:45 smithi052 ceph-mon[30947]: pgmap v737: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-19T09:34:45.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:45 smithi169 ceph-mon[35454]: pgmap v737: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-19T09:34:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:45 smithi086 ceph-mon[34813]: pgmap v737: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-19T09:34:47.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:47 smithi052 ceph-mon[30947]: pgmap v738: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T09:34:47.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:47 smithi169 ceph-mon[35454]: pgmap v738: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T09:34:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:47 smithi086 ceph-mon[34813]: pgmap v738: 97 pgs: 97 active+clean; 2.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T09:34:49.560 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:49 smithi086 ceph-mon[34813]: pgmap v739: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:49.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:49 smithi052 ceph-mon[30947]: pgmap v739: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:49 smithi169 ceph-mon[35454]: pgmap v739: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:51.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:51 smithi052 ceph-mon[30947]: pgmap v740: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:51 smithi169 ceph-mon[35454]: pgmap v740: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:51.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:51 smithi086 ceph-mon[34813]: pgmap v740: 97 pgs: 97 active+clean; 2.6 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-19T09:34:53.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:53 smithi052 ceph-mon[30947]: pgmap v741: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T09:34:53.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:53 smithi169 ceph-mon[35454]: pgmap v741: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T09:34:53.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:53 smithi086 ceph-mon[34813]: pgmap v741: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 -- 172.21.15.52:0/2720697522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 msgr2=0x7f4bb0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 --2- 172.21.15.52:0/2720697522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0107300 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009900 tx=0x7f4ba002a410 comp rx=0 tx=0).stop 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 -- 172.21.15.52:0/2720697522 shutdown_connections 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 --2- 172.21.15.52:0/2720697522 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb0107840 0x7f4bb0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 --2- 172.21.15.52:0/2720697522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0107300 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 --2- 172.21.15.52:0/2720697522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb01025e0 0x7f4bb01049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.529+0000 7f4bb862e640 1 -- 172.21.15.52:0/2720697522 >> 172.21.15.52:0/2720697522 conn(0x7f4bb00fc1e0 msgr2=0x7f4bb00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- 172.21.15.52:0/2720697522 shutdown_connections 2024-09-19T09:34:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- 172.21.15.52:0/2720697522 wait complete. 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 Processor -- start 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- start start 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb01025e0 0x7f4bb0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 0x7f4bb019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010d840 con 0x7f4bb0104f10 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010d6c0 con 0x7f4bb0107840 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb862e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb010d9c0 con 0x7f4bb01025e0 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.530+0000 7f4bb5bc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44656/0 (socket says 172.21.15.52:44656) 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 -- 172.21.15.52:0/370240294 learned_addr learned my addr 172.21.15.52:0/370240294 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb01025e0 0x7f4bb0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 0x7f4bb019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 -- 172.21.15.52:0/370240294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb01025e0 msgr2=0x7f4bb0197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb01025e0 0x7f4bb0197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 -- 172.21.15.52:0/370240294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 msgr2=0x7f4bb019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 0x7f4bb019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 -- 172.21.15.52:0/370240294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb019fa00 con 0x7f4bb0104f10 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 0x7f4bb019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0031440 tx=0x7f4ba0032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4ba77fe640 1 -- 172.21.15.52:0/370240294 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba003f030 con 0x7f4bb0104f10 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4ba77fe640 1 -- 172.21.15.52:0/370240294 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0003ce0 con 0x7f4bb0104f10 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb019fc90 con 0x7f4bb0104f10 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4ba77fe640 1 -- 172.21.15.52:0/370240294 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0035070 con 0x7f4bb0104f10 2024-09-19T09:34:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.531+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb01a01d0 con 0x7f4bb0104f10 2024-09-19T09:34:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.534+0000 7f4ba77fe640 1 -- 172.21.15.52:0/370240294 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4ba0042030 con 0x7f4bb0104f10 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.534+0000 7f4bbb3ca740 1 Processor -- start 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 -- start start 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f49ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56114f3f22f0 con 0x56114f492db0 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56114f39a270 con 0x56114f4936f0 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56114f3ee2b0 con 0x56114f498780 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4ba77fe640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 0x7f4b9c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb6bcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb6bcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44670/0 (socket says 172.21.15.52:44670) 2024-09-19T09:34:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/3267471320 learned_addr learned my addr 172.21.15.52:0/3267471320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4ba77fe640 1 -- 172.21.15.52:0/370240294 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4ba00efbd0 con 0x7f4bb0104f10 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f49ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.535+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 0x7f4b9c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/3267471320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 msgr2=0x56114f49ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f49ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/3267471320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 msgr2=0x56114f4981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/3267471320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114f399340 con 0x56114f492db0 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8014a60 tx=0x7f4ba8014e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caea2b167bc058a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4ba4bfe640 1 -- 172.21.15.52:0/3267471320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba801ea80 con 0x56114f492db0 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4ba4bfe640 1 -- 172.21.15.52:0/3267471320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba8023070 con 0x56114f492db0 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.536+0000 7f4ba4bfe640 1 -- 172.21.15.52:0/3267471320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba800cbe0 con 0x56114f492db0 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3267471320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 msgr2=0x56114f4931b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8014a60 tx=0x7f4ba8014e60 comp rx=0 tx=0).stop 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 0x7f4b9c0a5830 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8022000 tx=0x7f4ba801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3267471320 shutdown_connections 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f49ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3267471320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4931b0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3267471320 >> 172.21.15.52:0/3267471320 conn(0x56114f48a010 msgr2=0x56114f48a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3267471320 shutdown_connections 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3267471320 wait complete. 2024-09-19T09:34:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.537+0000 7f4bbb3ca740 1 -- start start 2024-09-19T09:34:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 Processor -- start 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f492db0 0x56114f49d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f49d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56114f49b750 con 0x56114f498780 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56114f37b290 con 0x56114f4936f0 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56114f49b8d0 con 0x56114f492db0 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bbb3ca740 10 client.0 _ll_register_callbacks cb 0x56114f3ac140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44676/0 (socket says 172.21.15.52:44676) 2024-09-19T09:34:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/954270119 learned_addr learned my addr 172.21.15.52:0/954270119 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f492db0 0x56114f49d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f49d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/954270119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f492db0 msgr2=0x56114f49d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f492db0 0x56114f49d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 msgr2=0x56114f49d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f49d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.538+0000 7f4bb6bcb640 1 -- 172.21.15.52:0/954270119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114f105210 con 0x56114f498780 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009900 tx=0x7f4ba8009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ba2fb13c3d14d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8037060 con 0x56114f498780 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4ba800c9c0 con 0x56114f498780 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba8023070 con 0x56114f498780 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4ba800cbc0 con 0x56114f498780 2024-09-19T09:34:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4bbb3ca740 10 client.20355 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56114f1d1620 con 0x56114f498780 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba8023070 con 0x56114f498780 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.539+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4ba800f040 con 0x56114f498780 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 10 client.20355 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 10 client.20355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 20 client.20355 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f4a8a60 0x56114f4aae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 4 client.20355 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56114f3ffa20 con 0x56114f4a8a60 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f4a8a60 0x56114f4aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f4a8a60 0x56114f4aae50 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b433b1778ac43913 server_cookie=ba3d489131dc3ac9 in_seq=0 out_seq=0 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.540+0000 7f4b99ffb640 10 client.20355 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4b99ffb640 1 -- 172.21.15.52:0/954270119 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56114f3ffa20 con 0x56114f4a8a60 2024-09-19T09:34:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4b99ffb640 10 client.20355 handle_command_reply: tid=0 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 client.20355 shutdown 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 msgr2=0x56114f4a4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8009900 tx=0x7f4ba8009930 comp rx=0 tx=0).stop 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 shutdown_connections 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f4a8a60 0x56114f4aae50 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f498780 0x56114f4a4580 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f49d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4b99ffb640 0 client.20355 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/954270119 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f492db0 0x56114f49d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 >> 172.21.15.52:0/954270119 conn(0x56114f48a010 msgr2=0x56114f48b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 shutdown_connections 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.541+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/954270119 wait complete. 2024-09-19T09:34:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.542+0000 7f4bbb3ca740 20 client.20355 trim_cache size 0 max 16384 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 Processor -- start 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 -- start start 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a9860 con 0x56114f492db0 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a7130 con 0x56114f4936f0 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.556+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a4f80 con 0x56114f498780 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44678/0 (socket says 172.21.15.52:44678) 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 -- 172.21.15.52:0/2040240665 learned_addr learned my addr 172.21.15.52:0/2040240665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 -- 172.21.15.52:0/2040240665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 msgr2=0x56114f4af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 -- 172.21.15.52:0/2040240665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 msgr2=0x56114f4a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 -- 172.21.15.52:0/2040240665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56114f49ba50 con 0x56114f492db0 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x56114f4ab640 tx=0x7f4bac00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdfc8b83a68de5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4b9bfff640 1 -- 172.21.15.52:0/2040240665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac027610 con 0x56114f492db0 2024-09-19T09:34:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4b9bfff640 1 -- 172.21.15.52:0/2040240665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bac01d8d0 con 0x56114f492db0 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.557+0000 7f4b9bfff640 1 -- 172.21.15.52:0/2040240665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00f980 con 0x56114f492db0 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/2040240665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 msgr2=0x56114f4890b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x56114f4ab640 tx=0x7f4bac00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/2040240665 shutdown_connections 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/2040240665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4890b0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/2040240665 >> 172.21.15.52:0/2040240665 conn(0x56114f48a010 msgr2=0x56114f4889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/2040240665 shutdown_connections 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/2040240665 wait complete. 2024-09-19T09:34:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- start start 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 Processor -- start 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a55f0 con 0x56114f492db0 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a6a60 con 0x56114f4936f0 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.558+0000 7f4bbb3ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01a5cc0 con 0x56114f498780 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bbb3ca740 10 client.0 _ll_register_callbacks cb 0x7f4bac00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44694/0 (socket says 172.21.15.52:44694) 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 -- 172.21.15.52:0/3772073185 learned_addr learned my addr 172.21.15.52:0/3772073185 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb6bcb640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 -- 172.21.15.52:0/3772073185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 msgr2=0x56114f4a2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 -- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 msgr2=0x56114f4a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 -- 172.21.15.52:0/3772073185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56114f4a3490 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bb63ca640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01d690 tx=0x7f4bac01d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2e6e86c5fc7041 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4b99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac034020 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4bac01ede0 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.559+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bac01d8d0 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4bac03f050 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 10 client.20361 fetch_fsmap learned FSMap version 24 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56114f4a4780 con 0x56114f492db0 2024-09-19T09:34:55.566 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bac01d8d0 con 0x56114f492db0 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4bac004cc0 con 0x56114f492db0 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 10 client.20361 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 10 client.20361 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 20 client.20361 populate_metadata read hostname 'smithi052' 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f513d60 0x56114f516180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 4 client.20361 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56114f3f9d70 con 0x56114f513d60 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.560+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f513d60 0x56114f516180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.561+0000 7f4b99ffb640 10 client.20361 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:55.567 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.561+0000 7f4bb5bc9640 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f513d60 0x56114f516180 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f4f7d4fda50f8d server_cookie=4a4eae443dec7e79 in_seq=0 out_seq=0 2024-09-19T09:34:55.576 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4b99ffb640 1 -- 172.21.15.52:0/3772073185 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56114f3f9d70 con 0x56114f513d60 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4b99ffb640 10 client.20361 handle_command_reply: tid=0 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 client.20361 shutdown 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 msgr2=0x56114f4a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01d690 tx=0x7f4bac01d6c0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 shutdown_connections 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56114f513d60 0x56114f516180 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56114f498780 0x56114f4a2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56114f4936f0 0x56114f4a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 --2- 172.21.15.52:0/3772073185 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56114f492db0 0x56114f4a1930 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4b99ffb640 0 client.20361 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 >> 172.21.15.52:0/3772073185 conn(0x56114f48a010 msgr2=0x56114f4889a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 shutdown_connections 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 1 -- 172.21.15.52:0/3772073185 wait complete. 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.574+0000 7f4bbb3ca740 20 client.20361 trim_cache size 0 max 16384 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:34:55.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:34:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:34:55.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 msgr2=0x7f4b9c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 0x7f4b9c0a5830 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8022000 tx=0x7f4ba801e000 comp rx=0 tx=0).stop 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 msgr2=0x7f4bb0198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0031440 tx=0x7f4ba0032e20 comp rx=0 tx=0).stop 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 shutdown_connections 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4bb0107840 0x7f4bb019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bb0104f10 0x7f4bb0198320 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b9c0a3370 0x7f4b9c0a5830 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 --2- 172.21.15.52:0/370240294 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4bb01025e0 0x7f4bb0197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 >> 172.21.15.52:0/370240294 conn(0x7f4bb00fc1e0 msgr2=0x7f4bb0102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 shutdown_connections 2024-09-19T09:34:55.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:34:55.575+0000 7f4bb862e640 1 -- 172.21.15.52:0/370240294 wait complete. 2024-09-19T09:34:55.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:55 smithi052 ceph-mon[30947]: pgmap v742: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:34:55.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:55 smithi169 ceph-mon[35454]: pgmap v742: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:34:55.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:55 smithi086 ceph-mon[34813]: pgmap v742: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:34:57.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:57 smithi052 ceph-mon[30947]: pgmap v743: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:34:57.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:57 smithi169 ceph-mon[35454]: pgmap v743: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:34:57.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:57 smithi086 ceph-mon[34813]: pgmap v743: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:34:59.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:34:59 smithi052 ceph-mon[30947]: pgmap v744: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:34:59.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:34:59 smithi169 ceph-mon[35454]: pgmap v744: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:34:59.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:34:59 smithi086 ceph-mon[34813]: pgmap v744: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:35:00.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:35:01.133 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:01.581 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:01 smithi052 ceph-mon[30947]: pgmap v745: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:01.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 -- 172.21.15.52:0/1771625517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101470 msgr2=0x7fceb0101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 --2- 172.21.15.52:0/1771625517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101470 0x7fceb0101850 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea002a410 comp rx=0 tx=0).stop 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 -- 172.21.15.52:0/1771625517 shutdown_connections 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 --2- 172.21.15.52:0/1771625517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0105de0 0x7fceb010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 --2- 172.21.15.52:0/1771625517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0101e20 0x7fceb01056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 --2- 172.21.15.52:0/1771625517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101470 0x7fceb0101850 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 -- 172.21.15.52:0/1771625517 >> 172.21.15.52:0/1771625517 conn(0x7fceb0077230 msgr2=0x7fceb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.667+0000 7fceb5c37640 1 -- 172.21.15.52:0/1771625517 shutdown_connections 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.668+0000 7fceb5c37640 1 -- 172.21.15.52:0/1771625517 wait complete. 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.668+0000 7fceb5c37640 1 Processor -- start 2024-09-19T09:35:01.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.668+0000 7fceb5c37640 1 -- start start 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0101470 0x7fceb0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0105de0 0x7fceb01a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0110e40 con 0x7fceb0101e20 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0110cc0 con 0x7fceb0101470 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceb5c37640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fceb0110fc0 con 0x7fceb0105de0 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47926/0 (socket says 172.21.15.52:47926) 2024-09-19T09:35:01.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2679302569 learned_addr learned my addr 172.21.15.52:0/2679302569 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0101470 0x7fceb0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fceaffff640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0105de0 0x7fceb01a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2679302569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0105de0 msgr2=0x7fceb01a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0105de0 0x7fceb01a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2679302569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0101470 msgr2=0x7fceb0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0101470 0x7fceb0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.669+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2679302569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb01a4850 con 0x7fceb0101e20 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fce9800e9f0 tx=0x7fce9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fcead7fa640 1 -- 172.21.15.52:0/2679302569 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9800cd80 con 0x7fceb0101e20 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fcead7fa640 1 -- 172.21.15.52:0/2679302569 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce98005500 con 0x7fceb0101e20 2024-09-19T09:35:01.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb0197080 con 0x7fceb0101e20 2024-09-19T09:35:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fcead7fa640 1 -- 172.21.15.52:0/2679302569 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98010690 con 0x7fceb0101e20 2024-09-19T09:35:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.670+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb0197570 con 0x7fceb0101e20 2024-09-19T09:35:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.672+0000 7fcead7fa640 1 -- 172.21.15.52:0/2679302569 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce980046c0 con 0x7fceb0101e20 2024-09-19T09:35:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.673+0000 7fcead7fa640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 0x7fce9c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.673+0000 7fcead7fa640 1 -- 172.21.15.52:0/2679302569 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fce980cfe40 con 0x7fceb0101e20 2024-09-19T09:35:01.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.673+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 0x7fce9c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 0x7fce9c0a5780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 Processor -- start 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 -- start start 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5585879014a0 0x558587901880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5585878672e0 con 0x558587901dc0 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55858780ece0 con 0x5585879014a0 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceb8010740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5585878632a0 con 0x55858790c680 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fcea6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fcea6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47938/0 (socket says 172.21.15.52:47938) 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2245965774 learned_addr learned my addr 172.21.15.52:0/2245965774 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceaffff640 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.674+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5585879014a0 0x558587901880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2245965774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 msgr2=0x55858790ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2245965774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5585879014a0 msgr2=0x558587901880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5585879014a0 0x558587901880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 -- 172.21.15.52:0/2245965774 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585877f3440 con 0x558587901dc0 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fce98098d50 tx=0x7fce9809bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dad97e628ffac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea5ffb640 1 -- 172.21.15.52:0/2245965774 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce980a0730 con 0x558587901dc0 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea5ffb640 1 -- 172.21.15.52:0/2245965774 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce980a4ff0 con 0x558587901dc0 2024-09-19T09:35:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.675+0000 7fcea5ffb640 1 -- 172.21.15.52:0/2245965774 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9809b7d0 con 0x558587901dc0 2024-09-19T09:35:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 -- 172.21.15.52:0/2245965774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 msgr2=0x55858790c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fce98098d50 tx=0x7fce9809bf80 comp rx=0 tx=0).stop 2024-09-19T09:35:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 -- 172.21.15.52:0/2245965774 shutdown_connections 2024-09-19T09:35:01.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558587901dc0 0x55858790c140 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 --2- 172.21.15.52:0/2245965774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5585879014a0 0x558587901880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 -- 172.21.15.52:0/2245965774 >> 172.21.15.52:0/2245965774 conn(0x5585878fda30 msgr2=0x5585878fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 -- 172.21.15.52:0/2245965774 shutdown_connections 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.676+0000 7fceb8010740 1 -- 172.21.15.52:0/2245965774 wait complete. 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 -- start start 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 Processor -- start 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587909270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x5585879097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55858790f250 con 0x5585879014a0 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558587822050 con 0x558587901dc0 2024-09-19T09:35:01.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55858790f3d0 con 0x55858790c680 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceb8010740 10 client.0 _ll_register_callbacks cb 0x558587862160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47954/0 (socket says 172.21.15.52:47954) 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceaf7fe640 1 -- 172.21.15.52:0/1602525235 learned_addr learned my addr 172.21.15.52:0/1602525235 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fceaffff640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x5585879097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.677+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587909270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 -- 172.21.15.52:0/1602525235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 msgr2=0x5585879097b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x5585879097b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 -- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 msgr2=0x558587909270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587909270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 -- 172.21.15.52:0/1602525235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585875d83c0 con 0x5585879014a0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5e4bcfb2107dad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fce8effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0035040 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce980a4ff0 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcea00035f0 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcea0057020 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceb8010740 10 client.20373 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.678+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55858791ac00 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce980a4ff0 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcea003c8f0 con 0x5585879014a0 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 10 client.20373 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 10 client.20373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 20 client.20373 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55858791c0c0 0x55858791e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 4 client.20373 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:01.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558587874850 con 0x55858791c0c0 2024-09-19T09:35:01.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.679+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55858791c0c0 0x55858791e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.680+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55858791c0c0 0x55858791e4d0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a70ed62ae1f06dd server_cookie=a5f864da956bae18 in_seq=0 out_seq=0 2024-09-19T09:35:01.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.680+0000 7fce8effd640 10 client.20373 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.680+0000 7fce8effd640 1 -- 172.21.15.52:0/1602525235 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558587874850 con 0x55858791c0c0 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.680+0000 7fce8effd640 10 client.20373 handle_command_reply: tid=0 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.680+0000 7fceb8010740 1 client.20373 shutdown 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 msgr2=0x55858790bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea0009260 comp rx=0 tx=0).stop 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 shutdown_connections 2024-09-19T09:35:01.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55858791c0c0 0x55858791e4d0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x5585879097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587909270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 --2- 172.21.15.52:0/1602525235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x55858790bfc0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 >> 172.21.15.52:0/1602525235 conn(0x5585878fda30 msgr2=0x5585878fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fce8effd640 0 client.20373 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 shutdown_connections 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 1 -- 172.21.15.52:0/1602525235 wait complete. 2024-09-19T09:35:01.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.681+0000 7fceb8010740 20 client.20373 trim_cache size 0 max 16384 2024-09-19T09:35:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:01 smithi169 ceph-mon[35454]: pgmap v745: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 Processor -- start 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 -- start start 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558587901dc0 0x558587904740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55858790c680 0x558587923da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01b22e0 con 0x5585879014a0 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01afbb0 con 0x55858790c680 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceb8010740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01ada00 con 0x558587901dc0 2024-09-19T09:35:01.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47958/0 (socket says 172.21.15.52:47958) 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3164956381 learned_addr learned my addr 172.21.15.52:0/3164956381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558587901dc0 0x558587904740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaffff640 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55858790c680 0x558587923da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3164956381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558587901dc0 msgr2=0x558587904740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558587901dc0 0x558587904740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3164956381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55858790c680 msgr2=0x558587923da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55858790c680 0x558587923da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.715+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3164956381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585879012d0 con 0x5585879014a0 2024-09-19T09:35:01.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.716+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fcea0006010 tx=0x7fcea0005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a0ee72888bd415 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.716+0000 7fcea57fa640 1 -- 172.21.15.52:0/3164956381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0035040 con 0x5585879014a0 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.716+0000 7fcea57fa640 1 -- 172.21.15.52:0/3164956381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea003c920 con 0x5585879014a0 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.716+0000 7fcea57fa640 1 -- 172.21.15.52:0/3164956381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0003d70 con 0x5585879014a0 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- 172.21.15.52:0/3164956381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 msgr2=0x5585879184b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fcea0006010 tx=0x7fcea0005940 comp rx=0 tx=0).stop 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- 172.21.15.52:0/3164956381 shutdown_connections 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55858790c680 0x558587923da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558587901dc0 0x558587904740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 --2- 172.21.15.52:0/3164956381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x5585879184b0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- 172.21.15.52:0/3164956381 >> 172.21.15.52:0/3164956381 conn(0x5585878fda30 msgr2=0x558587904030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- 172.21.15.52:0/3164956381 shutdown_connections 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- 172.21.15.52:0/3164956381 wait complete. 2024-09-19T09:35:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 -- start start 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.717+0000 7fceb8010740 1 Processor -- start 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587914f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01ae070 con 0x5585879014a0 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01af4e0 con 0x558587901dc0 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fceb01ae740 con 0x55858790c680 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceb8010740 10 client.0 _ll_register_callbacks cb 0x7fcea0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47962/0 (socket says 172.21.15.52:47962) 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3146277030 learned_addr learned my addr 172.21.15.52:0/3146277030 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaffff640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587914f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3146277030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 msgr2=0x55858790ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 msgr2=0x558587914f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587914f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 -- 172.21.15.52:0/3146277030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585879107c0 con 0x5585879014a0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587914f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.718+0000 7fceaf7fe640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fcea0004770 tx=0x7fcea0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b8dfbb6df0122e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0069030 con 0x5585879014a0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcea0003af0 con 0x5585879014a0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea003c920 con 0x5585879014a0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcea0077050 con 0x5585879014a0 2024-09-19T09:35:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fceb8010740 10 client.20379 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558587986a30 con 0x5585879014a0 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea003c920 con 0x5585879014a0 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcea004a430 con 0x5585879014a0 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.719+0000 7fceb8010740 10 client.20379 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 10 client.20379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 20 client.20379 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558587987040 0x558587989430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 4 client.20379 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5585878fe5e0 con 0x558587987040 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558587987040 0x558587989430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fce8effd640 10 client.20379 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fcea6ffd640 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558587987040 0x558587989430 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47dcf82b58df0dbd server_cookie=5bc8f37edcb1c475 in_seq=0 out_seq=0 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fce8effd640 1 -- 172.21.15.52:0/3146277030 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5585878fe5e0 con 0x558587987040 2024-09-19T09:35:01.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fce8effd640 10 client.20379 handle_command_reply: tid=0 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.720+0000 7fceb8010740 1 client.20379 shutdown 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 msgr2=0x558587914a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fcea0004770 tx=0x7fcea0009260 comp rx=0 tx=0).stop 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 shutdown_connections 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558587987040 0x558587989430 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55858790c680 0x55858790ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558587901dc0 0x558587914f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 --2- 172.21.15.52:0/3146277030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585879014a0 0x558587914a10 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 >> 172.21.15.52:0/3146277030 conn(0x5585878fda30 msgr2=0x558587902ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fce8effd640 0 client.20379 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 shutdown_connections 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 1 -- 172.21.15.52:0/3146277030 wait complete. 2024-09-19T09:35:01.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb8010740 20 client.20379 trim_cache size 0 max 16384 2024-09-19T09:35:01.728 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:01.728 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:35:01.728 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:35:01.728 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 msgr2=0x7fce9c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 0x7fce9c0a5780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea00058d0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 msgr2=0x7fceb01997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.721+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fce9800e9f0 tx=0x7fce9800edf0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 shutdown_connections 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fce9c0a32c0 0x7fce9c0a5780 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb0105de0 0x7fceb01a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fceb0101e20 0x7fceb01997d0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 --2- 172.21.15.52:0/2679302569 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceb0101470 0x7fceb0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 >> 172.21.15.52:0/2679302569 conn(0x7fceb0077230 msgr2=0x7fceb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 shutdown_connections 2024-09-19T09:35:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:01.722+0000 7fceb5c37640 1 -- 172.21.15.52:0/2679302569 wait complete. 2024-09-19T09:35:01.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:01 smithi086 ceph-mon[34813]: pgmap v745: 97 pgs: 97 active+clean; 2.7 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:02.557 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:35:02.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:02.825 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 -- 172.21.15.52:0/2065356141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f898010c160 msgr2=0x7f898010e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 --2- 172.21.15.52:0/2065356141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f898010c160 0x7f898010e5f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f8978009ca0 tx=0x7f897802a950 comp rx=0 tx=0).stop 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 -- 172.21.15.52:0/2065356141 shutdown_connections 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 --2- 172.21.15.52:0/2065356141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f898010c160 0x7f898010e5f0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 --2- 172.21.15.52:0/2065356141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 0x7f898010bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 --2- 172.21.15.52:0/2065356141 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8980102dc0 0x7f89801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 -- 172.21.15.52:0/2065356141 >> 172.21.15.52:0/2065356141 conn(0x7f89800fc780 msgr2=0x7f89800feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 -- 172.21.15.52:0/2065356141 shutdown_connections 2024-09-19T09:35:03.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.339+0000 7f8985d45640 1 -- 172.21.15.52:0/2065356141 wait complete. 2024-09-19T09:35:03.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 Processor -- start 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 -- start start 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 0x7f898019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 0x7f898019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8980111f90 con 0x7f8980102dc0 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8980111e10 con 0x7f898010c160 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f8985d45640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8980112110 con 0x7f89801036e0 2024-09-19T09:35:03.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f897f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47978/0 (socket says 172.21.15.52:47978) 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f897f7fe640 1 -- 172.21.15.52:0/1743203217 learned_addr learned my addr 172.21.15.52:0/1743203217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.340+0000 7f897effd640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 0x7f898019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897ffff640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 0x7f898019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 -- 172.21.15.52:0/1743203217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 msgr2=0x7f898019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 0x7f898019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 -- 172.21.15.52:0/1743203217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 msgr2=0x7f898019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 0x7f898019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 -- 172.21.15.52:0/1743203217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898019f620 con 0x7f8980102dc0 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897ffff640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 0x7f898019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897f7fe640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f897000d950 tx=0x7f897000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:03.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970017030 con 0x7f8980102dc0 2024-09-19T09:35:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8970004020 con 0x7f8980102dc0 2024-09-19T09:35:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898019f910 con 0x7f8980102dc0 2024-09-19T09:35:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970005650 con 0x7f8980102dc0 2024-09-19T09:35:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.341+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89801a71f0 con 0x7f8980102dc0 2024-09-19T09:35:03.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.342+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89801031a0 con 0x7f8980102dc0 2024-09-19T09:35:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.343+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f89700041d0 con 0x7f8980102dc0 2024-09-19T09:35:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.344+0000 7f897cff9640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.344+0000 7f897effd640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.344+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f89700cfa20 con 0x7f8980102dc0 2024-09-19T09:35:03.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.345+0000 7f897effd640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f89800febc0 tx=0x7f8974009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:03.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.347+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8970024330 con 0x7f8980102dc0 2024-09-19T09:35:03.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.561+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f898019b9d0 con 0x7f8980102dc0 2024-09-19T09:35:03.563 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:03 smithi052 ceph-mon[30947]: pgmap v746: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.562+0000 7f897cff9640 1 -- 172.21.15.52:0/1743203217 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f897009c6c0 con 0x7f8980102dc0 2024-09-19T09:35:03.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:35:03.564 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:35:03.564 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 msgr2=0x7f89680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f89800febc0 tx=0x7f8974009110 comp rx=0 tx=0).stop 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 msgr2=0x7f898019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f897000d950 tx=0x7f897000dd50 comp rx=0 tx=0).stop 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 shutdown_connections 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f898010c160 0x7f898019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89801036e0 0x7f898019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 --2- 172.21.15.52:0/1743203217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8980102dc0 0x7f898019a670 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 >> 172.21.15.52:0/1743203217 conn(0x7f89800fc780 msgr2=0x7f8980100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.564+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 shutdown_connections 2024-09-19T09:35:03.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:03.565+0000 7f8985d45640 1 -- 172.21.15.52:0/1743203217 wait complete. 2024-09-19T09:35:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:03 smithi169 ceph-mon[35454]: pgmap v746: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:03 smithi086 ceph-mon[34813]: pgmap v746: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:04.315 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:35:04.579 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:04.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1743203217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:04.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:04 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1743203217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:04.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:04 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1743203217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:05.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- 172.21.15.52:0/555242017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc101280 msgr2=0x7fe5bc10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 --2- 172.21.15.52:0/555242017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc101280 0x7fe5bc10df40 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:05.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- 172.21.15.52:0/555242017 shutdown_connections 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 --2- 172.21.15.52:0/555242017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 --2- 172.21.15.52:0/555242017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc101280 0x7fe5bc10df40 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 --2- 172.21.15.52:0/555242017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- 172.21.15.52:0/555242017 >> 172.21.15.52:0/555242017 conn(0x7fe5bc0fc7a0 msgr2=0x7fe5bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- 172.21.15.52:0/555242017 shutdown_connections 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- 172.21.15.52:0/555242017 wait complete. 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 Processor -- start 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.072+0000 7fe5c382b640 1 -- start start 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc101280 0x7fe5bc1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc114260 con 0x7fe5bc1008d0 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1140e0 con 0x7fe5bc101280 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1143e0 con 0x7fe5bc10e480 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48000/0 (socket says 172.21.15.52:48000) 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 -- 172.21.15.52:0/802038992 learned_addr learned my addr 172.21.15.52:0/802038992 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc101280 0x7fe5bc1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 -- 172.21.15.52:0/802038992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 msgr2=0x7fe5bc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 -- 172.21.15.52:0/802038992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc101280 msgr2=0x7fe5bc1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc101280 0x7fe5bc1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 -- 172.21.15.52:0/802038992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5bc19aec0 con 0x7fe5bc1008d0 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b4a0 tx=0x7fe5b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5b27fc640 1 -- 172.21.15.52:0/802038992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8014070 con 0x7fe5bc1008d0 2024-09-19T09:35:05.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5b27fc640 1 -- 172.21.15.52:0/802038992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5b8010af0 con 0x7fe5bc1008d0 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5bc19b1b0 con 0x7fe5bc1008d0 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5b27fc640 1 -- 172.21.15.52:0/802038992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8017d10 con 0x7fe5bc1008d0 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.073+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5bc1a7500 con 0x7fe5bc1008d0 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5b27fc640 1 -- 172.21.15.52:0/802038992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe5b8017070 con 0x7fe5bc1008d0 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 Processor -- start 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 -- start start 2024-09-19T09:35:05.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9508090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9508a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ff946e2f0 con 0x555ff9513370 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ff9415cf0 con 0x555ff9509b40 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5b27fc640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 0x7fe5a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.076+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ff946a2b0 con 0x555ff95085d0 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 0x7fe5a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48002/0 (socket says 172.21.15.52:48002) 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/1746105750 learned_addr learned my addr 172.21.15.52:0/1746105750 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5b27fc640 1 -- 172.21.15.52:0/802038992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe5b80ced90 con 0x7fe5bc1008d0 2024-09-19T09:35:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9508a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9508090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/1746105750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 msgr2=0x555ff9508a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9508a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/1746105750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 msgr2=0x555ff9508090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9508090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/1746105750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff93fa3a0 con 0x555ff9513370 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 0x7fe5a80a5780 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400afd0 tx=0x7fe5b400ad00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18ab6e5adb301bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.077+0000 7fe5a77fe640 1 -- 172.21.15.52:0/1746105750 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac03f070 con 0x555ff9513370 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5a77fe640 1 -- 172.21.15.52:0/1746105750 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac0035f0 con 0x555ff9513370 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5a77fe640 1 -- 172.21.15.52:0/1746105750 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac035070 con 0x555ff9513370 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1746105750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 msgr2=0x555ff9515760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac031660 comp rx=0 tx=0).stop 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1746105750 shutdown_connections 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9515760 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9508a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1746105750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9508090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1746105750 >> 172.21.15.52:0/1746105750 conn(0x555ff94d1310 msgr2=0x555ff9504c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1746105750 shutdown_connections 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.078+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1746105750 wait complete. 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 -- start start 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 Processor -- start 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9512d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9510010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555ff9516010 con 0x555ff9513370 2024-09-19T09:35:05.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555ff9429060 con 0x555ff9509b40 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555ff9516190 con 0x555ff95085d0 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c5c04740 10 client.0 _ll_register_callbacks cb 0x555ff917c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c1dc8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c1dc8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48008/0 (socket says 172.21.15.52:48008) 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.079+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/1129818817 learned_addr learned my addr 172.21.15.52:0/1129818817 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9512d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9510010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 msgr2=0x555ff9512d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9512d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/1129818817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 msgr2=0x555ff9510010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9510010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/1129818817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff91df3c0 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9510010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9512d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4012a20 tx=0x7fe5b40012a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbef680775734a58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4023070 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe5b400fad0 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ac0035f0 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5b402f050 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c5c04740 10 client.20397 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.080+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ff9521ab0 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac0035f0 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe5b401e040 con 0x555ff9513370 2024-09-19T09:35:05.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 10 client.20397 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 10 client.20397 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 20 client.20397 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff9522f80 0x555ff9525440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 4 client.20397 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ff947b860 con 0x555ff9522f80 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff9522f80 0x555ff9525440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff9522f80 0x555ff9525440 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdf5d86fd6d54421 server_cookie=a70974f99f9a3526 in_seq=0 out_seq=0 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.081+0000 7fe5a4ff9640 10 client.20397 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/1129818817 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ff947b860 con 0x555ff9522f80 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5a4ff9640 10 client.20397 handle_command_reply: tid=0 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 client.20397 shutdown 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 msgr2=0x555ff9510600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4012a20 tx=0x7fe5b40012a0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 shutdown_connections 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff9522f80 0x555ff9525440 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff9510600 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9509b40 0x555ff9510010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5a4ff9640 0 client.20397 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/1129818817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9512d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.082+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 >> 172.21.15.52:0/1129818817 conn(0x555ff94d1310 msgr2=0x555ff950a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.083+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 shutdown_connections 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.083+0000 7fe5c5c04740 1 -- 172.21.15.52:0/1129818817 wait complete. 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.083+0000 7fe5c5c04740 20 client.20397 trim_cache size 0 max 16384 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 Processor -- start 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 -- start start 2024-09-19T09:35:05.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9511f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 0x555ff9514ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1b23e0 con 0x555ff9509b40 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1afcb0 con 0x555ff9513370 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1adb00 con 0x555ff95085d0 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48010/0 (socket says 172.21.15.52:48010) 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/3715330623 learned_addr learned my addr 172.21.15.52:0/3715330623 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 0x555ff9514ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/3715330623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 msgr2=0x555ff9511f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9511f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/3715330623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 msgr2=0x555ff9514ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 0x555ff9514ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c0dc6640 1 -- 172.21.15.52:0/3715330623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff95130d0 con 0x555ff9509b40 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.096+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 0x555ff9514ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af9bc09f76acc65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5a6ffd640 1 -- 172.21.15.52:0/3715330623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac035050 con 0x555ff9509b40 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5a6ffd640 1 -- 172.21.15.52:0/3715330623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac047070 con 0x555ff9509b40 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5a6ffd640 1 -- 172.21.15.52:0/3715330623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac03f040 con 0x555ff9509b40 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 -- 172.21.15.52:0/3715330623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 msgr2=0x555ff9514760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009900 tx=0x7fe5ac0097c0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 -- 172.21.15.52:0/3715330623 shutdown_connections 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff9513370 0x555ff9514ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9509b40 0x555ff9514760 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/3715330623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff95085d0 0x555ff9511f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 -- 172.21.15.52:0/3715330623 >> 172.21.15.52:0/3715330623 conn(0x555ff94d1310 msgr2=0x555ff9511870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 -- 172.21.15.52:0/3715330623 shutdown_connections 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.097+0000 7fe5c5c04740 1 -- 172.21.15.52:0/3715330623 wait complete. 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 -- start start 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 Processor -- start 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 0x555ff951b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff9509b40 0x555ff951b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1ae170 con 0x555ff9513370 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1af5e0 con 0x555ff95085d0 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe5bc1ae840 con 0x555ff9509b40 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c5c04740 10 client.0 _ll_register_callbacks cb 0x7fe5b400a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c1dc8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c1dc8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48018/0 (socket says 172.21.15.52:48018) 2024-09-19T09:35:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.098+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/924636118 learned_addr learned my addr 172.21.15.52:0/924636118 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c0dc6640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff9509b40 0x555ff951b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 0x555ff951b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff9509b40 msgr2=0x555ff951b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff9509b40 0x555ff951b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/924636118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 msgr2=0x555ff951b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 0x555ff951b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 -- 172.21.15.52:0/924636118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff9516a50 con 0x555ff9513370 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 0x555ff951b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c1dc8640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4012a20 tx=0x7fe5b400aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac96394d42c1b57a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4037020 con 0x555ff9513370 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5ac047070 con 0x555ff9513370 2024-09-19T09:35:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe5b400fad0 con 0x555ff9513370 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe5b4042050 con 0x555ff9513370 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c5c04740 10 client.20403 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.099+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555ff958e590 con 0x555ff9513370 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ac047070 con 0x555ff9513370 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe5b401e040 con 0x555ff9513370 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 10 client.20403 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 10 client.20403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 20 client.20403 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff958ec40 0x555ff9591060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 4 client.20403 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ff9475d70 con 0x555ff958ec40 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.100+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff958ec40 0x555ff9591060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c15c7640 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff958ec40 0x555ff9591060 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6779004d54232fa3 server_cookie=a10bc5b0939328e7 in_seq=0 out_seq=0 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5a4ff9640 10 client.20403 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5a4ff9640 1 -- 172.21.15.52:0/924636118 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ff9475d70 con 0x555ff958ec40 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5a4ff9640 10 client.20403 handle_command_reply: tid=0 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 client.20403 shutdown 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 msgr2=0x555ff95163e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4012a20 tx=0x7fe5b400aa50 comp rx=0 tx=0).stop 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 shutdown_connections 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x555ff958ec40 0x555ff9591060 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555ff9513370 0x555ff95163e0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555ff9509b40 0x555ff951b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 --2- 172.21.15.52:0/924636118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555ff95085d0 0x555ff951b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5a4ff9640 0 client.20403 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 >> 172.21.15.52:0/924636118 conn(0x555ff94d1310 msgr2=0x555ff9512090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 shutdown_connections 2024-09-19T09:35:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 1 -- 172.21.15.52:0/924636118 wait complete. 2024-09-19T09:35:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.101+0000 7fe5c5c04740 20 client.20403 trim_cache size 0 max 16384 2024-09-19T09:35:05.121 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 msgr2=0x7fe5a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 0x7fe5a80a5780 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400afd0 tx=0x7fe5b400ad00 comp rx=0 tx=0).stop 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 msgr2=0x7fe5bc1a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b4a0 tx=0x7fe5b800b960 comp rx=0 tx=0).stop 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 shutdown_connections 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5a80a32c0 0x7fe5a80a5780 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe5bc10e480 0x7fe5bc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe5bc101280 0x7fe5bc1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 --2- 172.21.15.52:0/802038992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5bc1008d0 0x7fe5bc1a0580 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:05.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 >> 172.21.15.52:0/802038992 conn(0x7fe5bc0fc7a0 msgr2=0x7fe5bc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:05.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 shutdown_connections 2024-09-19T09:35:05.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:05.102+0000 7fe5c382b640 1 -- 172.21.15.52:0/802038992 wait complete. 2024-09-19T09:35:05.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:05 smithi052 ceph-mon[30947]: pgmap v747: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:05 smithi169 ceph-mon[35454]: pgmap v747: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:05 smithi086 ceph-mon[34813]: pgmap v747: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:05.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:35:06.134 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 -- 172.21.15.52:0/3419702929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740106a80 msgr2=0x7f4740106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 --2- 172.21.15.52:0/3419702929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740106a80 0x7f4740106e60 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f4730009930 tx=0x7f473002a420 comp rx=0 tx=0).stop 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 -- 172.21.15.52:0/3419702929 shutdown_connections 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 --2- 172.21.15.52:0/3419702929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740101420 0x7f474010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 --2- 172.21.15.52:0/3419702929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 0x7f4740100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 --2- 172.21.15.52:0/3419702929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740106a80 0x7f4740106e60 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.596+0000 7f4745de8640 1 -- 172.21.15.52:0/3419702929 >> 172.21.15.52:0/3419702929 conn(0x7f47400fc7a0 msgr2=0x7f47400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 -- 172.21.15.52:0/3419702929 shutdown_connections 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 -- 172.21.15.52:0/3419702929 wait complete. 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 Processor -- start 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 -- start start 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 0x7f474010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.597+0000 7f4745de8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740106a80 0x7f474010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4740111fa0 con 0x7f4740101420 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4740111e20 con 0x7f4740106a80 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4740112120 con 0x7f4740100a80 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48026/0 (socket says 172.21.15.52:48026) 2024-09-19T09:35:06.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 -- 172.21.15.52:0/309804598 learned_addr learned my addr 172.21.15.52:0/309804598 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473f7fe640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 0x7f474010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473ffff640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740106a80 0x7f474010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 -- 172.21.15.52:0/309804598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 msgr2=0x7f474010e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 0x7f474010e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 -- 172.21.15.52:0/309804598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740106a80 msgr2=0x7f474010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740106a80 0x7f474010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 -- 172.21.15.52:0/309804598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47401a68c0 con 0x7f4740101420 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473effd640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f473400d950 tx=0x7f473400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473cff9640 1 -- 172.21.15.52:0/309804598 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734017070 con 0x7f4740101420 2024-09-19T09:35:06.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473cff9640 1 -- 172.21.15.52:0/309804598 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4734009c30 con 0x7f4740101420 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47401a6bb0 con 0x7f4740101420 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f473cff9640 1 -- 172.21.15.52:0/309804598 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473400f6b0 con 0x7f4740101420 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.598+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47401a70f0 con 0x7f4740101420 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f473cff9640 1 -- 172.21.15.52:0/309804598 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f47340109d0 con 0x7f4740101420 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 Processor -- start 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 -- start start 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558647d802f0 con 0x558647e1a5d0 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558647d27cf0 con 0x558647e25370 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f47481c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558647d7c2b0 con 0x558647e1bb40 2024-09-19T09:35:06.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f473cff9640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 0x7f47280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f473f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.601+0000 7f473f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48038/0 (socket says 172.21.15.52:48038) 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 -- 172.21.15.52:0/1535779715 learned_addr learned my addr 172.21.15.52:0/1535779715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473ffff640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473ffff640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 0x7f47280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473cff9640 1 -- 172.21.15.52:0/309804598 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f47340cf530 con 0x7f4740101420 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473effd640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e27760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 -- 172.21.15.52:0/1535779715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 msgr2=0x558647e1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 -- 172.21.15.52:0/1535779715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 msgr2=0x558647e27760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e27760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 -- 172.21.15.52:0/1535779715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558647d0c3a0 con 0x558647e1a5d0 2024-09-19T09:35:06.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473ffff640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f4730009930 tx=0x7f4730031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30679162fd5871d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f473ffff640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 0x7f47280a5700 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47380077f0 tx=0x7f4738007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f4725ffb640 1 -- 172.21.15.52:0/1535779715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730040070 con 0x558647e1a5d0 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f4725ffb640 1 -- 172.21.15.52:0/1535779715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4730005020 con 0x558647e1a5d0 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.602+0000 7f4725ffb640 1 -- 172.21.15.52:0/1535779715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730035040 con 0x558647e1a5d0 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- 172.21.15.52:0/1535779715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 msgr2=0x558647e1aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f4730009930 tx=0x7f4730031630 comp rx=0 tx=0).stop 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- 172.21.15.52:0/1535779715 shutdown_connections 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e1aa10 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 --2- 172.21.15.52:0/1535779715 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- 172.21.15.52:0/1535779715 >> 172.21.15.52:0/1535779715 conn(0x558647de3310 msgr2=0x558647e16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- 172.21.15.52:0/1535779715 shutdown_connections 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- 172.21.15.52:0/1535779715 wait complete. 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.603+0000 7f47481c1740 1 -- start start 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 Processor -- start 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e21f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e22450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558647e28010 con 0x558647e1a5d0 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558647d3b060 con 0x558647e25370 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558647e28190 con 0x558647e1bb40 2024-09-19T09:35:06.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f47481c1740 10 client.0 _ll_register_callbacks cb 0x558647a8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48048/0 (socket says 172.21.15.52:48048) 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 -- 172.21.15.52:0/3854082027 learned_addr learned my addr 172.21.15.52:0/3854082027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473effd640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e21f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473ffff640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e22450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 -- 172.21.15.52:0/3854082027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 msgr2=0x558647e21f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e21f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 -- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 msgr2=0x558647e22450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e22450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.604+0000 7f473f7fe640 1 -- 172.21.15.52:0/3854082027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558647af13c0 con 0x558647e1a5d0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f473f7fe640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4730006010 tx=0x7f4730004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5c5686dcf9d072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4730040070 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f47300053e0 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4730005020 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4730053030 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 10 client.20415 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558647e339c0 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4730005020 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f473003c930 con 0x558647e1a5d0 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 10 client.20415 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 10 client.20415 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 20 client.20415 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:06.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e34d10 0x558647e37100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 4 client.20415 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.605+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558647d8d860 con 0x558647e34d10 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.606+0000 7f473effd640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e34d10 0x558647e37100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.606+0000 7f473effd640 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e34d10 0x558647e37100 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8d10913e415ad24 server_cookie=df07c86f73d473fe in_seq=0 out_seq=0 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.606+0000 7f471effd640 10 client.20415 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f471effd640 1 -- 172.21.15.52:0/3854082027 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558647d8d860 con 0x558647e34d10 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f471effd640 10 client.20415 handle_command_reply: tid=0 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 client.20415 shutdown 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 msgr2=0x558647e24c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f4730006010 tx=0x7f4730004770 comp rx=0 tx=0).stop 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 shutdown_connections 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e34d10 0x558647e37100 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e25370 0x558647e22450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f471effd640 0 client.20415 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1bb40 0x558647e21f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 --2- 172.21.15.52:0/3854082027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1a5d0 0x558647e24c60 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 >> 172.21.15.52:0/3854082027 conn(0x558647de3310 msgr2=0x558647e1c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 shutdown_connections 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 1 -- 172.21.15.52:0/3854082027 wait complete. 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.607+0000 7f47481c1740 20 client.20415 trim_cache size 0 max 16384 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 Processor -- start 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 -- start start 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1a5d0 0x558647e312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1bb40 0x558647e26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47401b2180 con 0x558647e25370 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f47401afa50 con 0x558647e1bb40 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.620+0000 7f47481c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47401ad8a0 con 0x558647e1a5d0 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48058/0 (socket says 172.21.15.52:48058) 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 -- 172.21.15.52:0/1525052452 learned_addr learned my addr 172.21.15.52:0/1525052452 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1a5d0 0x558647e312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 -- 172.21.15.52:0/1525052452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1a5d0 msgr2=0x558647e312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1a5d0 0x558647e312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 -- 172.21.15.52:0/1525052452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1bb40 msgr2=0x558647e26760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1bb40 0x558647e26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 -- 172.21.15.52:0/1525052452 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558647e24fd0 con 0x558647e25370 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.621+0000 7f473ffff640 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f4738007240 tx=0x7f47380078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518775b5e26582d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47257fa640 1 -- 172.21.15.52:0/1525052452 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738003e40 con 0x558647e25370 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47257fa640 1 -- 172.21.15.52:0/1525052452 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f473802c070 con 0x558647e25370 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47257fa640 1 -- 172.21.15.52:0/1525052452 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738004860 con 0x558647e25370 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 -- 172.21.15.52:0/1525052452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 msgr2=0x558647e26ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f4738007240 tx=0x7f47380078c0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 -- 172.21.15.52:0/1525052452 shutdown_connections 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e25370 0x558647e26ca0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1bb40 0x558647e26760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 --2- 172.21.15.52:0/1525052452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e1a5d0 0x558647e312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.622+0000 7f47481c1740 1 -- 172.21.15.52:0/1525052452 >> 172.21.15.52:0/1525052452 conn(0x558647de3310 msgr2=0x558647e15d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- 172.21.15.52:0/1525052452 shutdown_connections 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- 172.21.15.52:0/1525052452 wait complete. 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- start start 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 Processor -- start 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1a5d0 0x558647e2dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e25370 0x558647e3c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47401adf10 con 0x558647e1bb40 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f47401af380 con 0x558647e1a5d0 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f47401ae5e0 con 0x558647e25370 2024-09-19T09:35:06.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.623+0000 7f47481c1740 10 client.0 _ll_register_callbacks cb 0x7f4730005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48064/0 (socket says 172.21.15.52:48064) 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 -- 172.21.15.52:0/1933283308 learned_addr learned my addr 172.21.15.52:0/1933283308 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473ffff640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e25370 0x558647e3c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1a5d0 0x558647e2dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 -- 172.21.15.52:0/1933283308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e25370 msgr2=0x558647e3c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e25370 0x558647e3c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 -- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1a5d0 msgr2=0x558647e2dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1a5d0 0x558647e2dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 -- 172.21.15.52:0/1933283308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558647e3cda0 con 0x558647e1bb40 2024-09-19T09:35:06.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f473effd640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f473409b880 tx=0x7f473400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c22dffc7ab45998 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f471effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340b4070 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4734099e80 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f473802c070 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4734020040 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f47481c1740 10 client.20421 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.624+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558647e9f700 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f473802c070 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f47340cf0e0 con 0x558647e1bb40 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 10 client.20421 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 10 client.20421 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:06.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 20 client.20421 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e9fe80 0x558647ea22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 4 client.20421 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558647d87d70 con 0x558647e9fe80 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e9fe80 0x558647ea22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f471effd640 10 client.20421 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.625+0000 7f473f7fe640 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e9fe80 0x558647ea22a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc566b20a9cfa8eb server_cookie=ec14915f445966c1 in_seq=0 out_seq=0 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f471effd640 1 -- 172.21.15.52:0/1933283308 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558647d87d70 con 0x558647e9fe80 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f471effd640 10 client.20421 handle_command_reply: tid=0 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 client.20421 shutdown 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 msgr2=0x558647e3c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f473409b880 tx=0x7f473400bf60 comp rx=0 tx=0).stop 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 shutdown_connections 2024-09-19T09:35:06.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558647e25370 0x558647e3c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558647e1bb40 0x558647e3c030 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x558647e9fe80 0x558647ea22a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 --2- 172.21.15.52:0/1933283308 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558647e1a5d0 0x558647e2dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f471effd640 0 client.20421 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 >> 172.21.15.52:0/1933283308 conn(0x558647de3310 msgr2=0x558647e206b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 shutdown_connections 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 1 -- 172.21.15.52:0/1933283308 wait complete. 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.626+0000 7f47481c1740 20 client.20421 trim_cache size 0 max 16384 2024-09-19T09:35:06.647 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:06.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 msgr2=0x7f47280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 0x7f47280a5700 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47380077f0 tx=0x7f4738007520 comp rx=0 tx=0).stop 2024-09-19T09:35:06.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 msgr2=0x7f474010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f473400d950 tx=0x7f473400de10 comp rx=0 tx=0).stop 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 shutdown_connections 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4740106a80 0x7f474010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4740101420 0x7f474010e920 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f47280a3240 0x7f47280a5700 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 --2- 172.21.15.52:0/309804598 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4740100a80 0x7f474010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 >> 172.21.15.52:0/309804598 conn(0x7f47400fc7a0 msgr2=0x7f47400fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 shutdown_connections 2024-09-19T09:35:06.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:06.627+0000 7f4745de8640 1 -- 172.21.15.52:0/309804598 wait complete. 2024-09-19T09:35:07.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:35:07.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:07 smithi052 ceph-mon[30947]: pgmap v748: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:35:07.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:07 smithi169 ceph-mon[35454]: pgmap v748: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:35:07.711 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:07.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:07 smithi086 ceph-mon[34813]: pgmap v748: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 -- 172.21.15.52:0/311325809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574106a80 msgr2=0x7f0574106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 --2- 172.21.15.52:0/311325809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574106a80 0x7f0574106e60 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f0568009930 tx=0x7f056802a420 comp rx=0 tx=0).stop 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 -- 172.21.15.52:0/311325809 shutdown_connections 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 --2- 172.21.15.52:0/311325809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574101420 0x7f057410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 --2- 172.21.15.52:0/311325809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 0x7f0574100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 --2- 172.21.15.52:0/311325809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574106a80 0x7f0574106e60 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 -- 172.21.15.52:0/311325809 >> 172.21.15.52:0/311325809 conn(0x7f05740fc7a0 msgr2=0x7f05740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 -- 172.21.15.52:0/311325809 shutdown_connections 2024-09-19T09:35:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.147+0000 7f057b240640 1 -- 172.21.15.52:0/311325809 wait complete. 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 Processor -- start 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 -- start start 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 0x7f0574198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574106a80 0x7f057419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0574111fa0 con 0x7f0574101420 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0574111e20 con 0x7f0574100a80 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.148+0000 7f057b240640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0574112120 con 0x7f0574106a80 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34116/0 (socket says 172.21.15.52:34116) 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 -- 172.21.15.52:0/1371382776 learned_addr learned my addr 172.21.15.52:0/1371382776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0578fdc640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 0x7f0574198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f05797dd640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574106a80 0x7f057419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 -- 172.21.15.52:0/1371382776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574106a80 msgr2=0x7f057419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574106a80 0x7f057419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 -- 172.21.15.52:0/1371382776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 msgr2=0x7f0574198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 0x7f0574198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 -- 172.21.15.52:0/1371382776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057419d430 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0573fff640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f056000d950 tx=0x7f056000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0571ffb640 1 -- 172.21.15.52:0/1371382776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560017070 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0571ffb640 1 -- 172.21.15.52:0/1371382776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0560009c30 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057419d720 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.149+0000 7f0571ffb640 1 -- 172.21.15.52:0/1371382776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056000f6b0 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.150+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05741a5000 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f0571ffb640 1 -- 172.21.15.52:0/1371382776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f05600109d0 con 0x7f0574101420 2024-09-19T09:35:08.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 Processor -- start 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 -- start start 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f0571ffb640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 0x7f05640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1507a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 0x556ce1514760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ce146d2f0 con 0x556ce1512370 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556ce1414cf0 con 0x556ce1508b40 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f057d619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556ce14692b0 con 0x556ce15075d0 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f05797dd640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 0x7f05640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.152+0000 7f0571ffb640 1 -- 172.21.15.52:0/1371382776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f05600cf580 con 0x7f0574101420 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f05797dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 0x556ce1514760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:56560/0 (socket says 172.21.15.52:56560) 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 -- 172.21.15.52:0/3840459485 learned_addr learned my addr 172.21.15.52:0/3840459485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f05797dd640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 0x7f05640a5780 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f056c0092f0 tx=0x7f056c014a50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 -- 172.21.15.52:0/3840459485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 msgr2=0x556ce1507a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1507a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 -- 172.21.15.52:0/3840459485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 msgr2=0x556ce1514760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 0x556ce1514760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 -- 172.21.15.52:0/3840459485 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce13f93a0 con 0x556ce1508b40 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f05797dd640 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 0x556ce1514760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f0578fdc640 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f056802a940 tx=0x7f0568005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c776f4d387ae1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.153+0000 7f055effd640 1 -- 172.21.15.52:0/3840459485 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568040070 con 0x556ce1508b40 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f055effd640 1 -- 172.21.15.52:0/3840459485 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0568031930 con 0x556ce1508b40 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f055effd640 1 -- 172.21.15.52:0/3840459485 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568035040 con 0x556ce1508b40 2024-09-19T09:35:08.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 -- 172.21.15.52:0/3840459485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 msgr2=0x556ce1507090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f056802a940 tx=0x7f0568005c00 comp rx=0 tx=0).stop 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 -- 172.21.15.52:0/3840459485 shutdown_connections 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1512370 0x556ce1514760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1507a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 --2- 172.21.15.52:0/3840459485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1508b40 0x556ce1507090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 -- 172.21.15.52:0/3840459485 >> 172.21.15.52:0/3840459485 conn(0x556ce14d0310 msgr2=0x556ce1503c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 -- 172.21.15.52:0/3840459485 shutdown_connections 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.154+0000 7f057d619740 1 -- 172.21.15.52:0/3840459485 wait complete. 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 -- start start 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 Processor -- start 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1511bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1512370 0x556ce150f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ce1515010 con 0x556ce1508b40 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556ce1428060 con 0x556ce1512370 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556ce1515190 con 0x556ce15075d0 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f057d619740 10 client.0 _ll_register_callbacks cb 0x556ce117b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34132/0 (socket says 172.21.15.52:34132) 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f0573fff640 1 -- 172.21.15.52:0/967894990 learned_addr learned my addr 172.21.15.52:0/967894990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.155+0000 7f0578fdc640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1511bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f05797dd640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1512370 0x556ce150f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 -- 172.21.15.52:0/967894990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 msgr2=0x556ce1511bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1511bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 -- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1512370 msgr2=0x556ce150f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1512370 0x556ce150f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 -- 172.21.15.52:0/967894990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce11de3c0 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0573fff640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f056009bab0 tx=0x7f056009b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feda8f1c026c89a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0553fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560020070 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0560098190 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0568031930 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05600134b0 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f057d619740 10 client.20433 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ce1520a00 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.156+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0568031930 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0560012480 con 0x556ce1508b40 2024-09-19T09:35:08.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 10 client.20433 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 10 client.20433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 20 client.20433 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1521e60 0x556ce1524250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 4 client.20433 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ce147a860 con 0x556ce1521e60 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f0578fdc640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1521e60 0x556ce1524250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f0578fdc640 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1521e60 0x556ce1524250 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa2bec85aae1935 server_cookie=478280357355bfea in_seq=0 out_seq=0 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.157+0000 7f0553fff640 10 client.20433 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f0553fff640 1 -- 172.21.15.52:0/967894990 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ce147a860 con 0x556ce1521e60 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f0553fff640 10 client.20433 handle_command_reply: tid=0 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 client.20433 shutdown 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 msgr2=0x556ce150eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f056009bab0 tx=0x7f056009b720 comp rx=0 tx=0).stop 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 shutdown_connections 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1521e60 0x556ce1524250 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce1512370 0x556ce150f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce150eef0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 --2- 172.21.15.52:0/967894990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce1511bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f0553fff640 0 client.20433 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.158+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 >> 172.21.15.52:0/967894990 conn(0x556ce14d0310 msgr2=0x556ce1509960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.159+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 shutdown_connections 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.159+0000 7f057d619740 1 -- 172.21.15.52:0/967894990 wait complete. 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.159+0000 7f057d619740 20 client.20433 trim_cache size 0 max 16384 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 Processor -- start 2024-09-19T09:35:08.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 -- start start 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce151e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce150a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05741b0010 con 0x556ce1508b40 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05741ad8e0 con 0x556ce14d0310 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f057d619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05741ab730 con 0x556ce15075d0 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34144/0 (socket says 172.21.15.52:34144) 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 -- 172.21.15.52:0/984084214 learned_addr learned my addr 172.21.15.52:0/984084214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f0578fdc640 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce151e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 -- 172.21.15.52:0/984084214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 msgr2=0x556ce150a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce150a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 -- 172.21.15.52:0/984084214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 msgr2=0x556ce151e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce151e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f05797dd640 1 -- 172.21.15.52:0/984084214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce150d440 con 0x556ce1508b40 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.172+0000 7f0578fdc640 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce151e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f05797dd640 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f056c005fd0 tx=0x7f056c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ad12ab0898a635 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f055e7fc640 1 -- 172.21.15.52:0/984084214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c021bd0 con 0x556ce1508b40 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f055e7fc640 1 -- 172.21.15.52:0/984084214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f056c021d70 con 0x556ce1508b40 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f055e7fc640 1 -- 172.21.15.52:0/984084214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c02be60 con 0x556ce1508b40 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 -- 172.21.15.52:0/984084214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 msgr2=0x556ce1529b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f056c005fd0 tx=0x7f056c01d000 comp rx=0 tx=0).stop 2024-09-19T09:35:08.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 -- 172.21.15.52:0/984084214 shutdown_connections 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce1508b40 0x556ce1529b20 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce15075d0 0x556ce150a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 --2- 172.21.15.52:0/984084214 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce151e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 -- 172.21.15.52:0/984084214 >> 172.21.15.52:0/984084214 conn(0x556ce150f590 msgr2=0x556ce150dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 -- 172.21.15.52:0/984084214 shutdown_connections 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.173+0000 7f057d619740 1 -- 172.21.15.52:0/984084214 wait complete. 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 -- start start 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 Processor -- start 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce15163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 0x556ce1516e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05741abda0 con 0x556ce15075d0 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05741ad210 con 0x556ce14d0310 2024-09-19T09:35:08.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05741ac470 con 0x556ce1508b40 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f057d619740 10 client.0 _ll_register_callbacks cb 0x7f0560097eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f0573fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34156/0 (socket says 172.21.15.52:34156) 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f0573fff640 1 -- 172.21.15.52:0/113567742 learned_addr learned my addr 172.21.15.52:0/113567742 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.174+0000 7f0578fdc640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce15163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f05797dd640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 0x556ce1516e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 -- 172.21.15.52:0/113567742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 msgr2=0x556ce1516e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 0x556ce1516e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 -- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 msgr2=0x556ce15163c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce15163c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 -- 172.21.15.52:0/113567742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce158bcf0 con 0x556ce15075d0 2024-09-19T09:35:08.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f05797dd640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 0x556ce1516e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0573fff640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f0560099dd0 tx=0x7f056009b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dc8fcdb15a0bad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0553fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560020070 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f05600ba4e0 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f056c021d70 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0560009de0 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f057d619740 10 client.20439 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.175+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556ce158cfb0 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f056c021d70 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f05600861b0 con 0x556ce15075d0 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 10 client.20439 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 10 client.20439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:08.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 20 client.20439 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1512370 0x556ce158f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 4 client.20439 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ce1474d70 con 0x556ce1512370 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0578fdc640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1512370 0x556ce158f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0578fdc640 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1512370 0x556ce158f4f0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3385e4f86c4732 server_cookie=7978f6560306fbb4 in_seq=0 out_seq=0 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0553fff640 10 client.20439 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0553fff640 1 -- 172.21.15.52:0/113567742 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ce1474d70 con 0x556ce1512370 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.176+0000 7f0553fff640 10 client.20439 handle_command_reply: tid=0 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 client.20439 shutdown 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 msgr2=0x556ce1516900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f0560099dd0 tx=0x7f056009b720 comp rx=0 tx=0).stop 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 shutdown_connections 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556ce1512370 0x556ce158f4f0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556ce1508b40 0x556ce1516e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ce15075d0 0x556ce1516900 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f0553fff640 0 client.20439 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 --2- 172.21.15.52:0/113567742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556ce14d0310 0x556ce15163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 >> 172.21.15.52:0/113567742 conn(0x556ce150f590 msgr2=0x556ce150dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 shutdown_connections 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 1 -- 172.21.15.52:0/113567742 wait complete. 2024-09-19T09:35:08.207 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057d619740 20 client.20439 trim_cache size 0 max 16384 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 msgr2=0x7f05640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 0x7f05640a5780 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f056c0092f0 tx=0x7f056c014a50 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 msgr2=0x7f05741989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f056000d950 tx=0x7f056000de10 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 shutdown_connections 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.177+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f05640a32c0 0x7f05640a5780 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0574106a80 0x7f057419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0574101420 0x7f05741989c0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 --2- 172.21.15.52:0/1371382776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0574100a80 0x7f0574198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 >> 172.21.15.52:0/1371382776 conn(0x7f05740fc7a0 msgr2=0x7f05740fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 shutdown_connections 2024-09-19T09:35:08.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:08.178+0000 7f057b240640 1 -- 172.21.15.52:0/1371382776 wait complete. 2024-09-19T09:35:08.669 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 -- 172.21.15.52:0/1084661785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4101b60 msgr2=0x7f90c4101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/1084661785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4101b60 0x7f90c4101f60 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009900 tx=0x7f90b402a410 comp rx=0 tx=0).stop 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 -- 172.21.15.52:0/1084661785 shutdown_connections 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/1084661785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/1084661785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4102d50 0x7f90c41031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/1084661785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4101b60 0x7f90c4101f60 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 -- 172.21.15.52:0/1084661785 >> 172.21.15.52:0/1084661785 conn(0x7f90c40fd2e0 msgr2=0x7f90c40ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 -- 172.21.15.52:0/1084661785 shutdown_connections 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.666+0000 7f90c9d4b640 1 -- 172.21.15.52:0/1084661785 wait complete. 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 Processor -- start 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 -- start start 2024-09-19T09:35:08.670 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4101b60 0x7f90c4197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90c410d7e0 con 0x7f90c4102d50 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90c410d660 con 0x7f90c4103710 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c9d4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90c410d960 con 0x7f90c4101b60 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34174/0 (socket says 172.21.15.52:34174) 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 -- 172.21.15.52:0/4233789015 learned_addr learned my addr 172.21.15.52:0/4233789015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c37fe640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4101b60 0x7f90c4197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c3fff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 -- 172.21.15.52:0/4233789015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4101b60 msgr2=0x7f90c4197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.671 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4101b60 0x7f90c4197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 -- 172.21.15.52:0/4233789015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 msgr2=0x7f90c419f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c419f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90bbfff640 1 -- 172.21.15.52:0/4233789015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c419fa50 con 0x7f90c4102d50 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.667+0000 7f90c3fff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90bbfff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00d770 tx=0x7f90ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90c17fa640 1 -- 172.21.15.52:0/4233789015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac017070 con 0x7f90c4102d50 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90c17fa640 1 -- 172.21.15.52:0/4233789015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ac005500 con 0x7f90c4102d50 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90c17fa640 1 -- 172.21.15.52:0/4233789015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac004e00 con 0x7f90c4102d50 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c419fd40 con 0x7f90c4102d50 2024-09-19T09:35:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.668+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c41a01e0 con 0x7f90c4102d50 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.670+0000 7f90c17fa640 1 -- 172.21.15.52:0/4233789015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f90ac004fa0 con 0x7f90c4102d50 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.670+0000 7f90cc722740 1 Processor -- start 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 -- start start 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de39a0 0x55dd99de3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99deb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd99d472f0 con 0x55dd99de42e0 2024-09-19T09:35:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dd99cef270 con 0x55dd99de9370 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90cc722740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dd99d432b0 con 0x55dd99de39a0 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34190/0 (socket says 172.21.15.52:34190) 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 -- 172.21.15.52:0/3689849802 learned_addr learned my addr 172.21.15.52:0/3689849802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c17fa640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 0x7f90b00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90bbfff640 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99deb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c3fff640 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de39a0 0x55dd99de3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c3fff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 0x7f90b00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 -- 172.21.15.52:0/3689849802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de39a0 msgr2=0x55dd99de3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de39a0 0x55dd99de3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 -- 172.21.15.52:0/3689849802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 msgr2=0x55dd99deb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.681 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99deb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 -- 172.21.15.52:0/3689849802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd99cee340 con 0x55dd99de42e0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c17fa640 1 -- 172.21.15.52:0/4233789015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90ac0cf410 con 0x7f90c4102d50 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.671+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f90b4031610 tx=0x7f90b4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e3116f6d8fd768 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90c3fff640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 0x7f90b00a57b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009370 tx=0x7f90bc009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90b9ffb640 1 -- 172.21.15.52:0/3689849802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4040070 con 0x55dd99de42e0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90b9ffb640 1 -- 172.21.15.52:0/3689849802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b40318b0 con 0x55dd99de42e0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90b9ffb640 1 -- 172.21.15.52:0/3689849802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4035040 con 0x55dd99de42e0 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 -- 172.21.15.52:0/3689849802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 msgr2=0x55dd99de8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f90b4031610 tx=0x7f90b4005c00 comp rx=0 tx=0).stop 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 -- 172.21.15.52:0/3689849802 shutdown_connections 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99deb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de42e0 0x55dd99de8da0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 --2- 172.21.15.52:0/3689849802 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de39a0 0x55dd99de3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 -- 172.21.15.52:0/3689849802 >> 172.21.15.52:0/3689849802 conn(0x55dd99ddf010 msgr2=0x55dd99ddf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 -- 172.21.15.52:0/3689849802 shutdown_connections 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.672+0000 7f90cc722740 1 -- 172.21.15.52:0/3689849802 wait complete. 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 -- start start 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 Processor -- start 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de39a0 0x55dd99dedb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99dee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55dd99dec2e0 con 0x55dd99de9370 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55dd99cd0290 con 0x55dd99de39a0 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55dd99dec460 con 0x55dd99de42e0 2024-09-19T09:35:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90cc722740 10 client.0 _ll_register_callbacks cb 0x55dd99d01140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34204/0 (socket says 172.21.15.52:34204) 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90c3fff640 1 -- 172.21.15.52:0/3010352043 learned_addr learned my addr 172.21.15.52:0/3010352043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.673+0000 7f90bbfff640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99dee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de39a0 0x55dd99dedb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 -- 172.21.15.52:0/3010352043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 msgr2=0x55dd99dee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99dee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 -- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de39a0 msgr2=0x55dd99dedb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de39a0 0x55dd99dedb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 -- 172.21.15.52:0/3010352043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd99a5a210 con 0x55dd99de9370 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90c3fff640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011f10 tx=0x7f90bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6730e356d878ac98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc025030 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90bc003970 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90b40318b0 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90bc02f050 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90cc722740 10 client.20451 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd99b26620 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b40318b0 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.674+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90bc02a6d0 con 0x55dd99de9370 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 10 client.20451 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 10 client.20451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 20 client.20451 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99df98b0 0x55dd99dfbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 4 client.20451 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd99d54a20 con 0x55dd99df98b0 2024-09-19T09:35:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99df98b0 0x55dd99dfbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90c37fe640 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99df98b0 0x55dd99dfbcc0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=745a3c3bcee9dcf0 server_cookie=2218cebf0cf8267c in_seq=0 out_seq=0 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.675+0000 7f90a2ffd640 10 client.20451 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90a2ffd640 1 -- 172.21.15.52:0/3010352043 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd99d54a20 con 0x55dd99df98b0 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90a2ffd640 10 client.20451 handle_command_reply: tid=0 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 client.20451 shutdown 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 msgr2=0x55dd99df50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f90bc011f10 tx=0x7f90bc004a40 comp rx=0 tx=0).stop 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 shutdown_connections 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99df98b0 0x55dd99dfbcc0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de9370 0x55dd99df50f0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99dee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90a2ffd640 0 client.20451 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 --2- 172.21.15.52:0/3010352043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de39a0 0x55dd99dedb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 >> 172.21.15.52:0/3010352043 conn(0x55dd99ddf010 msgr2=0x55dd99de0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.676+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 shutdown_connections 2024-09-19T09:35:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.677+0000 7f90cc722740 1 -- 172.21.15.52:0/3010352043 wait complete. 2024-09-19T09:35:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.677+0000 7f90cc722740 20 client.20451 trim_cache size 0 max 16384 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 Processor -- start 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 -- start start 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99ddfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41abaa0 con 0x55dd99de39a0 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a9370 con 0x55dd99de9370 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90cc722740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a71c0 con 0x55dd99de42e0 2024-09-19T09:35:08.697 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34210/0 (socket says 172.21.15.52:34210) 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90c37fe640 1 -- 172.21.15.52:0/2704792755 learned_addr learned my addr 172.21.15.52:0/2704792755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90c3fff640 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99ddfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.691+0000 7f90c37fe640 1 -- 172.21.15.52:0/2704792755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 msgr2=0x55dd99df50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c37fe640 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c37fe640 1 -- 172.21.15.52:0/2704792755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 msgr2=0x55dd99ddfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c37fe640 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99ddfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c37fe640 1 -- 172.21.15.52:0/2704792755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd99de4f70 con 0x55dd99de39a0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c3fff640 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99ddfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90c37fe640 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009900 tx=0x7f90b402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8b4b7dc5e7ab35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90b97fa640 1 -- 172.21.15.52:0/2704792755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4035040 con 0x55dd99de39a0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90b97fa640 1 -- 172.21.15.52:0/2704792755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b4005040 con 0x55dd99de39a0 2024-09-19T09:35:08.698 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90b97fa640 1 -- 172.21.15.52:0/2704792755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4040040 con 0x55dd99de39a0 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 -- 172.21.15.52:0/2704792755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 msgr2=0x55dd99de3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009900 tx=0x7f90b402a410 comp rx=0 tx=0).stop 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 -- 172.21.15.52:0/2704792755 shutdown_connections 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99ddfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 --2- 172.21.15.52:0/2704792755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99de3d80 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 -- 172.21.15.52:0/2704792755 >> 172.21.15.52:0/2704792755 conn(0x55dd99ddf010 msgr2=0x55dd99dedb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 -- 172.21.15.52:0/2704792755 shutdown_connections 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.692+0000 7f90cc722740 1 -- 172.21.15.52:0/2704792755 wait complete. 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 -- start start 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 Processor -- start 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.699 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99df3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a7830 con 0x55dd99de39a0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a8ca0 con 0x55dd99de9370 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a7f00 con 0x55dd99de42e0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90cc722740 10 client.0 _ll_register_callbacks cb 0x7f90bc011670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34214/0 (socket says 172.21.15.52:34214) 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c37fe640 1 -- 172.21.15.52:0/1129851034 learned_addr learned my addr 172.21.15.52:0/1129851034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c3fff640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99df3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90bbfff640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c37fe640 1 -- 172.21.15.52:0/1129851034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 msgr2=0x55dd99df2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.693+0000 7f90c37fe640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90c37fe640 1 -- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 msgr2=0x55dd99df3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:08.700 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90c37fe640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99df3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90c37fe640 1 -- 172.21.15.52:0/1129851034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd99df41d0 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90bbfff640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90c37fe640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f90b4000c00 tx=0x7f90b4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff26691ae8e70aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b4040070 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90b40051f0 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90b4005040 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90b4066050 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 10 client.20457 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dd99df5450 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b4005040 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90b404d070 con 0x55dd99de39a0 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 10 client.20457 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:08.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 10 client.20457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 20 client.20457 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99e648d0 0x55dd99e66cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 4 client.20457 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.694+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd99d4ed70 con 0x55dd99e648d0 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.695+0000 7f90bbfff640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99e648d0 0x55dd99e66cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.695+0000 7f90a2ffd640 10 client.20457 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.695+0000 7f90bbfff640 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99e648d0 0x55dd99e66cc0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a73b09878d0cb05 server_cookie=76f3c94fa27da1bd in_seq=0 out_seq=0 2024-09-19T09:35:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90a2ffd640 1 -- 172.21.15.52:0/1129851034 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd99d4ed70 con 0x55dd99e648d0 2024-09-19T09:35:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90a2ffd640 10 client.20457 handle_command_reply: tid=0 2024-09-19T09:35:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 client.20457 shutdown 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 msgr2=0x55dd99df2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f90b4000c00 tx=0x7f90b4004040 comp rx=0 tx=0).stop 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 shutdown_connections 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55dd99e648d0 0x55dd99e66cc0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55dd99de9370 0x55dd99df3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55dd99de42e0 0x55dd99df2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90a2ffd640 0 client.20457 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 --2- 172.21.15.52:0/1129851034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55dd99de39a0 0x55dd99df2670 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 >> 172.21.15.52:0/1129851034 conn(0x55dd99ddf010 msgr2=0x55dd99ddd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 shutdown_connections 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 1 -- 172.21.15.52:0/1129851034 wait complete. 2024-09-19T09:35:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90cc722740 20 client.20457 trim_cache size 0 max 16384 2024-09-19T09:35:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:35:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:35:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:35:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:35:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 msgr2=0x7f90b00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 0x7f90b00a57b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009370 tx=0x7f90bc009520 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 msgr2=0x7f90c4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.709+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00d770 tx=0x7f90ac00dc30 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 shutdown_connections 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90c4103710 0x7f90c419f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f90c4102d50 0x7f90c4198370 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90b00a32f0 0x7f90b00a57b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 --2- 172.21.15.52:0/4233789015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f90c4101b60 0x7f90c4197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 >> 172.21.15.52:0/4233789015 conn(0x7f90c40fd2e0 msgr2=0x7f90c4106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 shutdown_connections 2024-09-19T09:35:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:08.710+0000 7f90c9d4b640 1 -- 172.21.15.52:0/4233789015 wait complete. 2024-09-19T09:35:09.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:09 smithi052 ceph-mon[30947]: pgmap v749: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:09.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:09 smithi169 ceph-mon[35454]: pgmap v749: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:09 smithi086 ceph-mon[34813]: pgmap v749: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:09.964 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:35:09.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:35:10.236 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:10.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.732+0000 7f080ccaf640 1 -- 172.21.15.52:0/2599604027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08081055b0 msgr2=0x7f080810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.732+0000 7f080ccaf640 1 --2- 172.21.15.52:0/2599604027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08081055b0 0x7f080810d130 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f0800009ca0 tx=0x7f080002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 -- 172.21.15.52:0/2599604027 shutdown_connections 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 --2- 172.21.15.52:0/2599604027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08081055b0 0x7f080810d130 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 --2- 172.21.15.52:0/2599604027 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0808100e30 0x7f0808104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 --2- 172.21.15.52:0/2599604027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 0x7f0808100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 -- 172.21.15.52:0/2599604027 >> 172.21.15.52:0/2599604027 conn(0x7f0808077210 msgr2=0x7f08080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 -- 172.21.15.52:0/2599604027 shutdown_connections 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 -- 172.21.15.52:0/2599604027 wait complete. 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 Processor -- start 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.733+0000 7f080ccaf640 1 -- start start 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 0x7f08081983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08081055b0 0x7f080819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0808111fb0 con 0x7f0808100e30 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0808111e30 con 0x7f0808100480 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080ccaf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0808112130 con 0x7f08081055b0 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34232/0 (socket says 172.21.15.52:34232) 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 -- 172.21.15.52:0/143368217 learned_addr learned my addr 172.21.15.52:0/143368217 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f080659c640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 0x7f08081983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 -- 172.21.15.52:0/143368217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08081055b0 msgr2=0x7f080819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08081055b0 0x7f080819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 -- 172.21.15.52:0/143368217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 msgr2=0x7f08081983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 0x7f08081983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 -- 172.21.15.52:0/143368217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080819d370 con 0x7f0808100e30 2024-09-19T09:35:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.734+0000 7f0805d9b640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b4a0 tx=0x7f07fc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.735+0000 7f07f77fe640 1 -- 172.21.15.52:0/143368217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc015020 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.735+0000 7f07f77fe640 1 -- 172.21.15.52:0/143368217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07fc011d10 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.735+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f080819d660 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.735+0000 7f07f77fe640 1 -- 172.21.15.52:0/143368217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00f2e0 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.735+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a4f40 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f07f77fe640 1 -- 172.21.15.52:0/143368217 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f07fc018020 con 0x7f0808100e30 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 Processor -- start 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 -- start start 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeeef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbfef9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfe54280 con 0x55bcbfef9d40 2024-09-19T09:35:10.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfdfbb10 con 0x55bcbfeef480 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.738+0000 7f080f088740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfe50240 con 0x55bcbfeeeb60 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34236/0 (socket says 172.21.15.52:34236) 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 -- 172.21.15.52:0/2910680088 learned_addr learned my addr 172.21.15.52:0/2910680088 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0806d9d640 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeeef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f07f77fe640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 0x7f07f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f080659c640 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbfef9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 -- 172.21.15.52:0/2910680088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeeeb60 msgr2=0x55bcbfeeef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeeef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0806d9d640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 0x7f07f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 -- 172.21.15.52:0/2910680088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 msgr2=0x55bcbfef9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbfef9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f07f77fe640 1 -- 172.21.15.52:0/143368217 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f07fc0cf2a0 con 0x7f0808100e30 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 -- 172.21.15.52:0/2910680088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbfe081f0 con 0x55bcbfef9d40 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0805d9b640 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f07fc097ca0 tx=0x7f07fc050ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf48e87f9a0f8667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f07f4ff9640 1 -- 172.21.15.52:0/2910680088 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc09b380 con 0x55bcbfef9d40 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f0806d9d640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 0x7f07f00a5700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0800009430 tx=0x7f08000095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f07f4ff9640 1 -- 172.21.15.52:0/2910680088 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07fc09bf40 con 0x55bcbfef9d40 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.739+0000 7f07f4ff9640 1 -- 172.21.15.52:0/2910680088 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0092b0 con 0x55bcbfef9d40 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 -- 172.21.15.52:0/2910680088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 msgr2=0x55bcbfefc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f07fc097ca0 tx=0x7f07fc050ad0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 -- 172.21.15.52:0/2910680088 shutdown_connections 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbfefc130 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbfef9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 --2- 172.21.15.52:0/2910680088 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeeef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 -- 172.21.15.52:0/2910680088 >> 172.21.15.52:0/2910680088 conn(0x55bcbfeeb0f0 msgr2=0x55bcbfeeb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 -- 172.21.15.52:0/2910680088 shutdown_connections 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.740+0000 7f080f088740 1 -- 172.21.15.52:0/2910680088 wait complete. 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 -- start start 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 Processor -- start 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfef6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbfef7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfefc910 con 0x55bcbfeef480 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfe0ef10 con 0x55bcbfeeeb60 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bcbfefca90 con 0x55bcbfef9d40 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080f088740 10 client.0 _ll_register_callbacks cb 0x55bcbfdd7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f0805d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34242/0 (socket says 172.21.15.52:34242) 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f0805d9b640 1 -- 172.21.15.52:0/881908007 learned_addr learned my addr 172.21.15.52:0/881908007 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f0806d9d640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbfef7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.741+0000 7f080659c640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfef6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 -- 172.21.15.52:0/881908007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 msgr2=0x55bcbfef7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbfef7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 -- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 msgr2=0x55bcbfef6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfef6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 -- 172.21.15.52:0/881908007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbfbc56a0 con 0x55bcbfeef480 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080659c640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfef6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f0805d9b640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0ccd70 tx=0x7f07fc09b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32729a8eba389162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc09b1a0 con 0x55bcbfeef480 2024-09-19T09:35:10.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f07fc010510 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07fc09bf40 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07fc0092b0 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 10 client.20469 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcbfefc910 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f07fc09bf40 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f07fc0a4020 con 0x55bcbfeef480 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 10 client.20469 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 10 client.20469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 20 client.20469 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff09600 0x55bcbff0b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 4 client.20469 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.742+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcbfe617f0 con 0x55bcbff09600 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.743+0000 7f080659c640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff09600 0x55bcbff0b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.743+0000 7f080659c640 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff09600 0x55bcbff0b9f0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ca87ea6e18f66d server_cookie=e36846a4184e12ce in_seq=0 out_seq=0 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.743+0000 7f07edffb640 10 client.20469 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f07edffb640 1 -- 172.21.15.52:0/881908007 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bcbfe617f0 con 0x55bcbff09600 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f07edffb640 10 client.20469 handle_command_reply: tid=0 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 client.20469 shutdown 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 msgr2=0x55bcbfef70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0ccd70 tx=0x7f07fc09b740 comp rx=0 tx=0).stop 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 shutdown_connections 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff09600 0x55bcbff0b9f0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbfef7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeef480 0x55bcbfef70c0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 --2- 172.21.15.52:0/881908007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfef6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f07edffb640 0 client.20469 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:10.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 >> 172.21.15.52:0/881908007 conn(0x55bcbfeeb0f0 msgr2=0x55bcbfef0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 shutdown_connections 2024-09-19T09:35:10.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 1 -- 172.21.15.52:0/881908007 wait complete. 2024-09-19T09:35:10.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.744+0000 7f080f088740 20 client.20469 trim_cache size 0 max 16384 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 Processor -- start 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 -- start start 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeea0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeef480 0x55bcbff110e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b0070 con 0x55bcbfef9d40 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ad940 con 0x55bcbfeeeb60 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080f088740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ab790 con 0x55bcbfeef480 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34256/0 (socket says 172.21.15.52:34256) 2024-09-19T09:35:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 -- 172.21.15.52:0/2570838811 learned_addr learned my addr 172.21.15.52:0/2570838811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080659c640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeea0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0805d9b640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeef480 0x55bcbff110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 -- 172.21.15.52:0/2570838811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeef480 msgr2=0x55bcbff110e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeef480 0x55bcbff110e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 -- 172.21.15.52:0/2570838811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 msgr2=0x55bcbfeea0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeea0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 -- 172.21.15.52:0/2570838811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcbfee6830 con 0x55bcbfef9d40 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f080659c640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.762+0000 7f0806d9d640 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f0800031f70 tx=0x7f0800043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903a504207ef5890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f07effff640 1 -- 172.21.15.52:0/2570838811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800046040 con 0x55bcbfef9d40 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f07effff640 1 -- 172.21.15.52:0/2570838811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0800051070 con 0x55bcbfef9d40 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f07effff640 1 -- 172.21.15.52:0/2570838811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080002f610 con 0x55bcbfef9d40 2024-09-19T09:35:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 -- 172.21.15.52:0/2570838811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 msgr2=0x55bcbff11620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f0800031f70 tx=0x7f0800043000 comp rx=0 tx=0).stop 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 -- 172.21.15.52:0/2570838811 shutdown_connections 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfef9d40 0x55bcbff11620 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfeef480 0x55bcbff110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 --2- 172.21.15.52:0/2570838811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeeeb60 0x55bcbfeea0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 -- 172.21.15.52:0/2570838811 >> 172.21.15.52:0/2570838811 conn(0x55bcbfeeb0f0 msgr2=0x55bcbfef8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 -- 172.21.15.52:0/2570838811 shutdown_connections 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.763+0000 7f080f088740 1 -- 172.21.15.52:0/2570838811 wait complete. 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 -- start start 2024-09-19T09:35:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 Processor -- start 2024-09-19T09:35:10.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbff02220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbff6d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f08081abe00 con 0x55bcbfeeeb60 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ad270 con 0x55bcbfeef480 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f08081ac4d0 con 0x55bcbfef9d40 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080f088740 10 client.0 _ll_register_callbacks cb 0x7f07f800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34272/0 (socket says 172.21.15.52:34272) 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 -- 172.21.15.52:0/3357631914 learned_addr learned my addr 172.21.15.52:0/3357631914 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f0806d9d640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbff6d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f0805d9b640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbff02220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 -- 172.21.15.52:0/3357631914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 msgr2=0x55bcbff6d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbff6d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 -- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 msgr2=0x55bcbff02220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbff02220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f080659c640 1 -- 172.21.15.52:0/3357631914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcbff02890 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f0806d9d640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbff6d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.764+0000 7f0805d9b640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbff02220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080659c640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005e10 tx=0x7f07f8010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906c37ea1fe74753 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f801d940 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f07f801dae0 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0800051070 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f07f802d050 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 10 client.20475 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bcbff7d1f0 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0800051070 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f07f801c6a0 con 0x55bcbfeeeb60 2024-09-19T09:35:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 10 client.20475 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 10 client.20475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 20 client.20475 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff7d940 0x55bcbff7fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 4 client.20475 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.765+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bcbfe5bd00 con 0x55bcbff7d940 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.766+0000 7f0805d9b640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff7d940 0x55bcbff7fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.766+0000 7f0805d9b640 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff7d940 0x55bcbff7fd60 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60c1bedb1ce5942 server_cookie=5c2fe72b29257a3c in_seq=0 out_seq=0 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.766+0000 7f07edffb640 10 client.20475 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f07edffb640 1 -- 172.21.15.52:0/3357631914 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bcbfe5bd00 con 0x55bcbff7d940 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f07edffb640 10 client.20475 handle_command_reply: tid=0 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 client.20475 shutdown 2024-09-19T09:35:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 msgr2=0x55bcbff01ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f07f8005e10 tx=0x7f07f8010af0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 shutdown_connections 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bcbff7d940 0x55bcbff7fd60 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bcbfef9d40 0x55bcbff6d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bcbfeef480 0x55bcbff02220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 --2- 172.21.15.52:0/3357631914 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bcbfeeeb60 0x55bcbff01ce0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f07edffb640 0 client.20475 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 >> 172.21.15.52:0/3357631914 conn(0x55bcbfeeb0f0 msgr2=0x55bcbfef81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 shutdown_connections 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.767+0000 7f080f088740 1 -- 172.21.15.52:0/3357631914 wait complete. 2024-09-19T09:35:10.774 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080f088740 20 client.20475 trim_cache size 0 max 16384 2024-09-19T09:35:10.775 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:10.775 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:35:10.775 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "3258b24f-affb-4df3-8066-56ed63f5af32", 2024-09-19T09:35:10.775 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:35:10.775 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 msgr2=0x7f07f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 0x7f07f00a5700 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0800009430 tx=0x7f08000095c0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 msgr2=0x7f0808198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b4a0 tx=0x7f07fc00b8a0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 shutdown_connections 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f07f00a3240 0x7f07f00a5700 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08081055b0 0x7f080819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0808100e30 0x7f0808198900 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 --2- 172.21.15.52:0/143368217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0808100480 0x7f08081983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 >> 172.21.15.52:0/143368217 conn(0x7f0808077210 msgr2=0x7f0808103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 shutdown_connections 2024-09-19T09:35:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:10.768+0000 7f080ccaf640 1 -- 172.21.15.52:0/143368217 wait complete. 2024-09-19T09:35:11.052 INFO:tasks.workunit.client.0.smithi052.stdout:437/600: open fd = 3 2024-09-19T09:35:11.052 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.052 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.052 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.052 INFO:tasks.workunit.client.0.smithi052.stdout:438/600: open fd = 3 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:439/600: open fd = 3 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:440/600: open fd = 3 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:441/600: open fd = 3 2024-09-19T09:35:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:442/600: open fd = 3 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:443/600: open fd = 3 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:444/600: open fd = 3 2024-09-19T09:35:11.054 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:445/600: open fd = 3 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:446/600: open fd = 3 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:447/600: open fd = 3 2024-09-19T09:35:11.055 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:448/600: open fd = 3 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:449/600: open fd = 3 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:450/600: open fd = 3 2024-09-19T09:35:11.056 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:451/600: open fd = 3 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:452/600: open fd = 3 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.057 INFO:tasks.workunit.client.0.smithi052.stdout:453/600: open fd = 3 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:454/600: open fd = 3 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:455/600: open fd = 3 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:456/600: open fd = 3 2024-09-19T09:35:11.058 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:457/600: open fd = 3 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:458/600: open fd = 3 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:459/600: open fd = 3 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:460/600: open fd = 3 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:461/600: open fd = 3 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:462/600: open fd = 3 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.060 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:463/600: open fd = 3 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:464/600: open fd = 3 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:465/600: open fd = 3 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.061 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:466/600: open fd = 3 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:467/600: open fd = 3 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:468/600: open fd = 3 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.062 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:469/600: open fd = 3 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:470/600: open fd = 3 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:471/600: open fd = 3 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.063 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:472/600: open fd = 3 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:473/600: open fd = 3 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:474/600: open fd = 3 2024-09-19T09:35:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:475/600: open fd = 3 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:476/600: open fd = 3 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.065 INFO:tasks.workunit.client.0.smithi052.stdout:477/600: open fd = 3 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:478/600: open fd = 3 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:479/600: open fd = 3 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.066 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:480/600: open fd = 3 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:481/600: open fd = 3 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:482/600: open fd = 3 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.067 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:483/600: open fd = 3 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:484/600: open fd = 3 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:485/600: open fd = 3 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.068 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:486/600: open fd = 3 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:487/600: open fd = 3 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.069 INFO:tasks.workunit.client.0.smithi052.stdout:488/600: open fd = 3 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:489/600: open fd = 3 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:490/600: open fd = 3 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.070 INFO:tasks.workunit.client.0.smithi052.stdout:491/600: open fd = 3 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:492/600: open fd = 3 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:493/600: open fd = 3 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:494/600: open fd = 3 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:495/600: open fd = 3 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:496/600: open fd = 3 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.072 INFO:tasks.workunit.client.0.smithi052.stdout:497/600: open fd = 3 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:498/600: open fd = 3 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:35:11.073 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:35:11.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:35:11.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:11 smithi052 ceph-mon[30947]: pgmap v750: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:11.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:11 smithi169 ceph-mon[35454]: pgmap v750: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:11.747 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:11.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:11 smithi086 ceph-mon[34813]: pgmap v750: 97 pgs: 97 active+clean; 2.8 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:12.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 -- 172.21.15.52:0/1668086768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95001008d0 msgr2=0x7f9500100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 --2- 172.21.15.52:0/1668086768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95001008d0 0x7f9500100cb0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009900 tx=0x7f94fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 -- 172.21.15.52:0/1668086768 shutdown_connections 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 --2- 172.21.15.52:0/1668086768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f950010e480 0x7f9500110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 --2- 172.21.15.52:0/1668086768 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9500101280 0x7f950010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 --2- 172.21.15.52:0/1668086768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95001008d0 0x7f9500100cb0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 -- 172.21.15.52:0/1668086768 >> 172.21.15.52:0/1668086768 conn(0x7f95000fc7a0 msgr2=0x7f95000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 -- 172.21.15.52:0/1668086768 shutdown_connections 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 -- 172.21.15.52:0/1668086768 wait complete. 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.240+0000 7f9507532640 1 Processor -- start 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 -- start start 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001008d0 0x7f950019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9500101280 0x7f950019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9500114190 con 0x7f950010e480 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9500114010 con 0x7f9500101280 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9507532640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9500114310 con 0x7f95001008d0 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34280/0 (socket says 172.21.15.52:34280) 2024-09-19T09:35:12.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 -- 172.21.15.52:0/489322232 learned_addr learned my addr 172.21.15.52:0/489322232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:12.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f95052ce640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001008d0 0x7f950019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9504acd640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9500101280 0x7f950019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 -- 172.21.15.52:0/489322232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001008d0 msgr2=0x7f950019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001008d0 0x7f950019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 -- 172.21.15.52:0/489322232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9500101280 msgr2=0x7f950019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.241+0000 7f9505acf640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9500101280 0x7f950019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f9505acf640 1 -- 172.21.15.52:0/489322232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950019f5b0 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f9505acf640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009fd0 tx=0x7f94f800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f94f67fc640 1 -- 172.21.15.52:0/489322232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8004d20 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f94f67fc640 1 -- 172.21.15.52:0/489322232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f8005020 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950019f8a0 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f94f67fc640 1 -- 172.21.15.52:0/489322232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f80116d0 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.242+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95001a7180 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.244+0000 7f94f67fc640 1 -- 172.21.15.52:0/489322232 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f94f800cb20 con 0x7f950010e480 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 Processor -- start 2024-09-19T09:35:12.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 -- start start 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd95880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabda2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55faabcfb2e0 con 0x55faabd95dc0 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55faabca2ce0 con 0x55faabda0680 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f950990b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55faabcf72a0 con 0x55faabd954a0 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f94f67fc640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 0x7f94ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f9505acf640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 0x7f94ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34294/0 (socket says 172.21.15.52:34294) 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f95052ce640 1 -- 172.21.15.52:0/2447310766 learned_addr learned my addr 172.21.15.52:0/2447310766 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f94f67fc640 1 -- 172.21.15.52:0/489322232 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94f80cfd90 con 0x7f950010e480 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f9504acd640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd95880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.245+0000 7f9504acd640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabda2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 -- 172.21.15.52:0/2447310766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 msgr2=0x55faabd95880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd95880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 -- 172.21.15.52:0/2447310766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 msgr2=0x55faabda2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabda2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 -- 172.21.15.52:0/2447310766 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faabc87440 con 0x55faabd95dc0 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f9504acd640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabda2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f9505acf640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 0x7f94ec0a5700 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f94f809c2c0 tx=0x7f94f8015b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f95052ce640 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009900 tx=0x7f94fc031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c11b4c5aca1fede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f94eb7fe640 1 -- 172.21.15.52:0/2447310766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc040070 con 0x55faabd95dc0 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f94eb7fe640 1 -- 172.21.15.52:0/2447310766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94fc005020 con 0x55faabd95dc0 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.246+0000 7f94eb7fe640 1 -- 172.21.15.52:0/2447310766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc035040 con 0x55faabd95dc0 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- 172.21.15.52:0/2447310766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 msgr2=0x55faabda0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009900 tx=0x7f94fc031630 comp rx=0 tx=0).stop 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- 172.21.15.52:0/2447310766 shutdown_connections 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabda2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda0140 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 --2- 172.21.15.52:0/2447310766 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd95880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- 172.21.15.52:0/2447310766 >> 172.21.15.52:0/2447310766 conn(0x55faabd91a30 msgr2=0x55faabd91e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- 172.21.15.52:0/2447310766 shutdown_connections 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- 172.21.15.52:0/2447310766 wait complete. 2024-09-19T09:35:12.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 -- start start 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.247+0000 7f950990b740 1 Processor -- start 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd9ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabd9d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55faabda3250 con 0x55faabd95dc0 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55faabcb6050 con 0x55faabda0680 2024-09-19T09:35:12.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55faabda33d0 con 0x55faabd954a0 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f950990b740 10 client.0 _ll_register_callbacks cb 0x55faabcf6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34300/0 (socket says 172.21.15.52:34300) 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 -- 172.21.15.52:0/1490946983 learned_addr learned my addr 172.21.15.52:0/1490946983 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f9504acd640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd9ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f9504acd640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabd9d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 -- 172.21.15.52:0/1490946983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 msgr2=0x55faabd9ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd9ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 -- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 msgr2=0x55faabd9d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabd9d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 -- 172.21.15.52:0/1490946983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faaba6c3c0 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f9504acd640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabd9d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f95052ce640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f94fc02a450 tx=0x7f94fc031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f1ec0edbbf4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.248+0000 7f94e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc040070 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94fc005460 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94fc005020 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94fc035050 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 10 client.20487 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55faabdaebf0 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94fc005020 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f94fc058bf0 con 0x55faabd95dc0 2024-09-19T09:35:12.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 10 client.20487 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 10 client.20487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 20 client.20487 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabdb2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 4 client.20487 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.249+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55faabd08850 con 0x55faabdaff40 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.250+0000 7f9504acd640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabdb2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.250+0000 7f9504acd640 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabdb2330 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4876233d6657357 server_cookie=2b1c3debe9da59bd in_seq=0 out_seq=0 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.250+0000 7f94e8ff9640 10 client.20487 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f94e8ff9640 1 -- 172.21.15.52:0/1490946983 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55faabd08850 con 0x55faabdaff40 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f94e8ff9640 10 client.20487 handle_command_reply: tid=0 2024-09-19T09:35:12.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 client.20487 shutdown 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 msgr2=0x55faabd9d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f94fc02a450 tx=0x7f94fc031b10 comp rx=0 tx=0).stop 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 shutdown_connections 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabdb2330 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabda0680 0x55faabd9d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f94e8ff9640 0 client.20487 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabd9d1b0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 --2- 172.21.15.52:0/1490946983 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabd954a0 0x55faabd9ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 >> 172.21.15.52:0/1490946983 conn(0x55faabd91a30 msgr2=0x55faabd97710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 shutdown_connections 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 1 -- 172.21.15.52:0/1490946983 wait complete. 2024-09-19T09:35:12.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.251+0000 7f950990b740 20 client.20487 trim_cache size 0 max 16384 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.268+0000 7f950990b740 1 Processor -- start 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.268+0000 7f950990b740 1 -- start start 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 0x55faabdb79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabdb7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94e4010f40 con 0x55faabd954a0 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94e400e810 con 0x55faabd95dc0 2024-09-19T09:35:12.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f950990b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94e400c660 con 0x55faabda0680 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34316/0 (socket says 172.21.15.52:34316) 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 -- 172.21.15.52:0/378366171 learned_addr learned my addr 172.21.15.52:0/378366171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f95052ce640 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 0x55faabdb79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 -- 172.21.15.52:0/378366171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 msgr2=0x55faabdb7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabdb7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 -- 172.21.15.52:0/378366171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 msgr2=0x55faabdb79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 0x55faabdb79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 -- 172.21.15.52:0/378366171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faabd95bf0 con 0x55faabd954a0 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f95052ce640 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 0x55faabdb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f9504acd640 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000c00 tx=0x7f94f000a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e4395af58d32d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f94eaffd640 1 -- 172.21.15.52:0/378366171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0005110 con 0x55faabd954a0 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f94eaffd640 1 -- 172.21.15.52:0/378366171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f0004730 con 0x55faabd954a0 2024-09-19T09:35:12.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.269+0000 7f94eaffd640 1 -- 172.21.15.52:0/378366171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f001f620 con 0x55faabd954a0 2024-09-19T09:35:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- 172.21.15.52:0/378366171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 msgr2=0x55faabdac540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f94f0000c00 tx=0x7f94f000a6c0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- 172.21.15.52:0/378366171 shutdown_connections 2024-09-19T09:35:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabdb7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd95dc0 0x55faabdb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 --2- 172.21.15.52:0/378366171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd954a0 0x55faabdac540 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- 172.21.15.52:0/378366171 >> 172.21.15.52:0/378366171 conn(0x55faabd91a30 msgr2=0x55faabd9c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- 172.21.15.52:0/378366171 shutdown_connections 2024-09-19T09:35:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- 172.21.15.52:0/378366171 wait complete. 2024-09-19T09:35:12.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 -- start start 2024-09-19T09:35:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.270+0000 7f950990b740 1 Processor -- start 2024-09-19T09:35:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd954a0 0x55faabda46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabda5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94e400ccd0 con 0x55faabd95dc0 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94e400e140 con 0x55faabd954a0 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f94e400d3a0 con 0x55faabda0680 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f950990b740 10 client.0 _ll_register_callbacks cb 0x7f94f000aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34320/0 (socket says 172.21.15.52:34320) 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 -- 172.21.15.52:0/3700730343 learned_addr learned my addr 172.21.15.52:0/3700730343 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f9504acd640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd954a0 0x55faabda46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f9504acd640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabda5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 -- 172.21.15.52:0/3700730343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 msgr2=0x55faabda5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabda5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 -- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd954a0 msgr2=0x55faabda46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd954a0 0x55faabda46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f95052ce640 1 -- 172.21.15.52:0/3700730343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faabe19be0 con 0x55faabd95dc0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.271+0000 7f9504acd640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabda5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f95052ce640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f94fc02a930 tx=0x7f94fc0058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab476ac10e485bab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc040040 con 0x55faabd95dc0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f94fc03c960 con 0x55faabd95dc0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94f0004730 con 0x55faabd95dc0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f94fc03cb60 con 0x55faabd95dc0 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 10 client.20493 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:12.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55faabe1ae40 con 0x55faabd95dc0 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94f0004730 con 0x55faabd95dc0 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f94fc062690 con 0x55faabd95dc0 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 10 client.20493 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 10 client.20493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 20 client.20493 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabe1d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 4 client.20493 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.272+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55faabd02d60 con 0x55faabdaff40 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f9504acd640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabe1d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f9504acd640 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabe1d5a0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e21123ef9e5babc1 server_cookie=4989c4ec4199023f in_seq=0 out_seq=0 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f94e8ff9640 10 client.20493 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f94e8ff9640 1 -- 172.21.15.52:0/3700730343 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55faabd02d60 con 0x55faabdaff40 2024-09-19T09:35:12.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f94e8ff9640 10 client.20493 handle_command_reply: tid=0 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 client.20493 shutdown 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 msgr2=0x55faabda4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f94fc02a930 tx=0x7f94fc0058c0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 shutdown_connections 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55faabdaff40 0x55faabe1d5a0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55faabda0680 0x55faabda5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55faabd95dc0 0x55faabda4c30 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 --2- 172.21.15.52:0/3700730343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55faabd954a0 0x55faabda46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 >> 172.21.15.52:0/3700730343 conn(0x55faabd91a30 msgr2=0x55faabd9ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.273+0000 7f94e8ff9640 0 client.20493 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 shutdown_connections 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f950990b740 1 -- 172.21.15.52:0/3700730343 wait complete. 2024-09-19T09:35:12.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f950990b740 20 client.20493 trim_cache size 0 max 16384 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "3258b24f-affb-4df3-8066-56ed63f5af32": { 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "3258b24f-affb-4df3-8066-56ed63f5af32", 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:35:12.285 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:35:12.286 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:35:12.286 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 msgr2=0x7f94ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 0x7f94ec0a5700 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f94f809c2c0 tx=0x7f94f8015b80 comp rx=0 tx=0).stop 2024-09-19T09:35:12.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 msgr2=0x7f950019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009fd0 tx=0x7f94f800eda0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 shutdown_connections 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f950010e480 0x7f950019eed0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9500101280 0x7f950019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f94ec0a3240 0x7f94ec0a5700 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 --2- 172.21.15.52:0/489322232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f95001008d0 0x7f950019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:12.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 >> 172.21.15.52:0/489322232 conn(0x7f95000fc7a0 msgr2=0x7f95000feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:12.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 shutdown_connections 2024-09-19T09:35:12.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:12.274+0000 7f9507532640 1 -- 172.21.15.52:0/489322232 wait complete. 2024-09-19T09:35:12.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:12 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:35:12.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:12 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:35:12.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:12 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:12 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:35:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:12 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:35:12.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:12 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:12 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:35:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:12 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:35:12.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:12 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:12.943 INFO:tasks.cephfs.filesystem:scrub status for tag:3258b24f-affb-4df3-8066-56ed63f5af32 - {'path': '/', 'tag': '3258b24f-affb-4df3-8066-56ed63f5af32', 'options': 'recursive,force'} 2024-09-19T09:35:13.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:13 smithi052 ceph-mon[30947]: pgmap v751: 97 pgs: 97 active+clean; 2.9 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:13 smithi169 ceph-mon[35454]: pgmap v751: 97 pgs: 97 active+clean; 2.9 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:13 smithi086 ceph-mon[34813]: pgmap v751: 97 pgs: 97 active+clean; 2.9 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:14.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:14 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:35:14.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:14 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:35:14.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:14 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:35:15.582 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:15 smithi052 ceph-mon[30947]: pgmap v752: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:15.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:15 smithi169 ceph-mon[35454]: pgmap v752: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:15.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:15 smithi086 ceph-mon[34813]: pgmap v752: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:17.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:17 smithi052 ceph-mon[30947]: pgmap v753: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:17.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:17 smithi169 ceph-mon[35454]: pgmap v753: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:17.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:17 smithi086 ceph-mon[34813]: pgmap v753: 97 pgs: 97 active+clean; 2.9 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:19.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:19 smithi052 ceph-mon[30947]: pgmap v754: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:35:19.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:19 smithi169 ceph-mon[35454]: pgmap v754: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:35:19.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:19 smithi086 ceph-mon[34813]: pgmap v754: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:35:21.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:21 smithi052 ceph-mon[30947]: pgmap v755: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:21.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:21 smithi169 ceph-mon[35454]: pgmap v755: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:21.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:21 smithi086 ceph-mon[34813]: pgmap v755: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:35:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 -- 172.21.15.52:0/1314890926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b01078a0 msgr2=0x7f58b0109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 --2- 172.21.15.52:0/1314890926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b01078a0 0x7f58b0109cb0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009ca0 tx=0x7f58a802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 -- 172.21.15.52:0/1314890926 shutdown_connections 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 --2- 172.21.15.52:0/1314890926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b01078a0 0x7f58b0109cb0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 --2- 172.21.15.52:0/1314890926 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b0104f70 0x7f58b0107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 --2- 172.21.15.52:0/1314890926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0102640 0x7f58b0104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 -- 172.21.15.52:0/1314890926 >> 172.21.15.52:0/1314890926 conn(0x7f58b00fc1e0 msgr2=0x7f58b00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 -- 172.21.15.52:0/1314890926 shutdown_connections 2024-09-19T09:35:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.810+0000 7f58b4d23640 1 -- 172.21.15.52:0/1314890926 wait complete. 2024-09-19T09:35:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 Processor -- start 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 -- start start 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 0x7f58b0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 0x7f58b019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010d820 con 0x7f58b0102640 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010d6a0 con 0x7f58b0104f70 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58b4d23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010d9a0 con 0x7f58b01078a0 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60778/0 (socket says 172.21.15.52:60778) 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 -- 172.21.15.52:0/4180604368 learned_addr learned my addr 172.21.15.52:0/4180604368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58add9b640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 0x7f58b0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58aed9d640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 0x7f58b019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 -- 172.21.15.52:0/4180604368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 msgr2=0x7f58b019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 0x7f58b019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 -- 172.21.15.52:0/4180604368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 msgr2=0x7f58b0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 0x7f58b0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58ae59c640 1 -- 172.21.15.52:0/4180604368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b019fa10 con 0x7f58b0102640 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58aed9d640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 0x7f58b019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.811+0000 7f58add9b640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 0x7f58b0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f58ae59c640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d950 tx=0x7f58a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f589f7fe640 1 -- 172.21.15.52:0/4180604368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0017070 con 0x7f58b0102640 2024-09-19T09:35:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b019fd00 con 0x7f58b0102640 2024-09-19T09:35:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f589f7fe640 1 -- 172.21.15.52:0/4180604368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a0009c30 con 0x7f58b0102640 2024-09-19T09:35:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f589f7fe640 1 -- 172.21.15.52:0/4180604368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a000f6b0 con 0x7f58b0102640 2024-09-19T09:35:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.812+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01a01e0 con 0x7f58b0102640 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.815+0000 7f589f7fe640 1 -- 172.21.15.52:0/4180604368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58a00109d0 con 0x7f58b0102640 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.815+0000 7f58b7abb740 1 Processor -- start 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.815+0000 7f58b7abb740 1 -- start start 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a9370 0x5625d59ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625d59072f0 con 0x5625d59a42e0 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5625d58af270 con 0x5625d59a39a0 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58b7abb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625d59032b0 con 0x5625d59a9370 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60782/0 (socket says 172.21.15.52:60782) 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 -- 172.21.15.52:0/187090249 learned_addr learned my addr 172.21.15.52:0/187090249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58aed9d640 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58add9b640 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a9370 0x5625d59ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 -- 172.21.15.52:0/187090249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a9370 msgr2=0x5625d59ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a9370 0x5625d59ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 -- 172.21.15.52:0/187090249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 msgr2=0x5625d59a3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59a3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.824 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 -- 172.21.15.52:0/187090249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d58ae340 con 0x5625d59a42e0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f589f7fe640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58aed9d640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f58ae59c640 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f58a00d5cf0 tx=0x7f58a00d5de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cb0cb802379e51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.816+0000 7f589f7fe640 1 -- 172.21.15.52:0/4180604368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58a00cf650 con 0x7f58b0102640 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f589cff9640 1 -- 172.21.15.52:0/187090249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0020030 con 0x5625d59a42e0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f589cff9640 1 -- 172.21.15.52:0/187090249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a009c2f0 con 0x5625d59a42e0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f589cff9640 1 -- 172.21.15.52:0/187090249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a009b730 con 0x5625d59a42e0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f58b7abb740 1 -- 172.21.15.52:0/187090249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 msgr2=0x5625d59a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f58aed9d640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 0x7f58980a57b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006010 tx=0x7f58a80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.817+0000 7f58b7abb740 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f58a00d5cf0 tx=0x7f58a00d5de0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- 172.21.15.52:0/187090249 shutdown_connections 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a9370 0x5625d59ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a42e0 0x5625d59a8da0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- 172.21.15.52:0/187090249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59a3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- 172.21.15.52:0/187090249 >> 172.21.15.52:0/187090249 conn(0x5625d599f010 msgr2=0x5625d599f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- 172.21.15.52:0/187090249 shutdown_connections 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- 172.21.15.52:0/187090249 wait complete. 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- start start 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 Processor -- start 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a39a0 0x5625d59adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a42e0 0x5625d59ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625d59ac340 con 0x5625d59a9370 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5625d5890290 con 0x5625d59a42e0 2024-09-19T09:35:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5625d59ac4c0 con 0x5625d59a39a0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58b7abb740 10 client.0 _ll_register_callbacks cb 0x5625d58c1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.818+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60790/0 (socket says 172.21.15.52:60790) 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 -- 172.21.15.52:0/208665365 learned_addr learned my addr 172.21.15.52:0/208665365 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58add9b640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a42e0 0x5625d59ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58ae59c640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a39a0 0x5625d59adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 -- 172.21.15.52:0/208665365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a39a0 msgr2=0x5625d59adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a39a0 0x5625d59adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 -- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a42e0 msgr2=0x5625d59ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a42e0 0x5625d59ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 -- 172.21.15.52:0/208665365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d561a210 con 0x5625d59a9370 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58aed9d640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f58a8031f30 tx=0x7f58a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc671a51b86a7b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f5895ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a802f310 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58a80047d0 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.819+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a009c2f0 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58a8059050 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 10 client.20505 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5625d56e6620 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a009c2f0 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58a8043040 con 0x5625d59a9370 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 10 client.20505 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 10 client.20505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 20 client.20505 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d59b98d0 0x5625d59bbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 4 client.20505 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:21.828 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625d5914a20 con 0x5625d59b98d0 2024-09-19T09:35:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.820+0000 7f58ae59c640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d59b98d0 0x5625d59bbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.821+0000 7f58ae59c640 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d59b98d0 0x5625d59bbd30 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ee41824e64aad81 server_cookie=6477e3a2e425a3c5 in_seq=0 out_seq=0 2024-09-19T09:35:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.821+0000 7f5895ffb640 10 client.20505 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.821+0000 7f5895ffb640 1 -- 172.21.15.52:0/208665365 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625d5914a20 con 0x5625d59b98d0 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.821+0000 7f5895ffb640 10 client.20505 handle_command_reply: tid=0 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.821+0000 7f58b7abb740 1 client.20505 shutdown 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 msgr2=0x5625d59b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f58a8031f30 tx=0x7f58a80095c0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 shutdown_connections 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d59b98d0 0x5625d59bbd30 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59b50e0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a42e0 0x5625d59ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f5895ffb640 0 client.20505 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 --2- 172.21.15.52:0/208665365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a39a0 0x5625d59adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 >> 172.21.15.52:0/208665365 conn(0x5625d599f010 msgr2=0x5625d59a0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 shutdown_connections 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 1 -- 172.21.15.52:0/208665365 wait complete. 2024-09-19T09:35:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.822+0000 7f58b7abb740 20 client.20505 trim_cache size 0 max 16384 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.836+0000 7f58b7abb740 1 Processor -- start 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.836+0000 7f58b7abb740 1 -- start start 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d599fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01aba10 con 0x5625d59a9370 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a92e0 con 0x5625d59a39a0 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58b7abb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a7130 con 0x5625d59a42e0 2024-09-19T09:35:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60800/0 (socket says 172.21.15.52:60800) 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 -- 172.21.15.52:0/1280252204 learned_addr learned my addr 172.21.15.52:0/1280252204 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58ae59c640 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58add9b640 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d599fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 -- 172.21.15.52:0/1280252204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 msgr2=0x5625d599fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d599fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 -- 172.21.15.52:0/1280252204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 msgr2=0x5625d59ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 -- 172.21.15.52:0/1280252204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625d599ee30 con 0x5625d59a9370 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f58aed9d640 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f58a8030a60 tx=0x7f58a802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74064868c113f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f5897fff640 1 -- 172.21.15.52:0/1280252204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8009800 con 0x5625d59a9370 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f5897fff640 1 -- 172.21.15.52:0/1280252204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a8036040 con 0x5625d59a9370 2024-09-19T09:35:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.837+0000 7f5897fff640 1 -- 172.21.15.52:0/1280252204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a802fd50 con 0x5625d59a9370 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- 172.21.15.52:0/1280252204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 msgr2=0x5625d59a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f58a8030a60 tx=0x7f58a802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- 172.21.15.52:0/1280252204 shutdown_connections 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d59a0400 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d599fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 --2- 172.21.15.52:0/1280252204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d59ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- 172.21.15.52:0/1280252204 >> 172.21.15.52:0/1280252204 conn(0x5625d599f010 msgr2=0x5625d59adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.845 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- 172.21.15.52:0/1280252204 shutdown_connections 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- 172.21.15.52:0/1280252204 wait complete. 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 -- start start 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.838+0000 7f58b7abb740 1 Processor -- start 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d5a1f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d5a1fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a77a0 con 0x5625d59a9370 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a8c10 con 0x5625d59a39a0 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a7e70 con 0x5625d59a42e0 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58b7abb740 10 client.0 _ll_register_callbacks cb 0x7f58a8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60816/0 (socket says 172.21.15.52:60816) 2024-09-19T09:35:21.846 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 -- 172.21.15.52:0/2826721552 learned_addr learned my addr 172.21.15.52:0/2826721552 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58ae59c640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d5a1f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 -- 172.21.15.52:0/2826721552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 msgr2=0x5625d5a1fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d5a1fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 -- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 msgr2=0x5625d5a1f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d5a1f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 -- 172.21.15.52:0/2826721552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625d5a273a0 con 0x5625d59a9370 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58ae59c640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d5a1f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f58aed9d640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009bf0 tx=0x7f58a80308c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d3198a131a5e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.839+0000 7f5895ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8030de0 con 0x5625d59a9370 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f58a802f610 con 0x5625d59a9370 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a8036040 con 0x5625d59a9370 2024-09-19T09:35:21.847 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58a802f810 con 0x5625d59a9370 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 10 client.20511 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5625d5a286b0 con 0x5625d59a9370 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a8036040 con 0x5625d59a9370 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58a8043040 con 0x5625d59a9370 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 10 client.20511 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 10 client.20511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 20 client.20511 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d5a28fd0 0x5625d5a2b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 4 client.20511 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625d590ed70 con 0x5625d5a28fd0 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.840+0000 7f58ae59c640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d5a28fd0 0x5625d5a2b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.841+0000 7f58ae59c640 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d5a28fd0 0x5625d5a2b3c0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81c80370ddca310 server_cookie=dd6fe8a5466963f8 in_seq=0 out_seq=0 2024-09-19T09:35:21.848 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.841+0000 7f5895ffb640 10 client.20511 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.854+0000 7f5895ffb640 1 -- 172.21.15.52:0/2826721552 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625d590ed70 con 0x5625d5a28fd0 2024-09-19T09:35:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.854+0000 7f5895ffb640 10 client.20511 handle_command_reply: tid=0 2024-09-19T09:35:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.854+0000 7f58b7abb740 1 client.20511 shutdown 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 msgr2=0x5625d5a26d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009bf0 tx=0x7f58a80308c0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 shutdown_connections 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5625d5a28fd0 0x5625d5a2b3c0 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625d59a9370 0x5625d5a26d90 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5625d59a42e0 0x5625d5a1fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f5895ffb640 0 client.20511 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 --2- 172.21.15.52:0/2826721552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5625d59a39a0 0x5625d5a1f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 >> 172.21.15.52:0/2826721552 conn(0x5625d599f010 msgr2=0x5625d599d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 shutdown_connections 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 1 -- 172.21.15.52:0/2826721552 wait complete. 2024-09-19T09:35:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b7abb740 20 client.20511 trim_cache size 0 max 16384 2024-09-19T09:35:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:35:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:35:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:35:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 msgr2=0x7f58980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 0x7f58980a57b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006010 tx=0x7f58a80093f0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 msgr2=0x7f58b0197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d950 tx=0x7f58a000de10 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 shutdown_connections 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f58b01078a0 0x7f58b019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b0104f70 0x7f58b0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 --2- 172.21.15.52:0/4180604368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58b0102640 0x7f58b0197df0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.855+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 >> 172.21.15.52:0/4180604368 conn(0x7f58b00fc1e0 msgr2=0x7f58b0102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.856+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 shutdown_connections 2024-09-19T09:35:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:21.856+0000 7f58b4d23640 1 -- 172.21.15.52:0/4180604368 wait complete. 2024-09-19T09:35:23.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:23 smithi052 ceph-mon[30947]: pgmap v756: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:35:23.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:23 smithi169 ceph-mon[35454]: pgmap v756: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:35:23.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:23 smithi086 ceph-mon[34813]: pgmap v756: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T09:35:25.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:25 smithi052 ceph-mon[30947]: pgmap v757: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:25.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:25 smithi169 ceph-mon[35454]: pgmap v757: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:25.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:25 smithi086 ceph-mon[34813]: pgmap v757: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:27.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:27 smithi052 ceph-mon[30947]: pgmap v758: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:27.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:27 smithi169 ceph-mon[35454]: pgmap v758: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:27.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:27 smithi086 ceph-mon[34813]: pgmap v758: 97 pgs: 97 active+clean; 3.0 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:29.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:29 smithi052 ceph-mon[30947]: pgmap v759: 97 pgs: 97 active+clean; 3.1 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:35:29.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:29 smithi169 ceph-mon[35454]: pgmap v759: 97 pgs: 97 active+clean; 3.1 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:35:29.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:29 smithi086 ceph-mon[34813]: pgmap v759: 97 pgs: 97 active+clean; 3.1 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-19T09:35:31.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:31 smithi052 ceph-mon[30947]: pgmap v760: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:31.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:31 smithi169 ceph-mon[35454]: pgmap v760: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:31.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:31 smithi086 ceph-mon[34813]: pgmap v760: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:33.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:33 smithi052 ceph-mon[30947]: pgmap v761: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:33.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:33 smithi169 ceph-mon[35454]: pgmap v761: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:33.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:33 smithi086 ceph-mon[34813]: pgmap v761: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 -- 172.21.15.52:0/3726139143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e41025c0 msgr2=0x7f54e41049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/3726139143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e41025c0 0x7f54e41049b0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009ca0 tx=0x7f54e002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 -- 172.21.15.52:0/3726139143 shutdown_connections 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/3726139143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4107820 0x7f54e4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/3726139143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e4104ef0 0x7f54e41072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/3726139143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e41025c0 0x7f54e41049b0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 -- 172.21.15.52:0/3726139143 >> 172.21.15.52:0/3726139143 conn(0x7f54e40fc1e0 msgr2=0x7f54e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 -- 172.21.15.52:0/3726139143 shutdown_connections 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.957+0000 7f54eb5c4640 1 -- 172.21.15.52:0/3726139143 wait complete. 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 Processor -- start 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 -- start start 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e41025c0 0x7f54e4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4104ef0 0x7f54e4100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d800 con 0x7f54e4107820 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d680 con 0x7f54e4104ef0 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54eb5c4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54e410d980 con 0x7f54e41025c0 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e9b61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e9b61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47486/0 (socket says 172.21.15.52:47486) 2024-09-19T09:35:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e9b61640 1 -- 172.21.15.52:0/2911902262 learned_addr learned my addr 172.21.15.52:0/2911902262 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e9360640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e41025c0 0x7f54e4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4104ef0 0x7f54e4100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.958+0000 7f54e9b61640 1 -- 172.21.15.52:0/2911902262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e41025c0 msgr2=0x7f54e4101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54e9b61640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e41025c0 0x7f54e4101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54e9b61640 1 -- 172.21.15.52:0/2911902262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4104ef0 msgr2=0x7f54e4100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54e9b61640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4104ef0 0x7f54e4100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54e9b61640 1 -- 172.21.15.52:0/2911902262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e4101340 con 0x7f54e4107820 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54e9b61640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d720 tx=0x7f54dc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54da7fc640 1 -- 172.21.15.52:0/2911902262 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc017070 con 0x7f54e4107820 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54da7fc640 1 -- 172.21.15.52:0/2911902262 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54dc00de30 con 0x7f54e4107820 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e41a1f80 con 0x7f54e4107820 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54da7fc640 1 -- 172.21.15.52:0/2911902262 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc004d90 con 0x7f54e4107820 2024-09-19T09:35:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.959+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e41a2390 con 0x7f54e4107820 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54da7fc640 1 -- 172.21.15.52:0/2911902262 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f54dc004f30 con 0x7f54e4107820 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 Processor -- start 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 -- start start 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0c9c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ded0bf82f0 con 0x55ded0c949a0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ded0ba0270 con 0x55ded0c952e0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54ee43e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded0bf42b0 con 0x55ded0c9a370 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.962+0000 7f54da7fc640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 0x7f54d00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47498/0 (socket says 172.21.15.52:47498) 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 -- 172.21.15.52:0/3258111756 learned_addr learned my addr 172.21.15.52:0/3258111756 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e9b61640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 0x7f54d00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e9360640 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0c9c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54da7fc640 1 -- 172.21.15.52:0/2911902262 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f54dc0cf200 con 0x7f54e4107820 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 -- 172.21.15.52:0/3258111756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 msgr2=0x55ded0c9c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0c9c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 -- 172.21.15.52:0/3258111756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 msgr2=0x55ded0c99da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c99da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 -- 172.21.15.52:0/3258111756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded0b9f340 con 0x55ded0c949a0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f54d40058a0 tx=0x7f54d400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aeb9bd938dc6b2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54e9b61640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 0x7f54d00a57b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f54dc09b550 tx=0x7f54dc06a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54cf7fe640 1 -- 172.21.15.52:0/3258111756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4004030 con 0x55ded0c949a0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54cf7fe640 1 -- 172.21.15.52:0/3258111756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54d4005500 con 0x55ded0c949a0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.963+0000 7f54cf7fe640 1 -- 172.21.15.52:0/3258111756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4004d60 con 0x55ded0c949a0 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 -- 172.21.15.52:0/3258111756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 msgr2=0x55ded0c94da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f54d40058a0 tx=0x7f54d400b820 comp rx=0 tx=0).stop 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 -- 172.21.15.52:0/3258111756 shutdown_connections 2024-09-19T09:35:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0c9c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c99da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 --2- 172.21.15.52:0/3258111756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c949a0 0x55ded0c94da0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 -- 172.21.15.52:0/3258111756 >> 172.21.15.52:0/3258111756 conn(0x55ded0c90010 msgr2=0x55ded0c90410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 -- 172.21.15.52:0/3258111756 shutdown_connections 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.964+0000 7f54ee43e740 1 -- 172.21.15.52:0/3258111756 wait complete. 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 -- start start 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 Processor -- start 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0c9ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c9f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ded0c9d340 con 0x55ded0c9a370 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ded0b81290 con 0x55ded0c952e0 2024-09-19T09:35:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ded0c9d4c0 con 0x55ded0c949a0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54ee43e740 10 client.0 _ll_register_callbacks cb 0x55ded0bb2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47504/0 (socket says 172.21.15.52:47504) 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4022214363 learned_addr learned my addr 172.21.15.52:0/4022214363 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0c9ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.965+0000 7f54e9360640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c9f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4022214363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 msgr2=0x55ded0c9ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0c9ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 msgr2=0x55ded0c9f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c9f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4022214363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded090b210 con 0x55ded0c9a370 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f54d40057c0 tx=0x7f54d400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530ca2f9790e2468 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:34.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4027040 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d4005500 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f54d4004b00 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54d4012210 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ee43e740 10 client.20523 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.966+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ded09d7620 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54d4005500 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f54d401c020 con 0x55ded0c9a370 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 10 client.20523 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 10 client.20523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 20 client.20523 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0caa570 0x55ded0cac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 4 client.20523 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:34.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded0c05a20 con 0x55ded0caa570 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.967+0000 7f54e9360640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0caa570 0x55ded0cac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ccff9640 10 client.20523 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54e9360640 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0caa570 0x55ded0cac960 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98723a4884da5a5f server_cookie=4d61f6097f395138 in_seq=0 out_seq=0 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ccff9640 1 -- 172.21.15.52:0/4022214363 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ded0c05a20 con 0x55ded0caa570 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ccff9640 10 client.20523 handle_command_reply: tid=0 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 client.20523 shutdown 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 msgr2=0x55ded0ca6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f54d40057c0 tx=0x7f54d400b390 comp rx=0 tx=0).stop 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 shutdown_connections 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0caa570 0x55ded0cac960 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca6140 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0c9f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4022214363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0c9ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ccff9640 0 client.20523 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.968+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 >> 172.21.15.52:0/4022214363 conn(0x55ded0c90010 msgr2=0x55ded0c91820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.969+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 shutdown_connections 2024-09-19T09:35:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.969+0000 7f54ee43e740 1 -- 172.21.15.52:0/4022214363 wait complete. 2024-09-19T09:35:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.969+0000 7f54ee43e740 20 client.20523 trim_cache size 0 max 16384 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.983+0000 7f54ee43e740 1 Processor -- start 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.983+0000 7f54ee43e740 1 -- start start 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c949a0 0x55ded0c91b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0cb1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41add40 con 0x55ded0c952e0 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41ab610 con 0x55ded0c949a0 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ee43e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41a9460 con 0x55ded0c9a370 2024-09-19T09:35:34.988 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47516/0 (socket says 172.21.15.52:47516) 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 -- 172.21.15.52:0/1558401684 learned_addr learned my addr 172.21.15.52:0/1558401684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c949a0 0x55ded0c91b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0cb1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 -- 172.21.15.52:0/1558401684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 msgr2=0x55ded0cb1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0cb1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 -- 172.21.15.52:0/1558401684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c949a0 msgr2=0x55ded0c91b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c949a0 0x55ded0c91b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 -- 172.21.15.52:0/1558401684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded0c8fe30 con 0x55ded0c952e0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0cb1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54e9360640 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f54e002ade0 tx=0x7f54e0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc0acfdd27011c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ceffd640 1 -- 172.21.15.52:0/1558401684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0031650 con 0x55ded0c952e0 2024-09-19T09:35:34.989 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ceffd640 1 -- 172.21.15.52:0/1558401684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54e0036040 con 0x55ded0c952e0 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.984+0000 7f54ceffd640 1 -- 172.21.15.52:0/1558401684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0030820 con 0x55ded0c952e0 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- 172.21.15.52:0/1558401684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 msgr2=0x55ded0ca6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f54e002ade0 tx=0x7f54e0000f40 comp rx=0 tx=0).stop 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- 172.21.15.52:0/1558401684 shutdown_connections 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c9a370 0x55ded0cb1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c952e0 0x55ded0ca6060 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 --2- 172.21.15.52:0/1558401684 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c949a0 0x55ded0c91b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- 172.21.15.52:0/1558401684 >> 172.21.15.52:0/1558401684 conn(0x55ded0c90010 msgr2=0x55ded0c903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- 172.21.15.52:0/1558401684 shutdown_connections 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- 172.21.15.52:0/1558401684 wait complete. 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.985+0000 7f54ee43e740 1 -- start start 2024-09-19T09:35:34.990 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 Processor -- start 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0ca3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0ca3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41a9ad0 con 0x55ded0c9a370 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41aaf40 con 0x55ded0c952e0 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f54e41aa1a0 con 0x55ded0c949a0 2024-09-19T09:35:34.993 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54ee43e740 10 client.0 _ll_register_callbacks cb 0x7f54e0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47528/0 (socket says 172.21.15.52:47528) 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4229743599 learned_addr learned my addr 172.21.15.52:0/4229743599 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0ca3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e9360640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0ca3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4229743599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 msgr2=0x55ded0ca3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0ca3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 msgr2=0x55ded0ca3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.986+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0ca3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54e8b5f640 1 -- 172.21.15.52:0/4229743599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded0ca53a0 con 0x55ded0c9a370 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54e8b5f640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f54d4012e30 tx=0x7f54d40056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abdb5a9aece995a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d400b770 con 0x55ded0c9a370 2024-09-19T09:35:34.994 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f54d4010870 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54e0036040 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f54d4005500 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 10 client.20529 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ded0d15340 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54e0036040 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f54d4041070 con 0x55ded0c9a370 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 10 client.20529 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 10 client.20529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 20 client.20529 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.987+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0d15cd0 0x55ded0d180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.988+0000 7f54ee43e740 4 client.20529 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.988+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ded0bffd70 con 0x55ded0d15cd0 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.988+0000 7f54e9360640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0d15cd0 0x55ded0d180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:34.995 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.988+0000 7f54e9360640 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0d15cd0 0x55ded0d180f0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f6e60cb11728c68 server_cookie=9b4ad7592fd77735 in_seq=0 out_seq=0 2024-09-19T09:35:34.996 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:34.988+0000 7f54ccff9640 10 client.20529 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ccff9640 1 -- 172.21.15.52:0/4229743599 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ded0bffd70 con 0x55ded0d15cd0 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ccff9640 10 client.20529 handle_command_reply: tid=0 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 client.20529 shutdown 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 msgr2=0x55ded0ca4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f54d4012e30 tx=0x7f54d40056b0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.005 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 shutdown_connections 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ded0d15cd0 0x55ded0d180f0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ded0c9a370 0x55ded0ca4d90 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ccff9640 0 client.20529 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ded0c952e0 0x55ded0ca3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 --2- 172.21.15.52:0/4229743599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ded0c949a0 0x55ded0ca3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.002+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 >> 172.21.15.52:0/4229743599 conn(0x55ded0c90010 msgr2=0x55ded0c90c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 shutdown_connections 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54ee43e740 1 -- 172.21.15.52:0/4229743599 wait complete. 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54ee43e740 20 client.20529 trim_cache size 0 max 16384 2024-09-19T09:35:35.006 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:35:35.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:35:35.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:35:35.007 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 msgr2=0x7f54d00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 0x7f54d00a57b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f54dc09b550 tx=0x7f54dc06a590 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 msgr2=0x7f54e4100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d720 tx=0x7f54dc00dbe0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 shutdown_connections 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f54e4107820 0x7f54e4100ab0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f54e4104ef0 0x7f54e4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f54d00a32f0 0x7f54d00a57b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 --2- 172.21.15.52:0/2911902262 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54e41025c0 0x7f54e4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 >> 172.21.15.52:0/2911902262 conn(0x7f54e40fc1e0 msgr2=0x7f54e4102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 shutdown_connections 2024-09-19T09:35:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:35.003+0000 7f54eb5c4640 1 -- 172.21.15.52:0/2911902262 wait complete. 2024-09-19T09:35:35.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:35 smithi052 ceph-mon[30947]: pgmap v762: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:35.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:35 smithi169 ceph-mon[35454]: pgmap v762: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:35.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:35 smithi086 ceph-mon[34813]: pgmap v762: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:37.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:37 smithi052 ceph-mon[30947]: pgmap v763: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:35:37.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:37 smithi169 ceph-mon[35454]: pgmap v763: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:35:37.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:37 smithi086 ceph-mon[34813]: pgmap v763: 97 pgs: 97 active+clean; 3.1 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:35:39.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:39 smithi052 ceph-mon[30947]: pgmap v764: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:35:39.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:39 smithi169 ceph-mon[35454]: pgmap v764: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:35:39.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:39 smithi086 ceph-mon[34813]: pgmap v764: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:35:40.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:40.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:40.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:40.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:35:40.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:40.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:40.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:40.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:35:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:40.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:35:41.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:41 smithi052 ceph-mon[30947]: pgmap v765: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:41.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:41 smithi169 ceph-mon[35454]: pgmap v765: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:41.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:41 smithi086 ceph-mon[34813]: pgmap v765: 97 pgs: 97 active+clean; 3.2 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:42.945 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:35:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:43.595 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:43 smithi052 ceph-mon[30947]: pgmap v766: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:43.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:43 smithi169 ceph-mon[35454]: pgmap v766: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:43.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:43 smithi086 ceph-mon[34813]: pgmap v766: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 -- 172.21.15.52:0/3909803884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 msgr2=0x7fb300106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 --2- 172.21.15.52:0/3909803884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb300106e60 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009930 tx=0x7fb2f002a420 comp rx=0 tx=0).stop 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 -- 172.21.15.52:0/3909803884 shutdown_connections 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 --2- 172.21.15.52:0/3909803884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300101420 0x7fb30010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 --2- 172.21.15.52:0/3909803884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300100a80 0x7fb300100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 --2- 172.21.15.52:0/3909803884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb300106e60 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 -- 172.21.15.52:0/3909803884 >> 172.21.15.52:0/3909803884 conn(0x7fb3000fc7a0 msgr2=0x7fb3000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 -- 172.21.15.52:0/3909803884 shutdown_connections 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 -- 172.21.15.52:0/3909803884 wait complete. 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.808+0000 7fb3053ac640 1 Processor -- start 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 -- start start 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300100a80 0x7fb3001992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300101420 0x7fb300199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb300110e40 con 0x7fb300106a80 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb300110cc0 con 0x7fb300101420 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb3053ac640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb300110fc0 con 0x7fb300100a80 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54198/0 (socket says 172.21.15.52:54198) 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/800321353 learned_addr learned my addr 172.21.15.52:0/800321353 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:43.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2feffd640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300100a80 0x7fb3001992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300101420 0x7fb300199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/800321353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300100a80 msgr2=0x7fb3001992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300100a80 0x7fb3001992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/800321353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300101420 msgr2=0x7fb300199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.809+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300101420 0x7fb300199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/800321353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3001a4890 con 0x7fb300106a80 2024-09-19T09:35:43.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800eaa0 tx=0x7fb2f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb2fcff9640 1 -- 172.21.15.52:0/800321353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800cdb0 con 0x7fb300106a80 2024-09-19T09:35:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3001970c0 con 0x7fb300106a80 2024-09-19T09:35:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb2fcff9640 1 -- 172.21.15.52:0/800321353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f8005020 con 0x7fb300106a80 2024-09-19T09:35:43.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3001975b0 con 0x7fb300106a80 2024-09-19T09:35:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.810+0000 7fb2fcff9640 1 -- 172.21.15.52:0/800321353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80116b0 con 0x7fb300106a80 2024-09-19T09:35:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.812+0000 7fb2fcff9640 1 -- 172.21.15.52:0/800321353 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb2f8004a40 con 0x7fb300106a80 2024-09-19T09:35:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 Processor -- start 2024-09-19T09:35:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 -- start start 2024-09-19T09:35:43.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb2fcff9640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 0x7fb2ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 0x7fb2ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb2fcff9640 1 -- 172.21.15.52:0/800321353 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2f80cfa10 con 0x7fb300106a80 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f2f680 0x55fee3f31a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.813+0000 7fb307785740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fee3e8a2e0 con 0x55fee3f24dc0 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb307785740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fee3e31ce0 con 0x55fee3f244a0 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb307785740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fee3e862a0 con 0x55fee3f2f680 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54206/0 (socket says 172.21.15.52:54206) 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 -- 172.21.15.52:0/2466271174 learned_addr learned my addr 172.21.15.52:0/2466271174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2feffd640 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f2f680 0x55fee3f31a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 0x7fb2ec0a5780 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bfd0 tx=0x7fb2e80138e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 -- 172.21.15.52:0/2466271174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f2f680 msgr2=0x55fee3f31a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f2f680 0x55fee3f31a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 -- 172.21.15.52:0/2466271174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 msgr2=0x55fee3f24880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f24880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 -- 172.21.15.52:0/2466271174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee3e16440 con 0x55fee3f24dc0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.814+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8013de0 tx=0x7fb2e801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3588675647caa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.815+0000 7fb2f57fa640 1 -- 172.21.15.52:0/2466271174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801f700 con 0x55fee3f24dc0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.815+0000 7fb2f57fa640 1 -- 172.21.15.52:0/2466271174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e801fd80 con 0x55fee3f24dc0 2024-09-19T09:35:43.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.815+0000 7fb2f57fa640 1 -- 172.21.15.52:0/2466271174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801ed30 con 0x55fee3f24dc0 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- 172.21.15.52:0/2466271174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 msgr2=0x55fee3f2f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8013de0 tx=0x7fb2e801d000 comp rx=0 tx=0).stop 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- 172.21.15.52:0/2466271174 shutdown_connections 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f2f680 0x55fee3f31a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2f140 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 --2- 172.21.15.52:0/2466271174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f24880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- 172.21.15.52:0/2466271174 >> 172.21.15.52:0/2466271174 conn(0x55fee3f20a30 msgr2=0x55fee3f20e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- 172.21.15.52:0/2466271174 shutdown_connections 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- 172.21.15.52:0/2466271174 wait complete. 2024-09-19T09:35:43.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 -- start start 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 Processor -- start 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.816+0000 7fb307785740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f2ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f2f680 0x55fee3f2c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fee3f32250 con 0x55fee3f24dc0 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55fee3e45050 con 0x55fee3f2f680 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fee3f323d0 con 0x55fee3f244a0 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb307785740 10 client.0 _ll_register_callbacks cb 0x55fee3e85160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54212/0 (socket says 172.21.15.52:54212) 2024-09-19T09:35:43.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 -- 172.21.15.52:0/3734333001 learned_addr learned my addr 172.21.15.52:0/3734333001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f2f680 0x55fee3f2c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2feffd640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f2ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 -- 172.21.15.52:0/3734333001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 msgr2=0x55fee3f2ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f2ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 -- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f2f680 msgr2=0x55fee3f2c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f2f680 0x55fee3f2c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 -- 172.21.15.52:0/3734333001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee3bfb3c0 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bac0 tx=0x7fb2e800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8de1d0f1916e4bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e801e690 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.817+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2e801eab0 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e801fd80 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2e801ecb0 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 10 client.20541 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fee3f3dbc0 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e801fd80 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb2e801f900 con 0x55fee3f24dc0 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 10 client.20541 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 10 client.20541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:43.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 20 client.20541 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3f3f020 0x55fee3f41410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 4 client.20541 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.818+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fee3e97850 con 0x55fee3f3f020 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.819+0000 7fb2feffd640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3f3f020 0x55fee3f41410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.819+0000 7fb2feffd640 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3f3f020 0x55fee3f41410 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722d5b7fb6f06eb7 server_cookie=73f5020be4e07aa8 in_seq=0 out_seq=0 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.819+0000 7fb2e67fc640 10 client.20541 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb2e67fc640 1 -- 172.21.15.52:0/3734333001 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fee3e97850 con 0x55fee3f3f020 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb2e67fc640 10 client.20541 handle_command_reply: tid=0 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 client.20541 shutdown 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 msgr2=0x55fee3f2c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bac0 tx=0x7fb2e800b390 comp rx=0 tx=0).stop 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 shutdown_connections 2024-09-19T09:35:43.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3f3f020 0x55fee3f41410 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f2f680 0x55fee3f2c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f24dc0 0x55fee3f2c1c0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 --2- 172.21.15.52:0/3734333001 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f2ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 >> 172.21.15.52:0/3734333001 conn(0x55fee3f20a30 msgr2=0x55fee3f1fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb2e67fc640 0 client.20541 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 shutdown_connections 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 1 -- 172.21.15.52:0/3734333001 wait complete. 2024-09-19T09:35:43.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.820+0000 7fb307785740 20 client.20541 trim_cache size 0 max 16384 2024-09-19T09:35:43.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.837+0000 7fb307785740 1 Processor -- start 2024-09-19T09:35:43.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.837+0000 7fb307785740 1 -- start start 2024-09-19T09:35:43.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f3b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f24dc0 0x55fee3f27900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0010f40 con 0x55fee3f2f680 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e000e810 con 0x55fee3f24dc0 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb307785740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e000c660 con 0x55fee3f244a0 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54224/0 (socket says 172.21.15.52:54224) 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/246773976 learned_addr learned my addr 172.21.15.52:0/246773976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f24dc0 0x55fee3f27900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2feffd640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f3b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/246773976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 msgr2=0x55fee3f3b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f3b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/246773976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f24dc0 msgr2=0x55fee3f27900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f24dc0 0x55fee3f27900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 -- 172.21.15.52:0/246773976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fee3f24220 con 0x55fee3f2f680 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2feffd640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f3b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.838+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8098920 tx=0x7fb2f809bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731d447e40844664 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb2f4ff9640 1 -- 172.21.15.52:0/246773976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80b4070 con 0x55fee3f2f680 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb2f4ff9640 1 -- 172.21.15.52:0/246773976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f809a250 con 0x55fee3f2f680 2024-09-19T09:35:43.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb2f4ff9640 1 -- 172.21.15.52:0/246773976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f801f040 con 0x55fee3f2f680 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 -- 172.21.15.52:0/246773976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 msgr2=0x55fee3f26570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8098920 tx=0x7fb2f809bda0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 -- 172.21.15.52:0/246773976 shutdown_connections 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f26570 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f24dc0 0x55fee3f27900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 --2- 172.21.15.52:0/246773976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f244a0 0x55fee3f3b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 -- 172.21.15.52:0/246773976 >> 172.21.15.52:0/246773976 conn(0x55fee3f20a30 msgr2=0x55fee3f25e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.839+0000 7fb307785740 1 -- 172.21.15.52:0/246773976 shutdown_connections 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 -- 172.21.15.52:0/246773976 wait complete. 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 -- start start 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 Processor -- start 2024-09-19T09:35:43.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 0x55fee3f37fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f28df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e000ccd0 con 0x55fee3f2f680 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e000e140 con 0x55fee3f244a0 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e000d3a0 con 0x55fee3f24dc0 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.840+0000 7fb307785740 10 client.0 _ll_register_callbacks cb 0x7fb2e8011710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:33134/0 (socket says 172.21.15.52:33134) 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 -- 172.21.15.52:0/1425567964 learned_addr learned my addr 172.21.15.52:0/1425567964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f28df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 -- 172.21.15.52:0/1425567964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 msgr2=0x55fee3f37fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 0x55fee3f37fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 0x55fee3f37fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 -- 172.21.15.52:0/1425567964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 msgr2=0x55fee3f28df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f28df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 -- 172.21.15.52:0/1425567964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fee3f29620 con 0x55fee3f244a0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2ff7fe640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 0x55fee3f37fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2feffd640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0006010 tx=0x7fb2f0031a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9683ad60e3fe2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.841+0000 7fb2e67fc640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f004a070 con 0x55fee3f244a0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2f809a250 con 0x55fee3f244a0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb2f0004450 con 0x55fee3f244a0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb2f0054030 con 0x55fee3f244a0 2024-09-19T09:35:43.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 10 client.29063 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fee3fb2110 con 0x55fee3f244a0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f809a250 con 0x55fee3f244a0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb2f004f730 con 0x55fee3f244a0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 10 client.29063 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 10 client.29063 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 20 client.29063 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.842+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3fb27e0 0x55fee3fb4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 4 client.29063 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fee3e91d60 con 0x55fee3fb27e0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3fb27e0 0x55fee3fb4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2e67fc640 10 client.29063 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2f7fff640 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3fb27e0 0x55fee3fb4c00 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5431721ba3ee38b server_cookie=a80c22afc9448ecb in_seq=0 out_seq=0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2e67fc640 1 -- 172.21.15.52:0/1425567964 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fee3e91d60 con 0x55fee3fb27e0 2024-09-19T09:35:43.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2e67fc640 10 client.29063 handle_command_reply: tid=0 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 client.29063 shutdown 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 msgr2=0x55fee3f37a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0006010 tx=0x7fb2f0031a60 comp rx=0 tx=0).stop 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 shutdown_connections 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55fee3fb27e0 0x55fee3fb4c00 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fee3f2f680 0x55fee3f28df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fee3f24dc0 0x55fee3f37fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 --2- 172.21.15.52:0/1425567964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55fee3f244a0 0x55fee3f37a60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 >> 172.21.15.52:0/1425567964 conn(0x55fee3f20a30 msgr2=0x55fee3f25e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.843+0000 7fb2e67fc640 0 client.29063 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 shutdown_connections 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb307785740 1 -- 172.21.15.52:0/1425567964 wait complete. 2024-09-19T09:35:43.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb307785740 20 client.29063 trim_cache size 0 max 16384 2024-09-19T09:35:43.852 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:43.852 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:35:43.852 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:35:43.852 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 msgr2=0x7fb2ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 0x7fb2ec0a5780 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800bfd0 tx=0x7fb2e80138e0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 msgr2=0x7fb3001a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.844+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800eaa0 tx=0x7fb2f800ef60 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 shutdown_connections 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb300106a80 0x7fb3001a4350 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb300101420 0x7fb300199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb2ec0a32c0 0x7fb2ec0a5780 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 --2- 172.21.15.52:0/800321353 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb300100a80 0x7fb3001992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:43.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 >> 172.21.15.52:0/800321353 conn(0x7fb3000fc7a0 msgr2=0x7fb3000fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:43.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 shutdown_connections 2024-09-19T09:35:43.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:43.845+0000 7fb3053ac640 1 -- 172.21.15.52:0/800321353 wait complete. 2024-09-19T09:35:44.731 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:35:44.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:45.004 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:45.390 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:45 smithi052 ceph-mon[30947]: pgmap v767: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:45.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 -- 172.21.15.52:0/3850097879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080101de0 msgr2=0x7fe0801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 --2- 172.21.15.52:0/3850097879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080101de0 0x7fe0801021c0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fe068009900 tx=0x7fe06802a410 comp rx=0 tx=0).stop 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 -- 172.21.15.52:0/3850097879 shutdown_connections 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 --2- 172.21.15.52:0/3850097879 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080106f10 0x7fe08010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 --2- 172.21.15.52:0/3850097879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080102790 0x7fe0801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 --2- 172.21.15.52:0/3850097879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080101de0 0x7fe0801021c0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 -- 172.21.15.52:0/3850097879 >> 172.21.15.52:0/3850097879 conn(0x7fe0800fd8c0 msgr2=0x7fe0800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 -- 172.21.15.52:0/3850097879 shutdown_connections 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.471+0000 7fe086ca1640 1 -- 172.21.15.52:0/3850097879 wait complete. 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 Processor -- start 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 -- start start 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe080111f90 con 0x7fe080102790 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe080111e10 con 0x7fe080106f10 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe086ca1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe080112110 con 0x7fe080101de0 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe07ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe07ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54248/0 (socket says 172.21.15.52:54248) 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.472+0000 7fe07ffff640 1 -- 172.21.15.52:0/2169235987 learned_addr learned my addr 172.21.15.52:0/2169235987 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe084a3d640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe08523e640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 -- 172.21.15.52:0/2169235987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080101de0 msgr2=0x7fe0800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 -- 172.21.15.52:0/2169235987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080106f10 msgr2=0x7fe080074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 -- 172.21.15.52:0/2169235987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0801a6890 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07ffff640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c920 tx=0x7fe07000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070007c70 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe070007e10 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0801a6b80 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070018890 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.473+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0801a70c0 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.475+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0801021c0 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.476+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe070018a70 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.476+0000 7fe07dffb640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 0x7fe06c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.476+0000 7fe084a3d640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 0x7fe06c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.477+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe0700cfae0 con 0x7fe080102790 2024-09-19T09:35:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.477+0000 7fe084a3d640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 0x7fe06c0a5700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe068000c00 tx=0x7fe0680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:45.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.481+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe070014030 con 0x7fe080102790 2024-09-19T09:35:45.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:45 smithi169 ceph-mon[35454]: pgmap v767: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:45.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.694+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe08010a0f0 con 0x7fe080102790 2024-09-19T09:35:45.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.695+0000 7fe07dffb640 1 -- 172.21.15.52:0/2169235987 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe07009c780 con 0x7fe080102790 2024-09-19T09:35:45.697 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:35:45.698 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:35:45.698 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:35:45.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 msgr2=0x7fe06c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 0x7fe06c0a5700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe068000c00 tx=0x7fe0680058d0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 msgr2=0x7fe080074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c920 tx=0x7fe07000cde0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 shutdown_connections 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe080106f10 0x7fe080074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe080102790 0x7fe080074a30 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe06c0a3240 0x7fe06c0a5700 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 --2- 172.21.15.52:0/2169235987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe080101de0 0x7fe0800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 >> 172.21.15.52:0/2169235987 conn(0x7fe0800fd8c0 msgr2=0x7fe0800fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 shutdown_connections 2024-09-19T09:35:45.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:45.697+0000 7fe086ca1640 1 -- 172.21.15.52:0/2169235987 wait complete. 2024-09-19T09:35:45.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:45 smithi086 ceph-mon[34813]: pgmap v767: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:46.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:46 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2169235987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:46.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:35:46.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:46 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2169235987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:46.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:46 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2169235987' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:46.761 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 -- 172.21.15.52:0/3058430815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 msgr2=0x7f6b8810bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 --2- 172.21.15.52:0/3058430815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b8810bbf0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c009900 tx=0x7f6b7c02a480 comp rx=0 tx=0).stop 2024-09-19T09:35:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 -- 172.21.15.52:0/3058430815 shutdown_connections 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 --2- 172.21.15.52:0/3058430815 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b8810c180 0x7f6b8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 --2- 172.21.15.52:0/3058430815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b8810bbf0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 --2- 172.21.15.52:0/3058430815 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b88102de0 0x7f6b881031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 -- 172.21.15.52:0/3058430815 >> 172.21.15.52:0/3058430815 conn(0x7f6b880fc7a0 msgr2=0x7f6b880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 -- 172.21.15.52:0/3058430815 shutdown_connections 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.208+0000 7f6b8f691640 1 -- 172.21.15.52:0/3058430815 wait complete. 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.209+0000 7f6b8f691640 1 Processor -- start 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.209+0000 7f6b8f691640 1 -- start start 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88102de0 0x7f6b88198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 0x7f6b8819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88111f70 con 0x7f6b88103700 2024-09-19T09:35:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88111df0 con 0x7f6b88102de0 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881120f0 con 0x7f6b8810c180 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54268/0 (socket says 172.21.15.52:54268) 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 -- 172.21.15.52:0/1719744746 learned_addr learned my addr 172.21.15.52:0/1719744746 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88102de0 0x7f6b88198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 0x7f6b8819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 -- 172.21.15.52:0/1719744746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 msgr2=0x7f6b8819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 0x7f6b8819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 -- 172.21.15.52:0/1719744746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88102de0 msgr2=0x7f6b88198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88102de0 0x7f6b88198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 -- 172.21.15.52:0/1719744746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8819d440 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 0x7f6b8819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006010 tx=0x7f6b7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b867fc640 1 -- 172.21.15.52:0/1719744746 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c03f030 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b867fc640 1 -- 172.21.15.52:0/1719744746 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b7c003ce0 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8819d6d0 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.210+0000 7f6b867fc640 1 -- 172.21.15.52:0/1719744746 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c035070 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.211+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b881a5010 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.213+0000 7f6b867fc640 1 -- 172.21.15.52:0/1719744746 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6b7c042030 con 0x7f6b88103700 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 Processor -- start 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 -- start start 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b896090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b867fc640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 0x7f6b700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b896a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56480b7fc2f0 con 0x56480b8a1370 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56480b7a3cf0 con 0x56480b8965d0 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56480b7f82b0 con 0x56480b897b40 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 0x7f6b700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b867fc640 1 -- 172.21.15.52:0/1719744746 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b7c0f00b0 con 0x7f6b88103700 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54280/0 (socket says 172.21.15.52:54280) 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/4107270003 learned_addr learned my addr 172.21.15.52:0/4107270003 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b896090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b896a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/4107270003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 msgr2=0x56480b896090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b896090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/4107270003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 msgr2=0x56480b896a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b896a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.214+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/4107270003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480b7883a0 con 0x56480b8a1370 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.215+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 0x7f6b700a5700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005fd0 tx=0x7f6b78009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.215+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000dfb0 tx=0x7f6b8000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9faf469306ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.215+0000 7f6b6f7fe640 1 -- 172.21.15.52:0/4107270003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80012860 con 0x56480b8a1370 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.215+0000 7f6b6f7fe640 1 -- 172.21.15.52:0/4107270003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b80011440 con 0x56480b8a1370 2024-09-19T09:35:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.215+0000 7f6b6f7fe640 1 -- 172.21.15.52:0/4107270003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b800105d0 con 0x56480b8a1370 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- 172.21.15.52:0/4107270003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 msgr2=0x56480b8a3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000dfb0 tx=0x7f6b8000d4c0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- 172.21.15.52:0/4107270003 shutdown_connections 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a3760 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b896a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/4107270003 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b896090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- 172.21.15.52:0/4107270003 >> 172.21.15.52:0/4107270003 conn(0x56480b85f310 msgr2=0x56480b892c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- 172.21.15.52:0/4107270003 shutdown_connections 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- 172.21.15.52:0/4107270003 wait complete. 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 -- start start 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.216+0000 7f6b91a6a740 1 Processor -- start 2024-09-19T09:35:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b897b40 0x56480b89dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b8a1370 0x56480b89e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56480b8a4070 con 0x56480b8965d0 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56480b7b7060 con 0x56480b897b40 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56480b8a41f0 con 0x56480b8a1370 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 10 client.0 _ll_register_callbacks cb 0x56480b50a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54296/0 (socket says 172.21.15.52:54296) 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 -- 172.21.15.52:0/1486046074 learned_addr learned my addr 172.21.15.52:0/1486046074 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b897b40 0x56480b89dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b8a1370 0x56480b89e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 -- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b8a1370 msgr2=0x56480b89e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b8a1370 0x56480b89e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 -- 172.21.15.52:0/1486046074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b897b40 msgr2=0x56480b89dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b897b40 0x56480b89dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 -- 172.21.15.52:0/1486046074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480b56d3c0 con 0x56480b8965d0 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f6b780128a0 tx=0x7f6b78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a44bfe3664fe18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78023070 con 0x56480b8965d0 2024-09-19T09:35:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b78011cf0 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.217+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b80011440 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b7802f050 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 10 client.20565 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56480b8afb40 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b80011440 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b7800f040 con 0x56480b8965d0 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 10 client.20565 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 10 client.20565 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 20 client.20565 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b8b0f50 0x56480b8b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 4 client.20565 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.218+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56480b809860 con 0x56480b8b0f50 2024-09-19T09:35:47.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.219+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b8b0f50 0x56480b8b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.219+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b8b0f50 0x56480b8b33b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43bbc6962ae7756f server_cookie=e987488f3b3fe803 in_seq=0 out_seq=0 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.219+0000 7f6b6cff9640 10 client.20565 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1486046074 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56480b809860 con 0x56480b8b0f50 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b6cff9640 10 client.20565 handle_command_reply: tid=0 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 client.20565 shutdown 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 msgr2=0x56480b8a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f6b780128a0 tx=0x7f6b78004a40 comp rx=0 tx=0).stop 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 shutdown_connections 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b8b0f50 0x56480b8b33b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b8a1370 0x56480b89e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b897b40 0x56480b89dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b6cff9640 0 client.20565 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:47.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1486046074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8965d0 0x56480b8a0d40 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 >> 172.21.15.52:0/1486046074 conn(0x56480b85f310 msgr2=0x56480b898960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 shutdown_connections 2024-09-19T09:35:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1486046074 wait complete. 2024-09-19T09:35:47.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.220+0000 7f6b91a6a740 20 client.20565 trim_cache size 0 max 16384 2024-09-19T09:35:47.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.233+0000 7f6b91a6a740 1 Processor -- start 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.233+0000 7f6b91a6a740 1 -- start start 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.233+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.233+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b89ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.233+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881b00f0 con 0x56480b8a1370 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ad9c0 con 0x56480b8965d0 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ab810 con 0x56480b897b40 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54300/0 (socket says 172.21.15.52:54300) 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/493439448 learned_addr learned my addr 172.21.15.52:0/493439448 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b89ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/493439448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 msgr2=0x56480b89ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b89ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/493439448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 msgr2=0x56480b8ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/493439448 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56480b8b3a30 con 0x56480b8a1370 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011e40 tx=0x7f6b800058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88690ba52f552429 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b6effd640 1 -- 172.21.15.52:0/493439448 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80012860 con 0x56480b8a1370 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b6effd640 1 -- 172.21.15.52:0/493439448 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b80011440 con 0x56480b8a1370 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.234+0000 7f6b6effd640 1 -- 172.21.15.52:0/493439448 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8001d660 con 0x56480b8a1370 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- 172.21.15.52:0/493439448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 msgr2=0x56480b8b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f6b80011e40 tx=0x7f6b800058d0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- 172.21.15.52:0/493439448 shutdown_connections 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8b8cd0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b89ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/493439448 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- 172.21.15.52:0/493439448 >> 172.21.15.52:0/493439448 conn(0x56480b85f310 msgr2=0x56480b89f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- 172.21.15.52:0/493439448 shutdown_connections 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- 172.21.15.52:0/493439448 wait complete. 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 -- start start 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.235+0000 7f6b91a6a740 1 Processor -- start 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8a9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b8a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881abe80 con 0x56480b8a1370 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ad2f0 con 0x56480b8965d0 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ac550 con 0x56480b897b40 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b91a6a740 10 client.0 _ll_register_callbacks cb 0x7f6b78016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54310/0 (socket says 172.21.15.52:54310) 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/1719151050 learned_addr learned my addr 172.21.15.52:0/1719151050 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b8a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 msgr2=0x56480b8a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b8a9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/1719151050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 msgr2=0x56480b8a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8dc2e640 1 -- 172.21.15.52:0/1719151050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56480b8a6af0 con 0x56480b8a1370 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.236+0000 7f6b8cc2c640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b8a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b8dc2e640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000de30 tx=0x7f6b8000d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cfe140c25dc70e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80011a00 con 0x56480b8a1370 2024-09-19T09:35:47.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b80011ba0 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b80011440 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b80011e70 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 10 client.20571 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56480b91c630 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b80011440 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b80025020 con 0x56480b8a1370 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 10 client.20571 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 10 client.20571 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 20 client.20571 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b91ca50 0x56480b91ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 4 client.20571 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.237+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56480b803d70 con 0x56480b91ca50 2024-09-19T09:35:47.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b91ca50 0x56480b91ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b8d42d640 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b91ca50 0x56480b91ee70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e8a86f2371a812c server_cookie=5b0c5d11a5348132 in_seq=0 out_seq=0 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b6cff9640 10 client.20571 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b6cff9640 1 -- 172.21.15.52:0/1719151050 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56480b803d70 con 0x56480b91ca50 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b6cff9640 10 client.20571 handle_command_reply: tid=0 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 client.20571 shutdown 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 msgr2=0x56480b8a6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000de30 tx=0x7f6b8000d9a0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 shutdown_connections 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x56480b91ca50 0x56480b91ee70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.238+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56480b8a1370 0x56480b8a6450 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56480b897b40 0x56480b8a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 1 --2- 172.21.15.52:0/1719151050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56480b8965d0 0x56480b8a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 >> 172.21.15.52:0/1719151050 conn(0x56480b85f310 msgr2=0x56480b891d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b6cff9640 0 client.20571 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:47.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 shutdown_connections 2024-09-19T09:35:47.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 1 -- 172.21.15.52:0/1719151050 wait complete. 2024-09-19T09:35:47.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b91a6a740 20 client.20571 trim_cache size 0 max 16384 2024-09-19T09:35:47.254 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 msgr2=0x7f6b700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 0x7f6b700a5700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005fd0 tx=0x7f6b78009680 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 msgr2=0x7f6b881989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c006010 tx=0x7f6b7c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 shutdown_connections 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b700a3240 0x7f6b700a5700 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b8810c180 0x7f6b8819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b88103700 0x7f6b881989d0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 --2- 172.21.15.52:0/1719744746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b88102de0 0x7f6b88198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 >> 172.21.15.52:0/1719744746 conn(0x7f6b880fc7a0 msgr2=0x7f6b880fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:47.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 shutdown_connections 2024-09-19T09:35:47.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:47.239+0000 7f6b8f691640 1 -- 172.21.15.52:0/1719744746 wait complete. 2024-09-19T09:35:47.627 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:47 smithi052 ceph-mon[30947]: pgmap v768: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:47.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:47 smithi169 ceph-mon[35454]: pgmap v768: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:47.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:47 smithi086 ceph-mon[34813]: pgmap v768: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:35:48.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:35:48.104 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.100+0000 7f12bebfd640 1 -- 172.21.15.52:0/3695107086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 msgr2=0x7f12b8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.104 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.100+0000 7f12bebfd640 1 --2- 172.21.15.52:0/3695107086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b8108e80 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009ca0 tx=0x7f12b002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.104 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.100+0000 7f12bebfd640 1 -- 172.21.15.52:0/3695107086 shutdown_connections 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.100+0000 7f12bebfd640 1 --2- 172.21.15.52:0/3695107086 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b8108e80 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 --2- 172.21.15.52:0/3695107086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 0x7f12b81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 --2- 172.21.15.52:0/3695107086 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 0x7f12b8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- 172.21.15.52:0/3695107086 >> 172.21.15.52:0/3695107086 conn(0x7f12b80fc1e0 msgr2=0x7f12b80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- 172.21.15.52:0/3695107086 shutdown_connections 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- 172.21.15.52:0/3695107086 wait complete. 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 Processor -- start 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- start start 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 0x7f12b8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 0x7f12b81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.105 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b810d810 con 0x7f12b81025f0 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f12b810d690 con 0x7f12b8101c30 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bebfd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12b810d990 con 0x7f12b8100a40 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.101+0000 7f12bd19a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52176/0 (socket says 172.21.15.52:52176) 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 -- 172.21.15.52:0/514878682 learned_addr learned my addr 172.21.15.52:0/514878682 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12affff640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 0x7f12b81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.106 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bc999640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 0x7f12b8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 -- 172.21.15.52:0/514878682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 msgr2=0x7f12b8197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 0x7f12b8197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 -- 172.21.15.52:0/514878682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 msgr2=0x7f12b81982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 0x7f12b81982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 -- 172.21.15.52:0/514878682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b819f980 con 0x7f12b81025f0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bd19a640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f12b0005e30 tx=0x7f12b0031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12adffb640 1 -- 172.21.15.52:0/514878682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0003c30 con 0x7f12b81025f0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12adffb640 1 -- 172.21.15.52:0/514878682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b0003dd0 con 0x7f12b81025f0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b819fc10 con 0x7f12b81025f0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12adffb640 1 -- 172.21.15.52:0/514878682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b002fde0 con 0x7f12b81025f0 2024-09-19T09:35:48.107 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.102+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b81a01b0 con 0x7f12b81025f0 2024-09-19T09:35:48.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 Processor -- start 2024-09-19T09:35:48.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12adffb640 1 -- 172.21.15.52:0/514878682 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f12b0004050 con 0x7f12b81025f0 2024-09-19T09:35:48.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 -- start start 2024-09-19T09:35:48.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173578da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x56517357dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5651734dc2f0 con 0x56517357e370 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x565173484270 con 0x5651735792e0 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.105+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5651734d82b0 con 0x5651735789a0 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52188/0 (socket says 172.21.15.52:52188) 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 -- 172.21.15.52:0/2214012362 learned_addr learned my addr 172.21.15.52:0/2214012362 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173578da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12bc999640 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x56517357dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12adffb640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 0x7f12a00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 -- 172.21.15.52:0/2214012362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 msgr2=0x565173578da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173578da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 -- 172.21.15.52:0/2214012362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 msgr2=0x56517357dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x56517357dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 -- 172.21.15.52:0/2214012362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565173483340 con 0x56517357e370 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12bd19a640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 0x7f12a00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12adffb640 1 -- 172.21.15.52:0/514878682 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f12b00f0c80 con 0x7f12b81025f0 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f12affff640 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f12a8012530 tx=0x7f12a800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3185271d78c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f129effd640 1 -- 172.21.15.52:0/2214012362 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8004220 con 0x56517357e370 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f129effd640 1 -- 172.21.15.52:0/2214012362 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a80043c0 con 0x56517357e370 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.106+0000 7f129effd640 1 -- 172.21.15.52:0/2214012362 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8010970 con 0x56517357e370 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 -- 172.21.15.52:0/2214012362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 msgr2=0x565173580830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12bd19a640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 0x7f12a00a5830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f12b00b9680 tx=0x7f12b003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f12a8012530 tx=0x7f12a800b650 comp rx=0 tx=0).stop 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 -- 172.21.15.52:0/2214012362 shutdown_connections 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173580830 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x56517357dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/2214012362 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173578da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 -- 172.21.15.52:0/2214012362 >> 172.21.15.52:0/2214012362 conn(0x565173574010 msgr2=0x565173574410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 -- 172.21.15.52:0/2214012362 shutdown_connections 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.107+0000 7f12c1a7a740 1 -- 172.21.15.52:0/2214012362 wait complete. 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 -- start start 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 Processor -- start 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173582c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56517357e370 0x56517358a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x565173581340 con 0x5651735792e0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x565173465290 con 0x5651735789a0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5651735814c0 con 0x56517357e370 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12c1a7a740 10 client.0 _ll_register_callbacks cb 0x565173496140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.108+0000 7f12bc999640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52200/0 (socket says 172.21.15.52:52200) 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 -- 172.21.15.52:0/3910864069 learned_addr learned my addr 172.21.15.52:0/3910864069 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12affff640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173582c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12affff640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56517357e370 0x56517358a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 -- 172.21.15.52:0/3910864069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56517357e370 msgr2=0x56517358a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56517357e370 0x56517358a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 -- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 msgr2=0x565173582c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173582c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 -- 172.21.15.52:0/3910864069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651731ef210 con 0x5651735792e0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12affff640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173582c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12bc999640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f12b400be20 tx=0x7f12b4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62e9811e14ba135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f1297fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4005220 con 0x5651735792e0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f12b40053c0 con 0x5651735792e0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a80043c0 con 0x5651735792e0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f12b4021020 con 0x5651735792e0 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12c1a7a740 10 client.20583 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:48.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.109+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5651732bb620 con 0x5651735792e0 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a80043c0 con 0x5651735792e0 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f12b4010ad0 con 0x5651735792e0 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 10 client.20583 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 10 client.20583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 20 client.20583 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56517358e890 0x565173590ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 4 client.20583 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651734e9a20 con 0x56517358e890 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.110+0000 7f12affff640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56517358e890 0x565173590ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.111+0000 7f12affff640 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56517358e890 0x565173590ce0 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2e2608e0d06ae5 server_cookie=36e4c2746da28ec8 in_seq=0 out_seq=0 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.111+0000 7f1297fff640 10 client.20583 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:48.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.111+0000 7f1297fff640 1 -- 172.21.15.52:0/3910864069 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651734e9a20 con 0x56517358e890 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.111+0000 7f1297fff640 10 client.20583 handle_command_reply: tid=0 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.111+0000 7f12c1a7a740 1 client.20583 shutdown 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 msgr2=0x5651735831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f12b400be20 tx=0x7f12b4012820 comp rx=0 tx=0).stop 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 shutdown_connections 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56517358e890 0x565173590ce0 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56517357e370 0x56517358a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5651735792e0 0x5651735831a0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3910864069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173582c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f1297fff640 0 client.20583 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 >> 172.21.15.52:0/3910864069 conn(0x565173574010 msgr2=0x565173575820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 shutdown_connections 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3910864069 wait complete. 2024-09-19T09:35:48.122 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.112+0000 7f12c1a7a740 20 client.20583 trim_cache size 0 max 16384 2024-09-19T09:35:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 Processor -- start 2024-09-19T09:35:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 -- start start 2024-09-19T09:35:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173575b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735792e0 0x56517358a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81aba00 con 0x56517357e370 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81a92d0 con 0x5651735789a0 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.126+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81a7120 con 0x5651735792e0 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52204/0 (socket says 172.21.15.52:52204) 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 -- 172.21.15.52:0/1922647204 learned_addr learned my addr 172.21.15.52:0/1922647204 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12bc999640 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735792e0 0x56517358a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173575b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 -- 172.21.15.52:0/1922647204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735792e0 msgr2=0x56517358a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735792e0 0x56517358a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.134 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 -- 172.21.15.52:0/1922647204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 msgr2=0x565173575b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173575b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 -- 172.21.15.52:0/1922647204 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565173573e30 con 0x56517357e370 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f12affff640 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005940 tx=0x7f12a8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177f86d70cdd58e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f129e7fc640 1 -- 172.21.15.52:0/1922647204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8003fc0 con 0x56517357e370 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f129e7fc640 1 -- 172.21.15.52:0/1922647204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a8021040 con 0x56517357e370 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.127+0000 7f129e7fc640 1 -- 172.21.15.52:0/1922647204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8010820 con 0x56517357e370 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 -- 172.21.15.52:0/1922647204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 msgr2=0x565173595630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005940 tx=0x7f12a8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 -- 172.21.15.52:0/1922647204 shutdown_connections 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x565173595630 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735792e0 0x56517358a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/1922647204 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735789a0 0x565173575b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.135 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 -- 172.21.15.52:0/1922647204 >> 172.21.15.52:0/1922647204 conn(0x565173574010 msgr2=0x5651735743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 -- 172.21.15.52:0/1922647204 shutdown_connections 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.128+0000 7f12c1a7a740 1 -- 172.21.15.52:0/1922647204 wait complete. 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 -- start start 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 Processor -- start 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173587e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x5651735883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81a7790 con 0x56517357e370 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81a8c00 con 0x5651735792e0 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f12b81a7e60 con 0x5651735789a0 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12c1a7a740 10 client.0 _ll_register_callbacks cb 0x7f12b400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.129+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.136 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52206/0 (socket says 172.21.15.52:52206) 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 -- 172.21.15.52:0/3247355718 learned_addr learned my addr 172.21.15.52:0/3247355718 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173587e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12bc999640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x5651735883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 -- 172.21.15.52:0/3247355718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 msgr2=0x565173587e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173587e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 -- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 msgr2=0x5651735883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x5651735883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 -- 172.21.15.52:0/3247355718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651735899d0 con 0x56517357e370 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12bc999640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x5651735883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12affff640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b960 tx=0x7f12a8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffe97e58752fcf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.137 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f1297fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80041b0 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f12a8030070 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a8021040 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f12a8004350 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12c1a7a740 10 client.20589 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.130+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5651735f9bc0 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a8021040 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f12a801c070 con 0x56517357e370 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 10 client.20589 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:48.138 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 10 client.20589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 20 client.20589 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5651735fa350 0x5651735fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 4 client.20589 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651734e3d70 con 0x5651735fa350 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.131+0000 7f12bc999640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5651735fa350 0x5651735fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.132+0000 7f12bc999640 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5651735fa350 0x5651735fc770 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90cd37465e9d6df4 server_cookie=f6089e9907a9f1bb in_seq=0 out_seq=0 2024-09-19T09:35:48.139 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.132+0000 7f1297fff640 10 client.20589 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f1297fff640 1 -- 172.21.15.52:0/3247355718 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651734e3d70 con 0x5651735fa350 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f1297fff640 10 client.20589 handle_command_reply: tid=0 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 client.20589 shutdown 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 msgr2=0x5651735893c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b960 tx=0x7f12a8005740 comp rx=0 tx=0).stop 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 shutdown_connections 2024-09-19T09:35:48.148 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5651735fa350 0x5651735fc770 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56517357e370 0x5651735893c0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5651735792e0 0x5651735883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 --2- 172.21.15.52:0/3247355718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5651735789a0 0x565173587e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f1297fff640 0 client.20589 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 >> 172.21.15.52:0/3247355718 conn(0x565173574010 msgr2=0x5651735743f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 shutdown_connections 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.146+0000 7f12c1a7a740 1 -- 172.21.15.52:0/3247355718 wait complete. 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12c1a7a740 20 client.20589 trim_cache size 0 max 16384 2024-09-19T09:35:48.149 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:35:48.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:35:48.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:35:48.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:35:48.150 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 msgr2=0x7f12a00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 0x7f12a00a5830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f12b00b9680 tx=0x7f12b003d040 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 msgr2=0x7f12b819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f12b0005e30 tx=0x7f12b0031ee0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 shutdown_connections 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12b81025f0 0x7f12b819f310 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f12b8101c30 0x7f12b81982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f12a00a3370 0x7f12a00a5830 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 --2- 172.21.15.52:0/514878682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f12b8100a40 0x7f12b8197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 >> 172.21.15.52:0/514878682 conn(0x7f12b80fc1e0 msgr2=0x7f12b8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 shutdown_connections 2024-09-19T09:35:48.151 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:35:48.147+0000 7f12bebfd640 1 -- 172.21.15.52:0/514878682 wait complete. 2024-09-19T09:35:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:48.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 -- 172.21.15.52:0/1649121536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 msgr2=0x7f2d3c110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 --2- 172.21.15.52:0/1649121536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c110910 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009ca0 tx=0x7f2d2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 -- 172.21.15.52:0/1649121536 shutdown_connections 2024-09-19T09:35:48.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 --2- 172.21.15.52:0/1649121536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c110910 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 --2- 172.21.15.52:0/1649121536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c101440 0x7f2d3c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 --2- 172.21.15.52:0/1649121536 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c100b20 0x7f2d3c100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 -- 172.21.15.52:0/1649121536 >> 172.21.15.52:0/1649121536 conn(0x7f2d3c0fc7d0 msgr2=0x7f2d3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 -- 172.21.15.52:0/1649121536 shutdown_connections 2024-09-19T09:35:48.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.790+0000 7f2d436f3640 1 -- 172.21.15.52:0/1649121536 wait complete. 2024-09-19T09:35:48.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.791+0000 7f2d436f3640 1 Processor -- start 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.791+0000 7f2d436f3640 1 -- start start 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c100b20 0x7f2d3c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c101440 0x7f2d3c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1142d0 con 0x7f2d3c10e500 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c114150 con 0x7f2d3c101440 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d436f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c114450 con 0x7f2d3c100b20 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52226/0 (socket says 172.21.15.52:52226) 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 -- 172.21.15.52:0/79107807 learned_addr learned my addr 172.21.15.52:0/79107807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c101440 0x7f2d3c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d4148f640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c100b20 0x7f2d3c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 -- 172.21.15.52:0/79107807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c100b20 msgr2=0x7f2d3c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c100b20 0x7f2d3c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 -- 172.21.15.52:0/79107807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c101440 msgr2=0x7f2d3c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c101440 0x7f2d3c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 -- 172.21.15.52:0/79107807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3c19f6a0 con 0x7f2d3c10e500 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d41c90640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c031f80 tx=0x7f2d2c031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.792+0000 7f2d3a7fc640 1 -- 172.21.15.52:0/79107807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003b70 con 0x7f2d3c10e500 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.793+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c19f930 con 0x7f2d3c10e500 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.793+0000 7f2d3a7fc640 1 -- 172.21.15.52:0/79107807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d2c003d10 con 0x7f2d3c10e500 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.793+0000 7f2d3a7fc640 1 -- 172.21.15.52:0/79107807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004760 con 0x7f2d3c10e500 2024-09-19T09:35:48.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.793+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d3c1a7270 con 0x7f2d3c10e500 2024-09-19T09:35:48.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.795+0000 7f2d3a7fc640 1 -- 172.21.15.52:0/79107807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2d2c02f710 con 0x7f2d3c10e500 2024-09-19T09:35:48.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.795+0000 7f2d45acc740 1 Processor -- start 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.795+0000 7f2d45acc740 1 -- start start 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55749963d2f0 con 0x5574996d75d0 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5574995e4cf0 con 0x5574996e2370 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d45acc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5574996392b0 con 0x5574996d8b40 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52234/0 (socket says 172.21.15.52:52234) 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 -- 172.21.15.52:0/185619282 learned_addr learned my addr 172.21.15.52:0/185619282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d3a7fc640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 0x7f2d240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d41c90640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 0x7f2d240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 -- 172.21.15.52:0/185619282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 msgr2=0x5574996d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 -- 172.21.15.52:0/185619282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 msgr2=0x5574996e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d4148f640 1 -- 172.21.15.52:0/185619282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574995c93a0 con 0x5574996d75d0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.796+0000 7f2d3a7fc640 1 -- 172.21.15.52:0/79107807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2d2c0f0cc0 con 0x7f2d3c10e500 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.797+0000 7f2d4148f640 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400cc60 tx=0x7f2d3400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53ed5280b40e342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.797+0000 7f2d41c90640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 0x7f2d240a5700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02fe30 tx=0x7f2d2c0b8ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.797+0000 7f2d237fe640 1 -- 172.21.15.52:0/185619282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34014070 con 0x5574996d75d0 2024-09-19T09:35:48.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.797+0000 7f2d237fe640 1 -- 172.21.15.52:0/185619282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d340047a0 con 0x5574996d75d0 2024-09-19T09:35:48.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.797+0000 7f2d237fe640 1 -- 172.21.15.52:0/185619282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d34010720 con 0x5574996d75d0 2024-09-19T09:35:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- 172.21.15.52:0/185619282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 msgr2=0x5574996d7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f2d3400cc60 tx=0x7f2d3400e720 comp rx=0 tx=0).stop 2024-09-19T09:35:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- 172.21.15.52:0/185619282 shutdown_connections 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996d7a10 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 --2- 172.21.15.52:0/185619282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- 172.21.15.52:0/185619282 >> 172.21.15.52:0/185619282 conn(0x5574996a0310 msgr2=0x5574996d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- 172.21.15.52:0/185619282 shutdown_connections 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- 172.21.15.52:0/185619282 wait complete. 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 -- start start 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.798+0000 7f2d45acc740 1 Processor -- start 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996df030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996df640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5574996e5070 con 0x5574996d75d0 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5574995f8060 con 0x5574996e2370 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5574996e51f0 con 0x5574996d8b40 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d45acc740 10 client.0 _ll_register_callbacks cb 0x55749934b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52248/0 (socket says 172.21.15.52:52248) 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 -- 172.21.15.52:0/3346534465 learned_addr learned my addr 172.21.15.52:0/3346534465 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d4148f640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 -- 172.21.15.52:0/3346534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 msgr2=0x5574996df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996df030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 -- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 msgr2=0x5574996df640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 -- 172.21.15.52:0/3346534465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574993ae3c0 con 0x5574996d75d0 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d4148f640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f2d30013330 tx=0x7f2d300137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba221d8ec2ff8474 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.799+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30015800 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2d300159a0 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d340047a0 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d30022030 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 10 client.20601 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5574996f0b10 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d340047a0 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2d3001d400 con 0x5574996d75d0 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 10 client.20601 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 10 client.20601 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 20 client.20601 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5574996f1fd0 0x5574996f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 4 client.20601 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.800+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55749964a860 con 0x5574996f1fd0 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.801+0000 7f2d4148f640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5574996f1fd0 0x5574996f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.801+0000 7f2d20ff9640 10 client.20601 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.801+0000 7f2d4148f640 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5574996f1fd0 0x5574996f43e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=652d075b49caa9a server_cookie=4058756eddaac60a in_seq=0 out_seq=0 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d20ff9640 1 -- 172.21.15.52:0/3346534465 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55749964a860 con 0x5574996f1fd0 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d20ff9640 10 client.20601 handle_command_reply: tid=0 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 client.20601 shutdown 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 msgr2=0x5574996e1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f2d30013330 tx=0x7f2d300137f0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 shutdown_connections 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5574996f1fd0 0x5574996f43e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996e2370 0x5574996df640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996df030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 --2- 172.21.15.52:0/3346534465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996d75d0 0x5574996e1d80 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d20ff9640 0 client.20601 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 >> 172.21.15.52:0/3346534465 conn(0x5574996a0310 msgr2=0x5574996d9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 shutdown_connections 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 1 -- 172.21.15.52:0/3346534465 wait complete. 2024-09-19T09:35:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.802+0000 7f2d45acc740 20 client.20601 trim_cache size 0 max 16384 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.815+0000 7f2d45acc740 1 Processor -- start 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.815+0000 7f2d45acc740 1 -- start start 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1b2210 con 0x5574996e2370 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1afae0 con 0x5574996d75d0 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d45acc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1ad930 con 0x5574996d8b40 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52260/0 (socket says 172.21.15.52:52260) 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2377382357 learned_addr learned my addr 172.21.15.52:0/2377382357 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d4148f640 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2377382357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 msgr2=0x5574996e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996e14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2377382357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 msgr2=0x5574996e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2377382357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574996f4a60 con 0x5574996e2370 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006f10 tx=0x7f2d30001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35be7e4903b09687 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d22ffd640 1 -- 172.21.15.52:0/2377382357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3002c070 con 0x5574996e2370 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d22ffd640 1 -- 172.21.15.52:0/2377382357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d3002d040 con 0x5574996e2370 2024-09-19T09:35:48.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.816+0000 7f2d22ffd640 1 -- 172.21.15.52:0/2377382357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30015e60 con 0x5574996e2370 2024-09-19T09:35:48.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- 172.21.15.52:0/2377382357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 msgr2=0x5574996da120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006f10 tx=0x7f2d30001e70 comp rx=0 tx=0).stop 2024-09-19T09:35:48.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- 172.21.15.52:0/2377382357 shutdown_connections 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996da120 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2377382357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- 172.21.15.52:0/2377382357 >> 172.21.15.52:0/2377382357 conn(0x5574996a0310 msgr2=0x5574996e0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- 172.21.15.52:0/2377382357 shutdown_connections 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- 172.21.15.52:0/2377382357 wait complete. 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 -- start start 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.817+0000 7f2d45acc740 1 Processor -- start 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1adfa0 con 0x5574996e2370 2024-09-19T09:35:48.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1af410 con 0x5574996d75d0 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3c1ae670 con 0x5574996d8b40 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d45acc740 10 client.0 _ll_register_callbacks cb 0x7f2d300095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52266/0 (socket says 172.21.15.52:52266) 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2761061154 learned_addr learned my addr 172.21.15.52:0/2761061154 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d4148f640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2761061154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 msgr2=0x5574996dbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996dbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 msgr2=0x5574996eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.818+0000 7f2d40c8e640 1 -- 172.21.15.52:0/2761061154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574996dcb00 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d40c8e640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f2d3001d9c0 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e91b842a7a3c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3002c070 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2d30015600 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d3002d040 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d30015a10 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 10 client.20607 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55749975cc80 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d3002d040 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2d30034650 con 0x5574996e2370 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 10 client.20607 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 10 client.20607 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:48.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 20 client.20607 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55749975d210 0x55749975f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 4 client.20607 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.819+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557499644d70 con 0x55749975d210 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d4148f640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55749975d210 0x55749975f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d4148f640 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55749975d210 0x55749975f630 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89632b49f5d3b9dc server_cookie=8ded4fc8766f0695 in_seq=0 out_seq=0 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d20ff9640 10 client.20607 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d20ff9640 1 -- 172.21.15.52:0/2761061154 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557499644d70 con 0x55749975d210 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d20ff9640 10 client.20607 handle_command_reply: tid=0 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 client.20607 shutdown 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 msgr2=0x5574996dc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f2d3001d9c0 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 shutdown_connections 2024-09-19T09:35:48.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5574996e2370 0x5574996dc300 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574996d8b40 0x5574996dbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x55749975d210 0x55749975f630 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 --2- 172.21.15.52:0/2761061154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5574996d75d0 0x5574996eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d20ff9640 0 client.20607 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.820+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 >> 172.21.15.52:0/2761061154 conn(0x5574996a0310 msgr2=0x5574996e10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 shutdown_connections 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d45acc740 1 -- 172.21.15.52:0/2761061154 wait complete. 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d45acc740 20 client.20607 trim_cache size 0 max 16384 2024-09-19T09:35:48.828 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 msgr2=0x7f2d240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 0x7f2d240a5700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02fe30 tx=0x7f2d2c0b8ea0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 msgr2=0x7f2d3c19efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c031f80 tx=0x7f2d2c031a60 comp rx=0 tx=0).stop 2024-09-19T09:35:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 shutdown_connections 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d3c10e500 0x7f2d3c19efc0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d3c101440 0x7f2d3c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2d240a3240 0x7f2d240a5700 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 --2- 172.21.15.52:0/79107807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d3c100b20 0x7f2d3c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 >> 172.21.15.52:0/79107807 conn(0x7f2d3c0fc7d0 msgr2=0x7f2d3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 shutdown_connections 2024-09-19T09:35:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:48.821+0000 7f2d436f3640 1 -- 172.21.15.52:0/79107807 wait complete. 2024-09-19T09:35:49.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:35:49.629 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:49 smithi052 ceph-mon[30947]: pgmap v769: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:49.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:49 smithi169 ceph-mon[35454]: pgmap v769: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:49.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:49 smithi086 ceph-mon[34813]: pgmap v769: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:49.867 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 -- 172.21.15.52:0/4269283106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 msgr2=0x7f32fc114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 --2- 172.21.15.52:0/4269283106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc114f90 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009ca0 tx=0x7f32f402a950 comp rx=0 tx=0).stop 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 -- 172.21.15.52:0/4269283106 shutdown_connections 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 --2- 172.21.15.52:0/4269283106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc114f90 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 --2- 172.21.15.52:0/4269283106 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074eb0 0x7f32fc112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 --2- 172.21.15.52:0/4269283106 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074590 0x7f32fc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 -- 172.21.15.52:0/4269283106 >> 172.21.15.52:0/4269283106 conn(0x7f32fc0fd8b0 msgr2=0x7f32fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 -- 172.21.15.52:0/4269283106 shutdown_connections 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.365+0000 7f330405d640 1 -- 172.21.15.52:0/4269283106 wait complete. 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 Processor -- start 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 -- start start 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074590 0x7f32fc1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074eb0 0x7f32fc1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc118560 con 0x7f32fc112ba0 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1183e0 con 0x7f32fc074590 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f330405d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1186e0 con 0x7f32fc074eb0 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f33025fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f33025fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52288/0 (socket says 172.21.15.52:52288) 2024-09-19T09:35:50.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f33025fa640 1 -- 172.21.15.52:0/3878569406 learned_addr learned my addr 172.21.15.52:0/3878569406 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f3301df9640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074590 0x7f32fc1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.366+0000 7f33015f8640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074eb0 0x7f32fc1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 -- 172.21.15.52:0/3878569406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074eb0 msgr2=0x7f32fc1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074eb0 0x7f32fc1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 -- 172.21.15.52:0/3878569406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074590 msgr2=0x7f32fc1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074590 0x7f32fc1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 -- 172.21.15.52:0/3878569406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc19efc0 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f33025fa640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f32f402ae70 tx=0x7f32f402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f32f2ffd640 1 -- 172.21.15.52:0/3878569406 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4034040 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32fc19f250 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f32f2ffd640 1 -- 172.21.15.52:0/3878569406 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f4030920 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f32f2ffd640 1 -- 172.21.15.52:0/3878569406 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4045480 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.367+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32fc1ab5a0 con 0x7f32fc112ba0 2024-09-19T09:35:50.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.369+0000 7f32f2ffd640 1 -- 172.21.15.52:0/3878569406 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32f4037020 con 0x7f32fc112ba0 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 Processor -- start 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 -- start start 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x56531067d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531068a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653105e32f0 con 0x56531067d5d0 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56531058acf0 con 0x56531067eb40 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3306436740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653105df2b0 con 0x565310688370 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f32f2ffd640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 0x7f32e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3301df9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3301df9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52292/0 (socket says 172.21.15.52:52292) 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f3301df9640 1 -- 172.21.15.52:0/3329391197 learned_addr learned my addr 172.21.15.52:0/3329391197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:50.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f33015f8640 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x56531067d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f32f2ffd640 1 -- 172.21.15.52:0/3878569406 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32f40f0860 con 0x7f32fc112ba0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f33025fa640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 0x7f32e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.370+0000 7f33015f8640 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531068a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 -- 172.21.15.52:0/3329391197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 msgr2=0x56531068a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531068a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 -- 172.21.15.52:0/3329391197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 msgr2=0x56531067d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x56531067d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 -- 172.21.15.52:0/3329391197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531056f3a0 con 0x56531067d5d0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f3301df9640 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f32f800bcb0 tx=0x7f32f80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9814f6dcb090b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f33025fa640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 0x7f32e80a5700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ee2e0 tx=0x7f32f4004330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f32e7fff640 1 -- 172.21.15.52:0/3329391197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f801c480 con 0x56531067d5d0 2024-09-19T09:35:50.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f32e7fff640 1 -- 172.21.15.52:0/3329391197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f801cb00 con 0x56531067d5d0 2024-09-19T09:35:50.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.371+0000 7f32e7fff640 1 -- 172.21.15.52:0/3329391197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8011d40 con 0x56531067d5d0 2024-09-19T09:35:50.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- 172.21.15.52:0/3329391197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 msgr2=0x56531067da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f32f800bcb0 tx=0x7f32f80107a0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- 172.21.15.52:0/3329391197 shutdown_connections 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531068a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x56531067da10 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 --2- 172.21.15.52:0/3329391197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x56531067d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- 172.21.15.52:0/3329391197 >> 172.21.15.52:0/3329391197 conn(0x565310646310 msgr2=0x565310679c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- 172.21.15.52:0/3329391197 shutdown_connections 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- 172.21.15.52:0/3329391197 wait complete. 2024-09-19T09:35:50.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.372+0000 7f3306436740 1 -- start start 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 Processor -- start 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 0x565310687d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x5653106855e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56531068b070 con 0x56531067eb40 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56531059e060 con 0x565310688370 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56531068b1f0 con 0x56531067d5d0 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3306436740 10 client.0 _ll_register_callbacks cb 0x5653102f18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52294/0 (socket says 172.21.15.52:52294) 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 -- 172.21.15.52:0/2266085902 learned_addr learned my addr 172.21.15.52:0/2266085902 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f33015f8640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x5653106855e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f33015f8640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 0x565310687d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 -- 172.21.15.52:0/2266085902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 msgr2=0x565310687d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 0x565310687d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 -- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 msgr2=0x5653106855e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x5653106855e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f3301df9640 1 -- 172.21.15.52:0/2266085902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653103543c0 con 0x56531067eb40 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.373+0000 7f33015f8640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 0x565310687d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3301df9640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f32f80118e0 tx=0x7f32f800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f75d9262634dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f802b060 con 0x56531067eb40 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32f8011c50 con 0x56531067eb40 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f801cb00 con 0x56531067eb40 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32f8011e50 con 0x56531067eb40 2024-09-19T09:35:50.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 10 client.20619 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565310696ae0 con 0x56531067eb40 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f801cb00 con 0x56531067eb40 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f32f80046c0 con 0x56531067eb40 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 10 client.20619 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 10 client.20619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 20 client.20619 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310697ee0 0x56531069a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 4 client.20619 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.374+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653105f0860 con 0x565310697ee0 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.375+0000 7f33015f8640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310697ee0 0x56531069a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.375+0000 7f33015f8640 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310697ee0 0x56531069a2d0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f662332d7a7ea2 server_cookie=e515f5daf52bdf6d in_seq=0 out_seq=0 2024-09-19T09:35:50.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.375+0000 7f32e57fa640 10 client.20619 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f32e57fa640 1 -- 172.21.15.52:0/2266085902 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653105f0860 con 0x565310697ee0 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f32e57fa640 10 client.20619 handle_command_reply: tid=0 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 client.20619 shutdown 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 msgr2=0x565310684ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f32f80118e0 tx=0x7f32f800bfd0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 shutdown_connections 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310697ee0 0x56531069a2d0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x5653106855e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067eb40 0x565310684ff0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f32e57fa640 0 client.20619 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 --2- 172.21.15.52:0/2266085902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067d5d0 0x565310687d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 >> 172.21.15.52:0/2266085902 conn(0x565310646310 msgr2=0x56531067f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 shutdown_connections 2024-09-19T09:35:50.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 1 -- 172.21.15.52:0/2266085902 wait complete. 2024-09-19T09:35:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.376+0000 7f3306436740 20 client.20619 trim_cache size 0 max 16384 2024-09-19T09:35:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 Processor -- start 2024-09-19T09:35:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 -- start start 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x565310684010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531069f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b66c0 con 0x56531067d5d0 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b3f90 con 0x56531067eb40 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3306436740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b1de0 con 0x565310688370 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52310/0 (socket says 172.21.15.52:52310) 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 -- 172.21.15.52:0/3941741731 learned_addr learned my addr 172.21.15.52:0/3941741731 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f3301df9640 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x565310684010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531069f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 -- 172.21.15.52:0/3941741731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 msgr2=0x56531069f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531069f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 -- 172.21.15.52:0/3941741731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 msgr2=0x565310684010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x565310684010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.390+0000 7f33015f8640 1 -- 172.21.15.52:0/3941741731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565310683580 con 0x56531067d5d0 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f33015f8640 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0135a0 tx=0x7f32ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c736ecd231134789 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f32e77fe640 1 -- 172.21.15.52:0/3941741731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec025040 con 0x56531067d5d0 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f32e77fe640 1 -- 172.21.15.52:0/3941741731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ec005500 con 0x56531067d5d0 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f32e77fe640 1 -- 172.21.15.52:0/3941741731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec01f720 con 0x56531067d5d0 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f3306436740 1 -- 172.21.15.52:0/3941741731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 msgr2=0x565310694310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.391+0000 7f3306436740 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0135a0 tx=0x7f32ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- 172.21.15.52:0/3941741731 shutdown_connections 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x565310688370 0x56531069f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56531067eb40 0x565310684010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- 172.21.15.52:0/3941741731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310694310 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- 172.21.15.52:0/3941741731 >> 172.21.15.52:0/3941741731 conn(0x565310646310 msgr2=0x565310683900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- 172.21.15.52:0/3941741731 shutdown_connections 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- 172.21.15.52:0/3941741731 wait complete. 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- start start 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 Processor -- start 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067eb40 0x565310681d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x565310682240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b2450 con 0x56531067d5d0 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b38c0 con 0x565310688370 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc1b2b20 con 0x56531067eb40 2024-09-19T09:35:50.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.392+0000 7f3306436740 10 client.0 _ll_register_callbacks cb 0x7f32ec00ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52326/0 (socket says 172.21.15.52:52326) 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 -- 172.21.15.52:0/1276891902 learned_addr learned my addr 172.21.15.52:0/1276891902 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f3301df9640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067eb40 0x565310681d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x565310682240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 -- 172.21.15.52:0/1276891902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067eb40 msgr2=0x565310681d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067eb40 0x565310681d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 -- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 msgr2=0x565310682240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x565310682240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 -- 172.21.15.52:0/1276891902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565310682a40 con 0x56531067d5d0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f33015f8640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f32ec013230 tx=0x7f32ec004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2540ccd9ed8f6e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f32e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec004730 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32ec0048d0 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.393+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ec005500 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32ec004020 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 10 client.20625 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565310702810 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ec005500 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f32ec037070 con 0x56531067d5d0 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 10 client.20625 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 10 client.20625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 20 client.20625 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310702e50 0x565310705270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 4 client.20625 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653105ead70 con 0x565310702e50 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.394+0000 7f3301df9640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310702e50 0x565310705270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3301df9640 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310702e50 0x565310705270 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f45630e03bf0cf29 server_cookie=5164f4733046dc54 in_seq=0 out_seq=0 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f32e57fa640 10 client.20625 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f32e57fa640 1 -- 172.21.15.52:0/1276891902 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653105ead70 con 0x565310702e50 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f32e57fa640 10 client.20625 handle_command_reply: tid=0 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 client.20625 shutdown 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 msgr2=0x565310690b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f32ec013230 tx=0x7f32ec004c80 comp rx=0 tx=0).stop 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 shutdown_connections 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x565310702e50 0x565310705270 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x565310688370 0x565310682240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56531067eb40 0x565310681d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f32e57fa640 0 client.20625 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 --2- 172.21.15.52:0/1276891902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56531067d5d0 0x565310690b90 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 >> 172.21.15.52:0/1276891902 conn(0x565310646310 msgr2=0x565310684120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.395+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 shutdown_connections 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f3306436740 1 -- 172.21.15.52:0/1276891902 wait complete. 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f3306436740 20 client.20625 trim_cache size 0 max 16384 2024-09-19T09:35:50.405 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 msgr2=0x7f32e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 0x7f32e80a5700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ee2e0 tx=0x7f32f4004330 comp rx=0 tx=0).stop 2024-09-19T09:35:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 msgr2=0x7f32fc19e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f32f402ae70 tx=0x7f32f402f5b0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 shutdown_connections 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32fc112ba0 0x7f32fc19e890 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32e80a3240 0x7f32e80a5700 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32fc074eb0 0x7f32fc1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 --2- 172.21.15.52:0/3878569406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32fc074590 0x7f32fc1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 >> 172.21.15.52:0/3878569406 conn(0x7f32fc0fd8b0 msgr2=0x7f32fc0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 shutdown_connections 2024-09-19T09:35:50.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:50.396+0000 7f330405d640 1 -- 172.21.15.52:0/3878569406 wait complete. 2024-09-19T09:35:51.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:51 smithi052 ceph-mon[30947]: pgmap v770: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:51.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:51 smithi169 ceph-mon[35454]: pgmap v770: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:51.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:51 smithi086 ceph-mon[34813]: pgmap v770: 97 pgs: 97 active+clean; 3.3 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:35:52.276 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:35:52.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:35:52.546 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 -- 172.21.15.52:0/4180963553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60106f10 msgr2=0x7f5a6010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 --2- 172.21.15.52:0/4180963553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60106f10 0x7f5a6010ea90 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ca0 tx=0x7f5a5802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 -- 172.21.15.52:0/4180963553 shutdown_connections 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 --2- 172.21.15.52:0/4180963553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60106f10 0x7f5a6010ea90 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 --2- 172.21.15.52:0/4180963553 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60102790 0x7f5a601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 --2- 172.21.15.52:0/4180963553 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60101de0 0x7f5a601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.044+0000 7f5a67747640 1 -- 172.21.15.52:0/4180963553 >> 172.21.15.52:0/4180963553 conn(0x7f5a600fd8c0 msgr2=0x7f5a600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.045+0000 7f5a67747640 1 -- 172.21.15.52:0/4180963553 shutdown_connections 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.045+0000 7f5a67747640 1 -- 172.21.15.52:0/4180963553 wait complete. 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.045+0000 7f5a67747640 1 Processor -- start 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.045+0000 7f5a67747640 1 -- start start 2024-09-19T09:35:53.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 0x7f5a601988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60106f10 0x7f5a6019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60111f70 con 0x7f5a60101de0 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60111df0 con 0x7f5a60106f10 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601120f0 con 0x7f5a60102790 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52342/0 (socket says 172.21.15.52:52342) 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 -- 172.21.15.52:0/3184701102 learned_addr learned my addr 172.21.15.52:0/3184701102 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60106f10 0x7f5a6019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 0x7f5a601988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 -- 172.21.15.52:0/3184701102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 msgr2=0x7f5a601988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 0x7f5a601988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 -- 172.21.15.52:0/3184701102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60106f10 msgr2=0x7f5a6019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60106f10 0x7f5a6019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 -- 172.21.15.52:0/3184701102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6019d360 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 0x7f5a601988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c890 tx=0x7f5a5c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a567fc640 1 -- 172.21.15.52:0/3184701102 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c004220 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6019d650 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.046+0000 7f5a567fc640 1 -- 172.21.15.52:0/3184701102 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a5c0043c0 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.047+0000 7f5a567fc640 1 -- 172.21.15.52:0/3184701102 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c004a00 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.047+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a601a4f30 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.049+0000 7f5a567fc640 1 -- 172.21.15.52:0/3184701102 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5a5c0079b0 con 0x7f5a60101de0 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 Processor -- start 2024-09-19T09:35:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 -- start start 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989bdb60 0x563c989bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989be480 0x563c989c8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563c98923280 con 0x563c989c8d40 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563c988cab10 con 0x563c989bdb60 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a69b20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563c9891f240 con 0x563c989be480 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a567fc640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 0x7f5a4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a64ce2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a64ce2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52358/0 (socket says 172.21.15.52:52358) 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a64ce2640 1 -- 172.21.15.52:0/2007433742 learned_addr learned my addr 172.21.15.52:0/2007433742 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989bdb60 0x563c989bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a567fc640 1 -- 172.21.15.52:0/3184701102 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5a5c0cf6f0 con 0x7f5a60101de0 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 0x7f5a4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.050+0000 7f5a654e3640 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989be480 0x563c989c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 -- 172.21.15.52:0/2007433742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989be480 msgr2=0x563c989c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989be480 0x563c989c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 -- 172.21.15.52:0/2007433742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989bdb60 msgr2=0x563c989bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989bdb60 0x563c989bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 -- 172.21.15.52:0/2007433742 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c988d71f0 con 0x563c989c8d40 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000bcb0 tx=0x7f5a5000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3546c2349e6886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 0x7f5a4c0a5700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5a58004af0 tx=0x7f5a58004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a4b7fe640 1 -- 172.21.15.52:0/2007433742 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50015070 con 0x563c989c8d40 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a4b7fe640 1 -- 172.21.15.52:0/2007433742 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a50011920 con 0x563c989c8d40 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.051+0000 7f5a4b7fe640 1 -- 172.21.15.52:0/2007433742 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50010910 con 0x563c989c8d40 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- 172.21.15.52:0/2007433742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 msgr2=0x563c989cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000bcb0 tx=0x7f5a5000f730 comp rx=0 tx=0).stop 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- 172.21.15.52:0/2007433742 shutdown_connections 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989cb130 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989be480 0x563c989c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 --2- 172.21.15.52:0/2007433742 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989bdb60 0x563c989bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- 172.21.15.52:0/2007433742 >> 172.21.15.52:0/2007433742 conn(0x563c989ba0f0 msgr2=0x563c989ba4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- 172.21.15.52:0/2007433742 shutdown_connections 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- 172.21.15.52:0/2007433742 wait complete. 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 -- start start 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.052+0000 7f5a69b20740 1 Processor -- start 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989bdb60 0x563c989c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563c989cb910 con 0x563c989c8d40 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563c988ddf10 con 0x563c989be480 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563c989cba90 con 0x563c989bdb60 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a69b20740 10 client.0 _ll_register_callbacks cb 0x563c988a6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52370/0 (socket says 172.21.15.52:52370) 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 -- 172.21.15.52:0/305533749 learned_addr learned my addr 172.21.15.52:0/305533749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a654e3640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989bdb60 0x563c989c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 -- 172.21.15.52:0/305533749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989bdb60 msgr2=0x563c989c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989bdb60 0x563c989c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 -- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 msgr2=0x563c989c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 -- 172.21.15.52:0/305533749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c986946a0 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ca0 tx=0x7f5a580095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e4463639ec4177 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.053+0000 7f5a48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5804f070 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5a58003d80 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a50011920 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5a58058030 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 10 client.20637 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563c989d74c0 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a50011920 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5a58048040 con 0x563c989c8d40 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 10 client.20637 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:53.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 10 client.20637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 20 client.20637 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c989d8970 0x563c989dae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 4 client.20637 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.054+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c989307f0 con 0x563c989d8970 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.055+0000 7f5a654e3640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c989d8970 0x563c989dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.055+0000 7f5a48ff9640 10 client.20637 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.055+0000 7f5a654e3640 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c989d8970 0x563c989dae10 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2750bdb6ae6be5e1 server_cookie=49c6059ca81e0702 in_seq=0 out_seq=0 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a48ff9640 1 -- 172.21.15.52:0/305533749 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c989307f0 con 0x563c989d8970 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a48ff9640 10 client.20637 handle_command_reply: tid=0 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 client.20637 shutdown 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 msgr2=0x563c989c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009ca0 tx=0x7f5a580095c0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 shutdown_connections 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c989d8970 0x563c989dae10 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989c8d40 0x563c989c6640 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a48ff9640 0 client.20637 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 --2- 172.21.15.52:0/305533749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989bdb60 0x563c989c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 >> 172.21.15.52:0/305533749 conn(0x563c989ba0f0 msgr2=0x563c989b9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 shutdown_connections 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 1 -- 172.21.15.52:0/305533749 wait complete. 2024-09-19T09:35:53.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.056+0000 7f5a69b20740 20 client.20637 trim_cache size 0 max 16384 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.073+0000 7f5a69b20740 1 Processor -- start 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 -- start start 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601b0080 con 0x563c989bdb60 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601ad950 con 0x563c989be480 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a69b20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601ab7a0 con 0x563c989c8d40 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52376/0 (socket says 172.21.15.52:52376) 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 -- 172.21.15.52:0/212592496 learned_addr learned my addr 172.21.15.52:0/212592496 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:53.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 -- 172.21.15.52:0/212592496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 msgr2=0x563c989e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 -- 172.21.15.52:0/212592496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 msgr2=0x563c989e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989e06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 -- 172.21.15.52:0/212592496 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c989be2b0 con 0x563c989bdb60 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.074+0000 7f5a654e3640 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c007590 tx=0x7f5a5c0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458b3ed5db68b825 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a4affd640 1 -- 172.21.15.52:0/212592496 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c0b9070 con 0x563c989bdb60 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a4affd640 1 -- 172.21.15.52:0/212592496 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a5c09ffe0 con 0x563c989bdb60 2024-09-19T09:35:53.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a4affd640 1 -- 172.21.15.52:0/212592496 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c01d040 con 0x563c989bdb60 2024-09-19T09:35:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 -- 172.21.15.52:0/212592496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 msgr2=0x563c989c05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c007590 tx=0x7f5a5c0cf040 comp rx=0 tx=0).stop 2024-09-19T09:35:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 -- 172.21.15.52:0/212592496 shutdown_connections 2024-09-19T09:35:53.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 --2- 172.21.15.52:0/212592496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989c05c0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 -- 172.21.15.52:0/212592496 >> 172.21.15.52:0/212592496 conn(0x563c989ba0f0 msgr2=0x563c989c7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 -- 172.21.15.52:0/212592496 shutdown_connections 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.075+0000 7f5a69b20740 1 -- 172.21.15.52:0/212592496 wait complete. 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 -- start start 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 Processor -- start 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601abe10 con 0x563c989bdb60 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601ad280 con 0x563c989be480 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601ac4e0 con 0x563c989c8d40 2024-09-19T09:35:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a69b20740 10 client.0 _ll_register_callbacks cb 0x7f5a58031e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a654e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52384/0 (socket says 172.21.15.52:52384) 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.076+0000 7f5a654e3640 1 -- 172.21.15.52:0/3989706370 learned_addr learned my addr 172.21.15.52:0/3989706370 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a65ce4640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 -- 172.21.15.52:0/3989706370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 msgr2=0x563c989cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 -- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 msgr2=0x563c989d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 -- 172.21.15.52:0/3989706370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c989c3ac0 con 0x563c989bdb60 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a654e3640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0a4370 tx=0x7f5a5c09bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293ca7fdf580ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c07f060 con 0x563c989bdb60 2024-09-19T09:35:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f5a5c0cd220 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a5c09ffe0 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5a5c01d050 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a69b20740 10 client.20643 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563c98a43ba0 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.077+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a5c09ffe0 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5a5c0860d0 con 0x563c989bdb60 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 10 client.20643 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 10 client.20643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 20 client.20643 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c98a44200 0x563c98a46620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 4 client.20643 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563c9892ad00 con 0x563c98a44200 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.078+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c98a44200 0x563c98a46620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.079+0000 7f5a64ce2640 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c98a44200 0x563c98a46620 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f3f95a7321d65a server_cookie=d9378284b1d938bf in_seq=0 out_seq=0 2024-09-19T09:35:53.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.079+0000 7f5a48ff9640 10 client.20643 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a48ff9640 1 -- 172.21.15.52:0/3989706370 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563c9892ad00 con 0x563c98a44200 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a48ff9640 10 client.20643 handle_command_reply: tid=0 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 client.20643 shutdown 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 msgr2=0x563c989d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0a4370 tx=0x7f5a5c09bdb0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 shutdown_connections 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x563c98a44200 0x563c98a46620 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563c989c8d40 0x563c989cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563c989be480 0x563c989d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 --2- 172.21.15.52:0/3989706370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563c989bdb60 0x563c989d0ce0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 >> 172.21.15.52:0/3989706370 conn(0x563c989ba0f0 msgr2=0x563c989c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a48ff9640 0 client.20643 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 shutdown_connections 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 1 -- 172.21.15.52:0/3989706370 wait complete. 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.080+0000 7f5a69b20740 20 client.20643 trim_cache size 0 max 16384 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "03c6d3e7-0187-40c7-b443-2084ec133b01", 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:35:53.086 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 msgr2=0x7f5a4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 0x7f5a4c0a5700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5a58004af0 tx=0x7f5a58004a80 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 msgr2=0x7f5a601983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00c890 tx=0x7f5a5c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 shutdown_connections 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a60106f10 0x7f5a6019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f5a4c0a3240 0x7f5a4c0a5700 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5a60102790 0x7f5a601988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 --2- 172.21.15.52:0/3184701102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a60101de0 0x7f5a601983b0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 >> 172.21.15.52:0/3184701102 conn(0x7f5a600fd8c0 msgr2=0x7f5a600fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 shutdown_connections 2024-09-19T09:35:53.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:53.081+0000 7f5a67747640 1 -- 172.21.15.52:0/3184701102 wait complete. 2024-09-19T09:35:53.675 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:53 smithi052 ceph-mon[30947]: pgmap v771: 97 pgs: 97 active+clean; 3.4 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:53.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:53 smithi169 ceph-mon[35454]: pgmap v771: 97 pgs: 97 active+clean; 3.4 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:53.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:53 smithi086 ceph-mon[34813]: pgmap v771: 97 pgs: 97 active+clean; 3.4 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:35:53.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:35:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:54.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:54 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:35:54.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:54 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:54 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:35:54.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:54 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.534 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:54 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:35:54.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 -- 172.21.15.52:0/3625496542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 msgr2=0x7f4b401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 --2- 172.21.15.52:0/3625496542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401021c0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009900 tx=0x7f4b3c02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 -- 172.21.15.52:0/3625496542 shutdown_connections 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 --2- 172.21.15.52:0/3625496542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 --2- 172.21.15.52:0/3625496542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 --2- 172.21.15.52:0/3625496542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401021c0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 -- 172.21.15.52:0/3625496542 >> 172.21.15.52:0/3625496542 conn(0x7f4b400fd8c0 msgr2=0x7f4b400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 -- 172.21.15.52:0/3625496542 shutdown_connections 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.616+0000 7f4b47e21640 1 -- 172.21.15.52:0/3625496542 wait complete. 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 Processor -- start 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 -- start start 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b40198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40111f70 con 0x7f4b40101de0 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40111df0 con 0x7f4b40102790 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b47e21640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401120f0 con 0x7f4b40106f10 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b45bbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b45bbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52406/0 (socket says 172.21.15.52:52406) 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b45bbd640 1 -- 172.21.15.52:0/860730748 learned_addr learned my addr 172.21.15.52:0/860730748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.617+0000 7f4b463be640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b453bc640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b40198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 -- 172.21.15.52:0/860730748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 msgr2=0x7f4b4019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 -- 172.21.15.52:0/860730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 msgr2=0x7f4b40198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b40198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 -- 172.21.15.52:0/860730748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4019d380 con 0x7f4b40101de0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b463be640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b453bc640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b40198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c005ab0 tx=0x7f4b3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b36ffd640 1 -- 172.21.15.52:0/860730748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c03f030 con 0x7f4b40101de0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4019d610 con 0x7f4b40101de0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b36ffd640 1 -- 172.21.15.52:0/860730748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b3c003ce0 con 0x7f4b40101de0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b36ffd640 1 -- 172.21.15.52:0/860730748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c035070 con 0x7f4b40101de0 2024-09-19T09:35:54.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.618+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b401a4f50 con 0x7f4b40101de0 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.620+0000 7f4b36ffd640 1 -- 172.21.15.52:0/860730748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4b3c042030 con 0x7f4b40101de0 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 Processor -- start 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 -- start start 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608bc9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561608b1e2e0 con 0x561608bb8360 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561608ac5ce0 con 0x561608bc7a90 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561608b1a2a0 con 0x561608bb8c80 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52410/0 (socket says 172.21.15.52:52410) 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b463be640 1 -- 172.21.15.52:0/3832025866 learned_addr learned my addr 172.21.15.52:0/3832025866 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:54.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b36ffd640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 0x7f4b2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.621+0000 7f4b453bc640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608bc9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 -- 172.21.15.52:0/3832025866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 msgr2=0x561608bc7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 -- 172.21.15.52:0/3832025866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 msgr2=0x561608bc9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608bc9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 -- 172.21.15.52:0/3832025866 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561608aaa440 con 0x561608bb8360 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b453bc640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608bc9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 0x7f4b2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b36ffd640 1 -- 172.21.15.52:0/860730748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b3c0f0310 con 0x7f4b40101de0 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b463be640 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005c80 tx=0x7f4b3800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189f80ebbd146321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b2bfff640 1 -- 172.21.15.52:0/3832025866 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38022070 con 0x561608bb8360 2024-09-19T09:35:54.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b2bfff640 1 -- 172.21.15.52:0/3832025866 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b38011c30 con 0x561608bb8360 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.622+0000 7f4b2bfff640 1 -- 172.21.15.52:0/3832025866 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3801a400 con 0x561608bb8360 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/3832025866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 msgr2=0x561608bb8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b463be640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 0x7f4b2c0a5700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b3801f000 tx=0x7f4b38020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005c80 tx=0x7f4b3800e7e0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/3832025866 shutdown_connections 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608bc9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/3832025866 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8360 0x561608bb8740 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/3832025866 >> 172.21.15.52:0/3832025866 conn(0x561608bb4a30 msgr2=0x561608bb4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/3832025866 shutdown_connections 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/3832025866 wait complete. 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 -- start start 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.623+0000 7f4b4a1fa740 1 Processor -- start 2024-09-19T09:35:54.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8360 0x561608bc7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561608bca660 con 0x561608bc7a90 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561608ad9050 con 0x561608bb8360 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561608bca7e0 con 0x561608bb8c80 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b4a1fa740 10 client.0 _ll_register_callbacks cb 0x561608b19160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52416/0 (socket says 172.21.15.52:52416) 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 -- 172.21.15.52:0/1775910307 learned_addr learned my addr 172.21.15.52:0/1775910307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8360 0x561608bc7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b453bc640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 -- 172.21.15.52:0/1775910307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 msgr2=0x561608bc46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 -- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8360 msgr2=0x561608bc7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8360 0x561608bc7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 -- 172.21.15.52:0/1775910307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56160888f3c0 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b463be640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007540 tx=0x7f4b38004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795553843c68b681 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.624+0000 7f4b297fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38034060 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b38011a30 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b38011c30 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b38022040 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 10 client.20655 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561608bd6000 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b38011c30 con 0x561608bc7a90 2024-09-19T09:35:54.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b38019040 con 0x561608bc7a90 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 10 client.20655 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 10 client.20655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 20 client.20655 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608bd7350 0x561608bd9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 4 client.20655 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.625+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561608b2b850 con 0x561608bd7350 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.626+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608bd7350 0x561608bd9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.626+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608bd7350 0x561608bd9740 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60a218a46178b6c5 server_cookie=e089b38b5eb1bfa2 in_seq=0 out_seq=0 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.626+0000 7f4b297fa640 10 client.20655 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:54.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.626+0000 7f4b297fa640 1 -- 172.21.15.52:0/1775910307 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561608b2b850 con 0x561608bd7350 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.626+0000 7f4b297fa640 10 client.20655 handle_command_reply: tid=0 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 client.20655 shutdown 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 msgr2=0x561608bc4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f4b38007540 tx=0x7f4b38004a00 comp rx=0 tx=0).stop 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 shutdown_connections 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608bd7350 0x561608bd9740 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bc4c40 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8c80 0x561608bc46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b297fa640 0 client.20655 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/1775910307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8360 0x561608bc7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 >> 172.21.15.52:0/1775910307 conn(0x561608bb4a30 msgr2=0x561608bba790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 shutdown_connections 2024-09-19T09:35:54.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/1775910307 wait complete. 2024-09-19T09:35:54.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.627+0000 7f4b4a1fa740 20 client.20655 trim_cache size 0 max 16384 2024-09-19T09:35:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 Processor -- start 2024-09-19T09:35:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 -- start start 2024-09-19T09:35:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bc69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 0x561608bd3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ade50 con 0x561608bc7a90 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ab720 con 0x561608bb8c80 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401a9570 con 0x561608bb8360 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52428/0 (socket says 172.21.15.52:52428) 2024-09-19T09:35:54.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 -- 172.21.15.52:0/427359408 learned_addr learned my addr 172.21.15.52:0/427359408 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bc69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b453bc640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 0x561608bd3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 -- 172.21.15.52:0/427359408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 msgr2=0x561608bc69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bc69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 -- 172.21.15.52:0/427359408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 msgr2=0x561608bd3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 0x561608bd3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b463be640 1 -- 172.21.15.52:0/427359408 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561608bd9cd0 con 0x561608bc7a90 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.645+0000 7f4b453bc640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 0x561608bd3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.646+0000 7f4b463be640 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4b3801af50 tx=0x7f4b3800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba0f31278ebfb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.646+0000 7f4b2b7fe640 1 -- 172.21.15.52:0/427359408 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38034030 con 0x561608bc7a90 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.646+0000 7f4b2b7fe640 1 -- 172.21.15.52:0/427359408 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b3801a400 con 0x561608bc7a90 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.646+0000 7f4b2b7fe640 1 -- 172.21.15.52:0/427359408 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3801a720 con 0x561608bc7a90 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/427359408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 msgr2=0x561608bdef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f4b3801af50 tx=0x7f4b3800e7e0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/427359408 shutdown_connections 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bc7a90 0x561608bdef00 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bb8c80 0x561608bd3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/427359408 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bc69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/427359408 >> 172.21.15.52:0/427359408 conn(0x561608bb4a30 msgr2=0x561608bb3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/427359408 shutdown_connections 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/427359408 wait complete. 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 -- start start 2024-09-19T09:35:54.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.647+0000 7f4b4a1fa740 1 Processor -- start 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bcbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608c40ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401a9be0 con 0x561608bb8c80 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401ab050 con 0x561608bc7a90 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401aa2b0 con 0x561608bb8360 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 10 client.0 _ll_register_callbacks cb 0x7f4b38020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52432/0 (socket says 172.21.15.52:52432) 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 -- 172.21.15.52:0/804169849 learned_addr learned my addr 172.21.15.52:0/804169849 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b463be640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608c40ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bcbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 -- 172.21.15.52:0/804169849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 msgr2=0x561608bcbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bcbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 -- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 msgr2=0x561608c40ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608c40ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 -- 172.21.15.52:0/804169849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561608bb44d0 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b453bc640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f4b400fdce0 tx=0x7f4b30011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fe5ef78823728c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b297fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3001e060 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4b3000fd80 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.648+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b3801a400 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b30019430 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 10 client.20661 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561608c42610 con 0x561608bb8c80 2024-09-19T09:35:54.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b3801a400 con 0x561608bb8c80 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4b3000b5e0 con 0x561608bb8c80 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 10 client.20661 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 10 client.20661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 20 client.20661 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608c42df0 0x561608c45210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 4 client.20661 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561608b25d60 con 0x561608c42df0 2024-09-19T09:35:54.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.649+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608c42df0 0x561608c45210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:54.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b45bbd640 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608c42df0 0x561608c45210 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b0ad3997b830b3 server_cookie=4f53463c0b04594f in_seq=0 out_seq=0 2024-09-19T09:35:54.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b297fa640 10 client.20661 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:54.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b297fa640 1 -- 172.21.15.52:0/804169849 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561608b25d60 con 0x561608c42df0 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b297fa640 10 client.20661 handle_command_reply: tid=0 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 client.20661 shutdown 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 msgr2=0x561608bcc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f4b400fdce0 tx=0x7f4b30011c60 comp rx=0 tx=0).stop 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 shutdown_connections 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561608c42df0 0x561608c45210 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561608bc7a90 0x561608c40ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561608bb8c80 0x561608bcc510 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 --2- 172.21.15.52:0/804169849 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561608bb8360 0x561608bcbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b297fa640 0 client.20661 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 >> 172.21.15.52:0/804169849 conn(0x561608bb4a30 msgr2=0x561608bb3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 shutdown_connections 2024-09-19T09:35:54.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 1 -- 172.21.15.52:0/804169849 wait complete. 2024-09-19T09:35:54.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.650+0000 7f4b4a1fa740 20 client.20661 trim_cache size 0 max 16384 2024-09-19T09:35:54.658 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:35:54.658 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:35:54.658 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:35:54.658 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 msgr2=0x7f4b2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 0x7f4b2c0a5700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b3801f000 tx=0x7f4b38020000 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 msgr2=0x7f4b401983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c005ab0 tx=0x7f4b3c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 shutdown_connections 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4b2c0a3240 0x7f4b2c0a5700 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b40106f10 0x7f4b4019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b40102790 0x7f4b40198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 --2- 172.21.15.52:0/860730748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b40101de0 0x7f4b401983d0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 >> 172.21.15.52:0/860730748 conn(0x7f4b400fd8c0 msgr2=0x7f4b400febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:54.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 shutdown_connections 2024-09-19T09:35:54.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:54.651+0000 7f4b47e21640 1 -- 172.21.15.52:0/860730748 wait complete. 2024-09-19T09:35:54.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:54 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:35:54.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:54 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:54 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:35:54.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:54 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:54 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:35:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:54 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:35:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:54 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:54 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:35:54.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:54 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:35:54.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:54 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:35:55.508 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:35:55.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:55.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:55 smithi052 ceph-mon[30947]: pgmap v772: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:55.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:55 smithi169 ceph-mon[35454]: pgmap v772: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:55.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:55 smithi086 ceph-mon[34813]: pgmap v772: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:55.766 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- 172.21.15.52:0/1868405806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7981027a0 msgr2=0x7ff7981067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1868405806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7981027a0 0x7ff7981067f0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009900 tx=0x7ff78c02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:56.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- 172.21.15.52:0/1868405806 shutdown_connections 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1868405806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff798106f20 0x7ff79810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1868405806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff7981027a0 0x7ff7981067f0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1868405806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7981021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- 172.21.15.52:0/1868405806 >> 172.21.15.52:0/1868405806 conn(0x7ff7980fd8b0 msgr2=0x7ff7980ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- 172.21.15.52:0/1868405806 shutdown_connections 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- 172.21.15.52:0/1868405806 wait complete. 2024-09-19T09:35:56.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 Processor -- start 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.223+0000 7ff79e45b640 1 -- start start 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 0x7ff798074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff798112020 con 0x7ff798106f20 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff798111ea0 con 0x7ff798101df0 2024-09-19T09:35:56.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79e45b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981121a0 con 0x7ff7981027a0 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52438/0 (socket says 172.21.15.52:52438) 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 -- 172.21.15.52:0/1502424476 learned_addr learned my addr 172.21.15.52:0/1502424476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff797fff640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff7977fe640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 0x7ff798074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:56.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 -- 172.21.15.52:0/1502424476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 msgr2=0x7ff798074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 0x7ff798074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 -- 172.21.15.52:0/1502424476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 msgr2=0x7ff7980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 -- 172.21.15.52:0/1502424476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7981a6a30 con 0x7ff798106f20 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff797fff640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff7977fe640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 0x7ff798074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:56.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff79c9f8640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7ff79000b970 tx=0x7ff79000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.224+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790019070 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.225+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff79000cb40 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.225+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7981a6d20 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.225+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790007650 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.225+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7981a72b0 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.226+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff798102250 con 0x7ff798106f20 2024-09-19T09:35:56.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.227+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff79001c070 con 0x7ff798106f20 2024-09-19T09:35:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.227+0000 7ff7957fa640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 0x7ff7800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.228+0000 7ff797fff640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 0x7ff7800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.228+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff7900cef20 con 0x7ff798106f20 2024-09-19T09:35:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.228+0000 7ff797fff640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 0x7ff7800a5780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff788009930 tx=0x7ff788008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:56.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.232+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff79009bbc0 con 0x7ff798106f20 2024-09-19T09:35:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.444+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff79802d7c0 con 0x7ff798106f20 2024-09-19T09:35:56.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.445+0000 7ff7957fa640 1 -- 172.21.15.52:0/1502424476 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ff79009b4c0 con 0x7ff798106f20 2024-09-19T09:35:56.447 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:35:56.447 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:35:56.447 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 msgr2=0x7ff7800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 0x7ff7800a5780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff788009930 tx=0x7ff788008040 comp rx=0 tx=0).stop 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 msgr2=0x7ff798074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7ff79000b970 tx=0x7ff79000be30 comp rx=0 tx=0).stop 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 shutdown_connections 2024-09-19T09:35:56.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff798106f20 0x7ff798074f70 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7800a32c0 0x7ff7800a5780 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7981027a0 0x7ff798074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 --2- 172.21.15.52:0/1502424476 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff798101df0 0x7ff7980744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 >> 172.21.15.52:0/1502424476 conn(0x7ff7980fd8b0 msgr2=0x7ff7980fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 shutdown_connections 2024-09-19T09:35:56.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:56.447+0000 7ff79e45b640 1 -- 172.21.15.52:0/1502424476 wait complete. 2024-09-19T09:35:57.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:35:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:57 smithi052 ceph-mon[30947]: pgmap v773: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:57 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1502424476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:57.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:57 smithi169 ceph-mon[35454]: pgmap v773: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:57.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:57 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1502424476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:57.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:57 smithi086 ceph-mon[34813]: pgmap v773: 97 pgs: 97 active+clean; 3.4 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:35:57.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:57 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1502424476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:57.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 -- 172.21.15.52:0/266977817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 msgr2=0x7f62b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 --2- 172.21.15.52:0/266977817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81067e0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009900 tx=0x7f62a802a410 comp rx=0 tx=0).stop 2024-09-19T09:35:57.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 -- 172.21.15.52:0/266977817 shutdown_connections 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 --2- 172.21.15.52:0/266977817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8106f10 0x7f62b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 --2- 172.21.15.52:0/266977817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81067e0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 --2- 172.21.15.52:0/266977817 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8101de0 0x7f62b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 -- 172.21.15.52:0/266977817 >> 172.21.15.52:0/266977817 conn(0x7f62b80fd8c0 msgr2=0x7f62b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 -- 172.21.15.52:0/266977817 shutdown_connections 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.859+0000 7f62c05d6640 1 -- 172.21.15.52:0/266977817 wait complete. 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 Processor -- start 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 -- start start 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 0x7f62b8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 0x7f62b819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8111f70 con 0x7f62b8102790 2024-09-19T09:35:57.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62b8111df0 con 0x7f62b8101de0 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62c05d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81120f0 con 0x7f62b8106f10 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62bdb71640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62bdb71640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52448/0 (socket says 172.21.15.52:52448) 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62bdb71640 1 -- 172.21.15.52:0/1406999105 learned_addr learned my addr 172.21.15.52:0/1406999105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62beb73640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 0x7f62b819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62be372640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 0x7f62b8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62bdb71640 1 -- 172.21.15.52:0/1406999105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 msgr2=0x7f62b819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.860+0000 7f62bdb71640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 0x7f62b819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62bdb71640 1 -- 172.21.15.52:0/1406999105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 msgr2=0x7f62b8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62bdb71640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 0x7f62b8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62bdb71640 1 -- 172.21.15.52:0/1406999105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b819d440 con 0x7f62b8102790 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62beb73640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 0x7f62b819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:57.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62be372640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 0x7f62b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62bdb71640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f62a8006010 tx=0x7f62a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62af7fe640 1 -- 172.21.15.52:0/1406999105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a803f030 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62af7fe640 1 -- 172.21.15.52:0/1406999105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62a8003ce0 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b819d6d0 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62af7fe640 1 -- 172.21.15.52:0/1406999105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8035070 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.861+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b81a5010 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.863+0000 7f62af7fe640 1 -- 172.21.15.52:0/1406999105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f62a8042030 con 0x7f62b8102790 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.863+0000 7f62c29af740 1 Processor -- start 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 -- start start 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e3a3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3ae370 0x55619e3b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55619e3092f0 con 0x55619e3a35d0 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55619e2b0cf0 con 0x55619e3a4b40 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62c29af740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55619e3052b0 con 0x55619e3ae370 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52462/0 (socket says 172.21.15.52:52462) 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 -- 172.21.15.52:0/2630660414 learned_addr learned my addr 172.21.15.52:0/2630660414 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62beb73640 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e3a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62bdb71640 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3ae370 0x55619e3b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62af7fe640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 0x7f62a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 -- 172.21.15.52:0/2630660414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3ae370 msgr2=0x55619e3b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3ae370 0x55619e3b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 -- 172.21.15.52:0/2630660414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 msgr2=0x55619e3a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e3a3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62be372640 1 -- 172.21.15.52:0/2630660414 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619e2953a0 con 0x55619e3a35d0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62beb73640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 0x7f62a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.864+0000 7f62af7fe640 1 -- 172.21.15.52:0/1406999105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f62a80f0060 con 0x7f62b8102790 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62be372640 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f62b400cca0 tx=0x7f62b400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67fc5c78326fa25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62acff9640 1 -- 172.21.15.52:0/2630660414 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4005220 con 0x55619e3a35d0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62acff9640 1 -- 172.21.15.52:0/2630660414 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b4004c80 con 0x55619e3a35d0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62acff9640 1 -- 172.21.15.52:0/2630660414 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b4010800 con 0x55619e3a35d0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62c29af740 1 -- 172.21.15.52:0/2630660414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 msgr2=0x55619e3a3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62beb73640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 0x7f62a40a5700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005fd0 tx=0x7f62b0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.865+0000 7f62c29af740 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f62b400cca0 tx=0x7f62b400e720 comp rx=0 tx=0).stop 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 -- 172.21.15.52:0/2630660414 shutdown_connections 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3ae370 0x55619e3b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3a3a10 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 --2- 172.21.15.52:0/2630660414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e3a3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 -- 172.21.15.52:0/2630660414 >> 172.21.15.52:0/2630660414 conn(0x55619e36c310 msgr2=0x55619e39fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 -- 172.21.15.52:0/2630660414 shutdown_connections 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 -- 172.21.15.52:0/2630660414 wait complete. 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 -- start start 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.866+0000 7f62c29af740 1 Processor -- start 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 0x55619e3adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55619e3b1070 con 0x55619e3ae370 2024-09-19T09:35:57.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55619e2c4060 con 0x55619e3a35d0 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55619e3b11f0 con 0x55619e3a4b40 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62c29af740 10 client.0 _ll_register_callbacks cb 0x55619e0178c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52476/0 (socket says 172.21.15.52:52476) 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 -- 172.21.15.52:0/3091031135 learned_addr learned my addr 172.21.15.52:0/3091031135 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62be372640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 0x55619e3adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62bdb71640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 -- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 msgr2=0x55619e3aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 -- 172.21.15.52:0/3091031135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 msgr2=0x55619e3adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 0x55619e3adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 -- 172.21.15.52:0/3091031135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619e07a3c0 con 0x55619e3ae370 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62be372640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 0x55619e3adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62beb73640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f62b00128d0 tx=0x7f62b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5adef6b2604aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.867+0000 7f62a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:57.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001db60 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f62b001dd00 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b4004c80 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f62b002c070 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 10 client.20679 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55619e3bcae0 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b4004c80 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f62b001b680 con 0x55619e3ae370 2024-09-19T09:35:57.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 10 client.20679 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 10 client.20679 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 20 client.20679 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e3bdfa0 0x55619e3c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 4 client.20679 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619e316860 con 0x55619e3bdfa0 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.868+0000 7f62be372640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e3bdfa0 0x55619e3c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.869+0000 7f62a1ffb640 10 client.20679 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.869+0000 7f62be372640 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e3bdfa0 0x55619e3c03b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d7aa358670b39a0 server_cookie=8a1c425ee22425ac in_seq=0 out_seq=0 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62a1ffb640 1 -- 172.21.15.52:0/3091031135 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55619e316860 con 0x55619e3bdfa0 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62a1ffb640 10 client.20679 handle_command_reply: tid=0 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 client.20679 shutdown 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 msgr2=0x55619e3ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f62b00128d0 tx=0x7f62b0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 shutdown_connections 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e3bdfa0 0x55619e3c03b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e3ab4d0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 --2- 172.21.15.52:0/3091031135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a35d0 0x55619e3adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 >> 172.21.15.52:0/3091031135 conn(0x55619e36c310 msgr2=0x55619e3a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62a1ffb640 0 client.20679 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 shutdown_connections 2024-09-19T09:35:57.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 1 -- 172.21.15.52:0/3091031135 wait complete. 2024-09-19T09:35:57.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.870+0000 7f62c29af740 20 client.20679 trim_cache size 0 max 16384 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 Processor -- start 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 -- start start 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a35d0 0x55619e3ba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e39f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81b00f0 con 0x55619e3ae370 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ad9c0 con 0x55619e3a4b40 2024-09-19T09:35:57.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62c29af740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ab810 con 0x55619e3a35d0 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62beb73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62beb73640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52492/0 (socket says 172.21.15.52:52492) 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62beb73640 1 -- 172.21.15.52:0/210624644 learned_addr learned my addr 172.21.15.52:0/210624644 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.883+0000 7f62be372640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a35d0 0x55619e3ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 -- 172.21.15.52:0/210624644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a35d0 msgr2=0x55619e3ba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a35d0 0x55619e3ba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62bdb71640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e39f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 -- 172.21.15.52:0/210624644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 msgr2=0x55619e39f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e39f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 -- 172.21.15.52:0/210624644 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619e3a0180 con 0x55619e3ae370 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62bdb71640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e39f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:57.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62beb73640 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f62b001baa0 tx=0x7f62b0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3087a86b72996ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62a3fff640 1 -- 172.21.15.52:0/210624644 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b001b640 con 0x55619e3ae370 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62a3fff640 1 -- 172.21.15.52:0/210624644 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b0035070 con 0x55619e3ae370 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.884+0000 7f62a3fff640 1 -- 172.21.15.52:0/210624644 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b003a830 con 0x55619e3ae370 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- 172.21.15.52:0/210624644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 msgr2=0x55619e39fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f62b001baa0 tx=0x7f62b0000f40 comp rx=0 tx=0).stop 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- 172.21.15.52:0/210624644 shutdown_connections 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3ae370 0x55619e39fc40 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3a4b40 0x55619e39f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- 172.21.15.52:0/210624644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a35d0 0x55619e3ba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- 172.21.15.52:0/210624644 >> 172.21.15.52:0/210624644 conn(0x55619e36c310 msgr2=0x55619e3a9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- 172.21.15.52:0/210624644 shutdown_connections 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- 172.21.15.52:0/210624644 wait complete. 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- start start 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 Processor -- start 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3ae370 0x55619e3a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81abe80 con 0x55619e3a35d0 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ad2f0 con 0x55619e3ae370 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f62b81ac550 con 0x55619e3a4b40 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.885+0000 7f62c29af740 10 client.0 _ll_register_callbacks cb 0x7f62b0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:57.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52508/0 (socket says 172.21.15.52:52508) 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 -- 172.21.15.52:0/2510333200 learned_addr learned my addr 172.21.15.52:0/2510333200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62bdb71640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62beb73640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3ae370 0x55619e3a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 -- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 msgr2=0x55619e3b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 -- 172.21.15.52:0/2510333200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3ae370 msgr2=0x55619e3a77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3ae370 0x55619e3a77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 -- 172.21.15.52:0/2510333200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619e3a7e40 con 0x55619e3a35d0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62be372640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x55619e3a0ac0 tx=0x7f62b4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d5daca88ca4ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:57.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b402c030 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f62b4004930 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b0035070 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f62b4036050 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.886+0000 7f62c29af740 10 client.20685 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55619e428540 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62b0035070 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f62b40053f0 con 0x55619e3a35d0 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 10 client.20685 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 10 client.20685 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 20 client.20685 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e4289e0 0x55619e42add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 4 client.20685 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55619e310d70 con 0x55619e4289e0 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.887+0000 7f62bdb71640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e4289e0 0x55619e42add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62bdb71640 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e4289e0 0x55619e42add0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=774bf0b0d81fe8c7 server_cookie=9b53542b8a2b01f1 in_seq=0 out_seq=0 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62a1ffb640 10 client.20685 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62a1ffb640 1 -- 172.21.15.52:0/2510333200 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55619e310d70 con 0x55619e4289e0 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62a1ffb640 10 client.20685 handle_command_reply: tid=0 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 client.20685 shutdown 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 msgr2=0x55619e3b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x55619e3a0ac0 tx=0x7f62b4005780 comp rx=0 tx=0).stop 2024-09-19T09:35:57.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 shutdown_connections 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55619e4289e0 0x55619e42add0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55619e3ae370 0x55619e3a77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55619e3a4b40 0x55619e3b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 --2- 172.21.15.52:0/2510333200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55619e3a35d0 0x55619e3b6660 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62a1ffb640 0 client.20685 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 >> 172.21.15.52:0/2510333200 conn(0x55619e36c310 msgr2=0x55619e39e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 shutdown_connections 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 1 -- 172.21.15.52:0/2510333200 wait complete. 2024-09-19T09:35:57.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.888+0000 7f62c29af740 20 client.20685 trim_cache size 0 max 16384 2024-09-19T09:35:57.899 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 msgr2=0x7f62a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 0x7f62a40a5700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f62b0005fd0 tx=0x7f62b0004a40 comp rx=0 tx=0).stop 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 msgr2=0x7f62b81989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f62a8006010 tx=0x7f62a80042f0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 shutdown_connections 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f62a40a3240 0x7f62a40a5700 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62b8106f10 0x7f62b819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62b8102790 0x7f62b81989d0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 --2- 172.21.15.52:0/1406999105 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8101de0 0x7f62b8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 >> 172.21.15.52:0/1406999105 conn(0x7f62b80fd8c0 msgr2=0x7f62b80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 shutdown_connections 2024-09-19T09:35:57.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:57.889+0000 7f62c05d6640 1 -- 172.21.15.52:0/1406999105 wait complete. 2024-09-19T09:35:58.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:35:58.927 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:59.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 -- 172.21.15.52:0/3353210965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 msgr2=0x7f9104100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 --2- 172.21.15.52:0/3353210965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104100860 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f90f4009900 tx=0x7f90f402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 -- 172.21.15.52:0/3353210965 shutdown_connections 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 --2- 172.21.15.52:0/3353210965 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 --2- 172.21.15.52:0/3353210965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 0x7f9104104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 --2- 172.21.15.52:0/3353210965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104100860 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 -- 172.21.15.52:0/3353210965 >> 172.21.15.52:0/3353210965 conn(0x7f9104077210 msgr2=0x7f91040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 -- 172.21.15.52:0/3353210965 shutdown_connections 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.418+0000 7f910a458640 1 -- 172.21.15.52:0/3353210965 wait complete. 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 Processor -- start 2024-09-19T09:35:59.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 -- start start 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 0x7f9104198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9104110e90 con 0x7f9104100480 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9104110d10 con 0x7f91041055b0 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f910a458640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9104111010 con 0x7f9104100e30 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36270/0 (socket says 172.21.15.52:36270) 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f9103fff640 1 -- 172.21.15.52:0/2711549120 learned_addr learned my addr 172.21.15.52:0/2711549120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:59.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.419+0000 7f91037fe640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 0x7f9104198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f91089f5640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 -- 172.21.15.52:0/2711549120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 msgr2=0x7f9104198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 0x7f9104198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 -- 172.21.15.52:0/2711549120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 msgr2=0x7f910419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 -- 172.21.15.52:0/2711549120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910419d3c0 con 0x7f9104100480 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f91089f5640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f9103fff640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f90f4006010 tx=0x7f90f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f91017fa640 1 -- 172.21.15.52:0/2711549120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f403f030 con 0x7f9104100480 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f91017fa640 1 -- 172.21.15.52:0/2711549120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f4003ce0 con 0x7f9104100480 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910419d650 con 0x7f9104100480 2024-09-19T09:35:59.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f91017fa640 1 -- 172.21.15.52:0/2711549120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4035070 con 0x7f9104100480 2024-09-19T09:35:59.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.420+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91041a4f90 con 0x7f9104100480 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.422+0000 7f91017fa640 1 -- 172.21.15.52:0/2711549120 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f90f4042030 con 0x7f9104100480 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 Processor -- start 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 -- start start 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a975d0 0x5572b9a97a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5572b99fd2f0 con 0x5572b9a98b40 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5572b99a4cf0 con 0x5572b9aa6780 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f910c831740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572b99f92b0 con 0x5572b9a975d0 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91017fa640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 0x7f90ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91089f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91089f5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36284/0 (socket says 172.21.15.52:36284) 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91089f5640 1 -- 172.21.15.52:0/1078341550 learned_addr learned my addr 172.21.15.52:0/1078341550 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91089f5640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 0x7f90ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.423+0000 7f91017fa640 1 -- 172.21.15.52:0/2711549120 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90f40efea0 con 0x7f9104100480 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f9103fff640 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a975d0 0x5572b9a97a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91037fe640 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 -- 172.21.15.52:0/1078341550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a975d0 msgr2=0x5572b9a97a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a975d0 0x5572b9a97a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 -- 172.21.15.52:0/1078341550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 msgr2=0x5572b9aa8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 -- 172.21.15.52:0/1078341550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b99893a0 con 0x5572b9a98b40 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f90fc013e60 tx=0x7f90fc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7c8a6396d19c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f91089f5640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 0x7f90ec0a5700 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f90fc010ca0 tx=0x7f90fc015000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f90ea7fc640 1 -- 172.21.15.52:0/1078341550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00ae10 con 0x5572b9a98b40 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f90ea7fc640 1 -- 172.21.15.52:0/1078341550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc007be0 con 0x5572b9a98b40 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.424+0000 7f90ea7fc640 1 -- 172.21.15.52:0/1078341550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc01f660 con 0x5572b9a98b40 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- 172.21.15.52:0/1078341550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 msgr2=0x5572b9a97090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f90fc013e60 tx=0x7f90fc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- 172.21.15.52:0/1078341550 shutdown_connections 2024-09-19T09:35:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a975d0 0x5572b9a97a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 --2- 172.21.15.52:0/1078341550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9a97090 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- 172.21.15.52:0/1078341550 >> 172.21.15.52:0/1078341550 conn(0x5572b9a60310 msgr2=0x5572b9a93c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- 172.21.15.52:0/1078341550 shutdown_connections 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- 172.21.15.52:0/1078341550 wait complete. 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.425+0000 7f910c831740 1 -- start start 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 Processor -- start 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9aa3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5572b9aa9420 con 0x5572b9a975d0 2024-09-19T09:35:59.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5572b99b8060 con 0x5572b9aa6780 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572b9aa95a0 con 0x5572b9a98b40 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f910c831740 10 client.0 _ll_register_callbacks cb 0x5572b970b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36298/0 (socket says 172.21.15.52:36298) 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 -- 172.21.15.52:0/1172558116 learned_addr learned my addr 172.21.15.52:0/1172558116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f91089f5640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f91037fe640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9aa3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 -- 172.21.15.52:0/1172558116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 msgr2=0x5572b9aa3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9aa3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 -- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 msgr2=0x5572b9aa39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f9103fff640 1 -- 172.21.15.52:0/1172558116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b976e3c0 con 0x5572b9a975d0 2024-09-19T09:35:59.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.426+0000 7f91037fe640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9aa3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f9103fff640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ed920 tx=0x7f90f40095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9654ad12c90d263d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40da060 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90f40c4ce0 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90fc007be0 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90f4049040 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 10 client.20697 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5572b9ab4ea0 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90fc007be0 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90f40bb950 con 0x5572b9a975d0 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 10 client.20697 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 10 client.20697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:59.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 20 client.20697 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:59.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9ab6290 0x5572b9ab8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 4 client.20697 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:35:59.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.427+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b9a0a860 con 0x5572b9ab6290 2024-09-19T09:35:59.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.428+0000 7f91037fe640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9ab6290 0x5572b9ab8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.428+0000 7f91037fe640 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9ab6290 0x5572b9ab8680 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5951738dffae7343 server_cookie=f5d758adc2a47a9b in_seq=0 out_seq=0 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.428+0000 7f90e37fe640 10 client.20697 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f90e37fe640 1 -- 172.21.15.52:0/1172558116 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572b9a0a860 con 0x5572b9ab6290 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f90e37fe640 10 client.20697 handle_command_reply: tid=0 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 client.20697 shutdown 2024-09-19T09:35:59.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 msgr2=0x5572b9aa6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ed920 tx=0x7f90f40095e0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 shutdown_connections 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9ab6290 0x5572b9ab8680 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9aa39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9aa3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 --2- 172.21.15.52:0/1172558116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa6160 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f90e37fe640 0 client.20697 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 >> 172.21.15.52:0/1172558116 conn(0x5572b9a60310 msgr2=0x5572b9a99960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 shutdown_connections 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.429+0000 7f910c831740 1 -- 172.21.15.52:0/1172558116 wait complete. 2024-09-19T09:35:59.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.430+0000 7f910c831740 20 client.20697 trim_cache size 0 max 16384 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.442+0000 7f910c831740 1 Processor -- start 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.442+0000 7f910c831740 1 -- start start 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9abdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9abe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91041add90 con 0x5572b9a975d0 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91041ab660 con 0x5572b9aa6780 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f910c831740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91041a94b0 con 0x5572b9a98b40 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36314/0 (socket says 172.21.15.52:36314) 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 -- 172.21.15.52:0/2742284700 learned_addr learned my addr 172.21.15.52:0/2742284700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f91089f5640 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9abe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f91037fe640 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9abdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 -- 172.21.15.52:0/2742284700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 msgr2=0x5572b9abdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9abdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 -- 172.21.15.52:0/2742284700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 msgr2=0x5572b9abe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9abe4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 -- 172.21.15.52:0/2742284700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9a94950 con 0x5572b9a975d0 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f9103fff640 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005940 tx=0x7f90f40bcd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fdf55b31f734e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f90e9ffb640 1 -- 172.21.15.52:0/2742284700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40da040 con 0x5572b9a975d0 2024-09-19T09:35:59.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f90e9ffb640 1 -- 172.21.15.52:0/2742284700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f403b580 con 0x5572b9a975d0 2024-09-19T09:35:59.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.443+0000 7f90e9ffb640 1 -- 172.21.15.52:0/2742284700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40bc500 con 0x5572b9a975d0 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 -- 172.21.15.52:0/2742284700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 msgr2=0x5572b9aa5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f90f4005940 tx=0x7f90f40bcd20 comp rx=0 tx=0).stop 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 -- 172.21.15.52:0/2742284700 shutdown_connections 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9aa6780 0x5572b9abe4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9a98b40 0x5572b9abdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 --2- 172.21.15.52:0/2742284700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a975d0 0x5572b9aa5380 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 -- 172.21.15.52:0/2742284700 >> 172.21.15.52:0/2742284700 conn(0x5572b9a60310 msgr2=0x5572b9aa4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 -- 172.21.15.52:0/2742284700 shutdown_connections 2024-09-19T09:35:59.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.444+0000 7f910c831740 1 -- 172.21.15.52:0/2742284700 wait complete. 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 -- start start 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 Processor -- start 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9a975d0 0x5572b9aae830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9aa6780 0x5572b9aab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91041a9b20 con 0x5572b9a98b40 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91041aaf90 con 0x5572b9a975d0 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91041aa1f0 con 0x5572b9aa6780 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.445+0000 7f910c831740 10 client.0 _ll_register_callbacks cb 0x7f90f40dc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36330/0 (socket says 172.21.15.52:36330) 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 -- 172.21.15.52:0/361352757 learned_addr learned my addr 172.21.15.52:0/361352757 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:35:59.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f9103fff640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9a975d0 0x5572b9aae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91089f5640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9aa6780 0x5572b9aab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 -- 172.21.15.52:0/361352757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9aa6780 msgr2=0x5572b9aab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9aa6780 0x5572b9aab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 -- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9a975d0 msgr2=0x5572b9aae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9a975d0 0x5572b9aae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 -- 172.21.15.52:0/361352757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b9aaf460 con 0x5572b9a98b40 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f91037fe640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f90f800b7c0 tx=0x7f90f800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf9823e2dc81e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f90e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f8005020 con 0x5572b9a98b40 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f90f80051c0 con 0x5572b9a98b40 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.446+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572b9a04d70 con 0x5572b9a98b40 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90f80053c0 con 0x5572b9a98b40 2024-09-19T09:35:59.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 10 client.20703 fetch_fsmap learned FSMap version 24 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5572b9b215d0 con 0x5572b9a98b40 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5572b9a04d70 con 0x5572b9a98b40 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90f8024030 con 0x5572b9a98b40 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 10 client.20703 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 10 client.20703 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 20 client.20703 populate_metadata read hostname 'smithi052' 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9b21cf0 0x5572b9b24110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 4 client.20703 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572b9981170 con 0x5572b9b21cf0 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.447+0000 7f9103fff640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9b21cf0 0x5572b9b24110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f9103fff640 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9b21cf0 0x5572b9b24110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4aa5094607b1587 server_cookie=3318bfa96f3bdb35 in_seq=0 out_seq=0 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f90e37fe640 10 client.20703 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:59.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f90e37fe640 1 -- 172.21.15.52:0/361352757 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572b9981170 con 0x5572b9b21cf0 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f90e37fe640 10 client.20703 handle_command_reply: tid=0 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 client.20703 shutdown 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 msgr2=0x5572b9aaed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f90f800b7c0 tx=0x7f90f800be70 comp rx=0 tx=0).stop 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 shutdown_connections 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5572b9aa6780 0x5572b9aab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5572b9a98b40 0x5572b9aaed70 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5572b9b21cf0 0x5572b9b24110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 --2- 172.21.15.52:0/361352757 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5572b9a975d0 0x5572b9aae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 >> 172.21.15.52:0/361352757 conn(0x5572b9a60310 msgr2=0x5572b9aa5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f90e37fe640 0 client.20703 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 shutdown_connections 2024-09-19T09:35:59.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 1 -- 172.21.15.52:0/361352757 wait complete. 2024-09-19T09:35:59.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.448+0000 7f910c831740 20 client.20703 trim_cache size 0 max 16384 2024-09-19T09:35:59.455 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:35:59.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 msgr2=0x7f90ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 0x7f90ec0a5700 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f90fc010ca0 tx=0x7f90fc015000 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 msgr2=0x7f9104198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f90f4006010 tx=0x7f90f40042f0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 shutdown_connections 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91041055b0 0x7f910419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f90ec0a3240 0x7f90ec0a5700 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9104100e30 0x7f9104198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 --2- 172.21.15.52:0/2711549120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9104100480 0x7f9104198410 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 >> 172.21.15.52:0/2711549120 conn(0x7f9104077210 msgr2=0x7f910410dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 shutdown_connections 2024-09-19T09:35:59.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:35:59.449+0000 7f910a458640 1 -- 172.21.15.52:0/2711549120 wait complete. 2024-09-19T09:35:59.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:35:59 smithi052 ceph-mon[30947]: pgmap v774: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:35:59.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:35:59 smithi169 ceph-mon[35454]: pgmap v774: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:35:59.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:35:59 smithi086 ceph-mon[34813]: pgmap v774: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-19T09:36:00.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:36:00.436 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:00.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 -- 172.21.15.52:0/2014146858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 msgr2=0x7fa44810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2014146858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44810ec40 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fa438009930 tx=0x7fa43802a420 comp rx=0 tx=0).stop 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 -- 172.21.15.52:0/2014146858 shutdown_connections 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2014146858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44810ec40 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2014146858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4481036e0 0x7fa448107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2014146858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa448102d30 0x7fa448103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 -- 172.21.15.52:0/2014146858 >> 172.21.15.52:0/2014146858 conn(0x7fa4480fc7d0 msgr2=0x7fa4480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 -- 172.21.15.52:0/2014146858 shutdown_connections 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.884+0000 7fa44eea4640 1 -- 172.21.15.52:0/2014146858 wait complete. 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 Processor -- start 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 -- start start 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa448102d30 0x7fa448198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4481036e0 0x7fa448198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa448112150 con 0x7fa4481082a0 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa448111fd0 con 0x7fa448102d30 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44eea4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481122d0 con 0x7fa4481036e0 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44d441640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44d441640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36342/0 (socket says 172.21.15.52:36342) 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44d441640 1 -- 172.21.15.52:0/2835511368 learned_addr learned my addr 172.21.15.52:0/2835511368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa44cc40640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa448102d30 0x7fa448198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.885+0000 7fa447fff640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4481036e0 0x7fa448198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 -- 172.21.15.52:0/2835511368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4481036e0 msgr2=0x7fa448198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4481036e0 0x7fa448198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 -- 172.21.15.52:0/2835511368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa448102d30 msgr2=0x7fa448198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa448102d30 0x7fa448198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 -- 172.21.15.52:0/2835511368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44819d4c0 con 0x7fa4481082a0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44d441640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fa43802aa10 tx=0x7fa438003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa445ffb640 1 -- 172.21.15.52:0/2835511368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43803f070 con 0x7fa4481082a0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44819d750 con 0x7fa4481082a0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa445ffb640 1 -- 172.21.15.52:0/2835511368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa438031c90 con 0x7fa4481082a0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa445ffb640 1 -- 172.21.15.52:0/2835511368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438035030 con 0x7fa4481082a0 2024-09-19T09:36:00.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.886+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4481a5090 con 0x7fa4481082a0 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.888+0000 7fa445ffb640 1 -- 172.21.15.52:0/2835511368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa438042070 con 0x7fa4481082a0 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 Processor -- start 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 -- start start 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 0x55ccbbb84090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb8f370 0x55ccbbb91760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ccbbaea2f0 con 0x55ccbbb845d0 2024-09-19T09:36:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ccbba91cf0 con 0x55ccbbb8f370 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa45127d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ccbbae62b0 con 0x55ccbbb85b40 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa445ffb640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 0x7fa4300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36348/0 (socket says 172.21.15.52:36348) 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa44cc40640 1 -- 172.21.15.52:0/1113557511 learned_addr learned my addr 172.21.15.52:0/1113557511 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.889+0000 7fa447fff640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 0x55ccbbb84090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44d441640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 0x7fa4300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa447fff640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb8f370 0x55ccbbb91760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa445ffb640 1 -- 172.21.15.52:0/2835511368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa4380f01b0 con 0x7fa4481082a0 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 -- 172.21.15.52:0/1113557511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 msgr2=0x55ccbbb84090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 0x55ccbbb84090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 -- 172.21.15.52:0/1113557511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb8f370 msgr2=0x55ccbbb91760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb8f370 0x55ccbbb91760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 -- 172.21.15.52:0/1113557511 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbba763a0 con 0x55ccbbb845d0 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa447fff640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 0x55ccbbb84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fa44000a4b0 tx=0x7fa4400096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6471f8475bda87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa44d441640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 0x7fa4300a5700 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa438003c00 tx=0x7fa438047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa42effd640 1 -- 172.21.15.52:0/1113557511 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440018020 con 0x55ccbbb845d0 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa42effd640 1 -- 172.21.15.52:0/1113557511 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440014cf0 con 0x55ccbbb845d0 2024-09-19T09:36:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.890+0000 7fa42effd640 1 -- 172.21.15.52:0/1113557511 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440013db0 con 0x55ccbbb845d0 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- 172.21.15.52:0/1113557511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 msgr2=0x55ccbbb84a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fa44000a4b0 tx=0x7fa4400096d0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- 172.21.15.52:0/1113557511 shutdown_connections 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb8f370 0x55ccbbb91760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb845d0 0x55ccbbb84a10 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 --2- 172.21.15.52:0/1113557511 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb85b40 0x55ccbbb84090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- 172.21.15.52:0/1113557511 >> 172.21.15.52:0/1113557511 conn(0x55ccbbb4d310 msgr2=0x55ccbbb80c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- 172.21.15.52:0/1113557511 shutdown_connections 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- 172.21.15.52:0/1113557511 wait complete. 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.891+0000 7fa45127d740 1 -- start start 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 Processor -- start 2024-09-19T09:36:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb8ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb8c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ccbbb96480 con 0x55ccbbb85b40 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ccbbaa5060 con 0x55ccbbb845d0 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ccbbb96600 con 0x55ccbbb8f370 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa45127d740 10 client.0 _ll_register_callbacks cb 0x55ccbb7f88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36360/0 (socket says 172.21.15.52:36360) 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 -- 172.21.15.52:0/1176336627 learned_addr learned my addr 172.21.15.52:0/1176336627 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa447fff640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb8ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa447fff640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb8c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 -- 172.21.15.52:0/1176336627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 msgr2=0x55ccbbb8c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb8c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 -- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 msgr2=0x55ccbbb8ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb8ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa44cc40640 1 -- 172.21.15.52:0/1176336627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccbb85b3c0 con 0x55ccbbb85b40 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.892+0000 7fa447fff640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb8ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa44cc40640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fa44000afd0 tx=0x7fa440007020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea299b56fa882e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44002c060 con 0x55ccbbb85b40 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa440014810 con 0x55ccbbb85b40 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa440014cf0 con 0x55ccbbb85b40 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa440014a10 con 0x55ccbbb85b40 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa45127d740 10 client.20715 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ccbbba1f00 con 0x55ccbbb85b40 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440014cf0 con 0x55ccbbb85b40 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.893+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa44001dce0 con 0x55ccbbb85b40 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 10 client.20715 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 10 client.20715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 20 client.20715 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbba3250 0x55ccbbba5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 4 client.20715 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccbbaf7860 con 0x55ccbbba3250 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa447fff640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbba3250 0x55ccbbba5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa447fff640 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbba3250 0x55ccbbba5640 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d05de6ae48471f2 server_cookie=e30a7b627e2eccff in_seq=0 out_seq=0 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.894+0000 7fa427fff640 10 client.20715 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa427fff640 1 -- 172.21.15.52:0/1176336627 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccbbaf7860 con 0x55ccbbba3250 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa427fff640 10 client.20715 handle_command_reply: tid=0 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 client.20715 shutdown 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 msgr2=0x55ccbbb8c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fa44000afd0 tx=0x7fa440007020 comp rx=0 tx=0).stop 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 shutdown_connections 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbba3250 0x55ccbbba5640 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb8c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb8c000 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 --2- 172.21.15.52:0/1176336627 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb8ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 >> 172.21.15.52:0/1176336627 conn(0x55ccbbb4d310 msgr2=0x55ccbbb86960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa427fff640 0 client.20715 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 shutdown_connections 2024-09-19T09:36:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 1 -- 172.21.15.52:0/1176336627 wait complete. 2024-09-19T09:36:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.895+0000 7fa45127d740 20 client.20715 trim_cache size 0 max 16384 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.908+0000 7fa45127d740 1 Processor -- start 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.908+0000 7fa45127d740 1 -- start start 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb9f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb87850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481ade10 con 0x55ccbbb85b40 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481ab6e0 con 0x55ccbbb845d0 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa45127d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481a9530 con 0x55ccbbb8f370 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36376/0 (socket says 172.21.15.52:36376) 2024-09-19T09:36:00.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 -- 172.21.15.52:0/544828896 learned_addr learned my addr 172.21.15.52:0/544828896 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa447fff640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb9f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa447fff640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb87850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 -- 172.21.15.52:0/544828896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 msgr2=0x55ccbbb87850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb87850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 -- 172.21.15.52:0/544828896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 msgr2=0x55ccbbb9f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb9f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 -- 172.21.15.52:0/544828896 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccbbba5640 con 0x55ccbbb85b40 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa447fff640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa44cc40640 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fa44000afa0 tx=0x7fa4400094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ec969fb3ae0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa42e7fc640 1 -- 172.21.15.52:0/544828896 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440018070 con 0x55ccbbb85b40 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa42e7fc640 1 -- 172.21.15.52:0/544828896 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440014610 con 0x55ccbbb85b40 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.909+0000 7fa42e7fc640 1 -- 172.21.15.52:0/544828896 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44002c030 con 0x55ccbbb85b40 2024-09-19T09:36:00.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- 172.21.15.52:0/544828896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 msgr2=0x55ccbbb87310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fa44000afa0 tx=0x7fa4400094f0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- 172.21.15.52:0/544828896 shutdown_connections 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb87850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbb87310 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 --2- 172.21.15.52:0/544828896 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbb9f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- 172.21.15.52:0/544828896 >> 172.21.15.52:0/544828896 conn(0x55ccbbb4d310 msgr2=0x55ccbbb83e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- 172.21.15.52:0/544828896 shutdown_connections 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- 172.21.15.52:0/544828896 wait complete. 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 -- start start 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.910+0000 7fa45127d740 1 Processor -- start 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbbaa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb9a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481a9ba0 con 0x55ccbbb85b40 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481ab010 con 0x55ccbbb845d0 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481aa270 con 0x55ccbbb8f370 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa45127d740 10 client.0 _ll_register_callbacks cb 0x7fa43c00a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36384/0 (socket says 172.21.15.52:36384) 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 -- 172.21.15.52:0/258569630 learned_addr learned my addr 172.21.15.52:0/258569630 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa447fff640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbbaa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 -- 172.21.15.52:0/258569630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 msgr2=0x55ccbbb9a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb9a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 -- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 msgr2=0x55ccbbbaa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbbaa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa44cc40640 1 -- 172.21.15.52:0/258569630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccbbb9ae00 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.911+0000 7fa447fff640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbbaa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa44cc40640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fa44001c800 tx=0x7fa44000ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc86a937e78760c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440018070 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa440014db0 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa440014610 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa44003f020 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 10 client.20721 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ccbbb9bff0 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa440014610 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa440032a50 con 0x55ccbbb85b40 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 10 client.20721 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:00.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 10 client.20721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 20 client.20721 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbc0dda0 0x55ccbbc10190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 4 client.20721 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.912+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccbbaf1d70 con 0x55ccbbc0dda0 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa447fff640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbc0dda0 0x55ccbbc10190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa447fff640 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbc0dda0 0x55ccbbc10190 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2eadb0ec5ff7896 server_cookie=a1b22345e58d75a3 in_seq=0 out_seq=0 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa427fff640 10 client.20721 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa427fff640 1 -- 172.21.15.52:0/258569630 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccbbaf1d70 con 0x55ccbbc0dda0 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa427fff640 10 client.20721 handle_command_reply: tid=0 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 client.20721 shutdown 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 msgr2=0x55ccbbbaa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fa44001c800 tx=0x7fa44000ae00 comp rx=0 tx=0).stop 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 shutdown_connections 2024-09-19T09:36:00.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ccbbc0dda0 0x55ccbbc10190 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ccbbb8f370 0x55ccbbb9a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa427fff640 0 client.20721 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ccbbb85b40 0x55ccbbbaa8f0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 --2- 172.21.15.52:0/258569630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ccbbb845d0 0x55ccbbbaa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.913+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 >> 172.21.15.52:0/258569630 conn(0x55ccbbb4d310 msgr2=0x55ccbbb872c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 shutdown_connections 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa45127d740 1 -- 172.21.15.52:0/258569630 wait complete. 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa45127d740 20 client.20721 trim_cache size 0 max 16384 2024-09-19T09:36:00.922 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 msgr2=0x7fa4300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 0x7fa4300a5700 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa438003c00 tx=0x7fa438047000 comp rx=0 tx=0).stop 2024-09-19T09:36:00.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 msgr2=0x7fa44819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fa43802aa10 tx=0x7fa438003b90 comp rx=0 tx=0).stop 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 shutdown_connections 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4481082a0 0x7fa44819cde0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa4300a3240 0x7fa4300a5700 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4481036e0 0x7fa448198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 --2- 172.21.15.52:0/2835511368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa448102d30 0x7fa448198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 >> 172.21.15.52:0/2835511368 conn(0x7fa4480fc7d0 msgr2=0x7fa4480fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.914+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 shutdown_connections 2024-09-19T09:36:00.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:00.915+0000 7fa44eea4640 1 -- 172.21.15.52:0/2835511368 wait complete. 2024-09-19T09:36:01.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 -- 172.21.15.52:0/1461274249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440ffbf0 msgr2=0x7f4244100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 --2- 172.21.15.52:0/1461274249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440ffbf0 0x7f4244100070 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f422c009900 tx=0x7f422c02a410 comp rx=0 tx=0).stop 2024-09-19T09:36:01.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 -- 172.21.15.52:0/1461274249 shutdown_connections 2024-09-19T09:36:01.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 --2- 172.21.15.52:0/1461274249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42441005b0 0x7f4244100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 --2- 172.21.15.52:0/1461274249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42440ffbf0 0x7f4244100070 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 --2- 172.21.15.52:0/1461274249 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4244102070 0x7f4244102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 -- 172.21.15.52:0/1461274249 >> 172.21.15.52:0/1461274249 conn(0x7f42440fb980 msgr2=0x7f42440fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 -- 172.21.15.52:0/1461274249 shutdown_connections 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.242+0000 7f4248847640 1 -- 172.21.15.52:0/1461274249 wait complete. 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 Processor -- start 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 -- start start 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 0x7f4244199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4244102070 0x7f42441a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f424410fa20 con 0x7f42441005b0 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f424410f8a0 con 0x7f42440ffbf0 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4248847640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f424410fba0 con 0x7f4244102070 2024-09-19T09:36:01.247 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36400/0 (socket says 172.21.15.52:36400) 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f423bfff640 1 -- 172.21.15.52:0/2999756304 learned_addr learned my addr 172.21.15.52:0/2999756304 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.243+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4244102070 0x7f42441a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f424259c640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 0x7f4244199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 -- 172.21.15.52:0/2999756304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4244102070 msgr2=0x7f42441a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4244102070 0x7f42441a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 -- 172.21.15.52:0/2999756304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 msgr2=0x7f4244199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 0x7f4244199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 -- 172.21.15.52:0/2999756304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42441a1b70 con 0x7f42441005b0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f424259c640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 0x7f4244199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423bfff640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f422c009230 tx=0x7f422c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423b7fe640 1 -- 172.21.15.52:0/2999756304 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c03f030 con 0x7f42441005b0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423b7fe640 1 -- 172.21.15.52:0/2999756304 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422c003ce0 con 0x7f42441005b0 2024-09-19T09:36:01.248 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42441a1e00 con 0x7f42441005b0 2024-09-19T09:36:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f423b7fe640 1 -- 172.21.15.52:0/2999756304 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c035070 con 0x7f42441005b0 2024-09-19T09:36:01.249 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.244+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a2260 con 0x7f42441005b0 2024-09-19T09:36:01.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f423b7fe640 1 -- 172.21.15.52:0/2999756304 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f422c042030 con 0x7f42441005b0 2024-09-19T09:36:01.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 Processor -- start 2024-09-19T09:36:01.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 -- start start 2024-09-19T09:36:01.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10114da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10119da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf100782f0 con 0x55bf1011a370 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bf10020270 con 0x55bf101152e0 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.247+0000 7f424b5db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bf100742b0 con 0x55bf101149a0 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36406/0 (socket says 172.21.15.52:36406) 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 -- 172.21.15.52:0/1179661392 learned_addr learned my addr 172.21.15.52:0/1179661392 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f424259c640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f4242d9d640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423b7fe640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 0x7f42300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 -- 172.21.15.52:0/1179661392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 msgr2=0x55bf10114da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10114da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 -- 172.21.15.52:0/1179661392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 msgr2=0x55bf10119da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10119da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 -- 172.21.15.52:0/1179661392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1001f340 con 0x55bf1011a370 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f424259c640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 0x7f42300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423b7fe640 1 -- 172.21.15.52:0/2999756304 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f422c0f03a0 con 0x7f42441005b0 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f423bfff640 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f422c00a730 tx=0x7f422c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bed953426075cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 0x7f42300a57b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f423c005fd0 tx=0x7f423c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f4238ff9640 1 -- 172.21.15.52:0/1179661392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0bc280 con 0x55bf1011a370 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.248+0000 7f4238ff9640 1 -- 172.21.15.52:0/1179661392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422c0bd020 con 0x55bf1011a370 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f4238ff9640 1 -- 172.21.15.52:0/1179661392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c046e60 con 0x55bf1011a370 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 -- 172.21.15.52:0/1179661392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 msgr2=0x55bf1011c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f422c00a730 tx=0x7f422c04c000 comp rx=0 tx=0).stop 2024-09-19T09:36:01.257 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 -- 172.21.15.52:0/1179661392 shutdown_connections 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf1011c830 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 --2- 172.21.15.52:0/1179661392 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10114da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 -- 172.21.15.52:0/1179661392 >> 172.21.15.52:0/1179661392 conn(0x55bf10110010 msgr2=0x55bf10110410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 -- 172.21.15.52:0/1179661392 shutdown_connections 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.249+0000 7f424b5db740 1 -- 172.21.15.52:0/1179661392 wait complete. 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 -- start start 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 Processor -- start 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101149a0 0x55bf1011e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 0x55bf1011ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.258 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55bf1011d100 con 0x55bf1011a370 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55bf10001290 con 0x55bf101149a0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55bf1011d280 con 0x55bf101152e0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424b5db740 10 client.0 _ll_register_callbacks cb 0x55bf10032140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36422/0 (socket says 172.21.15.52:36422) 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 -- 172.21.15.52:0/1505451743 learned_addr learned my addr 172.21.15.52:0/1505451743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f424259c640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101149a0 0x55bf1011e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f423bfff640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 0x55bf1011ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 -- 172.21.15.52:0/1505451743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 msgr2=0x55bf1011ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 0x55bf1011ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 -- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101149a0 msgr2=0x55bf1011e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101149a0 0x55bf1011e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f4242d9d640 1 -- 172.21.15.52:0/1505451743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf0fd8b210 con 0x55bf1011a370 2024-09-19T09:36:01.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.250+0000 7f423bfff640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 0x55bf1011ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4242d9d640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f423c0126c0 tx=0x7f423c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d3cacb26024cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c010810 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f423c0109b0 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422c0bd020 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f423c030050 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 10 client.20733 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bf0fe57620 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422c0bd020 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f423c00f040 con 0x55bf1011a370 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 10 client.20733 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:01.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 10 client.20733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 20 client.20733 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1012a5e0 0x55bf1012ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.251+0000 7f424b5db740 4 client.20733 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.252+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf10085a20 con 0x55bf1012a5e0 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.252+0000 7f424259c640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1012a5e0 0x55bf1012ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.252+0000 7f424259c640 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1012a5e0 0x55bf1012ca60 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e091a99176a14c server_cookie=36d6cccfc4e9f6d in_seq=0 out_seq=0 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.252+0000 7f4229ffb640 10 client.20733 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f4229ffb640 1 -- 172.21.15.52:0/1505451743 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf10085a20 con 0x55bf1012a5e0 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f4229ffb640 10 client.20733 handle_command_reply: tid=0 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 client.20733 shutdown 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 msgr2=0x55bf10125e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f423c0126c0 tx=0x7f423c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 shutdown_connections 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1012a5e0 0x55bf1012ca60 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10125e20 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101152e0 0x55bf1011ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f4229ffb640 0 client.20733 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 --2- 172.21.15.52:0/1505451743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101149a0 0x55bf1011e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 >> 172.21.15.52:0/1505451743 conn(0x55bf10110010 msgr2=0x55bf10111820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 shutdown_connections 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 1 -- 172.21.15.52:0/1505451743 wait complete. 2024-09-19T09:36:01.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.253+0000 7f424b5db740 20 client.20733 trim_cache size 0 max 16384 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 Processor -- start 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 -- start start 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10110ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf1011a370 0x55bf10111400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42441adbf0 con 0x55bf101152e0 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42441ab4c0 con 0x55bf1011a370 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.267+0000 7f424b5db740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42441a9310 con 0x55bf101149a0 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.271 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36436/0 (socket says 172.21.15.52:36436) 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 -- 172.21.15.52:0/3881316238 learned_addr learned my addr 172.21.15.52:0/3881316238 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f4242d9d640 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf1011a370 0x55bf10111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f424259c640 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10110ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 -- 172.21.15.52:0/3881316238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 msgr2=0x55bf10110ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10110ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 -- 172.21.15.52:0/3881316238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf1011a370 msgr2=0x55bf10111400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf1011a370 0x55bf10111400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 -- 172.21.15.52:0/3881316238 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1012d0e0 con 0x55bf101152e0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f423bfff640 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f422c0bc620 tx=0x7f422c0bc920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2957810fba56eaaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f422bfff640 1 -- 172.21.15.52:0/3881316238 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c049070 con 0x55bf101152e0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f422bfff640 1 -- 172.21.15.52:0/3881316238 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422c0bd020 con 0x55bf101152e0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.268+0000 7f422bfff640 1 -- 172.21.15.52:0/3881316238 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c0a73f0 con 0x55bf101152e0 2024-09-19T09:36:01.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- 172.21.15.52:0/3881316238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 msgr2=0x55bf10125de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f422c0bc620 tx=0x7f422c0bc920 comp rx=0 tx=0).stop 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- 172.21.15.52:0/3881316238 shutdown_connections 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf1011a370 0x55bf10111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf101152e0 0x55bf10125de0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 --2- 172.21.15.52:0/3881316238 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf10110ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- 172.21.15.52:0/3881316238 >> 172.21.15.52:0/3881316238 conn(0x55bf10110010 msgr2=0x55bf1011e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- 172.21.15.52:0/3881316238 shutdown_connections 2024-09-19T09:36:01.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- 172.21.15.52:0/3881316238 wait complete. 2024-09-19T09:36:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.269+0000 7f424b5db740 1 -- start start 2024-09-19T09:36:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 Processor -- start 2024-09-19T09:36:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf101235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10123af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f4242d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36438/0 (socket says 172.21.15.52:36438) 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424259c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf101235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f4242d9d640 1 -- 172.21.15.52:0/2717784473 learned_addr learned my addr 172.21.15.52:0/2717784473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f42441a9980 con 0x55bf1011a370 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f42441aadf0 con 0x55bf101152e0 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.270+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42441aa050 con 0x55bf101149a0 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 -- 172.21.15.52:0/2717784473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 msgr2=0x55bf101235b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf101235b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 -- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 msgr2=0x55bf10123af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10123af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf10125100 con 0x55bf1011a370 2024-09-19T09:36:01.276 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f424b5db740 10 client.0 _ll_register_callbacks cb 0x7f423c009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422c0bd020 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4242d9d640 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f423c009f70 tx=0x7f423c010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4aa709fd0e9e94b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4229ffb640 10 client.20739 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4229ffb640 1 -- 172.21.15.52:0/2717784473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c049020 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.271+0000 7f4229ffb640 1 -- 172.21.15.52:0/2717784473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f423c010c30 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f4229ffb640 1 -- 172.21.15.52:0/2717784473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f423c024020 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 10 client.20739 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55bf1018f310 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f4229ffb640 1 -- 172.21.15.52:0/2717784473 <== mon.0 v2:172.21.15.52:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f423c020400 con 0x55bf1011a370 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 10 client.20739 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 10 client.20739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 20 client.20739 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:01.277 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1018fd20 0x55bf101921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 4 client.20739 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:36:01.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf1007fd70 con 0x55bf1018fd20 2024-09-19T09:36:01.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.272+0000 7f424259c640 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1018fd20 0x55bf101921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.273+0000 7f424259c640 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1018fd20 0x55bf101921e0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd32d6aab48f6449 server_cookie=4658c8dbc473b0b4 in_seq=0 out_seq=0 2024-09-19T09:36:01.278 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.273+0000 7f4229ffb640 10 client.20739 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:01.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f4229ffb640 1 -- 172.21.15.52:0/2717784473 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf1007fd70 con 0x55bf1018fd20 2024-09-19T09:36:01.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f4229ffb640 10 client.20739 handle_command_reply: tid=0 2024-09-19T09:36:01.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 client.20739 shutdown 2024-09-19T09:36:01.287 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 msgr2=0x55bf10124af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f423c009f70 tx=0x7f423c010a40 comp rx=0 tx=0).stop 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 shutdown_connections 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55bf1018fd20 0x55bf101921e0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55bf1011a370 0x55bf10124af0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f4229ffb640 0 client.20739 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55bf101152e0 0x55bf10123af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 --2- 172.21.15.52:0/2717784473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55bf101149a0 0x55bf101235b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 >> 172.21.15.52:0/2717784473 conn(0x55bf10110010 msgr2=0x55bf1010e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 shutdown_connections 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 1 -- 172.21.15.52:0/2717784473 wait complete. 2024-09-19T09:36:01.288 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.285+0000 7f424b5db740 20 client.20739 trim_cache size 0 max 16384 2024-09-19T09:36:01.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:36:01.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:36:01.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:36:01.289 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 msgr2=0x7f42300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 0x7f42300a57b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f423c005fd0 tx=0x7f423c004a40 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 msgr2=0x7f424419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f422c009230 tx=0x7f422c004360 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 shutdown_connections 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f42300a32f0 0x7f42300a57b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4244102070 0x7f42441a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441005b0 0x7f424419a490 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 --2- 172.21.15.52:0/2999756304 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42440ffbf0 0x7f4244199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 >> 172.21.15.52:0/2999756304 conn(0x7f42440fb980 msgr2=0x7f42440fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.290 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 shutdown_connections 2024-09-19T09:36:01.291 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:01.286+0000 7f4248847640 1 -- 172.21.15.52:0/2999756304 wait complete. 2024-09-19T09:36:01.614 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:01 smithi052 ceph-mon[30947]: pgmap v775: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:01 smithi169 ceph-mon[35454]: pgmap v775: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:01.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:01 smithi086 ceph-mon[34813]: pgmap v775: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:01.995 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:36:01.995 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T09:36:01.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:02.255 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:02.644 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:36:02.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:36:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.750+0000 7fc4e659e640 1 -- 172.21.15.52:0/1698896099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0101e10 msgr2=0x7fc4e01021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.750+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1698896099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0101e10 0x7fc4e01021f0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009900 tx=0x7fc4d002a410 comp rx=0 tx=0).stop 2024-09-19T09:36:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 -- 172.21.15.52:0/1698896099 shutdown_connections 2024-09-19T09:36:02.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1698896099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e0106f40 0x7fc4e010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1698896099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e01027c0 0x7fc4e0106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1698896099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0101e10 0x7fc4e01021f0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 -- 172.21.15.52:0/1698896099 >> 172.21.15.52:0/1698896099 conn(0x7fc4e00fd8d0 msgr2=0x7fc4e00ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 -- 172.21.15.52:0/1698896099 shutdown_connections 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 -- 172.21.15.52:0/1698896099 wait complete. 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 Processor -- start 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.751+0000 7fc4e659e640 1 -- start start 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e0101e10 0x7fc4e019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 0x7fc4e019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111fa0 con 0x7fc4e0106f40 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0111e20 con 0x7fc4e01027c0 2024-09-19T09:36:02.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e659e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0112120 con 0x7fc4e0101e10 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36468/0 (socket says 172.21.15.52:36468) 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 -- 172.21.15.52:0/1609688083 learned_addr learned my addr 172.21.15.52:0/1609688083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4df7fe640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 0x7fc4e019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4dffff640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e0101e10 0x7fc4e019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 -- 172.21.15.52:0/1609688083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e0101e10 msgr2=0x7fc4e019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e0101e10 0x7fc4e019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 -- 172.21.15.52:0/1609688083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 msgr2=0x7fc4e019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 0x7fc4e019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 -- 172.21.15.52:0/1609688083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019f600 con 0x7fc4e0106f40 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4df7fe640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 0x7fc4e019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4e4b3b640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800eaa0 tx=0x7fc4d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.752+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800cdb0 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.753+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d8005020 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.753+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019f8f0 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.753+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80116b0 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.753+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a71d0 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.754+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e01021f0 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.755+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc4d8005560 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.755+0000 7fc4dd7fa640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 0x7fc4c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.756+0000 7fc4dffff640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 0x7fc4c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.756+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc4d80cfc30 con 0x7fc4e0106f40 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.756+0000 7fc4dffff640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 0x7fc4c80a5700 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005ab0 tx=0x7fc4d0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:02.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.760+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4d8016030 con 0x7fc4e0106f40 2024-09-19T09:36:02.916 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.989+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e01a74b0 con 0x7fc4e0106f40 2024-09-19T09:36:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.989+0000 7fc4dd7fa640 1 -- 172.21.15.52:0/1609688083 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fc4d809c8d0 con 0x7fc4e0106f40 2024-09-19T09:36:02.991 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:36:02.991 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:36:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:36:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 msgr2=0x7fc4c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 0x7fc4c80a5700 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005ab0 tx=0x7fc4d0005a20 comp rx=0 tx=0).stop 2024-09-19T09:36:02.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 msgr2=0x7fc4e019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800eaa0 tx=0x7fc4d800ef60 comp rx=0 tx=0).stop 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 shutdown_connections 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4e0106f40 0x7fc4e019ef20 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01027c0 0x7fc4e019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc4c80a3240 0x7fc4c80a5700 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 --2- 172.21.15.52:0/1609688083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc4e0101e10 0x7fc4e019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 >> 172.21.15.52:0/1609688083 conn(0x7fc4e00fd8d0 msgr2=0x7fc4e00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 shutdown_connections 2024-09-19T09:36:02.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:02.992+0000 7fc4e659e640 1 -- 172.21.15.52:0/1609688083 wait complete. 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 -- 172.21.15.52:0/685137939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac101de0 msgr2=0x7fccac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 --2- 172.21.15.52:0/685137939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac101de0 0x7fccac1021c0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009900 tx=0x7fcca802a410 comp rx=0 tx=0).stop 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 -- 172.21.15.52:0/685137939 shutdown_connections 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 --2- 172.21.15.52:0/685137939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 --2- 172.21.15.52:0/685137939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac102790 0x7fccac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 --2- 172.21.15.52:0/685137939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac101de0 0x7fccac1021c0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 -- 172.21.15.52:0/685137939 >> 172.21.15.52:0/685137939 conn(0x7fccac0fd8c0 msgr2=0x7fccac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 -- 172.21.15.52:0/685137939 shutdown_connections 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 -- 172.21.15.52:0/685137939 wait complete. 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.569+0000 7fccb47b9640 1 Processor -- start 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 -- start start 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac101de0 0x7fccac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccac112010 con 0x7fccac102790 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccac111e90 con 0x7fccac101de0 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb47b9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccac112190 con 0x7fccac106f10 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36484/0 (socket says 172.21.15.52:36484) 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 -- 172.21.15.52:0/2937992597 learned_addr learned my addr 172.21.15.52:0/2937992597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:03.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb2555640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac101de0 0x7fccac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb2d56640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 -- 172.21.15.52:0/2937992597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 msgr2=0x7fccac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 -- 172.21.15.52:0/2937992597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac101de0 msgr2=0x7fccac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac101de0 0x7fccac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 -- 172.21.15.52:0/2937992597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccac1a6a70 con 0x7fccac102790 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb2d56640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.570+0000 7fccb1d54640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00b4a0 tx=0x7fcc9c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.571+0000 7fcca37fe640 1 -- 172.21.15.52:0/2937992597 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c014070 con 0x7fccac102790 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.571+0000 7fcca37fe640 1 -- 172.21.15.52:0/2937992597 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc9c010af0 con 0x7fccac102790 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.571+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccac1a6d60 con 0x7fccac102790 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.571+0000 7fcca37fe640 1 -- 172.21.15.52:0/2937992597 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c017d10 con 0x7fccac102790 2024-09-19T09:36:03.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.571+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccac1a7260 con 0x7fccac102790 2024-09-19T09:36:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.573+0000 7fcca37fe640 1 -- 172.21.15.52:0/2937992597 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcc9c017070 con 0x7fccac102790 2024-09-19T09:36:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 Processor -- start 2024-09-19T09:36:03.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 -- start start 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf77f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf82800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fcca37fe640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 0x7fcc980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56340bedd280 con 0x56340bf82d40 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56340be84b10 con 0x56340bf77b60 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb6b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56340bed9240 con 0x56340bf78480 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.574+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36486/0 (socket says 172.21.15.52:36486) 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 -- 172.21.15.52:0/3719436410 learned_addr learned my addr 172.21.15.52:0/3719436410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:03.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb1d54640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 0x7fcc980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf77f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2555640 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf82800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fcca37fe640 1 -- 172.21.15.52:0/2937992597 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcc9c0ced10 con 0x7fccac102790 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 -- 172.21.15.52:0/3719436410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 msgr2=0x56340bf82800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf82800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 -- 172.21.15.52:0/3719436410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 msgr2=0x56340bf77f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf77f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 -- 172.21.15.52:0/3719436410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340be911f0 con 0x56340bf82d40 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fcca4014bc0 tx=0x7fcca400a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6e6a64585ff335 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fccb1d54640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 0x7fcc980a5780 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c09b240 tx=0x7fcc9c00bf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fcca0ff9640 1 -- 172.21.15.52:0/3719436410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4014250 con 0x56340bf82d40 2024-09-19T09:36:03.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fcca0ff9640 1 -- 172.21.15.52:0/3719436410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca4011400 con 0x56340bf82d40 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.575+0000 7fcca0ff9640 1 -- 172.21.15.52:0/3719436410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4013650 con 0x56340bf82d40 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 -- 172.21.15.52:0/3719436410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 msgr2=0x56340bf85130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7fcca4014bc0 tx=0x7fcca400a6b0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 -- 172.21.15.52:0/3719436410 shutdown_connections 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf82d40 0x56340bf85130 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf82800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3719436410 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf77f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 -- 172.21.15.52:0/3719436410 >> 172.21.15.52:0/3719436410 conn(0x56340bf740f0 msgr2=0x56340bf744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 -- 172.21.15.52:0/3719436410 shutdown_connections 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.576+0000 7fccb6b92740 1 -- 172.21.15.52:0/3719436410 wait complete. 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 -- start start 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 Processor -- start 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf7fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf82d40 0x56340bf80690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56340bf85910 con 0x56340bf78480 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56340be97f10 con 0x56340bf77b60 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56340bf85a90 con 0x56340bf82d40 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb6b92740 10 client.0 _ll_register_callbacks cb 0x56340be60a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36498/0 (socket says 172.21.15.52:36498) 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 -- 172.21.15.52:0/1920769120 learned_addr learned my addr 172.21.15.52:0/1920769120 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2d56640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf7fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2d56640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf82d40 0x56340bf80690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 -- 172.21.15.52:0/1920769120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf82d40 msgr2=0x56340bf80690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf82d40 0x56340bf80690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 -- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 msgr2=0x56340bf7fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf7fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2555640 1 -- 172.21.15.52:0/1920769120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340bc4e6a0 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.577+0000 7fccb2d56640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf7fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fccb2555640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58111b52b5eebfed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8035040 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcca8005220 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca4011400 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcca804a030 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fccb6b92740 10 client.20757 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56340bf91510 con 0x56340bf78480 2024-09-19T09:36:03.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca4011400 con 0x56340bf78480 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcca80035f0 con 0x56340bf78480 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.578+0000 7fccb6b92740 10 client.20757 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb6b92740 10 client.20757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb6b92740 20 client.20757 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf929d0 0x56340bf94dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb6b92740 4 client.20757 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56340beea7f0 con 0x56340bf929d0 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb2d56640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf929d0 0x56340bf94dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fcc95ffb640 10 client.20757 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.579+0000 7fccb2d56640 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf929d0 0x56340bf94dc0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d8380cb52ebbd40 server_cookie=a3b51e5080e0a9e2 in_seq=0 out_seq=0 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fcc95ffb640 1 -- 172.21.15.52:0/1920769120 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56340beea7f0 con 0x56340bf929d0 2024-09-19T09:36:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fcc95ffb640 10 client.20757 handle_command_reply: tid=0 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 client.20757 shutdown 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 msgr2=0x56340bf80150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fcca8033000 tx=0x7fcca8004270 comp rx=0 tx=0).stop 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 shutdown_connections 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf929d0 0x56340bf94dc0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf82d40 0x56340bf80690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf78480 0x56340bf80150 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 --2- 172.21.15.52:0/1920769120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf7fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 >> 172.21.15.52:0/1920769120 conn(0x56340bf740f0 msgr2=0x56340bf79dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fcc95ffb640 0 client.20757 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 shutdown_connections 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 1 -- 172.21.15.52:0/1920769120 wait complete. 2024-09-19T09:36:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.580+0000 7fccb6b92740 20 client.20757 trim_cache size 0 max 16384 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 Processor -- start 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 -- start start 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 0x56340bf9a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf78480 0x56340bf9ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1b2340 con 0x56340bf740f0 2024-09-19T09:36:03.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1afc10 con 0x56340bf78480 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb6b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1ada60 con 0x56340bf77b60 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36512/0 (socket says 172.21.15.52:36512) 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 -- 172.21.15.52:0/432494475 learned_addr learned my addr 172.21.15.52:0/432494475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2555640 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 0x56340bf9a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 -- 172.21.15.52:0/432494475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 msgr2=0x56340bf9a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 0x56340bf9a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 -- 172.21.15.52:0/432494475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf78480 msgr2=0x56340bf9ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf78480 0x56340bf9ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2d56640 1 -- 172.21.15.52:0/432494475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56340bf6f830 con 0x56340bf740f0 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.598+0000 7fccb2555640 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 0x56340bf9a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb2d56640 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fcca4011d70 tx=0x7fcca4011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a8b023b4e7cbe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fcc97fff640 1 -- 172.21.15.52:0/432494475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca402e070 con 0x56340bf740f0 2024-09-19T09:36:03.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fcc97fff640 1 -- 172.21.15.52:0/432494475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca4026070 con 0x56340bf740f0 2024-09-19T09:36:03.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fcc97fff640 1 -- 172.21.15.52:0/432494475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca4021690 con 0x56340bf740f0 2024-09-19T09:36:03.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 -- 172.21.15.52:0/432494475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 msgr2=0x56340bf81a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fcca4011d70 tx=0x7fcca4011e40 comp rx=0 tx=0).stop 2024-09-19T09:36:03.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 -- 172.21.15.52:0/432494475 shutdown_connections 2024-09-19T09:36:03.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf78480 0x56340bf9ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf77b60 0x56340bf9a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 --2- 172.21.15.52:0/432494475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf81a70 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.599+0000 7fccb6b92740 1 -- 172.21.15.52:0/432494475 >> 172.21.15.52:0/432494475 conn(0x56340bf7b600 msgr2=0x56340bf81360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- 172.21.15.52:0/432494475 shutdown_connections 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- 172.21.15.52:0/432494475 wait complete. 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- start start 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 Processor -- start 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf87100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf87640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1ae0d0 con 0x56340bf740f0 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1af540 con 0x56340bf77b60 2024-09-19T09:36:03.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fccac1ae7a0 con 0x56340bf78480 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb6b92740 10 client.0 _ll_register_callbacks cb 0x7fcca8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb2d56640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36528/0 (socket says 172.21.15.52:36528) 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.600+0000 7fccb2d56640 1 -- 172.21.15.52:0/3379910610 learned_addr learned my addr 172.21.15.52:0/3379910610 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2555640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf87100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf87640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 -- 172.21.15.52:0/3379910610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 msgr2=0x56340bf87640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf87640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 -- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 msgr2=0x56340bf87100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf87100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 -- 172.21.15.52:0/3379910610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56340bffc840 con 0x56340bf740f0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb2d56640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fcca4004a80 tx=0x7fcca400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420175c5d3b165e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:03.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fcc95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca403c060 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcca4011400 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca4026070 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcca402e070 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb6b92740 10 client.20763 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.601+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56340bffdab0 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcca4026070 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcca4010040 con 0x56340bf740f0 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 10 client.20763 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 10 client.20763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 20 client.20763 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf82d40 0x56340bffff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:03.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 4 client.20763 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56340bee4d00 con 0x56340bf82d40 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb2555640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf82d40 0x56340bffff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.603+0000 7fcc95ffb640 10 client.20763 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.602+0000 7fccb2555640 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf82d40 0x56340bffff90 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9574cd47f90625a server_cookie=8f01bc5eb9e72d0c in_seq=0 out_seq=0 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.603+0000 7fcc95ffb640 1 -- 172.21.15.52:0/3379910610 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56340bee4d00 con 0x56340bf82d40 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.603+0000 7fcc95ffb640 10 client.20763 handle_command_reply: tid=0 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.603+0000 7fccb6b92740 1 client.20763 shutdown 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 msgr2=0x56340bf86bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fcca4004a80 tx=0x7fcca400a510 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 shutdown_connections 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56340bf82d40 0x56340bffff90 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56340bf78480 0x56340bf87640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56340bf77b60 0x56340bf87100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 --2- 172.21.15.52:0/3379910610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56340bf740f0 0x56340bf86bc0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 >> 172.21.15.52:0/3379910610 conn(0x56340bf7b600 msgr2=0x56340bf73270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fcc95ffb640 0 client.20763 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 shutdown_connections 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 1 -- 172.21.15.52:0/3379910610 wait complete. 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb6b92740 20 client.20763 trim_cache size 0 max 16384 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "09ee5ed2-dff3-4ba8-992c-13866d03ba27", 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:36:03.610 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 msgr2=0x7fcc980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 0x7fcc980a5780 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c09b240 tx=0x7fcc9c00bf90 comp rx=0 tx=0).stop 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 msgr2=0x7fccac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.604+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c00b4a0 tx=0x7fcc9c00b960 comp rx=0 tx=0).stop 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 shutdown_connections 2024-09-19T09:36:03.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcc980a32c0 0x7fcc980a5780 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccac106f10 0x7fccac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccac102790 0x7fccac074a30 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 --2- 172.21.15.52:0/2937992597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccac101de0 0x7fccac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 >> 172.21.15.52:0/2937992597 conn(0x7fccac0fd8c0 msgr2=0x7fccac0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 shutdown_connections 2024-09-19T09:36:03.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:03.605+0000 7fccb47b9640 1 -- 172.21.15.52:0/2937992597 wait complete. 2024-09-19T09:36:03.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:03 smithi052 ceph-mon[30947]: pgmap v776: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:36:03.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1609688083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:03 smithi169 ceph-mon[35454]: pgmap v776: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:36:03.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:03 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1609688083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:03 smithi086 ceph-mon[34813]: pgmap v776: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:36:03.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:03 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1609688083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:04.080 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T09:36:04.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T09:36:04.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:36:04.875 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 -- 172.21.15.52:0/2037924698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c106f10 msgr2=0x7ff78c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 --2- 172.21.15.52:0/2037924698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c106f10 0x7ff78c10ea90 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7ff788009ca0 tx=0x7ff78802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 -- 172.21.15.52:0/2037924698 shutdown_connections 2024-09-19T09:36:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 --2- 172.21.15.52:0/2037924698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c106f10 0x7ff78c10ea90 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 --2- 172.21.15.52:0/2037924698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c102790 0x7ff78c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 --2- 172.21.15.52:0/2037924698 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 -- 172.21.15.52:0/2037924698 >> 172.21.15.52:0/2037924698 conn(0x7ff78c0fd8c0 msgr2=0x7ff78c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 -- 172.21.15.52:0/2037924698 shutdown_connections 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 -- 172.21.15.52:0/2037924698 wait complete. 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.351+0000 7ff793556640 1 Processor -- start 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 -- start start 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 0x7ff78c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c111f70 con 0x7ff78c102790 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c111df0 con 0x7ff78c106f10 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff793556640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1120f0 con 0x7ff78c101de0 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36532/0 (socket says 172.21.15.52:36532) 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 -- 172.21.15.52:0/3238134453 learned_addr learned my addr 172.21.15.52:0/3238134453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:05.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff791af3640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 0x7ff78c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 -- 172.21.15.52:0/3238134453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 msgr2=0x7ff78c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 -- 172.21.15.52:0/3238134453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 msgr2=0x7ff78c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 0x7ff78c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 -- 172.21.15.52:0/3238134453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c1a68b0 con 0x7ff78c102790 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff791af3640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 0x7ff78c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.352+0000 7ff790af1640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00d950 tx=0x7ff77c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.353+0000 7ff7827fc640 1 -- 172.21.15.52:0/3238134453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c017070 con 0x7ff78c102790 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.353+0000 7ff7827fc640 1 -- 172.21.15.52:0/3238134453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77c009c30 con 0x7ff78c102790 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.353+0000 7ff7827fc640 1 -- 172.21.15.52:0/3238134453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00f6b0 con 0x7ff78c102790 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.353+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c1a6ba0 con 0x7ff78c102790 2024-09-19T09:36:05.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.353+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c1a7130 con 0x7ff78c102790 2024-09-19T09:36:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff7827fc640 1 -- 172.21.15.52:0/3238134453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff77c0109d0 con 0x7ff78c102790 2024-09-19T09:36:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 Processor -- start 2024-09-19T09:36:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 -- start start 2024-09-19T09:36:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c52850 0x558085c52c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c5fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558085bb7160 con 0x558085c53170 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558085b5e720 con 0x558085c52850 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff79592f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558085bb3120 con 0x558085c5da30 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.356+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36548/0 (socket says 172.21.15.52:36548) 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 -- 172.21.15.52:0/3364330053 learned_addr learned my addr 172.21.15.52:0/3364330053 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff791af3640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c52850 0x558085c52c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff790af1640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c5fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 -- 172.21.15.52:0/3364330053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 msgr2=0x558085c5fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c5fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7827fc640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 0x7ff7780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 -- 172.21.15.52:0/3364330053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c52850 msgr2=0x558085c52c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c52850 0x558085c52c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 -- 172.21.15.52:0/3364330053 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558085928ba0 con 0x558085c53170 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff790af1640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c5fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff791af3640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 0x7ff7780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7827fc640 1 -- 172.21.15.52:0/3238134453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff77c0cf560 con 0x7ff78c102790 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff78400bd40 tx=0x7ff78400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc8b1f90f19f514 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.357+0000 7ff7777fe640 1 -- 172.21.15.52:0/3364330053 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784015070 con 0x558085c53170 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff7777fe640 1 -- 172.21.15.52:0/3364330053 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff78400be30 con 0x558085c53170 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff7777fe640 1 -- 172.21.15.52:0/3364330053 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784011aa0 con 0x558085c53170 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 -- 172.21.15.52:0/3364330053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 msgr2=0x558085c5d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff791af3640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 0x7ff7780a5780 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff78802f540 tx=0x7ff7880095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff78400bd40 tx=0x7ff78400f730 comp rx=0 tx=0).stop 2024-09-19T09:36:05.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 -- 172.21.15.52:0/3364330053 shutdown_connections 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c5fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c53170 0x558085c5d4f0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 --2- 172.21.15.52:0/3364330053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c52850 0x558085c52c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 -- 172.21.15.52:0/3364330053 >> 172.21.15.52:0/3364330053 conn(0x558085c4ede0 msgr2=0x558085c4f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 -- 172.21.15.52:0/3364330053 shutdown_connections 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.358+0000 7ff79592f740 1 -- 172.21.15.52:0/3364330053 wait complete. 2024-09-19T09:36:05.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 -- start start 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 Processor -- start 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c5ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c5b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558085c60600 con 0x558085c52850 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558085b3f900 con 0x558085c5da30 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558085c60780 con 0x558085c53170 2024-09-19T09:36:05.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff79592f740 10 client.0 _ll_register_callbacks cb 0x558085b3d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.359+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36562/0 (socket says 172.21.15.52:36562) 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 -- 172.21.15.52:0/716010526 learned_addr learned my addr 172.21.15.52:0/716010526 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff790af1640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c5ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff791af3640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c5b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 -- 172.21.15.52:0/716010526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 msgr2=0x558085c5ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c5ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 -- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 msgr2=0x558085c5b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c5b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 -- 172.21.15.52:0/716010526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558085b7fc50 con 0x558085c52850 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff7912f2640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c010 tx=0x7ff78401af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b74cd753503dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784015070 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff78400be30 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff784005250 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff784005450 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff79592f740 10 client.20775 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.360+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558085c6c2f0 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff78400be30 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff784004ac0 con 0x558085c52850 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 10 client.20775 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:05.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 10 client.20775 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:05.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 20 client.20775 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:05.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085c6d700 0x558085c6faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 4 client.20775 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:05.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558085bc4890 con 0x558085c6d700 2024-09-19T09:36:05.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.361+0000 7ff790af1640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085c6d700 0x558085c6faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.362+0000 7ff774ff9640 10 client.20775 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:05.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.362+0000 7ff790af1640 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085c6d700 0x558085c6faf0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc2f38a52fd1459 server_cookie=f92709ecff60f736 in_seq=0 out_seq=0 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff774ff9640 1 -- 172.21.15.52:0/716010526 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558085bc4890 con 0x558085c6d700 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff774ff9640 10 client.20775 handle_command_reply: tid=0 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 client.20775 shutdown 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 msgr2=0x558085c5a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff78400c010 tx=0x7ff78401af10 comp rx=0 tx=0).stop 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 shutdown_connections 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085c6d700 0x558085c6faf0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c5b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c5ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff774ff9640 0 client.20775 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 --2- 172.21.15.52:0/716010526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c5a8a0 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 >> 172.21.15.52:0/716010526 conn(0x558085c4ede0 msgr2=0x558085c54b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 shutdown_connections 2024-09-19T09:36:05.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 1 -- 172.21.15.52:0/716010526 wait complete. 2024-09-19T09:36:05.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.363+0000 7ff79592f740 20 client.20775 trim_cache size 0 max 16384 2024-09-19T09:36:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 Processor -- start 2024-09-19T09:36:05.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 -- start start 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c68fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c69500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1b2280 con 0x558085c52850 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1afb50 con 0x558085c5da30 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff79592f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1ad9a0 con 0x558085c53170 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36568/0 (socket says 172.21.15.52:36568) 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff7912f2640 1 -- 172.21.15.52:0/3564035342 learned_addr learned my addr 172.21.15.52:0/3564035342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff791af3640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c69500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.381+0000 7ff790af1640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c68fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 -- 172.21.15.52:0/3564035342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 msgr2=0x558085c68fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c68fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 -- 172.21.15.52:0/3564035342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 msgr2=0x558085c69500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c69500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 -- 172.21.15.52:0/3564035342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558085c70080 con 0x558085c52850 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff790af1640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c68fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7ff78400fc30 tx=0x7ff78400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8814e50c0a9c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff776ffd640 1 -- 172.21.15.52:0/3564035342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784015040 con 0x558085c52850 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff776ffd640 1 -- 172.21.15.52:0/3564035342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff784033020 con 0x558085c52850 2024-09-19T09:36:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.382+0000 7ff776ffd640 1 -- 172.21.15.52:0/3564035342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff784004680 con 0x558085c52850 2024-09-19T09:36:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- 172.21.15.52:0/3564035342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 msgr2=0x558085c552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7ff78400fc30 tx=0x7ff78400bbc0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- 172.21.15.52:0/3564035342 shutdown_connections 2024-09-19T09:36:05.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c5da30 0x558085c69500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c53170 0x558085c68fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 --2- 172.21.15.52:0/3564035342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c552b0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- 172.21.15.52:0/3564035342 >> 172.21.15.52:0/3564035342 conn(0x558085c4ede0 msgr2=0x558085c688b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- 172.21.15.52:0/3564035342 shutdown_connections 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- 172.21.15.52:0/3564035342 wait complete. 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.383+0000 7ff79592f740 1 -- start start 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 Processor -- start 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c62160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1ae010 con 0x558085c52850 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1af480 con 0x558085c53170 2024-09-19T09:36:05.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c1ae6e0 con 0x558085c5da30 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff79592f740 10 client.0 _ll_register_callbacks cb 0x7ff788009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff7912f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c62160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff790af1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff790af1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:54976/0 (socket says 172.21.15.52:54976) 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff790af1640 1 -- 172.21.15.52:0/3997654334 learned_addr learned my addr 172.21.15.52:0/3997654334 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.384+0000 7ff791af3640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 -- 172.21.15.52:0/3997654334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 msgr2=0x558085c657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 -- 172.21.15.52:0/3997654334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 msgr2=0x558085c62160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c62160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 -- 172.21.15.52:0/3997654334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558085c4a3f0 con 0x558085c53170 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c62160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:05.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff790af1640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff77c097f60 tx=0x7ff77c010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=219ae90a7c08624e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c020040 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff784033020 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff77c098170 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff77c009de0 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff79592f740 10 client.29231 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.385+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558085c4ec10 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff784033020 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff77c0a42e0 con 0x558085c53170 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 10 client.29231 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 10 client.29231 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 20 client.29231 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:05.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085cd9160 0x558085cdb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 4 client.29231 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T09:36:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x558085bbebe0 con 0x558085cd9160 2024-09-19T09:36:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.386+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085cd9160 0x558085cdb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.387+0000 7ff7912f2640 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085cd9160 0x558085cdb580 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=529a2db845f7fc29 server_cookie=84176a0f2a0ca85f in_seq=0 out_seq=0 2024-09-19T09:36:05.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.387+0000 7ff774ff9640 10 client.29231 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:05.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.402+0000 7ff774ff9640 1 -- 172.21.15.52:0/3997654334 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558085bbebe0 con 0x558085cd9160 2024-09-19T09:36:05.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.402+0000 7ff774ff9640 10 client.29231 handle_command_reply: tid=0 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.402+0000 7ff79592f740 1 client.29231 shutdown 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 msgr2=0x558085c626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff77c097f60 tx=0x7ff77c010d70 comp rx=0 tx=0).stop 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 shutdown_connections 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x558085cd9160 0x558085cdb580 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff774ff9640 0 client.29231 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558085c5da30 0x558085c657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558085c53170 0x558085c626a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 --2- 172.21.15.52:0/3997654334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558085c52850 0x558085c62160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 >> 172.21.15.52:0/3997654334 conn(0x558085c4ede0 msgr2=0x558085c690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 shutdown_connections 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 1 -- 172.21.15.52:0/3997654334 wait complete. 2024-09-19T09:36:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.403+0000 7ff79592f740 20 client.29231 trim_cache size 0 max 16384 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 50, 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "e6c61f98": { 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 50, 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:36:05.406 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.4, 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:05.407 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:05.408 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:05.408 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:05.408 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 msgr2=0x7ff7780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 0x7ff7780a5780 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff78802f540 tx=0x7ff7880095c0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 msgr2=0x7ff78c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00d950 tx=0x7ff77c00de10 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 shutdown_connections 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff78c106f10 0x7ff78c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff78c102790 0x7ff78c074a30 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff7780a32c0 0x7ff7780a5780 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 --2- 172.21.15.52:0/3238134453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c101de0 0x7ff78c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 >> 172.21.15.52:0/3238134453 conn(0x7ff78c0fd8c0 msgr2=0x7ff78c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 shutdown_connections 2024-09-19T09:36:05.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:05.404+0000 7ff793556640 1 -- 172.21.15.52:0/3238134453 wait complete. 2024-09-19T09:36:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:05.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:05 smithi052 ceph-mon[30947]: pgmap v777: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:36:05.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:05 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:36:05.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:05 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:05.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:05 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:36:05.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:05 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:05 smithi169 ceph-mon[35454]: pgmap v777: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:36:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:05 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:36:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:05 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:05 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:36:05.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:05 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:05 smithi086 ceph-mon[34813]: pgmap v777: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:36:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:05 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:36:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:05 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:05 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:36:05.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:05 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:06.199 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e6c61f98', quiesce took 4.2 seconds. Will release after: 25.25 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 -- 172.21.15.52:0/3312129283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570101de0 msgr2=0x7fc5701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 --2- 172.21.15.52:0/3312129283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570101de0 0x7fc5701021c0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7fc560009900 tx=0x7fc56002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 -- 172.21.15.52:0/3312129283 shutdown_connections 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 --2- 172.21.15.52:0/3312129283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570106f10 0x7fc57010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 --2- 172.21.15.52:0/3312129283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 0x7fc5701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 --2- 172.21.15.52:0/3312129283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570101de0 0x7fc5701021c0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 -- 172.21.15.52:0/3312129283 >> 172.21.15.52:0/3312129283 conn(0x7fc5700fd8c0 msgr2=0x7fc5700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 -- 172.21.15.52:0/3312129283 shutdown_connections 2024-09-19T09:36:06.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 -- 172.21.15.52:0/3312129283 wait complete. 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.636+0000 7fc575a17640 1 Processor -- start 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 -- start start 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 0x7fc5701984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 0x7fc570198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc570111f90 con 0x7fc570106f10 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc570111e10 con 0x7fc570101de0 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc575a17640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc570112110 con 0x7fc570102790 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36604/0 (socket says 172.21.15.52:36604) 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 -- 172.21.15.52:0/982596412 learned_addr learned my addr 172.21.15.52:0/982596412 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56effd640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 0x7fc5701984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 0x7fc570198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 -- 172.21.15.52:0/982596412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 msgr2=0x7fc570198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 0x7fc570198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 -- 172.21.15.52:0/982596412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 msgr2=0x7fc5701984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 0x7fc5701984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56f7fe640 1 -- 172.21.15.52:0/982596412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57019d480 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.637+0000 7fc56effd640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 0x7fc5701984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc568009fd0 tx=0x7fc56800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc574a15640 1 -- 172.21.15.52:0/982596412 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc568017070 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57019d770 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc574a15640 1 -- 172.21.15.52:0/982596412 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc568003e50 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc574a15640 1 -- 172.21.15.52:0/982596412 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5680106c0 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.638+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5701a5050 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.640+0000 7fc574a15640 1 -- 172.21.15.52:0/982596412 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc568003970 con 0x7fc570106f10 2024-09-19T09:36:06.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.640+0000 7fc577df0740 1 Processor -- start 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.640+0000 7fc577df0740 1 -- start start 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea1b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea1de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5624ae9722e0 con 0x5624aea0c3a0 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5624ae919ce0 con 0x5624aea0ccc0 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc577df0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5624ae96e2a0 con 0x5624aea1ba90 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36606/0 (socket says 172.21.15.52:36606) 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 -- 172.21.15.52:0/3795373556 learned_addr learned my addr 172.21.15.52:0/3795373556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56effd640 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea1b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 -- 172.21.15.52:0/3795373556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 msgr2=0x5624aea1de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea1de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 -- 172.21.15.52:0/3795373556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 msgr2=0x5624aea1b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea1b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 -- 172.21.15.52:0/3795373556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ae8fe440 con 0x5624aea0c3a0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56effd640 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea1b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc574a15640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 0x7fc5580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56effd640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 0x7fc5580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fc564009a10 tx=0x7fc564009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affdfb3556f9bfae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.641+0000 7fc574a15640 1 -- 172.21.15.52:0/982596412 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc5680cf800 con 0x7fc570106f10 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc555ffb640 1 -- 172.21.15.52:0/3795373556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56400fc90 con 0x5624aea0c3a0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc555ffb640 1 -- 172.21.15.52:0/3795373556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564010040 con 0x5624aea0c3a0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc555ffb640 1 -- 172.21.15.52:0/3795373556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564013700 con 0x5624aea0c3a0 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 -- 172.21.15.52:0/3795373556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 msgr2=0x5624aea0c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc56effd640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 0x7fc5580a5700 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x5624aea0f090 tx=0x7fc560005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fc564009a10 tx=0x7fc564009ed0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 -- 172.21.15.52:0/3795373556 shutdown_connections 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea1de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea1b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 --2- 172.21.15.52:0/3795373556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea0c780 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 -- 172.21.15.52:0/3795373556 >> 172.21.15.52:0/3795373556 conn(0x5624aea08a30 msgr2=0x5624aea08e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 -- 172.21.15.52:0/3795373556 shutdown_connections 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.642+0000 7fc577df0740 1 -- 172.21.15.52:0/3795373556 wait complete. 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 -- start start 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 Processor -- start 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea18c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5624aea1e6c0 con 0x5624aea0c3a0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5624ae92d050 con 0x5624aea0ccc0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5624aea1e840 con 0x5624aea1ba90 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc577df0740 10 client.0 _ll_register_callbacks cb 0x5624ae96d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36612/0 (socket says 172.21.15.52:36612) 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc56effd640 1 -- 172.21.15.52:0/783988351 learned_addr learned my addr 172.21.15.52:0/783988351 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.643+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea18c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 -- 172.21.15.52:0/783988351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 msgr2=0x5624aea18c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea18c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 -- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 msgr2=0x5624aea186c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea186c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 -- 172.21.15.52:0/783988351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ae6e33c0 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc56effd640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc560009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5125b92ec2abee6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc54effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56004b030 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc560003d00 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc564010040 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc560055030 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc577df0740 10 client.20793 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624aea2a140 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.644+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564010040 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc56005a430 con 0x5624aea0c3a0 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 10 client.20793 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:06.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 10 client.20793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 20 client.20793 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea2b600 0x5624aea2da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 4 client.20793 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624ae97f850 con 0x5624aea2b600 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea2b600 0x5624aea2da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea2b600 0x5624aea2da50 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da3d37916924f4e8 server_cookie=5a25f3137a5ca134 in_seq=0 out_seq=0 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.645+0000 7fc54effd640 10 client.20793 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.646+0000 7fc54effd640 1 -- 172.21.15.52:0/783988351 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624ae97f850 con 0x5624aea2b600 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.646+0000 7fc54effd640 10 client.20793 handle_command_reply: tid=0 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.646+0000 7fc577df0740 1 client.20793 shutdown 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 msgr2=0x5624aea1b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fc560033000 tx=0x7fc560009260 comp rx=0 tx=0).stop 2024-09-19T09:36:06.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 shutdown_connections 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea2b600 0x5624aea2da50 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea18c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea186c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 --2- 172.21.15.52:0/783988351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1b410 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc54effd640 0 client.20793 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 >> 172.21.15.52:0/783988351 conn(0x5624aea08a30 msgr2=0x5624aea0e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 shutdown_connections 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 1 -- 172.21.15.52:0/783988351 wait complete. 2024-09-19T09:36:06.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.647+0000 7fc577df0740 20 client.20793 trim_cache size 0 max 16384 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.664+0000 7fc577df0740 1 Processor -- start 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.664+0000 7fc577df0740 1 -- start start 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea0e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea33370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701add40 con 0x5624aea0c3a0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701ab610 con 0x5624aea0ccc0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc577df0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701a9460 con 0x5624aea1ba90 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36620/0 (socket says 172.21.15.52:36620) 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 -- 172.21.15.52:0/2096015542 learned_addr learned my addr 172.21.15.52:0/2096015542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea0e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea33370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 -- 172.21.15.52:0/2096015542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 msgr2=0x5624aea33370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea33370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 -- 172.21.15.52:0/2096015542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 msgr2=0x5624aea0e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea0e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 -- 172.21.15.52:0/2096015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624aea18fb0 con 0x5624aea0c3a0 2024-09-19T09:36:06.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea33370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea0e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.665+0000 7fc56effd640 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fc560005ab0 tx=0x7fc5600314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a170140304b6f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc5557fa640 1 -- 172.21.15.52:0/2096015542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56004b040 con 0x5624aea0c3a0 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc5557fa640 1 -- 172.21.15.52:0/2096015542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56005e070 con 0x5624aea0c3a0 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc5557fa640 1 -- 172.21.15.52:0/2096015542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560035050 con 0x5624aea0c3a0 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 -- 172.21.15.52:0/2096015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 msgr2=0x5624aea27960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fc560005ab0 tx=0x7fc5600314a0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 -- 172.21.15.52:0/2096015542 shutdown_connections 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea33370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea0e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 --2- 172.21.15.52:0/2096015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea27960 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 -- 172.21.15.52:0/2096015542 >> 172.21.15.52:0/2096015542 conn(0x5624aea08a30 msgr2=0x5624aea0ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 -- 172.21.15.52:0/2096015542 shutdown_connections 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.666+0000 7fc577df0740 1 -- 172.21.15.52:0/2096015542 wait complete. 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 -- start start 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 Processor -- start 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea95340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701a9ad0 con 0x5624aea0c3a0 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701aaf40 con 0x5624aea0ccc0 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5701aa1a0 con 0x5624aea1ba90 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc577df0740 10 client.0 _ll_register_callbacks cb 0x7fc560009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc56effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36636/0 (socket says 172.21.15.52:36636) 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc56effd640 1 -- 172.21.15.52:0/773593823 learned_addr learned my addr 172.21.15.52:0/773593823 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.667+0000 7fc56f7fe640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea95340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 -- 172.21.15.52:0/773593823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 msgr2=0x5624aea95340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea95340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 -- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 msgr2=0x5624aea200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 -- 172.21.15.52:0/773593823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624aea0caf0 con 0x5624aea0c3a0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc56effd640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fc560006010 tx=0x7fc560005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9034994119a2ef40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc54effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560067020 con 0x5624aea0c3a0 2024-09-19T09:36:06.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc56005a430 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56005e070 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc560072050 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc577df0740 10 client.20799 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5624aea96700 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.668+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56005e070 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc5600047c0 con 0x5624aea0c3a0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 10 client.20799 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 10 client.20799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 20 client.20799 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea96d60 0x5624aea99180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 4 client.20799 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624ae979d60 con 0x5624aea96d60 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.669+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea96d60 0x5624aea99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:06.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc56e7fc640 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea96d60 0x5624aea99180 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d479aa9aad7bca98 server_cookie=41f9d185686ee9b7 in_seq=0 out_seq=0 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc54effd640 10 client.20799 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc54effd640 1 -- 172.21.15.52:0/773593823 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5624ae979d60 con 0x5624aea96d60 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc54effd640 10 client.20799 handle_command_reply: tid=0 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 client.20799 shutdown 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 msgr2=0x5624aea1fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fc560006010 tx=0x7fc560005c90 comp rx=0 tx=0).stop 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 shutdown_connections 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5624aea96d60 0x5624aea99180 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc54effd640 0 client.20799 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:06.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5624aea1ba90 0x5624aea95340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5624aea0ccc0 0x5624aea200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 --2- 172.21.15.52:0/773593823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5624aea0c3a0 0x5624aea1fb70 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 >> 172.21.15.52:0/773593823 conn(0x5624aea08a30 msgr2=0x5624aea0e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 shutdown_connections 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 1 -- 172.21.15.52:0/773593823 wait complete. 2024-09-19T09:36:06.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.670+0000 7fc577df0740 20 client.20799 trim_cache size 0 max 16384 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "09ee5ed2-dff3-4ba8-992c-13866d03ba27": { 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "09ee5ed2-dff3-4ba8-992c-13866d03ba27", 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:06.682 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 msgr2=0x7fc5580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 0x7fc5580a5700 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x5624aea0f090 tx=0x7fc560005a20 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 msgr2=0x7fc57019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc568009fd0 tx=0x7fc56800b260 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 shutdown_connections 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc570106f10 0x7fc57019cda0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5580a3240 0x7fc5580a5700 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc570102790 0x7fc570198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 --2- 172.21.15.52:0/982596412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc570101de0 0x7fc5701984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:06.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 >> 172.21.15.52:0/982596412 conn(0x7fc5700fd8c0 msgr2=0x7fc5700fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:06.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 shutdown_connections 2024-09-19T09:36:06.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:06.671+0000 7fc575a17640 1 -- 172.21.15.52:0/982596412 wait complete. 2024-09-19T09:36:07.434 INFO:tasks.cephfs.filesystem:scrub status for tag:09ee5ed2-dff3-4ba8-992c-13866d03ba27 - {'path': '/', 'tag': '09ee5ed2-dff3-4ba8-992c-13866d03ba27', 'options': 'recursive,force'} 2024-09-19T09:36:07.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:07 smithi052 ceph-mon[30947]: pgmap v778: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:36:07.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:07 smithi169 ceph-mon[35454]: pgmap v778: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:36:07.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:07 smithi086 ceph-mon[34813]: pgmap v778: 97 pgs: 97 active+clean; 3.5 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:36:09.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:09 smithi052 ceph-mon[30947]: pgmap v779: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:36:09.681 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:09 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:36:09.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:09 smithi169 ceph-mon[35454]: pgmap v779: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:36:09.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:09 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:36:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:09 smithi086 ceph-mon[34813]: pgmap v779: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-19T09:36:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:09 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:36:11.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:11 smithi052 ceph-mon[30947]: pgmap v780: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:36:11.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:11 smithi169 ceph-mon[35454]: pgmap v780: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:36:11.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:11 smithi086 ceph-mon[34813]: pgmap v780: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-19T09:36:13.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:13 smithi052 ceph-mon[30947]: pgmap v781: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:13.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:13 smithi169 ceph-mon[35454]: pgmap v781: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:13.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:13 smithi086 ceph-mon[34813]: pgmap v781: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/1920375515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 msgr2=0x7fc6c8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/1920375515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c8100e40 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009ca0 tx=0x7fc6b802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/1920375515 shutdown_connections 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/1920375515 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c81025f0 0x7fc6c8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/1920375515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8101c30 0x7fc6c81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/1920375515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c8100e40 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.389 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/1920375515 >> 172.21.15.52:0/1920375515 conn(0x7fc6c80fc1e0 msgr2=0x7fc6c80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/1920375515 shutdown_connections 2024-09-19T09:36:14.390 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.387+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/1920375515 wait complete. 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 Processor -- start 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 -- start start 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c8101c30 0x7fc6c819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 0x7fc6c819f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810c6f0 con 0x7fc6c8100a40 2024-09-19T09:36:14.392 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810c570 con 0x7fc6c81025f0 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6ccbfd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c810c870 con 0x7fc6c8101c30 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.388+0000 7fc6c659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53506/0 (socket says 172.21.15.52:53506) 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 -- 172.21.15.52:0/2509449224 learned_addr learned my addr 172.21.15.52:0/2509449224 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c8101c30 0x7fc6c819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 0x7fc6c819f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 -- 172.21.15.52:0/2509449224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c8101c30 msgr2=0x7fc6c819cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c8101c30 0x7fc6c819cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 -- 172.21.15.52:0/2509449224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 msgr2=0x7fc6c819f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 0x7fc6c819f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 -- 172.21.15.52:0/2509449224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c819fa40 con 0x7fc6c8100a40 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 0x7fc6c819f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:14.393 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6c659c640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8000f80 tx=0x7fc6b80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6b77fe640 1 -- 172.21.15.52:0/2509449224 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8003c70 con 0x7fc6c8100a40 2024-09-19T09:36:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6b77fe640 1 -- 172.21.15.52:0/2509449224 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b8003e10 con 0x7fc6c8100a40 2024-09-19T09:36:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c819fc70 con 0x7fc6c8100a40 2024-09-19T09:36:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6b77fe640 1 -- 172.21.15.52:0/2509449224 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802fda0 con 0x7fc6c8100a40 2024-09-19T09:36:14.394 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.389+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c81a01c0 con 0x7fc6c8100a40 2024-09-19T09:36:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.392+0000 7fc6b77fe640 1 -- 172.21.15.52:0/2509449224 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc6b8004040 con 0x7fc6c8100a40 2024-09-19T09:36:14.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 Processor -- start 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 -- start start 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e93dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e942da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56077e8a12f0 con 0x56077e943370 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56077e849270 con 0x56077e93d9a0 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56077e89d2b0 con 0x56077e93e2e0 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53518/0 (socket says 172.21.15.52:53518) 2024-09-19T09:36:14.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/1964487175 learned_addr learned my addr 172.21.15.52:0/1964487175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.393+0000 7fc6c659c640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e942da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e93dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6b77fe640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 0x7fc6b00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/1964487175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 msgr2=0x56077e942da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e942da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/1964487175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 msgr2=0x56077e93dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e93dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/1964487175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56077e848340 con 0x56077e943370 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e93dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 0x7fc6b00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6b77fe640 1 -- 172.21.15.52:0/2509449224 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc6b80f0f60 con 0x7fc6c8100a40 2024-09-19T09:36:14.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00bcb0 tx=0x7fc6bc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75387319c57283a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6b4ff9640 1 -- 172.21.15.52:0/1964487175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc004030 con 0x56077e943370 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6b4ff9640 1 -- 172.21.15.52:0/1964487175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc0041d0 con 0x56077e943370 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.394+0000 7fc6b4ff9640 1 -- 172.21.15.52:0/1964487175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0116e0 con 0x56077e943370 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 0x7fc6b00a57b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000cbe0 tx=0x7fc6c00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1964487175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 msgr2=0x56077e945830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00bcb0 tx=0x7fc6bc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1964487175 shutdown_connections 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e945830 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e942da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1964487175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e93dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1964487175 >> 172.21.15.52:0/1964487175 conn(0x56077e939010 msgr2=0x56077e939410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1964487175 shutdown_connections 2024-09-19T09:36:14.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1964487175 wait complete. 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.395+0000 7fc6cfa7e740 1 -- start start 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 Processor -- start 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e947bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 0x56077e94f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56077e946340 con 0x56077e93e2e0 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56077e82a290 con 0x56077e93d9a0 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56077e9464c0 con 0x56077e943370 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6cfa7e740 10 client.0 _ll_register_callbacks cb 0x56077e85b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53520/0 (socket says 172.21.15.52:53520) 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/649989573 learned_addr learned my addr 172.21.15.52:0/649989573 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:14.403 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 0x56077e94f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c659c640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e947bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/649989573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 msgr2=0x56077e94f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 0x56077e94f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 msgr2=0x56077e947bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e947bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/649989573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56077e5b4210 con 0x56077e93e2e0 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 0x56077e94f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c659c640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e947bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc011010 tx=0x7fc6bc00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5721d3078294f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.396+0000 7fc6adffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:14.404 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02a060 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc6bc003800 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc0041d0 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc6bc003a00 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 10 client.20811 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56077e680620 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc0041d0 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc6bc004a70 con 0x56077e93e2e0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 10 client.20811 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 10 client.20811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 20 client.20811 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9534c0 0x56077e9558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 4 client.20811 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.397+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56077e8aea20 con 0x56077e9534c0 2024-09-19T09:36:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.398+0000 7fc6c659c640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9534c0 0x56077e9558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.398+0000 7fc6c659c640 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9534c0 0x56077e9558b0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a016a4bfdf61c5 server_cookie=5ee458d2c7770ded in_seq=0 out_seq=0 2024-09-19T09:36:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.398+0000 7fc6adffb640 10 client.20811 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6adffb640 1 -- 172.21.15.52:0/649989573 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56077e8aea20 con 0x56077e9534c0 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6adffb640 10 client.20811 handle_command_reply: tid=0 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 client.20811 shutdown 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 msgr2=0x56077e948100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc011010 tx=0x7fc6bc00bfd0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 shutdown_connections 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9534c0 0x56077e9558b0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e943370 0x56077e94f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e948100 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6adffb640 0 client.20811 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/649989573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e947bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 >> 172.21.15.52:0/649989573 conn(0x56077e939010 msgr2=0x56077e93a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 shutdown_connections 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/649989573 wait complete. 2024-09-19T09:36:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.399+0000 7fc6cfa7e740 20 client.20811 trim_cache size 0 max 16384 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 Processor -- start 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 -- start start 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93d9a0 0x56077e9380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e943370 0x56077e93a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81aba90 con 0x56077e93e2e0 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81a9360 con 0x56077e943370 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81a71b0 con 0x56077e93d9a0 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6c5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53530/0 (socket says 172.21.15.52:53530) 2024-09-19T09:36:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/4191996454 learned_addr learned my addr 172.21.15.52:0/4191996454 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6c659c640 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93d9a0 0x56077e9380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.414+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e943370 0x56077e93a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/4191996454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93d9a0 msgr2=0x56077e9380b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93d9a0 0x56077e9380b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/4191996454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e943370 msgr2=0x56077e93a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e943370 0x56077e93a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 -- 172.21.15.52:0/4191996454 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56077e938e30 con 0x56077e93e2e0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b620 tx=0x7fc6bc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9cc3a2336d1273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6affff640 1 -- 172.21.15.52:0/4191996454 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc01f070 con 0x56077e93e2e0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6affff640 1 -- 172.21.15.52:0/4191996454 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc003800 con 0x56077e93e2e0 2024-09-19T09:36:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.415+0000 7fc6affff640 1 -- 172.21.15.52:0/4191996454 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc02a050 con 0x56077e93e2e0 2024-09-19T09:36:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/4191996454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 msgr2=0x56077e94f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b620 tx=0x7fc6bc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/4191996454 shutdown_connections 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e943370 0x56077e93a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e93e2e0 0x56077e94f100 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/4191996454 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93d9a0 0x56077e9380b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/4191996454 >> 172.21.15.52:0/4191996454 conn(0x56077e939010 msgr2=0x56077e9379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/4191996454 shutdown_connections 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/4191996454 wait complete. 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 -- start start 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.416+0000 7fc6cfa7e740 1 Processor -- start 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e94ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.422 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81a7820 con 0x56077e943370 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81a8c90 con 0x56077e93d9a0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c81a7ef0 con 0x56077e93e2e0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6cfa7e740 10 client.0 _ll_register_callbacks cb 0x7fc6b80f4870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:51914/0 (socket says 172.21.15.52:51914) 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 -- 172.21.15.52:0/1999365169 learned_addr learned my addr 172.21.15.52:0/1999365169 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53544/0 (socket says 172.21.15.52:53544) 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e94ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 -- 172.21.15.52:0/1999365169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 msgr2=0x56077e94ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e94ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.423 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 -- 172.21.15.52:0/1999365169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 msgr2=0x56077e94da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 -- 172.21.15.52:0/1999365169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56077e94e030 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e94ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c6d9d640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6c659c640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80b9990 tx=0x7fc6b802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56fffeb7a5592907 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.417+0000 7fc6adffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80bd070 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6bc003800 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc6b80eea90 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc6b80bce90 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 10 client.29261 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56077e94f410 con 0x56077e93d9a0 2024-09-19T09:36:14.424 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6bc003800 con 0x56077e93d9a0 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc6b80b9ba0 con 0x56077e93d9a0 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 10 client.29261 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 10 client.29261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 20 client.29261 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9be730 0x56077e9c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 4 client.29261 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56077e8a8d70 con 0x56077e9be730 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.418+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9be730 0x56077e9c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.419+0000 7fc6adffb640 10 client.29261 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:14.425 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.419+0000 7fc6c5d9b640 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9be730 0x56077e9c0b50 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b58b4e34c37a28 server_cookie=c334d5c176ab2728 in_seq=0 out_seq=0 2024-09-19T09:36:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6adffb640 1 -- 172.21.15.52:0/1999365169 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56077e8a8d70 con 0x56077e9be730 2024-09-19T09:36:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6adffb640 10 client.29261 handle_command_reply: tid=0 2024-09-19T09:36:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 client.29261 shutdown 2024-09-19T09:36:14.433 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 msgr2=0x56077e94c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc6b80b9990 tx=0x7fc6b802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 shutdown_connections 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56077e9be730 0x56077e9c0b50 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56077e943370 0x56077e94da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6adffb640 0 client.29261 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56077e93e2e0 0x56077e94ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 --2- 172.21.15.52:0/1999365169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56077e93d9a0 0x56077e94c4d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 >> 172.21.15.52:0/1999365169 conn(0x56077e939010 msgr2=0x56077e9381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.431+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 shutdown_connections 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6cfa7e740 1 -- 172.21.15.52:0/1999365169 wait complete. 2024-09-19T09:36:14.434 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6cfa7e740 20 client.29261 trim_cache size 0 max 16384 2024-09-19T09:36:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:36:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:36:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:36:14.435 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 msgr2=0x7fc6b00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 0x7fc6b00a57b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000cbe0 tx=0x7fc6c00046c0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 msgr2=0x7fc6c806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8000f80 tx=0x7fc6b80319f0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 shutdown_connections 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c81025f0 0x7fc6c819f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc6b00a32f0 0x7fc6b00a57b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6c8101c30 0x7fc6c819cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 --2- 172.21.15.52:0/2509449224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6c8100a40 0x7fc6c806a410 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:14.436 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 >> 172.21.15.52:0/2509449224 conn(0x7fc6c80fc1e0 msgr2=0x7fc6c8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 shutdown_connections 2024-09-19T09:36:14.437 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:14.432+0000 7fc6ccbfd640 1 -- 172.21.15.52:0/2509449224 wait complete. 2024-09-19T09:36:15.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:15 smithi052 ceph-mon[30947]: pgmap v782: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2024-09-19T09:36:15.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:15 smithi169 ceph-mon[35454]: pgmap v782: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2024-09-19T09:36:15.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:15 smithi086 ceph-mon[34813]: pgmap v782: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 12 op/s 2024-09-19T09:36:17.684 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:17 smithi052 ceph-mon[30947]: pgmap v783: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-19T09:36:17.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:17 smithi169 ceph-mon[35454]: pgmap v783: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-19T09:36:17.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:17 smithi086 ceph-mon[34813]: pgmap v783: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-19T09:36:18.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:18 smithi086 ceph-mon[34813]: pgmap v784: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:36:18.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:18 smithi052 ceph-mon[30947]: pgmap v784: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:36:18.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:18 smithi169 ceph-mon[35454]: pgmap v784: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 12 op/s 2024-09-19T09:36:20.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:20 smithi052 ceph-mon[30947]: pgmap v785: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:20.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:20 smithi169 ceph-mon[35454]: pgmap v785: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:21.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:20 smithi086 ceph-mon[34813]: pgmap v785: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:22.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:22 smithi052 ceph-mon[30947]: pgmap v786: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:22.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:22 smithi169 ceph-mon[35454]: pgmap v786: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:23.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:22 smithi086 ceph-mon[34813]: pgmap v786: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-19T09:36:24.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:24 smithi052 ceph-mon[30947]: pgmap v787: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:24.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:24 smithi169 ceph-mon[35454]: pgmap v787: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:25.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:24 smithi086 ceph-mon[34813]: pgmap v787: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:26.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:26 smithi052 ceph-mon[30947]: pgmap v788: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-19T09:36:26.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:26 smithi169 ceph-mon[35454]: pgmap v788: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-19T09:36:27.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:26 smithi086 ceph-mon[34813]: pgmap v788: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-09-19T09:36:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- 172.21.15.52:0/4227659775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c102610 msgr2=0x7f895c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 --2- 172.21.15.52:0/4227659775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c102610 0x7f895c108ea0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f8954009900 tx=0x7f895402a410 comp rx=0 tx=0).stop 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- 172.21.15.52:0/4227659775 shutdown_connections 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 --2- 172.21.15.52:0/4227659775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c102610 0x7f895c108ea0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 --2- 172.21.15.52:0/4227659775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c101c50 0x7f895c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 --2- 172.21.15.52:0/4227659775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c100a60 0x7f895c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- 172.21.15.52:0/4227659775 >> 172.21.15.52:0/4227659775 conn(0x7f895c0fc1e0 msgr2=0x7f895c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- 172.21.15.52:0/4227659775 shutdown_connections 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- 172.21.15.52:0/4227659775 wait complete. 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 Processor -- start 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.535+0000 7f8962cd0640 1 -- start start 2024-09-19T09:36:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c100a60 0x7f895c06ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 0x7f895c1a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f895c10c6c0 con 0x7f895c101c50 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f895c10c540 con 0x7f895c102610 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8962cd0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f895c10c840 con 0x7f895c100a60 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40754/0 (socket says 172.21.15.52:40754) 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 -- 172.21.15.52:0/2476136081 learned_addr learned my addr 172.21.15.52:0/2476136081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f896126d640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 0x7f895c1a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f8960a6c640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c100a60 0x7f895c06ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 -- 172.21.15.52:0/2476136081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c100a60 msgr2=0x7f895c06ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c100a60 0x7f895c06ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 -- 172.21.15.52:0/2476136081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 msgr2=0x7f895c1a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 0x7f895c1a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 -- 172.21.15.52:0/2476136081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c1a1c10 con 0x7f895c101c50 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f896126d640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 0x7f895c1a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.536+0000 7f895bfff640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f894c00db80 tx=0x7f894c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.537+0000 7f8959ffb640 1 -- 172.21.15.52:0/2476136081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c017070 con 0x7f895c101c50 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.537+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c1a1ea0 con 0x7f895c101c50 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.537+0000 7f8959ffb640 1 -- 172.21.15.52:0/2476136081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894c003b70 con 0x7f895c101c50 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.537+0000 7f8959ffb640 1 -- 172.21.15.52:0/2476136081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c0106c0 con 0x7f895c101c50 2024-09-19T09:36:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.537+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c1a2360 con 0x7f895c101c50 2024-09-19T09:36:27.546 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.539+0000 7f8959ffb640 1 -- 172.21.15.52:0/2476136081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f894c004020 con 0x7f895c101c50 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 Processor -- start 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 -- start start 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 0x55e77dfb9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfc1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e77df1d2f0 con 0x55e77dfba2e0 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e77dec5270 con 0x55e77dfbf370 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8965a6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e77df192b0 con 0x55e77dfb99a0 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8960a6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8960a6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40762/0 (socket says 172.21.15.52:40762) 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8960a6c640 1 -- 172.21.15.52:0/3523844998 learned_addr learned my addr 172.21.15.52:0/3523844998 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:27.547 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f8959ffb640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 0x7f89480a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f895bfff640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfc1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f896126d640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 0x55e77dfb9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.540+0000 7f896126d640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 0x7f89480a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 -- 172.21.15.52:0/3523844998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 msgr2=0x55e77dfb9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 0x55e77dfb9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 -- 172.21.15.52:0/3523844998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 msgr2=0x55e77dfc1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfc1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8959ffb640 1 -- 172.21.15.52:0/2476136081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f894c0cf780 con 0x7f895c101c50 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 -- 172.21.15.52:0/3523844998 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e77dec4340 con 0x55e77dfba2e0 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f896126d640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 0x55e77dfb9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f894400bd10 tx=0x7f894400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f047251fdcacc3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.548 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8952ffd640 1 -- 172.21.15.52:0/3523844998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944015070 con 0x55e77dfba2e0 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f896126d640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 0x7f89480a57e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8954031440 tx=0x7f8954009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8952ffd640 1 -- 172.21.15.52:0/3523844998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894401a940 con 0x55e77dfba2e0 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.541+0000 7f8952ffd640 1 -- 172.21.15.52:0/3523844998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944011980 con 0x55e77dfba2e0 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- 172.21.15.52:0/3523844998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 msgr2=0x55e77dfbeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f894400bd10 tx=0x7f894400f730 comp rx=0 tx=0).stop 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- 172.21.15.52:0/3523844998 shutdown_connections 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfc1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfbeda0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3523844998 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfb99a0 0x55e77dfb9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- 172.21.15.52:0/3523844998 >> 172.21.15.52:0/3523844998 conn(0x55e77dfb5010 msgr2=0x55e77dfb5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- 172.21.15.52:0/3523844998 shutdown_connections 2024-09-19T09:36:27.549 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- 172.21.15.52:0/3523844998 wait complete. 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 -- start start 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.542+0000 7f8965a6d740 1 Processor -- start 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfc4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55e77dfc2340 con 0x55e77dfbf370 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55e77dea6290 con 0x55e77dfb99a0 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55e77dfc24c0 con 0x55e77dfba2e0 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8965a6d740 10 client.0 _ll_register_callbacks cb 0x55e77ded7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8960a6c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.550 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40766/0 (socket says 172.21.15.52:40766) 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 -- 172.21.15.52:0/3367116018 learned_addr learned my addr 172.21.15.52:0/3367116018 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f895bfff640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfc4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 -- 172.21.15.52:0/3367116018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 msgr2=0x55e77dfc4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfc4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 -- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 msgr2=0x55e77dfc3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 -- 172.21.15.52:0/3367116018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e77dc30210 con 0x55e77dfbf370 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f895bfff640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfc4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f896126d640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f8954033000 tx=0x7f895402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b84f5765e271a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.543+0000 7f893bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954041070 con 0x55e77dfbf370 2024-09-19T09:36:27.551 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8954005220 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f894401a940 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8954055030 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 10 client.20829 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e77dcfc620 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894401a940 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8954004ac0 con 0x55e77dfbf370 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 10 client.20829 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 10 client.20829 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 20 client.20829 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77dfcf890 0x55e77dfd1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 4 client.20829 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.544+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e77df2aa20 con 0x55e77dfcf890 2024-09-19T09:36:27.552 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.545+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77dfcf890 0x55e77dfd1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.545+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77dfcf890 0x55e77dfd1c80 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca00d558d16e9d1 server_cookie=cbcfd0b5c1e29683 in_seq=0 out_seq=0 2024-09-19T09:36:27.553 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.545+0000 7f893bfff640 10 client.20829 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f893bfff640 1 -- 172.21.15.52:0/3367116018 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e77df2aa20 con 0x55e77dfcf890 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f893bfff640 10 client.20829 handle_command_reply: tid=0 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 client.20829 shutdown 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 msgr2=0x55e77dfcb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f8954033000 tx=0x7f895402a410 comp rx=0 tx=0).stop 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 shutdown_connections 2024-09-19T09:36:27.554 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77dfcf890 0x55e77dfd1c80 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfbf370 0x55e77dfcb170 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfc4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3367116018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f893bfff640 0 client.20829 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 >> 172.21.15.52:0/3367116018 conn(0x55e77dfb5010 msgr2=0x55e77dfb6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 shutdown_connections 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 1 -- 172.21.15.52:0/3367116018 wait complete. 2024-09-19T09:36:27.555 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.546+0000 7f8965a6d740 20 client.20829 trim_cache size 0 max 16384 2024-09-19T09:36:27.563 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 Processor -- start 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 -- start start 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfcb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfb5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1adc70 con 0x55e77dfb99a0 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1ab540 con 0x55e77dfbf370 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8965a6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1a9390 con 0x55e77dfba2e0 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8960a6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8960a6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40782/0 (socket says 172.21.15.52:40782) 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f8960a6c640 1 -- 172.21.15.52:0/151339175 learned_addr learned my addr 172.21.15.52:0/151339175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.561+0000 7f895bfff640 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfcb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.564 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f896126d640 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfb5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 -- 172.21.15.52:0/151339175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 msgr2=0x55e77dfcb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfcb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 -- 172.21.15.52:0/151339175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 msgr2=0x55e77dfb5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfb5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 -- 172.21.15.52:0/151339175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e77dfbaf70 con 0x55e77dfb99a0 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f8960a6c640 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f894400bce0 tx=0x7f894400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3e54c0d963a270 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f89527fc640 1 -- 172.21.15.52:0/151339175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944015050 con 0x55e77dfb99a0 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f89527fc640 1 -- 172.21.15.52:0/151339175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894401a940 con 0x55e77dfb99a0 2024-09-19T09:36:27.565 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.562+0000 7f89527fc640 1 -- 172.21.15.52:0/151339175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8944005650 con 0x55e77dfb99a0 2024-09-19T09:36:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- 172.21.15.52:0/151339175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 msgr2=0x55e77dfc2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f894400bce0 tx=0x7f894400b600 comp rx=0 tx=0).stop 2024-09-19T09:36:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- 172.21.15.52:0/151339175 shutdown_connections 2024-09-19T09:36:27.568 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfbf370 0x55e77dfb5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfba2e0 0x55e77dfcb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 --2- 172.21.15.52:0/151339175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfb99a0 0x55e77dfc2fd0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- 172.21.15.52:0/151339175 >> 172.21.15.52:0/151339175 conn(0x55e77dfb5010 msgr2=0x55e77dfc28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- 172.21.15.52:0/151339175 shutdown_connections 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- 172.21.15.52:0/151339175 wait complete. 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 -- start start 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.563+0000 7f8965a6d740 1 Processor -- start 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfbf370 0x55e77dfc9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1a9a00 con 0x55e77dfba2e0 2024-09-19T09:36:27.569 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1aae70 con 0x55e77dfb99a0 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f895c1aa0d0 con 0x55e77dfbf370 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8965a6d740 10 client.0 _ll_register_callbacks cb 0x7f8954009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40786/0 (socket says 172.21.15.52:40786) 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 -- 172.21.15.52:0/3238686681 learned_addr learned my addr 172.21.15.52:0/3238686681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 -- 172.21.15.52:0/3238686681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfbf370 msgr2=0x55e77dfc9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f896126d640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfbf370 0x55e77dfc9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfbf370 0x55e77dfc9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 -- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 msgr2=0x55e77dfc84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.570 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 -- 172.21.15.52:0/3238686681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e77dfca010 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f895bfff640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f894c0cd1a0 tx=0x7f894c06b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f4f2d3a511bc0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.564+0000 7f893bfff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c066b60 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f894c003d20 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f894401a940 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f894c09c3c0 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 10 client.20835 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e77dfcb3e0 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f894401a940 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f894c0a44a0 con 0x55e77dfba2e0 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 10 client.20835 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 10 client.20835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:27.571 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 20 client.20835 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77e03ab90 0x55e77e03cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 4 client.20835 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e77df24d70 con 0x55e77e03ab90 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.565+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77e03ab90 0x55e77e03cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.566+0000 7f8960a6c640 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77e03ab90 0x55e77e03cfb0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59cf319b7c484c2b server_cookie=e2b70ef1b593a0ff in_seq=0 out_seq=0 2024-09-19T09:36:27.572 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.566+0000 7f893bfff640 10 client.20835 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:27.577 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.575+0000 7f893bfff640 1 -- 172.21.15.52:0/3238686681 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e77df24d70 con 0x55e77e03ab90 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f893bfff640 10 client.20835 handle_command_reply: tid=0 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 client.20835 shutdown 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 msgr2=0x55e77dfc89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f894c0cd1a0 tx=0x7f894c06b930 comp rx=0 tx=0).stop 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 shutdown_connections 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55e77e03ab90 0x55e77e03cfb0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55e77dfbf370 0x55e77dfc9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f893bfff640 0 client.20835 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55e77dfba2e0 0x55e77dfc89f0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 --2- 172.21.15.52:0/3238686681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55e77dfb99a0 0x55e77dfc84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 >> 172.21.15.52:0/3238686681 conn(0x55e77dfb5010 msgr2=0x55e77dfc30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 shutdown_connections 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 1 -- 172.21.15.52:0/3238686681 wait complete. 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.576+0000 7f8965a6d740 20 client.20835 trim_cache size 0 max 16384 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:36:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 msgr2=0x7f89480a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 0x7f89480a57e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8954031440 tx=0x7f8954009260 comp rx=0 tx=0).stop 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 msgr2=0x7f895c19eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f894c00db80 tx=0x7f894c00b630 comp rx=0 tx=0).stop 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 shutdown_connections 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f895c102610 0x7f895c1a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f895c101c50 0x7f895c19eed0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f89480a3320 0x7f89480a57e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 --2- 172.21.15.52:0/2476136081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f895c100a60 0x7f895c06ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 >> 172.21.15.52:0/2476136081 conn(0x7f895c0fc1e0 msgr2=0x7f895c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 shutdown_connections 2024-09-19T09:36:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:27.577+0000 7f8962cd0640 1 -- 172.21.15.52:0/2476136081 wait complete. 2024-09-19T09:36:28.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:28 smithi052 ceph-mon[30947]: pgmap v789: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:28.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:28 smithi169 ceph-mon[35454]: pgmap v789: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:29.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:28 smithi086 ceph-mon[34813]: pgmap v789: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-19T09:36:30.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:30 smithi052 ceph-mon[30947]: pgmap v790: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:36:30.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:30 smithi169 ceph-mon[35454]: pgmap v790: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:36:31.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:30 smithi086 ceph-mon[34813]: pgmap v790: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-19T09:36:31.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:31.728 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:32.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.184+0000 7f85d54e7640 1 -- 172.21.15.52:0/3223865009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102570 msgr2=0x7f85d01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.184+0000 7f85d54e7640 1 --2- 172.21.15.52:0/3223865009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102570 0x7f85d01029b0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009900 tx=0x7f85c002a480 comp rx=0 tx=0).stop 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 -- 172.21.15.52:0/3223865009 shutdown_connections 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 --2- 172.21.15.52:0/3223865009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102ef0 0x7f85d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 --2- 172.21.15.52:0/3223865009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102570 0x7f85d01029b0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 --2- 172.21.15.52:0/3223865009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 -- 172.21.15.52:0/3223865009 >> 172.21.15.52:0/3223865009 conn(0x7f85d00fc7d0 msgr2=0x7f85d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 -- 172.21.15.52:0/3223865009 shutdown_connections 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 -- 172.21.15.52:0/3223865009 wait complete. 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 Processor -- start 2024-09-19T09:36:32.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.185+0000 7f85d54e7640 1 -- start start 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102570 0x7f85d0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0110f80 con 0x7f85d0102ef0 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0110e00 con 0x7f85d0102570 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85d54e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0111100 con 0x7f85d0100e20 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51962/0 (socket says 172.21.15.52:51962) 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 -- 172.21.15.52:0/1753028291 learned_addr learned my addr 172.21.15.52:0/1753028291 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85ce7fc640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102570 0x7f85d0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85ceffd640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 -- 172.21.15.52:0/1753028291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 msgr2=0x7f85d0199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 -- 172.21.15.52:0/1753028291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102570 msgr2=0x7f85d0199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102570 0x7f85d0199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 -- 172.21.15.52:0/1753028291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d01a48d0 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85ceffd640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.186+0000 7f85cf7fe640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f85c800cad0 tx=0x7f85c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.187+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c800ae20 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.187+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85c8005020 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.187+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d01a4aa0 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.187+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c800f6f0 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.187+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d01a4f90 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.188+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d0101200 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.189+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f85c80051d0 con 0x7f85d0102ef0 2024-09-19T09:36:32.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.189+0000 7f85c7fff640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 0x7f85bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.190+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f85c80cfa30 con 0x7f85d0102ef0 2024-09-19T09:36:32.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.190+0000 7f85ceffd640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 0x7f85bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.190+0000 7f85ceffd640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 0x7f85bc0a5700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009b40 tx=0x7f85b8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:32.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.194+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85c8014030 con 0x7f85d0102ef0 2024-09-19T09:36:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.408+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85d006a5a0 con 0x7f85d0102ef0 2024-09-19T09:36:32.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.409+0000 7f85c7fff640 1 -- 172.21.15.52:0/1753028291 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f85d006a5a0 con 0x7f85d0102ef0 2024-09-19T09:36:32.414 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:36:32.414 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 msgr2=0x7f85bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 0x7f85bc0a5700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009b40 tx=0x7f85b8005e50 comp rx=0 tx=0).stop 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 msgr2=0x7f85d01a4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f85c800cad0 tx=0x7f85c800cf90 comp rx=0 tx=0).stop 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 shutdown_connections 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0102ef0 0x7f85d01a4390 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85d0102570 0x7f85d0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f85bc0a3240 0x7f85bc0a5700 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 --2- 172.21.15.52:0/1753028291 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85d0100e20 0x7f85d0199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 >> 172.21.15.52:0/1753028291 conn(0x7f85d00fc7d0 msgr2=0x7f85d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 shutdown_connections 2024-09-19T09:36:32.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:32.412+0000 7f85d54e7640 1 -- 172.21.15.52:0/1753028291 wait complete. 2024-09-19T09:36:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:32 smithi052 ceph-mon[30947]: pgmap v791: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:36:32.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:32 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1753028291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:32.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:32 smithi169 ceph-mon[35454]: pgmap v791: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:36:32.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:32 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1753028291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:33.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:32 smithi086 ceph-mon[34813]: pgmap v791: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:36:33.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:32 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1753028291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:33.184 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id e6c61f98 --release --await' 2024-09-19T09:36:33.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id e6c61f98 --release --await 2024-09-19T09:36:33.448 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:33.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 -- 172.21.15.52:0/1073903675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 msgr2=0x7fdac81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 --2- 172.21.15.52:0/1073903675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac81067e0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009900 tx=0x7fdab802a410 comp rx=0 tx=0).stop 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 -- 172.21.15.52:0/1073903675 shutdown_connections 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 --2- 172.21.15.52:0/1073903675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 0x7fdac810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 --2- 172.21.15.52:0/1073903675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac81067e0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 --2- 172.21.15.52:0/1073903675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 -- 172.21.15.52:0/1073903675 >> 172.21.15.52:0/1073903675 conn(0x7fdac80fd8c0 msgr2=0x7fdac80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 -- 172.21.15.52:0/1073903675 shutdown_connections 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.905+0000 7fdacefce640 1 -- 172.21.15.52:0/1073903675 wait complete. 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 Processor -- start 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 -- start start 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 0x7fdac819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8112010 con 0x7fdac8102790 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8111e90 con 0x7fdac8101de0 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacefce640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdac8112190 con 0x7fdac8106f10 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdac7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51986/0 (socket says 172.21.15.52:51986) 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdac7fff640 1 -- 172.21.15.52:0/1811605633 learned_addr learned my addr 172.21.15.52:0/1811605633 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdacd56b640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 0x7fdac819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.906+0000 7fdac7fff640 1 -- 172.21.15.52:0/1811605633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 msgr2=0x7fdac819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac7fff640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 0x7fdac819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac7fff640 1 -- 172.21.15.52:0/1811605633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 msgr2=0x7fdac8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac7fff640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac7fff640 1 -- 172.21.15.52:0/1811605633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac819d540 con 0x7fdac8102790 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac7fff640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fdab8005ab0 tx=0x7fdab80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac5ffb640 1 -- 172.21.15.52:0/1811605633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab803f030 con 0x7fdac8102790 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac819d7d0 con 0x7fdac8102790 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac5ffb640 1 -- 172.21.15.52:0/1811605633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdab8003ce0 con 0x7fdac8102790 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdac5ffb640 1 -- 172.21.15.52:0/1811605633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8035070 con 0x7fdac8102790 2024-09-19T09:36:33.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.907+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac81a5110 con 0x7fdac8102790 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.909+0000 7fdac5ffb640 1 -- 172.21.15.52:0/1811605633 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdab8042030 con 0x7fdac8102790 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 Processor -- start 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 -- start start 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f50d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f53630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562520eab620 con 0x562520f46060 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562520e52e50 con 0x562520f46980 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdad13a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562520ea75e0 con 0x562520f51240 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52000/0 (socket says 172.21.15.52:52000) 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 -- 172.21.15.52:0/2405789869 learned_addr learned my addr 172.21.15.52:0/2405789869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f50d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdac5ffb640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 0x7fdab40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 -- 172.21.15.52:0/2405789869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 msgr2=0x562520f53630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f53630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 -- 172.21.15.52:0/2405789869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 msgr2=0x562520f50d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f50d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdacd56b640 1 -- 172.21.15.52:0/2405789869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562520e43d40 con 0x562520f46060 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.910+0000 7fdac5ffb640 1 -- 172.21.15.52:0/1811605633 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdab80f0260 con 0x7fdac8102790 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.911+0000 7fdacd56b640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 0x7fdab40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.911+0000 7fdacd56b640 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fdac000a5d0 tx=0x7fdac000aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf057aa9a59ae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.911+0000 7fdabeffd640 1 -- 172.21.15.52:0/2405789869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac001a040 con 0x562520f46060 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.911+0000 7fdabeffd640 1 -- 172.21.15.52:0/2405789869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdac0021ba0 con 0x562520f46060 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.911+0000 7fdabeffd640 1 -- 172.21.15.52:0/2405789869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac001f350 con 0x562520f46060 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- 172.21.15.52:0/2405789869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 msgr2=0x562520f46440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fdac000a5d0 tx=0x7fdac000aa90 comp rx=0 tx=0).stop 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdacd56b640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 0x7fdab40a5700 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdac0020000 tx=0x7fdac0021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- 172.21.15.52:0/2405789869 shutdown_connections 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f53630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f50d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 --2- 172.21.15.52:0/2405789869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f46440 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- 172.21.15.52:0/2405789869 >> 172.21.15.52:0/2405789869 conn(0x562520f425f0 msgr2=0x562520f429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- 172.21.15.52:0/2405789869 shutdown_connections 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- 172.21.15.52:0/2405789869 wait complete. 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 -- start start 2024-09-19T09:36:33.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.912+0000 7fdad13a7740 1 Processor -- start 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f4e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f4ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562520f53e10 con 0x562520f46060 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562520e33f10 con 0x562520f46980 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562520f53f90 con 0x562520f51240 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdad13a7740 10 client.0 _ll_register_callbacks cb 0x562520e57db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52008/0 (socket says 172.21.15.52:52008) 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 -- 172.21.15.52:0/3410378272 learned_addr learned my addr 172.21.15.52:0/3410378272 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdac7fff640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f4e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdacd56b640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f4ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 -- 172.21.15.52:0/3410378272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 msgr2=0x562520f4ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f4ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 -- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 msgr2=0x562520f4e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f4e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 -- 172.21.15.52:0/3410378272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562520bba580 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdacd56b640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f4ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fdab0010530 tx=0x7fdab00109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac982ae041efc2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaa7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.913+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab0018070 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdab0014640 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac0021ba0 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdab0024050 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 10 client.20853 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562520c84960 con 0x562520f46060 2024-09-19T09:36:33.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdac0021ba0 con 0x562520f46060 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdab0012a70 con 0x562520f46060 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 10 client.20853 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 10 client.20853 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 20 client.20853 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520f60db0 0x562520f631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 4 client.20853 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.914+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562520eb8b90 con 0x562520f60db0 2024-09-19T09:36:33.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.915+0000 7fdac7fff640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520f60db0 0x562520f631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.915+0000 7fdaa7fff640 10 client.20853 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:33.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.915+0000 7fdac7fff640 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520f60db0 0x562520f631c0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d454dfdc4f19f587 server_cookie=743f0f405f0a29a1 in_seq=0 out_seq=0 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3410378272 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562520eb8b90 con 0x562520f60db0 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdaa7fff640 10 client.20853 handle_command_reply: tid=0 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 client.20853 shutdown 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 msgr2=0x562520f4e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fdab0010530 tx=0x7fdab00109f0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 shutdown_connections 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520f60db0 0x562520f631c0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f51240 0x562520f4ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46980 0x562520f4e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3410378272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f46060 0x562520f4e170 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 >> 172.21.15.52:0/3410378272 conn(0x562520f425f0 msgr2=0x562520f48320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdaa7fff640 0 client.20853 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:33.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 shutdown_connections 2024-09-19T09:36:33.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 1 -- 172.21.15.52:0/3410378272 wait complete. 2024-09-19T09:36:33.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.916+0000 7fdad13a7740 20 client.20853 trim_cache size 0 max 16384 2024-09-19T09:36:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 Processor -- start 2024-09-19T09:36:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 -- start start 2024-09-19T09:36:33.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520f500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520f595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81b0110 con 0x562520f51240 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81ad9e0 con 0x562520f46060 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdad13a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81ab830 con 0x562520f46980 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52018/0 (socket says 172.21.15.52:52018) 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdacd56b640 1 -- 172.21.15.52:0/4092300044 learned_addr learned my addr 172.21.15.52:0/4092300044 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.933+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520f500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdac7fff640 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520f595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 -- 172.21.15.52:0/4092300044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 msgr2=0x562520f595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520f595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 -- 172.21.15.52:0/4092300044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 msgr2=0x562520f500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520f500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 -- 172.21.15.52:0/4092300044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562520f42420 con 0x562520f51240 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdacd56b640 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fdac0004a80 tx=0x7fdac0016f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f5eda4d9b590c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdabe7fc640 1 -- 172.21.15.52:0/4092300044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac001a050 con 0x562520f51240 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdabe7fc640 1 -- 172.21.15.52:0/4092300044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdac0009970 con 0x562520f51240 2024-09-19T09:36:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.934+0000 7fdabe7fc640 1 -- 172.21.15.52:0/4092300044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac002a6d0 con 0x562520f51240 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- 172.21.15.52:0/4092300044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 msgr2=0x562520f59b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7fdac0004a80 tx=0x7fdac0016f90 comp rx=0 tx=0).stop 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- 172.21.15.52:0/4092300044 shutdown_connections 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520f59b00 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520f595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 --2- 172.21.15.52:0/4092300044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520f500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- 172.21.15.52:0/4092300044 >> 172.21.15.52:0/4092300044 conn(0x562520f425f0 msgr2=0x562520f4f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- 172.21.15.52:0/4092300044 shutdown_connections 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- 172.21.15.52:0/4092300044 wait complete. 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 -- start start 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.935+0000 7fdad13a7740 1 Processor -- start 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520fc3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520fc3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81abea0 con 0x562520f51240 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81ad310 con 0x562520f46060 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdac81ac570 con 0x562520f46980 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdad13a7740 10 client.0 _ll_register_callbacks cb 0x7fdab0007e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:33.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52034/0 (socket says 172.21.15.52:52034) 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 -- 172.21.15.52:0/3232557400 learned_addr learned my addr 172.21.15.52:0/3232557400 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520fc3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdac7fff640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520fc3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 -- 172.21.15.52:0/3232557400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 msgr2=0x562520fc3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520fc3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 -- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 msgr2=0x562520fc3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520fc3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdacd56b640 1 -- 172.21.15.52:0/3232557400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562520fc4840 con 0x562520f51240 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.936+0000 7fdac7fff640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520fc3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdacd56b640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007140 tx=0x7fdac0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e39e8ddbee7ff5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:33.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac001f350 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fdac0021920 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdac0009970 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdac001a020 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 10 client.20859 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562520fd0130 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdac0009970 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdac0046070 con 0x562520f51240 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 10 client.20859 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 10 client.20859 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 20 client.20859 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520fd0600 0x562520fd29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 4 client.20859 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e6c61f98", "release": true, "await": true}] 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.937+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e6c61f98", "release": true, "await": true}) -- 0x562520eb30a0 con 0x562520fd0600 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.938+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520fd0600 0x562520fd29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:33.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.938+0000 7fdaccd6a640 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520fd0600 0x562520fd29f0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5d3b18c631420d server_cookie=73730b6c3e1b9188 in_seq=0 out_seq=0 2024-09-19T09:36:33.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.938+0000 7fdaa7fff640 10 client.20859 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.940+0000 7fdaa7fff640 1 -- 172.21.15.52:0/3232557400 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562520eb30a0 con 0x562520fd0600 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.940+0000 7fdaa7fff640 10 client.20859 handle_command_reply: tid=0 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.940+0000 7fdad13a7740 1 client.20859 shutdown 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 msgr2=0x562520fceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007140 tx=0x7fdac0009f10 comp rx=0 tx=0).stop 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 shutdown_connections 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562520fd0600 0x562520fd29f0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdaa7fff640 0 client.20859 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562520f51240 0x562520fceaa0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562520f46980 0x562520fc3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 --2- 172.21.15.52:0/3232557400 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562520f46060 0x562520fc3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 >> 172.21.15.52:0/3232557400 conn(0x562520f425f0 msgr2=0x562520f48320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 shutdown_connections 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 1 -- 172.21.15.52:0/3232557400 wait complete. 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.941+0000 7fdad13a7740 20 client.20859 trim_cache size 0 max 16384 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 52, 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:36:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "e6c61f98": { 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 52, 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.4, 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:36:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:33.948 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 msgr2=0x7fdab40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 0x7fdab40a5700 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdac0020000 tx=0x7fdac0021000 comp rx=0 tx=0).stop 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 msgr2=0x7fdac8198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fdab8005ab0 tx=0x7fdab80042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 shutdown_connections 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fdab40a3240 0x7fdab40a5700 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdac8106f10 0x7fdac819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac8102790 0x7fdac8198ad0 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 --2- 172.21.15.52:0/1811605633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdac8101de0 0x7fdac8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:33.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 >> 172.21.15.52:0/1811605633 conn(0x7fdac80fd8c0 msgr2=0x7fdac80fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:33.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 shutdown_connections 2024-09-19T09:36:33.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:33.942+0000 7fdacefce640 1 -- 172.21.15.52:0/1811605633 wait complete. 2024-09-19T09:36:34.740 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e6c61f98', total seconds elapsed: 32.7 2024-09-19T09:36:34.740 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.45 2024-09-19T09:36:34.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:34.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:34 smithi052 ceph-mon[30947]: pgmap v792: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:36:34.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:34 smithi169 ceph-mon[35454]: pgmap v792: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:36:35.005 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:35.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:34 smithi086 ceph-mon[34813]: pgmap v792: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3370335682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c102d40 msgr2=0x7fe19c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3370335682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c102d40 0x7fe19c103120 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009900 tx=0x7fe18c02a480 comp rx=0 tx=0).stop 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3370335682 shutdown_connections 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3370335682 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c10c170 0x7fe19c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3370335682 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3370335682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c102d40 0x7fe19c103120 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3370335682 >> 172.21.15.52:0/3370335682 conn(0x7fe19c0fc7a0 msgr2=0x7fe19c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3370335682 shutdown_connections 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.421+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3370335682 wait complete. 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 Processor -- start 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 -- start start 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c102d40 0x7fe19c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c111f70 con 0x7fe19c10c170 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c111df0 con 0x7fe19c102d40 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.422+0000 7fe1a1d6e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c1120f0 con 0x7fe19c103660 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19b7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c102d40 0x7fe19c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52044/0 (socket says 172.21.15.52:52044) 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 -- 172.21.15.52:0/3696739783 learned_addr learned my addr 172.21.15.52:0/3696739783 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19affd640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 -- 172.21.15.52:0/3696739783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 msgr2=0x7fe19c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 -- 172.21.15.52:0/3696739783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c102d40 msgr2=0x7fe19c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c102d40 0x7fe19c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 -- 172.21.15.52:0/3696739783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c19d3a0 con 0x7fe19c10c170 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19affd640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe19bfff640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fe19400cad0 tx=0x7fe19400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.423+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400ae20 con 0x7fe19c10c170 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.424+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c19d690 con 0x7fe19c10c170 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.424+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe194005020 con 0x7fe19c10c170 2024-09-19T09:36:35.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.424+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19400f6f0 con 0x7fe19c10c170 2024-09-19T09:36:35.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.424+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c1a4f70 con 0x7fe19c10c170 2024-09-19T09:36:35.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.425+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c103120 con 0x7fe19c10c170 2024-09-19T09:36:35.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.426+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe1940051d0 con 0x7fe19c10c170 2024-09-19T09:36:35.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.427+0000 7fe198ff9640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 0x7fe1840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.427+0000 7fe19b7fe640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 0x7fe1840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.427+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe1940cfdb0 con 0x7fe19c10c170 2024-09-19T09:36:35.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.427+0000 7fe19b7fe640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 0x7fe1840a5700 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.430+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe194014030 con 0x7fe19c10c170 2024-09-19T09:36:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.640+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe19c02d7c0 con 0x7fe19c10c170 2024-09-19T09:36:35.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.641+0000 7fe198ff9640 1 -- 172.21.15.52:0/3696739783 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe19409c9f0 con 0x7fe19c10c170 2024-09-19T09:36:35.643 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:36:35.643 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:36:35.643 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 msgr2=0x7fe1840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 0x7fe1840a5700 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 msgr2=0x7fe19c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fe19400cad0 tx=0x7fe19400cf90 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 shutdown_connections 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe19c10c170 0x7fe19c19ccc0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe1840a3240 0x7fe1840a5700 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe19c103660 0x7fe19c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 --2- 172.21.15.52:0/3696739783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe19c102d40 0x7fe19c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 >> 172.21.15.52:0/3696739783 conn(0x7fe19c0fc7a0 msgr2=0x7fe19c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 shutdown_connections 2024-09-19T09:36:35.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:35.643+0000 7fe1a1d6e640 1 -- 172.21.15.52:0/3696739783 wait complete. 2024-09-19T09:36:36.395 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0' 2024-09-19T09:36:36.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db / --timeout 90 --expiration 149.45 --await-for 45.0 2024-09-19T09:36:36.658 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:36.892 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:36 smithi052 ceph-mon[30947]: pgmap v793: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:36:36.892 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:36 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3696739783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:36.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:36 smithi169 ceph-mon[35454]: pgmap v793: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:36:36.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:36 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3696739783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:36 smithi086 ceph-mon[34813]: pgmap v793: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-19T09:36:37.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:36 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3696739783' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 -- 172.21.15.52:0/1019030775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102ef0 msgr2=0x7f697410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 --2- 172.21.15.52:0/1019030775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102ef0 0x7f697410da40 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f696c009ca0 tx=0x7f696c02a950 comp rx=0 tx=0).stop 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 -- 172.21.15.52:0/1019030775 shutdown_connections 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 --2- 172.21.15.52:0/1019030775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102ef0 0x7f697410da40 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 --2- 172.21.15.52:0/1019030775 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974102570 0x7f69741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 --2- 172.21.15.52:0/1019030775 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100e20 0x7f6974101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 -- 172.21.15.52:0/1019030775 >> 172.21.15.52:0/1019030775 conn(0x7f69740fc7d0 msgr2=0x7f69740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 -- 172.21.15.52:0/1019030775 shutdown_connections 2024-09-19T09:36:37.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.107+0000 7f697b218640 1 -- 172.21.15.52:0/1019030775 wait complete. 2024-09-19T09:36:37.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 Processor -- start 2024-09-19T09:36:37.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 -- start start 2024-09-19T09:36:37.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 0x7f69741983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 0x7f697419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6974110fd0 con 0x7f6974102570 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6974110e50 con 0x7f6974102ef0 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f697b218640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6974111150 con 0x7f6974100e20 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52062/0 (socket says 172.21.15.52:52062) 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 -- 172.21.15.52:0/1056679865 learned_addr learned my addr 172.21.15.52:0/1056679865 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f69797b5640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 0x7f697419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 0x7f69741983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 -- 172.21.15.52:0/1056679865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 msgr2=0x7f69741983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 0x7f69741983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 -- 172.21.15.52:0/1056679865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 msgr2=0x7f697419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 0x7f697419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6973fff640 1 -- 172.21.15.52:0/1056679865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697419d370 con 0x7f6974102570 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 0x7f69741983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.108+0000 7f69797b5640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 0x7f697419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f6973fff640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f696000c920 tx=0x7f696000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f6971ffb640 1 -- 172.21.15.52:0/1056679865 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960007c70 con 0x7f6974102570 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f6971ffb640 1 -- 172.21.15.52:0/1056679865 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6960007e10 con 0x7f6974102570 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697419d660 con 0x7f6974102570 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f6971ffb640 1 -- 172.21.15.52:0/1056679865 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960018890 con 0x7f6974102570 2024-09-19T09:36:37.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.109+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741a4f40 con 0x7f6974102570 2024-09-19T09:36:37.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.111+0000 7f6971ffb640 1 -- 172.21.15.52:0/1056679865 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6960018a70 con 0x7f6974102570 2024-09-19T09:36:37.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 Processor -- start 2024-09-19T09:36:37.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 -- start start 2024-09-19T09:36:37.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 0x56522d8784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56522d7d2160 con 0x56522d86d850 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56522d779720 con 0x56522d878a30 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f697d5f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56522d7ce120 con 0x56522d86e170 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f6971ffb640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 0x7f69640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f69797b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f69797b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52076/0 (socket says 172.21.15.52:52076) 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.112+0000 7f69797b5640 1 -- 172.21.15.52:0/1836024284 learned_addr learned my addr 172.21.15.52:0/1836024284 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 0x56522d8784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6973fff640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6971ffb640 1 -- 172.21.15.52:0/1056679865 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69600cfb70 con 0x7f6974102570 2024-09-19T09:36:37.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f69797b5640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 0x7f69640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 -- 172.21.15.52:0/1836024284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 msgr2=0x56522d87ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 -- 172.21.15.52:0/1836024284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 msgr2=0x56522d86dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 -- 172.21.15.52:0/1836024284 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522d543ba0 con 0x56522d86e170 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f69797b5640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f6978fb4640 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 0x56522d8784f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6968005fd0 tx=0x7f696800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5a14e8f4c0eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f69797b5640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 0x7f69640a5700 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f696c009a60 tx=0x7f696c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f695effd640 1 -- 172.21.15.52:0/1836024284 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968016070 con 0x56522d86e170 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f695effd640 1 -- 172.21.15.52:0/1836024284 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968005500 con 0x56522d86e170 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.113+0000 7f695effd640 1 -- 172.21.15.52:0/1836024284 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69680116d0 con 0x56522d86e170 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 -- 172.21.15.52:0/1836024284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 msgr2=0x56522d8784f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 0x56522d8784f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6968005fd0 tx=0x7f696800e6c0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 -- 172.21.15.52:0/1836024284 shutdown_connections 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86e170 0x56522d8784f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 --2- 172.21.15.52:0/1836024284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d86dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 -- 172.21.15.52:0/1836024284 >> 172.21.15.52:0/1836024284 conn(0x56522d869de0 msgr2=0x56522d86a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 -- 172.21.15.52:0/1836024284 shutdown_connections 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.114+0000 7f697d5f1740 1 -- 172.21.15.52:0/1836024284 wait complete. 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 -- start start 2024-09-19T09:36:37.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 Processor -- start 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d8758e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d875e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56522d87b600 con 0x56522d878a30 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56522d75a900 con 0x56522d86e170 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56522d87b780 con 0x56522d86d850 2024-09-19T09:36:37.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f697d5f1740 10 client.0 _ll_register_callbacks cb 0x56522d758780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f69797b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f69797b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52088/0 (socket says 172.21.15.52:52088) 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f69797b5640 1 -- 172.21.15.52:0/2868276572 learned_addr learned my addr 172.21.15.52:0/2868276572 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.115+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d8758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6973fff640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d875e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 -- 172.21.15.52:0/2868276572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 msgr2=0x56522d8758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d8758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 -- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 msgr2=0x56522d875e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d875e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 -- 172.21.15.52:0/2868276572 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522d79ac50 con 0x56522d878a30 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6973fff640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d875e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f69797b5640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f696c009ca0 tx=0x7f696c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9c4ba1c9e5991b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6953fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c04e070 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f696c004250 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6968005500 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f696c034040 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f697d5f1740 10 client.20877 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.116+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56522d887280 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968005500 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f696c039cc0 con 0x56522d878a30 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 10 client.20877 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 10 client.20877 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 20 client.20877 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:37.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d888690 0x56522d88ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 4 client.20877 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56522d7df890 con 0x56522d888690 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d888690 0x56522d88ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d888690 0x56522d88ab30 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672a6e7508cb7ee3 server_cookie=4bc83808dc8e21ef in_seq=0 out_seq=0 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.117+0000 7f6953fff640 10 client.20877 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f6953fff640 1 -- 172.21.15.52:0/2868276572 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56522d7df890 con 0x56522d888690 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f6953fff640 10 client.20877 handle_command_reply: tid=0 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 client.20877 shutdown 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 msgr2=0x56522d876360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f696c009ca0 tx=0x7f696c02a950 comp rx=0 tx=0).stop 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 shutdown_connections 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d888690 0x56522d88ab30 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d878a30 0x56522d876360 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d875e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2868276572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d8758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 >> 172.21.15.52:0/2868276572 conn(0x56522d869de0 msgr2=0x56522d86fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.118+0000 7f6953fff640 0 client.20877 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.119+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 shutdown_connections 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.119+0000 7f697d5f1740 1 -- 172.21.15.52:0/2868276572 wait complete. 2024-09-19T09:36:37.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.119+0000 7f697d5f1740 20 client.20877 trim_cache size 0 max 16384 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.135+0000 7f697d5f1740 1 Processor -- start 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.135+0000 7f697d5f1740 1 -- start start 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d890990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d878a30 0x56522d86f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69741b0000 con 0x56522d86d850 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ad8d0 con 0x56522d86e170 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f697d5f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ab720 con 0x56522d878a30 2024-09-19T09:36:37.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52090/0 (socket says 172.21.15.52:52090) 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 -- 172.21.15.52:0/2187999961 learned_addr learned my addr 172.21.15.52:0/2187999961 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 -- 172.21.15.52:0/2187999961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d878a30 msgr2=0x56522d86f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d878a30 0x56522d86f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 -- 172.21.15.52:0/2187999961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 msgr2=0x56522d890990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d890990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 -- 172.21.15.52:0/2187999961 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56522d869c10 con 0x56522d86d850 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f6978fb4640 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f6968005fd0 tx=0x7f696800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9bded53417703a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f695e7fc640 1 -- 172.21.15.52:0/2187999961 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968016040 con 0x56522d86d850 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f695e7fc640 1 -- 172.21.15.52:0/2187999961 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968004680 con 0x56522d86d850 2024-09-19T09:36:37.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.136+0000 7f695e7fc640 1 -- 172.21.15.52:0/2187999961 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968011470 con 0x56522d86d850 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- 172.21.15.52:0/2187999961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 msgr2=0x56522d890450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f6968005fd0 tx=0x7f696800eef0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- 172.21.15.52:0/2187999961 shutdown_connections 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d878a30 0x56522d86f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d86e170 0x56522d890990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 --2- 172.21.15.52:0/2187999961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86d850 0x56522d890450 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- 172.21.15.52:0/2187999961 >> 172.21.15.52:0/2187999961 conn(0x56522d869de0 msgr2=0x56522d870c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- 172.21.15.52:0/2187999961 shutdown_connections 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- 172.21.15.52:0/2187999961 wait complete. 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 -- start start 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.137+0000 7f697d5f1740 1 Processor -- start 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d87c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69741abd90 con 0x56522d86e170 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ad200 con 0x56522d878a30 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ac460 con 0x56522d86d850 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f697d5f1740 10 client.0 _ll_register_callbacks cb 0x7f696c02f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52098/0 (socket says 172.21.15.52:52098) 2024-09-19T09:36:37.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 -- 172.21.15.52:0/4210127107 learned_addr learned my addr 172.21.15.52:0/4210127107 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6978fb4640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d87c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f69797b5640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 -- 172.21.15.52:0/4210127107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 msgr2=0x56522d87c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d87c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 -- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 msgr2=0x56522d87d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f6973fff640 1 -- 172.21.15.52:0/4210127107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56522d8f2620 con 0x56522d86e170 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.138+0000 7f69797b5640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6973fff640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f6960098a80 tx=0x7f696001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cfa5e1bdea033b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69600a0460 con 0x56522d86e170 2024-09-19T09:36:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6968004680 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f69600bc0b0 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f69600a4d20 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 10 client.20883 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56522d8f38a0 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968004680 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6960098720 con 0x56522d86e170 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 10 client.20883 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 10 client.20883 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 20 client.20883 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d8f4070 0x56522d8f6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 4 client.20883 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}] 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.139+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.45, "await_for": 45.0}) -- 0x56522d7d9be0 con 0x56522d8f4070 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.140+0000 7f6978fb4640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d8f4070 0x56522d8f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.140+0000 7f6978fb4640 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d8f4070 0x56522d8f6490 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf0d075ce4a0904 server_cookie=2b7ecdeff60a074a in_seq=0 out_seq=0 2024-09-19T09:36:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.140+0000 7f6953fff640 10 client.20883 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f6953fff640 1 -- 172.21.15.52:0/4210127107 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56522d7d9be0 con 0x56522d8f4070 2024-09-19T09:36:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f6953fff640 10 client.20883 handle_command_reply: tid=0 2024-09-19T09:36:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 client.20883 shutdown 2024-09-19T09:36:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 msgr2=0x56522d87ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f6960098a80 tx=0x7f696001c000 comp rx=0 tx=0).stop 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 shutdown_connections 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56522d8f4070 0x56522d8f6490 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56522d878a30 0x56522d87d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56522d86e170 0x56522d87ce30 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 --2- 172.21.15.52:0/4210127107 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56522d86d850 0x56522d87c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.149+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 >> 172.21.15.52:0/4210127107 conn(0x56522d869de0 msgr2=0x56522d86f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f6953fff640 0 client.20883 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 shutdown_connections 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697d5f1740 1 -- 172.21.15.52:0/4210127107 wait complete. 2024-09-19T09:36:37.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697d5f1740 20 client.20883 trim_cache size 0 max 16384 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 54, 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "d53bd4b4": { 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 54, 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:37.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.4, 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "QUIESCED", 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:37.155 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 msgr2=0x7f69640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 0x7f69640a5700 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f696c009a60 tx=0x7f696c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 msgr2=0x7f6974198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f696000c920 tx=0x7f696000cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 shutdown_connections 2024-09-19T09:36:37.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974102ef0 0x7f697419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974102570 0x7f6974198900 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f69640a3240 0x7f69640a5700 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 --2- 172.21.15.52:0/1056679865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6974100e20 0x7f69741983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.150+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 >> 172.21.15.52:0/1056679865 conn(0x7f69740fc7d0 msgr2=0x7f697406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.151+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 shutdown_connections 2024-09-19T09:36:37.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:37.151+0000 7f697b218640 1 -- 172.21.15.52:0/1056679865 wait complete. 2024-09-19T09:36:37.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:36:37.968 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd53bd4b4', quiesce took 3.2 seconds. Will release after: 26.25 2024-09-19T09:36:38.025 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:38.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 -- 172.21.15.52:0/761954365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 msgr2=0x7fc5b010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 --2- 172.21.15.52:0/761954365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b010d950 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009cd0 tx=0x7fc5a802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 -- 172.21.15.52:0/761954365 shutdown_connections 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 --2- 172.21.15.52:0/761954365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b010d950 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 --2- 172.21.15.52:0/761954365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0100a80 0x7fc5b0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 --2- 172.21.15.52:0/761954365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0106a80 0x7fc5b0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 -- 172.21.15.52:0/761954365 >> 172.21.15.52:0/761954365 conn(0x7fc5b00fc7a0 msgr2=0x7fc5b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 -- 172.21.15.52:0/761954365 shutdown_connections 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.490+0000 7fc5b6265640 1 -- 172.21.15.52:0/761954365 wait complete. 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 Processor -- start 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 -- start start 2024-09-19T09:36:38.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0100a80 0x7fc5b019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0106a80 0x7fc5b019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0110e80 con 0x7fc5b0101420 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0110d00 con 0x7fc5b0100a80 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b6265640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0111000 con 0x7fc5b0106a80 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34826/0 (socket says 172.21.15.52:34826) 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5af7fe640 1 -- 172.21.15.52:0/2045534673 learned_addr learned my addr 172.21.15.52:0/2045534673 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5affff640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0100a80 0x7fc5b019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.491+0000 7fc5b4802640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0106a80 0x7fc5b019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 -- 172.21.15.52:0/2045534673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0106a80 msgr2=0x7fc5b019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0106a80 0x7fc5b019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 -- 172.21.15.52:0/2045534673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0100a80 msgr2=0x7fc5b019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0100a80 0x7fc5b019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 -- 172.21.15.52:0/2045534673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b019f540 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c920 tx=0x7fc5a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5ad7fa640 1 -- 172.21.15.52:0/2045534673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4007c70 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5ad7fa640 1 -- 172.21.15.52:0/2045534673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a4007e10 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b019f830 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5ad7fa640 1 -- 172.21.15.52:0/2045534673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a4018890 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.492+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01a7110 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.494+0000 7fc5ad7fa640 1 -- 172.21.15.52:0/2045534673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc5a4018a70 con 0x7fc5b0101420 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 Processor -- start 2024-09-19T09:36:38.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 -- start start 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6896e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68979140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab688d42e0 con 0x55ab68979680 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ab6887bce0 con 0x55ab6896edc0 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b863e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab688d02a0 con 0x55ab6896e4a0 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5ad7fa640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 0x7fc5980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34838/0 (socket says 172.21.15.52:34838) 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5af7fe640 1 -- 172.21.15.52:0/753897977 learned_addr learned my addr 172.21.15.52:0/753897977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b4802640 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6896e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.495+0000 7fc5b4802640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 0x7fc5980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5affff640 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68979140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5ad7fa640 1 -- 172.21.15.52:0/2045534673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc5a40cf9d0 con 0x7fc5b0101420 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 -- 172.21.15.52:0/753897977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 msgr2=0x55ab6896e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6896e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 -- 172.21.15.52:0/753897977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 msgr2=0x55ab68979140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68979140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 -- 172.21.15.52:0/753897977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab68860440 con 0x55ab68979680 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5b4802640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 0x7fc5980a5780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8004ab0 tx=0x7fc5a80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40a3720 tx=0x7fc5a400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b58c96156b77863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5967fc640 1 -- 172.21.15.52:0/753897977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a409bf70 con 0x55ab68979680 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5967fc640 1 -- 172.21.15.52:0/753897977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a40a0320 con 0x55ab68979680 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.496+0000 7fc5967fc640 1 -- 172.21.15.52:0/753897977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a409c1d0 con 0x55ab68979680 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- 172.21.15.52:0/753897977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 msgr2=0x55ab6897ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fc5a40a3720 tx=0x7fc5a400ff30 comp rx=0 tx=0).stop 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- 172.21.15.52:0/753897977 shutdown_connections 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab6897ba70 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68979140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 --2- 172.21.15.52:0/753897977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6896e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- 172.21.15.52:0/753897977 >> 172.21.15.52:0/753897977 conn(0x55ab6896aa30 msgr2=0x55ab6896ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- 172.21.15.52:0/753897977 shutdown_connections 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- 172.21.15.52:0/753897977 wait complete. 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.497+0000 7fc5b863e740 1 -- start start 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 Processor -- start 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab689763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ab6897c250 con 0x55ab68979680 2024-09-19T09:36:38.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ab6888f050 con 0x55ab6896edc0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ab6897c3d0 con 0x55ab6896e4a0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b863e740 10 client.0 _ll_register_callbacks cb 0x55ab688cf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34852/0 (socket says 172.21.15.52:34852) 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 -- 172.21.15.52:0/123831273 learned_addr learned my addr 172.21.15.52:0/123831273 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab689763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5affff640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 -- 172.21.15.52:0/123831273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 msgr2=0x55ab689790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 -- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 msgr2=0x55ab689763a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab689763a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.498+0000 7fc5b4802640 1 -- 172.21.15.52:0/123831273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab686453c0 con 0x55ab68979680 2024-09-19T09:36:38.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b4802640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8035000 tx=0x7fc5a8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e5382333ffd2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8041070 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc5a80305a0 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a40a0320 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc5a8044040 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 10 client.20895 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ab68987d20 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a40a0320 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc5a8030070 con 0x55ab68979680 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 10 client.20895 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 10 client.20895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 20 client.20895 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:38.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689891e0 0x55ab6898b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 4 client.20895 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.499+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab688e1850 con 0x55ab689891e0 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.500+0000 7fc5affff640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689891e0 0x55ab6898b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.500+0000 7fc58f7fe640 10 client.20895 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.500+0000 7fc5affff640 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689891e0 0x55ab6898b5d0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2833b2a3135bb8a7 server_cookie=c8ff01be179e1995 in_seq=0 out_seq=0 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc58f7fe640 1 -- 172.21.15.52:0/123831273 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab688e1850 con 0x55ab689891e0 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc58f7fe640 10 client.20895 handle_command_reply: tid=0 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 client.20895 shutdown 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 msgr2=0x55ab68976a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8035000 tx=0x7fc5a8009360 comp rx=0 tx=0).stop 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 shutdown_connections 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689891e0 0x55ab6898b5d0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68976a00 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab689763a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 --2- 172.21.15.52:0/123831273 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc58f7fe640 0 client.20895 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 >> 172.21.15.52:0/123831273 conn(0x55ab6896aa30 msgr2=0x55ab68970710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 shutdown_connections 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 1 -- 172.21.15.52:0/123831273 wait complete. 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.501+0000 7fc5b863e740 20 client.20895 trim_cache size 0 max 16384 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.518+0000 7fc5b863e740 1 Processor -- start 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.518+0000 7fc5b863e740 1 -- start start 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.518+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68990ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b863e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01b2220 con 0x55ab68979680 2024-09-19T09:36:38.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b863e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01afaf0 con 0x55ab6896edc0 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b863e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01ad940 con 0x55ab6896e4a0 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34856/0 (socket says 172.21.15.52:34856) 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 -- 172.21.15.52:0/3005090232 learned_addr learned my addr 172.21.15.52:0/3005090232 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5affff640 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 -- 172.21.15.52:0/3005090232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 msgr2=0x55ab689854b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689854b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 -- 172.21.15.52:0/3005090232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 msgr2=0x55ab68990ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68990ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 -- 172.21.15.52:0/3005090232 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab68978ca0 con 0x55ab68979680 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc5b4802640 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005e30 tx=0x7fc5a8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1f10a91c84acb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc595ffb640 1 -- 172.21.15.52:0/3005090232 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8062030 con 0x55ab68979680 2024-09-19T09:36:38.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc595ffb640 1 -- 172.21.15.52:0/3005090232 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a8036050 con 0x55ab68979680 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.519+0000 7fc595ffb640 1 -- 172.21.15.52:0/3005090232 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8041040 con 0x55ab68979680 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- 172.21.15.52:0/3005090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 msgr2=0x55ab68991430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005e30 tx=0x7fc5a8004990 comp rx=0 tx=0).stop 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- 172.21.15.52:0/3005090232 shutdown_connections 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab68979680 0x55ab68991430 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab6896edc0 0x55ab68990ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 --2- 172.21.15.52:0/3005090232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab689854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- 172.21.15.52:0/3005090232 >> 172.21.15.52:0/3005090232 conn(0x55ab6896aa30 msgr2=0x55ab68969b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- 172.21.15.52:0/3005090232 shutdown_connections 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- 172.21.15.52:0/3005090232 wait complete. 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 -- start start 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.520+0000 7fc5b863e740 1 Processor -- start 2024-09-19T09:36:38.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6897d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 0x55ab689f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01adfb0 con 0x55ab6896edc0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01af420 con 0x55ab68979680 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b01ae680 con 0x55ab6896e4a0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 10 client.0 _ll_register_callbacks cb 0x7fc5a8003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34858/0 (socket says 172.21.15.52:34858) 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 -- 172.21.15.52:0/997069162 learned_addr learned my addr 172.21.15.52:0/997069162 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5affff640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6897d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b4802640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 0x55ab689f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 -- 172.21.15.52:0/997069162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 msgr2=0x55ab6897d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6897d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 -- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 msgr2=0x55ab689f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 0x55ab689f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 -- 172.21.15.52:0/997069162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6897e600 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b4802640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 0x55ab689f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5af7fe640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4007590 tx=0x7fc5a40cfbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32932345ea0401 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc58f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40b6020 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fc5a4018d60 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.521+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5a8036050 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc5a409bd40 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 10 client.20901 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ab689f4540 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5a8036050 con 0x55ab6896edc0 2024-09-19T09:36:38.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc5a40a4750 con 0x55ab6896edc0 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 10 client.20901 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 10 client.20901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 20 client.20901 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689f4880 0x55ab689f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 4 client.20901 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.522+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab688dbd60 con 0x55ab689f4880 2024-09-19T09:36:38.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.523+0000 7fc5affff640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689f4880 0x55ab689f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc58f7fe640 10 client.20901 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5affff640 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689f4880 0x55ab689f6c70 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e175132b14aa44d4 server_cookie=2f9c2f9d2f83ce84 in_seq=0 out_seq=0 2024-09-19T09:36:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc58f7fe640 1 -- 172.21.15.52:0/997069162 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ab688dbd60 con 0x55ab689f4880 2024-09-19T09:36:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc58f7fe640 10 client.20901 handle_command_reply: tid=0 2024-09-19T09:36:38.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 client.20901 shutdown 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 msgr2=0x55ab6897dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4007590 tx=0x7fc5a40cfbd0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 shutdown_connections 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ab689f4880 0x55ab689f6c70 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc58f7fe640 0 client.20901 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ab68979680 0x55ab689f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ab6896edc0 0x55ab6897dd00 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 --2- 172.21.15.52:0/997069162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ab6896e4a0 0x55ab6897d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 >> 172.21.15.52:0/997069162 conn(0x55ab6896aa30 msgr2=0x55ab68977c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 shutdown_connections 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 1 -- 172.21.15.52:0/997069162 wait complete. 2024-09-19T09:36:38.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.524+0000 7fc5b863e740 20 client.20901 trim_cache size 0 max 16384 2024-09-19T09:36:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:38.543 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:36:38.543 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:36:38.543 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 msgr2=0x7fc5980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 0x7fc5980a5780 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8004ab0 tx=0x7fc5a80093f0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 msgr2=0x7fc5b019aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400c920 tx=0x7fc5a400cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 shutdown_connections 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fc5980a32c0 0x7fc5980a5780 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc5b0106a80 0x7fc5b019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5b0101420 0x7fc5b019aad0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 --2- 172.21.15.52:0/2045534673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5b0100a80 0x7fc5b019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 >> 172.21.15.52:0/2045534673 conn(0x7fc5b00fc7a0 msgr2=0x7fc5b006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 shutdown_connections 2024-09-19T09:36:38.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:38.525+0000 7fc5b6265640 1 -- 172.21.15.52:0/2045534673 wait complete. 2024-09-19T09:36:38.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:38 smithi052 ceph-mon[30947]: pgmap v794: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-19T09:36:38.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:38 smithi169 ceph-mon[35454]: pgmap v794: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-19T09:36:39.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:38 smithi086 ceph-mon[34813]: pgmap v794: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-09-19T09:36:39.133 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:36:39.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:39.390 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:39.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 -- 172.21.15.52:0/2910317519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 msgr2=0x7fb1c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2910317519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c010ea90 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009ca0 tx=0x7fb1b802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 -- 172.21.15.52:0/2910317519 shutdown_connections 2024-09-19T09:36:39.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2910317519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c010ea90 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2910317519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 0x7fb1c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2910317519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 0x7fb1c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.870+0000 7fb1c819f640 1 -- 172.21.15.52:0/2910317519 >> 172.21.15.52:0/2910317519 conn(0x7fb1c00fd8c0 msgr2=0x7fb1c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 -- 172.21.15.52:0/2910317519 shutdown_connections 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 -- 172.21.15.52:0/2910317519 wait complete. 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 Processor -- start 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 -- start start 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 0x7fb1c01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 0x7fb1c0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.871+0000 7fb1c819f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c819f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111fc0 con 0x7fb1c0106f10 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c819f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0111e40 con 0x7fb1c0102790 2024-09-19T09:36:39.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c819f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c0112140 con 0x7fb1c0101de0 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34880/0 (socket says 172.21.15.52:34880) 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c5f3b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 0x7fb1c01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 -- 172.21.15.52:0/2410838365 learned_addr learned my addr 172.21.15.52:0/2410838365 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c573a640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 0x7fb1c0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 -- 172.21.15.52:0/2410838365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 msgr2=0x7fb1c01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 0x7fb1c01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 -- 172.21.15.52:0/2410838365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 msgr2=0x7fb1c0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 0x7fb1c0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 -- 172.21.15.52:0/2410838365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c019d380 con 0x7fb1c0106f10 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c673c640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8003f10 tx=0x7fb1b8003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8031710 con 0x7fb1c0106f10 2024-09-19T09:36:39.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1b80318b0 con 0x7fb1c0106f10 2024-09-19T09:36:39.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c019d610 con 0x7fb1c0106f10 2024-09-19T09:36:39.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b802fb90 con 0x7fb1c0106f10 2024-09-19T09:36:39.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.872+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c01a4f50 con 0x7fb1c0106f10 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.873+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c01021c0 con 0x7fb1c0106f10 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.875+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb1b8004040 con 0x7fb1c0106f10 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.875+0000 7fb1b6ffd640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.875+0000 7fb1c5f3b640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.875+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb1b80f0e70 con 0x7fb1c0106f10 2024-09-19T09:36:39.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.876+0000 7fb1c5f3b640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc005fd0 tx=0x7fb1bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:39.879+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1b80bdb10 con 0x7fb1c0106f10 2024-09-19T09:36:40.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.097+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1c010a1b0 con 0x7fb1c0106f10 2024-09-19T09:36:40.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.097+0000 7fb1b6ffd640 1 -- 172.21.15.52:0/2410838365 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fb1b80bd410 con 0x7fb1c0106f10 2024-09-19T09:36:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:36:40.100 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:36:40.100 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:36:40.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 msgr2=0x7fb1ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc005fd0 tx=0x7fb1bc00b390 comp rx=0 tx=0).stop 2024-09-19T09:36:40.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 msgr2=0x7fb1c019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8003f10 tx=0x7fb1b8003f40 comp rx=0 tx=0).stop 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 shutdown_connections 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1c0106f10 0x7fb1c019cca0 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1c0102790 0x7fb1c0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb1ac0a3240 0x7fb1ac0a5700 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.099+0000 7fb1c819f640 1 --2- 172.21.15.52:0/2410838365 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1c0101de0 0x7fb1c01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.100+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 >> 172.21.15.52:0/2410838365 conn(0x7fb1c00fd8c0 msgr2=0x7fb1c00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.100+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 shutdown_connections 2024-09-19T09:36:40.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:40.100+0000 7fb1c819f640 1 -- 172.21.15.52:0/2410838365 wait complete. 2024-09-19T09:36:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 -- 172.21.15.52:0/3946046852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48102610 msgr2=0x7f7f48108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 --2- 172.21.15.52:0/3946046852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48102610 0x7f7f48108ea0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f7f40009ca0 tx=0x7f7f4002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 -- 172.21.15.52:0/3946046852 shutdown_connections 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 --2- 172.21.15.52:0/3946046852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48102610 0x7f7f48108ea0 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 --2- 172.21.15.52:0/3946046852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48101c50 0x7f7f481020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 --2- 172.21.15.52:0/3946046852 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48100a60 0x7f7f48100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.669+0000 7f7f4d768640 1 -- 172.21.15.52:0/3946046852 >> 172.21.15.52:0/3946046852 conn(0x7f7f480fc1e0 msgr2=0x7f7f480fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- 172.21.15.52:0/3946046852 shutdown_connections 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- 172.21.15.52:0/3946046852 wait complete. 2024-09-19T09:36:40.673 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 Processor -- start 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- start start 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48101c50 0x7f7f4819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48102610 0x7f7f4819f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4810c6e0 con 0x7f7f48100a60 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4810c560 con 0x7f7f48102610 2024-09-19T09:36:40.675 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.670+0000 7f7f4d768640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4810c860 con 0x7f7f48101c50 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34896/0 (socket says 172.21.15.52:34896) 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 -- 172.21.15.52:0/4107001152 learned_addr learned my addr 172.21.15.52:0/4107001152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f477fe640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48102610 0x7f7f4819f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f467fc640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48101c50 0x7f7f4819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 -- 172.21.15.52:0/4107001152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48101c50 msgr2=0x7f7f4819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48101c50 0x7f7f4819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 -- 172.21.15.52:0/4107001152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48102610 msgr2=0x7f7f4819f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48102610 0x7f7f4819f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 -- 172.21.15.52:0/4107001152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4819f9c0 con 0x7f7f48100a60 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9c0 tx=0x7f7f3800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f2ffff640 1 -- 172.21.15.52:0/4107001152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800cd80 con 0x7f7f48100a60 2024-09-19T09:36:40.676 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f2ffff640 1 -- 172.21.15.52:0/4107001152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f380035f0 con 0x7f7f48100a60 2024-09-19T09:36:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4819fcb0 con 0x7f7f48100a60 2024-09-19T09:36:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f2ffff640 1 -- 172.21.15.52:0/4107001152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38010690 con 0x7f7f48100a60 2024-09-19T09:36:40.677 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.671+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f481a01b0 con 0x7f7f48100a60 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f2ffff640 1 -- 172.21.15.52:0/4107001152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f380037a0 con 0x7f7f48100a60 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 Processor -- start 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 -- start start 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557164002da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640032e0 0x557164007da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557163f662f0 con 0x557164008370 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557163f0e270 con 0x5571640029a0 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f505da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557163f622b0 con 0x5571640032e0 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34906/0 (socket says 172.21.15.52:34906) 2024-09-19T09:36:40.683 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.674+0000 7f7f467fc640 1 -- 172.21.15.52:0/1327642126 learned_addr learned my addr 172.21.15.52:0/1327642126 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f477fe640 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557164002da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640032e0 0x557164007da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f2ffff640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 0x7f7f300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 -- 172.21.15.52:0/1327642126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640032e0 msgr2=0x557164007da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640032e0 0x557164007da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 -- 172.21.15.52:0/1327642126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 msgr2=0x557164002da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557164002da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 -- 172.21.15.52:0/1327642126 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557163f0d340 con 0x557164008370 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f477fe640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 0x7f7f300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f2ffff640 1 -- 172.21.15.52:0/4107001152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f380cfd40 con 0x7f7f48100a60 2024-09-19T09:36:40.684 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f467fc640 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00bcb0 tx=0x7f7f3c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fffb50639b9fac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f2d7fa640 1 -- 172.21.15.52:0/1327642126 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c004030 con 0x557164008370 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f2d7fa640 1 -- 172.21.15.52:0/1327642126 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3c0041d0 con 0x557164008370 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.675+0000 7f7f2d7fa640 1 -- 172.21.15.52:0/1327642126 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0117a0 con 0x557164008370 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- 172.21.15.52:0/1327642126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 msgr2=0x55716400a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f477fe640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 0x7f7f300a57b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005e30 tx=0x7f7f400095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00bcb0 tx=0x7f7f3c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- 172.21.15.52:0/1327642126 shutdown_connections 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557164008370 0x55716400a830 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640032e0 0x557164007da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 --2- 172.21.15.52:0/1327642126 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557164002da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- 172.21.15.52:0/1327642126 >> 172.21.15.52:0/1327642126 conn(0x557163ffe010 msgr2=0x557163ffe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- 172.21.15.52:0/1327642126 shutdown_connections 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- 172.21.15.52:0/1327642126 wait complete. 2024-09-19T09:36:40.685 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 -- start start 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.676+0000 7f7f505da740 1 Processor -- start 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640029a0 0x55716400cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557164008370 0x557164014140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55716400b340 con 0x5571640032e0 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557163eef290 con 0x557164008370 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55716400b4c0 con 0x5571640029a0 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 10 client.0 _ll_register_callbacks cb 0x557163f20140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34916/0 (socket says 172.21.15.52:34916) 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 -- 172.21.15.52:0/3956302618 learned_addr learned my addr 172.21.15.52:0/3956302618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640029a0 0x55716400cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f477fe640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557164008370 0x557164014140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 -- 172.21.15.52:0/3956302618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640029a0 msgr2=0x55716400cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640029a0 0x55716400cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 -- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557164008370 msgr2=0x557164014140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557164008370 0x557164014140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 -- 172.21.15.52:0/3956302618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557163c79210 con 0x5571640032e0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f467fc640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b970 tx=0x7f7f3c00b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a347731ac3cc38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c02a060 con 0x5571640032e0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f3c0035f0 con 0x5571640032e0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.677+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3c0041d0 con 0x5571640032e0 2024-09-19T09:36:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f3c003810 con 0x5571640032e0 2024-09-19T09:36:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 10 client.20919 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:40.688 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557163d45620 con 0x5571640032e0 2024-09-19T09:36:40.688 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:40 smithi052 ceph-mon[30947]: pgmap v795: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-19T09:36:40.688 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:40 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:40.688 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:40 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2410838365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3c0041d0 con 0x5571640032e0 2024-09-19T09:36:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7f3c004920 con 0x5571640032e0 2024-09-19T09:36:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 10 client.20919 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 10 client.20919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:40.690 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 20 client.20919 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164018550 0x55716401a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 4 client.20919 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.678+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557163f73a20 con 0x557164018550 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.679+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164018550 0x55716401a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.679+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164018550 0x55716401a940 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd7949c7d5d481f3 server_cookie=f94dfa33f796c0e4 in_seq=0 out_seq=0 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.679+0000 7f7f2aff5640 10 client.20919 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.679+0000 7f7f2aff5640 1 -- 172.21.15.52:0/3956302618 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557163f73a20 con 0x557164018550 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f2aff5640 10 client.20919 handle_command_reply: tid=0 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 client.20919 shutdown 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 msgr2=0x55716400d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b970 tx=0x7f7f3c00b9a0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 shutdown_connections 2024-09-19T09:36:40.691 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164018550 0x55716401a940 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557164008370 0x557164014140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f2aff5640 0 client.20919 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x55716400d100 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 --2- 172.21.15.52:0/3956302618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5571640029a0 0x55716400cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 >> 172.21.15.52:0/3956302618 conn(0x557163ffe010 msgr2=0x557163fff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 shutdown_connections 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 1 -- 172.21.15.52:0/3956302618 wait complete. 2024-09-19T09:36:40.692 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.680+0000 7f7f505da740 20 client.20919 trim_cache size 0 max 16384 2024-09-19T09:36:40.701 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.694+0000 7f7f505da740 1 Processor -- start 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.694+0000 7f7f505da740 1 -- start start 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.694+0000 7f7f505da740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557163fff400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.694+0000 7f7f505da740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f505da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557163fff940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f505da740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481abb40 con 0x5571640032e0 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f505da740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481a9410 con 0x5571640029a0 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f505da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481a7220 con 0x557164008370 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34930/0 (socket says 172.21.15.52:34930) 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 -- 172.21.15.52:0/2856369916 learned_addr learned my addr 172.21.15.52:0/2856369916 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:40.702 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557163fff400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f477fe640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557163fff940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 -- 172.21.15.52:0/2856369916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 msgr2=0x557163fff940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557163fff940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 -- 172.21.15.52:0/2856369916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 msgr2=0x557163fff400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557163fff400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 -- 172.21.15.52:0/2856369916 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557163ffde30 con 0x5571640032e0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f477fe640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557163fff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f467fc640 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c010ca0 tx=0x7f7f3c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117be7e7757cd31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f2cff9640 1 -- 172.21.15.52:0/2856369916 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c003810 con 0x5571640032e0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f2cff9640 1 -- 172.21.15.52:0/2856369916 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3c0035f0 con 0x5571640032e0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.695+0000 7f7f2cff9640 1 -- 172.21.15.52:0/2856369916 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c004590 con 0x5571640032e0 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- 172.21.15.52:0/2856369916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 msgr2=0x557164014100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c010ca0 tx=0x7f7f3c00b480 comp rx=0 tx=0).stop 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- 172.21.15.52:0/2856369916 shutdown_connections 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557163fff940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164014100 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 --2- 172.21.15.52:0/2856369916 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x557163fff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- 172.21.15.52:0/2856369916 >> 172.21.15.52:0/2856369916 conn(0x557163ffe010 msgr2=0x557163ffd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- 172.21.15.52:0/2856369916 shutdown_connections 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- 172.21.15.52:0/2856369916 wait complete. 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 -- start start 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.696+0000 7f7f505da740 1 Processor -- start 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x5571640114f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557164012a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.704 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481a78d0 con 0x5571640032e0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481a8d40 con 0x5571640029a0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7f481a7fa0 con 0x557164008370 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 10 client.0 _ll_register_callbacks cb 0x7f7f40009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34946/0 (socket says 172.21.15.52:34946) 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 -- 172.21.15.52:0/758706333 learned_addr learned my addr 172.21.15.52:0/758706333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x5571640114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f477fe640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557164012a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.705 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 -- 172.21.15.52:0/758706333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 msgr2=0x557164012a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557164012a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 -- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 msgr2=0x5571640114f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x5571640114f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 -- 172.21.15.52:0/758706333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557164013050 con 0x5571640032e0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x5571640114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f467fc640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b3d0 tx=0x7f7f3c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff8cc778e8debbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f2aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c0037a0 con 0x5571640032e0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7f3c003940 con 0x5571640032e0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.697+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f3c0035f0 con 0x5571640032e0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f3c047020 con 0x5571640032e0 2024-09-19T09:36:40.706 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 10 client.20925 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557164014360 con 0x5571640032e0 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3c0035f0 con 0x5571640032e0 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7f3c037020 con 0x5571640032e0 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 10 client.20925 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 10 client.20925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 20 client.20925 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164083710 0x557164085b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 4 client.20925 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:36:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557163f6dd70 con 0x557164083710 2024-09-19T09:36:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164083710 0x557164085b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f2aff5640 10 client.20925 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.698+0000 7f7f46ffd640 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164083710 0x557164085b30 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9234034660b86764 server_cookie=22b2768c5a408f5b in_seq=0 out_seq=0 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f2aff5640 1 -- 172.21.15.52:0/758706333 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557163f6dd70 con 0x557164083710 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f2aff5640 10 client.20925 handle_command_reply: tid=0 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 client.20925 shutdown 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 msgr2=0x557164011a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00b3d0 tx=0x7f7f3c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 shutdown_connections 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557164083710 0x557164085b30 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557164008370 0x557164012a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5571640032e0 0x557164011a30 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f2aff5640 0 client.20925 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 --2- 172.21.15.52:0/758706333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5571640029a0 0x5571640114f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 >> 172.21.15.52:0/758706333 conn(0x557163ffe010 msgr2=0x557163ffd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 shutdown_connections 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 1 -- 172.21.15.52:0/758706333 wait complete. 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.707+0000 7f7f505da740 20 client.20925 trim_cache size 0 max 16384 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:36:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:36:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 msgr2=0x7f7f300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 0x7f7f300a57b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f40005e30 tx=0x7f7f400095c0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.712 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 msgr2=0x7f7f4806aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800e9c0 tx=0x7f7f3800ee80 comp rx=0 tx=0).stop 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 shutdown_connections 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f48102610 0x7f7f4819f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7f300a32f0 0x7f7f300a57b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7f48101c50 0x7f7f4819cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 --2- 172.21.15.52:0/4107001152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f48100a60 0x7f7f4806aeb0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 >> 172.21.15.52:0/4107001152 conn(0x7f7f480fc1e0 msgr2=0x7f7f48104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 shutdown_connections 2024-09-19T09:36:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:40.708+0000 7f7f4d768640 1 -- 172.21.15.52:0/4107001152 wait complete. 2024-09-19T09:36:40.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:36:40.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:40 smithi169 ceph-mon[35454]: pgmap v795: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-19T09:36:40.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:40 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:40.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:40 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2410838365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:41.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:40 smithi086 ceph-mon[34813]: pgmap v795: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.6 KiB/s wr, 8 op/s 2024-09-19T09:36:41.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:40 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:41.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:40 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2410838365' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:41.028 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:41.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 -- 172.21.15.52:0/1495746668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4102d40 msgr2=0x7f18f4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 --2- 172.21.15.52:0/1495746668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4102d40 0x7f18f4103120 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009900 tx=0x7f18e402a480 comp rx=0 tx=0).stop 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 -- 172.21.15.52:0/1495746668 shutdown_connections 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 --2- 172.21.15.52:0/1495746668 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f410c170 0x7f18f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 --2- 172.21.15.52:0/1495746668 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 --2- 172.21.15.52:0/1495746668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f4102d40 0x7f18f4103120 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 -- 172.21.15.52:0/1495746668 >> 172.21.15.52:0/1495746668 conn(0x7f18f40fc7a0 msgr2=0x7f18f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 -- 172.21.15.52:0/1495746668 shutdown_connections 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.522+0000 7f18fa173640 1 -- 172.21.15.52:0/1495746668 wait complete. 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.523+0000 7f18fa173640 1 Processor -- start 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.523+0000 7f18fa173640 1 -- start start 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.523+0000 7f18fa173640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f4102d40 0x7f18f41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.523+0000 7f18fa173640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.523+0000 7f18fa173640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18fa173640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4111f70 con 0x7f18f410c170 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18fa173640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4111df0 con 0x7f18f4103660 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18fa173640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41120f0 con 0x7f18f4102d40 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34960/0 (socket says 172.21.15.52:34960) 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 -- 172.21.15.52:0/1470229269 learned_addr learned my addr 172.21.15.52:0/1470229269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f37fe640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f4102d40 0x7f18f41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 -- 172.21.15.52:0/1470229269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f4102d40 msgr2=0x7f18f41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f4102d40 0x7f18f41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 -- 172.21.15.52:0/1470229269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 msgr2=0x7f18f4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 -- 172.21.15.52:0/1470229269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f419d480 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f3fff640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cad0 tx=0x7f18ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18f17fa640 1 -- 172.21.15.52:0/1470229269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00ae20 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.524+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f419d770 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.525+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41a5050 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.525+0000 7f18f17fa640 1 -- 172.21.15.52:0/1470229269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ec005020 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.525+0000 7f18f17fa640 1 -- 172.21.15.52:0/1470229269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00f6b0 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18f17fa640 1 -- 172.21.15.52:0/1470229269 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f18ec0051d0 con 0x7f18f410c170 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 Processor -- start 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 -- start start 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 0x562d765d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 0x562d765e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d7653e2f0 con 0x562d765e3370 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d764e5cf0 con 0x562d765d85d0 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18fc54c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562d7653a2b0 con 0x562d765d9b40 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 0x562d765e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 0x562d765e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34972/0 (socket says 172.21.15.52:34972) 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18eaffd640 1 -- 172.21.15.52:0/1679219376 learned_addr learned my addr 172.21.15.52:0/1679219376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.527+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 0x562d765d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f17fa640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 0x7f18e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 -- 172.21.15.52:0/1679219376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 msgr2=0x562d765d8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 0x562d765d8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 -- 172.21.15.52:0/1679219376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 msgr2=0x562d765e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 0x562d765e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 -- 172.21.15.52:0/1679219376 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d764ca3a0 con 0x562d765d85d0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f3fff640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 0x7f18e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 0x562d765d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f17fa640 1 -- 172.21.15.52:0/1470229269 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f18ec0cfbd0 con 0x7f18f410c170 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f37fe640 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765d8a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18e4005940 tx=0x7f18e40316e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf09418995409fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18f3fff640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 0x7f18e00a5700 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f18ec098bf0 tx=0x7f18ec06af60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18e9ffb640 1 -- 172.21.15.52:0/1679219376 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4040070 con 0x562d765d85d0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18e9ffb640 1 -- 172.21.15.52:0/1679219376 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e4005020 con 0x562d765d85d0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.528+0000 7f18e9ffb640 1 -- 172.21.15.52:0/1679219376 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4035040 con 0x562d765d85d0 2024-09-19T09:36:41.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- 172.21.15.52:0/1679219376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 msgr2=0x562d765d8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765d8a10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f18e4005940 tx=0x7f18e40316e0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- 172.21.15.52:0/1679219376 shutdown_connections 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765e3370 0x562d765e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765d8a10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1679219376 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765d9b40 0x562d765d8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- 172.21.15.52:0/1679219376 >> 172.21.15.52:0/1679219376 conn(0x562d765a1310 msgr2=0x562d765d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- 172.21.15.52:0/1679219376 shutdown_connections 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- 172.21.15.52:0/1679219376 wait complete. 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.529+0000 7f18fc54c740 1 -- start start 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 Processor -- start 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562d765e6010 con 0x562d765d85d0 2024-09-19T09:36:41.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562d764f9060 con 0x562d765d9b40 2024-09-19T09:36:41.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562d765e6190 con 0x562d765e3370 2024-09-19T09:36:41.573 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18fc54c740 10 client.0 _ll_register_callbacks cb 0x562d7624c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34988/0 (socket says 172.21.15.52:34988) 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 -- 172.21.15.52:0/702150068 learned_addr learned my addr 172.21.15.52:0/702150068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18f37fe640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 -- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 msgr2=0x562d765e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 -- 172.21.15.52:0/702150068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 msgr2=0x562d765dfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765dfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.530+0000 7f18eaffd640 1 -- 172.21.15.52:0/702150068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d762af3c0 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18eaffd640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f18dc011f60 tx=0x7f18dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f679428f4e68a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc010e40 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f18dc004020 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e4005020 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f18dc024020 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 10 client.20937 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d765f1ae0 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e4005020 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f18dc0035f0 con 0x562d765d85d0 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 10 client.20937 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:41.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 10 client.20937 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 20 client.20937 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d765f2ef0 0x562d765f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 4 client.20937 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.531+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d7654b860 con 0x562d765f2ef0 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.532+0000 7f18f37fe640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d765f2ef0 0x562d765f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.532+0000 7f18f37fe640 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d765f2ef0 0x562d765f52e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1cbfd500f973746e server_cookie=5d3df229a6d4e462 in_seq=0 out_seq=0 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.532+0000 7f18d2ffd640 10 client.20937 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18d2ffd640 1 -- 172.21.15.52:0/702150068 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562d7654b860 con 0x562d765f2ef0 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18d2ffd640 10 client.20937 handle_command_reply: tid=0 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 client.20937 shutdown 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 msgr2=0x562d765e2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f18dc011f60 tx=0x7f18dc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 shutdown_connections 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d765f2ef0 0x562d765f52e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765dfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18d2ffd640 0 client.20937 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 --2- 172.21.15.52:0/702150068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765e2d40 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 >> 172.21.15.52:0/702150068 conn(0x562d765a1310 msgr2=0x562d765da960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 shutdown_connections 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 1 -- 172.21.15.52:0/702150068 wait complete. 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.533+0000 7f18fc54c740 20 client.20937 trim_cache size 0 max 16384 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 Processor -- start 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 -- start start 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765db120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765db660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41b0170 con 0x562d765d85d0 2024-09-19T09:36:41.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41ada40 con 0x562d765d9b40 2024-09-19T09:36:41.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18fc54c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41ab890 con 0x562d765e3370 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18eaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34990/0 (socket says 172.21.15.52:34990) 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.546+0000 7f18eaffd640 1 -- 172.21.15.52:0/1775480547 learned_addr learned my addr 172.21.15.52:0/1775480547 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18f37fe640 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765db660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 -- 172.21.15.52:0/1775480547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 msgr2=0x562d765db660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765db660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 -- 172.21.15.52:0/1775480547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 msgr2=0x562d765db120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765db120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 -- 172.21.15.52:0/1775480547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d765f5940 con 0x562d765d85d0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18eaffd640 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f18dc000c00 tx=0x7f18dc005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20956407dd5f6563 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18e97fa640 1 -- 172.21.15.52:0/1775480547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc003be0 con 0x562d765d85d0 2024-09-19T09:36:41.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18e97fa640 1 -- 172.21.15.52:0/1775480547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18dc030070 con 0x562d765d85d0 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.547+0000 7f18e97fa640 1 -- 172.21.15.52:0/1775480547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc005280 con 0x562d765d85d0 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- 172.21.15.52:0/1775480547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 msgr2=0x562d765d3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f18dc000c00 tx=0x7f18dc005f70 comp rx=0 tx=0).stop 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- 172.21.15.52:0/1775480547 shutdown_connections 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765db660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d9b40 0x562d765db120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- 172.21.15.52:0/1775480547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d85d0 0x562d765d3bf0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- 172.21.15.52:0/1775480547 >> 172.21.15.52:0/1775480547 conn(0x562d765a1310 msgr2=0x562d765d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- 172.21.15.52:0/1775480547 shutdown_connections 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- 172.21.15.52:0/1775480547 wait complete. 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 -- start start 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 Processor -- start 2024-09-19T09:36:41.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.548+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765dda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41abf00 con 0x562d765d9b40 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41ad370 con 0x562d765d85d0 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f18f41ac5d0 con 0x562d765e3370 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 10 client.0 _ll_register_callbacks cb 0x7f18dc011040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34992/0 (socket says 172.21.15.52:34992) 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 -- 172.21.15.52:0/549193593 learned_addr learned my addr 172.21.15.52:0/549193593 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18eaffd640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18eaffd640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765dda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 -- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 msgr2=0x562d765dda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765dda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 -- 172.21.15.52:0/549193593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 msgr2=0x562d765dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765dcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 -- 172.21.15.52:0/549193593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d76660f50 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18eaffd640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18f37fe640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f18e4031bf0 tx=0x7f18e40047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ae398677cf2977 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4040040 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f18e4004230 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.549+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18dc030070 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f18e405e020 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 10 client.20943 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562d76662240 con 0x562d765d9b40 2024-09-19T09:36:41.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18dc030070 con 0x562d765d9b40 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f18e403c440 con 0x562d765d9b40 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 10 client.20943 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 10 client.20943 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 20 client.20943 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d76662580 0x562d766649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 4 client.20943 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d76545d70 con 0x562d76662580 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.550+0000 7f18eaffd640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d76662580 0x562d766649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18d2ffd640 10 client.20943 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18eaffd640 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d76662580 0x562d766649a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c889cdc97c26f6f0 server_cookie=4c2019646e47193c in_seq=0 out_seq=0 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18d2ffd640 1 -- 172.21.15.52:0/549193593 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d76545d70 con 0x562d76662580 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18d2ffd640 10 client.20943 handle_command_reply: tid=0 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 client.20943 shutdown 2024-09-19T09:36:41.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 msgr2=0x562d765dd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f18e4031bf0 tx=0x7f18e40047a0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 shutdown_connections 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x562d76662580 0x562d766649a0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562d765e3370 0x562d765dda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562d765d9b40 0x562d765dd4c0 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18d2ffd640 0 client.20943 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 --2- 172.21.15.52:0/549193593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562d765d85d0 0x562d765dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 >> 172.21.15.52:0/549193593 conn(0x562d765a1310 msgr2=0x562d765d3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 shutdown_connections 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 1 -- 172.21.15.52:0/549193593 wait complete. 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.551+0000 7f18fc54c740 20 client.20943 trim_cache size 0 max 16384 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 msgr2=0x7f18e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 0x7f18e00a5700 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f18ec098bf0 tx=0x7f18ec06af60 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 msgr2=0x7f18f419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cad0 tx=0x7f18ec00cf90 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 shutdown_connections 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18f410c170 0x7f18f419cda0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18f4103660 0x7f18f4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f18e00a3240 0x7f18e00a5700 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 --2- 172.21.15.52:0/1470229269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18f4102d40 0x7f18f41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 >> 172.21.15.52:0/1470229269 conn(0x7f18f40fc7a0 msgr2=0x7f18f40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 shutdown_connections 2024-09-19T09:36:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:41.552+0000 7f18fa173640 1 -- 172.21.15.52:0/1470229269 wait complete. 2024-09-19T09:36:41.930 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:41.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:41.931 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:41 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:36:41.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:41.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:41.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:41 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:36:42.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:42.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:42.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:41 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:36:42.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:36:42.622 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:43.017 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:42 smithi052 ceph-mon[30947]: pgmap v796: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 -- 172.21.15.52:0/3245648172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8103780 msgr2=0x7feca8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 --2- 172.21.15.52:0/3245648172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8103780 0x7feca8107bc0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fec90009930 tx=0x7fec9002a420 comp rx=0 tx=0).stop 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 -- 172.21.15.52:0/3245648172 shutdown_connections 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 --2- 172.21.15.52:0/3245648172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 0x7feca810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 --2- 172.21.15.52:0/3245648172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8103780 0x7feca8107bc0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 --2- 172.21.15.52:0/3245648172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8102dd0 0x7feca81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 -- 172.21.15.52:0/3245648172 >> 172.21.15.52:0/3245648172 conn(0x7feca80fc7d0 msgr2=0x7feca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 -- 172.21.15.52:0/3245648172 shutdown_connections 2024-09-19T09:36:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.099+0000 7fecad1d8640 1 -- 172.21.15.52:0/3245648172 wait complete. 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 Processor -- start 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 -- start start 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 0x7feca8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 0x7feca819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feca8112070 con 0x7feca8102dd0 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feca8111ef0 con 0x7feca8108300 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7fecad1d8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feca81121f0 con 0x7feca8103780 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7feca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7feca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35006/0 (socket says 172.21.15.52:35006) 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.100+0000 7feca6d9d640 1 -- 172.21.15.52:0/1007093929 learned_addr learned my addr 172.21.15.52:0/1007093929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca659c640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 0x7feca8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca759e640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 0x7feca819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 -- 172.21.15.52:0/1007093929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 msgr2=0x7feca8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 0x7feca8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 -- 172.21.15.52:0/1007093929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 msgr2=0x7feca819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 0x7feca819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 -- 172.21.15.52:0/1007093929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca819d5a0 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca659c640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 0x7feca8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7feca000d770 tx=0x7feca000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7fec9ffff640 1 -- 172.21.15.52:0/1007093929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0017070 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7fec9ffff640 1 -- 172.21.15.52:0/1007093929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca0005500 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca819d890 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7fec9ffff640 1 -- 172.21.15.52:0/1007093929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0004e00 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.101+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca81a5170 con 0x7feca8102dd0 2024-09-19T09:36:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fec9ffff640 1 -- 172.21.15.52:0/1007093929 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feca0004fa0 con 0x7feca8102dd0 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 Processor -- start 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 -- start start 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f2954b2f0 con 0x555f295e55d0 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555f294f2cf0 con 0x555f295e6b40 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f295472b0 con 0x555f295f0370 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7feca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7feca6d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35014/0 (socket says 172.21.15.52:35014) 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7feca6d9d640 1 -- 172.21.15.52:0/1237179023 learned_addr learned my addr 172.21.15.52:0/1237179023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.104+0000 7feca759e640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca659c640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 -- 172.21.15.52:0/1237179023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 msgr2=0x555f295f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 -- 172.21.15.52:0/1237179023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 msgr2=0x555f295e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 -- 172.21.15.52:0/1237179023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f294d73a0 con 0x555f295e55d0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca759e640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7fec9ffff640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 0x7fec940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7feca00d55e0 tx=0x7feca00d5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358109c2ff4c558c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7feca759e640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 0x7fec940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7fec9d7fa640 1 -- 172.21.15.52:0/1237179023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca00e2070 con 0x555f295e55d0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7fec9ffff640 1 -- 172.21.15.52:0/1007093929 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feca00cf470 con 0x7feca8102dd0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7fec9d7fa640 1 -- 172.21.15.52:0/1237179023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca00046c0 con 0x555f295e55d0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.105+0000 7fec9d7fa640 1 -- 172.21.15.52:0/1237179023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca009b370 con 0x555f295e55d0 2024-09-19T09:36:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7feca759e640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 0x7fec940a5700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fec98005fd0 tx=0x7fec98009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1237179023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 msgr2=0x555f295e5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7feca00d55e0 tx=0x7feca00d5aa0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1237179023 shutdown_connections 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e55d0 0x555f295e5a10 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1237179023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1237179023 >> 172.21.15.52:0/1237179023 conn(0x555f295ae310 msgr2=0x555f295e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1237179023 shutdown_connections 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.106+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1237179023 wait complete. 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 -- start start 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 Processor -- start 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295efda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295ed050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555f295f3070 con 0x555f295f0370 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555f29506060 con 0x555f295e6b40 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555f295f31f0 con 0x555f295e55d0 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7fecaf5b1740 10 client.0 _ll_register_callbacks cb 0x555f292598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35018/0 (socket says 172.21.15.52:35018) 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 -- 172.21.15.52:0/1569377193 learned_addr learned my addr 172.21.15.52:0/1569377193 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca659c640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 -- 172.21.15.52:0/1569377193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 msgr2=0x555f295efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 -- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 msgr2=0x555f295ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295ed050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.107+0000 7feca759e640 1 -- 172.21.15.52:0/1569377193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f292bc3c0 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7feca759e640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fec98010bf0 tx=0x7fec98004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729ce748ebb6f3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9802c060 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fec98017030 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f29558860 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fec9801fbc0 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fecaf5b1740 10 client.20955 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f295febb0 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555f29558860 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.108+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fec98027430 con 0x555f295f0370 2024-09-19T09:36:43.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 10 client.20955 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 10 client.20955 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 20 client.20955 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f29600070 0x555f29602460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 4 client.20955 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f29552d70 con 0x555f29600070 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f29600070 0x555f29602460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f29600070 0x555f29602460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1806041005d1b6eb server_cookie=8a3e67a3e5153ac1 in_seq=0 out_seq=0 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.109+0000 7fec8e7fc640 10 client.20955 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1569377193 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f29552d70 con 0x555f29600070 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fec8e7fc640 10 client.20955 handle_command_reply: tid=0 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 client.20955 shutdown 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 msgr2=0x555f295ed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fec98010bf0 tx=0x7fec98004ab0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 shutdown_connections 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f295ed7e0 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f29600070 0x555f29602460 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1569377193 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 >> 172.21.15.52:0/1569377193 conn(0x555f295ae310 msgr2=0x555f295e7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fec8e7fc640 0 client.20955 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 shutdown_connections 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1569377193 wait complete. 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.110+0000 7fecaf5b1740 20 client.20955 trim_cache size 0 max 16384 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.123+0000 7fecaf5b1740 1 Processor -- start 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.123+0000 7fecaf5b1740 1 -- start start 2024-09-19T09:36:43.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feca81b00f0 con 0x555f295f0370 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feca81ad9c0 con 0x555f295e6b40 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feca81ab810 con 0x555f295e55d0 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35028/0 (socket says 172.21.15.52:35028) 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 -- 172.21.15.52:0/2954231607 learned_addr learned my addr 172.21.15.52:0/2954231607 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca659c640 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca6d9d640 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 -- 172.21.15.52:0/2954231607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 msgr2=0x555f295e1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295e1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 -- 172.21.15.52:0/2954231607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 msgr2=0x555f295e6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 -- 172.21.15.52:0/2954231607 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f295e2960 con 0x555f295f0370 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7feca759e640 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fec9800a010 tx=0x7fec98010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6873ce5d77ebe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.124+0000 7fec9cff9640 1 -- 172.21.15.52:0/2954231607 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98027610 con 0x555f295f0370 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fec9cff9640 1 -- 172.21.15.52:0/2954231607 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec98028e50 con 0x555f295f0370 2024-09-19T09:36:43.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fec9cff9640 1 -- 172.21.15.52:0/2954231607 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9801c650 con 0x555f295f0370 2024-09-19T09:36:43.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 -- 172.21.15.52:0/2954231607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 msgr2=0x555f29607d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fec9800a010 tx=0x7fec98010430 comp rx=0 tx=0).stop 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 -- 172.21.15.52:0/2954231607 shutdown_connections 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295f0370 0x555f29607d30 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e6b40 0x555f295e6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/2954231607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295e55d0 0x555f295e1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 -- 172.21.15.52:0/2954231607 >> 172.21.15.52:0/2954231607 conn(0x555f295ae310 msgr2=0x555f295e1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 -- 172.21.15.52:0/2954231607 shutdown_connections 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.125+0000 7fecaf5b1740 1 -- 172.21.15.52:0/2954231607 wait complete. 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 -- start start 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 Processor -- start 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e55d0 0x555f295f8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feca81abe80 con 0x555f295e6b40 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feca81ad2f0 con 0x555f295e55d0 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feca81ac550 con 0x555f295f0370 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35034/0 (socket says 172.21.15.52:35034) 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 -- 172.21.15.52:0/1590211157 learned_addr learned my addr 172.21.15.52:0/1590211157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7fecaf5b1740 10 client.0 _ll_register_callbacks cb 0x7fec98009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e55d0 0x555f295f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca759e640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 -- 172.21.15.52:0/1590211157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 msgr2=0x555f295f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 -- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e55d0 msgr2=0x555f295f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:43.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e55d0 0x555f295f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.126+0000 7feca659c640 1 -- 172.21.15.52:0/1590211157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f295e8120 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7feca759e640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7feca659c640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fec90006010 tx=0x7fec90031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f299ab3f4310c9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90035040 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fec90004450 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec98028e50 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fec9004b020 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fecaf5b1740 10 client.20961 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f2966b100 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec98028e50 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fec90004b10 con 0x555f295e6b40 2024-09-19T09:36:43.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.127+0000 7fecaf5b1740 10 client.20961 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fecaf5b1740 10 client.20961 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fecaf5b1740 20 client.20961 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f2966b860 0x555f2966dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fecaf5b1740 4 client.20961 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f294cf170 con 0x555f2966b860 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f2966b860 0x555f2966dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7fec8e7fc640 10 client.20961 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.128+0000 7feca6d9d640 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f2966b860 0x555f2966dc80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a2e243b0de1fcbe server_cookie=6e7fb8b24c7074b0 in_seq=0 out_seq=0 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fec8e7fc640 1 -- 172.21.15.52:0/1590211157 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f294cf170 con 0x555f2966b860 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fec8e7fc640 10 client.20961 handle_command_reply: tid=0 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 client.20961 shutdown 2024-09-19T09:36:43.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 msgr2=0x555f295f89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fec90006010 tx=0x7fec90031920 comp rx=0 tx=0).stop 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 shutdown_connections 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555f295f0370 0x555f295f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555f295e6b40 0x555f295f89c0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x555f2966b860 0x555f2966dc80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 --2- 172.21.15.52:0/1590211157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555f295e55d0 0x555f295f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 >> 172.21.15.52:0/1590211157 conn(0x555f295ae310 msgr2=0x555f295e04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fec8e7fc640 0 client.20961 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 shutdown_connections 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 1 -- 172.21.15.52:0/1590211157 wait complete. 2024-09-19T09:36:43.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecaf5b1740 20 client.20961 trim_cache size 0 max 16384 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 msgr2=0x7fec940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 0x7fec940a5700 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fec98005fd0 tx=0x7fec98009500 comp rx=0 tx=0).stop 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 msgr2=0x7feca81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.129+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7feca000d770 tx=0x7feca000dc30 comp rx=0 tx=0).stop 2024-09-19T09:36:43.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 shutdown_connections 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feca8108300 0x7feca819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fec940a3240 0x7fec940a5700 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feca8103780 0x7feca8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 --2- 172.21.15.52:0/1007093929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feca8102dd0 0x7feca81985f0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 >> 172.21.15.52:0/1007093929 conn(0x7feca80fc7d0 msgr2=0x7feca8105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 shutdown_connections 2024-09-19T09:36:43.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:43.130+0000 7fecad1d8640 1 -- 172.21.15.52:0/1007093929 wait complete. 2024-09-19T09:36:43.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:42 smithi086 ceph-mon[34813]: pgmap v796: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:43.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:42 smithi169 ceph-mon[35454]: pgmap v796: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:44.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:36:44.266 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- 172.21.15.52:0/2447146174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678102570 msgr2=0x7f36781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 --2- 172.21.15.52:0/2447146174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678102570 0x7f36781029b0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f3668009900 tx=0x7f366802a480 comp rx=0 tx=0).stop 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- 172.21.15.52:0/2447146174 shutdown_connections 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 --2- 172.21.15.52:0/2447146174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 0x7f367810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 --2- 172.21.15.52:0/2447146174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678102570 0x7f36781029b0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 --2- 172.21.15.52:0/2447146174 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678100e20 0x7f3678101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- 172.21.15.52:0/2447146174 >> 172.21.15.52:0/2447146174 conn(0x7f36780fc7d0 msgr2=0x7f36780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- 172.21.15.52:0/2447146174 shutdown_connections 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- 172.21.15.52:0/2447146174 wait complete. 2024-09-19T09:36:44.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 Processor -- start 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.716+0000 7f367fea9640 1 -- start start 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678102570 0x7f3678198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 0x7f367819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3678110fa0 con 0x7f3678100e20 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3678110e20 con 0x7f3678102ef0 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367fea9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3678111120 con 0x7f3678102570 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35050/0 (socket says 172.21.15.52:35050) 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 -- 172.21.15.52:0/4288088652 learned_addr learned my addr 172.21.15.52:0/4288088652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:44.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367e446640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 0x7f367819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367d444640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678102570 0x7f3678198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 -- 172.21.15.52:0/4288088652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678102570 msgr2=0x7f3678198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678102570 0x7f3678198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 -- 172.21.15.52:0/4288088652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 msgr2=0x7f367819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 0x7f367819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 -- 172.21.15.52:0/4288088652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367819d4a0 con 0x7f3678100e20 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.717+0000 7f367dc45640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f367400c920 tx=0x7f367400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.718+0000 7f366effd640 1 -- 172.21.15.52:0/4288088652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674007c70 con 0x7f3678100e20 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.718+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367819d790 con 0x7f3678100e20 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.718+0000 7f366effd640 1 -- 172.21.15.52:0/4288088652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3674007e10 con 0x7f3678100e20 2024-09-19T09:36:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.718+0000 7f366effd640 1 -- 172.21.15.52:0/4288088652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674018890 con 0x7f3678100e20 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.718+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781a5070 con 0x7f3678100e20 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.720+0000 7f366effd640 1 -- 172.21.15.52:0/4288088652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3674018a70 con 0x7f3678100e20 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.720+0000 7f3682282740 1 Processor -- start 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.720+0000 7f3682282740 1 -- start start 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56051304f5d0 0x56051304fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513060b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560512fb52f0 con 0x560513050b40 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560512f5ccf0 con 0x56051305e780 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f3682282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560512fb12b0 con 0x56051304f5d0 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35056/0 (socket says 172.21.15.52:35056) 2024-09-19T09:36:44.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 -- 172.21.15.52:0/2794140503 learned_addr learned my addr 172.21.15.52:0/2794140503 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f366effd640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 0x7f36640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367d444640 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513060b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367dc45640 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56051304f5d0 0x56051304fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 0x7f36640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 -- 172.21.15.52:0/2794140503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56051304f5d0 msgr2=0x56051304fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56051304f5d0 0x56051304fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 -- 172.21.15.52:0/2794140503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 msgr2=0x560513060b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513060b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 -- 172.21.15.52:0/2794140503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560512f413a0 con 0x560513050b40 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f366effd640 1 -- 172.21.15.52:0/4288088652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36740cfb40 con 0x7f3678100e20 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.721+0000 7f367e446640 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f367000a990 tx=0x7f367000ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0c83a9f6ff63cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3663fff640 1 -- 172.21.15.52:0/2794140503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367001d030 con 0x560513050b40 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3663fff640 1 -- 172.21.15.52:0/2794140503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670015c60 con 0x560513050b40 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3663fff640 1 -- 172.21.15.52:0/2794140503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36700213c0 con 0x560513050b40 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 -- 172.21.15.52:0/2794140503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 msgr2=0x56051304f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f367e446640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 0x7f36640a5700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3670020000 tx=0x7f367001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f367000a990 tx=0x7f367000ae50 comp rx=0 tx=0).stop 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 -- 172.21.15.52:0/2794140503 shutdown_connections 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513060b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56051304f5d0 0x56051304fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 --2- 172.21.15.52:0/2794140503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560513050b40 0x56051304f090 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.722+0000 7f3682282740 1 -- 172.21.15.52:0/2794140503 >> 172.21.15.52:0/2794140503 conn(0x560513018310 msgr2=0x56051304bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.723+0000 7f3682282740 1 -- 172.21.15.52:0/2794140503 shutdown_connections 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.723+0000 7f3682282740 1 -- 172.21.15.52:0/2794140503 wait complete. 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.723+0000 7f3682282740 1 -- start start 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.723+0000 7f3682282740 1 Processor -- start 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x56051305ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560513061480 con 0x56051304f5d0 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560512f70060 con 0x56051305e780 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560513061600 con 0x560513050b40 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 10 client.0 _ll_register_callbacks cb 0x560512cc38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35066/0 (socket says 172.21.15.52:35066) 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 -- 172.21.15.52:0/1012439727 learned_addr learned my addr 172.21.15.52:0/1012439727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367e446640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x56051305ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367d444640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 -- 172.21.15.52:0/1012439727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 msgr2=0x56051305b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 -- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 msgr2=0x56051305ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x56051305ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 -- 172.21.15.52:0/1012439727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560512d263c0 con 0x56051304f5d0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f367dc45640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f367409bd30 tx=0x7f367409baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ee1d6065de3d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f36617fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740a0430 con 0x56051304f5d0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f3674018d60 con 0x56051304f5d0 2024-09-19T09:36:44.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3670015c60 con 0x56051304f5d0 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f36740a4cf0 con 0x56051304f5d0 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 10 client.20973 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.724+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56051306cfb0 con 0x56051304f5d0 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3670015c60 con 0x56051304f5d0 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f36740a4860 con 0x56051304f5d0 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 10 client.20973 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 10 client.20973 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 20 client.20973 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56051306e470 0x560513070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 4 client.20973 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560512fc2860 con 0x56051306e470 2024-09-19T09:36:44.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.725+0000 7f367d444640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56051306e470 0x560513070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.726+0000 7f36617fa640 10 client.20973 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.726+0000 7f367d444640 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56051306e470 0x560513070860 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f2fd66a9e8d2dfc server_cookie=9efdc6e9d228f49 in_seq=0 out_seq=0 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.726+0000 7f36617fa640 1 -- 172.21.15.52:0/1012439727 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560512fc2860 con 0x56051306e470 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.726+0000 7f36617fa640 10 client.20973 handle_command_reply: tid=0 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 client.20973 shutdown 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 msgr2=0x56051305e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f367409bd30 tx=0x7f367409baa0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 shutdown_connections 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56051306e470 0x560513070860 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x56051305ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f36617fa640 0 client.20973 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 --2- 172.21.15.52:0/1012439727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x56051305e190 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 >> 172.21.15.52:0/1012439727 conn(0x560513018310 msgr2=0x560513051960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 shutdown_connections 2024-09-19T09:36:44.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 1 -- 172.21.15.52:0/1012439727 wait complete. 2024-09-19T09:36:44.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.727+0000 7f3682282740 20 client.20973 trim_cache size 0 max 16384 2024-09-19T09:36:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 Processor -- start 2024-09-19T09:36:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 -- start start 2024-09-19T09:36:44.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 0x56051306a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36781ade80 con 0x56051305e780 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36781ab750 con 0x56051304f5d0 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f3682282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36781a95a0 con 0x560513050b40 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f367e446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.740+0000 7f367e446640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35078/0 (socket says 172.21.15.52:35078) 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 -- 172.21.15.52:0/1790248087 learned_addr learned my addr 172.21.15.52:0/1790248087 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367dc45640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 0x56051306a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367d444640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 -- 172.21.15.52:0/1790248087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 msgr2=0x56051305ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 -- 172.21.15.52:0/1790248087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 msgr2=0x56051306a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 0x56051306a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 -- 172.21.15.52:0/1790248087 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051305a3f0 con 0x56051305e780 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367dc45640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 0x56051306a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f367e446640 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f367000a990 tx=0x7f3670009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990641266f27f123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f36637fe640 1 -- 172.21.15.52:0/1790248087 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367001d050 con 0x56051305e780 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f36637fe640 1 -- 172.21.15.52:0/1790248087 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f367002f070 con 0x56051305e780 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.741+0000 7f36637fe640 1 -- 172.21.15.52:0/1790248087 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36700216a0 con 0x56051305e780 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- 172.21.15.52:0/1790248087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 msgr2=0x56051304abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f367000a990 tx=0x7f3670009650 comp rx=0 tx=0).stop 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- 172.21.15.52:0/1790248087 shutdown_connections 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051305e780 0x56051304abf0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x56051305ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 --2- 172.21.15.52:0/1790248087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051304f5d0 0x56051306a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- 172.21.15.52:0/1790248087 >> 172.21.15.52:0/1790248087 conn(0x560513018310 msgr2=0x56051304a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- 172.21.15.52:0/1790248087 shutdown_connections 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- 172.21.15.52:0/1790248087 wait complete. 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 -- start start 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.742+0000 7f3682282740 1 Processor -- start 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x560513062de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513063320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36781a9c10 con 0x56051304f5d0 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f36781ab080 con 0x56051305e780 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f36781aa2e0 con 0x560513050b40 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f3682282740 10 client.0 _ll_register_callbacks cb 0x7f367400fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35084/0 (socket says 172.21.15.52:35084) 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 -- 172.21.15.52:0/638746723 learned_addr learned my addr 172.21.15.52:0/638746723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367e446640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513063320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367d444640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x560513062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 -- 172.21.15.52:0/638746723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 msgr2=0x560513062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x560513062de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 -- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 msgr2=0x560513063320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:44.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513063320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 -- 172.21.15.52:0/638746723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605130d8300 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f367dc45640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f36740cff00 tx=0x7f36740b0230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f478b2266fac54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.743+0000 7f36617fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36740a0430 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f36740cd5e0 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f367002f070 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f367409b670 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 10 client.20979 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5605130d9600 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f367002f070 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f367409af40 con 0x56051304f5d0 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 10 client.20979 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:44.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 10 client.20979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 20 client.20979 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5605130d9d20 0x5605130dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 4 client.20979 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.744+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560512fbcd70 con 0x5605130d9d20 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f367d444640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5605130d9d20 0x5605130dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f367d444640 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5605130d9d20 0x5605130dc130 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a48f8f5f07e35b9 server_cookie=cf4795bc0c53e173 in_seq=0 out_seq=0 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f36617fa640 10 client.20979 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f36617fa640 1 -- 172.21.15.52:0/638746723 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560512fbcd70 con 0x5605130d9d20 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f36617fa640 10 client.20979 handle_command_reply: tid=0 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 client.20979 shutdown 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 msgr2=0x5605130628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f36740cff00 tx=0x7f36740b0230 comp rx=0 tx=0).stop 2024-09-19T09:36:44.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 shutdown_connections 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5605130d9d20 0x5605130dc130 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56051305e780 0x560513063320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f36617fa640 0 client.20979 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560513050b40 0x560513062de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 --2- 172.21.15.52:0/638746723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56051304f5d0 0x5605130628a0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 >> 172.21.15.52:0/638746723 conn(0x560513018310 msgr2=0x560513051110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.745+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 shutdown_connections 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f3682282740 1 -- 172.21.15.52:0/638746723 wait complete. 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f3682282740 20 client.20979 trim_cache size 0 max 16384 2024-09-19T09:36:44.757 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:44.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 msgr2=0x7f36640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 0x7f36640a5700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f3670020000 tx=0x7f367001e000 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 msgr2=0x7f36781984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f367400c920 tx=0x7f367400cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 shutdown_connections 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3678102ef0 0x7f367819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f36640a3240 0x7f36640a5700 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3678102570 0x7f3678198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 --2- 172.21.15.52:0/4288088652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3678100e20 0x7f36781984f0 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 >> 172.21.15.52:0/4288088652 conn(0x7f36780fc7d0 msgr2=0x7f367806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 shutdown_connections 2024-09-19T09:36:44.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:44.746+0000 7f367fea9640 1 -- 172.21.15.52:0/4288088652 wait complete. 2024-09-19T09:36:45.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:44 smithi086 ceph-mon[34813]: pgmap v797: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-09-19T09:36:45.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:44 smithi052 ceph-mon[30947]: pgmap v797: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-09-19T09:36:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:44 smithi169 ceph-mon[35454]: pgmap v797: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.9 KiB/s wr, 9 op/s 2024-09-19T09:36:46.469 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:36:46.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:36:46.750 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:47.039 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:46 smithi052 ceph-mon[30947]: pgmap v798: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:47.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:46 smithi086 ceph-mon[34813]: pgmap v798: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 -- 172.21.15.52:0/2317227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 msgr2=0x7f8d94110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/2317227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d94110910 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009ca0 tx=0x7f8d8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 -- 172.21.15.52:0/2317227952 shutdown_connections 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/2317227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d94110910 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/2317227952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94101440 0x7f8d9410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/2317227952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94100b20 0x7f8d94100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.238+0000 7f8d9aa10640 1 -- 172.21.15.52:0/2317227952 >> 172.21.15.52:0/2317227952 conn(0x7f8d940fc7d0 msgr2=0x7f8d940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.239+0000 7f8d9aa10640 1 -- 172.21.15.52:0/2317227952 shutdown_connections 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.239+0000 7f8d9aa10640 1 -- 172.21.15.52:0/2317227952 wait complete. 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.239+0000 7f8d9aa10640 1 Processor -- start 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.239+0000 7f8d9aa10640 1 -- start start 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100b20 0x7f8d941a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94101440 0x7f8d941a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941142f0 con 0x7f8d9410e500 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94114170 con 0x7f8d94100b20 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d9aa10640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94114470 con 0x7f8d94101440 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35110/0 (socket says 172.21.15.52:35110) 2024-09-19T09:36:47.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94101440 0x7f8d941a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 -- 172.21.15.52:0/3633161123 learned_addr learned my addr 172.21.15.52:0/3633161123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d93fff640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100b20 0x7f8d941a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 -- 172.21.15.52:0/3633161123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94101440 msgr2=0x7f8d941a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94101440 0x7f8d941a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 -- 172.21.15.52:0/3633161123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100b20 msgr2=0x7f8d941a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100b20 0x7f8d941a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 -- 172.21.15.52:0/3633161123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9419ae90 con 0x7f8d9410e500 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.240+0000 7f8d98fad640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0319f0 tx=0x7f8d8c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.241+0000 7f8d917fa640 1 -- 172.21.15.52:0/3633161123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c003b70 con 0x7f8d9410e500 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.241+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9419b120 con 0x7f8d9410e500 2024-09-19T09:36:47.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.241+0000 7f8d917fa640 1 -- 172.21.15.52:0/3633161123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d8c003d10 con 0x7f8d9410e500 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.241+0000 7f8d917fa640 1 -- 172.21.15.52:0/3633161123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c02fd60 con 0x7f8d9410e500 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.241+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d941a74f0 con 0x7f8d9410e500 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d917fa640 1 -- 172.21.15.52:0/3633161123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8d8c004050 con 0x7f8d9410e500 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d9cde9740 1 Processor -- start 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d9cde9740 1 -- start start 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e34f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e35480 0x555d70e3f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.244+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555d70d9a280 con 0x555d70e3fd40 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555d70d41b10 con 0x555d70e35480 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555d70d96240 con 0x555d70e34b60 2024-09-19T09:36:47.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d917fa640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 0x7f8d7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35118/0 (socket says 172.21.15.52:35118) 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 -- 172.21.15.52:0/2476727937 learned_addr learned my addr 172.21.15.52:0/2476727937 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d93fff640 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e35480 0x555d70e3f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e34f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d98fad640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 0x7f8d7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d917fa640 1 -- 172.21.15.52:0/3633161123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8d8c0f0b60 con 0x7f8d9410e500 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 -- 172.21.15.52:0/2476727937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 msgr2=0x555d70e34f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e34f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 -- 172.21.15.52:0/2476727937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e35480 msgr2=0x555d70e3f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e35480 0x555d70e3f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 -- 172.21.15.52:0/2476727937 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d70d4e1f0 con 0x555d70e3fd40 2024-09-19T09:36:47.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.245+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009330 tx=0x7f8d880094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ffe9ecb2ae5b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d7a7fc640 1 -- 172.21.15.52:0/2476727937 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88017e60 con 0x555d70e3fd40 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d98fad640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 0x7f8d7c0a5700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b9b00 tx=0x7f8d8c087be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d7a7fc640 1 -- 172.21.15.52:0/2476727937 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d8801d070 con 0x555d70e3fd40 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d7a7fc640 1 -- 172.21.15.52:0/2476727937 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88018980 con 0x555d70e3fd40 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2476727937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 msgr2=0x555d70e42130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009330 tx=0x7f8d880094d0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2476727937 shutdown_connections 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e42130 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e35480 0x555d70e3f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2476727937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e34f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2476727937 >> 172.21.15.52:0/2476727937 conn(0x555d70e310f0 msgr2=0x555d70e314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.246+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2476727937 shutdown_connections 2024-09-19T09:36:47.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.247+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2476727937 wait complete. 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.247+0000 7f8d9cde9740 1 -- start start 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.247+0000 7f8d9cde9740 1 Processor -- start 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e34b60 0x555d70e3cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x555d70e42910 con 0x555d70e3fd40 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x555d70d54f10 con 0x555d70e34b60 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x555d70e42a90 con 0x555d70e35480 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d9cde9740 10 client.0 _ll_register_callbacks cb 0x555d70d1da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35134/0 (socket says 172.21.15.52:35134) 2024-09-19T09:36:47.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 -- 172.21.15.52:0/2776037142 learned_addr learned my addr 172.21.15.52:0/2776037142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e34b60 0x555d70e3cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d93fff640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 -- 172.21.15.52:0/2776037142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 msgr2=0x555d70e3d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e3d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 -- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e34b60 msgr2=0x555d70e3cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e34b60 0x555d70e3cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 -- 172.21.15.52:0/2776037142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d70b0b6a0 con 0x555d70e3fd40 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d93fff640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d937fe640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009300 tx=0x7f8d88018560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45deb6e029f6cb04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.248+0000 7f8d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88027070 con 0x555d70e3fd40 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d8801d070 con 0x555d70e3fd40 2024-09-19T09:36:47.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8d88018700 con 0x555d70e3fd40 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d88017e60 con 0x555d70e3fd40 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d9cde9740 10 client.20991 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d70e4e540 con 0x555d70e3fd40 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.249+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d8801d070 con 0x555d70e3fd40 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d88023840 con 0x555d70e3fd40 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 10 client.20991 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 10 client.20991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 20 client.20991 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70e4f890 0x555d70e51c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 4 client.20991 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d70da77f0 con 0x555d70e4f890 2024-09-19T09:36:47.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d93fff640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70e4f890 0x555d70e51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d93fff640 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70e4f890 0x555d70e51c80 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe44f5a449a60601 server_cookie=4ac68d21379e01d6 in_seq=0 out_seq=0 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.250+0000 7f8d737fe640 10 client.20991 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d737fe640 1 -- 172.21.15.52:0/2776037142 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d70da77f0 con 0x555d70e4f890 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d737fe640 10 client.20991 handle_command_reply: tid=0 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 client.20991 shutdown 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 msgr2=0x555d70e3d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009300 tx=0x7f8d88018560 comp rx=0 tx=0).stop 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 shutdown_connections 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70e4f890 0x555d70e51c80 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e3fd40 0x555d70e3d690 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d737fe640 0 client.20991 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:47.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/2776037142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e34b60 0x555d70e3cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 >> 172.21.15.52:0/2776037142 conn(0x555d70e310f0 msgr2=0x555d70e36dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 shutdown_connections 2024-09-19T09:36:47.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 1 -- 172.21.15.52:0/2776037142 wait complete. 2024-09-19T09:36:47.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.251+0000 7f8d9cde9740 20 client.20991 trim_cache size 0 max 16384 2024-09-19T09:36:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 Processor -- start 2024-09-19T09:36:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 -- start start 2024-09-19T09:36:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e3cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941b2250 con 0x555d70e34b60 2024-09-19T09:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941afb20 con 0x555d70e3fd40 2024-09-19T09:36:47.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941ad970 con 0x555d70e35480 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35150/0 (socket says 172.21.15.52:35150) 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d937fe640 1 -- 172.21.15.52:0/1133473438 learned_addr learned my addr 172.21.15.52:0/1133473438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d937fe640 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e3cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.270+0000 7f8d93fff640 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 -- 172.21.15.52:0/1133473438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 msgr2=0x555d70e577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 -- 172.21.15.52:0/1133473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 msgr2=0x555d70e3cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e3cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 -- 172.21.15.52:0/1133473438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d70e3f4e0 con 0x555d70e34b60 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d937fe640 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006aa0 tx=0x7f8d880047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d9bc9cea774ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d79ffb640 1 -- 172.21.15.52:0/1133473438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88027050 con 0x555d70e34b60 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d79ffb640 1 -- 172.21.15.52:0/1133473438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d8801d040 con 0x555d70e34b60 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.271+0000 7f8d79ffb640 1 -- 172.21.15.52:0/1133473438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88035040 con 0x555d70e34b60 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- 172.21.15.52:0/1133473438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 msgr2=0x555d70e572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f8d88006aa0 tx=0x7f8d880047d0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- 172.21.15.52:0/1133473438 shutdown_connections 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e3cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e35480 0x555d70e577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/1133473438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e34b60 0x555d70e572a0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- 172.21.15.52:0/1133473438 >> 172.21.15.52:0/1133473438 conn(0x555d70e310f0 msgr2=0x555d70e3eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- 172.21.15.52:0/1133473438 shutdown_connections 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- 172.21.15.52:0/1133473438 wait complete. 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 -- start start 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.272+0000 7f8d9cde9740 1 Processor -- start 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e48560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e43f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941adfe0 con 0x555d70e35480 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941af450 con 0x555d70e3fd40 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8d941ae6b0 con 0x555d70e34b60 2024-09-19T09:36:47.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d9cde9740 10 client.0 _ll_register_callbacks cb 0x7f8d84004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35162/0 (socket says 172.21.15.52:35162) 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 -- 172.21.15.52:0/4113851321 learned_addr learned my addr 172.21.15.52:0/4113851321 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d937fe640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e43f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d937fe640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e48560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 -- 172.21.15.52:0/4113851321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 msgr2=0x555d70e48560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e48560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 -- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 msgr2=0x555d70e43f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e43f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 -- 172.21.15.52:0/4113851321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d70e44730 con 0x555d70e35480 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d937fe640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e43f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:47.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d93fff640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f8d84004650 tx=0x7f8d8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ee15f08e0f2dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.273+0000 7f8d737fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8401fcd0 con 0x555d70e35480 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f8d84005020 con 0x555d70e35480 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d8801d040 con 0x555d70e35480 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d84005220 con 0x555d70e35480 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 10 client.20997 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:47.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555d70eba440 con 0x555d70e35480 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d8801d040 con 0x555d70e35480 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d84024070 con 0x555d70e35480 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 10 client.20997 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 10 client.20997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 20 client.20997 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70ebabf0 0x555d70ebd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 4 client.20997 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555d70da1d00 con 0x555d70ebabf0 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.274+0000 7f8d937fe640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70ebabf0 0x555d70ebd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:47.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.275+0000 7f8d737fe640 10 client.20997 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.275+0000 7f8d937fe640 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70ebabf0 0x555d70ebd010 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63925803ab58e9e4 server_cookie=45a65d5ac3dd99b3 in_seq=0 out_seq=0 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d737fe640 1 -- 172.21.15.52:0/4113851321 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555d70da1d00 con 0x555d70ebabf0 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d737fe640 10 client.20997 handle_command_reply: tid=0 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 client.20997 shutdown 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 msgr2=0x555d70e43930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f8d84004650 tx=0x7f8d8400bd70 comp rx=0 tx=0).stop 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 shutdown_connections 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555d70ebabf0 0x555d70ebd010 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x555d70e3fd40 0x555d70e43f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d737fe640 0 client.20997 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:47.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x555d70e35480 0x555d70e43930 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 --2- 172.21.15.52:0/4113851321 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x555d70e34b60 0x555d70e48560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 >> 172.21.15.52:0/4113851321 conn(0x555d70e310f0 msgr2=0x555d70e3cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 shutdown_connections 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 1 -- 172.21.15.52:0/4113851321 wait complete. 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.276+0000 7f8d9cde9740 20 client.20997 trim_cache size 0 max 16384 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:36:47.284 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "455fe586-3968-45fd-ae42-f135f229c11a", 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 msgr2=0x7f8d7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 0x7f8d7c0a5700 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b9b00 tx=0x7f8d8c087be0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 msgr2=0x7f8d9419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0319f0 tx=0x7f8d8c031a20 comp rx=0 tx=0).stop 2024-09-19T09:36:47.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 shutdown_connections 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d9410e500 0x7f8d9419a660 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f8d7c0a3240 0x7f8d7c0a5700 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8d94101440 0x7f8d941a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 --2- 172.21.15.52:0/3633161123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100b20 0x7f8d941a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 >> 172.21.15.52:0/3633161123 conn(0x7f8d940fc7d0 msgr2=0x7f8d940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 shutdown_connections 2024-09-19T09:36:47.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:47.277+0000 7f8d9aa10640 1 -- 172.21.15.52:0/3633161123 wait complete. 2024-09-19T09:36:47.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:46 smithi169 ceph-mon[35454]: pgmap v798: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.4 KiB/s wr, 9 op/s 2024-09-19T09:36:48.080 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:47 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:36:48.080 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:47 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.080 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:47 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:36:48.080 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:47 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:36:48.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:47 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:36:48.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:47 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:47 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:36:48.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:47 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.368 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:47 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:36:48.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:47 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:47 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:36:48.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:47 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- 172.21.15.52:0/421031767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8102ef0 msgr2=0x7ff9e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 --2- 172.21.15.52:0/421031767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8102ef0 0x7ff9e810da40 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009ca0 tx=0x7ff9e002a950 comp rx=0 tx=0).stop 2024-09-19T09:36:48.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- 172.21.15.52:0/421031767 shutdown_connections 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 --2- 172.21.15.52:0/421031767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8102ef0 0x7ff9e810da40 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 --2- 172.21.15.52:0/421031767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102570 0x7ff9e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 --2- 172.21.15.52:0/421031767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100e20 0x7ff9e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- 172.21.15.52:0/421031767 >> 172.21.15.52:0/421031767 conn(0x7ff9e80fc7d0 msgr2=0x7ff9e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- 172.21.15.52:0/421031767 shutdown_connections 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- 172.21.15.52:0/421031767 wait complete. 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 Processor -- start 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.900+0000 7ff9ee716640 1 -- start start 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8102570 0x7ff9e80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 0x7ff9e80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8110f80 con 0x7ff9e8100e20 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8110e00 con 0x7ff9e8102570 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9ee716640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e8111100 con 0x7ff9e8102ef0 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33618/0 (socket says 172.21.15.52:33618) 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 -- 172.21.15.52:0/3939745320 learned_addr learned my addr 172.21.15.52:0/3939745320 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 0x7ff9e80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8102570 0x7ff9e80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 -- 172.21.15.52:0/3939745320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 msgr2=0x7ff9e80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 0x7ff9e80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 -- 172.21.15.52:0/3939745320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8102570 msgr2=0x7ff9e80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8102570 0x7ff9e80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9e7fff640 1 -- 172.21.15.52:0/3939745320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e81a69c0 con 0x7ff9e8100e20 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.901+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 0x7ff9e80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c890 tx=0x7ff9d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9e57fa640 1 -- 172.21.15.52:0/3939745320 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8004220 con 0x7ff9e8100e20 2024-09-19T09:36:48.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9e57fa640 1 -- 172.21.15.52:0/3939745320 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9d80043c0 con 0x7ff9e8100e20 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e81a6cb0 con 0x7ff9e8100e20 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9e57fa640 1 -- 172.21.15.52:0/3939745320 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80049e0 con 0x7ff9e8100e20 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.902+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e81a71a0 con 0x7ff9e8100e20 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.904+0000 7ff9e57fa640 1 -- 172.21.15.52:0/3939745320 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff9d80079b0 con 0x7ff9e8100e20 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.904+0000 7ff9f0aef740 1 Processor -- start 2024-09-19T09:36:48.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.904+0000 7ff9f0aef740 1 -- start start 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.904+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x55854984ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5585497a72e0 con 0x5585498414a0 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55854974ece0 con 0x558549841dc0 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5585497a32a0 con 0x55854984c680 2024-09-19T09:36:48.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33630/0 (socket says 172.21.15.52:33630) 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 -- 172.21.15.52:0/1880651508 learned_addr learned my addr 172.21.15.52:0/1880651508 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x55854984ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9e57fa640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 -- 172.21.15.52:0/1880651508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 msgr2=0x55854984ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x55854984ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 -- 172.21.15.52:0/1880651508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 msgr2=0x55854984c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 -- 172.21.15.52:0/1880651508 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558549733440 con 0x5585498414a0 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x55854984ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9e57fa640 1 -- 172.21.15.52:0/3939745320 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff9d80cfaa0 con 0x7ff9e8100e20 2024-09-19T09:36:48.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.905+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7ff9e002f9b0 tx=0x7ff9e002f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea77cb029386b8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9ce7fc640 1 -- 172.21.15.52:0/1880651508 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0041040 con 0x5585498414a0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9ce7fc640 1 -- 172.21.15.52:0/1880651508 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e002f3a0 con 0x5585498414a0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9ce7fc640 1 -- 172.21.15.52:0/1880651508 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0034040 con 0x5585498414a0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1880651508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 msgr2=0x558549841880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7ff9e002f9b0 tx=0x7ff9e002f9e0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 0x7ff9d00a5700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff9e004c000 tx=0x7ff9e004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1880651508 shutdown_connections 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x55854984ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1880651508 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x558549841880 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1880651508 >> 172.21.15.52:0/1880651508 conn(0x55854983da30 msgr2=0x55854983de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.906+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1880651508 shutdown_connections 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1880651508 wait complete. 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 -- start start 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 Processor -- start 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x5585498491d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x558549849710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55854984f250 con 0x5585498414a0 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x558549762050 con 0x558549841dc0 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55854984f3d0 con 0x55854984c680 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9f0aef740 10 client.0 _ll_register_callbacks cb 0x5585497a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33642/0 (socket says 172.21.15.52:33642) 2024-09-19T09:36:48.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.907+0000 7ff9e7fff640 1 -- 172.21.15.52:0/1752445280 learned_addr learned my addr 172.21.15.52:0/1752445280 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:48.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x558549849710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x5585498491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 -- 172.21.15.52:0/1752445280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 msgr2=0x558549849710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x558549849710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 -- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 msgr2=0x5585498491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x5585498491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 -- 172.21.15.52:0/1752445280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585495183c0 con 0x5585498414a0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x5585498491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80cd890 tx=0x7ff9d809bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ba0fc69ddee0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80bc0b0 con 0x5585498414a0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff9d8007ca0 con 0x5585498414a0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585497b4850 con 0x5585498414a0 2024-09-19T09:36:48.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9d809c740 con 0x5585498414a0 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9f0aef740 10 client.21009 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55854985ac30 con 0x5585498414a0 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.908+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5585497b4850 con 0x5585498414a0 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff9d80a4820 con 0x5585498414a0 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 10 client.21009 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 10 client.21009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 20 client.21009 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55854985c040 0x55854985e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 4 client.21009 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:48.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585497aed60 con 0x55854985c040 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55854985c040 0x55854985e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55854985c040 0x55854985e490 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf89c23cfc3ac201 server_cookie=b27f814fd80a1569 in_seq=0 out_seq=0 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.909+0000 7ff9c77fe640 10 client.21009 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9c77fe640 1 -- 172.21.15.52:0/1752445280 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585497aed60 con 0x55854985c040 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9c77fe640 10 client.21009 handle_command_reply: tid=0 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 client.21009 shutdown 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 msgr2=0x55854984bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80cd890 tx=0x7ff9d809bec0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 shutdown_connections 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55854985c040 0x55854985e490 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55854984c680 0x558549849710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x5585498491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/1752445280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5585498414a0 0x55854984bf20 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.910+0000 7ff9c77fe640 0 client.21009 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:48.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.911+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 >> 172.21.15.52:0/1752445280 conn(0x55854983da30 msgr2=0x558549843760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.911+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 shutdown_connections 2024-09-19T09:36:48.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.911+0000 7ff9f0aef740 1 -- 172.21.15.52:0/1752445280 wait complete. 2024-09-19T09:36:48.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.911+0000 7ff9f0aef740 20 client.21009 trim_cache size 0 max 16384 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.928+0000 7ff9f0aef740 1 Processor -- start 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.928+0000 7ff9f0aef740 1 -- start start 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x558549858510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81b2330 con 0x55854984c680 2024-09-19T09:36:48.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81afc00 con 0x558549841dc0 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81ada50 con 0x5585498414a0 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33656/0 (socket says 172.21.15.52:33656) 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 -- 172.21.15.52:0/2387801403 learned_addr learned my addr 172.21.15.52:0/2387801403 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x558549858510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 -- 172.21.15.52:0/2387801403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 msgr2=0x558549858510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x558549858510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 -- 172.21.15.52:0/2387801403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 msgr2=0x55854984b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 -- 172.21.15.52:0/2387801403 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55854983d1e0 con 0x55854984c680 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x558549858510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0039560 tx=0x7ff9e00394f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a87498325bb5071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9cdffb640 1 -- 172.21.15.52:0/2387801403 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0060070 con 0x55854984c680 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9cdffb640 1 -- 172.21.15.52:0/2387801403 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e0009540 con 0x55854984c680 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.929+0000 7ff9cdffb640 1 -- 172.21.15.52:0/2387801403 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0041050 con 0x55854984c680 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- 172.21.15.52:0/2387801403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 msgr2=0x55854984b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0039560 tx=0x7ff9e00394f0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- 172.21.15.52:0/2387801403 shutdown_connections 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854984c680 0x55854984b680 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x558549841dc0 0x55854984b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/2387801403 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x558549858510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- 172.21.15.52:0/2387801403 >> 172.21.15.52:0/2387801403 conn(0x55854983da30 msgr2=0x55854984aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- 172.21.15.52:0/2387801403 shutdown_connections 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- 172.21.15.52:0/2387801403 wait complete. 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.930+0000 7ff9f0aef740 1 -- start start 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 Processor -- start 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x5585498528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55854984c680 0x5585498c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81ae0c0 con 0x558549841dc0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81af530 con 0x55854984c680 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e81ae790 con 0x5585498414a0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9f0aef740 10 client.0 _ll_register_callbacks cb 0x7ff9d8004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33666/0 (socket says 172.21.15.52:33666) 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9e77fe640 1 -- 172.21.15.52:0/787933316 learned_addr learned my addr 172.21.15.52:0/787933316 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x5585498528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.931+0000 7ff9eccb3640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55854984c680 0x5585498c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 -- 172.21.15.52:0/787933316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 msgr2=0x5585498528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x5585498528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 -- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55854984c680 msgr2=0x5585498c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:48.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55854984c680 0x5585498c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 -- 172.21.15.52:0/787933316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585498c6280 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9e77fe640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x558549848a60 tx=0x7ff9dc014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb7e3809a943e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0142d0 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff9dc012450 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0009540 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc012650 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9f0aef740 10 client.21015 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5585498c7470 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.932+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e0009540 con 0x558549841dc0 2024-09-19T09:36:48.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff9dc022070 con 0x558549841dc0 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 10 client.21015 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 10 client.21015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 20 client.21015 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5585498c7c20 0x5585498ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 4 client.21015 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55854972b210 con 0x5585498c7c20 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5585498c7c20 0x5585498ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9e7fff640 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5585498c7c20 0x5585498ca040 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9f4923147b6d72 server_cookie=b2e4d4834ee77d34 in_seq=0 out_seq=0 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9c77fe640 10 client.21015 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9c77fe640 1 -- 172.21.15.52:0/787933316 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55854972b210 con 0x5585498c7c20 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9c77fe640 10 client.21015 handle_command_reply: tid=0 2024-09-19T09:36:48.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.933+0000 7ff9f0aef740 1 client.21015 shutdown 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 msgr2=0x558549852e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x558549848a60 tx=0x7ff9dc014840 comp rx=0 tx=0).stop 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 shutdown_connections 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5585498c7c20 0x5585498ca040 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55854984c680 0x5585498c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558549841dc0 0x558549852e20 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 --2- 172.21.15.52:0/787933316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5585498414a0 0x5585498528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9c77fe640 0 client.21015 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 >> 172.21.15.52:0/787933316 conn(0x55854983da30 msgr2=0x55854984b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 shutdown_connections 2024-09-19T09:36:48.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 1 -- 172.21.15.52:0/787933316 wait complete. 2024-09-19T09:36:48.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9f0aef740 20 client.21015 trim_cache size 0 max 16384 2024-09-19T09:36:48.954 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:48.954 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:36:48.954 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:36:48.954 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 msgr2=0x7ff9d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 0x7ff9d00a5700 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff9e004c000 tx=0x7ff9e004d000 comp rx=0 tx=0).stop 2024-09-19T09:36:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 msgr2=0x7ff9e80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.934+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800c890 tx=0x7ff9d800cd50 comp rx=0 tx=0).stop 2024-09-19T09:36:48.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 shutdown_connections 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9e8102ef0 0x7ff9e80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8102570 0x7ff9e80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 --2- 172.21.15.52:0/3939745320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9e8100e20 0x7ff9e80fcc80 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 >> 172.21.15.52:0/3939745320 conn(0x7ff9e80fc7d0 msgr2=0x7ff9e806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 shutdown_connections 2024-09-19T09:36:48.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:48.935+0000 7ff9ee716640 1 -- 172.21.15.52:0/3939745320 wait complete. 2024-09-19T09:36:49.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:48 smithi052 ceph-mon[30947]: pgmap v799: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:36:49.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:48 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:36:49.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:48 smithi086 ceph-mon[34813]: pgmap v799: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:36:49.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:48 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:36:49.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:48 smithi169 ceph-mon[35454]: pgmap v799: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-09-19T09:36:49.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:48 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:36:49.695 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:36:49.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:49.954 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/3601783272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0102790 msgr2=0x7ff0f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/3601783272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0102790 0x7ff0f01067e0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009900 tx=0x7ff0e402a410 comp rx=0 tx=0).stop 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/3601783272 shutdown_connections 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/3601783272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0106f10 0x7ff0f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/3601783272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0102790 0x7ff0f01067e0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/3601783272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0101de0 0x7ff0f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/3601783272 >> 172.21.15.52:0/3601783272 conn(0x7ff0f00fd8c0 msgr2=0x7ff0f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/3601783272 shutdown_connections 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.414+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/3601783272 wait complete. 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 Processor -- start 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 -- start start 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 0x7ff0f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0106f10 0x7ff0f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0111f70 con 0x7ff0f0101de0 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0111df0 con 0x7ff0f0102790 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0f4ebb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01120f0 con 0x7ff0f0106f10 2024-09-19T09:36:50.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33688/0 (socket says 172.21.15.52:33688) 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 -- 172.21.15.52:0/1489966497 learned_addr learned my addr 172.21.15.52:0/1489966497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0eed9d640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0106f10 0x7ff0f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0edd9b640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 0x7ff0f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 -- 172.21.15.52:0/1489966497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0106f10 msgr2=0x7ff0f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0106f10 0x7ff0f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 -- 172.21.15.52:0/1489966497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 msgr2=0x7ff0f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 0x7ff0f0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0ee59c640 1 -- 172.21.15.52:0/1489966497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f01a69d0 con 0x7ff0f0101de0 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.415+0000 7ff0edd9b640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 0x7ff0f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0ee59c640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d770 tx=0x7ff0e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0017070 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f01a6cc0 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0e0005500 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0004e00 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.416+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f01a71b0 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.417+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f01021c0 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.418+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0e0004fa0 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.419+0000 7ff0df7fe640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 0x7ff0d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.419+0000 7ff0edd9b640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 0x7ff0d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.419+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff0e00cf470 con 0x7ff0f0101de0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.419+0000 7ff0edd9b640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 0x7ff0d80a5700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0075f80 tx=0x7ff0e4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.423+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0e009c0b0 con 0x7ff0f0101de0 2024-09-19T09:36:50.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.634+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0f010a150 con 0x7ff0f0101de0 2024-09-19T09:36:50.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.634+0000 7ff0df7fe640 1 -- 172.21.15.52:0/1489966497 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ff0e009b9b0 con 0x7ff0f0101de0 2024-09-19T09:36:50.637 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:36:50.637 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:36:50.637 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 msgr2=0x7ff0d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 0x7ff0d80a5700 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0075f80 tx=0x7ff0e4005a20 comp rx=0 tx=0).stop 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 msgr2=0x7ff0f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d770 tx=0x7ff0e000dc30 comp rx=0 tx=0).stop 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 shutdown_connections 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff0d80a3240 0x7ff0d80a5700 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff0f0106f10 0x7ff0f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0f0102790 0x7ff0f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 --2- 172.21.15.52:0/1489966497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f0101de0 0x7ff0f00744f0 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 >> 172.21.15.52:0/1489966497 conn(0x7ff0f00fd8c0 msgr2=0x7ff0f00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 shutdown_connections 2024-09-19T09:36:50.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:50.637+0000 7ff0f4ebb640 1 -- 172.21.15.52:0/1489966497 wait complete. 2024-09-19T09:36:51.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:50 smithi169 ceph-mon[35454]: pgmap v800: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:36:51.245 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:50 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1489966497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:50 smithi086 ceph-mon[34813]: pgmap v800: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:36:51.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:50 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1489966497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:51.322 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:50 smithi052 ceph-mon[30947]: pgmap v800: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 9 op/s 2024-09-19T09:36:51.322 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:50 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1489966497' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:51.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:36:51.614 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:52.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 -- 172.21.15.52:0/1761564892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038101420 msgr2=0x7f703810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 --2- 172.21.15.52:0/1761564892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038101420 0x7f703810d950 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f7030009cd0 tx=0x7f703002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 -- 172.21.15.52:0/1761564892 shutdown_connections 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 --2- 172.21.15.52:0/1761564892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038101420 0x7f703810d950 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 --2- 172.21.15.52:0/1761564892 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7038100a80 0x7f7038100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 --2- 172.21.15.52:0/1761564892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7038106a80 0x7f7038106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 -- 172.21.15.52:0/1761564892 >> 172.21.15.52:0/1761564892 conn(0x7f70380fc7a0 msgr2=0x7f70380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 -- 172.21.15.52:0/1761564892 shutdown_connections 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.124+0000 7f703e4f1640 1 -- 172.21.15.52:0/1761564892 wait complete. 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 Processor -- start 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 -- start start 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7038101420 0x7f70381a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7038106a80 0x7f703819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7038110f20 con 0x7f7038100a80 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7038110da0 con 0x7f7038106a80 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f703e4f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70381110a0 con 0x7f7038101420 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33700/0 (socket says 172.21.15.52:33700) 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 -- 172.21.15.52:0/3168527017 learned_addr learned my addr 172.21.15.52:0/3168527017 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 -- 172.21.15.52:0/3168527017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7038101420 msgr2=0x7f70381a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7038101420 0x7f70381a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 -- 172.21.15.52:0/3168527017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7038106a80 msgr2=0x7f703819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7038106a80 0x7f703819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 -- 172.21.15.52:0/3168527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703819ace0 con 0x7f7038100a80 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.125+0000 7f7037fff640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f702800b4a0 tx=0x7f702800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.126+0000 7f7035ffb640 1 -- 172.21.15.52:0/3168527017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028014070 con 0x7f7038100a80 2024-09-19T09:36:52.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.126+0000 7f7035ffb640 1 -- 172.21.15.52:0/3168527017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7028010af0 con 0x7f7038100a80 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.126+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703819afd0 con 0x7f7038100a80 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.126+0000 7f7035ffb640 1 -- 172.21.15.52:0/3168527017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028017d10 con 0x7f7038100a80 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.126+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a72c0 con 0x7f7038100a80 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.128+0000 7f7035ffb640 1 -- 172.21.15.52:0/3168527017 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7028017070 con 0x7f7038100a80 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.128+0000 7f70408ca740 1 Processor -- start 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.128+0000 7f70408ca740 1 -- start start 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.128+0000 7f70408ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f70408ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f70408ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2ec370 0x563d6d2ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f70408ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563d6d2472f0 con 0x563d6d2e2b40 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f70408ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563d6d1eecf0 con 0x563d6d2ec370 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f70408ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563d6d2432b0 con 0x563d6d2e15d0 2024-09-19T09:36:52.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33712/0 (socket says 172.21.15.52:33712) 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 -- 172.21.15.52:0/143984884 learned_addr learned my addr 172.21.15.52:0/143984884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f7037fff640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f7035ffb640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 0x7f70240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f702ffff640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2ec370 0x563d6d2ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 -- 172.21.15.52:0/143984884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 msgr2=0x563d6d2e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 -- 172.21.15.52:0/143984884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2ec370 msgr2=0x563d6d2ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2ec370 0x563d6d2ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 -- 172.21.15.52:0/143984884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6d1d33a0 con 0x563d6d2e2b40 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f7037fff640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:52.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f7035ffb640 1 -- 172.21.15.52:0/3168527017 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f70280ced90 con 0x7f7038100a80 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 0x7f70240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.129+0000 7f703ca8e640 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f7030031500 tx=0x7f7030031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c59f56cdad5f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f702e7fc640 1 -- 172.21.15.52:0/143984884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703004d070 con 0x563d6d2e2b40 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f702e7fc640 1 -- 172.21.15.52:0/143984884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7030043070 con 0x563d6d2e2b40 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f702e7fc640 1 -- 172.21.15.52:0/143984884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030030d50 con 0x563d6d2e2b40 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 -- 172.21.15.52:0/143984884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 msgr2=0x563d6d2e1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f703ca8e640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 0x7f70240a5780 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7030009df0 tx=0x7f703004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f7030031500 tx=0x7f7030031530 comp rx=0 tx=0).stop 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 -- 172.21.15.52:0/143984884 shutdown_connections 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2ec370 0x563d6d2ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 --2- 172.21.15.52:0/143984884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2e1090 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 -- 172.21.15.52:0/143984884 >> 172.21.15.52:0/143984884 conn(0x563d6d2aa310 msgr2=0x563d6d2ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 -- 172.21.15.52:0/143984884 shutdown_connections 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.130+0000 7f70408ca740 1 -- 172.21.15.52:0/143984884 wait complete. 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 -- start start 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 Processor -- start 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2ebd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e2b40 0x563d6d2e9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563d6d2ef070 con 0x563d6d2ec370 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563d6d202060 con 0x563d6d2e15d0 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563d6d2ef1f0 con 0x563d6d2e2b40 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f70408ca740 10 client.0 _ll_register_callbacks cb 0x563d6cf558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33728/0 (socket says 172.21.15.52:33728) 2024-09-19T09:36:52.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.131+0000 7f703ca8e640 1 -- 172.21.15.52:0/1810683687 learned_addr learned my addr 172.21.15.52:0/1810683687 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f7037fff640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2ebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f702ffff640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e2b40 0x563d6d2e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 -- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e2b40 msgr2=0x563d6d2e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e2b40 0x563d6d2e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 -- 172.21.15.52:0/1810683687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 msgr2=0x563d6d2ebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2ebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 -- 172.21.15.52:0/1810683687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6cfb83c0 con 0x563d6d2ec370 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f703ca8e640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f70300309f0 tx=0x7f7030003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836c8053830a24fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70177fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030059020 con 0x563d6d2ec370 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7030051470 con 0x563d6d2ec370 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7030043070 con 0x563d6d2ec370 2024-09-19T09:36:52.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7030064050 con 0x563d6d2ec370 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70408ca740 10 client.21033 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.132+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563d6d2fab70 con 0x563d6d2ec370 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7030043070 con 0x563d6d2ec370 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7030030070 con 0x563d6d2ec370 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 10 client.21033 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 10 client.21033 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 20 client.21033 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d2fbec0 0x563d6d2fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 4 client.21033 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6d254860 con 0x563d6d2fbec0 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f7037fff640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d2fbec0 0x563d6d2fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.133+0000 7f7037fff640 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d2fbec0 0x563d6d2fe2b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33f895e33a8f76df server_cookie=aa11359af76a8b71 in_seq=0 out_seq=0 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70177fe640 10 client.21033 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:52.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70177fe640 1 -- 172.21.15.52:0/1810683687 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d6d254860 con 0x563d6d2fbec0 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70177fe640 10 client.21033 handle_command_reply: tid=0 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 client.21033 shutdown 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 msgr2=0x563d6d2e9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f70300309f0 tx=0x7f7030003f30 comp rx=0 tx=0).stop 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 shutdown_connections 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d2fbec0 0x563d6d2fe2b0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d2e9640 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e2b40 0x563d6d2e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70177fe640 0 client.21033 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 --2- 172.21.15.52:0/1810683687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2ebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.134+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 >> 172.21.15.52:0/1810683687 conn(0x563d6d2aa310 msgr2=0x563d6d2e3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.135+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 shutdown_connections 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.135+0000 7f70408ca740 1 -- 172.21.15.52:0/1810683687 wait complete. 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.135+0000 7f70408ca740 20 client.21033 trim_cache size 0 max 16384 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.147+0000 7f70408ca740 1 Processor -- start 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 -- start start 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2ec370 0x563d6d303880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b2490 con 0x563d6d2e2b40 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70381afd60 con 0x563d6d2e15d0 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f70408ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70381adbb0 con 0x563d6d2ec370 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33730/0 (socket says 172.21.15.52:33730) 2024-09-19T09:36:52.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 -- 172.21.15.52:0/1470460293 learned_addr learned my addr 172.21.15.52:0/1470460293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f703ca8e640 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2ec370 0x563d6d303880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f7037fff640 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 -- 172.21.15.52:0/1470460293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2ec370 msgr2=0x563d6d303880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2ec370 0x563d6d303880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 -- 172.21.15.52:0/1470460293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 msgr2=0x563d6d2dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.148+0000 7f702ffff640 1 -- 172.21.15.52:0/1470460293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6d2dd4f0 con 0x563d6d2e2b40 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f702ffff640 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f703819b6f0 tx=0x7f702000bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834adceac2b22d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f702dffb640 1 -- 172.21.15.52:0/1470460293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702001a020 con 0x563d6d2e2b40 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f702dffb640 1 -- 172.21.15.52:0/1470460293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7020010be0 con 0x563d6d2e2b40 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f702dffb640 1 -- 172.21.15.52:0/1470460293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020016df0 con 0x563d6d2e2b40 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 -- 172.21.15.52:0/1470460293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 msgr2=0x563d6d2f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f703819b6f0 tx=0x7f702000bad0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 -- 172.21.15.52:0/1470460293 shutdown_connections 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2ec370 0x563d6d303880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2e2b40 0x563d6d2f8340 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 --2- 172.21.15.52:0/1470460293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e15d0 0x563d6d2dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 -- 172.21.15.52:0/1470460293 >> 172.21.15.52:0/1470460293 conn(0x563d6d2aa310 msgr2=0x563d6d2dd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 -- 172.21.15.52:0/1470460293 shutdown_connections 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.149+0000 7f70408ca740 1 -- 172.21.15.52:0/1470460293 wait complete. 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 -- start start 2024-09-19T09:36:52.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 Processor -- start 2024-09-19T09:36:52.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e2b40 0x563d6d2f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70381ae220 con 0x563d6d2ec370 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f70381af690 con 0x563d6d2e2b40 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f70381ae8f0 con 0x563d6d2e15d0 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.150+0000 7f70408ca740 10 client.0 _ll_register_callbacks cb 0x7f703004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33740/0 (socket says 172.21.15.52:33740) 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 -- 172.21.15.52:0/2481652335 learned_addr learned my addr 172.21.15.52:0/2481652335 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f7037fff640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f702ffff640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e2b40 0x563d6d2f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 -- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 msgr2=0x563d6d2f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 -- 172.21.15.52:0/2481652335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e2b40 msgr2=0x563d6d2f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e2b40 0x563d6d2f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 -- 172.21.15.52:0/2481652335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6d365d90 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f703ca8e640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f7030001220 tx=0x7f703003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973575e890cc755a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70177fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030059040 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f70300046a0 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7020010be0 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7030070050 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70408ca740 10 client.21039 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.151+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563d6d366ee0 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7020010be0 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f70300305a0 con 0x563d6d2ec370 2024-09-19T09:36:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 10 client.21039 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 10 client.21039 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 20 client.21039 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d3675a0 0x563d6d3699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 4 client.21039 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d6d24ed70 con 0x563d6d3675a0 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f7037fff640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d3675a0 0x563d6d3699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f70177fe640 10 client.21039 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.152+0000 7f7037fff640 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d3675a0 0x563d6d3699c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5695d8c6b53fddf0 server_cookie=adc73a3c2e6648c9 in_seq=0 out_seq=0 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70177fe640 1 -- 172.21.15.52:0/2481652335 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d6d24ed70 con 0x563d6d3675a0 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70177fe640 10 client.21039 handle_command_reply: tid=0 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 client.21039 shutdown 2024-09-19T09:36:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 msgr2=0x563d6d365850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f7030001220 tx=0x7f703003c000 comp rx=0 tx=0).stop 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 shutdown_connections 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x563d6d3675a0 0x563d6d3699c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563d6d2ec370 0x563d6d365850 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563d6d2e2b40 0x563d6d2f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 --2- 172.21.15.52:0/2481652335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563d6d2e15d0 0x563d6d2f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70177fe640 0 client.21039 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 >> 172.21.15.52:0/2481652335 conn(0x563d6d2aa310 msgr2=0x563d6d2ea890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 shutdown_connections 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 1 -- 172.21.15.52:0/2481652335 wait complete. 2024-09-19T09:36:52.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.153+0000 7f70408ca740 20 client.21039 trim_cache size 0 max 16384 2024-09-19T09:36:52.172 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:52.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 msgr2=0x7f70240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 0x7f70240a5780 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7030009df0 tx=0x7f703004d000 comp rx=0 tx=0).stop 2024-09-19T09:36:52.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 msgr2=0x7f70381a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:52.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f702800b4a0 tx=0x7f702800b960 comp rx=0 tx=0).stop 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 shutdown_connections 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7038106a80 0x7f703819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f70240a32c0 0x7f70240a5780 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7038101420 0x7f70381a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 --2- 172.21.15.52:0/3168527017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7038100a80 0x7f70381a03f0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 >> 172.21.15.52:0/3168527017 conn(0x7f70380fc7a0 msgr2=0x7f703806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 shutdown_connections 2024-09-19T09:36:52.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:52.154+0000 7f703e4f1640 1 -- 172.21.15.52:0/3168527017 wait complete. 2024-09-19T09:36:52.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:36:53.119 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:53.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:52 smithi052 ceph-mon[30947]: pgmap v801: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T09:36:53.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:52 smithi086 ceph-mon[34813]: pgmap v801: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T09:36:53.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:52 smithi169 ceph-mon[35454]: pgmap v801: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T09:36:53.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 -- 172.21.15.52:0/2492985247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 msgr2=0x7fa19c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 --2- 172.21.15.52:0/2492985247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c1067e0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009900 tx=0x7fa18c02a410 comp rx=0 tx=0).stop 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 -- 172.21.15.52:0/2492985247 shutdown_connections 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 --2- 172.21.15.52:0/2492985247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c106f10 0x7fa19c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 --2- 172.21.15.52:0/2492985247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c1067e0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 --2- 172.21.15.52:0/2492985247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c101de0 0x7fa19c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 -- 172.21.15.52:0/2492985247 >> 172.21.15.52:0/2492985247 conn(0x7fa19c0fd8c0 msgr2=0x7fa19c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 -- 172.21.15.52:0/2492985247 shutdown_connections 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.628+0000 7fa1a4582640 1 -- 172.21.15.52:0/2492985247 wait complete. 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 Processor -- start 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 -- start start 2024-09-19T09:36:53.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c112010 con 0x7fa19c102790 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c111e90 con 0x7fa19c106f10 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a4582640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c112190 con 0x7fa19c101de0 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33748/0 (socket says 172.21.15.52:33748) 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1116870867 learned_addr learned my addr 172.21.15.52:0/1116870867 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a231e640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1116870867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c101de0 msgr2=0x7fa19c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1116870867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 msgr2=0x7fa19c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1116870867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c1a6a70 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.629+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005ab0 tx=0x7fa18c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1937fe640 1 -- 172.21.15.52:0/1116870867 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c03f030 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1937fe640 1 -- 172.21.15.52:0/1116870867 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa18c003ce0 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c1a6d00 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1937fe640 1 -- 172.21.15.52:0/1116870867 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c035070 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.630+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c1a7190 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.632+0000 7fa1937fe640 1 -- 172.21.15.52:0/1116870867 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa18c042030 con 0x7fa19c102790 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.632+0000 7fa1a695b740 1 Processor -- start 2024-09-19T09:36:53.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.632+0000 7fa1a695b740 1 -- start start 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x56037135da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5603712c32f0 con 0x56037135eb40 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56037126acf0 con 0x560371368370 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a695b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5603712bf2b0 con 0x56037135d5d0 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33760/0 (socket says 172.21.15.52:33760) 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/2178468297 learned_addr learned my addr 172.21.15.52:0/2178468297 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1937fe640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 0x7fa1880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a231e640 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x56037135da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 0x7fa1880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1937fe640 1 -- 172.21.15.52:0/1116870867 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa18c0f02f0 con 0x7fa19c102790 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/2178468297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 msgr2=0x56037135da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x56037135da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/2178468297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 msgr2=0x56037136a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.633+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/2178468297 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56037124f3a0 con 0x56037135eb40 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fa19400cbf0 tx=0x7fa194007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a538b738c829967f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa190ff9640 1 -- 172.21.15.52:0/2178468297 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194015070 con 0x56037135eb40 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa190ff9640 1 -- 172.21.15.52:0/2178468297 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa194016040 con 0x56037135eb40 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa190ff9640 1 -- 172.21.15.52:0/2178468297 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19401e020 con 0x56037135eb40 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa1a695b740 1 -- 172.21.15.52:0/2178468297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 msgr2=0x56037135d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 0x7fa1880a5700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa19401f000 tx=0x7fa19401b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.634+0000 7fa1a695b740 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fa19400cbf0 tx=0x7fa194007680 comp rx=0 tx=0).stop 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- 172.21.15.52:0/2178468297 shutdown_connections 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x56037135da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- 172.21.15.52:0/2178468297 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x56037135d090 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- 172.21.15.52:0/2178468297 >> 172.21.15.52:0/2178468297 conn(0x560371326310 msgr2=0x560371359c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- 172.21.15.52:0/2178468297 shutdown_connections 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- 172.21.15.52:0/2178468297 wait complete. 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- start start 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 Processor -- start 2024-09-19T09:36:53.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371365020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 0x560371365610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56037136b070 con 0x56037135d5d0 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56037127e060 con 0x56037135eb40 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56037136b1f0 con 0x560371368370 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a695b740 10 client.0 _ll_register_callbacks cb 0x560370fd18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a231e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a231e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33776/0 (socket says 172.21.15.52:33776) 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.635+0000 7fa1a231e640 1 -- 172.21.15.52:0/4155680858 learned_addr learned my addr 172.21.15.52:0/4155680858 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 0x560371365610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371365020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 -- 172.21.15.52:0/4155680858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 msgr2=0x560371365610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 0x560371365610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 -- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 msgr2=0x560371365020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371365020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 -- 172.21.15.52:0/4155680858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603710343c0 con 0x56037135d5d0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 0x560371365610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a231e640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fa1980104d0 tx=0x7fa198010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904a4aa4b9ae2099 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa185ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19801a020 con 0x56037135d5d0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa198016690 con 0x56037135d5d0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa194016040 con 0x56037135d5d0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa198025050 con 0x56037135d5d0 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a695b740 10 client.21051 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:53.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560371376b70 con 0x56037135d5d0 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.636+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa194016040 con 0x56037135d5d0 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa198014a60 con 0x56037135d5d0 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 10 client.21051 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 10 client.21051 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 20 client.21051 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560371378030 0x56037137a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 4 client.21051 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603712d0860 con 0x560371378030 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560371378030 0x56037137a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560371378030 0x56037137a4f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4c2d282ca09db719 server_cookie=d368f4535160c3fb in_seq=0 out_seq=0 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.637+0000 7fa185ffb640 10 client.21051 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa185ffb640 1 -- 172.21.15.52:0/4155680858 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603712d0860 con 0x560371378030 2024-09-19T09:36:53.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa185ffb640 10 client.21051 handle_command_reply: tid=0 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 client.21051 shutdown 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 msgr2=0x560371367d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fa1980104d0 tx=0x7fa198010990 comp rx=0 tx=0).stop 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 shutdown_connections 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560371368370 0x560371365610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x560371378030 0x56037137a4f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371365020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa185ffb640 0 client.21051 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 --2- 172.21.15.52:0/4155680858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135d5d0 0x560371367d70 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 >> 172.21.15.52:0/4155680858 conn(0x560371326310 msgr2=0x56037135f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 shutdown_connections 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.638+0000 7fa1a695b740 1 -- 172.21.15.52:0/4155680858 wait complete. 2024-09-19T09:36:53.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.639+0000 7fa1a695b740 20 client.21051 trim_cache size 0 max 16384 2024-09-19T09:36:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 Processor -- start 2024-09-19T09:36:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 -- start start 2024-09-19T09:36:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371359e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371374310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1b23a0 con 0x560371368370 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1afc70 con 0x56037135eb40 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a695b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1adac0 con 0x56037135d5d0 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33786/0 (socket says 172.21.15.52:33786) 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/675903939 learned_addr learned my addr 172.21.15.52:0/675903939 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a231e640 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371359e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/675903939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 msgr2=0x560371359e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371359e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/675903939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 msgr2=0x560371374310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.652+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371374310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa1a2b1f640 1 -- 172.21.15.52:0/675903939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560371374850 con 0x560371368370 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa1a231e640 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371359e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7fa194004b90 tx=0x7fa19400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf0ed61912148e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa187fff640 1 -- 172.21.15.52:0/675903939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194031070 con 0x560371368370 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa187fff640 1 -- 172.21.15.52:0/675903939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa194016040 con 0x560371368370 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.653+0000 7fa187fff640 1 -- 172.21.15.52:0/675903939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194015050 con 0x560371368370 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- 172.21.15.52:0/675903939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 msgr2=0x56037137fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7fa194004b90 tx=0x7fa19400e000 comp rx=0 tx=0).stop 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- 172.21.15.52:0/675903939 shutdown_connections 2024-09-19T09:36:53.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560371368370 0x56037137fe10 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56037135eb40 0x560371374310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- 172.21.15.52:0/675903939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371359e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- 172.21.15.52:0/675903939 >> 172.21.15.52:0/675903939 conn(0x560371326310 msgr2=0x560371359700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- 172.21.15.52:0/675903939 shutdown_connections 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- 172.21.15.52:0/675903939 wait complete. 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- start start 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 Processor -- start 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371370480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1ae130 con 0x56037135eb40 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1af5a0 con 0x560371368370 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1ae800 con 0x56037135d5d0 2024-09-19T09:36:53.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.654+0000 7fa1a695b740 10 client.0 _ll_register_callbacks cb 0x7fa19800b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33802/0 (socket says 172.21.15.52:33802) 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1609517123 learned_addr learned my addr 172.21.15.52:0/1609517123 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a231e640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371370480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1609517123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 msgr2=0x560371370480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371370480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 msgr2=0x56037136d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 -- 172.21.15.52:0/1609517123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56037136d9c0 con 0x56037135eb40 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a231e640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371370480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a2b1f640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a1b1d640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fa18c006010 tx=0x7fa18c08b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b367bc81f4c824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa185ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c049040 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa18c03bd70 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa194016040 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa18c0bc1f0 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a695b740 10 client.21057 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.655+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603713e3620 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa194016040 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa18c0b8f00 con 0x56037135eb40 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 10 client.21057 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 10 client.21057 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 20 client.21057 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:53.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5603713e3d50 0x5603713e6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 4 client.21057 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603712cad70 con 0x5603713e3d50 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a231e640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5603713e3d50 0x5603713e6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa185ffb640 10 client.21057 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.656+0000 7fa1a231e640 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5603713e3d50 0x5603713e6170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8440ed7174480a83 server_cookie=f32429c949d9fc49 in_seq=0 out_seq=0 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa185ffb640 1 -- 172.21.15.52:0/1609517123 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603712cad70 con 0x5603713e3d50 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa185ffb640 10 client.21057 handle_command_reply: tid=0 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 client.21057 shutdown 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 msgr2=0x5603713709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fa18c006010 tx=0x7fa18c08b5d0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 shutdown_connections 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5603713e3d50 0x5603713e6170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560371368370 0x56037136d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56037135eb40 0x5603713709c0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 --2- 172.21.15.52:0/1609517123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56037135d5d0 0x560371370480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 >> 172.21.15.52:0/1609517123 conn(0x560371326310 msgr2=0x5603713584e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa185ffb640 0 client.21057 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 shutdown_connections 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 1 -- 172.21.15.52:0/1609517123 wait complete. 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a695b740 20 client.21057 trim_cache size 0 max 16384 2024-09-19T09:36:53.677 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 msgr2=0x7fa1880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 0x7fa1880a5700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa19401f000 tx=0x7fa19401b000 comp rx=0 tx=0).stop 2024-09-19T09:36:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 msgr2=0x7fa19c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.657+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005ab0 tx=0x7fa18c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 shutdown_connections 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa19c106f10 0x7fa19c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa19c102790 0x7fa19c074a30 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa1880a3240 0x7fa1880a5700 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 --2- 172.21.15.52:0/1116870867 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c101de0 0x7fa19c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 >> 172.21.15.52:0/1116870867 conn(0x7fa19c0fd8c0 msgr2=0x7fa19c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 shutdown_connections 2024-09-19T09:36:53.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:53.658+0000 7fa1a4582640 1 -- 172.21.15.52:0/1116870867 wait complete. 2024-09-19T09:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2068992549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448102600 msgr2=0x7fb448108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2068992549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448102600 0x7fb448108e90 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fb440009ca0 tx=0x7fb44002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2068992549 shutdown_connections 2024-09-19T09:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2068992549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448102600 0x7fb448108e90 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2068992549 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448101c40 0x7fb4481020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2068992549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448100a50 0x7fb448100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2068992549 >> 172.21.15.52:0/2068992549 conn(0x7fb4480fc1b0 msgr2=0x7fb4480fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2068992549 shutdown_connections 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.797+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2068992549 wait complete. 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 Processor -- start 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 -- start start 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 0x7fb44819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448102600 0x7fb4481a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810c6d0 con 0x7fb448100a50 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810c550 con 0x7fb448101c40 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb44d3cf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb44810c850 con 0x7fb448102600 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33830/0 (socket says 172.21.15.52:33830) 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.798+0000 7fb446ffd640 1 -- 172.21.15.52:0/2255319222 learned_addr learned my addr 172.21.15.52:0/2255319222 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb4477fe640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448102600 0x7fb4481a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb4467fc640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 0x7fb44819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 -- 172.21.15.52:0/2255319222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448102600 msgr2=0x7fb4481a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448102600 0x7fb4481a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 -- 172.21.15.52:0/2255319222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 msgr2=0x7fb44819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 0x7fb44819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 -- 172.21.15.52:0/2255319222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481a1b70 con 0x7fb448100a50 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb4467fc640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 0x7fb44819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c970 tx=0x7fb43800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb42ffff640 1 -- 172.21.15.52:0/2255319222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438004220 con 0x7fb448100a50 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb42ffff640 1 -- 172.21.15.52:0/2255319222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4380043c0 con 0x7fb448100a50 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481a1e60 con 0x7fb448100a50 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb42ffff640 1 -- 172.21.15.52:0/2255319222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43800f450 con 0x7fb448100a50 2024-09-19T09:36:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.799+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481a22c0 con 0x7fb448100a50 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.801+0000 7fb42ffff640 1 -- 172.21.15.52:0/2255319222 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb4380079b0 con 0x7fb448100a50 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 Processor -- start 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 -- start start 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a013699a0 0x560a01369da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a01371830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a012cd2f0 con 0x560a0136a2e0 2024-09-19T09:36:53.813 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560a01275270 con 0x560a0136f370 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb450243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560a012c92b0 con 0x560a013699a0 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb42ffff640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 0x7fb4300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.802+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33840/0 (socket says 172.21.15.52:33840) 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 -- 172.21.15.52:0/1807587427 learned_addr learned my addr 172.21.15.52:0/1807587427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb4477fe640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a013699a0 0x560a01369da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb42ffff640 1 -- 172.21.15.52:0/2255319222 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb4380cf780 con 0x7fb448100a50 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb4467fc640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a01371830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb4477fe640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 0x7fb4300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 -- 172.21.15.52:0/1807587427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a013699a0 msgr2=0x560a01369da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.814 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a013699a0 0x560a01369da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 -- 172.21.15.52:0/1807587427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 msgr2=0x560a01371830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a01371830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 -- 172.21.15.52:0/1807587427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a01274340 con 0x560a0136a2e0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb4467fc640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a01371830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fb438004770 tx=0x7fb438000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2198f782fce03aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb4477fe640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 0x7fb4300a57b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb440009430 tx=0x7fb440005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb42d7fa640 1 -- 172.21.15.52:0/1807587427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43801d070 con 0x560a0136a2e0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb42d7fa640 1 -- 172.21.15.52:0/1807587427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43809bcc0 con 0x560a0136a2e0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.803+0000 7fb42d7fa640 1 -- 172.21.15.52:0/1807587427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438007ca0 con 0x560a0136a2e0 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- 172.21.15.52:0/1807587427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 msgr2=0x560a0136eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fb438004770 tx=0x7fb438000bc0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- 172.21.15.52:0/1807587427 shutdown_connections 2024-09-19T09:36:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a01371830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a0136a2e0 0x560a0136eda0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 --2- 172.21.15.52:0/1807587427 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a013699a0 0x560a01369da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- 172.21.15.52:0/1807587427 >> 172.21.15.52:0/1807587427 conn(0x560a01365010 msgr2=0x560a01365410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- 172.21.15.52:0/1807587427 shutdown_connections 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- 172.21.15.52:0/1807587427 wait complete. 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 -- start start 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.804+0000 7fb450243740 1 Processor -- start 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a013740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a0137b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560a013722e0 con 0x560a013699a0 2024-09-19T09:36:53.816 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560a01256290 con 0x560a0136f370 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560a01372460 con 0x560a0136a2e0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 10 client.0 _ll_register_callbacks cb 0x560a01287140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33850/0 (socket says 172.21.15.52:33850) 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 -- 172.21.15.52:0/3570869010 learned_addr learned my addr 172.21.15.52:0/3570869010 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb4477fe640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a0137b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb4467fc640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a013740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 -- 172.21.15.52:0/3570869010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 msgr2=0x560a013740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a013740a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 -- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 msgr2=0x560a0137b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a0137b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 -- 172.21.15.52:0/3570869010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a00fe0210 con 0x560a013699a0 2024-09-19T09:36:53.817 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb4467fc640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a013740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb4477fe640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a0137b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb446ffd640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fb4380a4400 tx=0x7fb4380a4a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5c1d8a49c0c71b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb42aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43801d040 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb4380ba620 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.805+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43809bcc0 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4380cfb70 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 10 client.21069 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a010ac620 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb438064020 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb43809ab80 con 0x560a013699a0 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 10 client.21069 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 10 client.21069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 20 client.21069 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a0137f3e0 0x560a013817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 4 client.21069 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a012daa20 con 0x560a0137f3e0 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.806+0000 7fb4467fc640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a0137f3e0 0x560a013817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb42aff5640 10 client.21069 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb4467fc640 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a0137f3e0 0x560a013817d0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1b9567fd713ccc server_cookie=b75f56444ab6c696 in_seq=0 out_seq=0 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb42aff5640 1 -- 172.21.15.52:0/3570869010 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a012daa20 con 0x560a0137f3e0 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb42aff5640 10 client.21069 handle_command_reply: tid=0 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 client.21069 shutdown 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 msgr2=0x560a01373b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fb4380a4400 tx=0x7fb4380a4a20 comp rx=0 tx=0).stop 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 shutdown_connections 2024-09-19T09:36:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a0137f3e0 0x560a013817d0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a0137b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a013740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 --2- 172.21.15.52:0/3570869010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373b60 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb42aff5640 0 client.21069 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.807+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 >> 172.21.15.52:0/3570869010 conn(0x560a01365010 msgr2=0x560a01366820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.808+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 shutdown_connections 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.808+0000 7fb450243740 1 -- 172.21.15.52:0/3570869010 wait complete. 2024-09-19T09:36:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.808+0000 7fb450243740 20 client.21069 trim_cache size 0 max 16384 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 Processor -- start 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 -- start start 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136a2e0 0x560a0137b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136f370 0x560a01373e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481add20 con 0x560a013699a0 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481ab5f0 con 0x560a0136a2e0 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb450243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481a9440 con 0x560a0136f370 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33862/0 (socket says 172.21.15.52:33862) 2024-09-19T09:36:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 -- 172.21.15.52:0/1707009074 learned_addr learned my addr 172.21.15.52:0/1707009074 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb4477fe640 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136f370 0x560a01373e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb4467fc640 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136a2e0 0x560a0137b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 -- 172.21.15.52:0/1707009074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136f370 msgr2=0x560a01373e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136f370 0x560a01373e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 -- 172.21.15.52:0/1707009074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136a2e0 msgr2=0x560a0137b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136a2e0 0x560a0137b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.822+0000 7fb446ffd640 1 -- 172.21.15.52:0/1707009074 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a01381e00 con 0x560a013699a0 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb446ffd640 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fb43800afd0 tx=0x7fb4380cfae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a1c909c2a5432a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb42cff9640 1 -- 172.21.15.52:0/1707009074 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43801d040 con 0x560a013699a0 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb42cff9640 1 -- 172.21.15.52:0/1707009074 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb438064040 con 0x560a013699a0 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb42cff9640 1 -- 172.21.15.52:0/1707009074 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43809b110 con 0x560a013699a0 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 -- 172.21.15.52:0/1707009074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 msgr2=0x560a01373910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fb43800afd0 tx=0x7fb4380cfae0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 -- 172.21.15.52:0/1707009074 shutdown_connections 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136f370 0x560a01373e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136a2e0 0x560a0137b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 --2- 172.21.15.52:0/1707009074 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01373910 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 -- 172.21.15.52:0/1707009074 >> 172.21.15.52:0/1707009074 conn(0x560a01365010 msgr2=0x560a0136b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.823+0000 7fb450243740 1 -- 172.21.15.52:0/1707009074 shutdown_connections 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 -- 172.21.15.52:0/1707009074 wait complete. 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 -- start start 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 Processor -- start 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a01378990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a013799a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481a9ab0 con 0x560a013699a0 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481aaf20 con 0x560a0136f370 2024-09-19T09:36:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481aa180 con 0x560a0136a2e0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb450243740 10 client.0 _ll_register_callbacks cb 0x7fb4380046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33874/0 (socket says 172.21.15.52:33874) 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 -- 172.21.15.52:0/2228995202 learned_addr learned my addr 172.21.15.52:0/2228995202 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb4477fe640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a013799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 -- 172.21.15.52:0/2228995202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 msgr2=0x560a01378990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a01378990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 -- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 msgr2=0x560a013799a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a013799a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.824+0000 7fb446ffd640 1 -- 172.21.15.52:0/2228995202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a01379fb0 con 0x560a013699a0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb446ffd640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb438098120 tx=0x7fb4380039a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23cc3b35db8d487 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43801d070 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb438003680 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb438064040 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb4380ba420 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 10 client.21075 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a01379fb0 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb438064040 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb438082070 con 0x560a013699a0 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 10 client.21075 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 10 client.21075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 20 client.21075 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a013ea120 0x560a013ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 4 client.21075 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:36:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.825+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a012d4d70 con 0x560a013ea120 2024-09-19T09:36:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.826+0000 7fb4467fc640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a013ea120 0x560a013ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.826+0000 7fb4467fc640 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a013ea120 0x560a013ec510 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74193b7978bc1cf4 server_cookie=6caa038868f596aa in_seq=0 out_seq=0 2024-09-19T09:36:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.826+0000 7fb42aff5640 10 client.21075 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.837+0000 7fb42aff5640 1 -- 172.21.15.52:0/2228995202 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a012d4d70 con 0x560a013ea120 2024-09-19T09:36:53.840 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.837+0000 7fb42aff5640 10 client.21075 handle_command_reply: tid=0 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.837+0000 7fb450243740 1 client.21075 shutdown 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 msgr2=0x560a01378450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fb438098120 tx=0x7fb4380039a0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 shutdown_connections 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560a013ea120 0x560a013ec510 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560a0136f370 0x560a013799a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560a0136a2e0 0x560a01378990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 --2- 172.21.15.52:0/2228995202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560a013699a0 0x560a01378450 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb42aff5640 0 client.21075 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 >> 172.21.15.52:0/2228995202 conn(0x560a01365010 msgr2=0x560a01373910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.841 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 shutdown_connections 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 1 -- 172.21.15.52:0/2228995202 wait complete. 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb450243740 20 client.21075 trim_cache size 0 max 16384 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:36:53.842 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 msgr2=0x7fb4300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 0x7fb4300a57b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb440009430 tx=0x7fb440005d80 comp rx=0 tx=0).stop 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 msgr2=0x7fb448199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c970 tx=0x7fb43800ce30 comp rx=0 tx=0).stop 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 shutdown_connections 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb4300a32f0 0x7fb4300a57b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.843 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb448102600 0x7fb4481a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb448101c40 0x7fb44819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 --2- 172.21.15.52:0/2255319222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb448100a50 0x7fb448199f50 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.838+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 >> 172.21.15.52:0/2255319222 conn(0x7fb4480fc1b0 msgr2=0x7fb4480fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.839+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 shutdown_connections 2024-09-19T09:36:53.844 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:36:53.839+0000 7fb44d3cf640 1 -- 172.21.15.52:0/2255319222 wait complete. 2024-09-19T09:36:54.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:36:54.690 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:55.130 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:54 smithi052 ceph-mon[30947]: pgmap v802: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:36:55.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 -- 172.21.15.52:0/4264189721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60101420 msgr2=0x7faf6010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 --2- 172.21.15.52:0/4264189721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60101420 0x7faf6010d950 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7faf58009cd0 tx=0x7faf5802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 -- 172.21.15.52:0/4264189721 shutdown_connections 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 --2- 172.21.15.52:0/4264189721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60101420 0x7faf6010d950 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 --2- 172.21.15.52:0/4264189721 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 --2- 172.21.15.52:0/4264189721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60106a80 0x7faf60106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 -- 172.21.15.52:0/4264189721 >> 172.21.15.52:0/4264189721 conn(0x7faf600fc7a0 msgr2=0x7faf600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 -- 172.21.15.52:0/4264189721 shutdown_connections 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.128+0000 7faf64f19640 1 -- 172.21.15.52:0/4264189721 wait complete. 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 Processor -- start 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 -- start start 2024-09-19T09:36:55.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 0x7faf601989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110ea0 con 0x7faf60106a80 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110d20 con 0x7faf60101420 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf64f19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf60111020 con 0x7faf60100a80 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf5ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf5ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33896/0 (socket says 172.21.15.52:33896) 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf5ed9d640 1 -- 172.21.15.52:0/4181727677 learned_addr learned my addr 172.21.15.52:0/4181727677 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.129+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 0x7faf601989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 -- 172.21.15.52:0/4181727677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 msgr2=0x7faf60198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 -- 172.21.15.52:0/4181727677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 msgr2=0x7faf601989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 0x7faf601989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 -- 172.21.15.52:0/4181727677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6019d430 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5e59c640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 0x7faf601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf5ed9d640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7faf58006010 tx=0x7faf58003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf4f7fe640 1 -- 172.21.15.52:0/4181727677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58004450 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf6019d6c0 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf4f7fe640 1 -- 172.21.15.52:0/4181727677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf58003e10 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf4f7fe640 1 -- 172.21.15.52:0/4181727677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58046480 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.130+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf601a5000 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf4f7fe640 1 -- 172.21.15.52:0/4181727677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faf580045f0 con 0x7faf60106a80 2024-09-19T09:36:55.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 Processor -- start 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 -- start start 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6edd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6eeeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6e432f0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6deacf0 con 0x55a3d6edeb40 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf672f2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6e3f2b0 con 0x55a3d6eec780 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.133+0000 7faf4f7fe640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 0x7faf480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33912/0 (socket says 172.21.15.52:33912) 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5e59c640 1 -- 172.21.15.52:0/1213232042 learned_addr learned my addr 172.21.15.52:0/1213232042 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:55.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6edd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5ed9d640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 0x7faf480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6eeeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf4f7fe640 1 -- 172.21.15.52:0/4181727677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf5802e030 con 0x7faf60106a80 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 -- 172.21.15.52:0/1213232042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 msgr2=0x55a3d6eeeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6eeeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 -- 172.21.15.52:0/1213232042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 msgr2=0x55a3d6edda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 -- 172.21.15.52:0/1213232042 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d6dcf3a0 con 0x55a3d6edeb40 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5e59c640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5ed9d640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 0x7faf480a5700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faf580b82c0 tx=0x7faf58092040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6edd090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf601049e0 tx=0x7faf54009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd6ef36e88b9f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.134+0000 7faf4cff9640 1 -- 172.21.15.52:0/1213232042 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5400e7e0 con 0x55a3d6edeb40 2024-09-19T09:36:55.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf4cff9640 1 -- 172.21.15.52:0/1213232042 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5401d070 con 0x55a3d6edeb40 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf4cff9640 1 -- 172.21.15.52:0/1213232042 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54018b10 con 0x55a3d6edeb40 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 -- 172.21.15.52:0/1213232042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 msgr2=0x55a3d6edd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6edd090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faf601049e0 tx=0x7faf54009840 comp rx=0 tx=0).stop 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 -- 172.21.15.52:0/1213232042 shutdown_connections 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6eeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6edda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 --2- 172.21.15.52:0/1213232042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6edd090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.135+0000 7faf672f2740 1 -- 172.21.15.52:0/1213232042 >> 172.21.15.52:0/1213232042 conn(0x55a3d6ea6310 msgr2=0x55a3d6ed9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- 172.21.15.52:0/1213232042 shutdown_connections 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- 172.21.15.52:0/1213232042 wait complete. 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- start start 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 Processor -- start 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ee9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ee9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6eef420 con 0x55a3d6edd5d0 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6dfe060 con 0x55a3d6edeb40 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a3d6eef5a0 con 0x55a3d6eec780 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf672f2740 10 client.0 _ll_register_callbacks cb 0x55a3d6b518c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33924/0 (socket says 172.21.15.52:33924) 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.136+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2771822396 learned_addr learned my addr 172.21.15.52:0/2771822396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ee9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2771822396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 msgr2=0x55a3d6ee9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ee9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 msgr2=0x55a3d6ee9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ee9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2771822396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d6bb43c0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ee9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7faf5400e5a0 tx=0x7faf540097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65102a69fc62308d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54018d00 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5401d070 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf5400e7e0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf5402f020 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf672f2740 10 client.21087 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a3d6efaec0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.137+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5401d070 con 0x55a3d6edd5d0 2024-09-19T09:36:55.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf5402ab20 con 0x55a3d6edd5d0 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 10 client.21087 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 10 client.21087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 20 client.21087 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6efc270 0x55a3d6efe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 4 client.21087 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3d6e50860 con 0x55a3d6efc270 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6efc270 0x55a3d6efe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6efc270 0x55a3d6efe660 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df09299428f077b2 server_cookie=10f6d549367e5527 in_seq=0 out_seq=0 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.138+0000 7faf45ffb640 10 client.21087 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf45ffb640 1 -- 172.21.15.52:0/2771822396 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3d6e50860 con 0x55a3d6efc270 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf45ffb640 10 client.21087 handle_command_reply: tid=0 2024-09-19T09:36:55.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 client.21087 shutdown 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 msgr2=0x55a3d6eec170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7faf5400e5a0 tx=0x7faf540097c0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 shutdown_connections 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6efc270 0x55a3d6efe660 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ee9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ee9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 --2- 172.21.15.52:0/2771822396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6eec170 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf45ffb640 0 client.21087 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 >> 172.21.15.52:0/2771822396 conn(0x55a3d6ea6310 msgr2=0x55a3d6edf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.139+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 shutdown_connections 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.140+0000 7faf672f2740 1 -- 172.21.15.52:0/2771822396 wait complete. 2024-09-19T09:36:55.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.140+0000 7faf672f2740 20 client.21087 trim_cache size 0 max 16384 2024-09-19T09:36:55.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 Processor -- start 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 -- start start 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ed9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ed9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf601add80 con 0x55a3d6edd5d0 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf601ab650 con 0x55a3d6edeb40 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf672f2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf601a94a0 con 0x55a3d6eec780 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33940/0 (socket says 172.21.15.52:33940) 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2856524794 learned_addr learned my addr 172.21.15.52:0/2856524794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ed9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2856524794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 msgr2=0x55a3d6ed9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ed9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2856524794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 msgr2=0x55a3d6ed9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ed9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 -- 172.21.15.52:0/2856524794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d6efe9d0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ed9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.153+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7faf54034470 tx=0x7faf54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6d7c8a14614dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf47fff640 1 -- 172.21.15.52:0/2856524794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54039030 con 0x55a3d6edd5d0 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf47fff640 1 -- 172.21.15.52:0/2856524794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5401d070 con 0x55a3d6edd5d0 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf47fff640 1 -- 172.21.15.52:0/2856524794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5400e7e0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 -- 172.21.15.52:0/2856524794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 msgr2=0x55a3d6ef86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7faf54034470 tx=0x7faf54000bc0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 -- 172.21.15.52:0/2856524794 shutdown_connections 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6eec780 0x55a3d6ed9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6edeb40 0x55a3d6ed9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 --2- 172.21.15.52:0/2856524794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef86c0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 -- 172.21.15.52:0/2856524794 >> 172.21.15.52:0/2856524794 conn(0x55a3d6ea6310 msgr2=0x55a3d6ee83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 -- 172.21.15.52:0/2856524794 shutdown_connections 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.154+0000 7faf672f2740 1 -- 172.21.15.52:0/2856524794 wait complete. 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 -- start start 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 Processor -- start 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6eec780 0x55a3d6ef0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf601a9b10 con 0x55a3d6edeb40 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7faf601aaf80 con 0x55a3d6eec780 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faf601aa1e0 con 0x55a3d6edd5d0 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf672f2740 10 client.0 _ll_register_callbacks cb 0x7faf5000aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33954/0 (socket says 172.21.15.52:33954) 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf5e59c640 1 -- 172.21.15.52:0/2218804384 learned_addr learned my addr 172.21.15.52:0/2218804384 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.155+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6eec780 0x55a3d6ef0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 -- 172.21.15.52:0/2218804384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6edd5d0 msgr2=0x55a3d6ef5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 -- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6eec780 msgr2=0x55a3d6ef0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6eec780 0x55a3d6ef0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 -- 172.21.15.52:0/2218804384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d6f65c30 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf5e59c640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7faf50005e10 tx=0x7faf50014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10429abec8710c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf500142d0 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7faf50014470 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5401d070 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faf50012940 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 10 client.21093 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a3d6f66da0 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf5401d070 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faf500105b0 con 0x55a3d6edeb40 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 10 client.21093 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 10 client.21093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:55.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.156+0000 7faf672f2740 20 client.21093 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6f674f0 0x55a3d6f69910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 4 client.21093 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3d6e4ad70 con 0x55a3d6f674f0 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6f674f0 0x55a3d6f69910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf5dd9b640 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6f674f0 0x55a3d6f69910 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef62eea2d2f66f3 server_cookie=ce4251178eafa6f in_seq=0 out_seq=0 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf45ffb640 10 client.21093 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf45ffb640 1 -- 172.21.15.52:0/2218804384 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3d6e4ad70 con 0x55a3d6f674f0 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf45ffb640 10 client.21093 handle_command_reply: tid=0 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 client.21093 shutdown 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 msgr2=0x55a3d6ef04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7faf50005e10 tx=0x7faf50014a60 comp rx=0 tx=0).stop 2024-09-19T09:36:55.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 shutdown_connections 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55a3d6f674f0 0x55a3d6f69910 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a3d6eec780 0x55a3d6ef0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a3d6edeb40 0x55a3d6ef04a0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf45ffb640 0 client.21093 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 --2- 172.21.15.52:0/2218804384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a3d6edd5d0 0x55a3d6ef5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.157+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 >> 172.21.15.52:0/2218804384 conn(0x55a3d6ea6310 msgr2=0x55a3d6edf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 shutdown_connections 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf672f2740 1 -- 172.21.15.52:0/2218804384 wait complete. 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf672f2740 20 client.21093 trim_cache size 0 max 16384 2024-09-19T09:36:55.168 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:36:55.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 msgr2=0x7faf480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 0x7faf480a5700 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7faf580b82c0 tx=0x7faf58092040 comp rx=0 tx=0).stop 2024-09-19T09:36:55.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 msgr2=0x7faf6019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7faf58006010 tx=0x7faf58003c20 comp rx=0 tx=0).stop 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 shutdown_connections 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf60106a80 0x7faf6019cd50 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf60101420 0x7faf601989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7faf480a3240 0x7faf480a5700 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 --2- 172.21.15.52:0/4181727677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faf60100a80 0x7faf60198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 >> 172.21.15.52:0/4181727677 conn(0x7faf600fc7a0 msgr2=0x7faf6006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 shutdown_connections 2024-09-19T09:36:55.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:55.158+0000 7faf64f19640 1 -- 172.21.15.52:0/4181727677 wait complete. 2024-09-19T09:36:55.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:54 smithi086 ceph-mon[34813]: pgmap v802: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:36:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:54 smithi169 ceph-mon[35454]: pgmap v802: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-19T09:36:56.963 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:36:56.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:36:57.235 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:57.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:56 smithi086 ceph-mon[34813]: pgmap v803: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:36:57.295 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:56 smithi052 ceph-mon[30947]: pgmap v803: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:36:57.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:56 smithi169 ceph-mon[35454]: pgmap v803: 97 pgs: 97 active+clean; 3.6 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-19T09:36:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 -- 172.21.15.52:0/3230183932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 msgr2=0x7f9c881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 --2- 172.21.15.52:0/3230183932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c881021c0 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009ca0 tx=0x7f9c8402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 -- 172.21.15.52:0/3230183932 shutdown_connections 2024-09-19T09:36:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 --2- 172.21.15.52:0/3230183932 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 0x7f9c8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 --2- 172.21.15.52:0/3230183932 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 0x7f9c881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 --2- 172.21.15.52:0/3230183932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c881021c0 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 -- 172.21.15.52:0/3230183932 >> 172.21.15.52:0/3230183932 conn(0x7f9c880fd8c0 msgr2=0x7f9c880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 -- 172.21.15.52:0/3230183932 shutdown_connections 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.722+0000 7f9c9021f640 1 -- 172.21.15.52:0/3230183932 wait complete. 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 Processor -- start 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 -- start start 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 0x7f9c88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 0x7f9c88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88111f70 con 0x7f9c88101de0 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c88111df0 con 0x7f9c88106f10 2024-09-19T09:36:57.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c9021f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881120f0 con 0x7f9c88102790 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c8dfbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c8dfbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33978/0 (socket says 172.21.15.52:33978) 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/904656130 learned_addr learned my addr 172.21.15.52:0/904656130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 0x7f9c88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.723+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 0x7f9c88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/904656130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 msgr2=0x7f9c88074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 0x7f9c88074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/904656130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 msgr2=0x7f9c88074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 0x7f9c88074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/904656130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c881a6970 con 0x7f9c88101de0 2024-09-19T09:36:57.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f9c8402ade0 tx=0x7f9c840319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c7affd640 1 -- 172.21.15.52:0/904656130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8402fa20 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c881a6c00 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c7affd640 1 -- 172.21.15.52:0/904656130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c8402fbc0 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c7affd640 1 -- 172.21.15.52:0/904656130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c840467b0 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.724+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c881a7140 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.726+0000 7f9c7affd640 1 -- 172.21.15.52:0/904656130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9c84046950 con 0x7f9c88101de0 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.726+0000 7f9c925f8740 1 Processor -- start 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 -- start start 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b8190130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5565b80e8280 con 0x5565b8182b60 2024-09-19T09:36:57.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5565b808fb10 con 0x5565b8183480 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c925f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565b80e4240 con 0x5565b818dd40 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c8e7bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c8e7bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33988/0 (socket says 172.21.15.52:33988) 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/3523156947 learned_addr learned my addr 172.21.15.52:0/3523156947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b8190130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.727+0000 7f9c7affd640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 0x7f9c740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/3523156947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 msgr2=0x5565b8190130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b8190130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/3523156947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 msgr2=0x5565b818d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/3523156947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b809c1f0 con 0x5565b8182b60 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b8190130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c7affd640 1 -- 172.21.15.52:0/904656130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9c840f0da0 con 0x7f9c88101de0 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 0x7f9c740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000b7a0 tx=0x7f9c8000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3933d72211ba74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c73fff640 1 -- 172.21.15.52:0/3523156947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80024070 con 0x5565b8182b60 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c73fff640 1 -- 172.21.15.52:0/3523156947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c8001e960 con 0x5565b8182b60 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c73fff640 1 -- 172.21.15.52:0/3523156947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800118c0 con 0x5565b8182b60 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.728+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 0x7f9c740a5700 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c80021000 tx=0x7f9c8001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- 172.21.15.52:0/3523156947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 msgr2=0x5565b8182f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000b7a0 tx=0x7f9c8000bc60 comp rx=0 tx=0).stop 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- 172.21.15.52:0/3523156947 shutdown_connections 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b8190130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3523156947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b8182f40 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- 172.21.15.52:0/3523156947 >> 172.21.15.52:0/3523156947 conn(0x5565b817f0f0 msgr2=0x5565b817f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- 172.21.15.52:0/3523156947 shutdown_connections 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- 172.21.15.52:0/3523156947 wait complete. 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 -- start start 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.729+0000 7f9c925f8740 1 Processor -- start 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b818b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5565b8190910 con 0x5565b8182b60 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5565b80a2f10 con 0x5565b8183480 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5565b8190a90 con 0x5565b818dd40 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c925f8740 10 client.0 _ll_register_callbacks cb 0x5565b806ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33998/0 (socket says 172.21.15.52:33998) 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/3849079585 learned_addr learned my addr 172.21.15.52:0/3849079585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b818b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/3849079585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 msgr2=0x5565b818b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b818b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 msgr2=0x5565b818b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 -- 172.21.15.52:0/3849079585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b7e596a0 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9c840b9da0 tx=0x7f9c8404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4526b322cc71af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.730+0000 7f9c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c840c1780 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9c84046c40 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c8001e960 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c84046e40 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 10 client.21105 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565b8190910 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c8001e960 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9c840eece0 con 0x5565b8182b60 2024-09-19T09:36:57.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 10 client.21105 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 10 client.21105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 20 client.21105 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b819d930 0x5565b819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 4 client.21105 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.731+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b80f57f0 con 0x5565b819d930 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.732+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b819d930 0x5565b819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.732+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b819d930 0x5565b819fd80 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfd44a17554ae760 server_cookie=ffe71f9d3e0094a8 in_seq=0 out_seq=0 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.732+0000 7f9c717fa640 10 client.21105 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c717fa640 1 -- 172.21.15.52:0/3849079585 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565b80f57f0 con 0x5565b819d930 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c717fa640 10 client.21105 handle_command_reply: tid=0 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 client.21105 shutdown 2024-09-19T09:36:57.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 msgr2=0x5565b818abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f9c840b9da0 tx=0x7f9c8404a000 comp rx=0 tx=0).stop 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 shutdown_connections 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b819d930 0x5565b819fd80 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b818dd40 0x5565b818b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8183480 0x5565b818b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3849079585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8182b60 0x5565b818abd0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 >> 172.21.15.52:0/3849079585 conn(0x5565b817f0f0 msgr2=0x5565b8184e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c717fa640 0 client.21105 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 shutdown_connections 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 1 -- 172.21.15.52:0/3849079585 wait complete. 2024-09-19T09:36:57.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.733+0000 7f9c925f8740 20 client.21105 trim_cache size 0 max 16384 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 Processor -- start 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 -- start start 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8182b60 0x5565b8185610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 0x5565b81a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881b20a0 con 0x5565b818dd40 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881af970 con 0x5565b8182b60 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c925f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881ad7c0 con 0x5565b8183480 2024-09-19T09:36:57.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34004/0 (socket says 172.21.15.52:34004) 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/1193470443 learned_addr learned my addr 172.21.15.52:0/1193470443 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 0x5565b81a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8182b60 0x5565b8185610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/1193470443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 msgr2=0x5565b81a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 0x5565b81a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/1193470443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8182b60 msgr2=0x5565b8185610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8182b60 0x5565b8185610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8e7bc640 1 -- 172.21.15.52:0/1193470443 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b81832b0 con 0x5565b818dd40 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.751+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 0x5565b81a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000b6b0 tx=0x7f9c8000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf7411065c6acd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c737fe640 1 -- 172.21.15.52:0/1193470443 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c80024040 con 0x5565b818dd40 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c737fe640 1 -- 172.21.15.52:0/1193470443 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c80011be0 con 0x5565b818dd40 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c737fe640 1 -- 172.21.15.52:0/1193470443 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c800055b0 con 0x5565b818dd40 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c925f8740 1 -- 172.21.15.52:0/1193470443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 msgr2=0x5565b81a5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.752+0000 7f9c925f8740 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000b6b0 tx=0x7f9c8000b6e0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 -- 172.21.15.52:0/1193470443 shutdown_connections 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b818dd40 0x5565b81a5b90 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8183480 0x5565b81a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- 172.21.15.52:0/1193470443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b8182b60 0x5565b8185610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 -- 172.21.15.52:0/1193470443 >> 172.21.15.52:0/1193470443 conn(0x5565b817f0f0 msgr2=0x5565b818cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 -- 172.21.15.52:0/1193470443 shutdown_connections 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 -- 172.21.15.52:0/1193470443 wait complete. 2024-09-19T09:36:57.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 -- start start 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 Processor -- start 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8182b60 0x5565b8195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.753+0000 7f9c925f8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b818dd40 0x5565b8192cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c925f8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881ade30 con 0x5565b8183480 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c925f8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881af2a0 con 0x5565b818dd40 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c925f8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881ae500 con 0x5565b8182b60 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c925f8740 10 client.0 _ll_register_callbacks cb 0x7f9c84005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34020/0 (socket says 172.21.15.52:34020) 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 -- 172.21.15.52:0/3892993015 learned_addr learned my addr 172.21.15.52:0/3892993015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:57.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8e7bc640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b818dd40 0x5565b8192cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8182b60 0x5565b8195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 -- 172.21.15.52:0/3892993015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8182b60 msgr2=0x5565b8195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8182b60 0x5565b8195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 -- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b818dd40 msgr2=0x5565b8192cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b818dd40 0x5565b8192cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 -- 172.21.15.52:0/3892993015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b81931f0 con 0x5565b8183480 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c8d7ba640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x5565b8180470 tx=0x7f9c7c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a397fbc612a539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c717fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003e90 con 0x5565b8183480 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c80011be0 con 0x5565b8183480 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.754+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9c7c01d420 con 0x5565b8183480 2024-09-19T09:36:57.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c02d050 con 0x5565b8183480 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 10 client.21111 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5565b8208de0 con 0x5565b8183480 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c80011be0 con 0x5565b8183480 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9c7c011930 con 0x5565b8183480 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 10 client.21111 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 10 client.21111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 20 client.21111 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b8209590 0x5565b820b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 4 client.21111 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5565b80efd00 con 0x5565b8209590 2024-09-19T09:36:57.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.755+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b8209590 0x5565b820b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.756+0000 7f9c8dfbb640 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b8209590 0x5565b820b9b0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe1f99dda107137 server_cookie=330ce2e4d9d57cdc in_seq=0 out_seq=0 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.756+0000 7f9c717fa640 10 client.21111 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c717fa640 1 -- 172.21.15.52:0/3892993015 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5565b80efd00 con 0x5565b8209590 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c717fa640 10 client.21111 handle_command_reply: tid=0 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 client.21111 shutdown 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 msgr2=0x5565b8196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x5565b8180470 tx=0x7f9c7c00be50 comp rx=0 tx=0).stop 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 shutdown_connections 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5565b8209590 0x5565b820b9b0 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5565b818dd40 0x5565b8192cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5565b8183480 0x5565b8196220 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c717fa640 0 client.21111 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 --2- 172.21.15.52:0/3892993015 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5565b8182b60 0x5565b8195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 >> 172.21.15.52:0/3892993015 conn(0x5565b817f0f0 msgr2=0x5565b817da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 shutdown_connections 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 1 -- 172.21.15.52:0/3892993015 wait complete. 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.757+0000 7f9c925f8740 20 client.21111 trim_cache size 0 max 16384 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:57.770 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:36:57.771 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "9dd9baad-c5e1-4aa1-b4db-e0614cc5a1fd", 2024-09-19T09:36:57.771 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:36:57.771 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:57.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 msgr2=0x7f9c740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 0x7f9c740a5700 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9c80021000 tx=0x7f9c8001e000 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 msgr2=0x7f9c880744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f9c8402ade0 tx=0x7f9c840319f0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 shutdown_connections 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9c88106f10 0x7f9c88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9c740a3240 0x7f9c740a5700 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c88102790 0x7f9c88074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 --2- 172.21.15.52:0/904656130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c88101de0 0x7f9c880744f0 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 >> 172.21.15.52:0/904656130 conn(0x7f9c880fd8c0 msgr2=0x7f9c880fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 shutdown_connections 2024-09-19T09:36:57.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:57.758+0000 7f9c9021f640 1 -- 172.21.15.52:0/904656130 wait complete. 2024-09-19T09:36:58.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:36:58.872 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: pgmap v804: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:36:58 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:36:59.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: pgmap v804: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:36:59.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:36:59.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.264 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:36:59.265 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.265 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:36:58 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 -- 172.21.15.52:0/4029125099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b410c180 msgr2=0x7f32b410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/4029125099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b410c180 0x7f32b410e610 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009ca0 tx=0x7f32ac02a950 comp rx=0 tx=0).stop 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 -- 172.21.15.52:0/4029125099 shutdown_connections 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/4029125099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b410c180 0x7f32b410e610 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/4029125099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/4029125099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b4102de0 0x7f32b41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 -- 172.21.15.52:0/4029125099 >> 172.21.15.52:0/4029125099 conn(0x7f32b40fc7a0 msgr2=0x7f32b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 -- 172.21.15.52:0/4029125099 shutdown_connections 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.345+0000 7f32bbdc2640 1 -- 172.21.15.52:0/4029125099 wait complete. 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 Processor -- start 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 -- start start 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b410c180 0x7f32b419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4111fd0 con 0x7f32b4102de0 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4111e50 con 0x7f32b410c180 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32bbdc2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4112150 con 0x7f32b4103700 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37656/0 (socket says 172.21.15.52:37656) 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32b9b5e640 1 -- 172.21.15.52:0/2801935513 learned_addr learned my addr 172.21.15.52:0/2801935513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32b935d640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.346+0000 7f32ba35f640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b410c180 0x7f32b419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 -- 172.21.15.52:0/2801935513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 msgr2=0x7f32b41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 -- 172.21.15.52:0/2801935513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b410c180 msgr2=0x7f32b419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b410c180 0x7f32b419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 -- 172.21.15.52:0/2801935513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b419d420 con 0x7f32b4102de0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b935d640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b4a0 tx=0x7f32b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32a6ffd640 1 -- 172.21.15.52:0/2801935513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0014070 con 0x7f32b4102de0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b419d710 con 0x7f32b4102de0 2024-09-19T09:36:59.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32a6ffd640 1 -- 172.21.15.52:0/2801935513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b0010af0 con 0x7f32b4102de0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32a6ffd640 1 -- 172.21.15.52:0/2801935513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b0017d10 con 0x7f32b4102de0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.347+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41a4ff0 con 0x7f32b4102de0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.349+0000 7f32a6ffd640 1 -- 172.21.15.52:0/2801935513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32b0017070 con 0x7f32b4102de0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.349+0000 7f32be19b740 1 Processor -- start 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 -- start start 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fc2cc0 0x560e99fd1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fd1a90 0x560e99fd3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e99f282e0 con 0x560e99fc23a0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e99ecfce0 con 0x560e99fd1a90 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32be19b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e99f242a0 con 0x560e99fc2cc0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37668/0 (socket says 172.21.15.52:37668) 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 -- 172.21.15.52:0/4110728936 learned_addr learned my addr 172.21.15.52:0/4110728936 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32a6ffd640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 0x7f32a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fc2cc0 0x560e99fd1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32b935d640 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fd1a90 0x560e99fd3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 -- 172.21.15.52:0/4110728936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fc2cc0 msgr2=0x560e99fd1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fc2cc0 0x560e99fd1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 -- 172.21.15.52:0/4110728936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fd1a90 msgr2=0x560e99fd3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fd1a90 0x560e99fd3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.350+0000 7f32ba35f640 1 -- 172.21.15.52:0/4110728936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e99eb4440 con 0x560e99fc23a0 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f32ba35f640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 0x7f32a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f32a6ffd640 1 -- 172.21.15.52:0/2801935513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32b00cedb0 con 0x7f32b4102de0 2024-09-19T09:36:59.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f32ba35f640 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f32ac02f9c0 tx=0x7f32ac02f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b19e5f116322f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f329ffff640 1 -- 172.21.15.52:0/4110728936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac041040 con 0x560e99fc23a0 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f329ffff640 1 -- 172.21.15.52:0/4110728936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ac02fc10 con 0x560e99fc23a0 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.351+0000 7f329ffff640 1 -- 172.21.15.52:0/4110728936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac034040 con 0x560e99fc23a0 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- 172.21.15.52:0/4110728936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 msgr2=0x560e99fc2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32ba35f640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 0x7f32a00a5700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f32ac04c000 tx=0x7f32ac04d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f32ac02f9c0 tx=0x7f32ac02f9f0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- 172.21.15.52:0/4110728936 shutdown_connections 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fd1a90 0x560e99fd3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fc2cc0 0x560e99fd1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 --2- 172.21.15.52:0/4110728936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fc2780 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- 172.21.15.52:0/4110728936 >> 172.21.15.52:0/4110728936 conn(0x560e99fbea30 msgr2=0x560e99fbee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- 172.21.15.52:0/4110728936 shutdown_connections 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- 172.21.15.52:0/4110728936 wait complete. 2024-09-19T09:36:59.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 -- start start 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.352+0000 7f32be19b740 1 Processor -- start 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fcec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560e99fd46c0 con 0x560e99fc23a0 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560e99ee3050 con 0x560e99fc2cc0 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560e99fd4840 con 0x560e99fd1a90 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 10 client.0 _ll_register_callbacks cb 0x560e99f23160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37682/0 (socket says 172.21.15.52:37682) 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 -- 172.21.15.52:0/3132555820 learned_addr learned my addr 172.21.15.52:0/3132555820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b935d640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 -- 172.21.15.52:0/3132555820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 msgr2=0x560e99fcec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fcec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 -- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 msgr2=0x560e99fce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 -- 172.21.15.52:0/3132555820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e99c993c0 con 0x560e99fc23a0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f32b00cc830 tx=0x7f32b009acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c963382efc71a9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f329d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b001e070 con 0x560e99fc23a0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32b0017360 con 0x560e99fc23a0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.353+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ac02fc10 con 0x560e99fc23a0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32b009b350 con 0x560e99fc23a0 2024-09-19T09:36:59.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 10 client.21123 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e99fe0170 con 0x560e99fc23a0 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32ac02fc10 con 0x560e99fc23a0 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f32b00979c0 con 0x560e99fc23a0 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 10 client.21123 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 10 client.21123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 20 client.21123 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e99fe1630 0x560e99fe3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 4 client.21123 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e99f35850 con 0x560e99fe1630 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.354+0000 7f32b935d640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e99fe1630 0x560e99fe3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.355+0000 7f32b935d640 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e99fe1630 0x560e99fe3a40 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a58e4ac9ab80448 server_cookie=475bc87c9820f948 in_seq=0 out_seq=0 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.355+0000 7f329d7fa640 10 client.21123 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:59.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.355+0000 7f329d7fa640 1 -- 172.21.15.52:0/3132555820 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e99f35850 con 0x560e99fe1630 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.355+0000 7f329d7fa640 10 client.21123 handle_command_reply: tid=0 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.355+0000 7f32be19b740 1 client.21123 shutdown 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 msgr2=0x560e99fd1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f32b00cc830 tx=0x7f32b009acb0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 shutdown_connections 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e99fe1630 0x560e99fe3a40 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fcec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f329d7fa640 0 client.21123 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 --2- 172.21.15.52:0/3132555820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd1440 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 >> 172.21.15.52:0/3132555820 conn(0x560e99fbea30 msgr2=0x560e99fc4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 shutdown_connections 2024-09-19T09:36:59.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 1 -- 172.21.15.52:0/3132555820 wait complete. 2024-09-19T09:36:59.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.356+0000 7f32be19b740 20 client.21123 trim_cache size 0 max 16384 2024-09-19T09:36:59.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 Processor -- start 2024-09-19T09:36:59.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 -- start start 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fe9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fe9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41adf50 con 0x560e99fc23a0 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41ab820 con 0x560e99fc2cc0 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32be19b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41a9670 con 0x560e99fd1a90 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37692/0 (socket says 172.21.15.52:37692) 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1422730949 learned_addr learned my addr 172.21.15.52:0/1422730949 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1422730949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 msgr2=0x560e99fe9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fe9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1422730949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 msgr2=0x560e99fe9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fe9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.373+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1422730949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e99fbe860 con 0x560e99fc23a0 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f32b00977b0 tx=0x7f32b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b0adc39c009b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f329f7fe640 1 -- 172.21.15.52:0/1422730949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b001e050 con 0x560e99fc23a0 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f329f7fe640 1 -- 172.21.15.52:0/1422730949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b009f700 con 0x560e99fc23a0 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f329f7fe640 1 -- 172.21.15.52:0/1422730949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b009a870 con 0x560e99fc23a0 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 -- 172.21.15.52:0/1422730949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 msgr2=0x560e99fdd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f32b00977b0 tx=0x7f32b0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 -- 172.21.15.52:0/1422730949 shutdown_connections 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fe9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fe9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 --2- 172.21.15.52:0/1422730949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fdd960 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 -- 172.21.15.52:0/1422730949 >> 172.21.15.52:0/1422730949 conn(0x560e99fbea30 msgr2=0x560e99fc9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.374+0000 7f32be19b740 1 -- 172.21.15.52:0/1422730949 shutdown_connections 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 -- 172.21.15.52:0/1422730949 wait complete. 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 -- start start 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 Processor -- start 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fd68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fd9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41a9ce0 con 0x560e99fc23a0 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41ab150 con 0x560e99fc2cc0 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f32b41aa3b0 con 0x560e99fd1a90 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32be19b740 10 client.0 _ll_register_callbacks cb 0x7f32b000b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.375+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37696/0 (socket says 172.21.15.52:37696) 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1679140129 learned_addr learned my addr 172.21.15.52:0/1679140129 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32ba35f640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fd9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b935d640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fd68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1679140129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 msgr2=0x560e99fd9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fd9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 msgr2=0x560e99fd68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fd68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 -- 172.21.15.52:0/1679140129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e99fd41f0 con 0x560e99fc23a0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b935d640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fd68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32b9b5e640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f32b0099600 tx=0x7f32b000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e8794749441760 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f329d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b001e070 con 0x560e99fc23a0 2024-09-19T09:36:59.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32b00bb3b0 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32b009f700 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32b00b4300 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32be19b740 10 client.21129 fetch_fsmap learned FSMap version 24 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.376+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560e9a04ccf0 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b009f700 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f32b00972a0 con 0x560e99fc23a0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 10 client.21129 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 10 client.21129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 20 client.21129 populate_metadata read hostname 'smithi052' 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e9a04d1c0 0x560e9a04f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 4 client.21129 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560e99f2fd60 con 0x560e9a04d1c0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32b935d640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e9a04d1c0 0x560e9a04f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:59.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f32b935d640 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e9a04d1c0 0x560e9a04f5b0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c5cbcef477ea17b server_cookie=1fdaad2d9bd4fba0 in_seq=0 out_seq=0 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.377+0000 7f329d7fa640 10 client.21129 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f329d7fa640 1 -- 172.21.15.52:0/1679140129 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560e99f2fd60 con 0x560e9a04d1c0 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f329d7fa640 10 client.21129 handle_command_reply: tid=0 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 client.21129 shutdown 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 msgr2=0x560e99fd6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f32b0099600 tx=0x7f32b000bf90 comp rx=0 tx=0).stop 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 shutdown_connections 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560e9a04d1c0 0x560e9a04f5b0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560e99fd1a90 0x560e99fd9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560e99fc2cc0 0x560e99fd68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 --2- 172.21.15.52:0/1679140129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560e99fc23a0 0x560e99fd6380 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f329d7fa640 0 client.21129 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:36:59.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 >> 172.21.15.52:0/1679140129 conn(0x560e99fbea30 msgr2=0x560e99fc3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 shutdown_connections 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 1 -- 172.21.15.52:0/1679140129 wait complete. 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32be19b740 20 client.21129 trim_cache size 0 max 16384 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:36:59.394 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:36:59.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.378+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 msgr2=0x7f32a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 0x7f32a00a5700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f32ac04c000 tx=0x7f32ac04d000 comp rx=0 tx=0).stop 2024-09-19T09:36:59.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 msgr2=0x7f32b4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b4a0 tx=0x7f32b000b960 comp rx=0 tx=0).stop 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 shutdown_connections 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b410c180 0x7f32b419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32a00a3240 0x7f32a00a5700 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32b4103700 0x7f32b41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 --2- 172.21.15.52:0/2801935513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b4102de0 0x7f32b4198470 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 >> 172.21.15.52:0/2801935513 conn(0x7f32b40fc7a0 msgr2=0x7f32b40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 shutdown_connections 2024-09-19T09:36:59.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:36:59.379+0000 7f32bbdc2640 1 -- 172.21.15.52:0/2801935513 wait complete. 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: pgmap v804: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:36:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:36:58 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:37:00.142 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:37:00.142 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:00.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 -- 172.21.15.52:0/423597904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe538102d40 msgr2=0x7fe538103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 --2- 172.21.15.52:0/423597904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe538102d40 0x7fe538103120 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fe534009900 tx=0x7fe53402a480 comp rx=0 tx=0).stop 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 -- 172.21.15.52:0/423597904 shutdown_connections 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 --2- 172.21.15.52:0/423597904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe53810c170 0x7fe53810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 --2- 172.21.15.52:0/423597904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538103660 0x7fe53810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 --2- 172.21.15.52:0/423597904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe538102d40 0x7fe538103120 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 -- 172.21.15.52:0/423597904 >> 172.21.15.52:0/423597904 conn(0x7fe5380fc7a0 msgr2=0x7fe5380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 -- 172.21.15.52:0/423597904 shutdown_connections 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.853+0000 7fe53fb38640 1 -- 172.21.15.52:0/423597904 wait complete. 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 Processor -- start 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 -- start start 2024-09-19T09:37:00.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 0x7fe5381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe538103660 0x7fe538198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe538111f70 con 0x7fe53810c170 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe538111df0 con 0x7fe538102d40 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53fb38640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe5381120f0 con 0x7fe538103660 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53e0d5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53e0d5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37712/0 (socket says 172.21.15.52:37712) 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53e0d5640 1 -- 172.21.15.52:0/3005487538 learned_addr learned my addr 172.21.15.52:0/3005487538 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53d0d3640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe538103660 0x7fe538198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.854+0000 7fe53d8d4640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 0x7fe5381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 -- 172.21.15.52:0/3005487538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe538103660 msgr2=0x7fe538198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe538103660 0x7fe538198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 -- 172.21.15.52:0/3005487538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 msgr2=0x7fe5381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 0x7fe5381983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 -- 172.21.15.52:0/3005487538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53819d390 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53d8d4640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 0x7fe5381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53e0d5640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cce0 tx=0x7fe53000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000f450 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe53000fad0 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53819d680 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe530018c10 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.855+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5381a4f60 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.856+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe538103120 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.857+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe53000f5f0 con 0x7fe53810c170 2024-09-19T09:37:00.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.858+0000 7fe52effd640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 0x7fe5240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.858+0000 7fe53d8d4640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 0x7fe5240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.858+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe5300d0010 con 0x7fe53810c170 2024-09-19T09:37:00.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.859+0000 7fe53d8d4640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 0x7fe5240a5700 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe534005ab0 tx=0x7fe534005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:00.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:00.861+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe530014030 con 0x7fe53810c170 2024-09-19T09:37:01.080 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:00 smithi052 ceph-mon[30947]: pgmap v805: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.077+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe538199740 con 0x7fe53810c170 2024-09-19T09:37:01.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.078+0000 7fe52effd640 1 -- 172.21.15.52:0/3005487538 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7fe538199740 con 0x7fe53810c170 2024-09-19T09:37:01.081 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:37:01.081 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:37:01.081 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 msgr2=0x7fe5240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 0x7fe5240a5700 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe534005ab0 tx=0x7fe534005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 msgr2=0x7fe53819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe53000cce0 tx=0x7fe53000a620 comp rx=0 tx=0).stop 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 shutdown_connections 2024-09-19T09:37:01.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe53810c170 0x7fe53819ccb0 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe5240a3240 0x7fe5240a5700 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe538103660 0x7fe538198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 --2- 172.21.15.52:0/3005487538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe538102d40 0x7fe5381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 >> 172.21.15.52:0/3005487538 conn(0x7fe5380fc7a0 msgr2=0x7fe5380fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 shutdown_connections 2024-09-19T09:37:01.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:01.080+0000 7fe53fb38640 1 -- 172.21.15.52:0/3005487538 wait complete. 2024-09-19T09:37:01.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:00 smithi086 ceph-mon[34813]: pgmap v805: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:01.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:00 smithi169 ceph-mon[35454]: pgmap v805: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:02.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:37:02.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3005487538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.281 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:02.402 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3005487538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3005487538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 -- 172.21.15.52:0/2975937510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084100a80 msgr2=0x7fa084100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 --2- 172.21.15.52:0/2975937510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084100a80 0x7fa084100ee0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fa078009930 tx=0x7fa07802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 -- 172.21.15.52:0/2975937510 shutdown_connections 2024-09-19T09:37:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 --2- 172.21.15.52:0/2975937510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084101420 0x7fa08410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 --2- 172.21.15.52:0/2975937510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084100a80 0x7fa084100ee0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 --2- 172.21.15.52:0/2975937510 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084106a80 0x7fa084106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 -- 172.21.15.52:0/2975937510 >> 172.21.15.52:0/2975937510 conn(0x7fa0840fc7a0 msgr2=0x7fa0840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 -- 172.21.15.52:0/2975937510 shutdown_connections 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.908+0000 7fa089348640 1 -- 172.21.15.52:0/2975937510 wait complete. 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 Processor -- start 2024-09-19T09:37:02.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 -- start start 2024-09-19T09:37:02.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100a80 0x7fa0841992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084106a80 0x7fa0841a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa084110e80 con 0x7fa084101420 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa084110d00 con 0x7fa084106a80 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa089348640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa084111000 con 0x7fa084100a80 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa0827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa0827fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37732/0 (socket says 172.21.15.52:37732) 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa0827fc640 1 -- 172.21.15.52:0/3788539913 learned_addr learned my addr 172.21.15.52:0/3788539913 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa082ffd640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100a80 0x7fa0841992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.909+0000 7fa0837fe640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084106a80 0x7fa0841a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 -- 172.21.15.52:0/3788539913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100a80 msgr2=0x7fa0841992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100a80 0x7fa0841992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 -- 172.21.15.52:0/3788539913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084106a80 msgr2=0x7fa0841a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084106a80 0x7fa0841a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 -- 172.21.15.52:0/3788539913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0841a4890 con 0x7fa084101420 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa0827fc640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fa078009230 tx=0x7fa078004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa06bfff640 1 -- 172.21.15.52:0/3788539913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07803f030 con 0x7fa084101420 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa06bfff640 1 -- 172.21.15.52:0/3788539913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa078003ad0 con 0x7fa084101420 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0841a4a60 con 0x7fa084101420 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa06bfff640 1 -- 172.21.15.52:0/3788539913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078035070 con 0x7fa084101420 2024-09-19T09:37:02.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.910+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0841a4eb0 con 0x7fa084101420 2024-09-19T09:37:02.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa06bfff640 1 -- 172.21.15.52:0/3788539913 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa078042030 con 0x7fa084101420 2024-09-19T09:37:02.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 Processor -- start 2024-09-19T09:37:02.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 -- start start 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 0x55b85bdb2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 0x55b85bdbf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b85bd182f0 con 0x55b85bdb3b40 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b85bcbfcf0 con 0x55b85bdb25d0 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa08b721740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b85bd142b0 con 0x55b85bdbd370 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37738/0 (socket says 172.21.15.52:37738) 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa0837fe640 1 -- 172.21.15.52:0/1584262227 learned_addr learned my addr 172.21.15.52:0/1584262227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:02.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa0827fc640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 0x55b85bdbf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.913+0000 7fa082ffd640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 0x55b85bdb2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 -- 172.21.15.52:0/1584262227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 msgr2=0x55b85bdbf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 0x55b85bdbf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 -- 172.21.15.52:0/1584262227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 msgr2=0x55b85bdb2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 0x55b85bdb2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 -- 172.21.15.52:0/1584262227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85bca43a0 con 0x55b85bdb3b40 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0827fc640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 0x55b85bdbf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa082ffd640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 0x55b85bdb2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa06bfff640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 0x7fa06c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa082ffd640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 0x7fa06c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0837fe640 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009fd0 tx=0x7fa07c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb36dcb1d0ce00be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa06bfff640 1 -- 172.21.15.52:0/3788539913 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa0780effc0 con 0x7fa084101420 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0697fa640 1 -- 172.21.15.52:0/1584262227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c004d20 con 0x55b85bdb3b40 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0697fa640 1 -- 172.21.15.52:0/1584262227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07c004050 con 0x55b85bdb3b40 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.914+0000 7fa0697fa640 1 -- 172.21.15.52:0/1584262227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c005260 con 0x55b85bdb3b40 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- 172.21.15.52:0/1584262227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 msgr2=0x55b85bdb2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009fd0 tx=0x7fa07c0118d0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa082ffd640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 0x7fa06c0a5700 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55b85bdafac0 tx=0x7fa07400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- 172.21.15.52:0/1584262227 shutdown_connections 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdbd370 0x55b85bdbf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb25d0 0x55b85bdb2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 --2- 172.21.15.52:0/1584262227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb3b40 0x55b85bdb2090 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- 172.21.15.52:0/1584262227 >> 172.21.15.52:0/1584262227 conn(0x55b85bd7b310 msgr2=0x55b85bdaec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- 172.21.15.52:0/1584262227 shutdown_connections 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- 172.21.15.52:0/1584262227 wait complete. 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 -- start start 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.915+0000 7fa08b721740 1 Processor -- start 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdb9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b85bdc0070 con 0x55b85bdb25d0 2024-09-19T09:37:02.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b85bcd3060 con 0x55b85bdbd370 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b85bdc01f0 con 0x55b85bdb3b40 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa08b721740 10 client.0 _ll_register_callbacks cb 0x55b85ba268c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37748/0 (socket says 172.21.15.52:37748) 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 -- 172.21.15.52:0/4118235077 learned_addr learned my addr 172.21.15.52:0/4118235077 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa0837fe640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa0827fc640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdb9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 -- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 msgr2=0x55b85bdb9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdb9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 -- 172.21.15.52:0/4118235077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 msgr2=0x55b85bdba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 -- 172.21.15.52:0/4118235077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b85ba893c0 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fa074003ec0 tx=0x7fa0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e233a735d30089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.916+0000 7fa066ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401b660 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa07401b800 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa07c004050 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa07401ba00 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 10 client.21147 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b85bdcbb90 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa07c004050 con 0x55b85bdb25d0 2024-09-19T09:37:02.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa074024070 con 0x55b85bdb25d0 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 10 client.21147 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 10 client.21147 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 20 client.21147 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85bdccfa0 0x55b85bdcf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 4 client.21147 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.917+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b85bd25860 con 0x55b85bdccfa0 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.918+0000 7fa0827fc640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85bdccfa0 0x55b85bdcf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.918+0000 7fa0827fc640 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85bdccfa0 0x55b85bdcf400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1143dfafb915ca97 server_cookie=1012296ff0749c83 in_seq=0 out_seq=0 2024-09-19T09:37:02.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.918+0000 7fa066ff5640 10 client.21147 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:02.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa066ff5640 1 -- 172.21.15.52:0/4118235077 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b85bd25860 con 0x55b85bdccfa0 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa066ff5640 10 client.21147 handle_command_reply: tid=0 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 client.21147 shutdown 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 msgr2=0x55b85bdbcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fa074003ec0 tx=0x7fa0740046c0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 shutdown_connections 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85bdccfa0 0x55b85bdcf400 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdb9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa066ff5640 0 client.21147 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 --2- 172.21.15.52:0/4118235077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdbcd40 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 >> 172.21.15.52:0/4118235077 conn(0x55b85bd7b310 msgr2=0x55b85bdb4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 shutdown_connections 2024-09-19T09:37:02.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 1 -- 172.21.15.52:0/4118235077 wait complete. 2024-09-19T09:37:02.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.919+0000 7fa08b721740 20 client.21147 trim_cache size 0 max 16384 2024-09-19T09:37:02.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 Processor -- start 2024-09-19T09:37:02.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 -- start start 2024-09-19T09:37:02.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdb5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841b0010 con 0x55b85bdb25d0 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841ad8e0 con 0x55b85bdbd370 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa08b721740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841ab730 con 0x55b85bdb3b40 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa082ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37756/0 (socket says 172.21.15.52:37756) 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.932+0000 7fa082ffd640 1 -- 172.21.15.52:0/4219067723 learned_addr learned my addr 172.21.15.52:0/4219067723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa0837fe640 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdb5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa0827fc640 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 -- 172.21.15.52:0/4219067723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 msgr2=0x55b85bdae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 -- 172.21.15.52:0/4219067723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 msgr2=0x55b85bdb5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdb5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 -- 172.21.15.52:0/4219067723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85bdcfa80 con 0x55b85bdb25d0 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fa0740264c0 tx=0x7fa074012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d59ef9021c239b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa068ff9640 1 -- 172.21.15.52:0/4219067723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401b460 con 0x55b85bdb25d0 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa068ff9640 1 -- 172.21.15.52:0/4219067723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa074035070 con 0x55b85bdb25d0 2024-09-19T09:37:02.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.933+0000 7fa068ff9640 1 -- 172.21.15.52:0/4219067723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074026b50 con 0x55b85bdb25d0 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- 172.21.15.52:0/4219067723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 msgr2=0x55b85bdadbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fa0740264c0 tx=0x7fa074012cb0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- 172.21.15.52:0/4219067723 shutdown_connections 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdbd370 0x55b85bdb5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb3b40 0x55b85bdae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 --2- 172.21.15.52:0/4219067723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdb25d0 0x55b85bdadbf0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- 172.21.15.52:0/4219067723 >> 172.21.15.52:0/4219067723 conn(0x55b85bd7b310 msgr2=0x55b85bdad4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- 172.21.15.52:0/4219067723 shutdown_connections 2024-09-19T09:37:02.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- 172.21.15.52:0/4219067723 wait complete. 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 -- start start 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.934+0000 7fa08b721740 1 Processor -- start 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 0x55b85bdc5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb3b40 0x55b85bdb6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841abda0 con 0x55b85bdbd370 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841ad210 con 0x55b85bdb3b40 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841ac470 con 0x55b85bdb25d0 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa08b721740 10 client.0 _ll_register_callbacks cb 0x7fa074004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37772/0 (socket says 172.21.15.52:37772) 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 -- 172.21.15.52:0/4103503991 learned_addr learned my addr 172.21.15.52:0/4103503991 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 0x55b85bdc5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0827fc640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb3b40 0x55b85bdb6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 -- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 msgr2=0x55b85bdc5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 0x55b85bdc5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 -- 172.21.15.52:0/4103503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb3b40 msgr2=0x55b85bdb6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb3b40 0x55b85bdb6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 -- 172.21.15.52:0/4103503991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b85be3b100 con 0x55b85bdbd370 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 0x55b85bdc5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:02.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa0837fe640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fa07c000f80 tx=0x7fa07c0052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75462fc650be236b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.935+0000 7fa066ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c009c50 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fa07c005670 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa074035070 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa07c031030 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 10 client.21153 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b85be3c250 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa074035070 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa07c036430 con 0x55b85bdbd370 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 10 client.21153 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 10 client.21153 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:37:02.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 20 client.21153 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85be3c780 0x55b85be3eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 4 client.21153 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.936+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b85bd1fd70 con 0x55b85be3c780 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85be3c780 0x55b85be3eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa082ffd640 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85be3c780 0x55b85be3eb70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6be196981f4706d7 server_cookie=eecce51460777c83 in_seq=0 out_seq=0 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa066ff5640 10 client.21153 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa066ff5640 1 -- 172.21.15.52:0/4103503991 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b85bd1fd70 con 0x55b85be3c780 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa066ff5640 10 client.21153 handle_command_reply: tid=0 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 client.21153 shutdown 2024-09-19T09:37:02.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 msgr2=0x55b85bdb75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fa07c000f80 tx=0x7fa07c0052f0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 shutdown_connections 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55b85be3c780 0x55b85be3eb70 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b85bdbd370 0x55b85bdb75f0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b85bdb3b40 0x55b85bdb6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 --2- 172.21.15.52:0/4103503991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b85bdb25d0 0x55b85bdc5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 >> 172.21.15.52:0/4103503991 conn(0x55b85bd7b310 msgr2=0x55b85bdadd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa066ff5640 0 client.21153 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.937+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 shutdown_connections 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa08b721740 1 -- 172.21.15.52:0/4103503991 wait complete. 2024-09-19T09:37:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa08b721740 20 client.21153 trim_cache size 0 max 16384 2024-09-19T09:37:02.948 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 msgr2=0x7fa06c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 0x7fa06c0a5700 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55b85bdafac0 tx=0x7fa07400b390 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 msgr2=0x7fa084199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fa078009230 tx=0x7fa078004270 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 shutdown_connections 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa084106a80 0x7fa0841a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa084101420 0x7fa084199810 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fa06c0a3240 0x7fa06c0a5700 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 --2- 172.21.15.52:0/3788539913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa084100a80 0x7fa0841992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 >> 172.21.15.52:0/3788539913 conn(0x7fa0840fc7a0 msgr2=0x7fa0840fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.938+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 shutdown_connections 2024-09-19T09:37:02.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:02.939+0000 7fa089348640 1 -- 172.21.15.52:0/3788539913 wait complete. 2024-09-19T09:37:03.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:02 smithi086 ceph-mon[34813]: pgmap v806: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:37:03.320 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:02 smithi052 ceph-mon[30947]: pgmap v806: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:37:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:02 smithi169 ceph-mon[35454]: pgmap v806: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T09:37:03.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:37:03.904 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:04.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.412+0000 7fcff0de0640 1 -- 172.21.15.52:0/1978629199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 msgr2=0x7fcfec10dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.412+0000 7fcff0de0640 1 --2- 172.21.15.52:0/1978629199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec10dbd0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009ca0 tx=0x7fcfe402a8b0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 -- 172.21.15.52:0/1978629199 shutdown_connections 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 --2- 172.21.15.52:0/1978629199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec10dbd0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 --2- 172.21.15.52:0/1978629199 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101df0 0x7fcfec105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 --2- 172.21.15.52:0/1978629199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101440 0x7fcfec101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 -- 172.21.15.52:0/1978629199 >> 172.21.15.52:0/1978629199 conn(0x7fcfec077210 msgr2=0x7fcfec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 -- 172.21.15.52:0/1978629199 shutdown_connections 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 -- 172.21.15.52:0/1978629199 wait complete. 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.413+0000 7fcff0de0640 1 Processor -- start 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 -- start start 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101440 0x7fcfec196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101df0 0x7fcfec196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec10ffb0 con 0x7fcfec106050 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec10fe30 con 0x7fcfec101df0 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcff0de0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec110130 con 0x7fcfec101440 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37786/0 (socket says 172.21.15.52:37786) 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 -- 172.21.15.52:0/2417332710 learned_addr learned my addr 172.21.15.52:0/2417332710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101df0 0x7fcfec196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfea59c640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101440 0x7fcfec196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 -- 172.21.15.52:0/2417332710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101440 msgr2=0x7fcfec196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101440 0x7fcfec196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 -- 172.21.15.52:0/2417332710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101df0 msgr2=0x7fcfec196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101df0 0x7fcfec196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.414+0000 7fcfead9d640 1 -- 172.21.15.52:0/2417332710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec19b400 con 0x7fcfec106050 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcfead9d640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006010 tx=0x7fcfe4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcfdb7fe640 1 -- 172.21.15.52:0/2417332710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4003d80 con 0x7fcfec106050 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcfdb7fe640 1 -- 172.21.15.52:0/2417332710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe4040070 con 0x7fcfec106050 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec19b690 con 0x7fcfec106050 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcfdb7fe640 1 -- 172.21.15.52:0/2417332710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4045aa0 con 0x7fcfec106050 2024-09-19T09:37:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.415+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec19bb10 con 0x7fcfec106050 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.418+0000 7fcfdb7fe640 1 -- 172.21.15.52:0/2417332710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcfe4031440 con 0x7fcfec106050 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.418+0000 7fcff31b9740 1 Processor -- start 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.418+0000 7fcff31b9740 1 -- start start 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bc5d0 0x562aca7bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7c7370 0x562aca7c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562aca7222f0 con 0x562aca7bdb40 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562aca6c9cf0 con 0x562aca7c7370 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcff31b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562aca71e2b0 con 0x562aca7bc5d0 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfdb7fe640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 0x7fcfd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37794/0 (socket says 172.21.15.52:37794) 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/2009910872 learned_addr learned my addr 172.21.15.52:0/2009910872 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfdb7fe640 1 -- 172.21.15.52:0/2417332710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcfe40f0e00 con 0x7fcfec106050 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfead9d640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 0x7fcfd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/2009910872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bc5d0 msgr2=0x562aca7bca10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bc5d0 0x562aca7bca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/2009910872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7c7370 msgr2=0x562aca7c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7c7370 0x562aca7c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.419+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/2009910872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aca6ae3a0 con 0x562aca7bdb40 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.420+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000bdd0 tx=0x7fcfe00165b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921162651e628191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.420+0000 7fcfead9d640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 0x7fcfd40a5700 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b9e00 tx=0x7fcfe4045500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.420+0000 7fcfd8ff9640 1 -- 172.21.15.52:0/2009910872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0016cc0 con 0x562aca7bdb40 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.420+0000 7fcfd8ff9640 1 -- 172.21.15.52:0/2009910872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe0005500 con 0x562aca7bdb40 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcfd8ff9640 1 -- 172.21.15.52:0/2009910872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe001a670 con 0x562aca7bdb40 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 -- 172.21.15.52:0/2009910872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 msgr2=0x562aca7bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000bdd0 tx=0x7fcfe00165b0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 -- 172.21.15.52:0/2009910872 shutdown_connections 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7c7370 0x562aca7c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bc5d0 0x562aca7bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 --2- 172.21.15.52:0/2009910872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bdb40 0x562aca7bc090 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 -- 172.21.15.52:0/2009910872 >> 172.21.15.52:0/2009910872 conn(0x562aca785310 msgr2=0x562aca7b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 -- 172.21.15.52:0/2009910872 shutdown_connections 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.421+0000 7fcff31b9740 1 -- 172.21.15.52:0/2009910872 wait complete. 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 -- start start 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 Processor -- start 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7c7370 0x562aca7c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562aca7ca0b0 con 0x562aca7bc5d0 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562aca6dd060 con 0x562aca7bdb40 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562aca7ca230 con 0x562aca7c7370 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.422+0000 7fcff31b9740 10 client.0 _ll_register_callbacks cb 0x562aca4308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37810/0 (socket says 172.21.15.52:37810) 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/1522998941 learned_addr learned my addr 172.21.15.52:0/1522998941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfea59c640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/1522998941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7c7370 msgr2=0x562aca7c4600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7c7370 0x562aca7c4600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 msgr2=0x562aca7c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/1522998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aca4933c0 con 0x562aca7bc5d0 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.423+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b6c0 tx=0x7fcfe0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58dcce68add096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcfd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0005130 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcfe00052d0 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfe0005500 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcfe002c410 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcff31b9740 10 client.21165 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562aca7d5b50 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.424+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfe0027070 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcfe0022490 con 0x562aca7bc5d0 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 10 client.21165 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 10 client.21165 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 20 client.21165 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca7d6ea0 0x562aca7d9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 4 client.21165 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcfe0005500 con 0x562aca7d6ea0 2024-09-19T09:37:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcfea59c640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca7d6ea0 0x562aca7d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcfea59c640 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca7d6ea0 0x562aca7d9290 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a220620c6f8b2ef5 server_cookie=606f89d973c98ee3 in_seq=0 out_seq=0 2024-09-19T09:37:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.425+0000 7fcfd1ffb640 10 client.21165 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.426+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/1522998941 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fcfe0005500 con 0x562aca7d6ea0 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.426+0000 7fcfd1ffb640 10 client.21165 handle_command_reply: tid=0 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.426+0000 7fcff31b9740 1 client.21165 shutdown 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 msgr2=0x562aca7c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b6c0 tx=0x7fcfe0005780 comp rx=0 tx=0).stop 2024-09-19T09:37:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 shutdown_connections 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7c7370 0x562aca7c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca7d6ea0 0x562aca7d9290 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 --2- 172.21.15.52:0/1522998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7bc5d0 0x562aca7c6d60 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 >> 172.21.15.52:0/1522998941 conn(0x562aca785310 msgr2=0x562aca7be960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcfd1ffb640 0 client.21165 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 shutdown_connections 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 1 -- 172.21.15.52:0/1522998941 wait complete. 2024-09-19T09:37:04.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.427+0000 7fcff31b9740 20 client.21165 trim_cache size 0 max 16384 2024-09-19T09:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.440+0000 7fcff31b9740 1 Processor -- start 2024-09-19T09:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.440+0000 7fcff31b9740 1 -- start start 2024-09-19T09:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1ade00 con 0x562aca7c7370 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1ab6d0 con 0x562aca7bdb40 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcff31b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1a9520 con 0x562aca7bf120 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37814/0 (socket says 172.21.15.52:37814) 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 -- 172.21.15.52:0/3686266284 learned_addr learned my addr 172.21.15.52:0/3686266284 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 -- 172.21.15.52:0/3686266284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 msgr2=0x562aca7bf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7bf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 -- 172.21.15.52:0/3686266284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 msgr2=0x562aca7d3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7d3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.441+0000 7fcfea59c640 1 -- 172.21.15.52:0/3686266284 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aca7c70d0 con 0x562aca7c7370 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.442+0000 7fcfea59c640 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x562aca7c7340 tx=0x7fcfdc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cae009174985648 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.442+0000 7fcfd3fff640 1 -- 172.21.15.52:0/3686266284 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc02b070 con 0x562aca7c7370 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.442+0000 7fcfd3fff640 1 -- 172.21.15.52:0/3686266284 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc004310 con 0x562aca7c7370 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.442+0000 7fcfd3fff640 1 -- 172.21.15.52:0/3686266284 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc01a430 con 0x562aca7c7370 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- 172.21.15.52:0/3686266284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 msgr2=0x562aca7c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x562aca7c7340 tx=0x7fcfdc005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- 172.21.15.52:0/3686266284 shutdown_connections 2024-09-19T09:37:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7c38d0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 --2- 172.21.15.52:0/3686266284 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- 172.21.15.52:0/3686266284 >> 172.21.15.52:0/3686266284 conn(0x562aca785310 msgr2=0x562aca7b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- 172.21.15.52:0/3686266284 shutdown_connections 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- 172.21.15.52:0/3686266284 wait complete. 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 -- start start 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.443+0000 7fcff31b9740 1 Processor -- start 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1a9b90 con 0x562aca7c7370 2024-09-19T09:37:04.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1ab000 con 0x562aca7bdb40 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec1aa260 con 0x562aca7bf120 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcff31b9740 10 client.0 _ll_register_callbacks cb 0x7fcfe000bcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37822/0 (socket says 172.21.15.52:37822) 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/4143077075 learned_addr learned my addr 172.21.15.52:0/4143077075 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:04.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfea59c640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/4143077075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 msgr2=0x562aca7cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/4143077075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 msgr2=0x562aca7cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:04.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.444+0000 7fcfe9d9b640 1 -- 172.21.15.52:0/4143077075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aca840860 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfe9d9b640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7cb1f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0017010 tx=0x7fcfe0005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff9d4ea962e3c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0004b20 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfdc004310 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcfe001aa50 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcfe0004cc0 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcff31b9740 10 client.29537 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562aca841ac0 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.445+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc004310 con 0x562aca7bdb40 2024-09-19T09:37:04.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcfe0036040 con 0x562aca7bdb40 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 10 client.29537 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 10 client.29537 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 20 client.29537 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca842180 0x562aca844570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 4 client.29537 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562aca72f860 con 0x562aca842180 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcfea59c640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca842180 0x562aca844570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcfd1ffb640 10 client.29537 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.446+0000 7fcfea59c640 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca842180 0x562aca844570 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8bd839e6125f899 server_cookie=53f1de2288973a2d in_seq=0 out_seq=0 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcfd1ffb640 1 -- 172.21.15.52:0/4143077075 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562aca72f860 con 0x562aca842180 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcfd1ffb640 10 client.29537 handle_command_reply: tid=0 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 client.29537 shutdown 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 msgr2=0x562aca7cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7cb1f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0017010 tx=0x7fcfe0005780 comp rx=0 tx=0).stop 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 shutdown_connections 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562aca7c7370 0x562aca7cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562aca7bf120 0x562aca7cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x562aca842180 0x562aca844570 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 --2- 172.21.15.52:0/4143077075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562aca7bdb40 0x562aca7cb1f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 >> 172.21.15.52:0/4143077075 conn(0x562aca785310 msgr2=0x562aca7b7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.447+0000 7fcfd1ffb640 0 client.29537 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 shutdown_connections 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff31b9740 1 -- 172.21.15.52:0/4143077075 wait complete. 2024-09-19T09:37:04.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff31b9740 20 client.29537 trim_cache size 0 max 16384 2024-09-19T09:37:04.455 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:04.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 msgr2=0x7fcfd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 0x7fcfd40a5700 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b9e00 tx=0x7fcfe4045500 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 msgr2=0x7fcfec19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.448+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006010 tx=0x7fcfe4009800 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 shutdown_connections 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfec106050 0x7fcfec19ad20 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcfec101df0 0x7fcfec196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcfd40a3240 0x7fcfd40a5700 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 --2- 172.21.15.52:0/2417332710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfec101440 0x7fcfec196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 >> 172.21.15.52:0/2417332710 conn(0x7fcfec077210 msgr2=0x7fcfec104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 shutdown_connections 2024-09-19T09:37:04.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:04.449+0000 7fcff0de0640 1 -- 172.21.15.52:0/2417332710 wait complete. 2024-09-19T09:37:05.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:37:05.233 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:05.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:04 smithi086 ceph-mon[34813]: pgmap v807: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:05.356 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:04 smithi052 ceph-mon[30947]: pgmap v807: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:05.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:04 smithi169 ceph-mon[35454]: pgmap v807: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 -- 172.21.15.52:0/950087634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 msgr2=0x7f6504101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 --2- 172.21.15.52:0/950087634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f6504101200 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f6500009900 tx=0x7f650002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 -- 172.21.15.52:0/950087634 shutdown_connections 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 --2- 172.21.15.52:0/950087634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 0x7f650410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 --2- 172.21.15.52:0/950087634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f65041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 --2- 172.21.15.52:0/950087634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f6504101200 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 -- 172.21.15.52:0/950087634 >> 172.21.15.52:0/950087634 conn(0x7f65040fc7d0 msgr2=0x7f65040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 -- 172.21.15.52:0/950087634 shutdown_connections 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 -- 172.21.15.52:0/950087634 wait complete. 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.731+0000 7f650c60e640 1 Processor -- start 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 -- start start 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f6504198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 0x7f650419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6504110fa0 con 0x7f6504100e20 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6504110e20 con 0x7f6504102570 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650c60e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6504111120 con 0x7f6504102ef0 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37852/0 (socket says 172.21.15.52:37852) 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 -- 172.21.15.52:0/4250337469 learned_addr learned my addr 172.21.15.52:0/4250337469 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f6509ba9640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f6504198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650abab640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 0x7f650419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 -- 172.21.15.52:0/4250337469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 msgr2=0x7f650419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 0x7f650419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 -- 172.21.15.52:0/4250337469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 msgr2=0x7f6504198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f6504198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f650a3aa640 1 -- 172.21.15.52:0/4250337469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650419d590 con 0x7f6504100e20 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.732+0000 7f6509ba9640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f6504198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f650a3aa640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f6500006010 tx=0x7f6500003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650003f070 con 0x7f6504100e20 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650419d820 con 0x7f6504100e20 2024-09-19T09:37:05.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6500031c30 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500035030 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.733+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65041a5160 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.734+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65041021b0 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.735+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6500042070 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.736+0000 7f64fb7fe640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 0x7f64f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.736+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f65000f0650 con 0x7f6504100e20 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.736+0000 7f6509ba9640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 0x7f64f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.736+0000 7f6509ba9640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 0x7f64f00a5700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6504100030 tx=0x7f64f400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.739+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6500031de0 con 0x7f6504100e20 2024-09-19T09:37:05.845 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:05.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.962+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6504101200 con 0x7f6504100e20 2024-09-19T09:37:05.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.962+0000 7f64fb7fe640 1 -- 172.21.15.52:0/4250337469 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f65000bd3b0 con 0x7f6504100e20 2024-09-19T09:37:05.964 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:37:05.965 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:37:05.965 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:37:05.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.964+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 msgr2=0x7f64f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.964+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 0x7f64f00a5700 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6504100030 tx=0x7f64f400b390 comp rx=0 tx=0).stop 2024-09-19T09:37:05.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 msgr2=0x7f65041985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f6500006010 tx=0x7f6500003c10 comp rx=0 tx=0).stop 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 shutdown_connections 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a3240 0x7f64f00a5700 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6504102ef0 0x7f650419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6504102570 0x7f6504198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 --2- 172.21.15.52:0/4250337469 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6504100e20 0x7f65041985e0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 >> 172.21.15.52:0/4250337469 conn(0x7f65040fc7d0 msgr2=0x7f650406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 shutdown_connections 2024-09-19T09:37:05.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:05.965+0000 7f650c60e640 1 -- 172.21.15.52:0/4250337469 wait complete. 2024-09-19T09:37:06.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/4250337469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:06.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/4250337469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:06.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/4250337469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:06.775 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --set-id d53bd4b4 --release --await' 2024-09-19T09:37:06.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --set-id d53bd4b4 --release --await 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- 172.21.15.52:0/2941371056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0580102660 msgr2=0x7f0580104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 --2- 172.21.15.52:0/2941371056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0580102660 0x7f0580104a50 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f057c009900 tx=0x7f057c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- 172.21.15.52:0/2941371056 shutdown_connections 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 --2- 172.21.15.52:0/2941371056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05801078c0 0x7f0580109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 --2- 172.21.15.52:0/2941371056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 --2- 172.21.15.52:0/2941371056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0580102660 0x7f0580104a50 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- 172.21.15.52:0/2941371056 >> 172.21.15.52:0/2941371056 conn(0x7f05800fc1e0 msgr2=0x7f05800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- 172.21.15.52:0/2941371056 shutdown_connections 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- 172.21.15.52:0/2941371056 wait complete. 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 Processor -- start 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.936+0000 7f058792a640 1 -- start start 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 0x7f0580197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f058010d7e0 con 0x7f05801078c0 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f058010d660 con 0x7f0580104f90 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f058792a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f058010d960 con 0x7f0580102660 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.941 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:54878/0 (socket says 172.21.15.52:54878) 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37868/0 (socket says 172.21.15.52:37868) 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0584ec5640 1 -- 172.21.15.52:0/375354095 learned_addr learned my addr 172.21.15.52:0/375354095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f05856c6640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 0x7f0580197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 -- 172.21.15.52:0/375354095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 msgr2=0x7f0580197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 0x7f0580197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 -- 172.21.15.52:0/375354095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 msgr2=0x7f0580198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 -- 172.21.15.52:0/375354095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058019fa70 con 0x7f05801078c0 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f05856c6640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 0x7f0580197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0584ec5640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.937+0000 7f0585ec7640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f0578005fd0 tx=0x7f057800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.938+0000 7f05767fc640 1 -- 172.21.15.52:0/375354095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578017020 con 0x7f05801078c0 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.938+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058019fd60 con 0x7f05801078c0 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.938+0000 7f05767fc640 1 -- 172.21.15.52:0/375354095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057800bd40 con 0x7f05801078c0 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.938+0000 7f05767fc640 1 -- 172.21.15.52:0/375354095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057800f920 con 0x7f05801078c0 2024-09-19T09:37:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.938+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05801a0200 con 0x7f05801078c0 2024-09-19T09:37:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.940+0000 7f058a6c4740 1 Processor -- start 2024-09-19T09:37:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.940+0000 7f05767fc640 1 -- 172.21.15.52:0/375354095 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f057801a020 con 0x7f05801078c0 2024-09-19T09:37:06.950 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 -- start start 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aeada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 0x560178aefda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560178a4e2f0 con 0x560178af0370 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5601789f6270 con 0x560178aea9a0 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f058a6c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560178a4a2b0 con 0x560178aeb2e0 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37870/0 (socket says 172.21.15.52:37870) 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 -- 172.21.15.52:0/519496929 learned_addr learned my addr 172.21.15.52:0/519496929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aeada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f05856c6640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 0x560178aefda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.951 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 -- 172.21.15.52:0/519496929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 msgr2=0x560178aefda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 0x560178aefda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 -- 172.21.15.52:0/519496929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 msgr2=0x560178aeada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aeada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f0584ec5640 1 -- 172.21.15.52:0/519496929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601789f5340 con 0x560178af0370 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.941+0000 7f05856c6640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 0x560178aefda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f0584ec5640 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0570012c10 tx=0x7f057000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f23cdbe32a30ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f05767fc640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 0x7f056c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f05856c6640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 0x7f056c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f05767fc640 1 -- 172.21.15.52:0/375354095 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f05780cfac0 con 0x7f05801078c0 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f056b7fe640 1 -- 172.21.15.52:0/519496929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570012d00 con 0x560178af0370 2024-09-19T09:37:06.952 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f056b7fe640 1 -- 172.21.15.52:0/519496929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0570010c00 con 0x560178af0370 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.942+0000 7f056b7fe640 1 -- 172.21.15.52:0/519496929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057001d370 con 0x560178af0370 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- 172.21.15.52:0/519496929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 msgr2=0x560178af2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f05856c6640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 0x7f056c0a57b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f057c000c00 tx=0x7f057c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f0570012c10 tx=0x7f057000bc10 comp rx=0 tx=0).stop 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- 172.21.15.52:0/519496929 shutdown_connections 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178af0370 0x560178af2830 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aeb2e0 0x560178aefda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 --2- 172.21.15.52:0/519496929 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aeada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- 172.21.15.52:0/519496929 >> 172.21.15.52:0/519496929 conn(0x560178ae6010 msgr2=0x560178ae6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- 172.21.15.52:0/519496929 shutdown_connections 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- 172.21.15.52:0/519496929 wait complete. 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 -- start start 2024-09-19T09:37:06.953 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.943+0000 7f058a6c4740 1 Processor -- start 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 0x560178af50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178afc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560178af3340 con 0x560178aea9a0 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5601789d7290 con 0x560178aeb2e0 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560178af34c0 con 0x560178af0370 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f058a6c4740 10 client.0 _ll_register_callbacks cb 0x560178a08140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37876/0 (socket says 172.21.15.52:37876) 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 -- 172.21.15.52:0/3422028333 learned_addr learned my addr 172.21.15.52:0/3422028333 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f0584ec5640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 0x560178af50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.954 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f0585ec7640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178afc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 -- 172.21.15.52:0/3422028333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 msgr2=0x560178afc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178afc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 -- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 msgr2=0x560178af50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 0x560178af50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f05856c6640 1 -- 172.21.15.52:0/3422028333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560178761210 con 0x560178aea9a0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.944+0000 7f0584ec5640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 0x560178af50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f05856c6640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f057c02a930 tx=0x7f057c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d9018c8686a762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f0568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c04b020 con 0x560178aea9a0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f057c005260 con 0x560178aea9a0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0570010c00 con 0x560178aea9a0 2024-09-19T09:37:06.955 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f057c056050 con 0x560178aea9a0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f058a6c4740 10 client.21189 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56017882d620 con 0x560178aea9a0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.945+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0570010c00 con 0x560178aea9a0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f057c0035f0 con 0x560178aea9a0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 10 client.21189 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 10 client.21189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 20 client.21189 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b02c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 4 client.21189 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560178a5ba20 con 0x560178b007e0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f0584ec5640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b02c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f0584ec5640 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b02c30 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75024ff101952eee server_cookie=fb73a7e4de5f5d7 in_seq=0 out_seq=0 2024-09-19T09:37:06.956 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.946+0000 7f0568ff9640 10 client.21189 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f0568ff9640 1 -- 172.21.15.52:0/3422028333 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560178a5ba20 con 0x560178b007e0 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f0568ff9640 10 client.21189 handle_command_reply: tid=0 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 client.21189 shutdown 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 msgr2=0x560178af4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f057c02a930 tx=0x7f057c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 shutdown_connections 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b02c30 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178afc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aeb2e0 0x560178af50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f0568ff9640 0 client.21189 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 --2- 172.21.15.52:0/3422028333 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aea9a0 0x560178af4b90 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.957 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 >> 172.21.15.52:0/3422028333 conn(0x560178ae6010 msgr2=0x560178ae7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 shutdown_connections 2024-09-19T09:37:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.947+0000 7f058a6c4740 1 -- 172.21.15.52:0/3422028333 wait complete. 2024-09-19T09:37:06.958 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.948+0000 7f058a6c4740 20 client.21189 trim_cache size 0 max 16384 2024-09-19T09:37:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 Processor -- start 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 -- start start 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aead80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178ae63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05801add90 con 0x560178aeb2e0 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05801ab660 con 0x560178aea9a0 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f058a6c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05801a94b0 con 0x560178af0370 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37896/0 (socket says 172.21.15.52:37896) 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f0584ec5640 1 -- 172.21.15.52:0/58652723 learned_addr learned my addr 172.21.15.52:0/58652723 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f0585ec7640 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178ae63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.964+0000 7f05856c6640 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aead80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 -- 172.21.15.52:0/58652723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 msgr2=0x560178ae63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178ae63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 -- 172.21.15.52:0/58652723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 msgr2=0x560178aead80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aead80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 -- 172.21.15.52:0/58652723 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560178ae5e30 con 0x560178aeb2e0 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f0584ec5640 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f0570012be0 tx=0x7f0570005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3796d224401271 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f056affd640 1 -- 172.21.15.52:0/58652723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570012d00 con 0x560178aeb2e0 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f056affd640 1 -- 172.21.15.52:0/58652723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0570016040 con 0x560178aeb2e0 2024-09-19T09:37:06.968 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.965+0000 7f056affd640 1 -- 172.21.15.52:0/58652723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057001e740 con 0x560178aeb2e0 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 -- 172.21.15.52:0/482742798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 msgr2=0x7fcad41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 --2- 172.21.15.52:0/482742798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad41029b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009890 tx=0x7fcac402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 -- 172.21.15.52:0/482742798 shutdown_connections 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 --2- 172.21.15.52:0/482742798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 --2- 172.21.15.52:0/482742798 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad41029b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 --2- 172.21.15.52:0/482742798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 -- 172.21.15.52:0/482742798 >> 172.21.15.52:0/482742798 conn(0x7fcad40fc7d0 msgr2=0x7fcad40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 -- 172.21.15.52:0/482742798 shutdown_connections 2024-09-19T09:37:06.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.961+0000 7fcadbc31640 1 -- 172.21.15.52:0/482742798 wait complete. 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 Processor -- start 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 -- start start 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41120a0 con 0x7fcad4102ef0 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcad4111f20 con 0x7fcad4102570 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcadbc31640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcad4112220 con 0x7fcad4100e20 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcad99cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcad99cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:36820/0 (socket says 172.21.15.52:36820) 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37888/0 (socket says 172.21.15.52:37888) 2024-09-19T09:37:06.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcad99cd640 1 -- 172.21.15.52:0/2332257461 learned_addr learned my addr 172.21.15.52:0/2332257461 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.962+0000 7fcad91cc640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 -- 172.21.15.52:0/2332257461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 msgr2=0x7fcad419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 -- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 msgr2=0x7fcad419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 -- 172.21.15.52:0/2332257461 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad419f700 con 0x7fcad4100e20 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcada1ce640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcad99cd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcad000e9f0 tx=0x7fcad000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcacaffd640 1 -- 172.21.15.52:0/2332257461 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad000cd80 con 0x7fcad4100e20 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad419f9f0 con 0x7fcad4100e20 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcacaffd640 1 -- 172.21.15.52:0/2332257461 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcad0010910 con 0x7fcad4100e20 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcacaffd640 1 -- 172.21.15.52:0/2332257461 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00188f0 con 0x7fcad4100e20 2024-09-19T09:37:06.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.963+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad41a72d0 con 0x7fcad4100e20 2024-09-19T09:37:06.972 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 -- 172.21.15.52:0/58652723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 msgr2=0x560178afc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f0570012be0 tx=0x7f0570005f30 comp rx=0 tx=0).stop 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 -- 172.21.15.52:0/58652723 shutdown_connections 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178af0370 0x560178ae63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178afc0a0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 --2- 172.21.15.52:0/58652723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178aea9a0 0x560178aead80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.973 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.966+0000 7f058a6c4740 1 -- 172.21.15.52:0/58652723 >> 172.21.15.52:0/58652723 conn(0x560178ae6010 msgr2=0x560178af4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.966+0000 7fcade00a740 1 Processor -- start 2024-09-19T09:37:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.967+0000 7f058a6c4740 1 -- 172.21.15.52:0/58652723 shutdown_connections 2024-09-19T09:37:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.967+0000 7f058a6c4740 1 -- 172.21.15.52:0/58652723 wait complete. 2024-09-19T09:37:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 -- start start 2024-09-19T09:37:06.974 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.967+0000 7f058a6c4740 1 -- start start 2024-09-19T09:37:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.967+0000 7f058a6c4740 1 Processor -- start 2024-09-19T09:37:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af81d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557af812f2f0 con 0x557af81cab40 2024-09-19T09:37:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557af80d6cf0 con 0x557af81d4370 2024-09-19T09:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 0x560178af8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.976 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcade00a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557af812b2b0 con 0x557af81c95d0 2024-09-19T09:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178af0370 0x560178b69500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05801a9b20 con 0x560178aeb2e0 2024-09-19T09:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f05801aaf90 con 0x560178af0370 2024-09-19T09:37:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f05801aa1f0 con 0x560178aea9a0 2024-09-19T09:37:06.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcacaffd640 1 -- 172.21.15.52:0/2332257461 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcad0010ac0 con 0x7fcad4100e20 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f058a6c4740 10 client.0 _ll_register_callbacks cb 0x7f057c031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37924/0 (socket says 172.21.15.52:37924) 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 -- 172.21.15.52:0/4041573730 learned_addr learned my addr 172.21.15.52:0/4041573730 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f05856c6640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 0x560178af8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0585ec7640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178af0370 0x560178b69500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37910/0 (socket says 172.21.15.52:37910) 2024-09-19T09:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 -- 172.21.15.52:0/4041573730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 msgr2=0x560178af8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 0x560178af8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 -- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178af0370 msgr2=0x560178b69500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178af0370 0x560178b69500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 -- 172.21.15.52:0/4041573730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560178b69a40 con 0x560178aeb2e0 2024-09-19T09:37:06.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcada1ce640 1 -- 172.21.15.52:0/1700331013 learned_addr learned my addr 172.21.15.52:0/1700331013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f05856c6640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 0x560178af8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcad91cc640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af81d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0584ec5640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f057000b6c0 tx=0x7f0570012d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223a6076c43d2c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.968+0000 7f0568ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:06.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.967+0000 7fcad99cd640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570005050 con 0x560178aeb2e0 2024-09-19T09:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0570016040 con 0x560178aeb2e0 2024-09-19T09:37:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcada1ce640 1 -- 172.21.15.52:0/1700331013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 msgr2=0x557af81c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcada1ce640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f05700051f0 con 0x560178aeb2e0 2024-09-19T09:37:06.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcada1ce640 1 -- 172.21.15.52:0/1700331013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 msgr2=0x557af81d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f05700053f0 con 0x560178aeb2e0 2024-09-19T09:37:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f058a6c4740 10 client.21204 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560178b6ac60 con 0x560178aeb2e0 2024-09-19T09:37:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcada1ce640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af81d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcada1ce640 1 -- 172.21.15.52:0/1700331013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af80bb3a0 con 0x557af81cab40 2024-09-19T09:37:06.984 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.969+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0570016040 con 0x560178aeb2e0 2024-09-19T09:37:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcad99cd640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcad91cc640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af81d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0570003830 con 0x560178aeb2e0 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 10 client.21204 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 10 client.21204 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 20 client.21204 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 4 client.21204 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:37:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560178a55d70 con 0x560178b007e0 2024-09-19T09:37:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.968+0000 7fcacaffd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcad99cd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcacaffd640 1 -- 172.21.15.52:0/2332257461 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcad00cfd80 con 0x7fcad4100e20 2024-09-19T09:37:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.970+0000 7f05856c6640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcada1ce640 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00eb00 tx=0x7fcacc009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720c311d34db44d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcabffff640 1 -- 172.21.15.52:0/1700331013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc01d070 con 0x557af81cab40 2024-09-19T09:37:06.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcabffff640 1 -- 172.21.15.52:0/1700331013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcacc003e50 con 0x557af81cab40 2024-09-19T09:37:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.971+0000 7f05856c6640 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b6d410 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7878f436ba8f9b server_cookie=ea46e2ad7e801119 in_seq=0 out_seq=0 2024-09-19T09:37:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.971+0000 7f0568ff9640 10 client.21204 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.969+0000 7fcabffff640 1 -- 172.21.15.52:0/1700331013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc004850 con 0x557af81cab40 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 -- 172.21.15.52:0/1700331013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 msgr2=0x557af81c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fcacc00eb00 tx=0x7fcacc009f20 comp rx=0 tx=0).stop 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcad99cd640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 0x7fcac00a5700 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcad00987d0 tx=0x7fcad00deea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 -- 172.21.15.52:0/1700331013 shutdown_connections 2024-09-19T09:37:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af81d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 --2- 172.21.15.52:0/1700331013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81c9090 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 -- 172.21.15.52:0/1700331013 >> 172.21.15.52:0/1700331013 conn(0x557af8192310 msgr2=0x557af81c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 -- 172.21.15.52:0/1700331013 shutdown_connections 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.970+0000 7fcade00a740 1 -- 172.21.15.52:0/1700331013 wait complete. 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 -- start start 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 Processor -- start 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 0x557af81d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 0x557af81d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcad91cc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcada1ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 0x557af81d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37928/0 (socket says 172.21.15.52:37928) 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557af81d7070 con 0x557af81d4370 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcada1ce640 1 -- 172.21.15.52:0/3397302818 learned_addr learned my addr 172.21.15.52:0/3397302818 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:54964/0 (socket says 172.21.15.52:54964) 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557af80ea060 con 0x557af81cab40 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.971+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557af81d71f0 con 0x557af81c95d0 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcade00a740 10 client.0 _ll_register_callbacks cb 0x557af7e3d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 -- 172.21.15.52:0/3397302818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 msgr2=0x557af81d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 -- 172.21.15.52:0/3397302818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 msgr2=0x557af81d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 0x557af81d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af7ea03c0 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcac402a9e0 tx=0x7fcac40303d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e3d761ff13c27c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcabd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4037040 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcac40035f0 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcacc003e50 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcac404b050 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcade00a740 10 client.29573 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.972+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557af81e2b80 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcacc003e50 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcac4030aa0 con 0x557af81cab40 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 10 client.29573 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 10 client.29573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:06.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 20 client.29573 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af81e3fe0 0x557af81e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 4 client.29573 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557af813c860 con 0x557af81e3fe0 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.973+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af81e3fe0 0x557af81e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.974+0000 7fcabd7fa640 10 client.29573 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.974+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af81e3fe0 0x557af81e63f0 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ac2e0d01575228 server_cookie=d560c57033050f62 in_seq=0 out_seq=0 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3397302818 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557af813c860 con 0x557af81e3fe0 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcabd7fa640 10 client.29573 handle_command_reply: tid=0 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 client.29573 shutdown 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 msgr2=0x557af81d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcac402a9e0 tx=0x7fcac40303d0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 shutdown_connections 2024-09-19T09:37:06.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af81e3fe0 0x557af81e63f0 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81d4370 0x557af81d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81cab40 0x557af81d1050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 --2- 172.21.15.52:0/3397302818 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 >> 172.21.15.52:0/3397302818 conn(0x557af8192310 msgr2=0x557af81cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcabd7fa640 0 client.29573 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 shutdown_connections 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 1 -- 172.21.15.52:0/3397302818 wait complete. 2024-09-19T09:37:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.975+0000 7fcade00a740 20 client.29573 trim_cache size 0 max 16384 2024-09-19T09:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f0568ff9640 1 -- 172.21.15.52:0/4041573730 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560178a55d70 con 0x560178b007e0 2024-09-19T09:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f0568ff9640 10 client.21204 handle_command_reply: tid=0 2024-09-19T09:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 client.21204 shutdown 2024-09-19T09:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 msgr2=0x560178af94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7f057000b6c0 tx=0x7f0570012d90 comp rx=0 tx=0).stop 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 shutdown_connections 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560178b007e0 0x560178b6d410 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560178af0370 0x560178b69500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560178aeb2e0 0x560178af94b0 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 --2- 172.21.15.52:0/4041573730 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560178aea9a0 0x560178af8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f0568ff9640 0 client.21204 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 >> 172.21.15.52:0/4041573730 conn(0x560178ae6010 msgr2=0x560178ae49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 shutdown_connections 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 1 -- 172.21.15.52:0/4041573730 wait complete. 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.978+0000 7f058a6c4740 20 client.21204 trim_cache size 0 max 16384 2024-09-19T09:37:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:37:06.999 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 msgr2=0x7f056c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 0x7f056c0a57b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f057c000c00 tx=0x7f057c005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 msgr2=0x7f058019f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f0578005fd0 tx=0x7f057800dea0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 shutdown_connections 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05801078c0 0x7f058019f400 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0580104f90 0x7f0580198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f056c0a32f0 0x7f056c0a57b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 --2- 172.21.15.52:0/375354095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0580102660 0x7f0580197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 >> 172.21.15.52:0/375354095 conn(0x7f05800fc1e0 msgr2=0x7f0580102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 shutdown_connections 2024-09-19T09:37:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:06.979+0000 7f058792a640 1 -- 172.21.15.52:0/375354095 wait complete. 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.989+0000 7fcade00a740 1 Processor -- start 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.989+0000 7fcade00a740 1 -- start start 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81c95d0 0x557af81d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81d4370 0x557af81ec200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41adde0 con 0x557af81cab40 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41ab6b0 con 0x557af81c95d0 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcade00a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41a9500 con 0x557af81d4370 2024-09-19T09:37:07.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37936/0 (socket says 172.21.15.52:37936) 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 -- 172.21.15.52:0/3888040230 learned_addr learned my addr 172.21.15.52:0/3888040230 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81c95d0 0x557af81d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81d4370 0x557af81ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 -- 172.21.15.52:0/3888040230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81d4370 msgr2=0x557af81ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81d4370 0x557af81ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 -- 172.21.15.52:0/3888040230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81c95d0 msgr2=0x557af81d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81c95d0 0x557af81d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 -- 172.21.15.52:0/3888040230 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af81c5ed0 con 0x557af81cab40 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.990+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fcac4031000 tx=0x7fcac402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f4448e81b41942 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.991+0000 7fcabf7fe640 1 -- 172.21.15.52:0/3888040230 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4037070 con 0x557af81cab40 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.991+0000 7fcabf7fe640 1 -- 172.21.15.52:0/3888040230 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac403de30 con 0x557af81cab40 2024-09-19T09:37:07.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.991+0000 7fcabf7fe640 1 -- 172.21.15.52:0/3888040230 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40054d0 con 0x557af81cab40 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.991+0000 7fcade00a740 1 -- 172.21.15.52:0/3888040230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 msgr2=0x557af81ebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.991+0000 7fcade00a740 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fcac4031000 tx=0x7fcac402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 -- 172.21.15.52:0/3888040230 shutdown_connections 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81d4370 0x557af81ec200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81ebcc0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 --2- 172.21.15.52:0/3888040230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81c95d0 0x557af81d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 -- 172.21.15.52:0/3888040230 >> 172.21.15.52:0/3888040230 conn(0x557af8192310 msgr2=0x557af81d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 -- 172.21.15.52:0/3888040230 shutdown_connections 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 -- 172.21.15.52:0/3888040230 wait complete. 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 -- start start 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.992+0000 7fcade00a740 1 Processor -- start 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af824cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41a9b70 con 0x557af81cab40 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41aafe0 con 0x557af81d4370 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcad41aa240 con 0x557af81c95d0 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcade00a740 10 client.0 _ll_register_callbacks cb 0x7fcad0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37942/0 (socket says 172.21.15.52:37942) 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 -- 172.21.15.52:0/3594844272 learned_addr learned my addr 172.21.15.52:0/3594844272 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af824cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 -- 172.21.15.52:0/3594844272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 msgr2=0x557af81d79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 -- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 msgr2=0x557af824cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af824cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcad91cc640 1 -- 172.21.15.52:0/3594844272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af824d1c0 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.993+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcad91cc640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fcac4005d10 tx=0x7fcac4030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4044b9f9c17588 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcabd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4037070 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fcac403da80 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcac403de30 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcac40051d0 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcade00a740 10 client.21213 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557af824e460 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.994+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcac403de30 con 0x557af81cab40 2024-09-19T09:37:07.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcac40046c0 con 0x557af81cab40 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 10 client.21213 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 10 client.21213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 20 client.21213 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af824ea90 0x557af8250eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 4 client.21213 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557af8136d70 con 0x557af824ea90 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af824ea90 0x557af8250eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcabd7fa640 10 client.21213 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.995+0000 7fcada1ce640 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af824ea90 0x557af8250eb0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cdcddac9d85e86 server_cookie=7beb972d6077c302 in_seq=0 out_seq=0 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcabd7fa640 1 -- 172.21.15.52:0/3594844272 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557af8136d70 con 0x557af824ea90 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcabd7fa640 10 client.21213 handle_command_reply: tid=0 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 client.21213 shutdown 2024-09-19T09:37:07.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 msgr2=0x557af81d7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fcac4005d10 tx=0x7fcac4030340 comp rx=0 tx=0).stop 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 shutdown_connections 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557af824ea90 0x557af8250eb0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557af81d4370 0x557af824cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557af81cab40 0x557af81d7f20 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcabd7fa640 0 client.21213 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 --2- 172.21.15.52:0/3594844272 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557af81c95d0 0x557af81d79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 >> 172.21.15.52:0/3594844272 conn(0x557af8192310 msgr2=0x557af81cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 shutdown_connections 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 1 -- 172.21.15.52:0/3594844272 wait complete. 2024-09-19T09:37:07.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.996+0000 7fcade00a740 20 client.21213 trim_cache size 0 max 16384 2024-09-19T09:37:07.013 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 msgr2=0x7fcac00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 0x7fcac00a5700 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcad00987d0 tx=0x7fcad00deea0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 msgr2=0x7fcad419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcad000e9f0 tx=0x7fcad000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 shutdown_connections 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcad4102ef0 0x7fcad419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcad4102570 0x7fcad419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fcac00a3240 0x7fcac00a5700 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 --2- 172.21.15.52:0/2332257461 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcad4100e20 0x7fcad419a750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 >> 172.21.15.52:0/2332257461 conn(0x7fcad40fc7d0 msgr2=0x7fcad4103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 shutdown_connections 2024-09-19T09:37:07.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:06.997+0000 7fcadbc31640 1 -- 172.21.15.52:0/2332257461 wait complete. 2024-09-19T09:37:07.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:07 smithi086 ceph-mon[34813]: pgmap v808: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:37:07.380 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:07 smithi052 ceph-mon[30947]: pgmap v808: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:37:07.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:07 smithi169 ceph-mon[35454]: pgmap v808: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-19T09:37:07.769 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 -- 172.21.15.52:0/4001302630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 msgr2=0x7f1394100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 --2- 172.21.15.52:0/4001302630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394100ed0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f1388009930 tx=0x7f138802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:08.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 -- 172.21.15.52:0/4001302630 shutdown_connections 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 --2- 172.21.15.52:0/4001302630 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394101410 0x7f139410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 --2- 172.21.15.52:0/4001302630 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394100ed0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 --2- 172.21.15.52:0/4001302630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394106a70 0x7f1394106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 -- 172.21.15.52:0/4001302630 >> 172.21.15.52:0/4001302630 conn(0x7f13940fc790 msgr2=0x7f13940febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 -- 172.21.15.52:0/4001302630 shutdown_connections 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 -- 172.21.15.52:0/4001302630 wait complete. 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.255+0000 7f1399841640 1 Processor -- start 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 -- start start 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 0x7f1394198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394106a70 0x7f139419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1394110f10 con 0x7f1394100a70 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1394110d90 con 0x7f1394101410 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1399841640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1394111090 con 0x7f1394106a70 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52172/0 (socket says 172.21.15.52:52172) 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 -- 172.21.15.52:0/523209776 learned_addr learned my addr 172.21.15.52:0/523209776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f13937fe640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394106a70 0x7f139419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f13927fc640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 0x7f1394198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 -- 172.21.15.52:0/523209776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394106a70 msgr2=0x7f139419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394106a70 0x7f139419cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 -- 172.21.15.52:0/523209776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 msgr2=0x7f1394198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 0x7f1394198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f1392ffd640 1 -- 172.21.15.52:0/523209776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139419d5d0 con 0x7f1394100a70 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.256+0000 7f13927fc640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 0x7f1394198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f1392ffd640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f138400b4a0 tx=0x7f138400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f139883f640 1 -- 172.21.15.52:0/523209776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384014070 con 0x7f1394100a70 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f139883f640 1 -- 172.21.15.52:0/523209776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1384010af0 con 0x7f1394100a70 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139419d8c0 con 0x7f1394100a70 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f139883f640 1 -- 172.21.15.52:0/523209776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1384017d10 con 0x7f1394100a70 2024-09-19T09:37:08.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.257+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13941a51a0 con 0x7f1394100a70 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.259+0000 7f139883f640 1 -- 172.21.15.52:0/523209776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1384017070 con 0x7f1394100a70 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.259+0000 7f139bc1a740 1 Processor -- start 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 -- start start 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37060 0x556344c37440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c41d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556344b9c620 con 0x556344c42240 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556344b43e50 con 0x556344c37060 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139bc1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556344b985e0 con 0x556344c37980 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52178/0 (socket says 172.21.15.52:52178) 2024-09-19T09:37:08.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 -- 172.21.15.52:0/1475442420 learned_addr learned my addr 172.21.15.52:0/1475442420 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139883f640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 0x7f137c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13937fe640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37060 0x556344c37440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f1392ffd640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c41d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13937fe640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 0x7f137c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 -- 172.21.15.52:0/1475442420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 msgr2=0x556344c41d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c41d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 -- 172.21.15.52:0/1475442420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37060 msgr2=0x556344c37440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37060 0x556344c37440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f13927fc640 1 -- 172.21.15.52:0/1475442420 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556344b34d40 con 0x556344c42240 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f1392ffd640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c41d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.260+0000 7f139883f640 1 -- 172.21.15.52:0/523209776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f13840cee10 con 0x7f1394100a70 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f13927fc640 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f1388005ab0 tx=0x7f1388009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89ce77f87d4ea18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f1379ffb640 1 -- 172.21.15.52:0/1475442420 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138803f070 con 0x556344c42240 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f13937fe640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 0x7f137c0a5700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f1379ffb640 1 -- 172.21.15.52:0/1475442420 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13880317b0 con 0x556344c42240 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f1379ffb640 1 -- 172.21.15.52:0/1475442420 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388035070 con 0x556344c42240 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f139bc1a740 1 -- 172.21.15.52:0/1475442420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 msgr2=0x556344c44630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.261+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f1388005ab0 tx=0x7f1388009680 comp rx=0 tx=0).stop 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- 172.21.15.52:0/1475442420 shutdown_connections 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c44630 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c41d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1475442420 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37060 0x556344c37440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- 172.21.15.52:0/1475442420 >> 172.21.15.52:0/1475442420 conn(0x556344c335f0 msgr2=0x556344c339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- 172.21.15.52:0/1475442420 shutdown_connections 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- 172.21.15.52:0/1475442420 wait complete. 2024-09-19T09:37:08.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- start start 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 Processor -- start 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c3f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c3fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556344c44e10 con 0x556344c37060 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x556344b24f10 con 0x556344c42240 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.262+0000 7f139bc1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x556344c44f90 con 0x556344c37980 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f139bc1a740 10 client.0 _ll_register_callbacks cb 0x556344b48db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52184/0 (socket says 172.21.15.52:52184) 2024-09-19T09:37:08.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 -- 172.21.15.52:0/1311441645 learned_addr learned my addr 172.21.15.52:0/1311441645 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f13937fe640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c3fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f13927fc640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c3f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 -- 172.21.15.52:0/1311441645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 msgr2=0x556344c3f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c3f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 -- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 msgr2=0x556344c3fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c3fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 -- 172.21.15.52:0/1311441645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563448ab580 con 0x556344c37060 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f13937fe640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c3fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1392ffd640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f13840cc890 tx=0x7f138400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d40683f29f762fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1372ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138401e030 con 0x556344c37060 2024-09-19T09:37:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f1384010ca0 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13880317b0 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f138409b3b0 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f139bc1a740 10 client.21225 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.263+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556344975960 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13880317b0 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f13840b40f0 con 0x556344c37060 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 10 client.21225 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 10 client.21225 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 20 client.21225 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344c51cb0 0x556344c54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 4 client.21225 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556344ba9b90 con 0x556344c51cb0 2024-09-19T09:37:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.264+0000 7f13927fc640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344c51cb0 0x556344c54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f1372ffd640 10 client.21225 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f13927fc640 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344c51cb0 0x556344c54120 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2990591561506ea6 server_cookie=88eb60860670d0b9 in_seq=0 out_seq=0 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f1372ffd640 1 -- 172.21.15.52:0/1311441645 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556344ba9b90 con 0x556344c51cb0 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f1372ffd640 10 client.21225 handle_command_reply: tid=0 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 client.21225 shutdown 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 msgr2=0x556344c3f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:37:08.311 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 56, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": { 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "d53bd4b4": { 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "version": 56, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "age_ref": 0.0, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "timeout": 90.0, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "expiration": 149.4, 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "members": { 2024-09-19T09:37:08.312 INFO:teuthology.orchestra.run.smithi052.stdout: "file:/": { 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: "excluded": false, 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: "state": { 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RELEASED", 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:08.313 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f13840cc890 tx=0x7f138400bf90 comp rx=0 tx=0).stop 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 shutdown_connections 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344c51cb0 0x556344c54120 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c3fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37980 0x556344c3f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 --2- 172.21.15.52:0/1311441645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37060 0x556344c3f080 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f1372ffd640 0 client.21225 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.265+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 >> 172.21.15.52:0/1311441645 conn(0x556344c335f0 msgr2=0x556344c392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.266+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 shutdown_connections 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.266+0000 7f139bc1a740 1 -- 172.21.15.52:0/1311441645 wait complete. 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.266+0000 7f139bc1a740 20 client.21225 trim_cache size 0 max 16384 2024-09-19T09:37:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.282+0000 7f139bc1a740 1 Processor -- start 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.282+0000 7f139bc1a740 1 -- start start 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c39ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13941b01e0 con 0x556344c37980 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13941adab0 con 0x556344c42240 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f139bc1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13941ab900 con 0x556344c37060 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52196/0 (socket says 172.21.15.52:52196) 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 -- 172.21.15.52:0/3512465142 learned_addr learned my addr 172.21.15.52:0/3512465142 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13937fe640 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 -- 172.21.15.52:0/3512465142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 msgr2=0x556344c39ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c39ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 -- 172.21.15.52:0/3512465142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 msgr2=0x556344c599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 -- 172.21.15.52:0/3512465142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556344c377b0 con 0x556344c37980 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13927fc640 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f138802a940 tx=0x7f13880053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4b9fceb6a6a0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13797fa640 1 -- 172.21.15.52:0/3512465142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388051070 con 0x556344c37980 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13797fa640 1 -- 172.21.15.52:0/3512465142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13880316d0 con 0x556344c37980 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.283+0000 7f13797fa640 1 -- 172.21.15.52:0/3512465142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388035040 con 0x556344c37980 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- 172.21.15.52:0/3512465142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 msgr2=0x556344c32640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f138802a940 tx=0x7f13880053b0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- 172.21.15.52:0/3512465142 shutdown_connections 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c42240 0x556344c599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c37980 0x556344c32640 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 --2- 172.21.15.52:0/3512465142 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- 172.21.15.52:0/3512465142 >> 172.21.15.52:0/3512465142 conn(0x556344c335f0 msgr2=0x556344c31f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- 172.21.15.52:0/3512465142 shutdown_connections 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- 172.21.15.52:0/3512465142 wait complete. 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.284+0000 7f139bc1a740 1 -- start start 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 Processor -- start 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c3c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37980 0x556344c3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13941abf70 con 0x556344c42240 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13941ad3e0 con 0x556344c37980 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f13941ac640 con 0x556344c37060 2024-09-19T09:37:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f139bc1a740 10 client.0 _ll_register_callbacks cb 0x7f138409afe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52204/0 (socket says 172.21.15.52:52204) 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 -- 172.21.15.52:0/2116674361 learned_addr learned my addr 172.21.15.52:0/2116674361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f1392ffd640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c3c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13927fc640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37980 0x556344c3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 -- 172.21.15.52:0/2116674361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 msgr2=0x556344c3c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c3c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 -- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37980 msgr2=0x556344c3c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37980 0x556344c3c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.285+0000 7f13937fe640 1 -- 172.21.15.52:0/2116674361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556344cbbb60 con 0x556344c42240 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f13937fe640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f138c007b00 tx=0x7f138c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0cf111471c1d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138c02a060 con 0x556344c42240 2024-09-19T09:37:08.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f138c00a400 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13880316d0 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f138c015050 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 10 client.21231 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556344cbcec0 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13880316d0 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f138c024030 con 0x556344c42240 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 10 client.21231 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 10 client.21231 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 20 client.21231 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.286+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344cbd6a0 0x556344cbfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.287+0000 7f139bc1a740 4 client.21231 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d53bd4b4", "release": true, "await": true}] 2024-09-19T09:37:08.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.287+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d53bd4b4", "release": true, "await": true}) -- 0x556344ba40a0 con 0x556344cbd6a0 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.287+0000 7f1392ffd640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344cbd6a0 0x556344cbfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.287+0000 7f1372ffd640 10 client.21231 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.287+0000 7f1392ffd640 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344cbd6a0 0x556344cbfac0 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac12bae1d30e6906 server_cookie=6e20b85a93cd52de in_seq=0 out_seq=0 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f1372ffd640 1 -- 172.21.15.52:0/2116674361 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556344ba40a0 con 0x556344cbd6a0 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f1372ffd640 10 client.21231 handle_command_reply: tid=0 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 client.21231 shutdown 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 msgr2=0x556344c3cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f138c007b00 tx=0x7f138c004b50 comp rx=0 tx=0).stop 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 shutdown_connections 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x556344cbd6a0 0x556344cbfac0 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556344c42240 0x556344c3cd10 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x556344c37980 0x556344c3c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f1372ffd640 0 client.21231 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 --2- 172.21.15.52:0/2116674361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x556344c37060 0x556344c3c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 >> 172.21.15.52:0/2116674361 conn(0x556344c335f0 msgr2=0x556344c3f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 shutdown_connections 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 1 -- 172.21.15.52:0/2116674361 wait complete. 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.290+0000 7f139bc1a740 20 client.21231 trim_cache size 0 max 16384 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 msgr2=0x7f137c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 0x7f137c0a5700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f138c009fd0 tx=0x7f138c004a40 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 msgr2=0x7f1394198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f138400b4a0 tx=0x7f138400b960 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 shutdown_connections 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f137c0a3240 0x7f137c0a5700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1394106a70 0x7f139419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1394101410 0x7f1394198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 --2- 172.21.15.52:0/523209776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1394100a70 0x7f1394198620 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 >> 172.21.15.52:0/523209776 conn(0x7f13940fc790 msgr2=0x7f139406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 shutdown_connections 2024-09-19T09:37:08.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:08.291+0000 7f1399841640 1 -- 172.21.15.52:0/523209776 wait complete. 2024-09-19T09:37:08.688 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:37:08.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:37:09.042 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd53bd4b4', total seconds elapsed: 34.3 2024-09-19T09:37:09.081 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:09.258 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:09 smithi086 ceph-mon[34813]: pgmap v809: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:37:09.325 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:09 smithi052 ceph-mon[30947]: pgmap v809: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:37:09.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:09 smithi169 ceph-mon[35454]: pgmap v809: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:37:09.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/4004723184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d88103ff0 msgr2=0x7f6d881043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/4004723184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d88103ff0 0x7f6d881043d0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009900 tx=0x7f6d7802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/4004723184 shutdown_connections 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/4004723184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88109120 0x7f6d88110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/4004723184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d881049a0 0x7f6d881089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/4004723184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d88103ff0 0x7f6d881043d0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/4004723184 >> 172.21.15.52:0/4004723184 conn(0x7f6d880ffa90 msgr2=0x7f6d88101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/4004723184 shutdown_connections 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/4004723184 wait complete. 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 Processor -- start 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.545+0000 7f6d8d5e7640 1 -- start start 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 0x7f6d8819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d88109120 0x7f6d8819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d88114150 con 0x7f6d881049a0 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6d88113fd0 con 0x7f6d88109120 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d8d5e7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881142d0 con 0x7f6d88103ff0 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52214/0 (socket says 172.21.15.52:52214) 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 -- 172.21.15.52:0/3133183108 learned_addr learned my addr 172.21.15.52:0/3133183108 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d877fe640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d88109120 0x7f6d8819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 0x7f6d8819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 -- 172.21.15.52:0/3133183108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 msgr2=0x7f6d8819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 0x7f6d8819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 -- 172.21.15.52:0/3133183108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d88109120 msgr2=0x7f6d8819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d88109120 0x7f6d8819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 -- 172.21.15.52:0/3133183108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8819f5a0 con 0x7f6d881049a0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 0x7f6d8819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.546+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c890 tx=0x7f6d7000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.547+0000 7f6d84ff9640 1 -- 172.21.15.52:0/3133183108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70004220 con 0x7f6d881049a0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.547+0000 7f6d84ff9640 1 -- 172.21.15.52:0/3133183108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d700043c0 con 0x7f6d881049a0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.547+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8819f890 con 0x7f6d881049a0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.547+0000 7f6d84ff9640 1 -- 172.21.15.52:0/3133183108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700049e0 con 0x7f6d881049a0 2024-09-19T09:37:09.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.547+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d881a7170 con 0x7f6d881049a0 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.549+0000 7f6d84ff9640 1 -- 172.21.15.52:0/3133183108 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6d700079b0 con 0x7f6d881049a0 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.549+0000 7f6d8f9c0740 1 Processor -- start 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.549+0000 7f6d8f9c0740 1 -- start start 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.549+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.549+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa00f280 con 0x55d6fa0aa480 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9fb6b10 con 0x55d6fa0b4d40 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa00b240 con 0x55d6fa0a9b60 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52222/0 (socket says 172.21.15.52:52222) 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3235376241 learned_addr learned my addr 172.21.15.52:0/3235376241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d877fe640 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d84ff9640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 0x7f6d740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3235376241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 msgr2=0x55d6fa0a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3235376241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0b4d40 msgr2=0x55d6fa0b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3235376241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f9fc31f0 con 0x55d6fa0aa480 2024-09-19T09:37:09.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d877fe640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 0x7f6d740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d84ff9640 1 -- 172.21.15.52:0/3133183108 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6d700cfa30 con 0x7f6d881049a0 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.550+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f6d78033000 tx=0x7f6d78032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ae0921bafedc13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d7d7fa640 1 -- 172.21.15.52:0/3235376241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7803f070 con 0x55d6fa0aa480 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d877fe640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 0x7f6d740a5700 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005fd0 tx=0x7f6d80004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d7d7fa640 1 -- 172.21.15.52:0/3235376241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d780317b0 con 0x55d6fa0aa480 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d7d7fa640 1 -- 172.21.15.52:0/3235376241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78035070 con 0x55d6fa0aa480 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3235376241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 msgr2=0x55d6fa0b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f6d78033000 tx=0x7f6d78032d60 comp rx=0 tx=0).stop 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3235376241 shutdown_connections 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b4800 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3235376241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.551+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3235376241 >> 172.21.15.52:0/3235376241 conn(0x55d6fa0a60f0 msgr2=0x55d6fa0a64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3235376241 shutdown_connections 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3235376241 wait complete. 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- start start 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 Processor -- start 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa0b7910 con 0x55d6fa0b4d40 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55d6f9fc9f10 con 0x55d6fa0a9b60 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55d6fa0b7a90 con 0x55d6fa0aa480 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.552+0000 7f6d8f9c0740 10 client.0 _ll_register_callbacks cb 0x55d6f9f92a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52224/0 (socket says 172.21.15.52:52224) 2024-09-19T09:37:09.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 -- 172.21.15.52:0/4112495739 learned_addr learned my addr 172.21.15.52:0/4112495739 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 -- 172.21.15.52:0/4112495739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 msgr2=0x55d6fa0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 -- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0a9b60 msgr2=0x55d6fa0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 -- 172.21.15.52:0/4112495739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f9d806a0 con 0x55d6fa0b4d40 2024-09-19T09:37:09.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d877fe640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f6d80012720 tx=0x7f6d80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927479b06ff2e04a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d800107d0 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6d80010970 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d780317b0 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d80030050 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d8f9c0740 10 client.21243 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.553+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d6fa0c3570 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d780317b0 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6d8000f040 con 0x55d6fa0b4d40 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 10 client.21243 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 10 client.21243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:09.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 20 client.21243 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa0c4a30 0x55d6fa0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 4 client.21243 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fa01c7f0 con 0x55d6fa0c4a30 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.554+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa0c4a30 0x55d6fa0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa0c4a30 0x55d6fa0c6ed0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4ab1abdc828c207 server_cookie=534c5497235b14b0 in_seq=0 out_seq=0 2024-09-19T09:37:09.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d6e7fc640 10 client.21243 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:09.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/4112495739 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6fa01c7f0 con 0x55d6fa0c4a30 2024-09-19T09:37:09.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d6e7fc640 10 client.21243 handle_command_reply: tid=0 2024-09-19T09:37:09.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d8f9c0740 1 client.21243 shutdown 2024-09-19T09:37:09.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 msgr2=0x55d6fa0b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f6d80012720 tx=0x7f6d80004ab0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 shutdown_connections 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.555+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa0c4a30 0x55d6fa0c6ed0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0b2690 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/4112495739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 >> 172.21.15.52:0/4112495739 conn(0x55d6fa0a60f0 msgr2=0x55d6fa0abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d6e7fc640 0 client.21243 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 shutdown_connections 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/4112495739 wait complete. 2024-09-19T09:37:09.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.556+0000 7f6d8f9c0740 20 client.21243 trim_cache size 0 max 16384 2024-09-19T09:37:09.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 Processor -- start 2024-09-19T09:37:09.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 -- start start 2024-09-19T09:37:09.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881b2220 con 0x55d6fa0a9b60 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881afaf0 con 0x55d6fa0aa480 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881ad940 con 0x55d6fa0b4d40 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d86ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52228/0 (socket says 172.21.15.52:52228) 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.573+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3491766127 learned_addr learned my addr 172.21.15.52:0/3491766127 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3491766127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0b4d40 msgr2=0x55d6fa0aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3491766127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 msgr2=0x55d6fa0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 -- 172.21.15.52:0/3491766127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fa0a6d80 con 0x55d6fa0a9b60 2024-09-19T09:37:09.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f6d78000c00 tx=0x7f6d7802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929eebc9b49aa6af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d7cff9640 1 -- 172.21.15.52:0/3491766127 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78051070 con 0x55d6fa0a9b60 2024-09-19T09:37:09.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d7cff9640 1 -- 172.21.15.52:0/3491766127 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d780035f0 con 0x55d6fa0a9b60 2024-09-19T09:37:09.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.574+0000 7f6d7cff9640 1 -- 172.21.15.52:0/3491766127 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7803f040 con 0x55d6fa0a9b60 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3491766127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 msgr2=0x55d6fa0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f6d78000c00 tx=0x7f6d7802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3491766127 shutdown_connections 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0b4d40 0x55d6fa0aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/3491766127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0cc7f0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3491766127 >> 172.21.15.52:0/3491766127 conn(0x55d6fa0a60f0 msgr2=0x55d6fa0abdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3491766127 shutdown_connections 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/3491766127 wait complete. 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.575+0000 7f6d8f9c0740 1 -- start start 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 Processor -- start 2024-09-19T09:37:09.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881adfb0 con 0x55d6fa0b4d40 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881af420 con 0x55d6fa0aa480 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6d881ae680 con 0x55d6fa0a9b60 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d8f9c0740 10 client.0 _ll_register_callbacks cb 0x7f6d80004860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52230/0 (socket says 172.21.15.52:52230) 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d877fe640 1 -- 172.21.15.52:0/284114361 learned_addr learned my addr 172.21.15.52:0/284114361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d7ffff640 1 -- 172.21.15.52:0/284114361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 msgr2=0x55d6fa0b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d7ffff640 1 -- 172.21.15.52:0/284114361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 msgr2=0x55d6fa12e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.576+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d7ffff640 1 -- 172.21.15.52:0/284114361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6fa12ee00 con 0x55d6fa0aa480 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d877fe640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d7ffff640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b9780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d700cd420 tx=0x7f6d70098210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bccf7e4ec1a355d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7001d070 con 0x55d6fa0aa480 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6d700a4750 con 0x55d6fa0aa480 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d780035f0 con 0x55d6fa0aa480 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6d7009bab0 con 0x55d6fa0aa480 2024-09-19T09:37:09.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d8f9c0740 10 client.29603 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.577+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d6fa130160 con 0x55d6fa0aa480 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d780035f0 con 0x55d6fa0aa480 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6d700babb0 con 0x55d6fa0aa480 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 10 client.29603 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 10 client.29603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 20 client.29603 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa130860 0x55d6fa132c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 4 client.29603 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d6fa016d00 con 0x55d6fa130860 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa130860 0x55d6fa132c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d86ffd640 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa130860 0x55d6fa132c80 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fe24c96c49c2d7a server_cookie=3cda48bf4a53c793 in_seq=0 out_seq=0 2024-09-19T09:37:09.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.578+0000 7f6d6e7fc640 10 client.29603 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:09.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d6e7fc640 1 -- 172.21.15.52:0/284114361 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6fa016d00 con 0x55d6fa130860 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d6e7fc640 10 client.29603 handle_command_reply: tid=0 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d8f9c0740 1 client.29603 shutdown 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 msgr2=0x55d6fa0b9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b9780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6d700cd420 tx=0x7f6d70098210 comp rx=0 tx=0).stop 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 shutdown_connections 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.579+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55d6fa130860 0x55d6fa132c80 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d6fa0b4d40 0x55d6fa12e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d6e7fc640 0 client.29603 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55d6fa0aa480 0x55d6fa0b9780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 --2- 172.21.15.52:0/284114361 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55d6fa0a9b60 0x55d6fa0b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 >> 172.21.15.52:0/284114361 conn(0x55d6fa0a60f0 msgr2=0x55d6fa0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 shutdown_connections 2024-09-19T09:37:09.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 1 -- 172.21.15.52:0/284114361 wait complete. 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8f9c0740 20 client.29603 trim_cache size 0 max 16384 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "322a1472-6d7a-4fe0-8f10-5a371b80a772", 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:37:09.586 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 msgr2=0x7f6d740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 0x7f6d740a5700 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005fd0 tx=0x7f6d80004a40 comp rx=0 tx=0).stop 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 msgr2=0x7f6d8819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.580+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c890 tx=0x7f6d7000cd50 comp rx=0 tx=0).stop 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 shutdown_connections 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d88109120 0x7f6d8819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d881049a0 0x7f6d8819ab30 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6d740a3240 0x7f6d740a5700 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 --2- 172.21.15.52:0/3133183108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6d88103ff0 0x7f6d8819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 >> 172.21.15.52:0/3133183108 conn(0x7f6d880ffa90 msgr2=0x7f6d88100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 shutdown_connections 2024-09-19T09:37:09.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:09.581+0000 7f6d8d5e7640 1 -- 172.21.15.52:0/3133183108 wait complete. 2024-09-19T09:37:10.230 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:37:10.531 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:11.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 -- 172.21.15.52:0/638360121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917810c170 msgr2=0x7f917810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 --2- 172.21.15.52:0/638360121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917810c170 0x7f917810e610 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7f9170009ca0 tx=0x7f917002a950 comp rx=0 tx=0).stop 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 -- 172.21.15.52:0/638360121 shutdown_connections 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 --2- 172.21.15.52:0/638360121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f917810c170 0x7f917810e610 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 --2- 172.21.15.52:0/638360121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9178103660 0x7f917810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 --2- 172.21.15.52:0/638360121 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178102d40 0x7f9178103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.991+0000 7f917cc22640 1 -- 172.21.15.52:0/638360121 >> 172.21.15.52:0/638360121 conn(0x7f91780fc7a0 msgr2=0x7f91780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.992+0000 7f917cc22640 1 -- 172.21.15.52:0/638360121 shutdown_connections 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.992+0000 7f917cc22640 1 -- 172.21.15.52:0/638360121 wait complete. 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.992+0000 7f917cc22640 1 Processor -- start 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.992+0000 7f917cc22640 1 -- start start 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.992+0000 7f917cc22640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178103660 0x7f91781989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f917810c170 0x7f917819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111f50 con 0x7f9178102d40 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9178111dd0 con 0x7f9178103660 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91781120d0 con 0x7f917810c170 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52242/0 (socket says 172.21.15.52:52242) 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 -- 172.21.15.52:0/223805371 learned_addr learned my addr 172.21.15.52:0/223805371 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f9175d9b640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178103660 0x7f91781989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f9176d9d640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f917810c170 0x7f917819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 -- 172.21.15.52:0/223805371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f917810c170 msgr2=0x7f917819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f917810c170 0x7f917819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 -- 172.21.15.52:0/223805371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178103660 msgr2=0x7f91781989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178103660 0x7f91781989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 -- 172.21.15.52:0/223805371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917819d410 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917659c640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f916800c890 tx=0x7f916800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f916f7fe640 1 -- 172.21.15.52:0/223805371 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168004220 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917819d700 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f916f7fe640 1 -- 172.21.15.52:0/223805371 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91680043c0 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.993+0000 7f916f7fe640 1 -- 172.21.15.52:0/223805371 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168004a00 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.994+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91781a4fe0 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f916f7fe640 1 -- 172.21.15.52:0/223805371 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91680079b0 con 0x7f9178102d40 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 Processor -- start 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 -- start start 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a5e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c5e89c42e0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c5e896bce0 con 0x55c5e8a69680 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.996+0000 7f917effb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c5e89c02a0 con 0x55c5e8a5e4a0 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52246/0 (socket says 172.21.15.52:52246) 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 -- 172.21.15.52:0/521430485 learned_addr learned my addr 172.21.15.52:0/521430485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f916f7fe640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 0x7f91640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f9176d9d640 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a5e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f9175d9b640 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f916f7fe640 1 -- 172.21.15.52:0/223805371 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f91680cf5e0 con 0x7f9178102d40 2024-09-19T09:37:11.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f9176d9d640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 0x7f91640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 -- 172.21.15.52:0/521430485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 msgr2=0x55c5e8a5e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a5e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 -- 172.21.15.52:0/521430485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 msgr2=0x55c5e8a6ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 -- 172.21.15.52:0/521430485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e8950440 con 0x55c5e8a5edc0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f917659c640 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f91680b0970 tx=0x7f9168005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8874ba1c2cfc779b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f916cff9640 1 -- 172.21.15.52:0/521430485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916801d070 con 0x55c5e8a5edc0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f9176d9d640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 0x7f91640a5700 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fe0 tx=0x7f917002a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f916cff9640 1 -- 172.21.15.52:0/521430485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f916809bc30 con 0x55c5e8a5edc0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.997+0000 7f916cff9640 1 -- 172.21.15.52:0/521430485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916809a010 con 0x55c5e8a5edc0 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 -- 172.21.15.52:0/521430485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 msgr2=0x55c5e8a69140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7f91680b0970 tx=0x7f9168005300 comp rx=0 tx=0).stop 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 -- 172.21.15.52:0/521430485 shutdown_connections 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a69140 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 --2- 172.21.15.52:0/521430485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a5e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 -- 172.21.15.52:0/521430485 >> 172.21.15.52:0/521430485 conn(0x55c5e8a5aa30 msgr2=0x55c5e8a5ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 -- 172.21.15.52:0/521430485 shutdown_connections 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.998+0000 7f917effb740 1 -- 172.21.15.52:0/521430485 wait complete. 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 -- start start 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 Processor -- start 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a68fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c5e8a6c250 con 0x55c5e8a5edc0 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55c5e897f050 con 0x55c5e8a69680 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c5e8a6c3d0 con 0x55c5e8a5e4a0 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917effb740 10 client.0 _ll_register_callbacks cb 0x55c5e89bf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52262/0 (socket says 172.21.15.52:52262) 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 -- 172.21.15.52:0/1809707727 learned_addr learned my addr 172.21.15.52:0/1809707727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f917659c640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a68fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9176d9d640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 -- 172.21.15.52:0/1809707727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 msgr2=0x55c5e8a68fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a68fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 -- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 msgr2=0x55c5e8a667b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a667b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:10.999+0000 7f9175d9b640 1 -- 172.21.15.52:0/1809707727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e87353c0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f9175d9b640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f916000b9a0 tx=0x7f916000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d540a61bbb610b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160003dc0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9160005020 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f916809bc30 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9160020030 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 10 client.21261 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c5e8a77c60 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f916809bc30 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f916001b470 con 0x55c5e8a5edc0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 10 client.21261 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 10 client.21261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 20 client.21261 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8a79120 0x55c5e8a7b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 4 client.21261 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.000+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5e89d1850 con 0x55c5e8a79120 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.001+0000 7f917659c640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8a79120 0x55c5e8a7b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.001+0000 7f917659c640 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8a79120 0x55c5e8a7b560 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4e1306564e862d server_cookie=9d7f89f8ca7aba13 in_seq=0 out_seq=0 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.001+0000 7f915dffb640 10 client.21261 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f915dffb640 1 -- 172.21.15.52:0/1809707727 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5e89d1850 con 0x55c5e8a79120 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f915dffb640 10 client.21261 handle_command_reply: tid=0 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 client.21261 shutdown 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 msgr2=0x55c5e8a66270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f916000b9a0 tx=0x7f916000be60 comp rx=0 tx=0).stop 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 shutdown_connections 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8a79120 0x55c5e8a7b560 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a667b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a66270 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f915dffb640 0 client.21261 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 --2- 172.21.15.52:0/1809707727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a68fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 >> 172.21.15.52:0/1809707727 conn(0x55c5e8a5aa30 msgr2=0x55c5e8a60710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 shutdown_connections 2024-09-19T09:37:11.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 1 -- 172.21.15.52:0/1809707727 wait complete. 2024-09-19T09:37:11.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.002+0000 7f917effb740 20 client.21261 trim_cache size 0 max 16384 2024-09-19T09:37:11.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.020+0000 7f917effb740 1 Processor -- start 2024-09-19T09:37:11.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.020+0000 7f917effb740 1 -- start start 2024-09-19T09:37:11.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a69680 0x55c5e8a81370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91781b00f0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ad9c0 con 0x55c5e8a5e4a0 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917effb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ab810 con 0x55c5e8a69680 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52274/0 (socket says 172.21.15.52:52274) 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 -- 172.21.15.52:0/3494955747 learned_addr learned my addr 172.21.15.52:0/3494955747 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917659c640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9176d9d640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a69680 0x55c5e8a81370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 -- 172.21.15.52:0/3494955747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a69680 msgr2=0x55c5e8a81370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a69680 0x55c5e8a81370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 -- 172.21.15.52:0/3494955747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 msgr2=0x55c5e8a754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 -- 172.21.15.52:0/3494955747 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e8a672b0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f917659c640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.021+0000 7f9175d9b640 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f916001ba80 tx=0x7f9160004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f9dabef72bac93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f915ffff640 1 -- 172.21.15.52:0/3494955747 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160003dc0 con 0x55c5e8a5edc0 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f915ffff640 1 -- 172.21.15.52:0/3494955747 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f916001b470 con 0x55c5e8a5edc0 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f915ffff640 1 -- 172.21.15.52:0/3494955747 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160005550 con 0x55c5e8a5edc0 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 -- 172.21.15.52:0/3494955747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 msgr2=0x55c5e8a80e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f916001ba80 tx=0x7f9160004170 comp rx=0 tx=0).stop 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 -- 172.21.15.52:0/3494955747 shutdown_connections 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a69680 0x55c5e8a81370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a80e30 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 --2- 172.21.15.52:0/3494955747 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 -- 172.21.15.52:0/3494955747 >> 172.21.15.52:0/3494955747 conn(0x55c5e8a5aa30 msgr2=0x55c5e8a61900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 -- 172.21.15.52:0/3494955747 shutdown_connections 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.022+0000 7f917effb740 1 -- 172.21.15.52:0/3494955747 wait complete. 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 -- start start 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 Processor -- start 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a6d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91781abe80 con 0x55c5e8a5edc0 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ad2f0 con 0x55c5e8a69680 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91781ac550 con 0x55c5e8a5e4a0 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917effb740 10 client.0 _ll_register_callbacks cb 0x7f9160004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f9175d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52282/0 (socket says 172.21.15.52:52282) 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f9175d9b640 1 -- 172.21.15.52:0/2056558097 learned_addr learned my addr 172.21.15.52:0/2056558097 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f917659c640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a6d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.023+0000 7f9176d9d640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 -- 172.21.15.52:0/2056558097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 msgr2=0x55c5e8a6d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a6d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 -- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 msgr2=0x55c5e8a6de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 -- 172.21.15.52:0/2056558097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e8ae7240 con 0x55c5e8a5edc0 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f917659c640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a6d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9176d9d640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f9175d9b640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f916000b940 tx=0x7f916001b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbe5874344baefd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f915dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916001bb00 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9160017040 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f916001b470 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f916003b050 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f917effb740 10 client.21267 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c5e8ae8510 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.024+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f916001b470 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f916002d440 con 0x55c5e8a5edc0 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 10 client.21267 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 10 client.21267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 20 client.21267 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8ae8c40 0x55c5e8aeb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 4 client.21267 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c5e89cbd60 con 0x55c5e8ae8c40 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917659c640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8ae8c40 0x55c5e8aeb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f915dffb640 10 client.21267 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917659c640 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8ae8c40 0x55c5e8aeb060 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c250abc1f339023d server_cookie=bc52c586cb03fc63 in_seq=0 out_seq=0 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f915dffb640 1 -- 172.21.15.52:0/2056558097 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c5e89cbd60 con 0x55c5e8ae8c40 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f915dffb640 10 client.21267 handle_command_reply: tid=0 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.025+0000 7f917effb740 1 client.21267 shutdown 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 msgr2=0x55c5e8a6d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f916000b940 tx=0x7f916001b760 comp rx=0 tx=0).stop 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 shutdown_connections 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55c5e8ae8c40 0x55c5e8aeb060 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55c5e8a69680 0x55c5e8a6de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c5e8a5edc0 0x55c5e8a6d8d0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 --2- 172.21.15.52:0/2056558097 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c5e8a5e4a0 0x55c5e8a6d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 >> 172.21.15.52:0/2056558097 conn(0x55c5e8a5aa30 msgr2=0x55c5e8a60f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f915dffb640 0 client.21267 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 shutdown_connections 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 1 -- 172.21.15.52:0/2056558097 wait complete. 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917effb740 20 client.21267 trim_cache size 0 max 16384 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:37:11.039 INFO:teuthology.orchestra.run.smithi052.stdout: "322a1472-6d7a-4fe0-8f10-5a371b80a772": { 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "322a1472-6d7a-4fe0-8f10-5a371b80a772", 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:11.040 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 msgr2=0x7f91640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 0x7f91640a5700 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fe0 tx=0x7f917002a950 comp rx=0 tx=0).stop 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 msgr2=0x7f9178198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7f916800c890 tx=0x7f916800cd50 comp rx=0 tx=0).stop 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 shutdown_connections 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f91640a3240 0x7f91640a5700 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f917810c170 0x7f917819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9178103660 0x7f91781989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 --2- 172.21.15.52:0/223805371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9178102d40 0x7f9178198460 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.026+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 >> 172.21.15.52:0/223805371 conn(0x7f91780fc7a0 msgr2=0x7f91780fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.027+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 shutdown_connections 2024-09-19T09:37:11.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:11.027+0000 7f917cc22640 1 -- 172.21.15.52:0/223805371 wait complete. 2024-09-19T09:37:11.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:11 smithi052 ceph-mon[30947]: pgmap v810: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:37:11.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:11 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:37:11.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:11 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:11 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:37:11.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:11 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:11 smithi169 ceph-mon[35454]: pgmap v810: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:37:11.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:11 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:37:11.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:11 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:11 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:37:11.465 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:11 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:11 smithi086 ceph-mon[34813]: pgmap v810: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T09:37:11.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:11 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:37:11.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:11 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:11 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:37:11.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:11 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:11.696 INFO:tasks.cephfs.filesystem:scrub status for tag:322a1472-6d7a-4fe0-8f10-5a371b80a772 - {'path': '/', 'tag': '322a1472-6d7a-4fe0-8f10-5a371b80a772', 'options': 'recursive,force'} 2024-09-19T09:37:12.327 INFO:tasks.workunit.client.0.smithi052.stdout:499/600: open fd = 3 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:500/600: open fd = 3 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:501/600: open fd = 3 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.328 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:502/600: open fd = 3 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:503/600: open fd = 3 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:504/600: open fd = 3 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.329 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:505/600: open fd = 3 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:506/600: open fd = 3 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:507/600: open fd = 3 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:508/600: open fd = 3 2024-09-19T09:37:12.330 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:509/600: open fd = 3 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:510/600: open fd = 3 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:511/600: open fd = 3 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.331 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:512/600: open fd = 3 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:513/600: open fd = 3 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:514/600: open fd = 3 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:515/600: open fd = 3 2024-09-19T09:37:12.332 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:516/600: open fd = 3 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:517/600: open fd = 3 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:518/600: open fd = 3 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.333 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:519/600: open fd = 3 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:520/600: open fd = 3 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:521/600: open fd = 3 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.334 INFO:tasks.workunit.client.0.smithi052.stdout:522/600: open fd = 3 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:523/600: open fd = 3 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:524/600: open fd = 3 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.335 INFO:tasks.workunit.client.0.smithi052.stdout:525/600: open fd = 3 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:526/600: open fd = 3 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:527/600: open fd = 3 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.336 INFO:tasks.workunit.client.0.smithi052.stdout:528/600: open fd = 3 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:529/600: open fd = 3 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:530/600: open fd = 3 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:531/600: open fd = 3 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.337 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:532/600: open fd = 3 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:533/600: open fd = 3 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:534/600: open fd = 3 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.338 INFO:tasks.workunit.client.0.smithi052.stdout:535/600: open fd = 3 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:536/600: open fd = 3 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:537/600: open fd = 3 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.339 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:538/600: open fd = 3 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:539/600: open fd = 3 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:540/600: open fd = 3 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:541/600: open fd = 3 2024-09-19T09:37:12.340 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:542/600: open fd = 3 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:543/600: open fd = 3 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:544/600: open fd = 3 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.341 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:545/600: open fd = 3 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:546/600: open fd = 3 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:547/600: open fd = 3 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:548/600: open fd = 3 2024-09-19T09:37:12.342 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:549/600: open fd = 3 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:550/600: open fd = 3 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:551/600: open fd = 3 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.343 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:552/600: open fd = 3 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:553/600: open fd = 3 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.344 INFO:tasks.workunit.client.0.smithi052.stdout:554/600: open fd = 3 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:555/600: open fd = 3 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:556/600: open fd = 3 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:557/600: open fd = 3 2024-09-19T09:37:12.345 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:558/600: open fd = 3 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:559/600: open fd = 3 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:560/600: open fd = 3 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:12.346 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:13.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:13 smithi052 ceph-mon[30947]: pgmap v811: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:13.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:13 smithi169 ceph-mon[35454]: pgmap v811: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:13 smithi086 ceph-mon[34813]: pgmap v811: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:14.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:14 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:37:14.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:14 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:37:14.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:14 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:37:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:15 smithi052 ceph-mon[30947]: pgmap v812: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:15.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:15 smithi169 ceph-mon[35454]: pgmap v812: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:15 smithi086 ceph-mon[34813]: pgmap v812: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T09:37:17.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:17 smithi052 ceph-mon[30947]: pgmap v813: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:37:17.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:17 smithi169 ceph-mon[35454]: pgmap v813: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:37:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:17 smithi086 ceph-mon[34813]: pgmap v813: 97 pgs: 97 active+clean; 3.7 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2024-09-19T09:37:19.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:19 smithi052 ceph-mon[30947]: pgmap v814: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:19 smithi169 ceph-mon[35454]: pgmap v814: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:19 smithi086 ceph-mon[34813]: pgmap v814: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 -- 172.21.15.52:0/2030374570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 msgr2=0x7f6508104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 --2- 172.21.15.52:0/2030374570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508104a60 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009ca0 tx=0x7f64f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 -- 172.21.15.52:0/2030374570 shutdown_connections 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 --2- 172.21.15.52:0/2030374570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65081078d0 0x7f6508109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 --2- 172.21.15.52:0/2030374570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6508104fa0 0x7f6508107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 --2- 172.21.15.52:0/2030374570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508104a60 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 -- 172.21.15.52:0/2030374570 >> 172.21.15.52:0/2030374570 conn(0x7f65080fc1b0 msgr2=0x7f65080fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 -- 172.21.15.52:0/2030374570 shutdown_connections 2024-09-19T09:37:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.081+0000 7f650cb6d640 1 -- 172.21.15.52:0/2030374570 wait complete. 2024-09-19T09:37:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 Processor -- start 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 -- start start 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508104fa0 0x7f6508198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65081078d0 0x7f650819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f650810d880 con 0x7f6508102670 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f650810d700 con 0x7f65081078d0 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650cb6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f650810da00 con 0x7f6508104fa0 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43000/0 (socket says 172.21.15.52:43000) 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.082+0000 7f650659c640 1 -- 172.21.15.52:0/1830117326 learned_addr learned my addr 172.21.15.52:0/1830117326 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f6505d9b640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508104fa0 0x7f6508198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f6506d9d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65081078d0 0x7f650819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 -- 172.21.15.52:0/1830117326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508104fa0 msgr2=0x7f6508198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508104fa0 0x7f6508198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 -- 172.21.15.52:0/1830117326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65081078d0 msgr2=0x7f650819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65081078d0 0x7f650819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 -- 172.21.15.52:0/1830117326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650819fa70 con 0x7f6508102670 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650659c640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000f80 tx=0x7f64f80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f64f77fe640 1 -- 172.21.15.52:0/1830117326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8003b70 con 0x7f6508102670 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650819fd00 con 0x7f6508102670 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f64f77fe640 1 -- 172.21.15.52:0/1830117326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64f8003d10 con 0x7f6508102670 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f64f77fe640 1 -- 172.21.15.52:0/1830117326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f802fc70 con 0x7f6508102670 2024-09-19T09:37:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.083+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65081a01e0 con 0x7f6508102670 2024-09-19T09:37:20.094 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.086+0000 7f64f77fe640 1 -- 172.21.15.52:0/1830117326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f64f8004040 con 0x7f6508102670 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.086+0000 7f650f9e4740 1 Processor -- start 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.086+0000 7f650f9e4740 1 -- start start 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.086+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dd2e0 0x5622306e1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650f9e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5622306402f0 con 0x5622306e2370 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650f9e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622305e8270 con 0x5622306dc9a0 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650f9e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56223063c2b0 con 0x5622306dd2e0 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43006/0 (socket says 172.21.15.52:43006) 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 -- 172.21.15.52:0/3936615255 learned_addr learned my addr 172.21.15.52:0/3936615255 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f64f77fe640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 0x7f64f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f650659c640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dd2e0 0x5622306e1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6506d9d640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6506d9d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 0x7f64f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 -- 172.21.15.52:0/3936615255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dd2e0 msgr2=0x5622306e1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dd2e0 0x5622306e1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 -- 172.21.15.52:0/3936615255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 msgr2=0x5622306dcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306dcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 -- 172.21.15.52:0/3936615255 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622305e7340 con 0x5622306e2370 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6506d9d640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f64f77fe640 1 -- 172.21.15.52:0/1830117326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f64f80f0d30 con 0x7f6508102670 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.087+0000 7f6505d9b640 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009c60 tx=0x7f64fc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a29697d80f57c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f6506d9d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 0x7f64f00a57b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f65000058c0 tx=0x7f6500005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f64f4ff9640 1 -- 172.21.15.52:0/3936615255 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc004230 con 0x5622306e2370 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f64f4ff9640 1 -- 172.21.15.52:0/3936615255 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64fc0043d0 con 0x5622306e2370 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f64f4ff9640 1 -- 172.21.15.52:0/3936615255 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc004dc0 con 0x5622306e2370 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 -- 172.21.15.52:0/3936615255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 msgr2=0x5622306e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009c60 tx=0x7f64fc011810 comp rx=0 tx=0).stop 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 -- 172.21.15.52:0/3936615255 shutdown_connections 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306e4830 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dd2e0 0x5622306e1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 --2- 172.21.15.52:0/3936615255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.088+0000 7f650f9e4740 1 -- 172.21.15.52:0/3936615255 >> 172.21.15.52:0/3936615255 conn(0x5622306d8010 msgr2=0x5622306d8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- 172.21.15.52:0/3936615255 shutdown_connections 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- 172.21.15.52:0/3936615255 wait complete. 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- start start 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 Processor -- start 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 0x5622306ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5622306e5340 con 0x5622306dd2e0 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5622305c9290 con 0x5622306dc9a0 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5622306e54c0 con 0x5622306e2370 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f650f9e4740 10 client.0 _ll_register_callbacks cb 0x5622305fa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43012/0 (socket says 172.21.15.52:43012) 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f6505d9b640 1 -- 172.21.15.52:0/144558528 learned_addr learned my addr 172.21.15.52:0/144558528 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.089+0000 7f6506d9d640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 0x5622306ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f650659c640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 -- 172.21.15.52:0/144558528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 msgr2=0x5622306ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 0x5622306ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 -- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 msgr2=0x5622306e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 -- 172.21.15.52:0/144558528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562230353210 con 0x5622306dd2e0 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6506d9d640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 0x5622306ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f6505d9b640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f64fc000c00 tx=0x7f64fc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f105d021a66e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f64edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc028020 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f64fc024420 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64fc0043d0 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f64fc033050 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f650f9e4740 10 client.21279 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.090+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56223041f620 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64fc0043d0 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f64fc018070 con 0x5622306dd2e0 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 10 client.21279 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 10 client.21279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 20 client.21279 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622306f2570 0x5622306f4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 4 client.21279 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56223064da20 con 0x5622306f2570 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.091+0000 7f650659c640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622306f2570 0x5622306f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650659c640 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622306f2570 0x5622306f4960 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adbc9414b84c0ad3 server_cookie=2d2ecc3482069652 in_seq=0 out_seq=0 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f64edffb640 10 client.21279 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f64edffb640 1 -- 172.21.15.52:0/144558528 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56223064da20 con 0x5622306f2570 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f64edffb640 10 client.21279 handle_command_reply: tid=0 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 client.21279 shutdown 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 msgr2=0x5622306e70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f64fc000c00 tx=0x7f64fc005270 comp rx=0 tx=0).stop 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 shutdown_connections 2024-09-19T09:37:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5622306f2570 0x5622306f4960 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306e2370 0x5622306ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306e70b0 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f64edffb640 0 client.21279 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 --2- 172.21.15.52:0/144558528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dc9a0 0x5622306e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.092+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 >> 172.21.15.52:0/144558528 conn(0x5622306d8010 msgr2=0x5622306d9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.093+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 shutdown_connections 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.093+0000 7f650f9e4740 1 -- 172.21.15.52:0/144558528 wait complete. 2024-09-19T09:37:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.093+0000 7f650f9e4740 20 client.21279 trim_cache size 0 max 16384 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.107+0000 7f650f9e4740 1 Processor -- start 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.107+0000 7f650f9e4740 1 -- start start 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.107+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306d8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.107+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dd2e0 0x5622306ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f650f9e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f65081abb60 con 0x5622306e2370 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f650f9e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65081a9430 con 0x5622306dd2e0 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f650f9e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65081a7280 con 0x5622306dc9a0 2024-09-19T09:37:20.115 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43026/0 (socket says 172.21.15.52:43026) 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 -- 172.21.15.52:0/2306746351 learned_addr learned my addr 172.21.15.52:0/2306746351 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6505d9b640 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dd2e0 0x5622306ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f650659c640 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306d8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 -- 172.21.15.52:0/2306746351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 msgr2=0x5622306d8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306d8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 -- 172.21.15.52:0/2306746351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dd2e0 msgr2=0x5622306ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dd2e0 0x5622306ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 -- 172.21.15.52:0/2306746351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622306f4cd0 con 0x5622306e2370 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f6506d9d640 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6500003720 tx=0x7f6500005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ec720712b3dc6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f64effff640 1 -- 172.21.15.52:0/2306746351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500021880 con 0x5622306e2370 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f64effff640 1 -- 172.21.15.52:0/2306746351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650002a440 con 0x5622306e2370 2024-09-19T09:37:20.116 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.108+0000 7f64effff640 1 -- 172.21.15.52:0/2306746351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650000e600 con 0x5622306e2370 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- 172.21.15.52:0/2306746351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 msgr2=0x5622306d93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6500003720 tx=0x7f6500005850 comp rx=0 tx=0).stop 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- 172.21.15.52:0/2306746351 shutdown_connections 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306e2370 0x5622306d93a0 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306dd2e0 0x5622306ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 --2- 172.21.15.52:0/2306746351 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306d8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- 172.21.15.52:0/2306746351 >> 172.21.15.52:0/2306746351 conn(0x5622306d8010 msgr2=0x5622306de450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- 172.21.15.52:0/2306746351 shutdown_connections 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- 172.21.15.52:0/2306746351 wait complete. 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 -- start start 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.109+0000 7f650f9e4740 1 Processor -- start 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306eb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.117 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306e2370 0x5622306ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f65081a78f0 con 0x5622306dd2e0 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f65081a8d60 con 0x5622306e2370 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f65081a7fc0 con 0x5622306dc9a0 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 10 client.0 _ll_register_callbacks cb 0x7f64f80b8e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43032/0 (socket says 172.21.15.52:43032) 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 -- 172.21.15.52:0/1079660807 learned_addr learned my addr 172.21.15.52:0/1079660807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:20.118 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6506d9d640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306e2370 0x5622306ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650659c640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 -- 172.21.15.52:0/1079660807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 msgr2=0x5622306eb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306eb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 -- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306e2370 msgr2=0x5622306ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306e2370 0x5622306ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 -- 172.21.15.52:0/1079660807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622306ecdf0 con 0x5622306dd2e0 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650659c640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f6505d9b640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x5622306e8050 tx=0x7f64fc0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dedf3946a6fd3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f64edffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc028070 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f64fc0199a0 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.110+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f650002a440 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f64fc03c030 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 10 client.21285 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5622306ee100 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f650002a440 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f64fc018040 con 0x5622306dd2e0 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 10 client.21285 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 10 client.21285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 20 client.21285 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56223075d720 0x56223075fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 4 client.21285 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:37:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562230647d70 con 0x56223075d720 2024-09-19T09:37:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.111+0000 7f650659c640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56223075d720 0x56223075fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.112+0000 7f650659c640 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56223075d720 0x56223075fb40 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee0e1dbc098b52c server_cookie=ca0ddad1fefe1673 in_seq=0 out_seq=0 2024-09-19T09:37:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.112+0000 7f64edffb640 10 client.21285 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f64edffb640 1 -- 172.21.15.52:0/1079660807 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562230647d70 con 0x56223075d720 2024-09-19T09:37:20.127 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f64edffb640 10 client.21285 handle_command_reply: tid=0 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 client.21285 shutdown 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 msgr2=0x5622306eb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x5622306e8050 tx=0x7f64fc0096d0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 shutdown_connections 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x56223075d720 0x56223075fb40 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.128 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5622306e2370 0x5622306ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f64edffb640 0 client.21285 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5622306dd2e0 0x5622306eb7d0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 --2- 172.21.15.52:0/1079660807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5622306dc9a0 0x5622306eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 >> 172.21.15.52:0/1079660807 conn(0x5622306d8010 msgr2=0x5622306d69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 shutdown_connections 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 1 -- 172.21.15.52:0/1079660807 wait complete. 2024-09-19T09:37:20.129 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650f9e4740 20 client.21285 trim_cache size 0 max 16384 2024-09-19T09:37:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:37:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:37:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:37:20.130 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 msgr2=0x7f64f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 0x7f64f00a57b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f65000058c0 tx=0x7f6500005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 msgr2=0x7f6508197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.124+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f64f8000f80 tx=0x7f64f80319f0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 shutdown_connections 2024-09-19T09:37:20.132 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65081078d0 0x7f650819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f64f00a32f0 0x7f64f00a57b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508104fa0 0x7f6508198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 --2- 172.21.15.52:0/1830117326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6508102670 0x7f6508197e50 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 >> 172.21.15.52:0/1830117326 conn(0x7f65080fc1b0 msgr2=0x7f6508102ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 shutdown_connections 2024-09-19T09:37:20.133 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:20.125+0000 7f650cb6d640 1 -- 172.21.15.52:0/1830117326 wait complete. 2024-09-19T09:37:21.310 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:21 smithi086 ceph-mon[34813]: pgmap v815: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:21.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:21 smithi052 ceph-mon[30947]: pgmap v815: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:21.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:21 smithi169 ceph-mon[35454]: pgmap v815: 97 pgs: 97 active+clean; 3.7 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T09:37:23.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:23 smithi052 ceph-mon[30947]: pgmap v816: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-19T09:37:23.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:23 smithi169 ceph-mon[35454]: pgmap v816: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-19T09:37:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:23 smithi086 ceph-mon[34813]: pgmap v816: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-09-19T09:37:25.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:25 smithi052 ceph-mon[30947]: pgmap v817: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:25.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:25 smithi169 ceph-mon[35454]: pgmap v817: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:25 smithi086 ceph-mon[34813]: pgmap v817: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:27.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:27 smithi052 ceph-mon[30947]: pgmap v818: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:37:27.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:27 smithi169 ceph-mon[35454]: pgmap v818: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:37:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:27 smithi086 ceph-mon[34813]: pgmap v818: 97 pgs: 97 active+clean; 3.8 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-19T09:37:29.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:29 smithi052 ceph-mon[30947]: pgmap v819: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:29.445 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:29 smithi169 ceph-mon[35454]: pgmap v819: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:29 smithi086 ceph-mon[34813]: pgmap v819: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:31.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:31 smithi052 ceph-mon[30947]: pgmap v820: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:31.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:31 smithi169 ceph-mon[35454]: pgmap v820: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:31.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:31 smithi086 ceph-mon[34813]: pgmap v820: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 -- 172.21.15.52:0/563839314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404107840 msgr2=0x7fb404109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 --2- 172.21.15.52:0/563839314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404107840 0x7fb404109cb0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009ca0 tx=0x7fb3fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 -- 172.21.15.52:0/563839314 shutdown_connections 2024-09-19T09:37:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 --2- 172.21.15.52:0/563839314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404107840 0x7fb404109cb0 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 --2- 172.21.15.52:0/563839314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb404104f10 0x7fb404107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 --2- 172.21.15.52:0/563839314 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4041025e0 0x7fb4041049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 -- 172.21.15.52:0/563839314 >> 172.21.15.52:0/563839314 conn(0x7fb4040fc1e0 msgr2=0x7fb4040fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 -- 172.21.15.52:0/563839314 shutdown_connections 2024-09-19T09:37:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.226+0000 7fb4097e4640 1 -- 172.21.15.52:0/563839314 wait complete. 2024-09-19T09:37:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 Processor -- start 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 -- start start 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 0x7fb404197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 0x7fb40419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d8c0 con 0x7fb404104f10 2024-09-19T09:37:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410d740 con 0x7fb404107840 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4097e4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb40410da40 con 0x7fb4041025e0 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.227+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36022/0 (socket says 172.21.15.52:36022) 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 -- 172.21.15.52:0/722585858 learned_addr learned my addr 172.21.15.52:0/722585858 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb402ffd640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 0x7fb404197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4037fe640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 0x7fb40419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 -- 172.21.15.52:0/722585858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 msgr2=0x7fb404197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 0x7fb404197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 -- 172.21.15.52:0/722585858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 msgr2=0x7fb40419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 0x7fb40419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 -- 172.21.15.52:0/722585858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40419fa90 con 0x7fb404104f10 2024-09-19T09:37:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4037fe640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 0x7fb40419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb402ffd640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 0x7fb404197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4027fc640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b450 tx=0x7fb3f800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb3ebfff640 1 -- 172.21.15.52:0/722585858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8015020 con 0x7fb404104f10 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb3ebfff640 1 -- 172.21.15.52:0/722585858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f8011d70 con 0x7fb404104f10 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419fd80 con 0x7fb404104f10 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb3ebfff640 1 -- 172.21.15.52:0/722585858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800f340 con 0x7fb404104f10 2024-09-19T09:37:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.228+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041a0270 con 0x7fb404104f10 2024-09-19T09:37:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb3ebfff640 1 -- 172.21.15.52:0/722585858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb3f8018020 con 0x7fb404104f10 2024-09-19T09:37:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 Processor -- start 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 -- start start 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a75da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a7ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ba89d92f0 con 0x562ba8a7b370 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ba8981270 con 0x562ba8a762e0 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb40c656740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ba89d52b0 con 0x562ba8a759a0 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb3ebfff640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 0x7fb3ec0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.231+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a75da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36024/0 (socket says 172.21.15.52:36024) 2024-09-19T09:37:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb402ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a7ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 -- 172.21.15.52:0/3713418133 learned_addr learned my addr 172.21.15.52:0/3713418133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4037fe640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 0x7fb3ec0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb3ebfff640 1 -- 172.21.15.52:0/722585858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb3f80cf4a0 con 0x7fb404104f10 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 -- 172.21.15.52:0/3713418133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 msgr2=0x562ba8a75da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a75da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 -- 172.21.15.52:0/3713418133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 msgr2=0x562ba8a7ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a7ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 -- 172.21.15.52:0/3713418133 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba8980340 con 0x562ba8a7b370 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb402ffd640 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a7ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4027fc640 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8010920 tx=0x7fb3f8010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2586fe80ed77950 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb4037fe640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 0x7fb3ec0a57b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc02ade0 tx=0x7fb3fc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb3e97fa640 1 -- 172.21.15.52:0/3713418133 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8084d90 con 0x562ba8a7b370 2024-09-19T09:37:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb3e97fa640 1 -- 172.21.15.52:0/3713418133 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f809c140 con 0x562ba8a7b370 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.232+0000 7fb3e97fa640 1 -- 172.21.15.52:0/3713418133 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8010570 con 0x562ba8a7b370 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- 172.21.15.52:0/3713418133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 msgr2=0x562ba8a7d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8010920 tx=0x7fb3f8010970 comp rx=0 tx=0).stop 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- 172.21.15.52:0/3713418133 shutdown_connections 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a7d830 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a7ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 --2- 172.21.15.52:0/3713418133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a75da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- 172.21.15.52:0/3713418133 >> 172.21.15.52:0/3713418133 conn(0x562ba8a71010 msgr2=0x562ba8a71410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- 172.21.15.52:0/3713418133 shutdown_connections 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- 172.21.15.52:0/3713418133 wait complete. 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.233+0000 7fb40c656740 1 -- start start 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 Processor -- start 2024-09-19T09:37:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a759a0 0x562ba8a7fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a7b370 0x562ba8a87180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562ba8a7e340 con 0x562ba8a762e0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x562ba8962290 con 0x562ba8a759a0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x562ba8a7e4c0 con 0x562ba8a7b370 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb40c656740 10 client.0 _ll_register_callbacks cb 0x562ba8993140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36038/0 (socket says 172.21.15.52:36038) 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 -- 172.21.15.52:0/741514342 learned_addr learned my addr 172.21.15.52:0/741514342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb402ffd640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a759a0 0x562ba8a7fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4037fe640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a7b370 0x562ba8a87180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 -- 172.21.15.52:0/741514342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a7b370 msgr2=0x562ba8a87180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a7b370 0x562ba8a87180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 -- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a759a0 msgr2=0x562ba8a7fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a759a0 0x562ba8a7fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 -- 172.21.15.52:0/741514342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba86ec210 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb4027fc640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8098410 tx=0x7fb3f8099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e03df4da864dd95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.234+0000 7fb3e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80b4060 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb3f80860d0 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f809c140 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb3f8084d90 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 10 client.21297 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ba87b8620 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f809c140 con 0x562ba8a762e0 2024-09-19T09:37:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb3f809af20 con 0x562ba8a762e0 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 10 client.21297 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 10 client.21297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 20 client.21297 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8a8b480 0x562ba8a8d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 4 client.21297 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.235+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ba89e6a20 con 0x562ba8a8b480 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.236+0000 7fb402ffd640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8a8b480 0x562ba8a8d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.236+0000 7fb3e6ff5640 10 client.21297 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.236+0000 7fb402ffd640 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8a8b480 0x562ba8a8d870 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1b75308ce7ff97 server_cookie=7d244905bddcf658 in_seq=0 out_seq=0 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/741514342 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ba89e6a20 con 0x562ba8a8b480 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb3e6ff5640 10 client.21297 handle_command_reply: tid=0 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 client.21297 shutdown 2024-09-19T09:37:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 msgr2=0x562ba8a80140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8098410 tx=0x7fb3f8099ae0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 shutdown_connections 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8a8b480 0x562ba8a8d870 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a7b370 0x562ba8a87180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8a80140 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 --2- 172.21.15.52:0/741514342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a759a0 0x562ba8a7fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb3e6ff5640 0 client.21297 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 >> 172.21.15.52:0/741514342 conn(0x562ba8a71010 msgr2=0x562ba8a72820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 shutdown_connections 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 1 -- 172.21.15.52:0/741514342 wait complete. 2024-09-19T09:37:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.237+0000 7fb40c656740 20 client.21297 trim_cache size 0 max 16384 2024-09-19T09:37:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 Processor -- start 2024-09-19T09:37:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 -- start start 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a91f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041abb50 con 0x562ba8a7b370 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041a9420 con 0x562ba8a762e0 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb40c656740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041a7270 con 0x562ba8a759a0 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb4037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36042/0 (socket says 172.21.15.52:36042) 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb4037fe640 1 -- 172.21.15.52:0/3695118318 learned_addr learned my addr 172.21.15.52:0/3695118318 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.252+0000 7fb4027fc640 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a91f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb402ffd640 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 -- 172.21.15.52:0/3695118318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 msgr2=0x562ba8a700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 -- 172.21.15.52:0/3695118318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 msgr2=0x562ba8a91f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a91f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 -- 172.21.15.52:0/3695118318 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ba8a87530 con 0x562ba8a7b370 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb4037fe640 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc02f4d0 tx=0x7fb3fc042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311cd275f207edc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb3e8ff9640 1 -- 172.21.15.52:0/3695118318 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc003a30 con 0x562ba8a7b370 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb3e8ff9640 1 -- 172.21.15.52:0/3695118318 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3fc036040 con 0x562ba8a7b370 2024-09-19T09:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.253+0000 7fb3e8ff9640 1 -- 172.21.15.52:0/3695118318 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc02f870 con 0x562ba8a7b370 2024-09-19T09:37:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- 172.21.15.52:0/3695118318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 msgr2=0x562ba8a92490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc02f4d0 tx=0x7fb3fc042000 comp rx=0 tx=0).stop 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- 172.21.15.52:0/3695118318 shutdown_connections 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a7b370 0x562ba8a92490 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a762e0 0x562ba8a91f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- 172.21.15.52:0/3695118318 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8a700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- 172.21.15.52:0/3695118318 >> 172.21.15.52:0/3695118318 conn(0x562ba8a71010 msgr2=0x562ba8a6f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- 172.21.15.52:0/3695118318 shutdown_connections 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- 172.21.15.52:0/3695118318 wait complete. 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- start start 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 Processor -- start 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8af1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 0x562ba8af9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041a78e0 con 0x562ba8a762e0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041a8d50 con 0x562ba8a7b370 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041a7fb0 con 0x562ba8a759a0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb40c656740 10 client.0 _ll_register_callbacks cb 0x7fb3f400b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb4027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36050/0 (socket says 172.21.15.52:36050) 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb4027fc640 1 -- 172.21.15.52:0/1953137887 learned_addr learned my addr 172.21.15.52:0/1953137887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.254+0000 7fb402ffd640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8af1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4037fe640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 0x562ba8af9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 -- 172.21.15.52:0/1953137887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 msgr2=0x562ba8af1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8af1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 -- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 msgr2=0x562ba8af9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 0x562ba8af9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 -- 172.21.15.52:0/1953137887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ba8af9880 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4037fe640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 0x562ba8af9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb4027fc640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009fd0 tx=0x7fb3f8097ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa6783335a43d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80b4050 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fb3f809b0a0 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3fc036040 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb3f8097ce0 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb40c656740 10 client.21303 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562ba8afab90 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3fc036040 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.255+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb3f80ba170 con 0x562ba8a762e0 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 10 client.21303 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 10 client.21303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 20 client.21303 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8afb370 0x562ba8afd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 4 client.21303 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ba89e0d70 con 0x562ba8afb370 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb402ffd640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8afb370 0x562ba8afd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb3e6ff5640 10 client.21303 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.256+0000 7fb402ffd640 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8afb370 0x562ba8afd790 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6a1c682d37caa9 server_cookie=f875e7d127b9080e in_seq=0 out_seq=0 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb3e6ff5640 1 -- 172.21.15.52:0/1953137887 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ba89e0d70 con 0x562ba8afb370 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb3e6ff5640 10 client.21303 handle_command_reply: tid=0 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 client.21303 shutdown 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 msgr2=0x562ba8af2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009fd0 tx=0x7fb3f8097ae0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 shutdown_connections 2024-09-19T09:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x562ba8afb370 0x562ba8afd790 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x562ba8a7b370 0x562ba8af9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562ba8a762e0 0x562ba8af2230 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb3e6ff5640 0 client.21303 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 --2- 172.21.15.52:0/1953137887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x562ba8a759a0 0x562ba8af1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 >> 172.21.15.52:0/1953137887 conn(0x562ba8a71010 msgr2=0x562ba8a701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 shutdown_connections 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 1 -- 172.21.15.52:0/1953137887 wait complete. 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.270+0000 7fb40c656740 20 client.21303 trim_cache size 0 max 16384 2024-09-19T09:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:37:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:37:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:37:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:37:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 msgr2=0x7fb3ec0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 0x7fb3ec0a57b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc02ade0 tx=0x7fb3fc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 msgr2=0x7fb4041983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800b450 tx=0x7fb3f800b910 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 shutdown_connections 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb404107840 0x7fb40419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb404104f10 0x7fb4041983b0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fb3ec0a32f0 0x7fb3ec0a57b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 --2- 172.21.15.52:0/722585858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb4041025e0 0x7fb404197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 >> 172.21.15.52:0/722585858 conn(0x7fb4040fc1e0 msgr2=0x7fb404102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 shutdown_connections 2024-09-19T09:37:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:33.271+0000 7fb4097e4640 1 -- 172.21.15.52:0/722585858 wait complete. 2024-09-19T09:37:33.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:33 smithi052 ceph-mon[30947]: pgmap v821: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:33.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:33 smithi169 ceph-mon[35454]: pgmap v821: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:33.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:33 smithi086 ceph-mon[34813]: pgmap v821: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:35.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:35 smithi052 ceph-mon[30947]: pgmap v822: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:35.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:35 smithi169 ceph-mon[35454]: pgmap v822: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:35 smithi086 ceph-mon[34813]: pgmap v822: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:37 smithi052 ceph-mon[30947]: pgmap v823: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:37 smithi169 ceph-mon[35454]: pgmap v823: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:37 smithi086 ceph-mon[34813]: pgmap v823: 97 pgs: 97 active+clean; 3.9 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-19T09:37:39.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:39 smithi052 ceph-mon[30947]: pgmap v824: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:39 smithi169 ceph-mon[35454]: pgmap v824: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:39 smithi086 ceph-mon[34813]: pgmap v824: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:41.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:41 smithi052 ceph-mon[30947]: pgmap v825: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:41.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:41 smithi169 ceph-mon[35454]: pgmap v825: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:41.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:41 smithi086 ceph-mon[34813]: pgmap v825: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:41.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:37:41.958 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:42.314 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:42.315 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:42.315 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:42.315 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:37:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:37:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:37:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.504+0000 7f01ec607640 1 -- 172.21.15.52:0/610707705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 msgr2=0x7f01e41108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.504+0000 7f01ec607640 1 --2- 172.21.15.52:0/610707705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e41108e0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f01dc009900 tx=0x7f01dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:42.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- 172.21.15.52:0/610707705 shutdown_connections 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- 172.21.15.52:0/610707705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e41108e0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- 172.21.15.52:0/610707705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e4101360 0x7f01e410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- 172.21.15.52:0/610707705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e41009b0 0x7f01e4100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- 172.21.15.52:0/610707705 >> 172.21.15.52:0/610707705 conn(0x7f01e40fc7d0 msgr2=0x7f01e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- 172.21.15.52:0/610707705 shutdown_connections 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- 172.21.15.52:0/610707705 wait complete. 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 Processor -- start 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- start start 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e41009b0 0x7f01e419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e4101360 0x7f01e419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4114220 con 0x7f01e410e4d0 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41140a0 con 0x7f01e41009b0 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.505+0000 7f01ec607640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41143a0 con 0x7f01e4101360 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52542/0 (socket says 172.21.15.52:52542) 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 -- 172.21.15.52:0/1867096324 learned_addr learned my addr 172.21.15.52:0/1867096324 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e4101360 0x7f01e419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e41009b0 0x7f01e419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 -- 172.21.15.52:0/1867096324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e4101360 msgr2=0x7f01e419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e4101360 0x7f01e419ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 -- 172.21.15.52:0/1867096324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e41009b0 msgr2=0x7f01e419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e41009b0 0x7f01e419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 -- 172.21.15.52:0/1867096324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e419f6b0 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01eaba4640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005ab0 tx=0x7f01dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01d77fe640 1 -- 172.21.15.52:0/1867096324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc03f030 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e419f940 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01d77fe640 1 -- 172.21.15.52:0/1867096324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01dc003ce0 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01d77fe640 1 -- 172.21.15.52:0/1867096324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc035070 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.506+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41a7280 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.509+0000 7f01d77fe640 1 -- 172.21.15.52:0/1867096324 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f01dc042030 con 0x7f01e410e4d0 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.509+0000 7f01ee9e0740 1 Processor -- start 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.509+0000 7f01ee9e0740 1 -- start start 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c790b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c790da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653c78662e0 con 0x5653c790b680 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5653c780dce0 con 0x5653c79004a0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653c78622a0 con 0x5653c7900dc0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c790da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:41628/0 (socket says 172.21.15.52:41628) 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01d77fe640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 0x7f01d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 -- 172.21.15.52:0/5187381 learned_addr learned my addr 172.21.15.52:0/5187381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c790b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01eaba4640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 0x7f01d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 -- 172.21.15.52:0/5187381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 msgr2=0x5653c790b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c790b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01d77fe640 1 -- 172.21.15.52:0/1867096324 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f01dc0f0170 con 0x7f01e410e4d0 2024-09-19T09:37:42.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 -- 172.21.15.52:0/5187381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 msgr2=0x5653c790da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c790da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.510+0000 7f01e9ba2640 1 -- 172.21.15.52:0/5187381 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c77f2440 con 0x5653c79004a0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f01d800bfd0 tx=0x7f01d800b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d65052070d4e5c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01eaba4640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 0x7f01d00a5700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0bc410 tx=0x7f01dc0875f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01d4ff9640 1 -- 172.21.15.52:0/5187381 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8004020 con 0x5653c79004a0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01d4ff9640 1 -- 172.21.15.52:0/5187381 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d800fc10 con 0x5653c79004a0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01d4ff9640 1 -- 172.21.15.52:0/5187381 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8003930 con 0x5653c79004a0 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.511+0000 7f01ee9e0740 1 -- 172.21.15.52:0/5187381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 msgr2=0x5653c7900880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f01d800bfd0 tx=0x7f01d800b410 comp rx=0 tx=0).stop 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- 172.21.15.52:0/5187381 shutdown_connections 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c790da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c790b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/5187381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c79004a0 0x5653c7900880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- 172.21.15.52:0/5187381 >> 172.21.15.52:0/5187381 conn(0x5653c78fca30 msgr2=0x5653c78fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- 172.21.15.52:0/5187381 shutdown_connections 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- 172.21.15.52:0/5187381 wait complete. 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- start start 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 Processor -- start 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c7908290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c790b680 0x5653c79087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653c790e250 con 0x5653c79004a0 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5653c7821050 con 0x5653c790b680 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653c790e3d0 con 0x5653c7900dc0 2024-09-19T09:37:42.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.512+0000 7f01ee9e0740 10 client.0 _ll_register_callbacks cb 0x5653c7861160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52558/0 (socket says 172.21.15.52:52558) 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4109911727 learned_addr learned my addr 172.21.15.52:0/4109911727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c790b680 0x5653c79087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c7908290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4109911727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 msgr2=0x5653c7908290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c7908290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c790b680 msgr2=0x5653c79087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c790b680 0x5653c79087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4109911727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c75d73c0 con 0x5653c79004a0 2024-09-19T09:37:42.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f01d8003630 tx=0x7f01d8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d893b20e2f7299 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d800fe40 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f01d8012020 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.513+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d800fc10 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01d8030030 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 10 client.21315 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653c7919c20 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d800fc10 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01d802a030 con 0x5653c79004a0 2024-09-19T09:37:42.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 10 client.21315 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 10 client.21315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 20 client.21315 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c791af70 0x5653c791d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 4 client.21315 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653c7873850 con 0x5653c791af70 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.514+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c791af70 0x5653c791d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c791af70 0x5653c791d360 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d68a62c2d493e98 server_cookie=b52090ab85745b0e in_seq=0 out_seq=0 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01cdffb640 10 client.21315 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01cdffb640 1 -- 172.21.15.52:0/4109911727 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653c7873850 con 0x5653c791af70 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01cdffb640 10 client.21315 handle_command_reply: tid=0 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01ee9e0740 1 client.21315 shutdown 2024-09-19T09:37:42.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 msgr2=0x5653c790afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.515+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f01d8003630 tx=0x7f01d8005fd0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 shutdown_connections 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c791af70 0x5653c791d360 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c790b680 0x5653c79087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c7900dc0 0x5653c7908290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4109911727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c790afe0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 >> 172.21.15.52:0/4109911727 conn(0x5653c78fca30 msgr2=0x5653c78fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01cdffb640 0 client.21315 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 shutdown_connections 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4109911727 wait complete. 2024-09-19T09:37:42.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.516+0000 7f01ee9e0740 20 client.21315 trim_cache size 0 max 16384 2024-09-19T09:37:42.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 Processor -- start 2024-09-19T09:37:42.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 -- start start 2024-09-19T09:37:42.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c79004a0 0x5653c79174b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7922b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41b22a0 con 0x5653c790b680 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41afb70 con 0x5653c7900dc0 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ad9c0 con 0x5653c79004a0 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52560/0 (socket says 172.21.15.52:52560) 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.534+0000 7f01e9ba2640 1 -- 172.21.15.52:0/3496399440 learned_addr learned my addr 172.21.15.52:0/3496399440 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7922b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c79004a0 0x5653c79174b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 -- 172.21.15.52:0/3496399440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c79004a0 msgr2=0x5653c79174b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c79004a0 0x5653c79174b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 -- 172.21.15.52:0/3496399440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 msgr2=0x5653c7923060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 -- 172.21.15.52:0/3496399440 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c790b350 con 0x5653c7900dc0 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7922b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5653c791dac0 tx=0x7f01e0009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec1060a29e69384 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01cffff640 1 -- 172.21.15.52:0/3496399440 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0013250 con 0x5653c7900dc0 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01cffff640 1 -- 172.21.15.52:0/3496399440 <== mon.2 v2:172.21.15.86:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e0005520 con 0x5653c7900dc0 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.535+0000 7f01cffff640 1 -- 172.21.15.52:0/3496399440 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e001b770 con 0x5653c7900dc0 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 -- 172.21.15.52:0/3496399440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 msgr2=0x5653c7922b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7922b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x5653c791dac0 tx=0x7f01e0009660 comp rx=0 tx=0).stop 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 -- 172.21.15.52:0/3496399440 shutdown_connections 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c790b680 0x5653c7923060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7922b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/3496399440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c79004a0 0x5653c79174b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 -- 172.21.15.52:0/3496399440 >> 172.21.15.52:0/3496399440 conn(0x5653c78fca30 msgr2=0x5653c7907380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 -- 172.21.15.52:0/3496399440 shutdown_connections 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.536+0000 7f01ee9e0740 1 -- 172.21.15.52:0/3496399440 wait complete. 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 -- start start 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 Processor -- start 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7913d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c790b680 0x5653c7904aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ae030 con 0x5653c79004a0 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41af4a0 con 0x5653c7900dc0 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ae700 con 0x5653c790b680 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01ee9e0740 10 client.0 _ll_register_callbacks cb 0x7f01d800be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01e9ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52564/0 (socket says 172.21.15.52:52564) 2024-09-19T09:37:42.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.537+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4021212744 learned_addr learned my addr 172.21.15.52:0/4021212744 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7913d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4021212744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c790b680 msgr2=0x5653c7904aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c790b680 0x5653c7904aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 msgr2=0x5653c7913d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7913d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 -- 172.21.15.52:0/4021212744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c79051e0 con 0x5653c79004a0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7913d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01e9ba2640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f01d8005d00 tx=0x7f01d800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed685eae88a26f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d803a060 con 0x5653c79004a0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f01d800fe20 con 0x5653c79004a0 2024-09-19T09:37:42.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e0005520 con 0x5653c79004a0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01d8012040 con 0x5653c79004a0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01ee9e0740 10 client.21321 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.538+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653c7985500 con 0x5653c79004a0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e0005520 con 0x5653c79004a0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01d802a040 con 0x5653c79004a0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 10 client.21321 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 10 client.21321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 20 client.21321 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c7985bc0 0x5653c7987fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 4 client.21321 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653c786dd60 con 0x5653c7985bc0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c7985bc0 0x5653c7987fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:42.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01ea3a3640 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c7985bc0 0x5653c7987fe0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f15767157d1a907 server_cookie=f0216466800b4194 in_seq=0 out_seq=0 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.539+0000 7f01cdffb640 10 client.21321 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01cdffb640 1 -- 172.21.15.52:0/4021212744 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5653c786dd60 con 0x5653c7985bc0 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01cdffb640 10 client.21321 handle_command_reply: tid=0 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 client.21321 shutdown 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 msgr2=0x5653c7913800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f01d8005d00 tx=0x7f01d800b780 comp rx=0 tx=0).stop 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 shutdown_connections 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5653c7985bc0 0x5653c7987fe0 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653c790b680 0x5653c7904aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5653c7900dc0 0x5653c7913d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 --2- 172.21.15.52:0/4021212744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653c79004a0 0x5653c7913800 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 >> 172.21.15.52:0/4021212744 conn(0x5653c78fca30 msgr2=0x5653c7901ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01cdffb640 0 client.21321 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 shutdown_connections 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 1 -- 172.21.15.52:0/4021212744 wait complete. 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.540+0000 7f01ee9e0740 20 client.21321 trim_cache size 0 max 16384 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:37:42.549 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 msgr2=0x7f01d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 0x7f01d00a5700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f01dc0bc410 tx=0x7f01dc0875f0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 msgr2=0x7f01e419efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005ab0 tx=0x7f01dc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 shutdown_connections 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01e410e4d0 0x7f01e419efd0 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01d00a3240 0x7f01d00a5700 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e4101360 0x7f01e419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 --2- 172.21.15.52:0/1867096324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01e41009b0 0x7f01e419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 >> 172.21.15.52:0/1867096324 conn(0x7f01e40fc7d0 msgr2=0x7f01e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 shutdown_connections 2024-09-19T09:37:42.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:42.541+0000 7f01ec607640 1 -- 172.21.15.52:0/1867096324 wait complete. 2024-09-19T09:37:43.408 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:43 smithi052 ceph-mon[30947]: pgmap v826: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:37:43.442 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:37:43.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:43.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:43 smithi169 ceph-mon[35454]: pgmap v826: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:37:43.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:43 smithi086 ceph-mon[34813]: pgmap v826: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 15 op/s 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 -- 172.21.15.52:0/4167445330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 msgr2=0x7ff3e410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/4167445330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e410eaf0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc009cd0 tx=0x7ff3dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 -- 172.21.15.52:0/4167445330 shutdown_connections 2024-09-19T09:37:44.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/4167445330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e410eaf0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/4167445330 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 0x7ff3e4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/4167445330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 0x7ff3e41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 -- 172.21.15.52:0/4167445330 >> 172.21.15.52:0/4167445330 conn(0x7ff3e4077210 msgr2=0x7ff3e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 -- 172.21.15.52:0/4167445330 shutdown_connections 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 -- 172.21.15.52:0/4167445330 wait complete. 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.160+0000 7ff3eaad9640 1 Processor -- start 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 -- start start 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 0x7ff3e4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 0x7ff3e41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4111fa0 con 0x7ff3e4106f50 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4111e20 con 0x7ff3e41002f0 2024-09-19T09:37:44.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3eaad9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e4112120 con 0x7ff3e4100ca0 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52588/0 (socket says 172.21.15.52:52588) 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 -- 172.21.15.52:0/606482211 learned_addr learned my addr 172.21.15.52:0/606482211 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e8875640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 0x7ff3e4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e3fff640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 0x7ff3e41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 -- 172.21.15.52:0/606482211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 msgr2=0x7ff3e41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 0x7ff3e41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 -- 172.21.15.52:0/606482211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 msgr2=0x7ff3e4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 0x7ff3e4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.161+0000 7ff3e9076640 1 -- 172.21.15.52:0/606482211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e419d410 con 0x7ff3e4106f50 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3e9076640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc005cc0 tx=0x7ff3dc032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:44.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc004040 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3dc0046c0 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e419d6a0 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc030e00 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.162+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e41a4fe0 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.163+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e41006d0 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.164+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff3dc0305a0 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.165+0000 7ff3e1ffb640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 0x7ff3d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.165+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff3dc02e030 con 0x7ff3e4106f50 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.165+0000 7ff3e8875640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 0x7ff3d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.166+0000 7ff3e8875640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 0x7ff3d00a5780 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009bd0 tx=0x7ff3d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.168+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3dc04b060 con 0x7ff3e4106f50 2024-09-19T09:37:44.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.383+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3e41997c0 con 0x7ff3e4106f50 2024-09-19T09:37:44.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.384+0000 7ff3e1ffb640 1 -- 172.21.15.52:0/606482211 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7ff3e41997c0 con 0x7ff3e4106f50 2024-09-19T09:37:44.385 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:37:44.386 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:37:44.386 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 msgr2=0x7ff3d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 0x7ff3d00a5780 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009bd0 tx=0x7ff3d4005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 msgr2=0x7ff3e419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc005cc0 tx=0x7ff3dc032f40 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 shutdown_connections 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e4106f50 0x7ff3e419cd30 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff3d00a32c0 0x7ff3d00a5780 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e4100ca0 0x7ff3e41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 --2- 172.21.15.52:0/606482211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3e41002f0 0x7ff3e4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 >> 172.21.15.52:0/606482211 conn(0x7ff3e4077210 msgr2=0x7ff3e4105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:44.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 shutdown_connections 2024-09-19T09:37:44.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:44.386+0000 7ff3eaad9640 1 -- 172.21.15.52:0/606482211 wait complete. 2024-09-19T09:37:45.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:37:45.293 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:45.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:45 smithi052 ceph-mon[30947]: pgmap v827: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:45.415 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:45 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/606482211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:45 smithi169 ceph-mon[35454]: pgmap v827: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:45 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/606482211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:45 smithi086 ceph-mon[34813]: pgmap v827: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:45 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/606482211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 -- 172.21.15.52:0/3463702465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 msgr2=0x7f88401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 --2- 172.21.15.52:0/3463702465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f88401029b0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f8834009900 tx=0x7f883402a480 comp rx=0 tx=0).stop 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 -- 172.21.15.52:0/3463702465 shutdown_connections 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 --2- 172.21.15.52:0/3463702465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 0x7f884010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 --2- 172.21.15.52:0/3463702465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f88401029b0 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 --2- 172.21.15.52:0/3463702465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 0x7f8840101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 -- 172.21.15.52:0/3463702465 >> 172.21.15.52:0/3463702465 conn(0x7f88400fc7d0 msgr2=0x7f88400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 -- 172.21.15.52:0/3463702465 shutdown_connections 2024-09-19T09:37:45.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.752+0000 7f8846786640 1 -- 172.21.15.52:0/3463702465 wait complete. 2024-09-19T09:37:45.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 Processor -- start 2024-09-19T09:37:45.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 -- start start 2024-09-19T09:37:45.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 0x7f8840198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 0x7f884019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8840110f80 con 0x7f8840102570 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8840110e00 con 0x7f8840100e20 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8846786640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8840111100 con 0x7f8840102ef0 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52600/0 (socket says 172.21.15.52:52600) 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f883f7fe640 1 -- 172.21.15.52:0/2167268898 learned_addr learned my addr 172.21.15.52:0/2167268898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.753+0000 7f8844d23640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 0x7f884019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883ffff640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 0x7f8840198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 -- 172.21.15.52:0/2167268898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 msgr2=0x7f884019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 0x7f884019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 -- 172.21.15.52:0/2167268898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 msgr2=0x7f8840198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 0x7f8840198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 -- 172.21.15.52:0/2167268898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884019d510 con 0x7f8840102570 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883f7fe640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f8834006010 tx=0x7f8834003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883d7fa640 1 -- 172.21.15.52:0/2167268898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883403f070 con 0x7f8840102570 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884019d7a0 con 0x7f8840102570 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883d7fa640 1 -- 172.21.15.52:0/2167268898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8834031c30 con 0x7f8840102570 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f883d7fa640 1 -- 172.21.15.52:0/2167268898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834035030 con 0x7f8840102570 2024-09-19T09:37:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.754+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88401a50e0 con 0x7f8840102570 2024-09-19T09:37:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f883d7fa640 1 -- 172.21.15.52:0/2167268898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8834042070 con 0x7f8840102570 2024-09-19T09:37:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 Processor -- start 2024-09-19T09:37:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 -- start start 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9273a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9280760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7f91d92f0 con 0x55a7f9274b40 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a7f9180cf0 con 0x55a7f92735d0 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.757+0000 7f8848b5f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7f91d52b0 con 0x55a7f927e370 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52606/0 (socket says 172.21.15.52:52606) 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 -- 172.21.15.52:0/747577954 learned_addr learned my addr 172.21.15.52:0/747577954 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f883ffff640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9273a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f883f7fe640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9280760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f883d7fa640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 0x7f88280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 -- 172.21.15.52:0/747577954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 msgr2=0x55a7f9280760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9280760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 -- 172.21.15.52:0/747577954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 msgr2=0x55a7f9273a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9273a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 -- 172.21.15.52:0/747577954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7f91653a0 con 0x55a7f9274b40 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f883f7fe640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9280760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 0x7f88280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f883d7fa640 1 -- 172.21.15.52:0/2167268898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88340f0200 con 0x7f8840102570 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.758+0000 7f8844d23640 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f8838010440 tx=0x7f8838010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc934e0a63be214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f88267fc640 1 -- 172.21.15.52:0/747577954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883801d400 con 0x55a7f9274b40 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f88267fc640 1 -- 172.21.15.52:0/747577954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f883801da80 con 0x55a7f9274b40 2024-09-19T09:37:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f88267fc640 1 -- 172.21.15.52:0/747577954 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883801c840 con 0x55a7f9274b40 2024-09-19T09:37:45.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 -- 172.21.15.52:0/747577954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 msgr2=0x55a7f9273090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8844d23640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 0x7f88280a5700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8838021000 tx=0x7f883801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f8838010440 tx=0x7f8838010900 comp rx=0 tx=0).stop 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 -- 172.21.15.52:0/747577954 shutdown_connections 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9280760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9273a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 --2- 172.21.15.52:0/747577954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9273090 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 -- 172.21.15.52:0/747577954 >> 172.21.15.52:0/747577954 conn(0x55a7f923c310 msgr2=0x55a7f926fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 -- 172.21.15.52:0/747577954 shutdown_connections 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.759+0000 7f8848b5f740 1 -- 172.21.15.52:0/747577954 wait complete. 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 -- start start 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 Processor -- start 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f92827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9286e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55a7f9281070 con 0x55a7f9274b40 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55a7f9194060 con 0x55a7f92735d0 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55a7f92811f0 con 0x55a7f927e370 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f8848b5f740 10 client.0 _ll_register_callbacks cb 0x55a7f8ee78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.760+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52612/0 (socket says 172.21.15.52:52612) 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 -- 172.21.15.52:0/471585732 learned_addr learned my addr 172.21.15.52:0/471585732 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883ffff640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f92827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f8844d23640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9286e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 -- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 msgr2=0x55a7f9286e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9286e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 -- 172.21.15.52:0/471585732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 msgr2=0x55a7f92827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f92827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 -- 172.21.15.52:0/471585732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7f8f4a3c0 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883ffff640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f92827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f883f7fe640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f88340c4ee0 tx=0x7f88340bc630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44584f78f25cbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f881f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834049070 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88340b8e10 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f883801da80 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8834031de0 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f8848b5f740 10 client.21339 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.761+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7f9290f50 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f883801da80 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f88340bca00 con 0x55a7f9274b40 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 10 client.21339 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:45.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 10 client.21339 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 20 client.21339 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f9292340 0x55a7f9294770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 4 client.21339 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7f91e6860 con 0x55a7f9292340 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.762+0000 7f883ffff640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f9292340 0x55a7f9294770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.763+0000 7f883ffff640 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f9292340 0x55a7f9294770 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=674040fdb9d633ee server_cookie=7d0587b2780b5995 in_seq=0 out_seq=0 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.763+0000 7f881f7fe640 10 client.21339 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.763+0000 7f881f7fe640 1 -- 172.21.15.52:0/471585732 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7f91e6860 con 0x55a7f9292340 2024-09-19T09:37:45.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f881f7fe640 10 client.21339 handle_command_reply: tid=0 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 client.21339 shutdown 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 msgr2=0x55a7f9282ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f88340c4ee0 tx=0x7f88340bc630 comp rx=0 tx=0).stop 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 shutdown_connections 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f9292340 0x55a7f9294770 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f9286e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f9282ce0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f881f7fe640 0 client.21339 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 --2- 172.21.15.52:0/471585732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f92827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 >> 172.21.15.52:0/471585732 conn(0x55a7f923c310 msgr2=0x55a7f9275990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 shutdown_connections 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 1 -- 172.21.15.52:0/471585732 wait complete. 2024-09-19T09:37:45.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.764+0000 7f8848b5f740 20 client.21339 trim_cache size 0 max 16384 2024-09-19T09:37:45.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 Processor -- start 2024-09-19T09:37:45.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 -- start start 2024-09-19T09:37:45.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9286e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f929a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88401aded0 con 0x55a7f9274b40 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ab7a0 con 0x55a7f92735d0 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8848b5f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88401a95f0 con 0x55a7f927e370 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52614/0 (socket says 172.21.15.52:52614) 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f883f7fe640 1 -- 172.21.15.52:0/3133672463 learned_addr learned my addr 172.21.15.52:0/3133672463 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.777+0000 7f8844d23640 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f929a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 -- 172.21.15.52:0/3133672463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 msgr2=0x55a7f929a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883ffff640 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9286e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f929a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 -- 172.21.15.52:0/3133672463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 msgr2=0x55a7f9286e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9286e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 -- 172.21.15.52:0/3133672463 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7f9283050 con 0x55a7f9274b40 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f88340b8c00 tx=0x7f88340bacb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d024ef8f1146d254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f8825ffb640 1 -- 172.21.15.52:0/3133672463 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834049070 con 0x55a7f9274b40 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f8825ffb640 1 -- 172.21.15.52:0/3133672463 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88340da070 con 0x55a7f9274b40 2024-09-19T09:37:45.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f8825ffb640 1 -- 172.21.15.52:0/3133672463 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340bc7a0 con 0x55a7f9274b40 2024-09-19T09:37:45.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f8848b5f740 1 -- 172.21.15.52:0/3133672463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 msgr2=0x55a7f926fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.778+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f88340b8c00 tx=0x7f88340bacb0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 -- 172.21.15.52:0/3133672463 shutdown_connections 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f927e370 0x55a7f929a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f926fe10 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3133672463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f92735d0 0x55a7f9286e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 -- 172.21.15.52:0/3133672463 >> 172.21.15.52:0/3133672463 conn(0x55a7f923c310 msgr2=0x55a7f926f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 -- 172.21.15.52:0/3133672463 shutdown_connections 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 -- 172.21.15.52:0/3133672463 wait complete. 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 -- start start 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.779+0000 7f8848b5f740 1 Processor -- start 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f92735d0 0x55a7f928a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f927e370 0x55a7f928ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88401a9c60 con 0x55a7f9274b40 2024-09-19T09:37:45.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88401ab0d0 con 0x55a7f927e370 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88401aa330 con 0x55a7f92735d0 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 10 client.0 _ll_register_callbacks cb 0x7f8834005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52628/0 (socket says 172.21.15.52:52628) 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 -- 172.21.15.52:0/3703847752 learned_addr learned my addr 172.21.15.52:0/3703847752 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883ffff640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f92735d0 0x55a7f928a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8844d23640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f927e370 0x55a7f928ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 -- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f92735d0 msgr2=0x55a7f928a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f92735d0 0x55a7f928a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 -- 172.21.15.52:0/3703847752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f927e370 msgr2=0x55a7f928ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f927e370 0x55a7f928ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 -- 172.21.15.52:0/3703847752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7f92fc050 con 0x55a7f9274b40 2024-09-19T09:37:45.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f883f7fe640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f88340c4ee0 tx=0x7f88340edf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c32c23ca0196cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f881f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340c9020 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f88340bbdf0 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.780+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88340da070 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8834049040 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 10 client.21345 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a7f92fc050 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88340da070 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f88340b84f0 con 0x55a7f9274b40 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 10 client.21345 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 10 client.21345 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 20 client.21345 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:45.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f92fd640 0x55a7f92ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 4 client.21345 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a7f91e0d70 con 0x55a7f92fd640 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.781+0000 7f883ffff640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f92fd640 0x55a7f92ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f883ffff640 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f92fd640 0x55a7f92ffa60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e285db41f9f36bc server_cookie=31b830efa0496a07 in_seq=0 out_seq=0 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f881f7fe640 10 client.21345 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f881f7fe640 1 -- 172.21.15.52:0/3703847752 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a7f91e0d70 con 0x55a7f92fd640 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f881f7fe640 10 client.21345 handle_command_reply: tid=0 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 client.21345 shutdown 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 msgr2=0x55a7f928a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f88340c4ee0 tx=0x7f88340edf00 comp rx=0 tx=0).stop 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 shutdown_connections 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x55a7f92fd640 0x55a7f92ffa60 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55a7f927e370 0x55a7f928ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55a7f9274b40 0x55a7f928a8a0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 --2- 172.21.15.52:0/3703847752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55a7f92735d0 0x55a7f928a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 >> 172.21.15.52:0/3703847752 conn(0x55a7f923c310 msgr2=0x55a7f926e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f881f7fe640 0 client.21345 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 shutdown_connections 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 1 -- 172.21.15.52:0/3703847752 wait complete. 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.782+0000 7f8848b5f740 20 client.21345 trim_cache size 0 max 16384 2024-09-19T09:37:45.789 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 msgr2=0x7f88280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 0x7f88280a5700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8838021000 tx=0x7f883801e000 comp rx=0 tx=0).stop 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 msgr2=0x7f8840198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f8834006010 tx=0x7f8834003c10 comp rx=0 tx=0).stop 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 shutdown_connections 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f88280a3240 0x7f88280a5700 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8840102ef0 0x7f884019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8840102570 0x7f8840198aa0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 --2- 172.21.15.52:0/2167268898 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8840100e20 0x7f8840198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 >> 172.21.15.52:0/2167268898 conn(0x7f88400fc7d0 msgr2=0x7f884006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 shutdown_connections 2024-09-19T09:37:45.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:45.783+0000 7f8846786640 1 -- 172.21.15.52:0/2167268898 wait complete. 2024-09-19T09:37:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 -- 172.21.15.52:0/332774646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18101b60 msgr2=0x7feb18101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 --2- 172.21.15.52:0/332774646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18101b60 0x7feb18101f60 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7feb14009900 tx=0x7feb1402a410 comp rx=0 tx=0).stop 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 -- 172.21.15.52:0/332774646 shutdown_connections 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 --2- 172.21.15.52:0/332774646 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb18109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 --2- 172.21.15.52:0/332774646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18102d50 0x7feb181031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 --2- 172.21.15.52:0/332774646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18101b60 0x7feb18101f60 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.365+0000 7feb1f865640 1 -- 172.21.15.52:0/332774646 >> 172.21.15.52:0/332774646 conn(0x7feb180fd2e0 msgr2=0x7feb180ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- 172.21.15.52:0/332774646 shutdown_connections 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- 172.21.15.52:0/332774646 wait complete. 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 Processor -- start 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- start start 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18101b60 0x7feb18197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb1819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810d7e0 con 0x7feb18102d50 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810d660 con 0x7feb18101b60 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1f865640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810d960 con 0x7feb18103710 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.366+0000 7feb1ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52642/0 (socket says 172.21.15.52:52642) 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 -- 172.21.15.52:0/2309696399 learned_addr learned my addr 172.21.15.52:0/2309696399 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1d601640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18101b60 0x7feb18197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1de02640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb1819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 -- 172.21.15.52:0/2309696399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 msgr2=0x7feb1819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb1819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 -- 172.21.15.52:0/2309696399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18101b60 msgr2=0x7feb18197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18101b60 0x7feb18197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 -- 172.21.15.52:0/2309696399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1819fa20 con 0x7feb18102d50 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1de02640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb1819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7feb0800d950 tx=0x7feb0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb0e7fc640 1 -- 172.21.15.52:0/2309696399 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08017070 con 0x7feb18102d50 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb0e7fc640 1 -- 172.21.15.52:0/2309696399 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb08009c30 con 0x7feb18102d50 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1819fd10 con 0x7feb18102d50 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb0e7fc640 1 -- 172.21.15.52:0/2309696399 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0800f6b0 con 0x7feb18102d50 2024-09-19T09:37:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.367+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181a0200 con 0x7feb18102d50 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 Processor -- start 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb0e7fc640 1 -- 172.21.15.52:0/2309696399 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feb080109d0 con 0x7feb18102d50 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 -- start start 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f04da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 0x55b481f0c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b481e682f0 con 0x55b481f052e0 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b481e10270 con 0x55b481f0a370 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb22600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b481e642b0 con 0x55b481f049a0 2024-09-19T09:37:46.378 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1d601640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1d601640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52646/0 (socket says 172.21.15.52:52646) 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1d601640 1 -- 172.21.15.52:0/1808880767 learned_addr learned my addr 172.21.15.52:0/1808880767 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1de02640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f04da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1ce00640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 0x55b481f0c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1d601640 1 -- 172.21.15.52:0/1808880767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 msgr2=0x55b481f04da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.370+0000 7feb1d601640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f04da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1d601640 1 -- 172.21.15.52:0/1808880767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 msgr2=0x55b481f0c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1d601640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 0x55b481f0c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1d601640 1 -- 172.21.15.52:0/1808880767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b481e0f340 con 0x55b481f052e0 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1de02640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f04da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1ce00640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 0x55b481f0c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb0e7fc640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 0x7feb040a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.379 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1d601640 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7feb14031610 tx=0x7feb14005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2aeee092a8bb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb0e7fc640 1 -- 172.21.15.52:0/2309696399 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb080cf5e0 con 0x7feb18102d50 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb1de02640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 0x7feb040a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb037fe640 1 -- 172.21.15.52:0/1808880767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14040070 con 0x55b481f052e0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb037fe640 1 -- 172.21.15.52:0/1808880767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140318b0 con 0x55b481f052e0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.371+0000 7feb037fe640 1 -- 172.21.15.52:0/1808880767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14035040 con 0x55b481f052e0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- 172.21.15.52:0/1808880767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 msgr2=0x55b481f09da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb1de02640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 0x7feb040a57b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7feb10005fd0 tx=0x7feb10009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7feb14031610 tx=0x7feb14005c00 comp rx=0 tx=0).stop 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- 172.21.15.52:0/1808880767 shutdown_connections 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f0a370 0x55b481f0c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f09da0 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.380 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 --2- 172.21.15.52:0/1808880767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f04da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- 172.21.15.52:0/1808880767 >> 172.21.15.52:0/1808880767 conn(0x55b481f00010 msgr2=0x55b481f00410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- 172.21.15.52:0/1808880767 shutdown_connections 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- 172.21.15.52:0/1808880767 wait complete. 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 -- start start 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.372+0000 7feb22600740 1 Processor -- start 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f0f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f16050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55b481f0d2e0 con 0x55b481f049a0 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55b481df1290 con 0x55b481f052e0 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b481f0d460 con 0x55b481f0a370 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 10 client.0 _ll_register_callbacks cb 0x55b481e22140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:46.381 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52658/0 (socket says 172.21.15.52:52658) 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 -- 172.21.15.52:0/3401301502 learned_addr learned my addr 172.21.15.52:0/3401301502 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1ce00640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f0f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 -- 172.21.15.52:0/3401301502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 msgr2=0x55b481f16050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f16050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 -- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 msgr2=0x55b481f0f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f0f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 -- 172.21.15.52:0/3401301502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b481b7b210 con 0x55b481f049a0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb1d601640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7feb14000c00 tx=0x7feb140316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fa1b270c3604d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1404b020 con 0x55b481f049a0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb140035f0 con 0x55b481f049a0 2024-09-19T09:37:46.382 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.373+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb140318b0 con 0x55b481f049a0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feb14056050 con 0x55b481f049a0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 10 client.21357 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b481c47620 con 0x55b481f049a0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb140318b0 con 0x55b481f049a0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feb14004d50 con 0x55b481f049a0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 10 client.21357 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 10 client.21357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 20 client.21357 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f1a310 0x55b481f1c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 4 client.21357 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b481e75a20 con 0x55b481f1a310 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.374+0000 7feb1ce00640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f1a310 0x55b481f1c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.383 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb1ce00640 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f1a310 0x55b481f1c700 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d6d4d7d904050ac server_cookie=fa6c4ed84fab6717 in_seq=0 out_seq=0 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb00ff9640 10 client.21357 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb00ff9640 1 -- 172.21.15.52:0/3401301502 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b481e75a20 con 0x55b481f1a310 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb00ff9640 10 client.21357 handle_command_reply: tid=0 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 client.21357 shutdown 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 msgr2=0x55b481f0ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7feb14000c00 tx=0x7feb140316b0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 shutdown_connections 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f1a310 0x55b481f1c700 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f16050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f0f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 --2- 172.21.15.52:0/3401301502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f049a0 0x55b481f0ead0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb00ff9640 0 client.21357 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.375+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 >> 172.21.15.52:0/3401301502 conn(0x55b481f00010 msgr2=0x55b481f01820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.376+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 shutdown_connections 2024-09-19T09:37:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.376+0000 7feb22600740 1 -- 172.21.15.52:0/3401301502 wait complete. 2024-09-19T09:37:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.376+0000 7feb22600740 20 client.21357 trim_cache size 0 max 16384 2024-09-19T09:37:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 Processor -- start 2024-09-19T09:37:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 -- start start 2024-09-19T09:37:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f0ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f003f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.396 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb181aba10 con 0x55b481f0a370 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb181a92e0 con 0x55b481f052e0 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.390+0000 7feb22600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb181a7130 con 0x55b481f049a0 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52668/0 (socket says 172.21.15.52:52668) 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 -- 172.21.15.52:0/930279008 learned_addr learned my addr 172.21.15.52:0/930279008 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1d601640 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f0ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1ce00640 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 -- 172.21.15.52:0/930279008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 msgr2=0x55b481f0ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f0ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 -- 172.21.15.52:0/930279008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 msgr2=0x55b481f003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.397 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 -- 172.21.15.52:0/930279008 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b481efb2d0 con 0x55b481f0a370 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb1de02640 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7feb10012710 tx=0x7feb10014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c3f33c9e250e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb02ffd640 1 -- 172.21.15.52:0/930279008 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10004d20 con 0x55b481f0a370 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb02ffd640 1 -- 172.21.15.52:0/930279008 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb1001d9e0 con 0x55b481f0a370 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.391+0000 7feb02ffd640 1 -- 172.21.15.52:0/930279008 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10005670 con 0x55b481f0a370 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- 172.21.15.52:0/930279008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 msgr2=0x55b481f00930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7feb10012710 tx=0x7feb10014070 comp rx=0 tx=0).stop 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- 172.21.15.52:0/930279008 shutdown_connections 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f0a370 0x55b481f00930 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f052e0 0x55b481f003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 --2- 172.21.15.52:0/930279008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f049a0 0x55b481f0ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- 172.21.15.52:0/930279008 >> 172.21.15.52:0/930279008 conn(0x55b481f00010 msgr2=0x55b481f0e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.398 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- 172.21.15.52:0/930279008 shutdown_connections 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- 172.21.15.52:0/930279008 wait complete. 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 -- start start 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.392+0000 7feb22600740 1 Processor -- start 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f049a0 0x55b481f7ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f874d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb181a77a0 con 0x55b481f052e0 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb181a8c10 con 0x55b481f049a0 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb181a7e70 con 0x55b481f0a370 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 10 client.0 _ll_register_callbacks cb 0x7feb14032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.399 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52680/0 (socket says 172.21.15.52:52680) 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 -- 172.21.15.52:0/2131681146 learned_addr learned my addr 172.21.15.52:0/2131681146 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1d601640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f049a0 0x55b481f7ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 -- 172.21.15.52:0/2131681146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 msgr2=0x55b481f874d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f874d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 -- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f049a0 msgr2=0x55b481f7ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f049a0 0x55b481f7ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 -- 172.21.15.52:0/2131681146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b481f87ae0 con 0x55b481f052e0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb1ce00640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7feb08009610 tx=0x7feb08005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2b8f25dadb4343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb00ff9640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb08020040 con 0x55b481f052e0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb080981f0 con 0x55b481f052e0 2024-09-19T09:37:46.400 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb1001d9e0 con 0x55b481f052e0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7feb0809ff30 con 0x55b481f052e0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 10 client.21363 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.393+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b481f88ec0 con 0x55b481f052e0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb1001d9e0 con 0x55b481f052e0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7feb08086070 con 0x55b481f052e0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 10 client.21363 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 10 client.21363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 20 client.21363 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f89840 0x55b481f8bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 4 client.21363 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b481e6fd70 con 0x55b481f89840 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb1d601640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f89840 0x55b481f8bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:46.401 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb1d601640 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f89840 0x55b481f8bc60 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3226a664468ae9a server_cookie=ed498d173a79532e in_seq=0 out_seq=0 2024-09-19T09:37:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.394+0000 7feb00ff9640 10 client.21363 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb00ff9640 1 -- 172.21.15.52:0/2131681146 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b481e6fd70 con 0x55b481f89840 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb00ff9640 10 client.21363 handle_command_reply: tid=0 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 client.21363 shutdown 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 msgr2=0x55b481f80490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7feb08009610 tx=0x7feb08005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 shutdown_connections 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55b481f89840 0x55b481f8bc60 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b481f0a370 0x55b481f874d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55b481f052e0 0x55b481f80490 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 --2- 172.21.15.52:0/2131681146 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55b481f049a0 0x55b481f7ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb00ff9640 0 client.21363 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 >> 172.21.15.52:0/2131681146 conn(0x55b481f00010 msgr2=0x55b481efe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 shutdown_connections 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 1 -- 172.21.15.52:0/2131681146 wait complete. 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.408+0000 7feb22600740 20 client.21363 trim_cache size 0 max 16384 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:{ 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "message": "", 2024-09-19T09:37:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout: "return_code": 0 2024-09-19T09:37:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stdout:} 2024-09-19T09:37:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 msgr2=0x7feb040a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 0x7feb040a57b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7feb10005fd0 tx=0x7feb10009520 comp rx=0 tx=0).stop 2024-09-19T09:37:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 msgr2=0x7feb18198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7feb0800d950 tx=0x7feb0800de10 comp rx=0 tx=0).stop 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 shutdown_connections 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb040a32f0 0x7feb040a57b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb18103710 0x7feb1819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb18102d50 0x7feb18198340 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 --2- 172.21.15.52:0/2309696399 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb18101b60 0x7feb18197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 >> 172.21.15.52:0/2309696399 conn(0x7feb180fd2e0 msgr2=0x7feb18106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 shutdown_connections 2024-09-19T09:37:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi052.front.sepia.ceph.com.smithi052.stderr:2024-09-19T09:37:46.409+0000 7feb1f865640 1 -- 172.21.15.52:0/2309696399 wait complete. 2024-09-19T09:37:46.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:37:46.841 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:47.245 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:47 smithi052 ceph-mon[30947]: pgmap v828: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 -- 172.21.15.52:0/3542530293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c100e20 msgr2=0x7f6b2c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/3542530293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c100e20 0x7f6b2c101200 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c009ca0 tx=0x7f6b1c02a950 comp rx=0 tx=0).stop 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 -- 172.21.15.52:0/3542530293 shutdown_connections 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/3542530293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/3542530293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 0x7f6b2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/3542530293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c100e20 0x7f6b2c101200 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 -- 172.21.15.52:0/3542530293 >> 172.21.15.52:0/3542530293 conn(0x7f6b2c0fc7d0 msgr2=0x7f6b2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 -- 172.21.15.52:0/3542530293 shutdown_connections 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.328+0000 7f6b31c0a640 1 -- 172.21.15.52:0/3542530293 wait complete. 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 Processor -- start 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 -- start start 2024-09-19T09:37:47.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c100e20 0x7f6b2c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 0x7f6b2c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c112060 con 0x7f6b2c102ef0 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c111ee0 con 0x7f6b2c102570 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.329+0000 7f6b31c0a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1121e0 con 0x7f6b2c100e20 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52694/0 (socket says 172.21.15.52:52694) 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2259648189 learned_addr learned my addr 172.21.15.52:0/2259648189 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c100e20 0x7f6b2c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 0x7f6b2c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2259648189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c100e20 msgr2=0x7f6b2c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c100e20 0x7f6b2c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2259648189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 msgr2=0x7f6b2c10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 0x7f6b2c10ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 -- 172.21.15.52:0/2259648189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c1a6a50 con 0x7f6b2c102ef0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c970 tx=0x7f6b2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b28ff9640 1 -- 172.21.15.52:0/2259648189 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24007bb0 con 0x7f6b2c102ef0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b28ff9640 1 -- 172.21.15.52:0/2259648189 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b24007d50 con 0x7f6b2c102ef0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c1a6d40 con 0x7f6b2c102ef0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b28ff9640 1 -- 172.21.15.52:0/2259648189 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2400f450 con 0x7f6b2c102ef0 2024-09-19T09:37:47.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.330+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c1a7280 con 0x7f6b2c102ef0 2024-09-19T09:37:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b28ff9640 1 -- 172.21.15.52:0/2259648189 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6b24004f60 con 0x7f6b2c102ef0 2024-09-19T09:37:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 Processor -- start 2024-09-19T09:37:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 -- start start 2024-09-19T09:37:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde476b40 0x557fde475090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde480370 0x557fde482760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557fde3db2f0 con 0x557fde4755d0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557fde382cf0 con 0x557fde480370 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.333+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557fde3d72b0 con 0x557fde476b40 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b28ff9640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 0x7f6b140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52698/0 (socket says 172.21.15.52:52698) 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/3880202405 learned_addr learned my addr 172.21.15.52:0/3880202405 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2affd640 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde476b40 0x557fde475090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b28ff9640 1 -- 172.21.15.52:0/2259648189 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b240cf620 con 0x7f6b2c102ef0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 0x7f6b140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2affd640 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde480370 0x557fde482760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/3880202405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde476b40 msgr2=0x557fde475090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde476b40 0x557fde475090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/3880202405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde480370 msgr2=0x557fde482760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde480370 0x557fde482760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/3880202405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fde3673a0 con 0x557fde4755d0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0099b0 tx=0x7f6b1c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9277e2cbafe4b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b2bfff640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 0x7f6b140a5780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400a520 tx=0x7f6b2400a470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.334+0000 7f6b11ffb640 1 -- 172.21.15.52:0/3880202405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c034040 con 0x557fde4755d0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b11ffb640 1 -- 172.21.15.52:0/3880202405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b1c003970 con 0x557fde4755d0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b11ffb640 1 -- 172.21.15.52:0/3880202405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0046a0 con 0x557fde4755d0 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 -- 172.21.15.52:0/3880202405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 msgr2=0x557fde475a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0099b0 tx=0x7f6b1c0099e0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 -- 172.21.15.52:0/3880202405 shutdown_connections 2024-09-19T09:37:47.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde480370 0x557fde482760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde475a10 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/3880202405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde476b40 0x557fde475090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 -- 172.21.15.52:0/3880202405 >> 172.21.15.52:0/3880202405 conn(0x557fde43e310 msgr2=0x557fde471c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 -- 172.21.15.52:0/3880202405 shutdown_connections 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.335+0000 7f6b33fe3740 1 -- 172.21.15.52:0/3880202405 wait complete. 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 -- start start 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 Processor -- start 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde47d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557fde483010 con 0x557fde4755d0 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557fde396060 con 0x557fde476b40 2024-09-19T09:37:47.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557fde483190 con 0x557fde480370 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b33fe3740 10 client.0 _ll_register_callbacks cb 0x557fde0e98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52714/0 (socket says 172.21.15.52:52714) 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b2affd640 1 -- 172.21.15.52:0/2935879089 learned_addr learned my addr 172.21.15.52:0/2935879089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.336+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde47d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 -- 172.21.15.52:0/2935879089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 msgr2=0x557fde47d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 -- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 msgr2=0x557fde47d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde47d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 -- 172.21.15.52:0/2935879089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fde14c3c0 con 0x557fde4755d0 2024-09-19T09:37:47.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde47d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b2affd640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f6b20010f50 tx=0x7f6b200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553e3db87d949ede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b0affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2001a040 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b1c003970 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b20004220 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b20026050 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b33fe3740 10 client.21375 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557fde48ebf0 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.337+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b1c003970 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b2001e3d0 con 0x557fde4755d0 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 10 client.21375 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 10 client.21375 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 20 client.21375 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:47.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde492450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 4 client.21375 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fde3e8860 con 0x557fde490000 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde492450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde492450 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c3132a75326c6ad server_cookie=64cb2eb01ba13e82 in_seq=0 out_seq=0 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.338+0000 7f6b0affd640 10 client.21375 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b0affd640 1 -- 172.21.15.52:0/2935879089 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557fde3e8860 con 0x557fde490000 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b0affd640 10 client.21375 handle_command_reply: tid=0 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 client.21375 shutdown 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 msgr2=0x557fde47fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7f6b20010f50 tx=0x7f6b200046c0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 shutdown_connections 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde492450 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.347 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.339+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde47d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b0affd640 0 client.21375 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/2935879089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde4755d0 0x557fde47fe00 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 >> 172.21.15.52:0/2935879089 conn(0x557fde43e310 msgr2=0x557fde477930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 shutdown_connections 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b33fe3740 1 -- 172.21.15.52:0/2935879089 wait complete. 2024-09-19T09:37:47.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.340+0000 7f6b33fe3740 20 client.21375 trim_cache size 0 max 16384 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 Processor -- start 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 -- start start 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde4755d0 0x557fde4759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1b2370 con 0x557fde476b40 2024-09-19T09:37:47.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1afc40 con 0x557fde4755d0 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1ada90 con 0x557fde480370 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52728/0 (socket says 172.21.15.52:52728) 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/1364566521 learned_addr learned my addr 172.21.15.52:0/1364566521 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2affd640 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde4755d0 0x557fde4759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/1364566521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 msgr2=0x557fde47c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/1364566521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde4755d0 msgr2=0x557fde4759b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde4755d0 0x557fde4759b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.353+0000 7f6b2b7fe640 1 -- 172.21.15.52:0/1364566521 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fde480130 con 0x557fde476b40 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c02fe70 tx=0x7f6b1c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ca53ec6d721204 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b117fa640 1 -- 172.21.15.52:0/1364566521 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c034040 con 0x557fde476b40 2024-09-19T09:37:47.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b117fa640 1 -- 172.21.15.52:0/1364566521 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b1c052070 con 0x557fde476b40 2024-09-19T09:37:47.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b117fa640 1 -- 172.21.15.52:0/1364566521 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c003bd0 con 0x557fde476b40 2024-09-19T09:37:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 -- 172.21.15.52:0/1364566521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 msgr2=0x557fde47c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c02fe70 tx=0x7f6b1c000f40 comp rx=0 tx=0).stop 2024-09-19T09:37:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 -- 172.21.15.52:0/1364566521 shutdown_connections 2024-09-19T09:37:47.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde480370 0x557fde47c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde476b40 0x557fde47c970 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/1364566521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde4755d0 0x557fde4759b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 -- 172.21.15.52:0/1364566521 >> 172.21.15.52:0/1364566521 conn(0x557fde43e310 msgr2=0x557fde47b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.354+0000 7f6b33fe3740 1 -- 172.21.15.52:0/1364566521 shutdown_connections 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 -- 172.21.15.52:0/1364566521 wait complete. 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 -- start start 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 Processor -- start 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde4755d0 0x557fde483b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde4840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1ae100 con 0x557fde480370 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1af570 con 0x557fde476b40 2024-09-19T09:37:47.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c1ae7d0 con 0x557fde4755d0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b33fe3740 10 client.0 _ll_register_callbacks cb 0x7f6b2000a8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.355+0000 7f6b2affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52736/0 (socket says 172.21.15.52:52736) 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 -- 172.21.15.52:0/431015767 learned_addr learned my addr 172.21.15.52:0/431015767 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde4840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde4755d0 0x557fde483b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 -- 172.21.15.52:0/431015767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde4755d0 msgr2=0x557fde483b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde4755d0 0x557fde483b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 -- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 msgr2=0x557fde4840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde4840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 -- 172.21.15.52:0/431015767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fde4f33c0 con 0x557fde480370 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b2affd640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000fd80 tx=0x7f6b2000a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443a38d083e86a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b0affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2001e5d0 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6b2001e9c0 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b1c052070 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6b2001ebc0 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b33fe3740 10 client.21381 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.356+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557fde4fa750 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b1c052070 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6b20004aa0 con 0x557fde480370 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 10 client.21381 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 10 client.21381 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 20 client.21381 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:47.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde4fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 4 client.21381 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557fde3e2d70 con 0x557fde490000 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.357+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde4fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b2b7fe640 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde4fcdc0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=162ade2ed8169efa server_cookie=d15d08e720762f04 in_seq=0 out_seq=0 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b0affd640 10 client.21381 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b0affd640 1 -- 172.21.15.52:0/431015767 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557fde3e2d70 con 0x557fde490000 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b0affd640 10 client.21381 handle_command_reply: tid=0 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 client.21381 shutdown 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 msgr2=0x557fde4f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000fd80 tx=0x7f6b2000a9a0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 shutdown_connections 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557fde480370 0x557fde4f2d20 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x557fde490000 0x557fde4fcdc0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557fde476b40 0x557fde4840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 --2- 172.21.15.52:0/431015767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557fde4755d0 0x557fde483b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 >> 172.21.15.52:0/431015767 conn(0x557fde43e310 msgr2=0x557fde477930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b0affd640 0 client.21381 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 shutdown_connections 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 1 -- 172.21.15.52:0/431015767 wait complete. 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.358+0000 7f6b33fe3740 20 client.21381 trim_cache size 0 max 16384 2024-09-19T09:37:47.365 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 msgr2=0x7f6b140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 0x7f6b140a5780 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400a520 tx=0x7f6b2400a470 comp rx=0 tx=0).stop 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 msgr2=0x7f6b2c10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f6b2400c970 tx=0x7f6b2400ce30 comp rx=0 tx=0).stop 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 shutdown_connections 2024-09-19T09:37:47.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b2c102ef0 0x7f6b2c10ef50 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b2c102570 0x7f6b2c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6b140a32c0 0x7f6b140a5780 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 --2- 172.21.15.52:0/2259648189 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6b2c100e20 0x7f6b2c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 >> 172.21.15.52:0/2259648189 conn(0x7f6b2c0fc7d0 msgr2=0x7f6b2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 shutdown_connections 2024-09-19T09:37:47.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:47.359+0000 7f6b31c0a640 1 -- 172.21.15.52:0/2259648189 wait complete. 2024-09-19T09:37:47.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:47 smithi169 ceph-mon[35454]: pgmap v828: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:37:47.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:47 smithi086 ceph-mon[34813]: pgmap v828: 97 pgs: 97 active+clean; 4.0 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-19T09:37:48.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:37:48.354 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:48.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 -- 172.21.15.52:0/174869471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 msgr2=0x7ff8c41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/174869471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c41067e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009900 tx=0x7ff8ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 -- 172.21.15.52:0/174869471 shutdown_connections 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/174869471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 0x7ff8c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/174869471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c41067e0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/174869471 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 0x7ff8c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 -- 172.21.15.52:0/174869471 >> 172.21.15.52:0/174869471 conn(0x7ff8c40fd8c0 msgr2=0x7ff8c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 -- 172.21.15.52:0/174869471 shutdown_connections 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.803+0000 7ff8c9b20640 1 -- 172.21.15.52:0/174869471 wait complete. 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 Processor -- start 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 -- start start 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 0x7ff8c4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 0x7ff8c419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4111f70 con 0x7ff8c4102790 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4111df0 con 0x7ff8c4106f10 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.804+0000 7ff8c9b20640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41120f0 con 0x7ff8c4101de0 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55688/0 (socket says 172.21.15.52:55688) 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 -- 172.21.15.52:0/1000339492 learned_addr learned my addr 172.21.15.52:0/1000339492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 0x7ff8c419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 0x7ff8c4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 -- 172.21.15.52:0/1000339492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 msgr2=0x7ff8c4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 0x7ff8c4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 -- 172.21.15.52:0/1000339492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 msgr2=0x7ff8c419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 0x7ff8c419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 -- 172.21.15.52:0/1000339492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c419d400 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006010 tx=0x7ff8ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c17fa640 1 -- 172.21.15.52:0/1000339492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac03f030 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c17fa640 1 -- 172.21.15.52:0/1000339492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac003ce0 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c419d690 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c17fa640 1 -- 172.21.15.52:0/1000339492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac035070 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.805+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41a4fd0 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8c17fa640 1 -- 172.21.15.52:0/1000339492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff8ac042030 con 0x7ff8c4102790 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 Processor -- start 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 -- start start 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x55577129a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x55577129aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5557712002f0 con 0x5557712a9780 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5557711a7cf0 con 0x55577129bb40 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5557711fc2b0 con 0x55577129a5d0 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55694/0 (socket says 172.21.15.52:55694) 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8baffd640 1 -- 172.21.15.52:0/1457595000 learned_addr learned my addr 172.21.15.52:0/1457595000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x55577129aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x55577129a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8baffd640 1 -- 172.21.15.52:0/1457595000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 msgr2=0x55577129aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.809+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x55577129aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8baffd640 1 -- 172.21.15.52:0/1457595000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 msgr2=0x55577129a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x55577129a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8baffd640 1 -- 172.21.15.52:0/1457595000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577118c3a0 con 0x5557712a9780 2024-09-19T09:37:48.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0f3f80 tx=0x7ff8ac0f80e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b4b898eab7038a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8c17fa640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 0x7ff8b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8b9ffb640 1 -- 172.21.15.52:0/1457595000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0f8950 con 0x5557712a9780 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8b9ffb640 1 -- 172.21.15.52:0/1457595000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac0fd070 con 0x5557712a9780 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8b9ffb640 1 -- 172.21.15.52:0/1457595000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0d9200 con 0x5557712a9780 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 0x7ff8b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.810+0000 7ff8c17fa640 1 -- 172.21.15.52:0/1000339492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff8ac0efe70 con 0x7ff8c4102790 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 0x7ff8b00a5780 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc005fd0 tx=0x7ff8bc009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1457595000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 msgr2=0x5557712abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0f3f80 tx=0x7ff8ac0f80e0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1457595000 shutdown_connections 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x5557712abb70 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x55577129aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1457595000 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x55577129a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1457595000 >> 172.21.15.52:0/1457595000 conn(0x555771263310 msgr2=0x555771296c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1457595000 shutdown_connections 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1457595000 wait complete. 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 -- start start 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.811+0000 7ff8cbef9740 1 Processor -- start 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5557712ac240 con 0x55577129bb40 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x5557711bb060 con 0x55577129a5d0 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5557712ac3c0 con 0x5557712a9780 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 10 client.0 _ll_register_callbacks cb 0x555770f0e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55696/0 (socket says 172.21.15.52:55696) 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 -- 172.21.15.52:0/1934255162 learned_addr learned my addr 172.21.15.52:0/1934255162 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 -- 172.21.15.52:0/1934255162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 msgr2=0x5557712a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 -- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 msgr2=0x5557712a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 -- 172.21.15.52:0/1934255162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555770f713c0 con 0x55577129bb40 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8baffd640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0edc60 tx=0x7ff8ac005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699cf3ead83135dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac049050 con 0x55577129bb40 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff8ac0ba620 con 0x55577129bb40 2024-09-19T09:37:48.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.812+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac0fd070 con 0x55577129bb40 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff8ac0dc110 con 0x55577129bb40 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 10 client.21393 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5557712ac240 con 0x55577129bb40 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac0fd070 con 0x55577129bb40 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff8ac0b8bf0 con 0x55577129bb40 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 10 client.21393 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 10 client.21393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 20 client.21393 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5557712b8d60 0x5557712bb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 4 client.21393 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55577120d860 con 0x5557712b8d60 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.813+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5557712b8d60 0x5557712bb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.814+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5557712b8d60 0x5557712bb190 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21dd0e85e855291f server_cookie=d0d2ec8d4c083018 in_seq=0 out_seq=0 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.814+0000 7ff8a2ffd640 10 client.21393 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.814+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/1934255162 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55577120d860 con 0x5557712b8d60 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.814+0000 7ff8a2ffd640 10 client.21393 handle_command_reply: tid=0 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.814+0000 7ff8cbef9740 1 client.21393 shutdown 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 msgr2=0x5557712a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0edc60 tx=0x7ff8ac005890 comp rx=0 tx=0).stop 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 shutdown_connections 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x5557712b8d60 0x5557712bb190 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x5557712a63f0 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/1934255162 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8a2ffd640 0 client.21393 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 >> 172.21.15.52:0/1934255162 conn(0x555771263310 msgr2=0x55577129c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 shutdown_connections 2024-09-19T09:37:48.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 1 -- 172.21.15.52:0/1934255162 wait complete. 2024-09-19T09:37:48.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.815+0000 7ff8cbef9740 20 client.21393 trim_cache size 0 max 16384 2024-09-19T09:37:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 Processor -- start 2024-09-19T09:37:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 -- start start 2024-09-19T09:37:48.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41ade40 con 0x55577129bb40 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41ab710 con 0x55577129a5d0 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41a9540 con 0x5557712a9780 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55710/0 (socket says 172.21.15.52:55710) 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.828+0000 7ff8baffd640 1 -- 172.21.15.52:0/2817373305 learned_addr learned my addr 172.21.15.52:0/2817373305 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 -- 172.21.15.52:0/2817373305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 msgr2=0x5557712c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 -- 172.21.15.52:0/2817373305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 msgr2=0x5557712b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 -- 172.21.15.52:0/2817373305 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557712a8d60 con 0x55577129bb40 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8baffd640 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0bc050 tx=0x7ff8ac0f0170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e504605c7096ed4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8b97fa640 1 -- 172.21.15.52:0/2817373305 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac049070 con 0x55577129bb40 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8b97fa640 1 -- 172.21.15.52:0/2817373305 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac0fd070 con 0x55577129bb40 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.829+0000 7ff8b97fa640 1 -- 172.21.15.52:0/2817373305 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0d8cb0 con 0x55577129bb40 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2817373305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 msgr2=0x555771295bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0bc050 tx=0x7ff8ac0f0170 comp rx=0 tx=0).stop 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2817373305 shutdown_connections 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5557712a9780 0x5557712c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55577129bb40 0x555771295bf0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2817373305 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129a5d0 0x5557712b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2817373305 >> 172.21.15.52:0/2817373305 conn(0x555771263310 msgr2=0x5557712954e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2817373305 shutdown_connections 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2817373305 wait complete. 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 -- start start 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.830+0000 7ff8cbef9740 1 Processor -- start 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x5557712ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x5557712adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41a9bd0 con 0x5557712a9780 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41ab040 con 0x55577129bb40 2024-09-19T09:37:48.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c41aa2a0 con 0x55577129a5d0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8cbef9740 10 client.0 _ll_register_callbacks cb 0x7ff8bc009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55726/0 (socket says 172.21.15.52:55726) 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 -- 172.21.15.52:0/2914135254 learned_addr learned my addr 172.21.15.52:0/2914135254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8baffd640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x5557712adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x5557712ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 -- 172.21.15.52:0/2914135254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 msgr2=0x5557712ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x5557712ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 -- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 msgr2=0x5557712adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x5557712adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.831+0000 7ff8c3fff640 1 -- 172.21.15.52:0/2914135254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555771322f70 con 0x5557712a9780 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8c3fff640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc011ee0 tx=0x7ff8bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744e1d9797beee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc021b40 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff8bc021ce0 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac0fd070 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff8bc003970 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8cbef9740 10 client.21399 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555771324170 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ac0fd070 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff8bc00f040 con 0x5557712a9780 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.832+0000 7ff8cbef9740 10 client.21399 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 10 client.21399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 20 client.21399 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555771324940 0x555771326d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 4 client.21399 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555771207d70 con 0x555771324940 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555771324940 0x555771326d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8c37fe640 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555771324940 0x555771326d60 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a30d7f250a2d32 server_cookie=a4404f2463190213 in_seq=0 out_seq=0 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8a2ffd640 10 client.21399 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8a2ffd640 1 -- 172.21.15.52:0/2914135254 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555771207d70 con 0x555771324940 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8a2ffd640 10 client.21399 handle_command_reply: tid=0 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.833+0000 7ff8cbef9740 1 client.21399 shutdown 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 msgr2=0x555771322a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc011ee0 tx=0x7ff8bc004a40 comp rx=0 tx=0).stop 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 shutdown_connections 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x555771324940 0x555771326d60 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5557712a9780 0x555771322a30 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55577129bb40 0x5557712adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 --2- 172.21.15.52:0/2914135254 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55577129a5d0 0x5557712ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 >> 172.21.15.52:0/2914135254 conn(0x555771263310 msgr2=0x55577129c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8a2ffd640 0 client.21399 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 shutdown_connections 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 1 -- 172.21.15.52:0/2914135254 wait complete. 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8cbef9740 20 client.21399 trim_cache size 0 max 16384 2024-09-19T09:37:48.850 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:37:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 msgr2=0x7ff8b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 0x7ff8b00a5780 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc005fd0 tx=0x7ff8bc009600 comp rx=0 tx=0).stop 2024-09-19T09:37:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 msgr2=0x7ff8c4198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.834+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac006010 tx=0x7ff8ac0042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 shutdown_connections 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff8c4106f10 0x7ff8c419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8c4102790 0x7ff8c4198990 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff8b00a32c0 0x7ff8b00a5780 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 --2- 172.21.15.52:0/1000339492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff8c4101de0 0x7ff8c4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 >> 172.21.15.52:0/1000339492 conn(0x7ff8c40fd8c0 msgr2=0x7ff8c40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 shutdown_connections 2024-09-19T09:37:48.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:48.835+0000 7ff8c9b20640 1 -- 172.21.15.52:0/1000339492 wait complete. 2024-09-19T09:37:49.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:49 smithi052 ceph-mon[30947]: pgmap v829: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:37:49.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:49 smithi169 ceph-mon[35454]: pgmap v829: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:37:49.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:49 smithi086 ceph-mon[34813]: pgmap v829: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-19T09:37:50.616 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:37:50.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:37:50.886 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:51.287 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:51 smithi052 ceph-mon[30947]: pgmap v830: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 -- 172.21.15.52:0/3367038675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4101df0 msgr2=0x7f93b41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 --2- 172.21.15.52:0/3367038675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4101df0 0x7f93b41021d0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f93a4009ca0 tx=0x7f93a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 -- 172.21.15.52:0/3367038675 shutdown_connections 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 --2- 172.21.15.52:0/3367038675 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b4106f20 0x7f93b410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 --2- 172.21.15.52:0/3367038675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b41027a0 0x7f93b41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 --2- 172.21.15.52:0/3367038675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4101df0 0x7f93b41021d0 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 -- 172.21.15.52:0/3367038675 >> 172.21.15.52:0/3367038675 conn(0x7f93b40fd8b0 msgr2=0x7f93b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.371+0000 7f93ba05a640 1 -- 172.21.15.52:0/3367038675 shutdown_connections 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.372+0000 7f93ba05a640 1 -- 172.21.15.52:0/3367038675 wait complete. 2024-09-19T09:37:51.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.372+0000 7f93ba05a640 1 Processor -- start 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.372+0000 7f93ba05a640 1 -- start start 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b4101df0 0x7f93b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b41027a0 0x7f93b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4111f80 con 0x7f93b4106f20 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4111e00 con 0x7f93b4101df0 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93ba05a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4112100 con 0x7f93b41027a0 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55736/0 (socket says 172.21.15.52:55736) 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 -- 172.21.15.52:0/1884508785 learned_addr learned my addr 172.21.15.52:0/1884508785 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b37fe640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b4101df0 0x7f93b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b41027a0 0x7f93b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 -- 172.21.15.52:0/1884508785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b41027a0 msgr2=0x7f93b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b41027a0 0x7f93b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 -- 172.21.15.52:0/1884508785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b4101df0 msgr2=0x7f93b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b4101df0 0x7f93b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 -- 172.21.15.52:0/1884508785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b41a6840 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b3fff640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c970 tx=0x7f93ac00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.373+0000 7f93b0ff9640 1 -- 172.21.15.52:0/1884508785 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00ae60 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.374+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b41a6b30 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.374+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41a70c0 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.374+0000 7f93b0ff9640 1 -- 172.21.15.52:0/1884508785 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93ac005500 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.374+0000 7f93b0ff9640 1 -- 172.21.15.52:0/1884508785 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac01d060 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93b0ff9640 1 -- 172.21.15.52:0/1884508785 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f93ac007bb0 con 0x7f93b4106f20 2024-09-19T09:37:51.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 Processor -- start 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 -- start start 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4389b60 0x560ec4389f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4394800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.376+0000 7f93bc433740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ec42ef280 con 0x560ec4394d40 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93bc433740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560ec4296b10 con 0x560ec4389b60 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93bc433740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ec42eb240 con 0x560ec438a480 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55750/0 (socket says 172.21.15.52:55750) 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 -- 172.21.15.52:0/2469714364 learned_addr learned my addr 172.21.15.52:0/2469714364 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4389b60 0x560ec4389f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b37fe640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4394800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 -- 172.21.15.52:0/2469714364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 msgr2=0x560ec4394800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4394800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 -- 172.21.15.52:0/2469714364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4389b60 msgr2=0x560ec4389f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4389b60 0x560ec4389f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 -- 172.21.15.52:0/2469714364 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec42a31f0 con 0x560ec4394d40 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b37fe640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4394800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b0ff9640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 0x7f939c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f93a80115e0 tx=0x7f93a800a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4613fdf27d7329 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b37fe640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 0x7f939c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f93b0ff9640 1 -- 172.21.15.52:0/1884508785 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f93ac0cf410 con 0x7f93b4106f20 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f9399ffb640 1 -- 172.21.15.52:0/2469714364 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8005220 con 0x560ec4394d40 2024-09-19T09:37:51.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f9399ffb640 1 -- 172.21.15.52:0/2469714364 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a8004c80 con 0x560ec4394d40 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.377+0000 7f9399ffb640 1 -- 172.21.15.52:0/2469714364 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800fcb0 con 0x560ec4394d40 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- 172.21.15.52:0/2469714364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 msgr2=0x560ec4397130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f93a80115e0 tx=0x7f93a800a810 comp rx=0 tx=0).stop 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93b37fe640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 0x7f939c0a5700 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006010 tx=0x7f93a4031c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- 172.21.15.52:0/2469714364 shutdown_connections 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4397130 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4394800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 --2- 172.21.15.52:0/2469714364 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4389b60 0x560ec4389f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- 172.21.15.52:0/2469714364 >> 172.21.15.52:0/2469714364 conn(0x560ec43860f0 msgr2=0x560ec43864d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- 172.21.15.52:0/2469714364 shutdown_connections 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- 172.21.15.52:0/2469714364 wait complete. 2024-09-19T09:37:51.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.378+0000 7f93bc433740 1 -- start start 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 Processor -- start 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4392110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec4392650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560ec4397910 con 0x560ec4389b60 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x560ec42a9f10 con 0x560ec4394d40 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560ec4397a90 con 0x560ec438a480 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93bc433740 10 client.0 _ll_register_callbacks cb 0x560ec4272a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55758/0 (socket says 172.21.15.52:55758) 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 -- 172.21.15.52:0/282428453 learned_addr learned my addr 172.21.15.52:0/282428453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 -- 172.21.15.52:0/282428453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 msgr2=0x560ec4392110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4392110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 -- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 msgr2=0x560ec4392650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b3fff640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec4392650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec4392650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.379+0000 7f93b37fe640 1 -- 172.21.15.52:0/282428453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec40606a0 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93b37fe640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f93a4035000 tx=0x7f93a402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa36895c3c2660f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4055060 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f93a402fd20 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93a8004c80 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93a4031de0 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 10 client.21411 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560ec43a3490 con 0x560ec4389b60 2024-09-19T09:37:51.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a8004c80 con 0x560ec4389b60 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f93a404f030 con 0x560ec4389b60 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 10 client.21411 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 10 client.21411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 20 client.21411 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.380+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec43a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.381+0000 7f93bc433740 4 client.21411 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.381+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ec42fc7f0 con 0x560ec43a49d0 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.381+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec43a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.381+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec43a6e90 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c354cd73dba8d6bc server_cookie=3f67c0756b7a86cd in_seq=0 out_seq=0 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.381+0000 7f9392ffd640 10 client.21411 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f9392ffd640 1 -- 172.21.15.52:0/282428453 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ec42fc7f0 con 0x560ec43a49d0 2024-09-19T09:37:51.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f9392ffd640 10 client.21411 handle_command_reply: tid=0 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 client.21411 shutdown 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 msgr2=0x560ec4391bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f93a4035000 tx=0x7f93a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 shutdown_connections 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec43a6e90 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec4392650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec4392110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f9392ffd640 0 client.21411 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 --2- 172.21.15.52:0/282428453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec4391bd0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 >> 172.21.15.52:0/282428453 conn(0x560ec43860f0 msgr2=0x560ec438bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.382+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 shutdown_connections 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.383+0000 7f93bc433740 1 -- 172.21.15.52:0/282428453 wait complete. 2024-09-19T09:37:51.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.383+0000 7f93bc433740 20 client.21411 trim_cache size 0 max 16384 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 Processor -- start 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 -- start start 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec43acca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec438ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f93a0010f40 con 0x560ec4389b60 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000e810 con 0x560ec4394d40 2024-09-19T09:37:51.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93bc433740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000c660 con 0x560ec438a480 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55760/0 (socket says 172.21.15.52:55760) 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93b37fe640 1 -- 172.21.15.52:0/3771055359 learned_addr learned my addr 172.21.15.52:0/3771055359 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.400+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec43acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 -- 172.21.15.52:0/3771055359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 msgr2=0x560ec43acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b3fff640 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec438ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec43acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 -- 172.21.15.52:0/3771055359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 msgr2=0x560ec438ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec438ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 -- 172.21.15.52:0/3771055359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec4385b90 con 0x560ec4389b60 2024-09-19T09:37:51.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93b37fe640 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000f80 tx=0x7f93a4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948d4d85bf865ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93997fa640 1 -- 172.21.15.52:0/3771055359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a405e030 con 0x560ec4389b60 2024-09-19T09:37:51.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93997fa640 1 -- 172.21.15.52:0/3771055359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a4036040 con 0x560ec4389b60 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.401+0000 7f93997fa640 1 -- 172.21.15.52:0/3771055359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4055040 con 0x560ec4389b60 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- 172.21.15.52:0/3771055359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 msgr2=0x560ec43ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000f80 tx=0x7f93a4009c50 comp rx=0 tx=0).stop 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- 172.21.15.52:0/3771055359 shutdown_connections 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec4394d40 0x560ec438ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec438a480 0x560ec43acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 --2- 172.21.15.52:0/3771055359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4389b60 0x560ec43ac760 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- 172.21.15.52:0/3771055359 >> 172.21.15.52:0/3771055359 conn(0x560ec43860f0 msgr2=0x560ec438bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- 172.21.15.52:0/3771055359 shutdown_connections 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- 172.21.15.52:0/3771055359 wait complete. 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 -- start start 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.402+0000 7f93bc433740 1 Processor -- start 2024-09-19T09:37:51.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 0x560ec439cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4399d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000ccd0 con 0x560ec4394d40 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000e140 con 0x560ec438a480 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000d3a0 con 0x560ec4389b60 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93bc433740 10 client.0 _ll_register_callbacks cb 0x7f93a40318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4399d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 0x560ec439cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.52:57238/0 (socket says 172.21.15.52:57238) 2024-09-19T09:37:51.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b37fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 0x560ec439cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.52:37834/0 (socket says 172.21.15.52:37834) 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4399d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55766/0 (socket says 172.21.15.52:55766) 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 -- 172.21.15.52:0/469057377 learned_addr learned my addr 172.21.15.52:0/469057377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 -- 172.21.15.52:0/469057377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 msgr2=0x560ec439cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 0x560ec439cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 -- 172.21.15.52:0/469057377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 msgr2=0x560ec4399d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4399d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 -- 172.21.15.52:0/469057377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec439a250 con 0x560ec438a480 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f93b2ffd640 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93a8011f30 tx=0x7f93a800afb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7823c72a89441543 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f9392ffd640 10 client.0 ms_handle_connect on v2:172.21.15.86:3300/0 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.403+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mon.2 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800acf0 con 0x560ec438a480 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93a4036040 con 0x560ec438a480 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mon.2 v2:172.21.15.86:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f93a800f8e0 con 0x560ec438a480 2024-09-19T09:37:51.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mon.2 v2:172.21.15.86:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93a800fb00 con 0x560ec438a480 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 10 client.29732 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560ec440ff20 con 0x560ec438a480 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mon.2 v2:172.21.15.86:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a4036040 con 0x560ec438a480 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mon.2 v2:172.21.15.86:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f93a802f070 con 0x560ec438a480 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 10 client.29732 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 10 client.29732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 20 client.29732 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec4412470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 4 client.29732 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560ec42f6d00 con 0x560ec43a49d0 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.404+0000 7f93b37fe640 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec4412470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.405+0000 7f9392ffd640 10 client.29732 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:51.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.405+0000 7f93b37fe640 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec4412470 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2b87e5ff226845 server_cookie=28e00ebe78506bcb in_seq=0 out_seq=0 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f9392ffd640 1 -- 172.21.15.52:0/469057377 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560ec42f6d00 con 0x560ec43a49d0 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f9392ffd640 10 client.29732 handle_command_reply: tid=0 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 client.29732 shutdown 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 msgr2=0x560ec439d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93a8011f30 tx=0x7f93a800afb0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 shutdown_connections 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x560ec43a49d0 0x560ec4412470 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560ec4394d40 0x560ec4399d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x560ec438a480 0x560ec439d280 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f9392ffd640 0 client.29732 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 --2- 172.21.15.52:0/469057377 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560ec4389b60 0x560ec439cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 >> 172.21.15.52:0/469057377 conn(0x560ec43860f0 msgr2=0x560ec4393240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 shutdown_connections 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 1 -- 172.21.15.52:0/469057377 wait complete. 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.406+0000 7f93bc433740 20 client.29732 trim_cache size 0 max 16384 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: "return_code": 0, 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_tag": "6daa7b26-631c-42f1-97ae-1eade82aff29", 2024-09-19T09:37:51.413 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": "asynchronous" 2024-09-19T09:37:51.414 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 msgr2=0x7f939c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 0x7f939c0a5700 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f93a4006010 tx=0x7f93a4031c10 comp rx=0 tx=0).stop 2024-09-19T09:37:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 msgr2=0x7f93b4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:51.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c970 tx=0x7f93ac00cd70 comp rx=0 tx=0).stop 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 shutdown_connections 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f93b4106f20 0x7f93b4074f70 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f939c0a3240 0x7f939c0a5700 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f93b41027a0 0x7f93b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 --2- 172.21.15.52:0/1884508785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93b4101df0 0x7f93b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 >> 172.21.15.52:0/1884508785 conn(0x7f93b40fd8b0 msgr2=0x7f93b40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 shutdown_connections 2024-09-19T09:37:51.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:51.407+0000 7f93ba05a640 1 -- 172.21.15.52:0/1884508785 wait complete. 2024-09-19T09:37:51.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:51 smithi169 ceph-mon[35454]: pgmap v830: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:51 smithi086 ceph-mon[34813]: pgmap v830: 97 pgs: 97 active+clean; 4.1 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-19T09:37:52.123 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:37:52.380 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:52.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:52 smithi052 ceph-mon[30947]: scrub queued for path: / 2024-09-19T09:37:52.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:52 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:52 smithi052 ceph-mon[30947]: scrub summary: active paths [/] 2024-09-19T09:37:52.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:52 smithi052 ceph-mon[30947]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:52 smithi169 ceph-mon[35454]: scrub queued for path: / 2024-09-19T09:37:52.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:52 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:52 smithi169 ceph-mon[35454]: scrub summary: active paths [/] 2024-09-19T09:37:52.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:52 smithi169 ceph-mon[35454]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:52 smithi086 ceph-mon[34813]: scrub queued for path: / 2024-09-19T09:37:52.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:52 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:52 smithi086 ceph-mon[34813]: scrub summary: active paths [/] 2024-09-19T09:37:52.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:52 smithi086 ceph-mon[34813]: scrub summary: idle+waiting paths [/] 2024-09-19T09:37:52.629 INFO:tasks.workunit.client.0.smithi052.stdout:561/600: open fd = 3 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:562/600: open fd = 3 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:563/600: open fd = 3 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:564/600: open fd = 3 2024-09-19T09:37:52.630 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:565/600: open fd = 3 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:566/600: open fd = 3 2024-09-19T09:37:52.631 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:567/600: open fd = 3 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:568/600: open fd = 3 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.632 INFO:tasks.workunit.client.0.smithi052.stdout:569/600: open fd = 3 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:570/600: open fd = 3 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:571/600: open fd = 3 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.633 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:572/600: open fd = 3 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:573/600: open fd = 3 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:574/600: open fd = 3 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.634 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:575/600: open fd = 3 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:576/600: open fd = 3 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.635 INFO:tasks.workunit.client.0.smithi052.stdout:577/600: open fd = 3 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:578/600: open fd = 3 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.636 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:579/600: open fd = 3 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:580/600: open fd = 3 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.637 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.638 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.638 INFO:tasks.workunit.client.0.smithi052.stdout:581/600: open fd = 3 2024-09-19T09:37:52.638 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.638 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.638 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:582/600: open fd = 3 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:583/600: open fd = 3 2024-09-19T09:37:52.639 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:584/600: open fd = 3 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:585/600: open fd = 3 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.640 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:586/600: open fd = 3 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:587/600: open fd = 3 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:588/600: open fd = 3 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.641 INFO:tasks.workunit.client.0.smithi052.stdout:589/600: open fd = 3 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:590/600: open fd = 3 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:591/600: open fd = 3 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:592/600: open fd = 3 2024-09-19T09:37:52.642 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:593/600: open fd = 3 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:594/600: open fd = 3 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:595/600: open fd = 3 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.643 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:596/600: open fd = 3 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:597/600: open fd = 3 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:598/600: open fd = 3 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.644 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:599/600: open fd = 3 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:600/600: open fd = 3 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:write ret = 32 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stdout:pread ret = 64 2024-09-19T09:37:52.645 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo OK 2024-09-19T09:37:52.646 INFO:tasks.workunit.client.0.smithi052.stdout:OK 2024-09-19T09:37:52.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:37:52.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:37:52.697 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-19T09:37:52.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 -- 172.21.15.52:0/2592196235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 msgr2=0x7f4fc8110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 --2- 172.21.15.52:0/2592196235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc8110900 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009ca0 tx=0x7f4fc002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 -- 172.21.15.52:0/2592196235 shutdown_connections 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 --2- 172.21.15.52:0/2592196235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc8110900 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 --2- 172.21.15.52:0/2592196235 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 --2- 172.21.15.52:0/2592196235 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 0x7f4fc8100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 -- 172.21.15.52:0/2592196235 >> 172.21.15.52:0/2592196235 conn(0x7f4fc80fc7d0 msgr2=0x7f4fc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 -- 172.21.15.52:0/2592196235 shutdown_connections 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.895+0000 7f4fce01e640 1 -- 172.21.15.52:0/2592196235 wait complete. 2024-09-19T09:37:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 Processor -- start 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 -- start start 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 0x7f4fc819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8114250 con 0x7f4fc810e4f0 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81140d0 con 0x7f4fc81009d0 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fce01e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81143d0 con 0x7f4fc8101380 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 0x7f4fc819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55778/0 (socket says 172.21.15.52:55778) 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fc7fff640 1 -- 172.21.15.52:0/1731505618 learned_addr learned my addr 172.21.15.52:0/1731505618 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:52.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.896+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 -- 172.21.15.52:0/1731505618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 msgr2=0x7f4fc819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 -- 172.21.15.52:0/1731505618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 msgr2=0x7f4fc819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 0x7f4fc819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 -- 172.21.15.52:0/1731505618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc819f690 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00319f0 tx=0x7f4fc0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc4ff9640 1 -- 172.21.15.52:0/1731505618 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0003c30 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc4ff9640 1 -- 172.21.15.52:0/1731505618 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc0003dd0 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc819f920 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fc4ff9640 1 -- 172.21.15.52:0/1731505618 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc002fdd0 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.897+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc81a7260 con 0x7f4fc810e4f0 2024-09-19T09:37:52.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc4ff9640 1 -- 172.21.15.52:0/1731505618 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4fc0004050 con 0x7f4fc810e4f0 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 Processor -- start 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 -- start start 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff2140a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff21415670 0x55ff21417a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff213702e0 con 0x55ff2140adb0 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff21317ce0 con 0x55ff21415670 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff2136c2a0 con 0x55ff2140a490 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55792/0 (socket says 172.21.15.52:55792) 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc77fe640 1 -- 172.21.15.52:0/2428595219 learned_addr learned my addr 172.21.15.52:0/2428595219 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff2140a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.900+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff21415670 0x55ff21417a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 -- 172.21.15.52:0/2428595219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 msgr2=0x55ff2140a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff2140a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 -- 172.21.15.52:0/2428595219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff21415670 msgr2=0x55ff21417a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff21415670 0x55ff21417a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 -- 172.21.15.52:0/2428595219 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff212fc440 con 0x55ff2140adb0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc4ff9640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800bd10 tx=0x7f4fb80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afd41354595526e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fc4ff9640 1 -- 172.21.15.52:0/1731505618 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fc00f0c30 con 0x7f4fc810e4f0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fadffb640 1 -- 172.21.15.52:0/2428595219 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8004030 con 0x55ff2140adb0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fadffb640 1 -- 172.21.15.52:0/2428595219 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb80041d0 con 0x55ff2140adb0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.901+0000 7f4fadffb640 1 -- 172.21.15.52:0/2428595219 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80117e0 con 0x55ff2140adb0 2024-09-19T09:37:52.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- 172.21.15.52:0/2428595219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 msgr2=0x55ff21415130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 0x7f4fb00a5700 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55ff21407da0 tx=0x7f4fbc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800bd10 tx=0x7f4fb80107a0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- 172.21.15.52:0/2428595219 shutdown_connections 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff21415670 0x55ff21417a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff21415130 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/2428595219 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff2140a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- 172.21.15.52:0/2428595219 >> 172.21.15.52:0/2428595219 conn(0x55ff21406a20 msgr2=0x55ff21406e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- 172.21.15.52:0/2428595219 shutdown_connections 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- 172.21.15.52:0/2428595219 wait complete. 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.902+0000 7f4fd03f7740 1 -- start start 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 Processor -- start 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21414f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff21412230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff21418240 con 0x55ff21415670 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55ff2132b050 con 0x55ff2140adb0 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55ff214183c0 con 0x55ff2140a490 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fd03f7740 10 client.0 _ll_register_callbacks cb 0x55ff2136b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55808/0 (socket says 172.21.15.52:55808) 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 -- 172.21.15.52:0/3744363624 learned_addr learned my addr 172.21.15.52:0/3744363624 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21414f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff21412230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 -- 172.21.15.52:0/3744363624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 msgr2=0x55ff21414f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21414f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 -- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 msgr2=0x55ff21412230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.903+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff21412230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fc7fff640 1 -- 172.21.15.52:0/3744363624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff210e13c0 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0031f80 tx=0x7f4fc00099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc844c5e315643f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc002f690 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fc00bd4c0 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb80041d0 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fc00bd960 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fd03f7740 10 client.21429 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff21418240 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb80041d0 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fc00c59b0 con 0x55ff21415670 2024-09-19T09:37:52.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.904+0000 7f4fd03f7740 10 client.21429 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fd03f7740 10 client.21429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fd03f7740 20 client.21429 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fd03f7740 4 client.21429 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff2137d850 con 0x55ff21425070 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214274f0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9326e8d37265ea1f server_cookie=699c5ce78abf05fe in_seq=0 out_seq=0 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.905+0000 7f4fa6ffd640 10 client.21429 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/3744363624 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff2137d850 con 0x55ff21425070 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fa6ffd640 10 client.21429 handle_command_reply: tid=0 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 client.21429 shutdown 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 msgr2=0x55ff21412770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0031f80 tx=0x7f4fc00099f0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 shutdown_connections 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214274f0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff21412770 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff21412230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fa6ffd640 0 client.21429 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/3744363624 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21414f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 >> 172.21.15.52:0/3744363624 conn(0x55ff21406a20 msgr2=0x55ff21405ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 shutdown_connections 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 1 -- 172.21.15.52:0/3744363624 wait complete. 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.906+0000 7f4fd03f7740 20 client.21429 trim_cache size 0 max 16384 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.923+0000 7f4fd03f7740 1 Processor -- start 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.923+0000 7f4fd03f7740 1 -- start start 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21410b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff2142ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81b2250 con 0x55ff21415670 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81afb20 con 0x55ff2140adb0 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ad970 con 0x55ff2140a490 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55810/0 (socket says 172.21.15.52:55810) 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 -- 172.21.15.52:0/512486236 learned_addr learned my addr 172.21.15.52:0/512486236 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff2142ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21410b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 -- 172.21.15.52:0/512486236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 msgr2=0x55ff21410b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21410b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 -- 172.21.15.52:0/512486236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 msgr2=0x55ff2142ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff2142ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 -- 172.21.15.52:0/512486236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff214111e0 con 0x55ff21415670 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.924+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00b9c30 tx=0x7f4fc00bb770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220b4ca49f7cfb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fad7fa640 1 -- 172.21.15.52:0/512486236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00db020 con 0x55ff21415670 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fad7fa640 1 -- 172.21.15.52:0/512486236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc00d6070 con 0x55ff21415670 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fad7fa640 1 -- 172.21.15.52:0/512486236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00c1610 con 0x55ff21415670 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 -- 172.21.15.52:0/512486236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 msgr2=0x55ff2142d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00b9c30 tx=0x7f4fc00bb770 comp rx=0 tx=0).stop 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 -- 172.21.15.52:0/512486236 shutdown_connections 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff21415670 0x55ff2142d340 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140adb0 0x55ff2142ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/512486236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff2140a490 0x55ff21410b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 -- 172.21.15.52:0/512486236 >> 172.21.15.52:0/512486236 conn(0x55ff21406a20 msgr2=0x55ff214142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 -- 172.21.15.52:0/512486236 shutdown_connections 2024-09-19T09:37:52.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.925+0000 7f4fd03f7740 1 -- 172.21.15.52:0/512486236 wait complete. 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.926+0000 7f4fd03f7740 1 -- start start 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.926+0000 7f4fd03f7740 1 Processor -- start 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.926+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140a490 0x55ff2141b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff21415670 0x55ff2141be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81adfe0 con 0x55ff2140adb0 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81af450 con 0x55ff2140a490 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ae6b0 con 0x55ff21415670 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fd03f7740 10 client.0 _ll_register_callbacks cb 0x7f4fc0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55814/0 (socket says 172.21.15.52:55814) 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 -- 172.21.15.52:0/1921622756 learned_addr learned my addr 172.21.15.52:0/1921622756 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140a490 0x55ff2141b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc7fff640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff21415670 0x55ff2141be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 -- 172.21.15.52:0/1921622756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff21415670 msgr2=0x55ff2141be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff21415670 0x55ff2141be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 -- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140a490 msgr2=0x55ff2141b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140a490 0x55ff2141b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 -- 172.21.15.52:0/1921622756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2148ee60 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fc6ffd640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f4fc81028e0 tx=0x7f4fbc005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7d13d7f150fe04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc01fd70 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.927+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4fbc005020 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc00d6070 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc005220 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 10 client.21435 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ff214901b0 con 0x55ff2140adb0 2024-09-19T09:37:52.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fc00d6070 con 0x55ff2140adb0 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4fbc028070 con 0x55ff2140adb0 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 10 client.21435 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 10 client.21435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 20 client.21435 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 4 client.21435 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff21377d60 con 0x55ff21425070 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.928+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fc77fe640 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214929c0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=850307d7ffe6206b server_cookie=cf0acc2d5f9db284 in_seq=0 out_seq=0 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fa6ffd640 10 client.21435 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fa6ffd640 1 -- 172.21.15.52:0/1921622756 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ff21377d60 con 0x55ff21425070 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fa6ffd640 10 client.21435 handle_command_reply: tid=0 2024-09-19T09:37:52.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 client.21435 shutdown 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 msgr2=0x55ff2141b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f4fc81028e0 tx=0x7f4fbc005cf0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": { 2024-09-19T09:37:52.956 INFO:teuthology.orchestra.run.smithi052.stdout: "6daa7b26-631c-42f1-97ae-1eade82aff29": { 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "path": "/", 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "tag": "6daa7b26-631c-42f1-97ae-1eade82aff29", 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: "options": "recursive,force" 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 shutdown_connections 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55ff21425070 0x55ff214929c0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fa6ffd640 0 client.21435 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55ff21415670 0x55ff2141be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff2140adb0 0x55ff2141b950 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 --2- 172.21.15.52:0/1921622756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55ff2140a490 0x55ff2141b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 >> 172.21.15.52:0/1921622756 conn(0x55ff21406a20 msgr2=0x55ff214142b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 shutdown_connections 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.929+0000 7f4fd03f7740 1 -- 172.21.15.52:0/1921622756 wait complete. 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fd03f7740 20 client.21435 trim_cache size 0 max 16384 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 msgr2=0x7f4fb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 0x7f4fb00a5700 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x55ff21407da0 tx=0x7f4fbc005850 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 msgr2=0x7f4fc819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00319f0 tx=0x7f4fc0031a20 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 shutdown_connections 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4fc810e4f0 0x7f4fc819efb0 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f4fb00a3240 0x7f4fb00a5700 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4fc8101380 0x7f4fc819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 --2- 172.21.15.52:0/1731505618 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fc81009d0 0x7f4fc819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 >> 172.21.15.52:0/1731505618 conn(0x7f4fc80fc7d0 msgr2=0x7f4fc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 shutdown_connections 2024-09-19T09:37:52.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:52.930+0000 7f4fce01e640 1 -- 172.21.15.52:0/1731505618 wait complete. 2024-09-19T09:37:53.038 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:53.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:37:53.072 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:37:53.073 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:37:53.087 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:37:53.087 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:37:53.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:53.414 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:53 smithi052 ceph-mon[30947]: pgmap v831: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:53.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:53 smithi169 ceph-mon[35454]: pgmap v831: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:53 smithi086 ceph-mon[34813]: pgmap v831: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T09:37:53.838 INFO:tasks.cephfs.filesystem:scrub status for tag:6daa7b26-631c-42f1-97ae-1eade82aff29 - {'path': '/', 'tag': '6daa7b26-631c-42f1-97ae-1eade82aff29', 'options': 'recursive,force'} 2024-09-19T09:37:53.902 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:54.387 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:54 smithi052 ceph-mon[30947]: scrub summary: idle 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 -- 172.21.15.52:0/977298047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c102570 msgr2=0x7f218c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 --2- 172.21.15.52:0/977298047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c102570 0x7f218c1029b0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f2180009900 tx=0x7f218002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 -- 172.21.15.52:0/977298047 shutdown_connections 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 --2- 172.21.15.52:0/977298047 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102ef0 0x7f218c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 --2- 172.21.15.52:0/977298047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c102570 0x7f218c1029b0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 --2- 172.21.15.52:0/977298047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c100e20 0x7f218c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 -- 172.21.15.52:0/977298047 >> 172.21.15.52:0/977298047 conn(0x7f218c0fc7d0 msgr2=0x7f218c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 -- 172.21.15.52:0/977298047 shutdown_connections 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.386+0000 7f219255b640 1 -- 172.21.15.52:0/977298047 wait complete. 2024-09-19T09:37:54.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 Processor -- start 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 -- start start 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102570 0x7f218c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c102ef0 0x7f218c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f218c110f80 con 0x7f218c100e20 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f218c110e00 con 0x7f218c102ef0 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f219255b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f218c111100 con 0x7f218c102570 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f218bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f218bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55834/0 (socket says 172.21.15.52:55834) 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f218bfff640 1 -- 172.21.15.52:0/226639446 learned_addr learned my addr 172.21.15.52:0/226639446 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.387+0000 7f218b7fe640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102570 0x7f218c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f2190af8640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c102ef0 0x7f218c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 -- 172.21.15.52:0/226639446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102570 msgr2=0x7f218c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102570 0x7f218c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 -- 172.21.15.52:0/226639446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c102ef0 msgr2=0x7f218c1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c102ef0 0x7f218c1a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 -- 172.21.15.52:0/226639446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c1a4910 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f218bfff640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c890 tx=0x7f217c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c004220 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f217c0043c0 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218c1a4ae0 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c0049e0 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.388+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218c1a4fa0 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.389+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f218c101200 con 0x7f218c100e20 2024-09-19T09:37:54.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.390+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f217c0079b0 con 0x7f218c100e20 2024-09-19T09:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.391+0000 7f21897fa640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 0x7f21740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.391+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f217c0cf940 con 0x7f218c100e20 2024-09-19T09:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.391+0000 7f218b7fe640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 0x7f21740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.392+0000 7f218b7fe640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 0x7f21740a5700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2180009230 tx=0x7f21800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:54.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.396+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f217c014030 con 0x7f218c100e20 2024-09-19T09:37:54.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:54 smithi169 ceph-mon[35454]: scrub summary: idle 2024-09-19T09:37:54.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:54 smithi086 ceph-mon[34813]: scrub summary: idle 2024-09-19T09:37:54.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.608+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f218c109090 con 0x7f218c100e20 2024-09-19T09:37:54.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.609+0000 7f21897fa640 1 -- 172.21.15.52:0/226639446 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f217c09bf90 con 0x7f218c100e20 2024-09-19T09:37:54.610 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:37:54.610 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:37:54.611 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:37:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 msgr2=0x7f21740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 0x7f21740a5700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2180009230 tx=0x7f21800058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 msgr2=0x7f218c199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c890 tx=0x7f217c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 shutdown_connections 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f218c102ef0 0x7f218c1a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f21740a3240 0x7f21740a5700 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f218c102570 0x7f218c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 --2- 172.21.15.52:0/226639446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f218c100e20 0x7f218c199350 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 >> 172.21.15.52:0/226639446 conn(0x7f218c0fc7d0 msgr2=0x7f218c1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 shutdown_connections 2024-09-19T09:37:54.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:54.611+0000 7f219255b640 1 -- 172.21.15.52:0/226639446 wait complete. 2024-09-19T09:37:55.358 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:55 smithi052 ceph-mon[30947]: pgmap v832: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:55.358 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:55 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/226639446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:55.390 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24509 quiesce db --cancel --all' 2024-09-19T09:37:55.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24509 quiesce db --cancel --all 2024-09-19T09:37:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:55 smithi169 ceph-mon[35454]: pgmap v832: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:55 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/226639446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:55 smithi086 ceph-mon[34813]: pgmap v832: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:55 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/226639446' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:55.652 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:56.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 -- 172.21.15.52:0/2082295516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c105f40 msgr2=0x7f2b0c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 --2- 172.21.15.52:0/2082295516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c105f40 0x7f2b0c1063d0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009ca0 tx=0x7f2b0402a940 comp rx=0 tx=0).stop 2024-09-19T09:37:56.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 -- 172.21.15.52:0/2082295516 shutdown_connections 2024-09-19T09:37:56.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 --2- 172.21.15.52:0/2082295516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c105f40 0x7f2b0c1063d0 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 --2- 172.21.15.52:0/2082295516 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 0x7f2b0c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 --2- 172.21.15.52:0/2082295516 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c100b30 0x7f2b0c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 -- 172.21.15.52:0/2082295516 >> 172.21.15.52:0/2082295516 conn(0x7f2b0c0fc7a0 msgr2=0x7f2b0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 -- 172.21.15.52:0/2082295516 shutdown_connections 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.113+0000 7f2b116ff640 1 -- 172.21.15.52:0/2082295516 wait complete. 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 Processor -- start 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 -- start start 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 0x7f2b0c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c105f40 0x7f2b0c19e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c118560 con 0x7f2b0c100b30 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1183e0 con 0x7f2b0c105f40 2024-09-19T09:37:56.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.114+0000 7f2b116ff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1186e0 con 0x7f2b0c101450 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55842/0 (socket says 172.21.15.52:55842) 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 -- 172.21.15.52:0/3782239100 learned_addr learned my addr 172.21.15.52:0/3782239100 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 0x7f2b0c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c105f40 0x7f2b0c19e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 -- 172.21.15.52:0/3782239100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 msgr2=0x7f2b0c1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 0x7f2b0c1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 -- 172.21.15.52:0/3782239100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c105f40 msgr2=0x7f2b0c19e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c105f40 0x7f2b0c19e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 -- 172.21.15.52:0/3782239100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c19efd0 con 0x7f2b0c100b30 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b0affd640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d950 tx=0x7f2afc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2af3fff640 1 -- 172.21.15.52:0/3782239100 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc017070 con 0x7f2b0c100b30 2024-09-19T09:37:56.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c19f2c0 con 0x7f2b0c100b30 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2af3fff640 1 -- 172.21.15.52:0/3782239100 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2afc009c30 con 0x7f2b0c100b30 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2af3fff640 1 -- 172.21.15.52:0/3782239100 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00f6b0 con 0x7f2b0c100b30 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.115+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c1ab510 con 0x7f2b0c100b30 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 Processor -- start 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2af3fff640 1 -- 172.21.15.52:0/3782239100 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2afc00f850 con 0x7f2b0c100b30 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 -- start start 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c78de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c83be0 0x557500c85fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557500bdd200 con 0x557500c79320 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557500b83dc0 con 0x557500c78a00 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557500bd91c0 con 0x557500c83be0 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55846/0 (socket says 172.21.15.52:55846) 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b0affd640 1 -- 172.21.15.52:0/1156305167 learned_addr learned my addr 172.21.15.52:0/1156305167 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c78de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c83be0 0x557500c85fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.118+0000 7f2af3fff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 0x7f2af40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 -- 172.21.15.52:0/1156305167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c83be0 msgr2=0x557500c85fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c83be0 0x557500c85fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 -- 172.21.15.52:0/1156305167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 msgr2=0x557500c78de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c78de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 -- 172.21.15.52:0/1156305167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750094e620 con 0x557500c79320 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 0x7f2af40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2af3fff640 1 -- 172.21.15.52:0/3782239100 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2afc0cf520 con 0x7f2b0c100b30 2024-09-19T09:37:56.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2b0affd640 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f2afc071320 tx=0x7f2afc0665b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d1c5bf5ed73d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2af17fa640 1 -- 172.21.15.52:0/1156305167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc09b940 con 0x557500c79320 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2af17fa640 1 -- 172.21.15.52:0/1156305167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2afc071380 con 0x557500c79320 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.119+0000 7f2af17fa640 1 -- 172.21.15.52:0/1156305167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc071180 con 0x557500c79320 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- 172.21.15.52:0/1156305167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 msgr2=0x557500c836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f2afc071320 tx=0x7f2afc0665b0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 0x7f2af40a5700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005cc0 tx=0x7f2b040095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- 172.21.15.52:0/1156305167 shutdown_connections 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c83be0 0x557500c85fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c79320 0x557500c836a0 unknown :-1 s=CLOSED pgs=2348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/1156305167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c78de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- 172.21.15.52:0/1156305167 >> 172.21.15.52:0/1156305167 conn(0x557500c74f90 msgr2=0x557500c75370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- 172.21.15.52:0/1156305167 shutdown_connections 2024-09-19T09:37:56.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- 172.21.15.52:0/1156305167 wait complete. 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 -- start start 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.120+0000 7f2b13ad8740 1 Processor -- start 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c807a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557500c867b0 con 0x557500c83be0 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x557500b77c50 con 0x557500c78a00 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x557500c86930 con 0x557500c79320 2024-09-19T09:37:56.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 10 client.0 _ll_register_callbacks cb 0x557500b89ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55848/0 (socket says 172.21.15.52:55848) 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 -- 172.21.15.52:0/4150520829 learned_addr learned my addr 172.21.15.52:0/4150520829 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0affd640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c807a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 -- 172.21.15.52:0/4150520829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 msgr2=0x557500c807a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c807a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 -- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 msgr2=0x557500c834f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c834f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 -- 172.21.15.52:0/4150520829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557500c814e0 con 0x557500c83be0 2024-09-19T09:37:56.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0affd640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c834f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005df0 tx=0x7f2b04005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab329c4a629e09d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2aeeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04034040 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557500bea770 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.121+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2b04003b70 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2b04003db0 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 10 client.21453 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557500c92330 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557500bea770 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2b0402f070 con 0x557500c83be0 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 10 client.21453 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 10 client.21453 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:37:56.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 20 client.21453 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c937e0 0x557500c95c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 4 client.21453 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557500be4c80 con 0x557500c937e0 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.122+0000 7f2b0affd640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c937e0 0x557500c95c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.123+0000 7f2b0affd640 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c937e0 0x557500c95c60 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb53ad7a17f8f451 server_cookie=45e3b6f8ba755b9e in_seq=0 out_seq=0 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.123+0000 7f2aeeff5640 10 client.21453 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.123+0000 7f2aeeff5640 1 -- 172.21.15.52:0/4150520829 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557500be4c80 con 0x557500c937e0 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.123+0000 7f2aeeff5640 10 client.21453 handle_command_reply: tid=0 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.123+0000 7f2b13ad8740 1 client.21453 shutdown 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 msgr2=0x557500c80ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005df0 tx=0x7f2b04005c50 comp rx=0 tx=0).stop 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 shutdown_connections 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c937e0 0x557500c95c60 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c83be0 0x557500c80ce0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c807a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/4150520829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c834f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2aeeff5640 0 client.21453 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 >> 172.21.15.52:0/4150520829 conn(0x557500c74f90 msgr2=0x557500c741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 shutdown_connections 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 1 -- 172.21.15.52:0/4150520829 wait complete. 2024-09-19T09:37:56.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.124+0000 7f2b13ad8740 20 client.21453 trim_cache size 0 max 16384 2024-09-19T09:37:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 Processor -- start 2024-09-19T09:37:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 -- start start 2024-09-19T09:37:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c74f90 0x557500c8fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c79320 0x557500c9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b6700 con 0x557500c78a00 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b3fd0 con 0x557500c79320 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b1e70 con 0x557500c74f90 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55852/0 (socket says 172.21.15.52:55852) 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 -- 172.21.15.52:0/2392680904 learned_addr learned my addr 172.21.15.52:0/2392680904 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c79320 0x557500c9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0affd640 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c74f90 0x557500c8fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 -- 172.21.15.52:0/2392680904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c74f90 msgr2=0x557500c8fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c74f90 0x557500c8fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 -- 172.21.15.52:0/2392680904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c79320 msgr2=0x557500c9ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.141+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c79320 0x557500c9ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2b0a7fc640 1 -- 172.21.15.52:0/2392680904 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557500c86690 con 0x557500c78a00 2024-09-19T09:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c19fb80 tx=0x7f2b0000bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf068be631b35af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2af0ff9640 1 -- 172.21.15.52:0/2392680904 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000be60 con 0x557500c78a00 2024-09-19T09:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2af0ff9640 1 -- 172.21.15.52:0/2392680904 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b000047a0 con 0x557500c78a00 2024-09-19T09:37:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2af0ff9640 1 -- 172.21.15.52:0/2392680904 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00005580 con 0x557500c78a00 2024-09-19T09:37:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2b13ad8740 1 -- 172.21.15.52:0/2392680904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 msgr2=0x557500c9b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.142+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c19fb80 tx=0x7f2b0000bc10 comp rx=0 tx=0).stop 2024-09-19T09:37:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- 172.21.15.52:0/2392680904 shutdown_connections 2024-09-19T09:37:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c79320 0x557500c9ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c78a00 0x557500c9b530 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/2392680904 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c74f90 0x557500c8fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- 172.21.15.52:0/2392680904 >> 172.21.15.52:0/2392680904 conn(0x557500c70520 msgr2=0x557500c7be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- 172.21.15.52:0/2392680904 shutdown_connections 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- 172.21.15.52:0/2392680904 wait complete. 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- start start 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 Processor -- start 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c87db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b2490 con 0x557500c74f90 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b3900 con 0x557500c78a00 2024-09-19T09:37:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c1b2b60 con 0x557500c79320 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b13ad8740 10 client.0 _ll_register_callbacks cb 0x7f2b0402f5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.143+0000 7f2b0affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55856/0 (socket says 172.21.15.52:55856) 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 -- 172.21.15.52:0/78014326 learned_addr learned my addr 172.21.15.52:0/78014326 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0b7fe640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c87db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 -- 172.21.15.52:0/78014326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 msgr2=0x557500c882f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c882f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 -- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 msgr2=0x557500c87db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c87db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 -- 172.21.15.52:0/78014326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557500cfd500 con 0x557500c74f90 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b0affd640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f2afc09b870 tx=0x7f2afc005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9ce298cd51a07b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2aeeff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:37:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc020040 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2afc099c10 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b000047a0 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2afc071950 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b13ad8740 10 client.21459 fetch_fsmap learned FSMap version 24 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557500cfe760 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.144+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b000047a0 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2afc0981e0 con 0x557500c74f90 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 10 client.21459 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 10 client.21459 resolve_mds: validated gid 24509 aka daemon mds.b 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 20 client.21459 populate_metadata read hostname 'smithi052' 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c83be0 0x557500d00a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 4 client.21459 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x557500b611e0 con 0x557500c83be0 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c83be0 0x557500d00a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2b0a7fc640 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c83be0 0x557500d00a00 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4152f3145497341 server_cookie=2ed6fb818cd8ab47 in_seq=0 out_seq=0 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.145+0000 7f2aeeff5640 10 client.21459 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2aeeff5640 1 -- 172.21.15.52:0/78014326 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x557500b611e0 con 0x557500c83be0 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2aeeff5640 10 client.21459 handle_command_reply: tid=0 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 client.21459 shutdown 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 msgr2=0x557500c87870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f2afc09b870 tx=0x7f2afc005bb0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 shutdown_connections 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x557500c83be0 0x557500d00a00 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557500c79320 0x557500c882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x557500c78a00 0x557500c87db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2aeeff5640 0 client.21459 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 --2- 172.21.15.52:0/78014326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557500c74f90 0x557500c87870 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 >> 172.21.15.52:0/78014326 conn(0x557500c70520 msgr2=0x557500c741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 shutdown_connections 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 1 -- 172.21.15.52:0/78014326 wait complete. 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b13ad8740 20 client.21459 trim_cache size 0 max 16384 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 24, 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stdout: "leader": 24509, 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stdout: "set_version": 56, 2024-09-19T09:37:56.154 INFO:teuthology.orchestra.run.smithi052.stdout: "sets": {} 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.146+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 msgr2=0x7f2af40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 0x7f2af40a5700 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2b04005cc0 tx=0x7f2b040095c0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 msgr2=0x7f2b0c1a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d950 tx=0x7f2afc00de10 comp rx=0 tx=0).stop 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 shutdown_connections 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b0c105f40 0x7f2b0c19e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2af40a3240 0x7f2af40a5700 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2b0c101450 0x7f2b0c1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 --2- 172.21.15.52:0/3782239100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b0c100b30 0x7f2b0c1a46b0 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:56.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 >> 172.21.15.52:0/3782239100 conn(0x7f2b0c0fc7a0 msgr2=0x7f2b0c1038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:56.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 shutdown_connections 2024-09-19T09:37:56.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:37:56.147+0000 7f2b116ff640 1 -- 172.21.15.52:0/3782239100 wait complete. 2024-09-19T09:37:56.886 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:37:56.887 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:37:56.898 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:37:56.907 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:37:56.968 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:37:57.180 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:57 smithi052 ceph-mon[30947]: pgmap v833: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:57.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:57 smithi169 ceph-mon[35454]: pgmap v833: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:57 smithi086 ceph-mon[34813]: pgmap v833: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T09:37:59.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:37:59 smithi052 ceph-mon[30947]: pgmap v834: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T09:37:59.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:37:59 smithi169 ceph-mon[35454]: pgmap v834: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T09:37:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:37:59 smithi086 ceph-mon[34813]: pgmap v834: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T09:38:01.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:01 smithi052 ceph-mon[30947]: pgmap v835: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:38:01.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:01 smithi169 ceph-mon[35454]: pgmap v835: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:38:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:01 smithi086 ceph-mon[34813]: pgmap v835: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-19T09:38:03.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:03 smithi052 ceph-mon[30947]: pgmap v836: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:38:03.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:03 smithi169 ceph-mon[35454]: pgmap v836: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:38:03.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:03 smithi086 ceph-mon[34813]: pgmap v836: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T09:38:05.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:05 smithi052 ceph-mon[30947]: pgmap v837: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 KiB/s wr, 10 op/s 2024-09-19T09:38:05.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:05 smithi169 ceph-mon[35454]: pgmap v837: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 KiB/s wr, 10 op/s 2024-09-19T09:38:05.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:05 smithi086 ceph-mon[34813]: pgmap v837: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.0 KiB/s wr, 10 op/s 2024-09-19T09:38:07.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:07 smithi052 ceph-mon[30947]: pgmap v838: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:38:07.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:07 smithi169 ceph-mon[35454]: pgmap v838: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:38:07.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:07 smithi086 ceph-mon[34813]: pgmap v838: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2024-09-19T09:38:09.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:09 smithi052 ceph-mon[30947]: pgmap v839: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:38:09.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:09 smithi169 ceph-mon[35454]: pgmap v839: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:38:09.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:09 smithi086 ceph-mon[34813]: pgmap v839: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-19T09:38:11.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:11 smithi052 ceph-mon[30947]: pgmap v840: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:38:11.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:11 smithi169 ceph-mon[35454]: pgmap v840: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:38:11.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:11 smithi086 ceph-mon[34813]: pgmap v840: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T09:38:13.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:13 smithi052 ceph-mon[30947]: pgmap v841: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:38:13.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:13 smithi169 ceph-mon[35454]: pgmap v841: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:38:13.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:13 smithi086 ceph-mon[34813]: pgmap v841: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T09:38:15.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:15 smithi052 ceph-mon[30947]: pgmap v842: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:38:15.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:15 smithi169 ceph-mon[35454]: pgmap v842: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:38:15.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:15 smithi086 ceph-mon[34813]: pgmap v842: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-19T09:38:17.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:17 smithi052 ceph-mon[30947]: pgmap v843: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T09:38:17.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:17 smithi169 ceph-mon[35454]: pgmap v843: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T09:38:17.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:17 smithi086 ceph-mon[34813]: pgmap v843: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T09:38:19.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:19 smithi052 ceph-mon[30947]: pgmap v844: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T09:38:19.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:19 smithi169 ceph-mon[35454]: pgmap v844: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T09:38:19.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:19 smithi086 ceph-mon[34813]: pgmap v844: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-19T09:38:21.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:21 smithi052 ceph-mon[30947]: pgmap v845: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:38:21.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:21 smithi169 ceph-mon[35454]: pgmap v845: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:38:21.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:21 smithi086 ceph-mon[34813]: pgmap v845: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T09:38:23.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:23 smithi052 ceph-mon[30947]: pgmap v846: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:23.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:23 smithi169 ceph-mon[35454]: pgmap v846: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:23.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:23 smithi086 ceph-mon[34813]: pgmap v846: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:23.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:38:24.115 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.561+0000 7f4171d98640 1 -- 172.21.15.52:0/705140607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c101de0 msgr2=0x7f416c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.561+0000 7f4171d98640 1 --2- 172.21.15.52:0/705140607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c101de0 0x7f416c1021c0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f415c009900 tx=0x7f415c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 -- 172.21.15.52:0/705140607 shutdown_connections 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 --2- 172.21.15.52:0/705140607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c106f10 0x7f416c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 --2- 172.21.15.52:0/705140607 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 0x7f416c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 --2- 172.21.15.52:0/705140607 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c101de0 0x7f416c1021c0 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 -- 172.21.15.52:0/705140607 >> 172.21.15.52:0/705140607 conn(0x7f416c0fd8c0 msgr2=0x7f416c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 -- 172.21.15.52:0/705140607 shutdown_connections 2024-09-19T09:38:24.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 -- 172.21.15.52:0/705140607 wait complete. 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 Processor -- start 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.562+0000 7f4171d98640 1 -- start start 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c101de0 0x7f416c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 0x7f416c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111f70 con 0x7f416c106f10 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f416c111df0 con 0x7f416c102790 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f4171d98640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1120f0 con 0x7f416c101de0 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32852/0 (socket says 172.21.15.52:32852) 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 -- 172.21.15.52:0/2075675652 learned_addr learned my addr 172.21.15.52:0/2075675652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:24.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416affd640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 0x7f416c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416b7fe640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c101de0 0x7f416c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 -- 172.21.15.52:0/2075675652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c101de0 msgr2=0x7f416c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c101de0 0x7f416c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 -- 172.21.15.52:0/2075675652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 msgr2=0x7f416c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 0x7f416c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.563+0000 7f416bfff640 1 -- 172.21.15.52:0/2075675652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c19f5f0 con 0x7f416c106f10 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f416bfff640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f416400eaa0 tx=0x7f416400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f4168ff9640 1 -- 172.21.15.52:0/2075675652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416400cdb0 con 0x7f416c106f10 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c19f8e0 con 0x7f416c106f10 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f4168ff9640 1 -- 172.21.15.52:0/2075675652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4164005020 con 0x7f416c106f10 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f4168ff9640 1 -- 172.21.15.52:0/2075675652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41640116d0 con 0x7f416c106f10 2024-09-19T09:38:24.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.564+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a71c0 con 0x7f416c106f10 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.566+0000 7f4168ff9640 1 -- 172.21.15.52:0/2075675652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f41640054d0 con 0x7f416c106f10 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.566+0000 7f4174171740 1 Processor -- start 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.566+0000 7f4174171740 1 -- start start 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af69898140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af6989aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af697f32e0 con 0x55af6988d4a0 2024-09-19T09:38:24.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55af6979ace0 con 0x55af6988ddc0 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4174171740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af697ef2a0 con 0x55af69898680 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32856/0 (socket says 172.21.15.52:32856) 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 -- 172.21.15.52:0/712910164 learned_addr learned my addr 172.21.15.52:0/712910164 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4168ff9640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 0x7f41540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416b7fe640 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af69898140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f4168ff9640 1 -- 172.21.15.52:0/2075675652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f41640cfae0 con 0x7f416c106f10 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 -- 172.21.15.52:0/712910164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 msgr2=0x55af6989aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af6989aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 -- 172.21.15.52:0/712910164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 msgr2=0x55af69898140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af69898140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416affd640 1 -- 172.21.15.52:0/712910164 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6977f440 con 0x55af6988d4a0 2024-09-19T09:38:24.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416bfff640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 0x7f41540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.567+0000 7f416b7fe640 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af69898140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.568+0000 7f416affd640 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f416000b6c0 tx=0x7f41600127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31a8a79ba8beeb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.568+0000 7f416bfff640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 0x7f41540a5700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f41640092f0 tx=0x7f4164005440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.568+0000 7f4151ffb640 1 -- 172.21.15.52:0/712910164 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600120d0 con 0x55af6988d4a0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.568+0000 7f4151ffb640 1 -- 172.21.15.52:0/712910164 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4160016070 con 0x55af6988d4a0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.568+0000 7f4151ffb640 1 -- 172.21.15.52:0/712910164 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160010750 con 0x55af6988d4a0 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- 172.21.15.52:0/712910164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 msgr2=0x55af6988d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f416000b6c0 tx=0x7f41600127c0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- 172.21.15.52:0/712910164 shutdown_connections 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af6989aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af69898140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 --2- 172.21.15.52:0/712910164 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af6988d880 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- 172.21.15.52:0/712910164 >> 172.21.15.52:0/712910164 conn(0x55af69889a30 msgr2=0x55af69889e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- 172.21.15.52:0/712910164 shutdown_connections 2024-09-19T09:38:24.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- 172.21.15.52:0/712910164 wait complete. 2024-09-19T09:38:24.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.569+0000 7f4174171740 1 -- start start 2024-09-19T09:38:24.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 Processor -- start 2024-09-19T09:38:24.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af698952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af69895880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55af6989b250 con 0x55af6988d4a0 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x55af697ae050 con 0x55af6988ddc0 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55af6989b3d0 con 0x55af69898680 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f4174171740 10 client.0 _ll_register_callbacks cb 0x55af697ee160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32858/0 (socket says 172.21.15.52:32858) 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 -- 172.21.15.52:0/3455904114 learned_addr learned my addr 172.21.15.52:0/3455904114 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af698952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 -- 172.21.15.52:0/3455904114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 msgr2=0x55af69895880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af69895880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 -- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 msgr2=0x55af698952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af698952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.570+0000 7f416affd640 1 -- 172.21.15.52:0/3455904114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af695643c0 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f416affd640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f4160010470 tx=0x7f4160012300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6050edb3418c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160005610 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f416001b470 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4160016070 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f416002b030 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f4174171740 10 client.21471 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af698a6bd0 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4160016070 con 0x55af6988d4a0 2024-09-19T09:38:24.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.571+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4160024020 con 0x55af6988d4a0 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 10 client.21471 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 10 client.21471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 20 client.21471 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af698a8030 0x55af698aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 4 client.21471 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af69800850 con 0x55af698a8030 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af698a8030 0x55af698aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f414affd640 10 client.21471 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.572+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af698a8030 0x55af698aa420 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9190ed80bd700b26 server_cookie=bfa7358bf6bef03f in_seq=0 out_seq=0 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f414affd640 1 -- 172.21.15.52:0/3455904114 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af69800850 con 0x55af698a8030 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f414affd640 10 client.21471 handle_command_reply: tid=0 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 client.21471 shutdown 2024-09-19T09:38:24.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 msgr2=0x55af69898030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f4160010470 tx=0x7f4160012300 comp rx=0 tx=0).stop 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 shutdown_connections 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af698a8030 0x55af698aa420 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af69898680 0x55af69895880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af6988ddc0 0x55af698952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 --2- 172.21.15.52:0/3455904114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af69898030 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 >> 172.21.15.52:0/3455904114 conn(0x55af69889a30 msgr2=0x55af6988f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.573+0000 7f414affd640 0 client.21471 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.574+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 shutdown_connections 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.574+0000 7f4174171740 1 -- 172.21.15.52:0/3455904114 wait complete. 2024-09-19T09:38:24.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.574+0000 7f4174171740 20 client.21471 trim_cache size 0 max 16384 2024-09-19T09:38:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 Processor -- start 2024-09-19T09:38:24.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 -- start start 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988d4a0 0x55af698a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af698b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1b2390 con 0x55af6988ddc0 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1afc60 con 0x55af69898680 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f4174171740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1adab0 con 0x55af6988d4a0 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32860/0 (socket says 172.21.15.52:32860) 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 -- 172.21.15.52:0/3968033663 learned_addr learned my addr 172.21.15.52:0/3968033663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416affd640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988d4a0 0x55af698a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416affd640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af698b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 -- 172.21.15.52:0/3968033663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988d4a0 msgr2=0x55af698a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988d4a0 0x55af698a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 -- 172.21.15.52:0/3968033663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 msgr2=0x55af698b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af698b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 -- 172.21.15.52:0/3968033663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6989aa70 con 0x55af6988ddc0 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416affd640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af698b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f416b7fe640 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f415c009230 tx=0x7f415c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bec63e9e98a717 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f41517fa640 1 -- 172.21.15.52:0/3968033663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c035040 con 0x55af6988ddc0 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f41517fa640 1 -- 172.21.15.52:0/3968033663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f415c0319d0 con 0x55af6988ddc0 2024-09-19T09:38:24.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.592+0000 7f41517fa640 1 -- 172.21.15.52:0/3968033663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c004890 con 0x55af6988ddc0 2024-09-19T09:38:24.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- 172.21.15.52:0/3968033663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 msgr2=0x55af698afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f415c009230 tx=0x7f415c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- 172.21.15.52:0/3968033663 shutdown_connections 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af698b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988ddc0 0x55af698afb10 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 --2- 172.21.15.52:0/3968033663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988d4a0 0x55af698a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- 172.21.15.52:0/3968033663 >> 172.21.15.52:0/3968033663 conn(0x55af69889a30 msgr2=0x55af698943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- 172.21.15.52:0/3968033663 shutdown_connections 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- 172.21.15.52:0/3968033663 wait complete. 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 -- start start 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.593+0000 7f4174171740 1 Processor -- start 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988ddc0 0x55af698a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af6989bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1ae120 con 0x55af6988d4a0 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1af590 con 0x55af69898680 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1ae7f0 con 0x55af6988ddc0 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 10 client.0 _ll_register_callbacks cb 0x7f416000bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32868/0 (socket says 172.21.15.52:32868) 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 -- 172.21.15.52:0/263315090 learned_addr learned my addr 172.21.15.52:0/263315090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416b7fe640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988ddc0 0x55af698a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 -- 172.21.15.52:0/263315090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988ddc0 msgr2=0x55af698a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988ddc0 0x55af698a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 -- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 msgr2=0x55af6989bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af6989bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 -- 172.21.15.52:0/263315090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af6989c4d0 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f416affd640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f4160004fd0 tx=0x7f416000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bfdc4fbf361f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f414affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416000b410 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f4160004660 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.594+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f415c0319d0 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4160004860 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 10 client.21477 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55af699125c0 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f415c0319d0 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4160024040 con 0x55af6988d4a0 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 10 client.21477 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:24.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 10 client.21477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 20 client.21477 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af69912c20 0x55af69915040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 4 client.21477 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af697fad60 con 0x55af69912c20 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.595+0000 7f416b7fe640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af69912c20 0x55af69915040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f416b7fe640 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af69912c20 0x55af69915040 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b0d928963ea6e4d server_cookie=e77993121f6a78c6 in_seq=0 out_seq=0 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f414affd640 10 client.21477 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f414affd640 1 -- 172.21.15.52:0/263315090 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55af697fad60 con 0x55af69912c20 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f414affd640 10 client.21477 handle_command_reply: tid=0 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 client.21477 shutdown 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 msgr2=0x55af698a08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f4160004fd0 tx=0x7f416000b810 comp rx=0 tx=0).stop 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 shutdown_connections 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x55af69912c20 0x55af69915040 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x55af69898680 0x55af6989bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55af6988ddc0 0x55af698a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 --2- 172.21.15.52:0/263315090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55af6988d4a0 0x55af698a08e0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 >> 172.21.15.52:0/263315090 conn(0x55af69889a30 msgr2=0x55af69888350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f414affd640 0 client.21477 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 shutdown_connections 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 1 -- 172.21.15.52:0/263315090 wait complete. 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.596+0000 7f4174171740 20 client.21477 trim_cache size 0 max 16384 2024-09-19T09:38:24.604 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:24.605 INFO:teuthology.orchestra.run.smithi052.stdout: "status": "no active scrubs running", 2024-09-19T09:38:24.605 INFO:teuthology.orchestra.run.smithi052.stdout: "scrubs": {} 2024-09-19T09:38:24.605 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:24.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 msgr2=0x7f41540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 0x7f41540a5700 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f41640092f0 tx=0x7f4164005440 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 msgr2=0x7f416c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f416400eaa0 tx=0x7f416400ef60 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 shutdown_connections 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f416c106f10 0x7f416c19ef10 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f416c102790 0x7f416c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f41540a3240 0x7f41540a5700 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 --2- 172.21.15.52:0/2075675652 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f416c101de0 0x7f416c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 >> 172.21.15.52:0/2075675652 conn(0x7f416c0fd8c0 msgr2=0x7f416c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 shutdown_connections 2024-09-19T09:38:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:24.597+0000 7f4171d98640 1 -- 172.21.15.52:0/2075675652 wait complete. 2024-09-19T09:38:25.409 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:25 smithi052 ceph-mon[30947]: pgmap v847: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:25.439 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:38:25.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:25.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:25 smithi169 ceph-mon[35454]: pgmap v847: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:25.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:25 smithi086 ceph-mon[34813]: pgmap v847: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:25.699 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/3090849111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 msgr2=0x7f6e2810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/3090849111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e2810d950 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009cd0 tx=0x7f6e2002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/3090849111 shutdown_connections 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/3090849111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e2810d950 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/3090849111 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 0x7f6e28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/3090849111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 0x7f6e28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/3090849111 >> 172.21.15.52:0/3090849111 conn(0x7f6e280fc7a0 msgr2=0x7f6e280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.200+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/3090849111 shutdown_connections 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/3090849111 wait complete. 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 Processor -- start 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 -- start start 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 0x7f6e281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110e80 con 0x7f6e28101420 2024-09-19T09:38:26.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28110d00 con 0x7f6e28106a80 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.201+0000 7f6e2dcfa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28111000 con 0x7f6e28100a80 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32874/0 (socket says 172.21.15.52:32874) 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 -- 172.21.15.52:0/2376343246 learned_addr learned my addr 172.21.15.52:0/2376343246 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e277fe640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 0x7f6e281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e27fff640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 -- 172.21.15.52:0/2376343246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 msgr2=0x7f6e281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 0x7f6e281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 -- 172.21.15.52:0/2376343246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 msgr2=0x7f6e2819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 -- 172.21.15.52:0/2376343246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2819d450 con 0x7f6e28101420 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e26ffd640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d770 tx=0x7f6e1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c017070 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1c005500 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2819d740 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c004e00 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.202+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281a5020 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.203+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e28100ee0 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.204+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e1c004fa0 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.205+0000 7f6e24ff9640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 0x7f6e100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.205+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f6e1c0cf310 con 0x7f6e28101420 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.205+0000 7f6e277fe640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 0x7f6e100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.206+0000 7f6e277fe640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 0x7f6e100a5700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e18005d00 tx=0x7f6e1800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.209+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e1c09b960 con 0x7f6e28101420 2024-09-19T09:38:26.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.422+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e2810a020 con 0x7f6e28101420 2024-09-19T09:38:26.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.423+0000 7f6e24ff9640 1 -- 172.21.15.52:0/2376343246 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f6e1c09fc60 con 0x7f6e28101420 2024-09-19T09:38:26.425 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:26.425 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:38:26.425 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:38:26.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 msgr2=0x7f6e100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 0x7f6e100a5700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e18005d00 tx=0x7f6e1800b410 comp rx=0 tx=0).stop 2024-09-19T09:38:26.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 msgr2=0x7f6e281989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00d770 tx=0x7f6e1c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 shutdown_connections 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e28106a80 0x7f6e2819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6e28101420 0x7f6e281989e0 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f6e100a3240 0x7f6e100a5700 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 --2- 172.21.15.52:0/2376343246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6e28100a80 0x7f6e281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 >> 172.21.15.52:0/2376343246 conn(0x7f6e280fc7a0 msgr2=0x7f6e2806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 shutdown_connections 2024-09-19T09:38:26.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:26.425+0000 7f6e2dcfa640 1 -- 172.21.15.52:0/2376343246 wait complete. 2024-09-19T09:38:27.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:38:27.369 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:27 smithi052 ceph-mon[30947]: pgmap v848: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:38:27.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:27 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2376343246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:27.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:27 smithi169 ceph-mon[35454]: pgmap v848: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:38:27.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:27 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2376343246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:27 smithi086 ceph-mon[34813]: pgmap v848: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T09:38:27.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:27 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2376343246' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 -- 172.21.15.52:0/3727426751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134101420 msgr2=0x7f013410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 --2- 172.21.15.52:0/3727426751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134101420 0x7f013410d950 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f012c009cd0 tx=0x7f012c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 -- 172.21.15.52:0/3727426751 shutdown_connections 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 --2- 172.21.15.52:0/3727426751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134101420 0x7f013410d950 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 --2- 172.21.15.52:0/3727426751 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134100a80 0x7f0134100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 --2- 172.21.15.52:0/3727426751 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f0134106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 -- 172.21.15.52:0/3727426751 >> 172.21.15.52:0/3727426751 conn(0x7f01340fc7a0 msgr2=0x7f01340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 -- 172.21.15.52:0/3727426751 shutdown_connections 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.838+0000 7f013ae95640 1 -- 172.21.15.52:0/3727426751 wait complete. 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 Processor -- start 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 -- start start 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134101420 0x7f013419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f013419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0134110e80 con 0x7f0134100a80 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0134110d00 con 0x7f0134101420 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f013ae95640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0134111000 con 0x7f0134106a80 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32878/0 (socket says 172.21.15.52:32878) 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f0138c31640 1 -- 172.21.15.52:0/844563921 learned_addr learned my addr 172.21.15.52:0/844563921 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f0133fff640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134101420 0x7f013419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.839+0000 7f0139432640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f013419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 -- 172.21.15.52:0/844563921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 msgr2=0x7f013419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f013419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 -- 172.21.15.52:0/844563921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134101420 msgr2=0x7f013419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134101420 0x7f013419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 -- 172.21.15.52:0/844563921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013419f590 con 0x7f0134100a80 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0139432640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f013419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0138c31640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f012800d770 tx=0x7f012800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0131ffb640 1 -- 172.21.15.52:0/844563921 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128017070 con 0x7f0134100a80 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013419f880 con 0x7f0134100a80 2024-09-19T09:38:27.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0131ffb640 1 -- 172.21.15.52:0/844563921 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0128005500 con 0x7f0134100a80 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f0131ffb640 1 -- 172.21.15.52:0/844563921 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128004e00 con 0x7f0134100a80 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.840+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341a7160 con 0x7f0134100a80 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.842+0000 7f0131ffb640 1 -- 172.21.15.52:0/844563921 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0128004fa0 con 0x7f0134100a80 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 Processor -- start 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 -- start start 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x56031263d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x56031264a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5603125a32f0 con 0x56031263d5d0 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56031254acf0 con 0x56031263eb40 2024-09-19T09:38:27.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f013d26e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56031259f2b0 con 0x560312648370 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0131ffb640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 0x7f01240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32890/0 (socket says 172.21.15.52:32890) 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0138c31640 1 -- 172.21.15.52:0/3285192884 learned_addr learned my addr 172.21.15.52:0/3285192884 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0139432640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 0x7f01240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0133fff640 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x56031264a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0139432640 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x56031263d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.843+0000 7f0131ffb640 1 -- 172.21.15.52:0/844563921 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f01280cf370 con 0x7f0134100a80 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 -- 172.21.15.52:0/3285192884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 msgr2=0x56031264a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x56031264a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 -- 172.21.15.52:0/3285192884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 msgr2=0x56031263d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x56031263d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 -- 172.21.15.52:0/3285192884 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56031252f3a0 con 0x56031263d5d0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0139432640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 0x7f01240a5700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f012c009a60 tx=0x7f012c032fc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f0138c31640 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f01280ccdf0 tx=0x7f01280048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0e0f2523d412f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f011effd640 1 -- 172.21.15.52:0/3285192884 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128020070 con 0x56031263d5d0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f011effd640 1 -- 172.21.15.52:0/3285192884 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012809c010 con 0x56031263d5d0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.844+0000 7f011effd640 1 -- 172.21.15.52:0/3285192884 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128099c10 con 0x56031263d5d0 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- 172.21.15.52:0/3285192884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 msgr2=0x56031263da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f01280ccdf0 tx=0x7f01280048a0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- 172.21.15.52:0/3285192884 shutdown_connections 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x56031264a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x56031263da10 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 --2- 172.21.15.52:0/3285192884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x56031263d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- 172.21.15.52:0/3285192884 >> 172.21.15.52:0/3285192884 conn(0x560312606310 msgr2=0x560312639c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- 172.21.15.52:0/3285192884 shutdown_connections 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- 172.21.15.52:0/3285192884 wait complete. 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 -- start start 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.845+0000 7f013d26e740 1 Processor -- start 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x560312645030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x560312645640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56031264b010 con 0x56031263d5d0 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x56031255e060 con 0x56031263eb40 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56031264b190 con 0x560312648370 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f013d26e740 10 client.0 _ll_register_callbacks cb 0x5603122b18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32896/0 (socket says 172.21.15.52:32896) 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 -- 172.21.15.52:0/3361303969 learned_addr learned my addr 172.21.15.52:0/3361303969 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0133fff640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x560312645030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0139432640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x560312645640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 -- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 msgr2=0x560312645640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x560312645640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 -- 172.21.15.52:0/3361303969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 msgr2=0x560312645030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x560312645030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 -- 172.21.15.52:0/3361303969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603123143c0 con 0x56031263d5d0 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0133fff640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x560312645030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0138c31640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f01280a4740 tx=0x7f012809b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505cb3ef2ae0a91d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0113fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:27.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.846+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01280b3060 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f0128099c10 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012809c010 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0128020070 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 10 client.21495 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560312656ae0 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012809c010 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f012809ad60 con 0x56031263d5d0 2024-09-19T09:38:27.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 10 client.21495 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 10 client.21495 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 20 client.21495 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560312657f70 0x56031265a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 4 client.21495 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603125b0860 con 0x560312657f70 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.847+0000 7f0133fff640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560312657f70 0x56031265a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.848+0000 7f0133fff640 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560312657f70 0x56031265a360 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b0c55fbc990de480 server_cookie=37800f0992b6f179 in_seq=0 out_seq=0 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.848+0000 7f0113fff640 10 client.21495 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f0113fff640 1 -- 172.21.15.52:0/3361303969 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603125b0860 con 0x560312657f70 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f0113fff640 10 client.21495 handle_command_reply: tid=0 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 client.21495 shutdown 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 msgr2=0x560312647d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f01280a4740 tx=0x7f012809b980 comp rx=0 tx=0).stop 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 shutdown_connections 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x560312657f70 0x56031265a360 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x560312645640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263eb40 0x560312645030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 --2- 172.21.15.52:0/3361303969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263d5d0 0x560312647d80 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 >> 172.21.15.52:0/3361303969 conn(0x560312606310 msgr2=0x56031263f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f0113fff640 0 client.21495 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 shutdown_connections 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 1 -- 172.21.15.52:0/3361303969 wait complete. 2024-09-19T09:38:27.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.849+0000 7f013d26e740 20 client.21495 trim_cache size 0 max 16384 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.862+0000 7f013d26e740 1 Processor -- start 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.862+0000 7f013d26e740 1 -- start start 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x560312654430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56031263eb40 0x560312640120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01341b2250 con 0x560312648370 2024-09-19T09:38:27.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01341afb20 con 0x56031263d5d0 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f013d26e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01341ad970 con 0x56031263eb40 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32900/0 (socket says 172.21.15.52:32900) 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 -- 172.21.15.52:0/4156746137 learned_addr learned my addr 172.21.15.52:0/4156746137 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0138c31640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x560312654430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0133fff640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56031263eb40 0x560312640120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 -- 172.21.15.52:0/4156746137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56031263eb40 msgr2=0x560312640120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56031263eb40 0x560312640120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 -- 172.21.15.52:0/4156746137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 msgr2=0x560312654430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x560312654430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0139432640 1 -- 172.21.15.52:0/4156746137 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56031263a960 con 0x560312648370 2024-09-19T09:38:27.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.863+0000 7f0138c31640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x560312654430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f0139432640 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f012c009cd0 tx=0x7f012c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7078649a1e499e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f011e7fc640 1 -- 172.21.15.52:0/4156746137 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c004040 con 0x560312648370 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f011e7fc640 1 -- 172.21.15.52:0/4156746137 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c036040 con 0x560312648370 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f011e7fc640 1 -- 172.21.15.52:0/4156746137 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c030be0 con 0x560312648370 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f013d26e740 1 -- 172.21.15.52:0/4156746137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 msgr2=0x560312640660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.864+0000 7f013d26e740 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f012c009cd0 tx=0x7f012c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- 172.21.15.52:0/4156746137 shutdown_connections 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560312648370 0x560312640660 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56031263eb40 0x560312640120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- 172.21.15.52:0/4156746137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x560312654430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- 172.21.15.52:0/4156746137 >> 172.21.15.52:0/4156746137 conn(0x560312606310 msgr2=0x560312644120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- 172.21.15.52:0/4156746137 shutdown_connections 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- 172.21.15.52:0/4156746137 wait complete. 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- start start 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 Processor -- start 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x56031265a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x5603126b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01341adfe0 con 0x56031263eb40 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f01341af450 con 0x56031263d5d0 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.865+0000 7f013d26e740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01341ae6b0 con 0x560312648370 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f013d26e740 10 client.0 _ll_register_callbacks cb 0x7f012800df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32906/0 (socket says 172.21.15.52:32906) 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 -- 172.21.15.52:0/4002971293 learned_addr learned my addr 172.21.15.52:0/4002971293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0138c31640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x56031265a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0139432640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x5603126b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 -- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 msgr2=0x5603126b9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x5603126b9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 -- 172.21.15.52:0/4002971293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 msgr2=0x56031265a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x56031265a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 -- 172.21.15.52:0/4002971293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603126b9ea0 con 0x56031263eb40 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0133fff640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0120004700 tx=0x7f012000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870a5b2c55a834c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0113fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012001d410 con 0x56031263eb40 2024-09-19T09:38:27.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f012001d5b0 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.866+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c036040 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f012002a020 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 10 client.21501 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603126c24b0 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f012c036040 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0120024030 con 0x56031263eb40 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 10 client.21501 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 10 client.21501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 20 client.21501 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5603126c2bc0 0x5603126c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 4 client.21501 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:38:27.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 --> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603125aad70 con 0x5603126c2bc0 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.867+0000 7f0138c31640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5603126c2bc0 0x5603126c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f0138c31640 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5603126c2bc0 0x5603126c4fe0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2ad8dcad5bc5017 server_cookie=3018fd3530cc04f4 in_seq=0 out_seq=0 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f0113fff640 10 client.21501 ms_handle_connect on v2:172.21.15.169:6838/3841296575 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f0113fff640 1 -- 172.21.15.52:0/4002971293 <== mds.2 v2:172.21.15.169:6838/3841296575 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603125aad70 con 0x5603126c2bc0 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f0113fff640 10 client.21501 handle_command_reply: tid=0 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 client.21501 shutdown 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 msgr2=0x56031265abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0120004700 tx=0x7f012000bd20 comp rx=0 tx=0).stop 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 shutdown_connections 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:6838/3841296575,v1:172.21.15.169:6839/3841296575] conn(0x5603126c2bc0 0x5603126c4fe0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560312648370 0x5603126b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56031263eb40 0x56031265abe0 unknown :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f0113fff640 0 client.21501 ms_handle_reset on v2:172.21.15.169:6838/3841296575 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 --2- 172.21.15.52:0/4002971293 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x56031263d5d0 0x56031265a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 >> 172.21.15.52:0/4002971293 conn(0x560312606310 msgr2=0x5603126384e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 shutdown_connections 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 1 -- 172.21.15.52:0/4002971293 wait complete. 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.868+0000 7f013d26e740 20 client.21501 trim_cache size 0 max 16384 2024-09-19T09:38:27.877 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:38:27.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 msgr2=0x7f01240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 0x7f01240a5700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f012c009a60 tx=0x7f012c032fc0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 msgr2=0x7f013419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f012800d770 tx=0x7f012800dc30 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 shutdown_connections 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f01240a3240 0x7f01240a5700 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0134106a80 0x7f013419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0134101420 0x7f013419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 --2- 172.21.15.52:0/844563921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0134100a80 0x7f013419a5e0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 >> 172.21.15.52:0/844563921 conn(0x7f01340fc7a0 msgr2=0x7f013406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 shutdown_connections 2024-09-19T09:38:27.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:27.869+0000 7f013ae95640 1 -- 172.21.15.52:0/844563921 wait complete. 2024-09-19T09:38:28.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:38:28.948 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:29.324 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:29 smithi052 ceph-mon[30947]: pgmap v849: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 -- 172.21.15.52:0/81937102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 msgr2=0x7fe66c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 --2- 172.21.15.52:0/81937102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c10ea90 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7fe664009ca0 tx=0x7fe66402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 -- 172.21.15.52:0/81937102 shutdown_connections 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 --2- 172.21.15.52:0/81937102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c10ea90 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 --2- 172.21.15.52:0/81937102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c102790 0x7fe66c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 --2- 172.21.15.52:0/81937102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c101de0 0x7fe66c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 -- 172.21.15.52:0/81937102 >> 172.21.15.52:0/81937102 conn(0x7fe66c0fd8c0 msgr2=0x7fe66c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 -- 172.21.15.52:0/81937102 shutdown_connections 2024-09-19T09:38:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.406+0000 7fe671eda640 1 -- 172.21.15.52:0/81937102 wait complete. 2024-09-19T09:38:29.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 Processor -- start 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 -- start start 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c101de0 0x7fe66c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 0x7fe66c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c111fc0 con 0x7fe66c106f10 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c111e40 con 0x7fe66c102790 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe671eda640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c112140 con 0x7fe66c101de0 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe66bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c101de0 0x7fe66c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe66bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47552/0 (socket says 172.21.15.52:47552) 2024-09-19T09:38:29.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe66bfff640 1 -- 172.21.15.52:0/3866295381 learned_addr learned my addr 172.21.15.52:0/3866295381 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.407+0000 7fe66affd640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 0x7fe66c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 -- 172.21.15.52:0/3866295381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c101de0 msgr2=0x7fe66c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c101de0 0x7fe66c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 -- 172.21.15.52:0/3866295381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 msgr2=0x7fe66c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 0x7fe66c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 -- 172.21.15.52:0/3866295381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c1a6860 con 0x7fe66c106f10 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66affd640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 0x7fe66c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe66bfff640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fe664003f10 tx=0x7fe664003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe668ff9640 1 -- 172.21.15.52:0/3866295381 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664031710 con 0x7fe66c106f10 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1a6af0 con 0x7fe66c106f10 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe668ff9640 1 -- 172.21.15.52:0/3866295381 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6640318b0 con 0x7fe66c106f10 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe668ff9640 1 -- 172.21.15.52:0/3866295381 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66402fb90 con 0x7fe66c106f10 2024-09-19T09:38:29.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.408+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1a7080 con 0x7fe66c106f10 2024-09-19T09:38:29.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe668ff9640 1 -- 172.21.15.52:0/3866295381 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe66402fd30 con 0x7fe66c106f10 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 Processor -- start 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 -- start start 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x563845036090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845043760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563844f9c2f0 con 0x5638450365d0 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563844f43cf0 con 0x563845037b40 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe6742b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x563844f982b0 con 0x563845041370 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe668ff9640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 0x7fe6540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47562/0 (socket says 172.21.15.52:47562) 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3392960379 learned_addr learned my addr 172.21.15.52:0/3392960379 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe66affd640 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x563845036090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.411+0000 7fe66affd640 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845043760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66bfff640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 0x7fe6540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3392960379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 msgr2=0x563845043760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845043760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3392960379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 msgr2=0x563845036090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x563845036090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3392960379 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563844f283a0 con 0x5638450365d0 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe668ff9640 1 -- 172.21.15.52:0/3866295381 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe6640f1020 con 0x7fe66c106f10 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ac00 tx=0x7fe65c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2619b5752b49fd33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe66bfff640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 0x7fe6540a5700 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe6640c5d00 tx=0x7fe664090440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe651ffb640 1 -- 172.21.15.52:0/3392960379 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c005220 con 0x5638450365d0 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe651ffb640 1 -- 172.21.15.52:0/3392960379 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c004c80 con 0x5638450365d0 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.412+0000 7fe651ffb640 1 -- 172.21.15.52:0/3392960379 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0188a0 con 0x5638450365d0 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- 172.21.15.52:0/3392960379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 msgr2=0x563845036a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ac00 tx=0x7fe65c00f790 comp rx=0 tx=0).stop 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- 172.21.15.52:0/3392960379 shutdown_connections 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845043760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5638450365d0 0x563845036a10 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3392960379 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x563845036090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- 172.21.15.52:0/3392960379 >> 172.21.15.52:0/3392960379 conn(0x563844fff310 msgr2=0x563845032c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- 172.21.15.52:0/3392960379 shutdown_connections 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- 172.21.15.52:0/3392960379 wait complete. 2024-09-19T09:38:29.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.413+0000 7fe6742b3740 1 -- start start 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 Processor -- start 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638450365d0 0x563845040cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x56384503df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563845044070 con 0x563845041370 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x563844f57060 con 0x563845037b40 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5638450441f0 con 0x5638450365d0 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe6742b3740 10 client.0 _ll_register_callbacks cb 0x563844caa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47568/0 (socket says 172.21.15.52:47568) 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 -- 172.21.15.52:0/2223069099 learned_addr learned my addr 172.21.15.52:0/2223069099 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x56384503df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638450365d0 0x563845040cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 -- 172.21.15.52:0/2223069099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638450365d0 msgr2=0x563845040cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638450365d0 0x563845040cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 -- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 msgr2=0x56384503df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x56384503df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.414+0000 7fe66affd640 1 -- 172.21.15.52:0/2223069099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563844d0d3c0 con 0x563845041370 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe66affd640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe6600103d0 tx=0x7fe660004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b87165eb585ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66001b040 con 0x563845041370 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe660005020 con 0x563845041370 2024-09-19T09:38:29.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe65c004c80 con 0x563845041370 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe660005220 con 0x563845041370 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 10 client.21513 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56384504fb10 con 0x563845041370 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c004c80 con 0x563845041370 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe66002c480 con 0x563845041370 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 10 client.21513 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:29.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 10 client.21513 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 20 client.21513 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563845050f20 0x563845053330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 4 client.21513 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.415+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563844fa9860 con 0x563845050f20 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.416+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563845050f20 0x563845053330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.416+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563845050f20 0x563845053330 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99b7ea310c032e62 server_cookie=a755fa565df717b1 in_seq=0 out_seq=0 2024-09-19T09:38:29.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.416+0000 7fe64affd640 10 client.21513 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:38:29.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe64affd640 1 -- 172.21.15.52:0/2223069099 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563844fa9860 con 0x563845050f20 2024-09-19T09:38:29.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe64affd640 10 client.21513 handle_command_reply: tid=0 2024-09-19T09:38:29.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 client.21513 shutdown 2024-09-19T09:38:29.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 msgr2=0x56384503e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7fe6600103d0 tx=0x7fe660004730 comp rx=0 tx=0).stop 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 shutdown_connections 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503e4d0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x563845050f20 0x563845053330 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x563845037b40 0x56384503df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 --2- 172.21.15.52:0/2223069099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5638450365d0 0x563845040cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 >> 172.21.15.52:0/2223069099 conn(0x563844fff310 msgr2=0x563845038930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe64affd640 0 client.21513 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 shutdown_connections 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 1 -- 172.21.15.52:0/2223069099 wait complete. 2024-09-19T09:38:29.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.417+0000 7fe6742b3740 20 client.21513 trim_cache size 0 max 16384 2024-09-19T09:38:29.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 Processor -- start 2024-09-19T09:38:29.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 -- start start 2024-09-19T09:38:29.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x56384503fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845039660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1b21e0 con 0x563845037b40 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1afab0 con 0x5638450365d0 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe6742b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1ad900 con 0x563845041370 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe66b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47572/0 (socket says 172.21.15.52:47572) 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.430+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3317650187 learned_addr learned my addr 172.21.15.52:0/3317650187 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3317650187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 msgr2=0x563845039660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845039660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66affd640 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x56384503fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3317650187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 msgr2=0x56384503fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x56384503fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 -- 172.21.15.52:0/3317650187 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563845039ba0 con 0x563845037b40 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66affd640 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x56384503fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ac00 tx=0x7fe65c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9203249750a47b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe6517fa640 1 -- 172.21.15.52:0/3317650187 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00a840 con 0x563845037b40 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe6517fa640 1 -- 172.21.15.52:0/3317650187 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c02e030 con 0x563845037b40 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.431+0000 7fe6517fa640 1 -- 172.21.15.52:0/3317650187 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c004bb0 con 0x563845037b40 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- 172.21.15.52:0/3317650187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 msgr2=0x563845039120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ac00 tx=0x7fe65c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- 172.21.15.52:0/3317650187 shutdown_connections 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845041370 0x563845039660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845037b40 0x563845039120 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 --2- 172.21.15.52:0/3317650187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x56384503fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- 172.21.15.52:0/3317650187 >> 172.21.15.52:0/3317650187 conn(0x563844fff310 msgr2=0x56384503f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- 172.21.15.52:0/3317650187 shutdown_connections 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- 172.21.15.52:0/3317650187 wait complete. 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 -- start start 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.432+0000 7fe6742b3740 1 Processor -- start 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x563845049a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 0x56384503ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1adf70 con 0x563845041370 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1af3e0 con 0x5638450365d0 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1ae640 con 0x563845037b40 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe6742b3740 10 client.0 _ll_register_callbacks cb 0x7fe660012550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47588/0 (socket says 172.21.15.52:47588) 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 -- 172.21.15.52:0/883224323 learned_addr learned my addr 172.21.15.52:0/883224323 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x563845049a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 0x56384503ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 -- 172.21.15.52:0/883224323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 msgr2=0x56384503ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 0x56384503ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 -- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 msgr2=0x563845049a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x563845049a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 -- 172.21.15.52:0/883224323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56384503b6d0 con 0x563845041370 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 0x56384503ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe66affd640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fe660001eb0 tx=0x7fe66000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4edb5f9f0d955a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe64affd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.433+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6600053c0 con 0x563845041370 2024-09-19T09:38:29.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7fe660005560 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe65c02e030 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe66002ca70 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 10 client.21519 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5638450bba10 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65c02e030 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe660037070 con 0x563845041370 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 10 client.21519 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 10 client.21519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 20 client.21519 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5638450bc160 0x5638450be580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 4 client.21519 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 --> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563844fa3d70 con 0x5638450bc160 2024-09-19T09:38:29.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.434+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5638450bc160 0x5638450be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe64affd640 10 client.21519 ms_handle_connect on v2:172.21.15.86:6836/546883569 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe66b7fe640 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5638450bc160 0x5638450be580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a630c8150083ea7 server_cookie=dc00237e2a377039 in_seq=0 out_seq=0 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe64affd640 1 -- 172.21.15.52:0/883224323 <== mds.1 v2:172.21.15.86:6836/546883569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563844fa3d70 con 0x5638450bc160 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe64affd640 10 client.21519 handle_command_reply: tid=0 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 client.21519 shutdown 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 msgr2=0x56384503b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 secure :-1 s=READY pgs=2371 cs=0 l=1 rev1=1 crypto rx=0x7fe660001eb0 tx=0x7fe66000b390 comp rx=0 tx=0).stop 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 shutdown_connections 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563845041370 0x56384503b060 unknown :-1 s=CLOSED pgs=2371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x563845037b40 0x56384503ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:6836/546883569,v1:172.21.15.86:6837/546883569] conn(0x5638450bc160 0x5638450be580 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 --2- 172.21.15.52:0/883224323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x5638450365d0 0x563845049a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe64affd640 0 client.21519 ms_handle_reset on v2:172.21.15.86:6836/546883569 2024-09-19T09:38:29.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 >> 172.21.15.52:0/883224323 conn(0x563844fff310 msgr2=0x56384503fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 shutdown_connections 2024-09-19T09:38:29.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.435+0000 7fe6742b3740 1 -- 172.21.15.52:0/883224323 wait complete. 2024-09-19T09:38:29.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe6742b3740 20 client.21519 trim_cache size 0 max 16384 2024-09-19T09:38:29.446 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 msgr2=0x7fe6540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 0x7fe6540a5700 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe6640c5d00 tx=0x7fe664090440 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 msgr2=0x7fe66c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fe664003f10 tx=0x7fe664003f40 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 shutdown_connections 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe66c106f10 0x7fe66c074f70 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe66c102790 0x7fe66c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7fe6540a3240 0x7fe6540a5700 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 --2- 172.21.15.52:0/3866295381 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe66c101de0 0x7fe66c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 >> 172.21.15.52:0/3866295381 conn(0x7fe66c0fd8c0 msgr2=0x7fe66c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:29.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 shutdown_connections 2024-09-19T09:38:29.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:29.436+0000 7fe671eda640 1 -- 172.21.15.52:0/3866295381 wait complete. 2024-09-19T09:38:29.448 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:29 smithi169 ceph-mon[35454]: pgmap v849: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:29.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:29 smithi086 ceph-mon[34813]: pgmap v849: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T09:38:30.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:38:30.508 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:31.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/3895209913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a9810c170 msgr2=0x7f2a9810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/3895209913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a9810c170 0x7f2a9810e610 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009ca0 tx=0x7f2a9002a950 comp rx=0 tx=0).stop 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/3895209913 shutdown_connections 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/3895209913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a9810c170 0x7f2a9810e610 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/3895209913 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98103660 0x7f2a9810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/3895209913 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a98102d40 0x7f2a98103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/3895209913 >> 172.21.15.52:0/3895209913 conn(0x7f2a980fc7a0 msgr2=0x7f2a980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/3895209913 shutdown_connections 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.007+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/3895209913 wait complete. 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 Processor -- start 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 -- start start 2024-09-19T09:38:31.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98102d40 0x7f2a98198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a9810c170 0x7f2a9819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111f70 con 0x7f2a98103660 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a98111df0 con 0x7f2a98102d40 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9cbfa640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981120f0 con 0x7f2a9810c170 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47602/0 (socket says 172.21.15.52:47602) 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2282423750 learned_addr learned my addr 172.21.15.52:0/2282423750 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a9659c640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98102d40 0x7f2a98198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.008+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a9810c170 0x7f2a9819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2282423750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a9810c170 msgr2=0x7f2a9819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a9810c170 0x7f2a9819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2282423750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98102d40 msgr2=0x7f2a98198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98102d40 0x7f2a98198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2282423750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9819d3c0 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000d740 tx=0x7f2a8000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8f7fe640 1 -- 172.21.15.52:0/2282423750 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80017070 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8f7fe640 1 -- 172.21.15.52:0/2282423750 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8000de50 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9819d6b0 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a8f7fe640 1 -- 172.21.15.52:0/2282423750 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000f620 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.009+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a981a4f90 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.011+0000 7f2a8f7fe640 1 -- 172.21.15.52:0/2282423750 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2a80009c30 con 0x7f2a98103660 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 Processor -- start 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 -- start start 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36446090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36446a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f363ac2f0 con 0x561f36451370 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f36353cf0 con 0x561f364465d0 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561f363a82b0 con 0x561f36447b40 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a8ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47606/0 (socket says 172.21.15.52:47606) 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2494742552 learned_addr learned my addr 172.21.15.52:0/2494742552 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.012+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36446090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8f7fe640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 0x7f2a840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a9659c640 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36446a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 0x7f2a840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8f7fe640 1 -- 172.21.15.52:0/2282423750 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a800cf4b0 con 0x7f2a98103660 2024-09-19T09:38:31.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2494742552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 msgr2=0x561f36446090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36446090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2494742552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 msgr2=0x561f36446a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36446a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 -- 172.21.15.52:0/2494742552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f363383a0 con 0x561f36451370 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f2a8009ba30 tx=0x7f2a80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47662e21f0c555 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8cff9640 1 -- 172.21.15.52:0/2494742552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80020070 con 0x561f36451370 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8cff9640 1 -- 172.21.15.52:0/2494742552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8009fda0 con 0x561f36451370 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.013+0000 7f2a8cff9640 1 -- 172.21.15.52:0/2494742552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a800977f0 con 0x561f36451370 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2494742552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 msgr2=0x561f36453760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 0x7f2a840a5700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a90004ad0 tx=0x7f2a9002a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f2a8009ba30 tx=0x7f2a80005880 comp rx=0 tx=0).stop 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2494742552 shutdown_connections 2024-09-19T09:38:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f36453760 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36446a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2494742552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36446090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2494742552 >> 172.21.15.52:0/2494742552 conn(0x561f3640f310 msgr2=0x561f36442c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2494742552 shutdown_connections 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2494742552 wait complete. 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.014+0000 7f2a9efd3740 1 -- start start 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 Processor -- start 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36450de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f3644e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x561f36454010 con 0x561f36451370 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x561f36367060 con 0x561f364465d0 2024-09-19T09:38:31.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561f36454190 con 0x561f36447b40 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9efd3740 10 client.0 _ll_register_callbacks cb 0x561f360ba8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47614/0 (socket says 172.21.15.52:47614) 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 -- 172.21.15.52:0/3142927370 learned_addr learned my addr 172.21.15.52:0/3142927370 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a9659c640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36450de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f3644e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 -- 172.21.15.52:0/3142927370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 msgr2=0x561f3644e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f3644e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 -- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 msgr2=0x561f36450de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36450de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.015+0000 7f2a96d9d640 1 -- 172.21.15.52:0/3142927370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f3611d3c0 con 0x561f36451370 2024-09-19T09:38:31.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009ca0 tx=0x7f2a900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc06486ed118790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a90043050 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a90004510 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a8009fda0 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a90058030 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 10 client.21531 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561f3645fb90 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a8009fda0 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a90030440 con 0x561f36451370 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 10 client.21531 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 10 client.21531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 20 client.21531 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:31.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f36463480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 4 client.21531 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.016+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f363b9860 con 0x561f36461050 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.017+0000 7f2a9659c640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f36463480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.017+0000 7f2a9659c640 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f36463480 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7e3b950afad5ec server_cookie=9954fa22ce9364f in_seq=0 out_seq=0 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.017+0000 7f2a7dffb640 10 client.21531 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a7dffb640 1 -- 172.21.15.52:0/3142927370 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f363b9860 con 0x561f36461050 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a7dffb640 10 client.21531 handle_command_reply: tid=0 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 client.21531 shutdown 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 msgr2=0x561f3644e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009ca0 tx=0x7f2a900095c0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 shutdown_connections 2024-09-19T09:38:31.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f36463480 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f36451370 0x561f3644e7d0 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f3644e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a7dffb640 0 client.21531 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/3142927370 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f364465d0 0x561f36450de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 >> 172.21.15.52:0/3142927370 conn(0x561f3640f310 msgr2=0x561f36448960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 shutdown_connections 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 1 -- 172.21.15.52:0/3142927370 wait complete. 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.018+0000 7f2a9efd3740 20 client.21531 trim_cache size 0 max 16384 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 Processor -- start 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 -- start start 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36449120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36451370 0x561f36449660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981b0120 con 0x561f364465d0 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ad9f0 con 0x561f36451370 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ab840 con 0x561f36447b40 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47626/0 (socket says 172.21.15.52:47626) 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.031+0000 7f2a9659c640 1 -- 172.21.15.52:0/2146615709 learned_addr learned my addr 172.21.15.52:0/2146615709 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36451370 0x561f36449660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36449120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 -- 172.21.15.52:0/2146615709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 msgr2=0x561f36449120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36449120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 -- 172.21.15.52:0/2146615709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36451370 msgr2=0x561f36449660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36451370 0x561f36449660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 -- 172.21.15.52:0/2146615709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f36453ad0 con 0x561f364465d0 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a9659c640 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800bcd0 tx=0x7f2a8800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee1f1b7cc03d82d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a7ffff640 1 -- 172.21.15.52:0/2146615709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88005220 con 0x561f364465d0 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a7ffff640 1 -- 172.21.15.52:0/2146615709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a88004c80 con 0x561f364465d0 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.032+0000 7f2a7ffff640 1 -- 172.21.15.52:0/2146615709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a880267d0 con 0x561f364465d0 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2146615709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 msgr2=0x561f3645d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800bcd0 tx=0x7f2a8800b390 comp rx=0 tx=0).stop 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2146615709 shutdown_connections 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36451370 0x561f36449660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36447b40 0x561f36449120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/2146615709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f3645d300 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2146615709 >> 172.21.15.52:0/2146615709 conn(0x561f3640f310 msgr2=0x561f3644d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2146615709 shutdown_connections 2024-09-19T09:38:31.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- 172.21.15.52:0/2146615709 wait complete. 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- start start 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 Processor -- start 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36447b40 0x561f36454fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36451370 0x561f364555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981abeb0 con 0x561f364465d0 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ad320 con 0x561f36447b40 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.033+0000 7f2a9efd3740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2a981ac580 con 0x561f36451370 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9efd3740 10 client.0 _ll_register_callbacks cb 0x7f2a900098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47632/0 (socket says 172.21.15.52:47632) 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 -- 172.21.15.52:0/1593051875 learned_addr learned my addr 172.21.15.52:0/1593051875 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36447b40 0x561f36454fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a96d9d640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36451370 0x561f364555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 -- 172.21.15.52:0/1593051875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36451370 msgr2=0x561f364555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36451370 0x561f364555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 -- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36447b40 msgr2=0x561f36454fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36447b40 0x561f36454fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 -- 172.21.15.52:0/1593051875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f36455dd0 con 0x561f364465d0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9659c640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800b610 tx=0x7f2a880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9298986677dd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a88035060 con 0x561f364465d0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f2a88005020 con 0x561f364465d0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.034+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a88004c80 con 0x561f364465d0 2024-09-19T09:38:31.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2a88005220 con 0x561f364465d0 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 10 client.21537 fetch_fsmap learned FSMap version 24 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561f364cbe00 con 0x561f364465d0 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a88004c80 con 0x561f364465d0 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2a88011440 con 0x561f364465d0 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 10 client.21537 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 10 client.21537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 20 client.21537 populate_metadata read hostname 'smithi052' 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f364ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 4 client.21537 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 --> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f363b3d70 con 0x561f36461050 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.035+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f364ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a7dffb640 10 client.21537 ms_handle_connect on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:31.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a8ffff640 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f364ce450 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd002045b2a372a server_cookie=5578eade95251e16 in_seq=0 out_seq=0 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a7dffb640 1 -- 172.21.15.52:0/1593051875 <== mds.0 v2:172.21.15.86:6838/1882596213 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f363b3d70 con 0x561f36461050 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a7dffb640 10 client.21537 handle_command_reply: tid=0 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 client.21537 shutdown 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 msgr2=0x561f36459cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800b610 tx=0x7f2a880045e0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 shutdown_connections 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:6838/1882596213,v1:172.21.15.86:6839/1882596213] conn(0x561f36461050 0x561f364ce450 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561f36451370 0x561f364555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x561f36447b40 0x561f36454fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 --2- 172.21.15.52:0/1593051875 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x561f364465d0 0x561f36459cb0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 >> 172.21.15.52:0/1593051875 conn(0x561f3640f310 msgr2=0x561f3644f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a7dffb640 0 client.21537 ms_handle_reset on v2:172.21.15.86:6838/1882596213 2024-09-19T09:38:31.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 shutdown_connections 2024-09-19T09:38:31.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 1 -- 172.21.15.52:0/1593051875 wait complete. 2024-09-19T09:38:31.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.036+0000 7f2a9efd3740 20 client.21537 trim_cache size 0 max 16384 2024-09-19T09:38:31.054 INFO:teuthology.orchestra.run.smithi052.stdout:[] 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 msgr2=0x7f2a840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 0x7f2a840a5700 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2a90004ad0 tx=0x7f2a9002a950 comp rx=0 tx=0).stop 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 msgr2=0x7f2a98198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000d740 tx=0x7f2a8000dc00 comp rx=0 tx=0).stop 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 shutdown_connections 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f2a840a3240 0x7f2a840a5700 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2a9810c170 0x7f2a9819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a98103660 0x7f2a98198950 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 --2- 172.21.15.52:0/2282423750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a98102d40 0x7f2a98198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 >> 172.21.15.52:0/2282423750 conn(0x7f2a980fc7a0 msgr2=0x7f2a980fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 shutdown_connections 2024-09-19T09:38:31.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.037+0000 7f2a9cbfa640 1 -- 172.21.15.52:0/2282423750 wait complete. 2024-09-19T09:38:31.181 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:31 smithi052 ceph-mon[30947]: pgmap v850: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:31.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:31 smithi169 ceph-mon[35454]: pgmap v850: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:31.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:31 smithi086 ceph-mon[34813]: pgmap v850: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:31.801 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:38:31.802 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:38:31.802 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:38:31.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:38:31.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 -- 172.21.15.52:0/2929287492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0100a30 msgr2=0x7f7dc0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 --2- 172.21.15.52:0/2929287492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0100a30 0x7f7dc0100e30 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009900 tx=0x7f7dbc02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 -- 172.21.15.52:0/2929287492 shutdown_connections 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 --2- 172.21.15.52:0/2929287492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 0x7f7dc0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 --2- 172.21.15.52:0/2929287492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0101c20 0x7f7dc01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 --2- 172.21.15.52:0/2929287492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0100a30 0x7f7dc0100e30 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 -- 172.21.15.52:0/2929287492 >> 172.21.15.52:0/2929287492 conn(0x7f7dc00fc1b0 msgr2=0x7f7dc00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 -- 172.21.15.52:0/2929287492 shutdown_connections 2024-09-19T09:38:31.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.920+0000 7f7dc7627640 1 -- 172.21.15.52:0/2929287492 wait complete. 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 Processor -- start 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 -- start start 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 0x7f7dc0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 0x7f7dc019f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c710 con 0x7f7dc0101c20 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c590 con 0x7f7dc0100a30 2024-09-19T09:38:31.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc7627640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc010c890 con 0x7f7dc01025e0 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47664/0 (socket says 172.21.15.52:47664) 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 -- 172.21.15.52:0/369623873 learned_addr learned my addr 172.21.15.52:0/369623873 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc5bc4640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 0x7f7dc019f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 -- 172.21.15.52:0/369623873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 msgr2=0x7f7dc019f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 0x7f7dc019f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 -- 172.21.15.52:0/369623873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 msgr2=0x7f7dc0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:31.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc53c3640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 0x7f7dc0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 0x7f7dc0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 -- 172.21.15.52:0/369623873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc019fa80 con 0x7f7dc0101c20 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc53c3640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 0x7f7dc0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.921+0000 7f7dc4bc2640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b4a0 tx=0x7f7db000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.922+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0014070 con 0x7f7dc0101c20 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.922+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc019fd70 con 0x7f7dc0101c20 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.922+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db0010af0 con 0x7f7dc0101c20 2024-09-19T09:38:31.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.922+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0017d10 con 0x7f7dc0101c20 2024-09-19T09:38:31.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.922+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a02e0 con 0x7f7dc0101c20 2024-09-19T09:38:31.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.923+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc01a0570 con 0x7f7dc0101c20 2024-09-19T09:38:31.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.924+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7db0017070 con 0x7f7dc0101c20 2024-09-19T09:38:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.925+0000 7f7db67fc640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 0x7f7dac0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.925+0000 7f7dc53c3640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 0x7f7dac0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.925+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f7db00cf1b0 con 0x7f7dc0101c20 2024-09-19T09:38:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.925+0000 7f7dc53c3640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 0x7f7dac0a5710 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000c00 tx=0x7f7dbc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:31.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:31.928+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7db009be50 con 0x7f7dc0101c20 2024-09-19T09:38:32.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.104+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dc01a07e0 con 0x7f7dc0101c20 2024-09-19T09:38:32.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.105+0000 7f7db67fc640 1 -- 172.21.15.52:0/369623873 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7f7db009b750 con 0x7f7dc0101c20 2024-09-19T09:38:32.107 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:32.107 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 msgr2=0x7f7dac0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 0x7f7dac0a5710 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000c00 tx=0x7f7dbc031400 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 msgr2=0x7f7dc01983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b4a0 tx=0x7f7db000b960 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 shutdown_connections 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f7dac0a3250 0x7f7dac0a5710 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dc01025e0 0x7f7dc019f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dc0101c20 0x7f7dc01983a0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 --2- 172.21.15.52:0/369623873 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100a30 0x7f7dc0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 >> 172.21.15.52:0/369623873 conn(0x7f7dc00fc1b0 msgr2=0x7f7dc00fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 shutdown_connections 2024-09-19T09:38:32.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.107+0000 7f7dc7627640 1 -- 172.21.15.52:0/369623873 wait complete. 2024-09-19T09:38:32.120 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:14:47.724048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:19:14.651004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:19:16.771140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:38:32.121 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:38:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 -- 172.21.15.52:0/4263358996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508104f70 msgr2=0x7ff508107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 --2- 172.21.15.52:0/4263358996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508104f70 0x7ff508107360 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009900 tx=0x7ff4fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 -- 172.21.15.52:0/4263358996 shutdown_connections 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 --2- 172.21.15.52:0/4263358996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 0x7ff508109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 --2- 172.21.15.52:0/4263358996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508104f70 0x7ff508107360 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 --2- 172.21.15.52:0/4263358996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508102640 0x7ff508104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 -- 172.21.15.52:0/4263358996 >> 172.21.15.52:0/4263358996 conn(0x7ff5080fc180 msgr2=0x7ff5080fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 -- 172.21.15.52:0/4263358996 shutdown_connections 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 -- 172.21.15.52:0/4263358996 wait complete. 2024-09-19T09:38:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.227+0000 7ff50d18d640 1 Processor -- start 2024-09-19T09:38:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 -- start start 2024-09-19T09:38:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508104f70 0x7ff508198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 0x7ff50819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810d8b0 con 0x7ff508102640 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810d730 con 0x7ff5081078a0 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50d18d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff50810da30 con 0x7ff508104f70 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47674/0 (socket says 172.21.15.52:47674) 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 -- 172.21.15.52:0/3829504710 learned_addr learned my addr 172.21.15.52:0/3829504710 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50759e640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 0x7ff50819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff50659c640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508104f70 0x7ff508198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 -- 172.21.15.52:0/3829504710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508104f70 msgr2=0x7ff508198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508104f70 0x7ff508198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 -- 172.21.15.52:0/3829504710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 msgr2=0x7ff50819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 0x7ff50819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 -- 172.21.15.52:0/3829504710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50819fc40 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.228+0000 7ff506d9d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b4a0 tx=0x7ff4f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.229+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8014070 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.229+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4f8010af0 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.229+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50819ff30 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.229+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8017d10 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.229+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081a03c0 con 0x7ff508102640 2024-09-19T09:38:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.230+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5080fdc70 con 0x7ff508102640 2024-09-19T09:38:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.231+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff4f8017070 con 0x7ff508102640 2024-09-19T09:38:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.232+0000 7ff4effff640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 0x7ff4f00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.232+0000 7ff50659c640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 0x7ff4f00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.232+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7ff4f80cee70 con 0x7ff508102640 2024-09-19T09:38:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.232+0000 7ff50659c640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 0x7ff4f00a5710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.236+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4f809bab0 con 0x7ff508102640 2024-09-19T09:38:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.410+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff508062e90 con 0x7ff508102640 2024-09-19T09:38:32.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.410+0000 7ff4effff640 1 -- 172.21.15.52:0/3829504710 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7ff4f809b3b0 con 0x7ff508102640 2024-09-19T09:38:32.412 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 msgr2=0x7ff4f00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 0x7ff4f00a5710 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc006010 tx=0x7ff4fc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 msgr2=0x7ff508198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b4a0 tx=0x7ff4f800b960 comp rx=0 tx=0).stop 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 shutdown_connections 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5081078a0 0x7ff50819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7ff4f00a3250 0x7ff4f00a5710 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff508104f70 0x7ff508198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 --2- 172.21.15.52:0/3829504710 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff508102640 0x7ff508198020 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 >> 172.21.15.52:0/3829504710 conn(0x7ff5080fc180 msgr2=0x7ff5081030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 shutdown_connections 2024-09-19T09:38:32.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.412+0000 7ff50d18d640 1 -- 172.21.15.52:0/3829504710 wait complete. 2024-09-19T09:38:32.423 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:32 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/369623873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:32.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:38:32.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:32 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/369623873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:32.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:32 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/369623873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 -- 172.21.15.52:0/906041032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 msgr2=0x7f8498105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 --2- 172.21.15.52:0/906041032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f8498105160 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f8488009900 tx=0x7f848802a410 comp rx=0 tx=0).stop 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 -- 172.21.15.52:0/906041032 shutdown_connections 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 --2- 172.21.15.52:0/906041032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 0x7f8498105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 --2- 172.21.15.52:0/906041032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f8498105160 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 --2- 172.21.15.52:0/906041032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 0x7f84981027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 -- 172.21.15.52:0/906041032 >> 172.21.15.52:0/906041032 conn(0x7f84980fc1b0 msgr2=0x7f84980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 -- 172.21.15.52:0/906041032 shutdown_connections 2024-09-19T09:38:32.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.529+0000 7f849f51f640 1 -- 172.21.15.52:0/906041032 wait complete. 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 Processor -- start 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 -- start start 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 0x7f849819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 0x7f84981a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8498113de0 con 0x7f8498102cf0 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8498113c60 con 0x7f84981056a0 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849f51f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f8498113f60 con 0x7f84981003a0 2024-09-19T09:38:32.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47702/0 (socket says 172.21.15.52:47702) 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 -- 172.21.15.52:0/1228791398 learned_addr learned my addr 172.21.15.52:0/1228791398 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849d2bb640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 0x7f849819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849dabc640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 0x7f84981a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 -- 172.21.15.52:0/1228791398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 msgr2=0x7f849819e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 0x7f849819e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 -- 172.21.15.52:0/1228791398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 msgr2=0x7f84981a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 0x7f84981a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.530+0000 7f849caba640 1 -- 172.21.15.52:0/1228791398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84981a6140 con 0x7f8498102cf0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f849caba640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f8488005940 tx=0x7f8488004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848803f030 con 0x7f8498102cf0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84981a63d0 con 0x7f8498102cf0 2024-09-19T09:38:32.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8488003ce0 con 0x7f8498102cf0 2024-09-19T09:38:32.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488035070 con 0x7f8498102cf0 2024-09-19T09:38:32.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.531+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84981a68e0 con 0x7f8498102cf0 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.532+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84980fdca0 con 0x7f8498102cf0 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.533+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8488042030 con 0x7f8498102cf0 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.534+0000 7f848e7fc640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 0x7f84840a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.534+0000 7f849d2bb640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 0x7f84840a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.534+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f84880f02f0 con 0x7f8498102cf0 2024-09-19T09:38:32.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.534+0000 7f849d2bb640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 0x7f84840a5710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f84940058c0 tx=0x7f849400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.538+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84880bc8e0 con 0x7f8498102cf0 2024-09-19T09:38:32.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.714+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8498062df0 con 0x7f8498102cf0 2024-09-19T09:38:32.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.714+0000 7f848e7fc640 1 -- 172.21.15.52:0/1228791398 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f84880c0be0 con 0x7f8498102cf0 2024-09-19T09:38:32.716 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-09-19T09:38:32.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.716+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 msgr2=0x7f84840a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.716+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 0x7f84840a5710 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f84940058c0 tx=0x7f849400a250 comp rx=0 tx=0).stop 2024-09-19T09:38:32.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.716+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 msgr2=0x7f849819ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.716+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f8488005940 tx=0x7f8488004360 comp rx=0 tx=0).stop 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 shutdown_connections 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84981056a0 0x7f84981a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8498102cf0 0x7f849819ea60 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84840a3250 0x7f84840a5710 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 --2- 172.21.15.52:0/1228791398 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84981003a0 0x7f849819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 >> 172.21.15.52:0/1228791398 conn(0x7f84980fc1b0 msgr2=0x7f8498100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 shutdown_connections 2024-09-19T09:38:32.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.717+0000 7f849f51f640 1 -- 172.21.15.52:0/1228791398 wait complete. 2024-09-19T09:38:32.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:38:32.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 -- 172.21.15.52:0/3830528459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac1025b0 msgr2=0x7f84ac108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3830528459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac1025b0 0x7f84ac108e40 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009ca0 tx=0x7f84a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 -- 172.21.15.52:0/3830528459 shutdown_connections 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3830528459 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac1025b0 0x7f84ac108e40 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3830528459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 0x7f84ac102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3830528459 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac100a00 0x7f84ac100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 -- 172.21.15.52:0/3830528459 >> 172.21.15.52:0/3830528459 conn(0x7f84ac0fc140 msgr2=0x7f84ac0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 -- 172.21.15.52:0/3830528459 shutdown_connections 2024-09-19T09:38:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 -- 172.21.15.52:0/3830528459 wait complete. 2024-09-19T09:38:32.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.835+0000 7f84b10f1640 1 Processor -- start 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 -- start start 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 0x7f84ac198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 0x7f84ac19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac10c660 con 0x7f84ac100a00 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac10c4e0 con 0x7f84ac1025b0 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84b10f1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac10c7e0 con 0x7f84ac101bf0 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47718/0 (socket says 172.21.15.52:47718) 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 -- 172.21.15.52:0/3159769632 learned_addr learned my addr 172.21.15.52:0/3159769632 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:32.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84ab59e640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 0x7f84ac19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aa59c640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 0x7f84ac198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 -- 172.21.15.52:0/3159769632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 msgr2=0x7f84ac198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 0x7f84ac198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 -- 172.21.15.52:0/3159769632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 msgr2=0x7f84ac19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 0x7f84ac19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 -- 172.21.15.52:0/3159769632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac19fa20 con 0x7f84ac100a00 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84ab59e640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 0x7f84ac19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.836+0000 7f84aad9d640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f849c00e9c0 tx=0x7f849c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.837+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c00cd80 con 0x7f84ac100a00 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.837+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac19fd10 con 0x7f84ac100a00 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.837+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f849c0035f0 con 0x7f84ac100a00 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.837+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c010690 con 0x7f84ac100a00 2024-09-19T09:38:32.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.837+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac1a01b0 con 0x7f84ac100a00 2024-09-19T09:38:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.838+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac1a0440 con 0x7f84ac100a00 2024-09-19T09:38:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.839+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f849c0037a0 con 0x7f84ac100a00 2024-09-19T09:38:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.840+0000 7f8493fff640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.840+0000 7f84aa59c640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:32.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.840+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f849c0cfee0 con 0x7f84ac100a00 2024-09-19T09:38:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.841+0000 7f84aa59c640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 0x7f84940a5710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f84ac199310 tx=0x7f84a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:32.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:32.845+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f849c09cb80 con 0x7f84ac100a00 2024-09-19T09:38:33.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.020+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f84ac1a0d30 con 0x7f84ac100a00 2024-09-19T09:38:33.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.020+0000 7f8493fff640 1 -- 172.21.15.52:0/3159769632 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f849c09c480 con 0x7f84ac100a00 2024-09-19T09:38:33.022 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 msgr2=0x7f84940a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 0x7f84940a5710 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f84ac199310 tx=0x7f84a0005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 msgr2=0x7f84ac197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f849c00e9c0 tx=0x7f849c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 shutdown_connections 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84ac1025b0 0x7f84ac19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f84940a3250 0x7f84940a5710 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f84ac101bf0 0x7f84ac198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 --2- 172.21.15.52:0/3159769632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84ac100a00 0x7f84ac197e00 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 >> 172.21.15.52:0/3159769632 conn(0x7f84ac0fc140 msgr2=0x7f84ac0693b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 shutdown_connections 2024-09-19T09:38:33.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.022+0000 7f84b10f1640 1 -- 172.21.15.52:0/3159769632 wait complete. 2024-09-19T09:38:33.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:38:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 -- 172.21.15.52:0/1826367332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c1025e0 msgr2=0x7f342c108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 --2- 172.21.15.52:0/1826367332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c1025e0 0x7f342c108e70 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ca0 tx=0x7f342402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 -- 172.21.15.52:0/1826367332 shutdown_connections 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 --2- 172.21.15.52:0/1826367332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c1025e0 0x7f342c108e70 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 --2- 172.21.15.52:0/1826367332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c101c20 0x7f342c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 --2- 172.21.15.52:0/1826367332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c100a30 0x7f342c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 -- 172.21.15.52:0/1826367332 >> 172.21.15.52:0/1826367332 conn(0x7f342c0fc1b0 msgr2=0x7f342c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 -- 172.21.15.52:0/1826367332 shutdown_connections 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.137+0000 7f3433742640 1 -- 172.21.15.52:0/1826367332 wait complete. 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 Processor -- start 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 -- start start 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c100a30 0x7f342c06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c1025e0 0x7f342c19f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f342c10c690 con 0x7f342c101c20 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f342c10c510 con 0x7f342c1025e0 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3433742640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f342c10c810 con 0x7f342c100a30 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3430cdd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3430cdd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47744/0 (socket says 172.21.15.52:47744) 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.138+0000 7f3430cdd640 1 -- 172.21.15.52:0/3359344350 learned_addr learned my addr 172.21.15.52:0/3359344350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3431cdf640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c1025e0 0x7f342c19f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f34314de640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c100a30 0x7f342c06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 -- 172.21.15.52:0/3359344350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c100a30 msgr2=0x7f342c06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c100a30 0x7f342c06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 -- 172.21.15.52:0/3359344350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c1025e0 msgr2=0x7f342c19f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:33.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c1025e0 0x7f342c19f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 -- 172.21.15.52:0/3359344350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c19fa30 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3430cdd640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f341c00d950 tx=0x7f341c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c017030 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342c19fcc0 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f341c004020 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0047a0 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.139+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342c1a01c0 con 0x7f342c101c20 2024-09-19T09:38:33.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.140+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c107d70 con 0x7f342c101c20 2024-09-19T09:38:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.141+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f341c0041d0 con 0x7f342c101c20 2024-09-19T09:38:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.142+0000 7f34227fc640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 0x7f34180a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.142+0000 7f34314de640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 0x7f34180a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.142+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f341c0cf3d0 con 0x7f342c101c20 2024-09-19T09:38:33.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.142+0000 7f34314de640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 0x7f34180a5710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3428005fd0 tx=0x7f3428005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.146+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f341c09c010 con 0x7f342c101c20 2024-09-19T09:38:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.373+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f342c062e90 con 0x7f342c101c20 2024-09-19T09:38:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.381+0000 7f34227fc640 1 -- 172.21.15.52:0/3359344350 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742339 (secure 0 0 0) 0x7f341c09b910 con 0x7f342c101c20 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 18, 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "active_gid": 14150, 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "active_name": "x", 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "active_addrs": { 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.393 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:6800", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2340346787 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:6801", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2340346787 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "active_addr": "172.21.15.52:6801/2340346787", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "active_change": "2024-09-19T09:12:31.197787+0000", 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "available": true, 2024-09-19T09:38:33.394 INFO:teuthology.orchestra.run.smithi052.stdout: "standbys": [ 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "gid": 24106, 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "z", 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "available_modules": [ 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "alerts", 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.395 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.396 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.397 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.398 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.399 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.400 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.401 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_destination": { 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_destination", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.402 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_from_name": { 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_from_name", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "Ceph", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.403 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email From: name", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_host": { 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_host", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP server", 2024-09-19T09:38:33.404 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_password": { 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_password", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.405 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Password to authenticate with", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_port": { 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_port", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "465", 2024-09-19T09:38:33.406 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP port", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_sender": { 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_sender", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.407 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_ssl": { 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_ssl", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.408 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_user": { 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_user", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.409 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "User to authenticate as", 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.410 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "balancer", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "active": { 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "active", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.411 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_time": { 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_time", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.412 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0000", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_weekday": { 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_weekday", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.413 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_max_iterations": { 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.414 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "25", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "250", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_metrics": { 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_metrics", 2024-09-19T09:38:33.415 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_step": { 2024-09-19T09:38:33.416 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_step", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.5", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0.001", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "0.999", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.417 INFO:teuthology.orchestra.run.smithi052.stdout: "end_time": { 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_time", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2359", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.418 INFO:teuthology.orchestra.run.smithi052.stdout: "end_weekday": { 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_weekday", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.419 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.420 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.421 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.422 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.423 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.424 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "min_score": { 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_score", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.425 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.426 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "upmap", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-compat", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "none", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "read", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap-read" 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Balancer mode", 2024-09-19T09:38:33.427 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_ids": { 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_ids", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.428 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.429 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_deviation": { 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_deviation", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.430 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_optimizations": { 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:38:33.431 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm", 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_down_multiplier": { 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_down_multiplier", 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.432 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_refresh_rate": { 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_refresh_rate", 2024-09-19T09:38:33.433 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "20", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_starting_port": { 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_starting_port", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.434 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4721", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_ptrace": { 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_ptrace", 2024-09-19T09:38:33.435 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.436 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_interval": { 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_interval", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.437 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.7", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:38:33.438 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_log_destination": { 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm_log_destination", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.439 INFO:teuthology.orchestra.run.smithi052.stdout: "file", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "file,syslog", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "syslog" 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "cgroups_split": { 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cgroups_split", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.440 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "config_checks_enabled": { 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_checks_enabled", 2024-09-19T09:38:33.441 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "config_dashboard": { 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_dashboard", 2024-09-19T09:38:33.442 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_alertmanager": { 2024-09-19T09:38:33.443 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_alertmanager", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.444 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_base": { 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_base", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.445 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_elasticsearch": { 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "elasticsearch container image", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.446 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_grafana": { 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_grafana", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.447 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_haproxy": { 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_haproxy", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "HAproxy container image", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.448 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_agent": { 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.449 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_collector": { 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.450 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_query": { 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.451 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger query container image", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_keepalived": { 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_keepalived", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.452 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Keepalived container image", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_loki": { 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_loki", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.453 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Loki container image", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_node_exporter": { 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_node_exporter", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.454 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_nvmeof": { 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_nvmeof", 2024-09-19T09:38:33.455 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Nvme-of container image", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_prometheus": { 2024-09-19T09:38:33.456 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_prometheus", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_promtail": { 2024-09-19T09:38:33.457 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_promtail", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Promtail container image", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.458 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_samba": { 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_samba", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.459 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_snmp_gateway": { 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "container_init": { 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_init", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.461 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "daemon_cache_timeout": { 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.462 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "900", 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.463 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "default_registry": { 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_registry", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.464 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "device_cache_timeout": { 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_cache_timeout", 2024-09-19T09:38:33.465 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1800", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "device_enhanced_scan": { 2024-09-19T09:38:33.466 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_enhanced_scan", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "facts_cache_timeout": { 2024-09-19T09:38:33.467 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "facts_cache_timeout", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.468 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "grafana_dashboards_path": { 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.469 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "host_check_interval": { 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "host_check_interval", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.470 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "hw_monitoring": { 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hw_monitoring", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.471 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "inventory_list_all": { 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "inventory_list_all", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.472 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.473 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.474 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "log_refresh_metadata": { 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_refresh_metadata", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.475 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.476 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.477 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.478 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.479 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.480 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "*", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "max_count_per_host": { 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_count_per_host", 2024-09-19T09:38:33.481 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd_draining_count": { 2024-09-19T09:38:33.482 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_osd_draining_count", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "migration_current": { 2024-09-19T09:38:33.483 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "migration_current", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "internal - do not modify", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.484 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "root", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm-package", 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "root" 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.485 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "oob_default_addr": { 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "oob_default_addr", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "169.254.1.1", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.486 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "prometheus_alerts_path": { 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.487 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_insecure": { 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_insecure", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.488 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_password": { 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_password", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.489 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_url": { 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_url", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.490 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_username": { 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_username", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.491 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "secure_monitoring_stack": { 2024-09-19T09:38:33.492 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.493 INFO:teuthology.orchestra.run.smithi052.stdout: "service_discovery_port": { 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "service_discovery_port", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8765", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.494 INFO:teuthology.orchestra.run.smithi052.stdout: "ssh_config_file": { 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssh_config_file", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.495 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "use_agent": { 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_agent", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.496 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "use_repo_digest": { 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_repo_digest", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.497 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_failed_host_check": { 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.498 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_daemons": { 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.499 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_hosts": { 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.500 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crash", 2024-09-19T09:38:33.501 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.502 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.504 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.505 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.506 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.507 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "retain_interval": { 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retain_interval", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "31536000", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:38:33.508 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_recent_interval": { 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_recent_interval", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1209600", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.509 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dashboard", 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.511 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.512 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:38:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:38:33.514 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.515 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.516 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.517 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.518 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.519 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.520 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.521 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:38:33.522 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.523 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.524 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.525 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.526 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.527 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.528 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_URL": { 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.529 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.530 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.531 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.532 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:38:33.533 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.534 INFO:teuthology.orchestra.run.smithi052.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.535 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.536 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.537 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.538 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.539 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:38:33.540 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.541 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.542 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.543 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.544 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.545 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.546 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.547 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.548 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.549 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:38:33.550 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "45", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.551 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.552 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.553 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:38:33.554 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.556 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.557 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.558 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:38:33.559 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.560 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "cross_origin_url": { 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cross_origin_url", 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.561 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "crt_file": { 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crt_file", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.562 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "debug": { 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "debug", 2024-09-19T09:38:33.563 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "jwt_token_ttl": { 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "jwt_token_ttl", 2024-09-19T09:38:33.564 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "28800", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.567 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.568 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.569 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.570 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.571 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "motd": { 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "motd", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.572 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "The message of the day", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.573 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.574 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.575 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8080", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.576 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.577 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl_server_port": { 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl_server_port", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8443", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.578 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "redirect", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect" 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.579 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:33.580 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "url_prefix": { 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url_prefix", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.581 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "devicehealth", 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.582 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_monitoring": { 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_monitoring", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "monitor device health metrics", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.583 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.584 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.585 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.586 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.587 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.588 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mark_out_threshold": { 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mark_out_threshold", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2419200", 2024-09-19T09:38:33.589 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": { 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_name", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "device_health_metrics", 2024-09-19T09:38:33.590 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "retention_period": { 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retention_period", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15552000", 2024-09-19T09:38:33.591 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_frequency": { 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_frequency", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "self_heal": { 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "self_heal", 2024-09-19T09:38:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_threshold": { 2024-09-19T09:38:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_threshold", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7257600", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "diskprediction_local", 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "predict_interval": { 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predict_interval", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "predictor_model": { 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predictor_model", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "prophetstor", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.604 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.605 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "influx", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": false, 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "batch_size": { 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "batch_size", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5000", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.606 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "database": { 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "database", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "ceph", 2024-09-19T09:38:33.607 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": { 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hostname", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.608 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.609 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "30", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "5", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.610 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.611 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.613 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.614 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.615 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "password": { 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "password", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.616 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "port": { 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "port", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.617 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8086", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server port", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.618 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "false", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "threads": { 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threads", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.619 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "32", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "username": { 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "username", 2024-09-19T09:38:33.620 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "verify_ssl": { 2024-09-19T09:38:33.621 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "verify_ssl", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "true", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.622 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "insights", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.623 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.624 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.626 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.627 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "iostat", 2024-09-19T09:38:33.628 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.629 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.630 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.631 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.632 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.633 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.634 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "k8sevents", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_event_retention_days": { 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.635 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "config_check_secs": { 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_check_secs", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.636 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "10", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.637 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.638 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.639 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.640 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.641 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.642 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "localpool", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "failure_domain": { 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "failure_domain", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "host", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.643 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.644 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.645 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.646 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.647 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.648 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": { 2024-09-19T09:38:33.649 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_size", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.650 INFO:teuthology.orchestra.run.smithi052.stdout: "num_rep": { 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "num_rep", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.651 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": { 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_num", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "128", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.652 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "prefix": { 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prefix", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:38:33.653 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "subtree": { 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "subtree", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "rack", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.654 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mds_autoscaler", 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.655 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.657 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.659 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.660 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirroring", 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.661 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.662 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.663 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.664 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.665 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.666 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "nfs", 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.667 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.668 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.669 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.670 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.671 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.672 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:33.673 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fail_fs": { 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "fail_fs", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:38:33.674 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.675 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.676 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.677 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.678 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.679 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator": { 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.680 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "rook", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "test_orchestrator" 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Orchestrator backend", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.681 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_perf_query", 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.682 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.683 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.684 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.685 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.686 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.687 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_support", 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.688 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.689 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.690 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.691 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.692 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.693 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_autoscaler", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.694 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.695 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.697 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.698 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.699 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.700 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "threshold": { 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threshold", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1.0", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "scaling threshold", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.701 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "progress", 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_pg_recovery_event": { 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.702 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:33.703 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.704 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.705 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.706 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.707 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.708 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.709 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "max_completed_events": { 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_completed_events", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "50", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.710 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.711 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus", 2024-09-19T09:38:33.712 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "cache": { 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cache", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.713 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "exclude_perf_counters": { 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "exclude_perf_counters", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:38:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.715 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.716 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.717 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.718 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.719 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools": { 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools", 2024-09-19T09:38:33.720 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:38:33.721 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "300", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_interval": { 2024-09-19T09:38:33.722 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_interval", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15.0", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.723 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.724 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "9283", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.725 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "stale_cache_strategy": { 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stale_cache_strategy", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "log", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.726 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "default", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.727 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "default", 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "error" 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.728 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.729 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_support", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.730 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.731 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.732 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.733 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.734 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_snap_create": { 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.735 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.736 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "trash_purge_schedule": { 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "trash_purge_schedule", 2024-09-19T09:38:33.737 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.738 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "restful", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_auth": { 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_auth", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.739 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.740 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.741 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.742 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.743 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.744 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.745 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.746 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.747 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.748 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rgw", 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.749 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.750 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.751 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.752 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.753 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.754 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.755 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rook", 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.756 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.757 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.758 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.759 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.760 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.761 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "storage_class": { 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "storage_class", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "local", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.762 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "selftest", 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.763 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.764 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.765 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.766 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.767 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.768 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "roption1": { 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption1", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.769 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "roption2": { 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption2", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "xyz", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.770 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption1": { 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption1", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.771 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption2": { 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption2", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.772 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption3": { 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption3", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.773 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption4": { 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption4", 2024-09-19T09:38:33.774 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption5": { 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption5", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.776 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption6": { 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption6", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.777 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption7": { 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption7", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "42", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.778 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "testkey": { 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testkey", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.779 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "testlkey": { 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testlkey", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.780 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "testnewline": { 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testnewline", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.781 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snap_schedule", 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_m_granularity": { 2024-09-19T09:38:33.782 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_m_granularity", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.783 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "dump_on_update": { 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dump_on_update", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.784 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.785 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.786 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.787 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.788 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.789 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stats", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.790 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.791 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.792 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.793 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.794 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.795 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "status", 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.796 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.797 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.798 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.799 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.800 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.801 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telegraf", 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "address": { 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "address", 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.802 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.803 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.804 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.805 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.806 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.807 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.808 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.809 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.809 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.809 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.812 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telemetry", 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.813 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_basic": { 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_basic", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.814 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_crash": { 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_crash", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.815 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_device": { 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_device", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.816 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_ident": { 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_ident", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.817 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_perf": { 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_perf", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.818 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "contact": { 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "contact", 2024-09-19T09:38:33.819 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "description": { 2024-09-19T09:38:33.820 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "description", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "device_url": { 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_url", 2024-09-19T09:38:33.821 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.823 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "24", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "8", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.824 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "last_opt_revision": { 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "last_opt_revision", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.825 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard": { 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard_description": { 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard_description", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.827 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.828 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.829 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.830 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.831 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.832 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "organization": { 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "organization", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.833 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "proxy": { 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "proxy", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.834 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "url": { 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.835 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "test_orchestrator", 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.836 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.837 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.838 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.839 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.840 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.841 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "volumes", 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.842 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.843 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.844 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.845 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.846 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.847 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_clones": { 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_clones", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.848 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "periodic_async_work": { 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "periodic_async_work", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Periodically check for async work", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.849 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_delay": { 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:38:33.850 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.851 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix", 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.852 INFO:teuthology.orchestra.run.smithi052.stdout: "discovery_interval": { 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "discovery_interval", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "100", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.853 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "identifier": { 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "identifier", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.854 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.855 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.856 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.857 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.858 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.859 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.860 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_host": { 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_host", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.861 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_port": { 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_port", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10051", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.862 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_sender": { 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_sender", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.863 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:33.864 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "gid": 24110, 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "y", 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "available_modules": [ 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "alerts", 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:33.865 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.866 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.867 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.868 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.869 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.870 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.871 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_destination": { 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_destination", 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.872 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_from_name": { 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_from_name", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.873 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "Ceph", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email From: name", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_host": { 2024-09-19T09:38:33.874 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_host", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP server", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.875 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_password": { 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_password", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Password to authenticate with", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.876 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_port": { 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_port", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "465", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP port", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.877 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_sender": { 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_sender", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:38:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_ssl": { 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_ssl", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_user": { 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_user", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "User to authenticate as", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.880 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "balancer", 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "active": { 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "active", 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.881 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_time": { 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_time", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.882 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0000", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_weekday": { 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_weekday", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.883 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_max_iterations": { 2024-09-19T09:38:33.884 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "25", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "250", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.885 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_metrics": { 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_metrics", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.886 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_step": { 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_step", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.5", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0.001", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "0.999", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.887 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "end_time": { 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_time", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2359", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.888 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "end_weekday": { 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_weekday", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:33.889 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.890 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.891 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.892 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.893 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.894 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "min_score": { 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_score", 2024-09-19T09:38:33.895 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:33.896 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "upmap", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-compat", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "none", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "read", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap", 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap-read" 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.897 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Balancer mode", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_ids": { 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_ids", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.898 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.899 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_deviation": { 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_deviation", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:33.900 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_optimizations": { 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.901 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm", 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_down_multiplier": { 2024-09-19T09:38:33.902 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_down_multiplier", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_refresh_rate": { 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_refresh_rate", 2024-09-19T09:38:33.903 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "20", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_starting_port": { 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_starting_port", 2024-09-19T09:38:33.904 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4721", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.905 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_ptrace": { 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_ptrace", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.906 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_interval": { 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_interval", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.907 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.7", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.908 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_log_destination": { 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm_log_destination", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.909 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "file", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "file,syslog", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "syslog" 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "cgroups_split": { 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cgroups_split", 2024-09-19T09:38:33.910 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "config_checks_enabled": { 2024-09-19T09:38:33.911 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_checks_enabled", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.912 INFO:teuthology.orchestra.run.smithi052.stdout: "config_dashboard": { 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_dashboard", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.913 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_alertmanager": { 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_alertmanager", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.914 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_base": { 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_base", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.915 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_elasticsearch": { 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.916 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "elasticsearch container image", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_grafana": { 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_grafana", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.917 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_haproxy": { 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_haproxy", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.918 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "HAproxy container image", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_agent": { 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.919 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_collector": { 2024-09-19T09:38:33.920 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:38:33.921 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_query": { 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.922 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger query container image", 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_keepalived": { 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_keepalived", 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.923 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Keepalived container image", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_loki": { 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_loki", 2024-09-19T09:38:33.924 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Loki container image", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.925 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_node_exporter": { 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_node_exporter", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.926 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_nvmeof": { 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_nvmeof", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Nvme-of container image", 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_prometheus": { 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_prometheus", 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_promtail": { 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_promtail", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.929 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Promtail container image", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_samba": { 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_samba", 2024-09-19T09:38:33.930 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_snmp_gateway": { 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:38:33.931 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.932 INFO:teuthology.orchestra.run.smithi052.stdout: "container_init": { 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_init", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.933 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "daemon_cache_timeout": { 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.934 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "900", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.935 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "default_registry": { 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_registry", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.936 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "device_cache_timeout": { 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_cache_timeout", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1800", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.937 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "device_enhanced_scan": { 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_enhanced_scan", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.938 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "facts_cache_timeout": { 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "facts_cache_timeout", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.939 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "grafana_dashboards_path": { 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:38:33.940 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "host_check_interval": { 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "host_check_interval", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.941 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "hw_monitoring": { 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hw_monitoring", 2024-09-19T09:38:33.942 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "inventory_list_all": { 2024-09-19T09:38:33.943 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "inventory_list_all", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.944 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.945 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "log_refresh_metadata": { 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_refresh_metadata", 2024-09-19T09:38:33.946 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.947 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.948 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.949 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.952 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.953 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:38:33.954 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "*", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:38:33.955 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "max_count_per_host": { 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_count_per_host", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.956 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd_draining_count": { 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_osd_draining_count", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.957 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "migration_current": { 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "migration_current", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.958 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "internal - do not modify", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "root", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.959 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm-package", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "root" 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "oob_default_addr": { 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "oob_default_addr", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.960 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "169.254.1.1", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "prometheus_alerts_path": { 2024-09-19T09:38:33.961 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.962 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_insecure": { 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_insecure", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.963 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_password": { 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_password", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:38:33.964 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_url": { 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_url", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.965 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_username": { 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_username", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.966 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "secure_monitoring_stack": { 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.967 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "service_discovery_port": { 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "service_discovery_port", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.968 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8765", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "ssh_config_file": { 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssh_config_file", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.969 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "use_agent": { 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_agent", 2024-09-19T09:38:33.970 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "use_repo_digest": { 2024-09-19T09:38:33.971 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_repo_digest", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.972 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_failed_host_check": { 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.973 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_daemons": { 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.974 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_hosts": { 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.975 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crash", 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.976 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.977 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.978 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.980 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.981 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "retain_interval": { 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retain_interval", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "31536000", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.982 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_recent_interval": { 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_recent_interval", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1209600", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.983 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dashboard", 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:33.984 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.985 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:33.986 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.987 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.988 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:38:33.989 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:38:33.990 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.991 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.992 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.993 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.994 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.995 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.996 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.997 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.998 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:33.999 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.000 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.001 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_URL": { 2024-09-19T09:38:34.002 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.003 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.004 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.005 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.006 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.007 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.008 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.009 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.010 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.011 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.012 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.013 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:38:34.014 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.015 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.016 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.017 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.018 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.019 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.020 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.021 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.022 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "45", 2024-09-19T09:38:34.023 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.024 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.025 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:38:34.026 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:38:34.027 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.028 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.029 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.030 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.031 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "cross_origin_url": { 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cross_origin_url", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.032 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "crt_file": { 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crt_file", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.033 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "debug": { 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "debug", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.034 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "jwt_token_ttl": { 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "jwt_token_ttl", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "28800", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.035 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.036 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.037 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.038 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.039 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.040 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.041 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "motd": { 2024-09-19T09:38:34.042 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "motd", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "The message of the day", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.043 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.044 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.045 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8080", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.046 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.047 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl_server_port": { 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl_server_port", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8443", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.048 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "redirect", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.049 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect" 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:34.050 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "url_prefix": { 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url_prefix", 2024-09-19T09:38:34.051 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.052 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "devicehealth", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_monitoring": { 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_monitoring", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.053 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "monitor device health metrics", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.054 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.055 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.056 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.057 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.058 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "mark_out_threshold": { 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mark_out_threshold", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.059 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2419200", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": { 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_name", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.060 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "device_health_metrics", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "retention_period": { 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retention_period", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.061 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15552000", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_frequency": { 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_frequency", 2024-09-19T09:38:34.062 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "self_heal": { 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "self_heal", 2024-09-19T09:38:34.063 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.064 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.065 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_threshold": { 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_threshold", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7257600", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.066 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "diskprediction_local", 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.067 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.068 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.069 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.070 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.071 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "predict_interval": { 2024-09-19T09:38:34.072 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predict_interval", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "predictor_model": { 2024-09-19T09:38:34.073 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predictor_model", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "prophetstor", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.074 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.075 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "influx", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": false, 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "batch_size": { 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "batch_size", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5000", 2024-09-19T09:38:34.076 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "database": { 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "database", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.077 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "ceph", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": { 2024-09-19T09:38:34.078 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hostname", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.079 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "30", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "5", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.080 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.081 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.082 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.083 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.084 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.085 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "password": { 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "password", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.086 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "port": { 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "port", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.087 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8086", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server port", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:34.088 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "false", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "threads": { 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threads", 2024-09-19T09:38:34.089 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "32", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "username": { 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "username", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.090 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "verify_ssl": { 2024-09-19T09:38:34.091 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "verify_ssl", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "true", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.092 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "insights", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.093 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.094 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.095 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.096 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.097 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.098 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "iostat", 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.099 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.100 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.101 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.102 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.103 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.104 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "k8sevents", 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_event_retention_days": { 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.105 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "config_check_secs": { 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_check_secs", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.106 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "10", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.107 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.108 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.109 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.110 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.111 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "localpool", 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.113 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "failure_domain": { 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "failure_domain", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "host", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.114 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.115 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.116 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.117 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.118 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.119 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": { 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_size", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.120 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "num_rep": { 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "num_rep", 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.121 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": { 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_num", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.122 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "128", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "prefix": { 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prefix", 2024-09-19T09:38:34.123 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "subtree": { 2024-09-19T09:38:34.124 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "subtree", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "rack", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.125 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mds_autoscaler", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.126 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.127 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.128 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.129 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.130 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.131 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirroring", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.132 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.133 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.134 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.135 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.136 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.137 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "nfs", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.138 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.139 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.140 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.141 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.142 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.143 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "fail_fs": { 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "fail_fs", 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.144 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.145 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.146 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.147 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.148 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.149 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.150 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator": { 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "rook", 2024-09-19T09:38:34.151 INFO:teuthology.orchestra.run.smithi052.stdout: "test_orchestrator" 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Orchestrator backend", 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_perf_query", 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.152 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.153 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.154 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.155 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.156 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.157 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.158 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_support", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.159 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.160 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.161 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.162 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.163 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_autoscaler", 2024-09-19T09:38:34.164 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.165 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.166 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.167 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.168 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.169 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.170 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "threshold": { 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threshold", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.171 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1.0", 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "scaling threshold", 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.172 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "progress", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_pg_recovery_event": { 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.173 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.174 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.175 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.176 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.178 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.179 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.180 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "max_completed_events": { 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_completed_events", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "50", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.181 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.182 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.183 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "cache": { 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cache", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.184 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "exclude_perf_counters": { 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "exclude_perf_counters", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.185 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.186 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.187 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.188 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.189 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.190 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools": { 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.191 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "300", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_interval": { 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_interval", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15.0", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.193 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.194 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "9283", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:38:34.195 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "stale_cache_strategy": { 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stale_cache_strategy", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "log", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.196 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "default", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.197 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "default", 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "error" 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:34.198 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_support", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.200 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.201 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.202 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.203 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.204 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_snap_create": { 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.205 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.206 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "trash_purge_schedule": { 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "trash_purge_schedule", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.207 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.208 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "restful", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_auth": { 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_auth", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.209 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.210 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.211 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.213 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.214 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.215 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.216 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.217 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.218 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rgw", 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.220 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.221 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.222 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.223 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.224 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.225 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.226 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rook", 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.227 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.228 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.229 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.230 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.231 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.232 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "storage_class": { 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "storage_class", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "local", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:38:34.233 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "selftest", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.234 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.235 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.236 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.237 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.238 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "roption1": { 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption1", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.239 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "roption2": { 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption2", 2024-09-19T09:38:34.240 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "xyz", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.241 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption1": { 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption1", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.242 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption2": { 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption2", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption3": { 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption3", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption4": { 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption4", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.245 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption5": { 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption5", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.246 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption6": { 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption6", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.247 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption7": { 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption7", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "42", 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.248 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "testkey": { 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testkey", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.249 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "testlkey": { 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testlkey", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.250 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "testnewline": { 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testnewline", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.251 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.252 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snap_schedule", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_m_granularity": { 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_m_granularity", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.253 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "dump_on_update": { 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dump_on_update", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.254 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.255 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.256 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.257 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.258 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.259 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.260 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stats", 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.261 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.262 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.263 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.264 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.265 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.266 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "status", 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.267 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.268 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.269 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.270 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.271 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.272 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telegraf", 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "address": { 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "address", 2024-09-19T09:38:34.273 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.274 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.275 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.276 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.277 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.278 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.279 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.280 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telemetry", 2024-09-19T09:38:34.281 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_basic": { 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_basic", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.282 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_crash": { 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_crash", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:38:34.283 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_device": { 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_device", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.284 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_ident": { 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_ident", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.285 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_perf": { 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_perf", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.286 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "contact": { 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "contact", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.287 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "description": { 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "description", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.288 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "device_url": { 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_url", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.289 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.290 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.291 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "24", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "8", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "last_opt_revision": { 2024-09-19T09:38:34.292 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "last_opt_revision", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.293 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard": { 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard_description": { 2024-09-19T09:38:34.294 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard_description", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.295 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.296 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.297 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.298 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.299 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.300 INFO:teuthology.orchestra.run.smithi052.stdout: "organization": { 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "organization", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.301 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "proxy": { 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "proxy", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.302 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "url": { 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.303 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "test_orchestrator", 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.304 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.305 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.306 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.307 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.308 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.309 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "volumes", 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.310 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.311 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.312 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.313 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.314 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.315 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_clones": { 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_clones", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.316 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "periodic_async_work": { 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "periodic_async_work", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.317 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Periodically check for async work", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_delay": { 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.318 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.319 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.320 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "discovery_interval": { 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "discovery_interval", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "100", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.321 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "identifier": { 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "identifier", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.322 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.323 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.324 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.325 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.326 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.327 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.328 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_host": { 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_host", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.329 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_port": { 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_port", 2024-09-19T09:38:34.330 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10051", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_sender": { 2024-09-19T09:38:34.331 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_sender", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.332 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: "modules": [ 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm", 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: "dashboard", 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: "iostat", 2024-09-19T09:38:34.333 INFO:teuthology.orchestra.run.smithi052.stdout: "nfs", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "restful" 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "available_modules": [ 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "alerts", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.334 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.335 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.336 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.337 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.338 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.339 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.340 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_destination": { 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_destination", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.341 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_from_name": { 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_from_name", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "Ceph", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Email From: name", 2024-09-19T09:38:34.342 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_host": { 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_host", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.343 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP server", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_password": { 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_password", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.344 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Password to authenticate with", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_port": { 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_port", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.345 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "465", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP port", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_sender": { 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_sender", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.346 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_ssl": { 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_ssl", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.347 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "smtp_user": { 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "smtp_user", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.348 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "User to authenticate as", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.349 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "balancer", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "active": { 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "active", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.350 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_time": { 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_time", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0000", 2024-09-19T09:38:34.351 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "begin_weekday": { 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "begin_weekday", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.352 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_max_iterations": { 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.353 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "25", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "250", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_metrics": { 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_metrics", 2024-09-19T09:38:34.354 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_compat_step": { 2024-09-19T09:38:34.355 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crush_compat_step", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.5", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0.001", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "0.999", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.356 INFO:teuthology.orchestra.run.smithi052.stdout: "end_time": { 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_time", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2359", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.357 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "end_weekday": { 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "end_weekday", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "0", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "6", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:38:34.358 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.359 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.360 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.361 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.362 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.363 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "min_score": { 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_score", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.364 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "upmap", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.365 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-compat", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "none", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "read", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap-read" 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Balancer mode", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.366 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_ids": { 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_ids", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.368 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_deviation": { 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_deviation", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:38:34.369 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "upmap_max_optimizations": { 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:38:34.370 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm", 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_down_multiplier": { 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_down_multiplier", 2024-09-19T09:38:34.371 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.372 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_refresh_rate": { 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_refresh_rate", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "20", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.373 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "agent_starting_port": { 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "agent_starting_port", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4721", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.374 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_ptrace": { 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_ptrace", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.375 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_interval": { 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_interval", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.376 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.377 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0.7", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_log_destination": { 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cephadm_log_destination", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.378 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "file", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "file,syslog", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "syslog" 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.379 INFO:teuthology.orchestra.run.smithi052.stdout: "cgroups_split": { 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cgroups_split", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.380 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "config_checks_enabled": { 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_checks_enabled", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.381 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "config_dashboard": { 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_dashboard", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.382 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_alertmanager": { 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_alertmanager", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.383 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_base": { 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_base", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.384 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_elasticsearch": { 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "elasticsearch container image", 2024-09-19T09:38:34.385 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_grafana": { 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_grafana", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:34.386 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_haproxy": { 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_haproxy", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "HAproxy container image", 2024-09-19T09:38:34.387 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_agent": { 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.388 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_collector": { 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.389 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_jaeger_query": { 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.390 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Jaeger query container image", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_keepalived": { 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_keepalived", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.391 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Keepalived container image", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_loki": { 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_loki", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.392 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Loki container image", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_node_exporter": { 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_node_exporter", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.393 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_nvmeof": { 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_nvmeof", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.394 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Nvme-of container image", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_prometheus": { 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_prometheus", 2024-09-19T09:38:34.395 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Prometheus container image", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.396 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_promtail": { 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_promtail", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Promtail container image", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.397 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_samba": { 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_samba", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.398 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image_snmp_gateway": { 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:38:34.399 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "container_init": { 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "container_init", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.400 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "daemon_cache_timeout": { 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.401 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "900", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.402 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "default_registry": { 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "default_registry", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "docker.io", 2024-09-19T09:38:34.403 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "device_cache_timeout": { 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_cache_timeout", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1800", 2024-09-19T09:38:34.404 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "device_enhanced_scan": { 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_enhanced_scan", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.405 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "facts_cache_timeout": { 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "facts_cache_timeout", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.406 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "grafana_dashboards_path": { 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "host_check_interval": { 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "host_check_interval", 2024-09-19T09:38:34.408 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.409 INFO:teuthology.orchestra.run.smithi052.stdout: "hw_monitoring": { 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hw_monitoring", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.410 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "inventory_list_all": { 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "inventory_list_all", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.411 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.412 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "log_refresh_metadata": { 2024-09-19T09:38:34.413 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_refresh_metadata", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.414 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.415 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.416 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.417 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.418 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:38:34.419 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "*", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "max_count_per_host": { 2024-09-19T09:38:34.420 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_count_per_host", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.421 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd_draining_count": { 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_osd_draining_count", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.422 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "migration_current": { 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "migration_current", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "internal - do not modify", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.423 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "mode": { 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mode", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "root", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm-package", 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: "root" 2024-09-19T09:38:34.424 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "oob_default_addr": { 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "oob_default_addr", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "169.254.1.1", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.425 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "prometheus_alerts_path": { 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.426 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_insecure": { 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_insecure", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.427 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_password": { 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_password", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.428 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_url": { 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_url", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.429 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "registry_username": { 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "registry_username", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.430 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "secure_monitoring_stack": { 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.431 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "service_discovery_port": { 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "service_discovery_port", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.432 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8765", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "ssh_config_file": { 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssh_config_file", 2024-09-19T09:38:34.433 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "use_agent": { 2024-09-19T09:38:34.434 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_agent", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "use_repo_digest": { 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "use_repo_digest", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.436 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_failed_host_check": { 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.437 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_daemons": { 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.438 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_on_stray_hosts": { 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.439 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crash", 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.440 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.441 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.442 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.443 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.444 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.445 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "retain_interval": { 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retain_interval", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "31536000", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.446 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_recent_interval": { 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_recent_interval", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1209600", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.447 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dashboard", 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.448 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.449 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.450 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.451 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.452 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.453 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.454 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.455 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:38:34.456 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:38:34.457 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:38:34.458 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.459 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.460 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.462 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.463 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.464 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.465 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_URL": { 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.466 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.467 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:38:34.468 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:38:34.469 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:38:34.470 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.471 INFO:teuthology.orchestra.run.smithi052.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.472 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.473 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.474 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.475 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.476 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.477 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.478 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.479 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.480 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.481 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.482 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.483 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.484 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:38:34.485 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:38:34.486 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "45", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.487 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.488 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "admin", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.489 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.490 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.491 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.492 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.493 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.494 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "cross_origin_url": { 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cross_origin_url", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.495 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "crt_file": { 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "crt_file", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.496 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "debug": { 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "debug", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.497 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "jwt_token_ttl": { 2024-09-19T09:38:34.498 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "jwt_token_ttl", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "28800", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:34.499 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.500 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.501 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.502 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.503 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.504 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.505 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "motd": { 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "motd", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "The message of the day", 2024-09-19T09:38:34.506 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.507 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.508 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8080", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.509 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.510 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl_server_port": { 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl_server_port", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8443", 2024-09-19T09:38:34.511 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.512 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "redirect", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "redirect" 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:34.513 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "url_prefix": { 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url_prefix", 2024-09-19T09:38:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "devicehealth", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_monitoring": { 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_monitoring", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.516 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "monitor device health metrics", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.517 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.518 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.519 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.520 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.521 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.522 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "mark_out_threshold": { 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mark_out_threshold", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "2419200", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.523 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": { 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pool_name", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "device_health_metrics", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.524 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "retention_period": { 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "retention_period", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15552000", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:38:34.525 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_frequency": { 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_frequency", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:38:34.526 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "self_heal": { 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "self_heal", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:38:34.527 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.528 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "warn_threshold": { 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "warn_threshold", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7257600", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.529 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "diskprediction_local", 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.530 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.531 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.532 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.533 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.534 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.535 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "predict_interval": { 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predict_interval", 2024-09-19T09:38:34.536 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "86400", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.537 INFO:teuthology.orchestra.run.smithi052.stdout: "predictor_model": { 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "predictor_model", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "prophetstor", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.538 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "600", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.539 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "influx", 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": false, 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "batch_size": { 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "batch_size", 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.540 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5000", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "database": { 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "database", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.541 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "ceph", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": { 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "hostname", 2024-09-19T09:38:34.542 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.543 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "30", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "5", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.544 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.545 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.546 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.547 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.548 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.549 INFO:teuthology.orchestra.run.smithi052.stdout: "password": { 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "password", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "port": { 2024-09-19T09:38:34.550 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "port", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "8086", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "InfluxDB server port", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.551 INFO:teuthology.orchestra.run.smithi052.stdout: "ssl": { 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ssl", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "false", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "threads": { 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threads", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "32", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.553 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "username": { 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "username", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.554 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "verify_ssl": { 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "verify_ssl", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "true", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.555 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "insights", 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.556 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.557 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.558 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.559 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.560 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.561 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "iostat", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.562 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.563 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.564 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "k8sevents", 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_event_retention_days": { 2024-09-19T09:38:34.567 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "7", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "config_check_secs": { 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "config_check_secs", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "10", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.569 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.570 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.571 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.572 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.573 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.574 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "localpool", 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.575 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "failure_domain": { 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "failure_domain", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "host", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:38:34.576 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.577 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.578 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.579 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.580 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.581 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": { 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "min_size", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.582 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "num_rep": { 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "num_rep", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.583 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": { 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_num", 2024-09-19T09:38:34.584 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "128", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "prefix": { 2024-09-19T09:38:34.585 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prefix", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.586 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "subtree": { 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "subtree", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "rack", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.587 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mds_autoscaler", 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.588 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.589 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.590 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.591 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.592 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.593 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirroring", 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.594 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.595 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.596 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.597 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.598 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.599 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "nfs", 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.600 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.601 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.602 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.603 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.604 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.605 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "fail_fs": { 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "fail_fs", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.606 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.607 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.608 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.609 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.610 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.611 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.612 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator": { 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "orchestrator", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "rook", 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "test_orchestrator" 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.613 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Orchestrator backend", 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_perf_query", 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.614 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.615 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.616 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.617 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.618 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.619 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "osd_support", 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.620 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.621 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.622 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.623 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.624 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.625 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "pg_autoscaler", 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.626 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.628 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.630 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.631 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.632 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.633 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "threshold": { 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "threshold", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.634 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "3.0", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1.0", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "scaling threshold", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.635 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "progress", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_pg_recovery_event": { 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.636 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.637 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.638 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.639 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.640 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.641 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.642 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "max_completed_events": { 2024-09-19T09:38:34.643 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_completed_events", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "50", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "sleep_interval": { 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "sleep_interval", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.645 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "prometheus", 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "cache": { 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "cache", 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.646 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "exclude_perf_counters": { 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "exclude_perf_counters", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.647 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.648 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.649 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.650 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.651 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.652 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.653 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools": { 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.654 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "300", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.655 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "scrape_interval": { 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "scrape_interval", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15.0", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.656 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "::", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.657 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "9283", 2024-09-19T09:38:34.658 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "stale_cache_strategy": { 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stale_cache_strategy", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "log", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.659 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_behaviour": { 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_behaviour", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.660 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "default", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "default", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "error" 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "standby_error_status_code": { 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "standby_error_status_code", 2024-09-19T09:38:34.661 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "500", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "400", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "599", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.662 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_support", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.663 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.664 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.665 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.666 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.667 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_snap_create": { 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.668 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.669 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "trash_purge_schedule": { 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "trash_purge_schedule", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.670 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "restful", 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.671 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_auth": { 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enable_auth", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.672 INFO:teuthology.orchestra.run.smithi052.stdout: "key_file": { 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "key_file", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.673 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.674 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.675 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.676 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.677 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.678 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "server_addr": { 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_addr", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.679 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "server_port": { 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "server_port", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.680 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rgw", 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.681 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.682 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.683 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.684 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.685 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.686 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "5", 2024-09-19T09:38:34.687 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rook", 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.688 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.689 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.690 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.691 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.692 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.693 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "storage_class": { 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "storage_class", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "local", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:38:34.694 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "selftest", 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.695 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.696 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.697 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.698 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.699 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.700 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "roption1": { 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption1", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.701 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "roption2": { 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "roption2", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "xyz", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.702 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption1": { 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption1", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.703 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption2": { 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption2", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.704 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption3": { 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption3", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "float", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.705 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption4": { 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption4", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.706 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption5": { 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption5", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.707 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption6": { 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption6", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.708 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "rwoption7": { 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rwoption7", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "1", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "42", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.709 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "testkey": { 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testkey", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.710 INFO:teuthology.orchestra.run.smithi052.stdout: "testlkey": { 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testlkey", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.711 INFO:teuthology.orchestra.run.smithi052.stdout: "testnewline": { 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "testnewline", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.712 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snap_schedule", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_m_granularity": { 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "allow_m_granularity", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.713 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "dump_on_update": { 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "dump_on_update", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.714 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.715 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.716 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.717 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.718 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.719 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.720 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "stats", 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.721 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.722 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.723 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.724 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.725 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.726 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "status", 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.727 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.728 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.729 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.730 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.731 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.732 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telegraf", 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.733 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "address": { 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "address", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.734 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "15", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.735 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.736 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.737 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.738 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.739 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.740 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.741 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "telemetry", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_basic": { 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_basic", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.742 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_crash": { 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_crash", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.743 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_device": { 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_device", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.744 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_ident": { 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_ident", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.745 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "channel_perf": { 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "channel_perf", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.746 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "contact": { 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "contact", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.747 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "description": { 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "description", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.748 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "device_url": { 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "device_url", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.749 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "enabled": { 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "enabled", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.750 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "24", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "8", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.751 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "last_opt_revision": { 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "last_opt_revision", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "1", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.752 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard": { 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.753 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "leaderboard_description": { 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "leaderboard_description", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.754 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.755 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.756 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.757 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.758 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.759 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.760 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "organization": { 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "organization", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.761 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "proxy": { 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "proxy", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.762 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "url": { 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "url", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.763 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "test_orchestrator", 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.764 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.765 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.766 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.767 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.769 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "volumes", 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.770 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.771 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.772 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.774 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.775 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "max_concurrent_clones": { 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "max_concurrent_clones", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "4", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.776 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "periodic_async_work": { 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "periodic_async_work", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.777 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Periodically check for async work", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_delay": { 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.778 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "0", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.779 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "True", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.780 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix", 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "can_run": true, 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "error_string": "", 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "module_options": { 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "discovery_interval": { 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "discovery_interval", 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "uint", 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.781 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "100", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "identifier": { 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "identifier", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.782 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "interval": { 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "interval", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "secs", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.783 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "60", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "log_level": { 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_level", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.784 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.785 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster": { 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.786 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_cluster_level": { 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_cluster_level", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "info", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [ 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "critical", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "debug", 2024-09-19T09:38:34.787 INFO:teuthology.orchestra.run.smithi052.stdout: "error", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "info", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "warning" 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": { 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "log_to_file", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "bool", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.788 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "False", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_host": { 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_host", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.789 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_port": { 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_port", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "int", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "10051", 2024-09-19T09:38:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "zabbix_sender": { 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "zabbix_sender", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "str", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "level": "advanced", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 0, 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "min": "", 2024-09-19T09:38:34.791 INFO:teuthology.orchestra.run.smithi052.stdout: "max": "", 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "enum_allowed": [], 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "desc": "", 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "long_desc": "", 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "tags": [], 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "see_also": [] 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "services": { 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "dashboard": "https://172.21.15.52:8443/" 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "always_on_modules": { 2024-09-19T09:38:34.792 INFO:teuthology.orchestra.run.smithi052.stdout: "octopus": [ 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "balancer", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "crash", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "devicehealth", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscaler", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "progress", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_support", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "status", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "telemetry", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "volumes" 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "pacific": [ 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "balancer", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "crash", 2024-09-19T09:38:34.793 INFO:teuthology.orchestra.run.smithi052.stdout: "devicehealth", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscaler", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "progress", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_support", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "status", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "telemetry", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "volumes" 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "quincy": [ 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "balancer", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "crash", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "devicehealth", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscaler", 2024-09-19T09:38:34.794 INFO:teuthology.orchestra.run.smithi052.stdout: "progress", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_support", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "status", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "telemetry", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "volumes" 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "reef": [ 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "balancer", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "crash", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "devicehealth", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscaler", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "progress", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_support", 2024-09-19T09:38:34.795 INFO:teuthology.orchestra.run.smithi052.stdout: "status", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "telemetry", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "volumes" 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "squid": [ 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "balancer", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "crash", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "devicehealth", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "orchestrator", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscaler", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "progress", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_support", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "status", 2024-09-19T09:38:34.796 INFO:teuthology.orchestra.run.smithi052.stdout: "telemetry", 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "volumes" 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "active_clients": [ 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "devicehealth", 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:0", 2024-09-19T09:38:34.797 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 473527176 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "libcephsqlite", 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:0", 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 304195286 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.798 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "rbd_support", 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:0", 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 2604048988 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "volumes", 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-09-19T09:38:34.799 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.52:0", 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 4030105672 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-19T09:38:34.800 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 msgr2=0x7f34180a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 0x7f34180a5710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3428005fd0 tx=0x7f3428005850 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 msgr2=0x7f342c19cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f341c00d950 tx=0x7f341c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 shutdown_connections 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f342c1025e0 0x7f342c19f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f342c101c20 0x7f342c19cb00 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f34180a3250 0x7f34180a5710 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 --2- 172.21.15.52:0/3359344350 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f342c100a30 0x7f342c06af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 >> 172.21.15.52:0/3359344350 conn(0x7f342c0fc1b0 msgr2=0x7f342c104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:34.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 shutdown_connections 2024-09-19T09:38:34.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:33.386+0000 7f3433742640 1 -- 172.21.15.52:0/3359344350 wait complete. 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:33 smithi086 ceph-mon[34813]: pgmap v851: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:33 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3829504710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:33 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1228791398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:33 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3159769632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:34 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3359344350' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:33 smithi169 ceph-mon[35454]: pgmap v851: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:33 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3829504710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:33 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1228791398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.803 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:33 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3159769632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.804 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:34 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3359344350' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:38:34.804 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:33 smithi052 ceph-mon[30947]: pgmap v851: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:34.804 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:33 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3829504710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.804 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:33 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1228791398' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.804 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:33 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3159769632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:34.872 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:38:34.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:38:34.873 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:34 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3359344350' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:38:35.130 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:35.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:35 smithi052 ceph-mon[30947]: pgmap v852: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:35.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:35 smithi169 ceph-mon[35454]: pgmap v852: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:35.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:35 smithi086 ceph-mon[34813]: pgmap v852: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 0, 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2, 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:38:35.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 0, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.001406829, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.000256448, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 6, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 240, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 3312, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 199648, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:35.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.021563870, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.015369288, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.003633868, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 239, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.016871203, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000070590 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:35.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 199648 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 315, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 312, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 507344, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 192560, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.043290821, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.022983226, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.022407358, 2024-09-19T09:38:35.579 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 311, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.016634800, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000053488 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:35.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 507344, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 192560 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 0, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:35.581 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:35.582 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-19T09:38:35.583 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 148784, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 31, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:35.584 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:35.585 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 317, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 462802, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 317, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 317, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 462802, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:35.586 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:35.587 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:35.587 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:35.587 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:35.587 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:36.352 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T09:38:36.352 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T09:38:36.352 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:38:36.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:38:36.612 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:37.130 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:37.130 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 320, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 317, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 508704, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 195760, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.044222653, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.022789991, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.022955136, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 316, 2024-09-19T09:38:37.131 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.017851515, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000056492 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 508704, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 195760 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:37.132 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 242, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 320, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 199904, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.018825156, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.014542851, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.001559939, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 240, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.014775634, 2024-09-19T09:38:37.133 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000061565 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 199904 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 4, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 4, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:38:37.134 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 448, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.002511416, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000044288, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.002459698, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.004267342, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001422447 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:37.135 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 0, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-19T09:38:37.136 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:37.137 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:37.138 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 148704, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 29, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:37.139 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-19T09:38:37.140 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 322, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 463452, 2024-09-19T09:38:37.141 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 322, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 322, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 463452, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:37.142 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:37.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:37 smithi052 ceph-mon[30947]: pgmap v853: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:37.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:37 smithi169 ceph-mon[35454]: pgmap v853: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:37.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:37 smithi086 ceph-mon[34813]: pgmap v853: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:37.860 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:38:37.860 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:38:37.860 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:38:37.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:38:38.116 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:38.613 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:38.613 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 0, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 0, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.001205151, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.000132474, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:38.614 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:38.615 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 321, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 316, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 510880, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 194288, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.045689539, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.023516815, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.025287089, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 316, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.021178462, 2024-09-19T09:38:38.616 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000067020 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 510880, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 194288 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 240, 2024-09-19T09:38:38.617 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 320, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 199552, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.019132874, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.014869810, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.001511822, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 238, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.013145720, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000055234 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.618 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 199552 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 0, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:38.619 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:38.620 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:38.621 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 148682, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 29, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:38.622 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:38.623 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 319, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 463062, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 319, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-19T09:38:38.624 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 319, 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 463062, 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:38.625 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:39.297 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:39 smithi052 ceph-mon[30947]: pgmap v854: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:39.333 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T09:38:39.333 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T09:38:39.333 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:38:39.334 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:38:39.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:39 smithi169 ceph-mon[35454]: pgmap v854: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:39.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:39 smithi086 ceph-mon[34813]: pgmap v854: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:39.591 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:40.096 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-19T09:38:40.096 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:40.096 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 0, 2024-09-19T09:38:40.096 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 0, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.001460324, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.000293091, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:40.097 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 326, 2024-09-19T09:38:40.098 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 321, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 512240, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 197488, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.045472622, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.022844166, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.025406665, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:40.099 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 321, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.020828268, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000064885 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 512240, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 197488 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.100 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 2, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 244, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 320, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 200256, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.020708508, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.016100698, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.001826843, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:40.101 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 242, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.014337607, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000059246 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 200256 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 0, 2024-09-19T09:38:40.102 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:40.103 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:40.104 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 148744, 2024-09-19T09:38:40.105 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 30, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:40.106 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:40.107 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 324, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 463712, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 324, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 324, 2024-09-19T09:38:40.108 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 463712, 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-19T09:38:40.109 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-19T09:38:40.783 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T09:38:40.783 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T09:38:40.783 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:38:40.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:38:41.041 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:38:41.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:41 smithi052 ceph-mon[30947]: pgmap v855: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:41.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:41 smithi169 ceph-mon[35454]: pgmap v855: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:41.447 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:41 smithi086 ceph-mon[34813]: pgmap v855: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:41.683 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T09:38:41.683 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:41.683 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 4590, 2024-09-19T09:38:41.683 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 5120, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 1296711, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 9624723, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 11, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 4, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.430950754, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.159711463, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.150532440, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.081687436, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 5119, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.367894152, 2024-09-19T09:38:41.684 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000071868 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 3021, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000678559, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000224 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1306, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 1466, 2024-09-19T09:38:41.685 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 353022, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 6969471, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 499, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 8, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.248474410, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.040673772, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.164644075, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.024324209, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1464, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.308723634, 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000210876 2024-09-19T09:38:41.686 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 694, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000072054, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000103 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 60000, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 543328 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:41.687 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 5111, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 6328, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 2152129, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 2433727, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 11, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 6, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.551860067, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.211990303, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.263741737, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.097979077, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 6327, 2024-09-19T09:38:41.688 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.338915283, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000053566 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 6872, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.001568203, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000228 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 559616, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 243968 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-19T09:38:41.689 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 1, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-MDSRank": { 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 6923, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 1.604902328, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000231821 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:41.690 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 23, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000608515, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000026457 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": { 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "request": 732, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "reply": 732, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "reply_latency": { 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 732, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 3.039910866, 2024-09-19T09:38:41.691 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.004152883 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_reply": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "forward": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_commit": 498, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_split": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_merge": 0, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes": 25, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_top": 5, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_bottom": 20, 2024-09-19T09:38:41.692 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pinned": 17, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_expired": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_with_caps": 2, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": 2, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "subtrees": 2, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse": 891, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_hit": 883, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_forward": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_discover": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_lock": 0, 2024-09-19T09:38:41.693 INFO:teuthology.orchestra.run.smithi086.stdout: "load_cent": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "q": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "exported": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "exported_inodes": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "imported": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "imported_inodes": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_backtrace_fetch": 555, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_peer_discover": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rfiles": 4, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rbytes": 234, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rsnaps": 0, 2024-09-19T09:38:41.694 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_fetch": 555, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_inodes": 357, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_base_inodes": 40, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dirfrag_rstats": 317, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_file_inodes": 198, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_inode_file_caps": 2, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_revoke": 649, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_grant": 669, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_trunc": 599, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:41.695 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps": 757, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps_dirty": 709, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_cap_release": 4, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "process_request_cap_release": 629 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache": { 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update": 0, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_try_discover": 0, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_send_discover": 0, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_handle_discover": 3, 2024-09-19T09:38:41.696 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays": 1, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_created": 3, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_enqueued": 2, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_migrated": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_started": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_completed": 0, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_path": 14, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_inode": 194, 2024-09-19T09:38:41.697 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_enqueue_scrub": 40, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_flush": 0, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_inodestats": 0 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log": { 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "evlrg": 0, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "evadd": 2486, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "evex": 2445, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "evtrm": 2445, 2024-09-19T09:38:41.698 INFO:teuthology.orchestra.run.smithi086.stdout: "ev": 41, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "evexg": 0, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "evexd": 50, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segadd": 79, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segex": 78, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segtrm": 78, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "seg": 1, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segmjr": 1, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segexg": 0, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "segexd": 1, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "expos": 12086039, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "wrpos": 12206716, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "rdpos": 0, 2024-09-19T09:38:41.699 INFO:teuthology.orchestra.run.smithi086.stdout: "jlat": { 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2473, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 5.473763737, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.002213410 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "replayed": 0 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mem": { 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "ino": 24, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "ino+": 66, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "ino-": 42, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "dir": 19, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "dir+": 20, 2024-09-19T09:38:41.700 INFO:teuthology.orchestra.run.smithi086.stdout: "dir-": 1, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "dn": 25, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "dn+": 29, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "dn-": 4, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "cap": 2, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "cap+": 17, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "cap-": 15, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "rss": 58720, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "heap": 231712 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_server": { 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_client_request": 1950, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_server_request": 1, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_request": 732, 2024-09-19T09:38:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_session": 21, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_peer_request": 2, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "req_create_latency": { 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 18, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.010007774, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000555987 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getattr_latency": { 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 87, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.029263087, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000336357 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:41.702 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "req_link_latency": { 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookup_latency": { 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 3, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.001540854, 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000513618 2024-09-19T09:38:41.703 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupino_latency": { 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000114667, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000114667 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupname_latency": { 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.704 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lssnap_latency": { 2024-09-19T09:38:41.705 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.706 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.706 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.706 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.706 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mkdir_latency": { 2024-09-19T09:38:41.706 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 8, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.011801299, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.001475162 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mknod_latency": { 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mksnap_latency": { 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.707 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "req_open_latency": { 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000189626, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000189626 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "req_readdir_latency": { 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.004042696, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.002021348 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rename_latency": { 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2, 2024-09-19T09:38:41.708 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.002627353, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.001313676 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.709 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmdir_latency": { 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.015427099, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.007713549 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.710 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setattr_latency": { 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 600, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 2.943802420, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.004906337 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.711 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setlayout_latency": { 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setxattr_latency": { 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 7, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.017811693, 2024-09-19T09:38:41.712 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.002544527 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "req_symlink_latency": { 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "req_unlink_latency": { 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.003282298, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.003282298 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:41.713 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessions": { 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "session_count": 1, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "session_add": 2, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "session_remove": 1, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_open": 1, 2024-09-19T09:38:41.714 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_stale": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "total_load": 64, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "average_load": 64, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "avg_session_uptime": 1059, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:41.715 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:41.716 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-19T09:38:41.717 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 302908, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 107, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:41.718 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 165, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 98930, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 721, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter": { 2024-09-19T09:38:41.719 INFO:teuthology.orchestra.run.smithi086.stdout: "op_active": 0, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_laggy": 0, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send": 5148, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send_bytes": 8517977, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_resend": 37, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_reply": 5148, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_latency": { 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 5148, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 25.537448883, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.004960654 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "op_inflight": 0, 2024-09-19T09:38:41.720 INFO:teuthology.orchestra.run.smithi086.stdout: "oplen_avg": { 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 5148, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 6175 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "op": 5148, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "op_r": 637, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "op_w": 4511, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "op_rmw": 0, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "op_pg": 0, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_stat": 478, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_create": 25, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_read": 42, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_write": 2475, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writefull": 242, 2024-09-19T09:38:41.721 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writesame": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_append": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_zero": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_truncate": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_delete": 516, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_mapext": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_getxattr": 595, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_setxattr": 50, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:41.722 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_call": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_watch": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_notify": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_other": 599, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_active": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_send": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_resend": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_ping": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_active": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_send": 0, 2024-09-19T09:38:41.723 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_resend": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_active": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_send": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_resend": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_active": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_send": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_resend": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "command_active": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "command_send": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "command_resend": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "map_epoch": 81, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "map_full": 0, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "map_inc": 4, 2024-09-19T09:38:41.724 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_sessions": 12, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_open": 12, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_close": 0, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_laggy": 0, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_wr": 1142, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_rd": 0, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_del": 11 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "oft": { 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_objs": 1, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_updates": 0, 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_removes": 0 2024-09-19T09:38:41.725 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "osd-slow-ops": { 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_ops_count": 208 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "purge_queue": { 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops_high_water": 1, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing": 0, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_high_water": 1, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed_ops": 2, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed": 2, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.726 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 11003, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 2780390, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 11003, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 11003, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 2780390, 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:41.727 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:41.728 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 5148, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 8518179, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 5148, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 8518179, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 1024, 2024-09-19T09:38:41.729 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 5148, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 5148, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 5148, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 5148, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.730 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 2, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 202, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 2, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2, 2024-09-19T09:38:41.731 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 202, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle-0x562d4ff26960": { 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 2486, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 8012412, 2024-09-19T09:38:41.732 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 2486, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2473, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 8012412, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:41.733 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.432 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:42 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:42 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:42 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:38:42.564 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-19T09:38:42.564 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-19T09:38:42.564 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:38:42.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:38:42.809 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: pgmap v856: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:43.259 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:43.260 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:43 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 2505, 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2500, 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 5376614, 2024-09-19T09:38:43.284 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 888796, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 5, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.247383458, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.102430963, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.077640512, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.054069102, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2499, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.106340207, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000042553 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.285 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 532928, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 198096 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 495, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 736, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 122356, 2024-09-19T09:38:43.286 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 660806, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 6, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 4, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.061048657, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.021937809, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.013657622, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.019323460, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 734, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.032264232, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000043956 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:43.287 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 503648 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 1468, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 1468, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 4189334, 2024-09-19T09:38:43.288 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 466007, 2024-09-19T09:38:43.289 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:43.289 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 3, 2024-09-19T09:38:43.289 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.129073830, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.035007469, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.040161152, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.043580794, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1467, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.044824530, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000030555 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.290 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 1, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-MDSRank": { 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:43.291 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 6923, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.165603311, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000023920 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": { 2024-09-19T09:38:43.292 INFO:teuthology.orchestra.run.smithi086.stdout: "request": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "reply": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "reply_latency": { 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_reply": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "forward": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_commit": 0, 2024-09-19T09:38:43.293 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_split": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_merge": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes": 18, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_top": 4, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_bottom": 14, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pinned": 11, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_expired": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_with_caps": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": 0, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "subtrees": 2, 2024-09-19T09:38:43.294 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_hit": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_forward": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_discover": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_lock": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "load_cent": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "q": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "exported": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "exported_inodes": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "imported": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "imported_inodes": 0, 2024-09-19T09:38:43.295 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_peer_discover": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rfiles": 4, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rbytes": 234, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rsnaps": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:38:43.296 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_file_inodes": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_cap_release": 0, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "process_request_cap_release": 0 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache": { 2024-09-19T09:38:43.297 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update": 0, 2024-09-19T09:38:43.298 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:43.298 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_try_discover": 0, 2024-09-19T09:38:43.298 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_send_discover": 0, 2024-09-19T09:38:43.298 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_handle_discover": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_created": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_enqueued": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_migrated": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_started": 0, 2024-09-19T09:38:43.299 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_completed": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_flush": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_inodestats": 0 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log": { 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "evlrg": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "evadd": 0, 2024-09-19T09:38:43.300 INFO:teuthology.orchestra.run.smithi086.stdout: "evex": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "evtrm": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "ev": 2486, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "evexg": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "evexd": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segadd": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segex": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segtrm": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "seg": 2, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segmjr": 78, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segexg": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "segexd": 0, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "expos": 12086039, 2024-09-19T09:38:43.301 INFO:teuthology.orchestra.run.smithi086.stdout: "wrpos": 12206716, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "rdpos": 12204219, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "jlat": { 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "replayed": 2486 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mem": { 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "ino": 15, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "ino+": 17, 2024-09-19T09:38:43.302 INFO:teuthology.orchestra.run.smithi086.stdout: "ino-": 2, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dir": 10, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dir+": 11, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dir-": 1, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dn": 18, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dn+": 19, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dn-": 1, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "cap": 0, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "cap+": 0, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "cap-": 0, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "rss": 48508, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "heap": 215328 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_server": { 2024-09-19T09:38:43.303 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_client_request": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_server_request": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_request": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_session": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_peer_request": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "req_create_latency": { 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getattr_latency": { 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.304 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "req_link_latency": { 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookup_latency": { 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.305 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupino_latency": { 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupname_latency": { 2024-09-19T09:38:43.306 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.307 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lssnap_latency": { 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mkdir_latency": { 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mknod_latency": { 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.308 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mksnap_latency": { 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "req_open_latency": { 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "req_readdir_latency": { 2024-09-19T09:38:43.309 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rename_latency": { 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.310 INFO:teuthology.orchestra.run.smithi086.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmdir_latency": { 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.311 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setattr_latency": { 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:43.312 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setlayout_latency": { 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.313 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setxattr_latency": { 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "req_symlink_latency": { 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "req_unlink_latency": { 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.314 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessions": { 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "session_count": 1, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "session_add": 2, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "session_remove": 1, 2024-09-19T09:38:43.315 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_open": 2, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_stale": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "total_load": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "average_load": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "avg_session_uptime": 3510, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:43.316 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:43.317 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:43.318 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 190244, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 54, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:43.319 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 165, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 59298, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 354, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter": { 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "op_active": 0, 2024-09-19T09:38:43.320 INFO:teuthology.orchestra.run.smithi086.stdout: "op_laggy": 0, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send": 4130, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send_bytes": 26, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_resend": 4, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_reply": 4130, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_latency": { 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 4130, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 1.784961413, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000432194 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "op_inflight": 0, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "oplen_avg": { 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 4130, 2024-09-19T09:38:43.321 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 4131 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "op": 4130, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "op_r": 4130, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "op_w": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "op_rmw": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "op_pg": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_stat": 2299, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_create": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_read": 1828, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_write": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writefull": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writesame": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_append": 0, 2024-09-19T09:38:43.322 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_zero": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_truncate": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_delete": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_mapext": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_getxattr": 2, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_setxattr": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_call": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_watch": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_notify": 0, 2024-09-19T09:38:43.323 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_other": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_active": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_send": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_resend": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_ping": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_active": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_send": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_resend": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_active": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_send": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_resend": 0, 2024-09-19T09:38:43.324 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_active": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_send": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_resend": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "command_active": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "command_send": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "command_resend": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "map_epoch": 81, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "map_full": 0, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "map_inc": 4, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_sessions": 5, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_open": 6, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_close": 1, 2024-09-19T09:38:43.325 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_laggy": 0, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_wr": 0, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_rd": 2, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_del": 0 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "oft": { 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_objs": 0, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_updates": 0, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_removes": 0 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "osd-slow-ops": { 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_ops_count": 0 2024-09-19T09:38:43.326 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "purge_queue": { 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_high_water": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed_ops": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed": 0, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:43.327 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 4464, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 9266398, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 4464, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:43.328 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 4464, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 9266398, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:43.329 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 4130, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 8012422, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 4130, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 8012422, 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:43.330 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 1024, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:43.331 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 4130, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 4130, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 4130, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 4130, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:43.332 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.333 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle-0x561a9aaaeb40": { 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-09-19T09:38:43.334 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:43.335 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: pgmap v856: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:43.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:43 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:38:43.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: pgmap v856: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi169 to 176.0M 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi169 to 184591769: error parsing value: Value '184591769' is below minimum 939524096 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi052 to 177.0M 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi052 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Adjusting osd_memory_target on smithi086 to 176.0M 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: Unable to set osd_memory_target on smithi086 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:43.444 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:43 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' 2024-09-19T09:38:44.034 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:38:44.035 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:38:44.035 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:38:44.035 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 478, 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 474, 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 561730, 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 1259475, 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 96, 2024-09-19T09:38:44.760 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 6, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.097240154, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.031102508, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.062032183, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000423230, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 469, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.033764375, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000071992 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 115, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000014675, 2024-09-19T09:38:44.761 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000127 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 543856, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 202096 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 761, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 1177, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 163444, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 919391, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 11, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 4, 2024-09-19T09:38:44.762 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.116140297, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.058883355, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.048910669, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.005743345, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1177, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.072820578, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000061869 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 1658, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000390576, 2024-09-19T09:38:44.763 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000235 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 593376 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 100, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 98, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 34490, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 40130, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 7, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 4, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.010913509, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.002955943, 2024-09-19T09:38:44.764 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.008106136, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000300746, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 99, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.021263170, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000214779 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 158, 2024-09-19T09:38:44.765 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000029926, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000189 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 1, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-MDSRank": { 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 36, 2024-09-19T09:38:44.766 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.001367389, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000037983 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "queue_len": 0, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "complete_latency": { 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000010998, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000005499 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "mds": { 2024-09-19T09:38:44.767 INFO:teuthology.orchestra.run.smithi086.stdout: "request": 1, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "reply": 0, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "reply_latency": { 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_reply": 0, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "forward": 1, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_commit": 11, 2024-09-19T09:38:44.768 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_split": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_merge": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes": 10, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_top": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_bottom": 10, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_pinned": 10, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_expired": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "inodes_with_caps": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "caps": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "subtrees": 1, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse": 28, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_hit": 28, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_forward": 0, 2024-09-19T09:38:44.769 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_discover": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "traverse_lock": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "load_cent": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "q": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "exported": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "exported_inodes": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "imported": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "imported_inodes": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "openino_peer_discover": 1, 2024-09-19T09:38:44.770 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rfiles": 5, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rbytes": 298, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "root_rsnaps": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "scrub_file_inodes": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:38:44.771 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_cap_release": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "process_request_cap_release": 0 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_cache": { 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_try_discover": 0, 2024-09-19T09:38:44.772 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_send_discover": 1, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "dir_handle_discover": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_created": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_enqueued": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "strays_migrated": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_started": 0, 2024-09-19T09:38:44.773 INFO:teuthology.orchestra.run.smithi086.stdout: "recovery_completed": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_path": 14, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_quiesce_inode": 14, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_flush": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "ireq_inodestats": 0 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_log": { 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "evlrg": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "evadd": 3, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "evex": 0, 2024-09-19T09:38:44.774 INFO:teuthology.orchestra.run.smithi086.stdout: "evtrm": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "ev": 3, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "evexg": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "evexd": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segadd": 2, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segex": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segtrm": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "seg": 2, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segmjr": 2, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segexg": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "segexd": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "expos": 4194304, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "wrpos": 4195200, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "rdpos": 0, 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "jlat": { 2024-09-19T09:38:44.775 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 2, 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.003057286, 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.001528643 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "replayed": 0 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_mem": { 2024-09-19T09:38:44.776 INFO:teuthology.orchestra.run.smithi086.stdout: "ino": 13, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "ino+": 13, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "ino-": 0, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dir": 11, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dir+": 12, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dir-": 1, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dn": 10, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dn+": 10, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "dn-": 0, 2024-09-19T09:38:44.777 INFO:teuthology.orchestra.run.smithi086.stdout: "cap": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "cap+": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "cap-": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "rss": 50796, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "heap": 223520 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_server": { 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_client_request": 1, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "dispatch_server_request": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_request": 1, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_client_session": 14, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "handle_peer_request": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "req_create_latency": { 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.778 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getattr_latency": { 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.779 INFO:teuthology.orchestra.run.smithi086.stdout: "req_link_latency": { 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookup_latency": { 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.780 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupino_latency": { 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupname_latency": { 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.781 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "req_lssnap_latency": { 2024-09-19T09:38:44.782 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mkdir_latency": { 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mknod_latency": { 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.783 INFO:teuthology.orchestra.run.smithi086.stdout: "req_mksnap_latency": { 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "req_open_latency": { 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.784 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "req_readdir_latency": { 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.785 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rename_latency": { 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:44.786 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmdir_latency": { 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.787 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setattr_latency": { 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:44.788 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setlayout_latency": { 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.789 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "req_setxattr_latency": { 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "req_symlink_latency": { 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "req_unlink_latency": { 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.790 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_sessions": { 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "session_count": 1, 2024-09-19T09:38:44.791 INFO:teuthology.orchestra.run.smithi086.stdout: "session_add": 1, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "session_remove": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_open": 1, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "sessions_stale": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "total_load": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "average_load": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "avg_session_uptime": 1041, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:44.792 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:44.793 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:44.794 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 230807, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 75, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:44.795 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 165, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 50872, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 198, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:44.796 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "objecter": { 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "op_active": 0, 2024-09-19T09:38:44.797 INFO:teuthology.orchestra.run.smithi086.stdout: "op_laggy": 0, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send": 37, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "op_send_bytes": 11108, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "op_resend": 33, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "op_reply": 37, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "op_latency": { 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 37, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.211995476, 2024-09-19T09:38:44.798 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.005729607 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op_inflight": 0, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "oplen_avg": { 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 37, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 59 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op": 37, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op_r": 0, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op_w": 37, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op_rmw": 0, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "op_pg": 0, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_stat": 0, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_create": 10, 2024-09-19T09:38:44.799 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_read": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_write": 2, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writefull": 6, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_writesame": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_append": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_zero": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_truncate": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_delete": 6, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_mapext": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_getxattr": 0, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_setxattr": 20, 2024-09-19T09:38:44.800 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_call": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_watch": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_notify": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "osdop_other": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_active": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_send": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_resend": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "linger_ping": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_active": 0, 2024-09-19T09:38:44.801 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_send": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "poolop_resend": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_active": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_send": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "poolstat_resend": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_active": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_send": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "statfs_resend": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "command_active": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "command_send": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "command_resend": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "map_epoch": 81, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "map_full": 0, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "map_inc": 4, 2024-09-19T09:38:44.802 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_sessions": 9, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_open": 13, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_session_close": 4, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_laggy": 0, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_wr": 14, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_rd": 0, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_del": 1 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "oft": { 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_objs": 1, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_updates": 0, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "omap_total_removes": 0 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "osd-slow-ops": { 2024-09-19T09:38:44.803 INFO:teuthology.orchestra.run.smithi086.stdout: "slow_ops_count": 28 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "purge_queue": { 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executing_high_water": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed_ops": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_executed": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:44.804 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 1335, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 617909, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 1335, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 1335, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 617909, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.805 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 37, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 11108, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 37, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 11108, 2024-09-19T09:38:44.806 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 1024, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:44.807 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 37, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 37, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 37, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 37, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:44.808 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:44.809 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:44.809 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:44.809 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 0, 2024-09-19T09:38:44.809 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 0, 2024-09-19T09:38:44.809 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:44.810 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:44.810 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:44.810 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:44.810 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 0, 2024-09-19T09:38:44.810 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 0, 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.811 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-write_buf_throttle-0x55fbec44a960": { 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 3758096384, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 3, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 896, 2024-09-19T09:38:44.812 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 3, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 2, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 896, 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:44.813 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:44.814 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:44.814 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:44.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.814 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:44.814 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T09:38:45.399 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T09:38:45.399 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T09:38:45.399 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:38:45.399 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:38:45.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:45 smithi052 ceph-mon[30947]: pgmap v857: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:45.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:45 smithi169 ceph-mon[35454]: pgmap v857: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:45.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:45 smithi086 ceph-mon[34813]: pgmap v857: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:45.643 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:38:46.100 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 0, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 2, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 0, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.000925481, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.000116212, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:46.101 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:46.102 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 324, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 321, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 509792, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 198320, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.047159468, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.023085901, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.027502344, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 320, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.021102021, 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000065943 2024-09-19T09:38:46.103 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 509792, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 198320 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_messages": 6, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages": 247, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_bytes": 3312, 2024-09-19T09:38:46.104 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_bytes": 200880, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_total_time": 0.017785755, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_send_time": 0.011825474, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_recv_time": 0.003168079, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 246, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.020343758, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000082698 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:46.105 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "msgr_send_encrypted_bytes": 200880 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "cct": { 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "total_workers": 0, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "unhealthy_workers": 0 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "mempool": { 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:46.106 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:46.107 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:46.108 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_items": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_bytes": 148682, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_anon_items": 29, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_items": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:46.109 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "pgmap_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_co_items": 2, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_1_items": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:46.110 INFO:teuthology.orchestra.run.smithi086.stdout: "unittest_2_items": 0 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "val": 0, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "max": 104857600, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "get_started": 0, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "get": 326, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "get_sum": 463972, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "get_or_fail_success": 326, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "take": 0, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "take_sum": 0, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "put": 326, 2024-09-19T09:38:46.111 INFO:teuthology.orchestra.run.smithi086.stdout: "put_sum": 463972, 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: "wait": { 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: "avgcount": 0, 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: "sum": 0.000000000, 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: "avgtime": 0.000000000 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-09-19T09:38:46.112 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-09-19T09:38:46.750 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T09:38:46.750 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T09:38:46.750 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:38:46.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:38:47.014 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:38:47.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:47 smithi052 ceph-mon[30947]: pgmap v858: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:47.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:47 smithi169 ceph-mon[35454]: pgmap v858: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 3368, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 3368, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 954803, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 1070207, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.303520059, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.101874495, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.077676288, 2024-09-19T09:38:47.470 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.100241957, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3367, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.141274961, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000041958 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:47.471 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 334, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 329, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 533324, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 198634, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 3, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.047349579, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.022572070, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.030038325, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000075921, 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:47.472 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 328, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.022235595, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000067791 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 532768, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 197936 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 3, 2024-09-19T09:38:47.473 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 244, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 588, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 593870, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.014996902, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.010317488, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.002041016, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000021713, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 242, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.017464693, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000072168 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.474 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 593552 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T09:38:47.475 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5681, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.161843501, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000028488 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.476 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:47.477 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-19T09:38:47.478 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T09:38:47.479 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:38:47.480 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-19T09:38:47.481 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T09:38:47.482 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-19T09:38:47.483 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 3, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4195200, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 4194892, 2024-09-19T09:38:47.484 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 3 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 3, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 3, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 0, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 1, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1, 2024-09-19T09:38:47.485 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 50972, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-19T09:38:47.486 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:47.487 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.488 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.489 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.490 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.491 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T09:38:47.492 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.493 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.494 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T09:38:47.495 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.496 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.497 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.498 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 1, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 0, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 2330, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:47.499 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:47.500 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:47.501 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 182121, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 50, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T09:38:47.502 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 165, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 8512, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 13, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T09:38:47.503 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 3367, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 3367, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3367, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.643965972, 2024-09-19T09:38:47.504 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000488258 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3367, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3368 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 3367, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 3367, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 2202, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-19T09:38:47.505 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 1163, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:47.506 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T09:38:47.507 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 81, 2024-09-19T09:38:47.508 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 4, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 5, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 1, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-19T09:38:47.509 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-19T09:38:47.510 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 3701, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1135482, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 3701, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3701, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1135482, 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:47.511 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3367, 2024-09-19T09:38:47.512 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 901, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3367, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 901, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:47.513 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3367, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 3367, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3367, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 3367, 2024-09-19T09:38:47.514 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:47.515 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:47.516 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x5626ca15ab40": { 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:47.517 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:47.518 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T09:38:47.519 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:47 smithi086 ceph-mon[34813]: pgmap v858: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:48.301 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T09:38:48.301 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T09:38:48.301 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:38:48.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:38:48.555 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:38:49.081 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T09:38:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:49.081 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 334, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 329, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 533874, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 198900, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 6, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.049783153, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.023640670, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.029906479, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000020109, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 328, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.021645601, 2024-09-19T09:38:49.082 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000065992 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 533040, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 198576 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1072, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1314, 2024-09-19T09:38:49.083 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 263648, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 847639, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 5, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 4, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.129373522, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.041972194, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.029133166, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.044404828, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1312, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.065448713, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000049884 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:49.084 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 507056 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 2330, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 2330, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 699677, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 740174, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 3, 2024-09-19T09:38:49.085 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.252553981, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.078301707, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.070526780, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.080560844, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2329, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.109716332, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000047108 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:49.086 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 5626, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.171407433, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000030467 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:49.087 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 0, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 0, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.088 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 0, 2024-09-19T09:38:49.089 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 1, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 0, 2024-09-19T09:38:49.090 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-19T09:38:49.091 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:49.092 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 0 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:49.093 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:38:49.094 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 5, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-19T09:38:49.095 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4195734, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 4195593, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.096 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 5 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 3, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 3, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 0, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 1, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 1, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 0, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 0, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 0, 2024-09-19T09:38:49.097 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 52476, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 215328 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 0, 2024-09-19T09:38:49.098 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.099 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.100 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.101 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.102 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.104 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.105 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.106 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.107 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.108 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.109 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.110 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 2, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T09:38:49.111 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 3510, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:49.112 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:49.113 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:49.114 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 190145, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 52, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:49.115 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 165, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 8512, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 13, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T09:38:49.116 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 3398, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 21, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 3, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 3398, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3398, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 1.940959865, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000571206 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T09:38:49.117 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3398, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 3399 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 3398, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 3398, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 2229, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 1167, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T09:38:49.118 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 1, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T09:38:49.119 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T09:38:49.120 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 81, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 5, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 6, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 1, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 0, 2024-09-19T09:38:49.121 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 2, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 0 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 0, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 0 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:38:49.122 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 3732, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1141167, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 3732, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:49.123 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3732, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1141167, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:49.124 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3398, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 1435, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3398, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1435, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.125 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 3398, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 3398, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 3398, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 3398, 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:49.126 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:49.127 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x55e60051ab40": { 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:49.128 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:49.129 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T09:38:49.305 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:49 smithi169 ceph-mon[35454]: pgmap v859: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:49.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:49 smithi052 ceph-mon[30947]: pgmap v859: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:49.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:49 smithi086 ceph-mon[34813]: pgmap v859: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:49.760 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T09:38:49.760 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T09:38:49.760 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:38:49.760 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:38:50.011 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:38:50.538 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T09:38:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 1974, 2024-09-19T09:38:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 1445, 2024-09-19T09:38:50.538 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 478302, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 471916, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 9, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.146258030, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.054812054, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.092540379, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.006888518, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1446, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.067623926, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000046766 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.539 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3318, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000803550, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000242 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 50, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 235, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 10993, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 519519, 2024-09-19T09:38:50.540 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 18, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.028220687, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.012807746, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.012203152, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000456372, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 233, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.020586456, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000088353 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 51, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000010014, 2024-09-19T09:38:50.541 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000196 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 401152 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 449, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 503, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 553482, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 1348143, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 88, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 5, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.083301008, 2024-09-19T09:38:50.542 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.028635410, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.056247192, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000127739, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 500, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.032276022, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000064552 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 85, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000007260, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000085 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 540816, 2024-09-19T09:38:50.543 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 394896 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 1, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-MDSRank": { 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 52, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.001487813, 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000028611 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.544 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "finisher-PurgeQueue": { 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "queue_len": 0, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "complete_latency": { 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000011031, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000005515 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "mds": { 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "request": 4, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "reply": 3, 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "reply_latency": { 2024-09-19T09:38:50.545 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 3, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.002698529, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000899509 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_reply": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "forward": 1, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_complete": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_fetch_keys": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_commit": 11, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_split": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_merge": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes": 14, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_top": 0, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_bottom": 14, 2024-09-19T09:38:50.546 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pin_tail": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_pinned": 14, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_expired": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "inodes_with_caps": 2, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "caps": 2, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "subtrees": 2, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse": 33, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_hit": 31, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_forward": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_discover": 1, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_remote_ino": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "traverse_lock": 0, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "load_cent": 1000, 2024-09-19T09:38:50.547 INFO:teuthology.orchestra.run.smithi169.stdout: "q": 1, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "exported": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "exported_inodes": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "imported": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "imported_inodes": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_dir_fetch": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "openino_peer_discover": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rfiles": 5, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rbytes": 298, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "root_rsnaps": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:38:50.548 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_set_tag": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "scrub_file_inodes": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_revoke": 5, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_grant": 4, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps": 6, 2024-09-19T09:38:50.549 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_cap_release": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "process_request_cap_release": 1 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_cache": { 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_update_receipt": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_try_discover": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_send_discover": 2, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "dir_handle_discover": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_delayed": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:38:50.550 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_created": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_enqueued": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_reintegrated": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "strays_migrated": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_processing": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_started": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "recovery_completed": 0, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_path": 14, 2024-09-19T09:38:50.551 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_quiesce_inode": 70, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_exportdir": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_flush": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_fragstats": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ireq_inodestats": 0 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_log": { 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "evlrg": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "evadd": 5, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "evex": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "evtrm": 0, 2024-09-19T09:38:50.552 INFO:teuthology.orchestra.run.smithi169.stdout: "ev": 5, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "evexg": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "evexd": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segadd": 2, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segex": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segtrm": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "seg": 2, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segmjr": 2, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segexg": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "segexd": 0, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "expos": 4194304, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "wrpos": 4195734, 2024-09-19T09:38:50.553 INFO:teuthology.orchestra.run.smithi169.stdout: "rdpos": 0, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "jlat": { 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 4, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.007806729, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001951682 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "replayed": 0 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_mem": { 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "ino": 17, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "ino+": 17, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "ino-": 0, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "dir": 15, 2024-09-19T09:38:50.554 INFO:teuthology.orchestra.run.smithi169.stdout: "dir+": 16, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dir-": 1, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dn": 14, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dn+": 14, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dn-": 0, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "cap": 2, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "cap+": 2, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "cap-": 0, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "rss": 51472, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "heap": 223520 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_server": { 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_client_request": 7, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "dispatch_server_request": 0, 2024-09-19T09:38:50.555 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_request": 4, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_client_session": 18, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "handle_peer_request": 1, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_create_latency": { 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getattr_latency": { 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 2, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.002551804, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.001275902 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.556 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getfilelock_latency": { 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "req_link_latency": { 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookup_latency": { 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.557 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookuphash_latency": { 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupino_latency": { 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 1, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000146725, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000146725 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupname_latency": { 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.558 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupparent_latency": { 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lookupsnap_latency": { 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "req_lssnap_latency": { 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.559 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.560 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mkdir_latency": { 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.561 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mknod_latency": { 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "req_mksnap_latency": { 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "req_open_latency": { 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.562 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_readdir_latency": { 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rename_latency": { 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "req_renamesnap_latency": { 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.563 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_snapdiff_latency": { 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmdir_latency": { 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmsnap_latency": { 2024-09-19T09:38:50.564 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "req_rmxattr_latency": { 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setattr_latency": { 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.565 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setdirlayout_latency": { 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setfilelock_latency": { 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setlayout_latency": { 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.566 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "req_setxattr_latency": { 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "req_symlink_latency": { 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "req_unlink_latency": { 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.567 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "req_getvxattr_latency": { 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_sessions": { 2024-09-19T09:38:50.568 INFO:teuthology.orchestra.run.smithi169.stdout: "session_count": 1, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "session_add": 2, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "session_remove": 1, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_open": 1, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "sessions_stale": 0, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "total_load": 2, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "average_load": 2, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "avg_session_uptime": 1071, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "mdthresh_evicted": 0 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:50.569 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:50.570 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:50.571 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 246823, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 79, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:50.572 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 7984, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 165, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 68421, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 292, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:50.573 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "objecter": { 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_active": 0, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_laggy": 0, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send": 42, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_send_bytes": 12108, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_resend": 32, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_reply": 42, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_latency": { 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 42, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.203995955, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.004857046 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.574 INFO:teuthology.orchestra.run.smithi169.stdout: "op_inflight": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "oplen_avg": { 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 42, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 67 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "op": 42, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "op_r": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "op_w": 42, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "op_rmw": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "op_pg": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_stat": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_create": 10, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_read": 0, 2024-09-19T09:38:50.575 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_write": 4, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writefull": 6, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_writesame": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_append": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_zero": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_truncate": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_delete": 6, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_mapext": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_sparse_read": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_clonerange": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_getxattr": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_setxattr": 20, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:38:50.576 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_rmxattr": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_call": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_watch": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_notify": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "osdop_other": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_active": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_send": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_resend": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "linger_ping": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_active": 0, 2024-09-19T09:38:50.577 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_send": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "poolop_resend": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_active": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_send": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "poolstat_resend": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_active": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_send": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "statfs_resend": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "command_active": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "command_send": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "command_resend": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "map_epoch": 81, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "map_full": 0, 2024-09-19T09:38:50.578 INFO:teuthology.orchestra.run.smithi169.stdout: "map_inc": 4, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_sessions": 8, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_open": 13, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_session_close": 5, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_laggy": 0, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_wr": 19, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_rd": 0, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_del": 2 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "oft": { 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_objs": 1, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_updates": 0, 2024-09-19T09:38:50.579 INFO:teuthology.orchestra.run.smithi169.stdout: "omap_total_removes": 0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "osd-slow-ops": { 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "slow_ops_count": 84 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "purge_queue": { 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executing_high_water": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed_ops": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_executed": 0, 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: "pq_item_in_journal": 0 2024-09-19T09:38:50.580 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 2469, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 798928, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 2469, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 2469, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 798928, 2024-09-19T09:38:50.581 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_bytes": { 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:50.582 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 42, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 12108, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 42, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 12108, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-objecter_ops": { 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 1024, 2024-09-19T09:38:50.583 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 42, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 42, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 42, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 42, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.584 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 0, 2024-09-19T09:38:50.585 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-write_buf_throttle-0x564390d1a960": { 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 3758096384, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 5, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 1430, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 5, 2024-09-19T09:38:50.586 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 4, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 1430, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:50.587 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T09:38:51.194 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T09:38:51.194 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T09:38:51.194 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:38:51.194 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:38:51.441 INFO:teuthology.orchestra.run.smithi169.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:38:51.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:51 smithi169 ceph-mon[35454]: pgmap v860: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:51.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:51 smithi086 ceph-mon[34813]: pgmap v860: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:51.680 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:51 smithi052 ceph-mon[30947]: pgmap v860: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T09:38:51.921 INFO:teuthology.orchestra.run.smithi169.stdout:{ 2024-09-19T09:38:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:38:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 326, 2024-09-19T09:38:51.921 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 323, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 510336, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 199600, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 0, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.047651329, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.022802197, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.029776258, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 322, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.021347601, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000066296 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.922 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 510336, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 199600 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 6, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 249, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 3312, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 201232, 2024-09-19T09:38:51.923 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 4, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 2, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.017955833, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.011880815, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.003072272, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 248, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.022030334, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000088831 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:51.924 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 201232 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_messages": 0, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages": 2, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_bytes": 0, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_created_connections": 2, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_active_connections": 1, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_total_time": 0.000351254, 2024-09-19T09:38:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_recv_time": 0.000279088, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:38:51.926 INFO:teuthology.orchestra.run.smithi169.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "cct": { 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "total_workers": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "unhealthy_workers": 0 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "mempool": { 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bloom_filter_items": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:38:51.927 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_extent_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_blob_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:38:51.928 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_txc_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluestore_writing_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:38:51.929 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_bytes": 148784, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_anon_items": 31, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "buffer_meta_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_mapbl_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osd_pglog_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_bytes": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_items": 0, 2024-09-19T09:38:51.930 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_bytes": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "pgmap_items": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_bytes": 928, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "mds_co_items": 2, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_bytes": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_1_items": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_bytes": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "unittest_2_items": 0 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: }, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "val": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "max": 104857600, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "get_started": 0, 2024-09-19T09:38:51.931 INFO:teuthology.orchestra.run.smithi169.stdout: "get": 328, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "get_sum": 464232, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_fail": 0, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "get_or_fail_success": 328, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "take": 0, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "take_sum": 0, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "put": 328, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "put_sum": 464232, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "wait": { 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "avgcount": 0, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "sum": 0.000000000, 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: "avgtime": 0.000000000 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout: } 2024-09-19T09:38:51.932 INFO:teuthology.orchestra.run.smithi169.stdout:} 2024-09-19T09:38:52.578 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T09:38:52.578 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T09:38:52.579 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:38:52.589 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:38:52.590 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:38:52.590 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:38:52.612 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-19T09:38:52.612 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:38:52.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:38:52.986 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:53.417 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:53 smithi052 ceph-mon[30947]: pgmap v861: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 -- 172.21.15.52:0/3262712358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0102790 msgr2=0x7feee01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 --2- 172.21.15.52:0/3262712358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0102790 0x7feee01067e0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7feed0009900 tx=0x7feed002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 -- 172.21.15.52:0/3262712358 shutdown_connections 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 --2- 172.21.15.52:0/3262712358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0106f10 0x7feee010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 --2- 172.21.15.52:0/3262712358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0102790 0x7feee01067e0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 --2- 172.21.15.52:0/3262712358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0101de0 0x7feee01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 -- 172.21.15.52:0/3262712358 >> 172.21.15.52:0/3262712358 conn(0x7feee00fd8c0 msgr2=0x7feee00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 -- 172.21.15.52:0/3262712358 shutdown_connections 2024-09-19T09:38:53.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 -- 172.21.15.52:0/3262712358 wait complete. 2024-09-19T09:38:53.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.434+0000 7feee728a640 1 Processor -- start 2024-09-19T09:38:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 -- start start 2024-09-19T09:38:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0101de0 0x7feee0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0102790 0x7feee0198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feee0111f70 con 0x7feee0106f10 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feee0111df0 con 0x7feee0101de0 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee728a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feee01120f0 con 0x7feee0102790 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56840/0 (socket says 172.21.15.52:56840) 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 -- 172.21.15.52:0/2956376279 learned_addr learned my addr 172.21.15.52:0/2956376279 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5026640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0101de0 0x7feee0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee4825640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0102790 0x7feee0198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 -- 172.21.15.52:0/2956376279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0102790 msgr2=0x7feee0198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0102790 0x7feee0198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 -- 172.21.15.52:0/2956376279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0101de0 msgr2=0x7feee0198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0101de0 0x7feee0198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.435+0000 7feee5827640 1 -- 172.21.15.52:0/2956376279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee019d2f0 con 0x7feee0106f10 2024-09-19T09:38:53.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feee5827640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7feed800cce0 tx=0x7feed800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed800f450 con 0x7feee0106f10 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feed800fad0 con 0x7feee0106f10 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee019d5e0 con 0x7feee0106f10 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed8018b60 con 0x7feee0106f10 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.436+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee01a4ec0 con 0x7feee0106f10 2024-09-19T09:38:53.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.437+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee01021c0 con 0x7feee0106f10 2024-09-19T09:38:53.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.438+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feed800fc80 con 0x7feee0106f10 2024-09-19T09:38:53.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.439+0000 7feed67fc640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 0x7feecc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.439+0000 7feee5026640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 0x7feecc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.439+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feed80d02d0 con 0x7feee0106f10 2024-09-19T09:38:53.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.439+0000 7feee5026640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 0x7feecc0a5700 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7feedc00abe0 tx=0x7feedc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:53 smithi169 ceph-mon[35454]: pgmap v861: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:53.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.442+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feed8014030 con 0x7feee0106f10 2024-09-19T09:38:53.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:53 smithi086 ceph-mon[34813]: pgmap v861: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.628+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feee01996a0 con 0x7feee0106f10 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.629+0000 7feed67fc640 1 -- 172.21.15.52:0/2956376279 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+587 (secure 0 0 0) 0x7feee01996a0 con 0x7feee0106f10 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3212727743 2024-09-20T09:12:31.197675+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/561717915 2024-09-20T09:12:31.197675+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/378801178 2024-09-20T09:12:31.197675+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/3194006990 2024-09-20T09:12:07.900133+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/3194006990 2024-09-20T09:12:07.900133+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2992795514 2024-09-20T09:12:07.900133+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/266113391 2024-09-20T09:12:07.900133+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/198451359 2024-09-20T09:12:31.197675+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/561717915 2024-09-20T09:12:31.197675+0000 2024-09-19T09:38:53.631 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/1008400409 2024-09-20T09:12:07.900133+0000 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi052.stderr:listed 10 entries 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 msgr2=0x7feecc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 0x7feecc0a5700 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7feedc00abe0 tx=0x7feedc00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 msgr2=0x7feee019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7feed800cce0 tx=0x7feed800a620 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 shutdown_connections 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0106f10 0x7feee019cc10 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feecc0a3240 0x7feecc0a5700 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feee0102790 0x7feee0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 --2- 172.21.15.52:0/2956376279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feee0101de0 0x7feee0198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 >> 172.21.15.52:0/2956376279 conn(0x7feee00fd8c0 msgr2=0x7feee00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 shutdown_connections 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:53.631+0000 7feee728a640 1 -- 172.21.15.52:0/2956376279 wait complete. 2024-09-19T09:38:54.380 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:54 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2956376279' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:38:54.416 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:38:54.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:54.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:54 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2956376279' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:38:54.461 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:38:54.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.461 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:38:54.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:54 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2956376279' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:38:54.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.513 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-19T09:38:54.530 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:38:54.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:38:54.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:54.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-19T09:38:54.689 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:38:54.701 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:38:54.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:38:54.701 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:55.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:55 smithi052 ceph-mon[30947]: pgmap v862: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:55.443 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:55 smithi169 ceph-mon[35454]: pgmap v862: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:55.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:55 smithi086 ceph-mon[34813]: pgmap v862: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T09:38:55.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- 172.21.15.52:0/2804840923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462810c170 msgr2=0x7f462810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 --2- 172.21.15.52:0/2804840923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462810c170 0x7f462810e610 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f4620009ca0 tx=0x7f462002a950 comp rx=0 tx=0).stop 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- 172.21.15.52:0/2804840923 shutdown_connections 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 --2- 172.21.15.52:0/2804840923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f462810c170 0x7f462810e610 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 --2- 172.21.15.52:0/2804840923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628103660 0x7f462810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 --2- 172.21.15.52:0/2804840923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4628102d40 0x7f4628103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- 172.21.15.52:0/2804840923 >> 172.21.15.52:0/2804840923 conn(0x7f46280fc7a0 msgr2=0x7f46280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- 172.21.15.52:0/2804840923 shutdown_connections 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- 172.21.15.52:0/2804840923 wait complete. 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 Processor -- start 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.587+0000 7f462ef2e640 1 -- start start 2024-09-19T09:38:55.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 0x7f46281983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f462810c170 0x7f462819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111fb0 con 0x7f4628103660 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4628111e30 con 0x7f4628102d40 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ef2e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4628112130 con 0x7f462810c170 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56844/0 (socket says 172.21.15.52:56844) 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 -- 172.21.15.52:0/1612233826 learned_addr learned my addr 172.21.15.52:0/1612233826 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ccca640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 0x7f46281983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462d4cb640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f462810c170 0x7f462819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 -- 172.21.15.52:0/1612233826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f462810c170 msgr2=0x7f462819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f462810c170 0x7f462819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 -- 172.21.15.52:0/1612233826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 msgr2=0x7f46281983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 0x7f46281983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 -- 172.21.15.52:0/1612233826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462819d380 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f462ccca640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 0x7f46281983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.588+0000 7f4627fff640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f461400c970 tx=0x7f461400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.589+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614007bb0 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.589+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614007d50 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.589+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614018820 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.589+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462819d670 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.589+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281a4f50 con 0x7f4628103660 2024-09-19T09:38:55.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.590+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4628103120 con 0x7f4628103660 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.591+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f46140189c0 con 0x7f4628103660 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.591+0000 7f4625ffb640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 0x7f46180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.592+0000 7f462ccca640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 0x7f46180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.592+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f46140cfaf0 con 0x7f4628103660 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.592+0000 7f462ccca640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 0x7f46180a5780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f461c009930 tx=0x7f461c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.596+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4614014030 con 0x7f4628103660 2024-09-19T09:38:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.806+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46281a5210 con 0x7f4628103660 2024-09-19T09:38:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.807+0000 7f4625ffb640 1 -- 172.21.15.52:0/1612233826 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f461409c730 con 0x7f4628103660 2024-09-19T09:38:55.809 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:55.809 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:38:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.809+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 msgr2=0x7f46180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.809+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 0x7f46180a5780 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f461c009930 tx=0x7f461c008040 comp rx=0 tx=0).stop 2024-09-19T09:38:55.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.809+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 msgr2=0x7f4628198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.809+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f461400c970 tx=0x7f461400ce30 comp rx=0 tx=0).stop 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 shutdown_connections 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f46180a32c0 0x7f46180a5780 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f462810c170 0x7f462819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4628103660 0x7f4628198910 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 --2- 172.21.15.52:0/1612233826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4628102d40 0x7f46281983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 >> 172.21.15.52:0/1612233826 conn(0x7f46280fc7a0 msgr2=0x7f46280fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 shutdown_connections 2024-09-19T09:38:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:55.810+0000 7f462ef2e640 1 -- 172.21.15.52:0/1612233826 wait complete. 2024-09-19T09:38:56.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:56 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/1612233826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:56.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:56 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/1612233826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:56 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/1612233826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.769 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 -- 172.21.15.52:0/1994314641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074eb0 msgr2=0x7f9ddc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 --2- 172.21.15.52:0/1994314641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc112650 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009900 tx=0x7f9dc802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 -- 172.21.15.52:0/1994314641 shutdown_connections 2024-09-19T09:38:57.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 --2- 172.21.15.52:0/1994314641 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 --2- 172.21.15.52:0/1994314641 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc112650 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 --2- 172.21.15.52:0/1994314641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074590 0x7f9ddc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 -- 172.21.15.52:0/1994314641 >> 172.21.15.52:0/1994314641 conn(0x7f9ddc0fd8c0 msgr2=0x7f9ddc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 -- 172.21.15.52:0/1994314641 shutdown_connections 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.234+0000 7f9de2c19640 1 -- 172.21.15.52:0/1994314641 wait complete. 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 Processor -- start 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 -- start start 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc118560 con 0x7f9ddc074590 2024-09-19T09:38:57.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1183e0 con 0x7f9ddc074eb0 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de2c19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1186e0 con 0x7f9ddc112b90 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56858/0 (socket says 172.21.15.52:56858) 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 -- 172.21.15.52:0/2333974063 learned_addr learned my addr 172.21.15.52:0/2333974063 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de11b6640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9ddbfff640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 -- 172.21.15.52:0/2333974063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 msgr2=0x7f9ddc19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 -- 172.21.15.52:0/2333974063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 msgr2=0x7f9ddc1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 -- 172.21.15.52:0/2333974063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc19f000 con 0x7f9ddc074590 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de11b6640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:57.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9ddbfff640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.235+0000 7f9de09b5640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c890 tx=0x7f9dd000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.236+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004220 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.236+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dd00043c0 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.236+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc19f2f0 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.236+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00049e0 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.236+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc1ab5e0 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.237+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc074970 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.238+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9dd00079b0 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.238+0000 7f9dd9ffb640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 0x7f9dcc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.239+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f9dd00cfa60 con 0x7f9ddc074590 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.239+0000 7f9ddbfff640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 0x7f9dcc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.239+0000 7f9ddbfff640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 0x7f9dcc0a5780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000c00 tx=0x7f9dc8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.243+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dd0014030 con 0x7f9ddc074590 2024-09-19T09:38:57.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:57 smithi052 ceph-mon[30947]: pgmap v863: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.455+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ddc1ab980 con 0x7f9ddc074590 2024-09-19T09:38:57.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.455+0000 7f9dd9ffb640 1 -- 172.21.15.52:0/2333974063 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11902 (secure 0 0 0) 0x7f9dd009c700 con 0x7f9ddc074590 2024-09-19T09:38:57.457 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:57.457 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-19T09:21:00:193861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14550,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/2692323672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":2692323672},{"type":"v1","addr":"172.21.15.52:6835","nonce":2692323672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/2830628688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":2830628688},{"type":"v1","addr":"172.21.15.52:6837","nonce":2830628688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/362105670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":362105670},{"type":"v1","addr":"172.21.15.52:6839","nonce":362105670}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6841/3428587988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6840","nonce":3428587988},{"type":"v1","addr":"172.21.15.52:6841","nonce":3428587988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6833/3295968296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":3295968296},{"type":"v1","addr":"172.21.15.169:6833","nonce":3295968296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6833/700754353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":700754353},{"type":"v1","addr":"172.21.15.86:6833","nonce":700754353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:19:18.374880+0000","modified":"2024-09-19T09:20:59.524065+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24482,"mds_2":24466},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24442":{"gid":24442,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6835/144132383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":144132383},{"type":"v1","addr":"172.21.15.169:6835","nonce":144132383}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.169:6837/1790018144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":1790018144},{"type":"v1","addr":"172.21.15.169:6837","nonce":1790018144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6835/4246812720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6834","nonce":4246812720},{"type":"v1","addr":"172.21.15.86:6835","nonce":4246812720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.169:6839/3841296575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6838","nonce":3841296575},{"type":"v1","addr":"172.21.15.169:6839","nonce":3841296575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.86:6837/546883569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6836","nonce":546883569},{"type":"v1","addr":"172.21.15.86:6837","nonce":546883569}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6839/1882596213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6838","nonce":1882596213},{"type":"v1","addr":"172.21.15.86:6839","nonce":1882596213}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24466,24482,24509]},"id":1}]} 2024-09-19T09:38:57.457 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 msgr2=0x7f9dcc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 0x7f9dcc0a5780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000c00 tx=0x7f9dc8032c70 comp rx=0 tx=0).stop 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 msgr2=0x7f9ddc1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c890 tx=0x7f9dd000cd50 comp rx=0 tx=0).stop 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 shutdown_connections 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9dcc0a32c0 0x7f9dcc0a5780 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9ddc112b90 0x7f9ddc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ddc074eb0 0x7f9ddc1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 --2- 172.21.15.52:0/2333974063 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ddc074590 0x7f9ddc1a4710 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 >> 172.21.15.52:0/2333974063 conn(0x7f9ddc0fd8c0 msgr2=0x7f9ddc0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 shutdown_connections 2024-09-19T09:38:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:57.457+0000 7f9de2c19640 1 -- 172.21.15.52:0/2333974063 wait complete. 2024-09-19T09:38:57.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:57 smithi086 ceph-mon[34813]: pgmap v863: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:57.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:57 smithi169 ceph-mon[35454]: pgmap v863: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T09:38:58.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:38:58.348 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:58.470 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:58 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2333974063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:58.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:58 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2333974063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:58.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:58 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2333974063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 -- 172.21.15.52:0/976959191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c102db0 msgr2=0x7f327c103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 --2- 172.21.15.52:0/976959191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c102db0 0x7f327c103190 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f326c009cd0 tx=0x7f326c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 -- 172.21.15.52:0/976959191 shutdown_connections 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 --2- 172.21.15.52:0/976959191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c1082e0 0x7f327c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 --2- 172.21.15.52:0/976959191 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 0x7f327c107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 --2- 172.21.15.52:0/976959191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c102db0 0x7f327c103190 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 -- 172.21.15.52:0/976959191 >> 172.21.15.52:0/976959191 conn(0x7f327c0fc7d0 msgr2=0x7f327c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 -- 172.21.15.52:0/976959191 shutdown_connections 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.772+0000 7f3281191640 1 -- 172.21.15.52:0/976959191 wait complete. 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 Processor -- start 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 -- start start 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c102db0 0x7f327c100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 0x7f327c100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f327c1120b0 con 0x7f327c1082e0 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f327c111f30 con 0x7f327c102db0 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f3281191640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f327c112230 con 0x7f327c103760 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f327b59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f327b59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59814/0 (socket says 172.21.15.52:59814) 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f327b59e640 1 -- 172.21.15.52:0/996614570 learned_addr learned my addr 172.21.15.52:0/996614570 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f327ad9d640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c102db0 0x7f327c100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.773+0000 7f327a59c640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 0x7f327c100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 -- 172.21.15.52:0/996614570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 msgr2=0x7f327c100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 0x7f327c100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 -- 172.21.15.52:0/996614570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c102db0 msgr2=0x7f327c100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c102db0 0x7f327c100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 -- 172.21.15.52:0/996614570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327c1a6a90 con 0x7f327c1082e0 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f327b59e640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f327400d750 tx=0x7f327400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274017070 con 0x7f327c1082e0 2024-09-19T09:38:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327c1a6d80 con 0x7f327c1082e0 2024-09-19T09:38:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3274005500 con 0x7f327c1082e0 2024-09-19T09:38:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274004d90 con 0x7f327c1082e0 2024-09-19T09:38:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.774+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327c1a7270 con 0x7f327c1082e0 2024-09-19T09:38:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.776+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327c06a7d0 con 0x7f327c1082e0 2024-09-19T09:38:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.777+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3274004f30 con 0x7f327c1082e0 2024-09-19T09:38:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.777+0000 7f3263fff640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 0x7f32640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.777+0000 7f327ad9d640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 0x7f32640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.777+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7f32740cf250 con 0x7f327c1082e0 2024-09-19T09:38:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.778+0000 7f327ad9d640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 0x7f32640a5700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f326c006010 tx=0x7f326c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.782+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f327409b8a0 con 0x7f327c1082e0 2024-09-19T09:38:58.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.957+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f327c10a2c0 con 0x7f327c1082e0 2024-09-19T09:38:58.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.958+0000 7f3263fff640 1 -- 172.21.15.52:0/996614570 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22883 (secure 0 0 0) 0x7f327409fba0 con 0x7f327c1082e0 2024-09-19T09:38:58.961 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-19T09:38:58.961 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":81,"fsid":"044f38fa-7667-11ef-bceb-c7b262605968","created":"2024-09-19T09:11:37.433695+0000","modified":"2024-09-19T09:20:33.079991+0000","last_up_change":"2024-09-19T09:18:28.259543+0000","last_in_change":"2024-09-19T09:18:03.784952+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:14:47.724048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:14.651004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:16.771140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffb4240a-2009-4628-bcd3-1c228b520686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6803","nonce":1361807976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6805","nonce":1361807976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6809","nonce":1361807976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1361807976},{"type":"v1","addr":"172.21.15.52:6807","nonce":1361807976}]},"public_addr":"172.21.15.52:6803/1361807976","cluster_addr":"172.21.15.52:6805/1361807976","heartbeat_back_addr":"172.21.15.52:6809/1361807976","heartbeat_front_addr":"172.21.15.52:6807/1361807976","state":["exists","up"]},{"osd":1,"uuid":"a590cdeb-d3d8-4648-8b73-60f4c8a49f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6801","nonce":740812264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6803","nonce":740812264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6807","nonce":740812264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":740812264},{"type":"v1","addr":"172.21.15.86:6805","nonce":740812264}]},"public_addr":"172.21.15.86:6801/740812264","cluster_addr":"172.21.15.86:6803/740812264","heartbeat_back_addr":"172.21.15.86:6807/740812264","heartbeat_front_addr":"172.21.15.86:6805/740812264","state":["exists","up"]},{"osd":2,"uuid":"46efd319-b3bd-4ac6-b9e8-9655c2327275","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6801","nonce":2551130038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6803","nonce":2551130038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6807","nonce":2551130038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":2551130038},{"type":"v1","addr":"172.21.15.169:6805","nonce":2551130038}]},"public_addr":"172.21.15.169:6801/2551130038","cluster_addr":"172.21.15.169:6803/2551130038","heartbeat_back_addr":"172.21.15.169:6807/2551130038","heartbeat_front_addr":"172.21.15.169:6805/2551130038","state":["exists","up"]},{"osd":3,"uuid":"9318aae9-50c2-4e6b-bbbb-2345588faaab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6811","nonce":3702275878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6813","nonce":3702275878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6817","nonce":3702275878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":3702275878},{"type":"v1","addr":"172.21.15.52:6815","nonce":3702275878}]},"public_addr":"172.21.15.52:6811/3702275878","cluster_addr":"172.21.15.52:6813/3702275878","heartbeat_back_addr":"172.21.15.52:6817/3702275878","heartbeat_front_addr":"172.21.15.52:6815/3702275878","state":["exists","up"]},{"osd":4,"uuid":"76a0dea0-afb1-4fb8-8659-1b4dd0622faa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6809","nonce":1147748892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6811","nonce":1147748892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6815","nonce":1147748892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":1147748892},{"type":"v1","addr":"172.21.15.86:6813","nonce":1147748892}]},"public_addr":"172.21.15.86:6809/1147748892","cluster_addr":"172.21.15.86:6811/1147748892","heartbeat_back_addr":"172.21.15.86:6815/1147748892","heartbeat_front_addr":"172.21.15.86:6813/1147748892","state":["exists","up"]},{"osd":5,"uuid":"591fa0a5-b621-4110-a02f-72e3532df5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6809","nonce":1256666547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6811","nonce":1256666547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6815","nonce":1256666547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1256666547},{"type":"v1","addr":"172.21.15.169:6813","nonce":1256666547}]},"public_addr":"172.21.15.169:6809/1256666547","cluster_addr":"172.21.15.169:6811/1256666547","heartbeat_back_addr":"172.21.15.169:6815/1256666547","heartbeat_front_addr":"172.21.15.169:6813/1256666547","state":["exists","up"]},{"osd":6,"uuid":"2c2a192f-6c1b-4b9f-8ce8-2408d527b2b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6819","nonce":517383530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6821","nonce":517383530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6825","nonce":517383530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":517383530},{"type":"v1","addr":"172.21.15.52:6823","nonce":517383530}]},"public_addr":"172.21.15.52:6819/517383530","cluster_addr":"172.21.15.52:6821/517383530","heartbeat_back_addr":"172.21.15.52:6825/517383530","heartbeat_front_addr":"172.21.15.52:6823/517383530","state":["exists","up"]},{"osd":7,"uuid":"e13e68f3-9922-4795-a513-b311f5bf755f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6817","nonce":2917689244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6819","nonce":2917689244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6823","nonce":2917689244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":2917689244},{"type":"v1","addr":"172.21.15.86:6821","nonce":2917689244}]},"public_addr":"172.21.15.86:6817/2917689244","cluster_addr":"172.21.15.86:6819/2917689244","heartbeat_back_addr":"172.21.15.86:6823/2917689244","heartbeat_front_addr":"172.21.15.86:6821/2917689244","state":["exists","up"]},{"osd":8,"uuid":"117090d0-d86d-49de-ba8e-5b3bacea18ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6817","nonce":1059670873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6819","nonce":1059670873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6823","nonce":1059670873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1059670873},{"type":"v1","addr":"172.21.15.169:6821","nonce":1059670873}]},"public_addr":"172.21.15.169:6817/1059670873","cluster_addr":"172.21.15.169:6819/1059670873","heartbeat_back_addr":"172.21.15.169:6823/1059670873","heartbeat_front_addr":"172.21.15.169:6821/1059670873","state":["exists","up"]},{"osd":9,"uuid":"03810cd0-6516-45f0-9945-be3a82e57bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6827","nonce":2842026931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6829","nonce":2842026931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6833","nonce":2842026931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":2842026931},{"type":"v1","addr":"172.21.15.52:6831","nonce":2842026931}]},"public_addr":"172.21.15.52:6827/2842026931","cluster_addr":"172.21.15.52:6829/2842026931","heartbeat_back_addr":"172.21.15.52:6833/2842026931","heartbeat_front_addr":"172.21.15.52:6831/2842026931","state":["exists","up"]},{"osd":10,"uuid":"00f8d84c-9ca3-4e10-a2a6-8bde20432f13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6825","nonce":3726855330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6827","nonce":3726855330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6831","nonce":3726855330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3726855330},{"type":"v1","addr":"172.21.15.86:6829","nonce":3726855330}]},"public_addr":"172.21.15.86:6825/3726855330","cluster_addr":"172.21.15.86:6827/3726855330","heartbeat_back_addr":"172.21.15.86:6831/3726855330","heartbeat_front_addr":"172.21.15.86:6829/3726855330","state":["exists","up"]},{"osd":11,"uuid":"d69dbe3c-e8f7-47f7-aa04-ba7bfcf8573a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6825","nonce":3787808833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6827","nonce":3787808833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6831","nonce":3787808833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":3787808833},{"type":"v1","addr":"172.21.15.169:6829","nonce":3787808833}]},"public_addr":"172.21.15.169:6825/3787808833","cluster_addr":"172.21.15.169:6827/3787808833","heartbeat_back_addr":"172.21.15.169:6831/3787808833","heartbeat_front_addr":"172.21.15.169:6829/3787808833","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:54.936474+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:19.684372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:44.524758+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:09.794816+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:33.868925+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:58.787289+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:23.427434+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:16:48.059873+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:11.793653+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:17:36.217089+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:01.027193+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:18:25.657633+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7}]},{"pgid":"3.1d","mappings":[{"from":1,"to":2},{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/3212727743":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6800/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/378801178":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:6800/3194006990":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/2992795514":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/266113391":"2024-09-20T09:12:07.900133+0000","172.21.15.52:0/198451359":"2024-09-20T09:12:31.197675+0000","172.21.15.52:6801/561717915":"2024-09-20T09:12:31.197675+0000","172.21.15.52:0/1008400409":"2024-09-20T09:12:07.900133+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 msgr2=0x7f32640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 0x7f32640a5700 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f326c006010 tx=0x7f326c009360 comp rx=0 tx=0).stop 2024-09-19T09:38:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 msgr2=0x7f327c101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f327400d750 tx=0x7f327400dc10 comp rx=0 tx=0).stop 2024-09-19T09:38:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 shutdown_connections 2024-09-19T09:38:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f327c1082e0 0x7f327c101490 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f32640a3240 0x7f32640a5700 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f327c103760 0x7f327c100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.960+0000 7f3281191640 1 --2- 172.21.15.52:0/996614570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f327c102db0 0x7f327c100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.961+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 >> 172.21.15.52:0/996614570 conn(0x7f327c0fc7d0 msgr2=0x7f327c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.961+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 shutdown_connections 2024-09-19T09:38:58.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:38:58.961+0000 7f3281191640 1 -- 172.21.15.52:0/996614570 wait complete. 2024-09-19T09:38:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:59 smithi086 ceph-mon[34813]: pgmap v864: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:38:59.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:38:59 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/996614570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.521 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:59 smithi052 ceph-mon[30947]: pgmap v864: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:38:59.521 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:38:59 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/996614570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.551 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:38:59.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:59 smithi169 ceph-mon[35454]: pgmap v864: 97 pgs: 97 active+clean; 4.2 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-19T09:38:59.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:38:59 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/996614570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:59.809 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:00.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 -- 172.21.15.52:0/1361564492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88106a80 msgr2=0x7feb88106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 --2- 172.21.15.52:0/1361564492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88106a80 0x7feb88106e60 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7feb78009930 tx=0x7feb7802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:00.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 -- 172.21.15.52:0/1361564492 shutdown_connections 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 --2- 172.21.15.52:0/1361564492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88101420 0x7feb8810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 --2- 172.21.15.52:0/1361564492 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88100a80 0x7feb88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 --2- 172.21.15.52:0/1361564492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88106a80 0x7feb88106e60 unknown :-1 s=CLOSED pgs=2396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 -- 172.21.15.52:0/1361564492 >> 172.21.15.52:0/1361564492 conn(0x7feb880fc7a0 msgr2=0x7feb880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 -- 172.21.15.52:0/1361564492 shutdown_connections 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 -- 172.21.15.52:0/1361564492 wait complete. 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.308+0000 7feb8e570640 1 Processor -- start 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 -- start start 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88100a80 0x7feb88198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88106a80 0x7feb8819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb88111fa0 con 0x7feb88101420 2024-09-19T09:39:00.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb88111e20 con 0x7feb88100a80 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8e570640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb88112120 con 0x7feb88106a80 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59844/0 (socket says 172.21.15.52:59844) 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 -- 172.21.15.52:0/2364173282 learned_addr learned my addr 172.21.15.52:0/2364173282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb87fff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88100a80 0x7feb88198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb8cb0d640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88106a80 0x7feb8819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 -- 172.21.15.52:0/2364173282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88106a80 msgr2=0x7feb8819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88106a80 0x7feb8819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 -- 172.21.15.52:0/2364173282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88100a80 msgr2=0x7feb88198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88100a80 0x7feb88198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 -- 172.21.15.52:0/2364173282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8819d3d0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.309+0000 7feb7ffff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7feb7000d770 tx=0x7feb7000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.310+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70017070 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.310+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb70005500 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.310+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8819d6c0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.310+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70004e00 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.310+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881a4fa0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.311+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb88100ee0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.312+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feb70004fa0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.313+0000 7feb85ffb640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 0x7feb740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.313+0000 7feb87fff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 0x7feb740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.313+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8364+0+0 (secure 0 0 0) 0x7feb700cf3e0 con 0x7feb88101420 2024-09-19T09:39:00.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.313+0000 7feb87fff640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 0x7feb740a5780 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feb78009900 tx=0x7feb780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:00.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.317+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb7009c020 con 0x7feb88101420 2024-09-19T09:39:00.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.528+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feb88109050 con 0x7feb88101420 2024-09-19T09:39:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.530+0000 7feb85ffb640 1 -- 172.21.15.52:0/2364173282 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7feb7009b920 con 0x7feb88101420 2024-09-19T09:39:00.532 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:39:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 msgr2=0x7feb740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 0x7feb740a5780 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feb78009900 tx=0x7feb780058d0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 msgr2=0x7feb88198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7feb7000d770 tx=0x7feb7000dc30 comp rx=0 tx=0).stop 2024-09-19T09:39:00.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 shutdown_connections 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7feb740a32c0 0x7feb740a5780 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb88106a80 0x7feb8819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb88101420 0x7feb88198960 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 --2- 172.21.15.52:0/2364173282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb88100a80 0x7feb88198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 >> 172.21.15.52:0/2364173282 conn(0x7feb880fc7a0 msgr2=0x7feb880fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:00.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 shutdown_connections 2024-09-19T09:39:00.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:00.534+0000 7feb8e570640 1 -- 172.21.15.52:0/2364173282 wait complete. 2024-09-19T09:39:00.837 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a[30943]: 2024-09-19T09:39:00.529+0000 7f8884923640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:39:00.944 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:00.944 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:00.944 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: starting mds.c at 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: starting mds.f at 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-mds[65658]: -- 172.21.15.169:0/3798724999 <== mon.1 v2:172.21.15.169:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55db27703860 con 0x55db276e1000 2024-09-19T09:39:00.945 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:39:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: starting mds.i at 2024-09-19T09:39:01.008 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-mds[65325]: -- 172.21.15.86:0/3146934557 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562003869860 con 0x562003847000 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: starting mds.b at 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-mds[64726]: -- 172.21.15.86:0/207542838 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56132627d860 con 0x56132625b000 2024-09-19T09:39:01.009 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: starting mds.e at 2024-09-19T09:39:01.010 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: ignoring --setuser ceph since I am not root 2024-09-19T09:39:01.010 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: ignoring --setgroup ceph since I am not root 2024-09-19T09:39:01.010 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-mds[65028]: -- 172.21.15.86:0/3597601297 <== mon.2 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c748fb7860 con 0x55c748f95000 2024-09-19T09:39:01.010 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:39:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: starting mds.h at 2024-09-19T09:39:01.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:39:01.415 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: pgmap v865: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:39:01.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:01 smithi052 ceph-mon[30947]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:39:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: pgmap v865: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:39:01.508 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:39:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:39:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:39:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:39:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:39:01.509 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:01 smithi086 ceph-mon[34813]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:39:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: pgmap v865: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T09:39:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:39:01.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:39:01.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:39:01.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/2364173282' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:39:01.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:39:01.694 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:01 smithi169 ceph-mon[35454]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 -- 172.21.15.52:0/1605968069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 msgr2=0x7f9e6410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 --2- 172.21.15.52:0/1605968069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6410d950 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009cd0 tx=0x7f9e5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 -- 172.21.15.52:0/1605968069 shutdown_connections 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 --2- 172.21.15.52:0/1605968069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64101420 0x7f9e6410d950 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 --2- 172.21.15.52:0/1605968069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e64100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 --2- 172.21.15.52:0/1605968069 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64106a80 0x7f9e64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 -- 172.21.15.52:0/1605968069 >> 172.21.15.52:0/1605968069 conn(0x7f9e640fc7a0 msgr2=0x7f9e640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 -- 172.21.15.52:0/1605968069 shutdown_connections 2024-09-19T09:39:01.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 -- 172.21.15.52:0/1605968069 wait complete. 2024-09-19T09:39:01.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.861+0000 7f9e6927f640 1 Processor -- start 2024-09-19T09:39:01.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 -- start start 2024-09-19T09:39:01.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e64198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 0x7f9e641989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64111fa0 con 0x7f9e64106a80 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64111e20 con 0x7f9e64100a80 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e6927f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64112120 con 0x7f9e64101420 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59854/0 (socket says 172.21.15.52:59854) 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 -- 172.21.15.52:0/3603581556 learned_addr learned my addr 172.21.15.52:0/3603581556 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e62ffd640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e64198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e5a7fc640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 0x7f9e641989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 -- 172.21.15.52:0/3603581556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 msgr2=0x7f9e641989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 0x7f9e641989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 -- 172.21.15.52:0/3603581556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 msgr2=0x7f9e64198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e64198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e637fe640 1 -- 172.21.15.52:0/3603581556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6419d430 con 0x7f9e64106a80 2024-09-19T09:39:01.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.862+0000 7f9e5a7fc640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 0x7f9e641989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e637fe640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005cc0 tx=0x7f9e5c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c004040 con 0x7f9e64106a80 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e5c0046c0 con 0x7f9e64106a80 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c030e70 con 0x7f9e64106a80 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6419d6c0 con 0x7f9e64106a80 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.863+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e641a5000 con 0x7f9e64106a80 2024-09-19T09:39:01.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.864+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e641021c0 con 0x7f9e64106a80 2024-09-19T09:39:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.865+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e5c0305a0 con 0x7f9e64106a80 2024-09-19T09:39:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.866+0000 7f9e60ff9640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 0x7f9e500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.866+0000 7f9e62ffd640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 0x7f9e500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.866+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8622+0+0 (secure 0 0 0) 0x7f9e5c02e030 con 0x7f9e64106a80 2024-09-19T09:39:01.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.866+0000 7f9e62ffd640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 0x7f9e500a5780 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009990 tx=0x7f9e54009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:01.870+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e5c0bd6f0 con 0x7f9e64106a80 2024-09-19T09:39:02.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.083+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9e641997e0 con 0x7f9e64106a80 2024-09-19T09:39:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.537+0000 7f9e60ff9640 1 -- 172.21.15.52:0/3603581556 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f9e5c0098b0 con 0x7f9e64106a80 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 msgr2=0x7f9e500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 0x7f9e500a5780 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009990 tx=0x7f9e54009110 comp rx=0 tx=0).stop 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 msgr2=0x7f9e6419cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c005cc0 tx=0x7f9e5c003970 comp rx=0 tx=0).stop 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 shutdown_connections 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e64106a80 0x7f9e6419cd50 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f9e500a32c0 0x7f9e500a5780 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e64101420 0x7f9e641989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 --2- 172.21.15.52:0/3603581556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e64100a80 0x7f9e64198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:02.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.539+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 >> 172.21.15.52:0/3603581556 conn(0x7f9e640fc7a0 msgr2=0x7f9e640fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:02.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.540+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 shutdown_connections 2024-09-19T09:39:02.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:02.540+0000 7f9e6927f640 1 -- 172.21.15.52:0/3603581556 wait complete. 2024-09-19T09:39:02.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6836/939593256,v1:172.21.15.169:6839/939593256] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6835/2064742876,v1:172.21.15.169:6838/2064742876] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6834/329407678,v1:172.21.15.86:6835/329407678] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.169:6834/3672276751,v1:172.21.15.169:6837/3672276751] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6836/2116247518,v1:172.21.15.86:6838/2116247518] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: mds.? [v2:172.21.15.86:6837/1292469898,v1:172.21.15.86:6839/1292469898] up:boot 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:39:02.759 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: pgmap v867: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-19T09:39:02.760 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:02 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:39:02.865 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6836/939593256,v1:172.21.15.169:6839/939593256] up:boot 2024-09-19T09:39:02.865 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6835/2064742876,v1:172.21.15.169:6838/2064742876] up:boot 2024-09-19T09:39:02.865 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6834/329407678,v1:172.21.15.86:6835/329407678] up:boot 2024-09-19T09:39:02.865 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.169:6834/3672276751,v1:172.21.15.169:6837/3672276751] up:boot 2024-09-19T09:39:02.865 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6836/2116247518,v1:172.21.15.86:6838/2116247518] up:boot 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: mds.? [v2:172.21.15.86:6837/1292469898,v1:172.21.15.86:6839/1292469898] up:boot 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: pgmap v867: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-19T09:39:02.866 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:02 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:39:02.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6836/939593256,v1:172.21.15.169:6839/939593256] up:boot 2024-09-19T09:39:02.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6835/2064742876,v1:172.21.15.169:6838/2064742876] up:boot 2024-09-19T09:39:02.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6834/329407678,v1:172.21.15.86:6835/329407678] up:boot 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.169:6834/3672276751,v1:172.21.15.169:6837/3672276751] up:boot 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6836/2116247518,v1:172.21.15.86:6838/2116247518] up:boot 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: mds.? [v2:172.21.15.86:6837/1292469898,v1:172.21.15.86:6839/1292469898] up:boot 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='mgr.14150 172.21.15.52:0/3783365671' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:39:02.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: pgmap v867: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 716 B/s wr, 7 op/s 2024-09-19T09:39:02.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:02 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:39:03.202 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:39:03.471 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:03.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:03 smithi052 ceph-mon[30947]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:39:03.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:03 smithi052 ceph-mon[30947]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:39:03.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:03 smithi052 ceph-mon[30947]: Cluster is now healthy 2024-09-19T09:39:03.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:03 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:39:03.852 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:03 smithi052 ceph-mon[30947]: fsmap 12 up:standby 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 -- 172.21.15.52:0/4141352241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80106f10 msgr2=0x7f1e8010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 --2- 172.21.15.52:0/4141352241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80106f10 0x7f1e8010ea90 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009ca0 tx=0x7f1e7802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 -- 172.21.15.52:0/4141352241 shutdown_connections 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 --2- 172.21.15.52:0/4141352241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80106f10 0x7f1e8010ea90 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 --2- 172.21.15.52:0/4141352241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80102790 0x7f1e801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 --2- 172.21.15.52:0/4141352241 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80101de0 0x7f1e801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 -- 172.21.15.52:0/4141352241 >> 172.21.15.52:0/4141352241 conn(0x7f1e800fd8c0 msgr2=0x7f1e800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:03.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 -- 172.21.15.52:0/4141352241 shutdown_connections 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.936+0000 7f1e85209640 1 -- 172.21.15.52:0/4141352241 wait complete. 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.937+0000 7f1e85209640 1 Processor -- start 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.937+0000 7f1e85209640 1 -- start start 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 0x7f1e80198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80106f10 0x7f1e8019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80111f70 con 0x7f1e80101de0 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80111df0 con 0x7f1e80106f10 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801120f0 con 0x7f1e80102790 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59872/0 (socket says 172.21.15.52:59872) 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 -- 172.21.15.52:0/631881473 learned_addr learned my addr 172.21.15.52:0/631881473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7f59e640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80106f10 0x7f1e8019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7e59c640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 0x7f1e80198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 -- 172.21.15.52:0/631881473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 msgr2=0x7f1e80198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 0x7f1e80198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 -- 172.21.15.52:0/631881473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80106f10 msgr2=0x7f1e8019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80106f10 0x7f1e8019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 -- 172.21.15.52:0/631881473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8019d2e0 con 0x7f1e80101de0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7e59c640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 0x7f1e80198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e7ed9d640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c920 tx=0x7f1e7000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70007c70 con 0x7f1e80101de0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e70007e10 con 0x7f1e80101de0 2024-09-19T09:39:03.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.938+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8019d5d0 con 0x7f1e80101de0 2024-09-19T09:39:03.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.939+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e70018890 con 0x7f1e80101de0 2024-09-19T09:39:03.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.939+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e801a4eb0 con 0x7f1e80101de0 2024-09-19T09:39:03.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.940+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e801021c0 con 0x7f1e80101de0 2024-09-19T09:39:03.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.941+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1e70018a70 con 0x7f1e80101de0 2024-09-19T09:39:03.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:03 smithi169 ceph-mon[35454]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:39:03.946 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:03 smithi169 ceph-mon[35454]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:39:03.947 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:03 smithi169 ceph-mon[35454]: Cluster is now healthy 2024-09-19T09:39:03.947 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:03 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:39:03.947 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:03 smithi169 ceph-mon[35454]: fsmap 12 up:standby 2024-09-19T09:39:03.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.942+0000 7f1e77fff640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 0x7f1e6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:03.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.942+0000 7f1e7e59c640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 0x7f1e6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:03.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.942+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8622+0+0 (secure 0 0 0) 0x7f1e700cfbe0 con 0x7f1e80101de0 2024-09-19T09:39:03.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.942+0000 7f1e7e59c640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 0x7f1e6c0a5700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1e80108880 tx=0x7f1e68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:03.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:03.946+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e70014030 con 0x7f1e80101de0 2024-09-19T09:39:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:03 smithi086 ceph-mon[34813]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:39:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:03 smithi086 ceph-mon[34813]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:39:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:03 smithi086 ceph-mon[34813]: Cluster is now healthy 2024-09-19T09:39:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:03 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3603581556' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:39:04.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:03 smithi086 ceph-mon[34813]: fsmap 12 up:standby 2024-09-19T09:39:04.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.121+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1e8002d7c0 con 0x7f1e80101de0 2024-09-19T09:39:04.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.544+0000 7f1e77fff640 1 -- 172.21.15.52:0/631881473 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7f1e7009c780 con 0x7f1e80101de0 2024-09-19T09:39:04.546 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 msgr2=0x7f1e6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 0x7f1e6c0a5700 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1e80108880 tx=0x7f1e68005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 msgr2=0x7f1e80198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000c920 tx=0x7f1e7000cde0 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 shutdown_connections 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e80106f10 0x7f1e8019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f1e6c0a3240 0x7f1e6c0a5700 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1e80102790 0x7f1e80198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 --2- 172.21.15.52:0/631881473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e80101de0 0x7f1e80198330 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 >> 172.21.15.52:0/631881473 conn(0x7f1e800fd8c0 msgr2=0x7f1e800febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:04.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.548+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 shutdown_connections 2024-09-19T09:39:04.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:04.549+0000 7f1e85209640 1 -- 172.21.15.52:0/631881473 wait complete. 2024-09-19T09:39:04.854 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:04 smithi052 ceph-mon[30947]: pgmap v868: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-19T09:39:04.855 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:04 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:04.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:04 smithi169 ceph-mon[35454]: pgmap v868: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-19T09:39:04.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:04 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:04 smithi086 ceph-mon[34813]: pgmap v868: 97 pgs: 97 active+clean; 4.2 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 716 B/s wr, 6 op/s 2024-09-19T09:39:05.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:04 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:05.196 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 044f38fa-7667-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:39:05.455 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:05.850 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:05 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:05.851 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:05 smithi052 ceph-mon[30947]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 -- 172.21.15.52:0/3988866907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688106a80 msgr2=0x7f9688106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3988866907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688106a80 0x7f9688106e60 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f9678009930 tx=0x7f967802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 -- 172.21.15.52:0/3988866907 shutdown_connections 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3988866907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688101420 0x7f968810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3988866907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688100a80 0x7f9688100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3988866907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688106a80 0x7f9688106e60 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 -- 172.21.15.52:0/3988866907 >> 172.21.15.52:0/3988866907 conn(0x7f96880fc7a0 msgr2=0x7f96880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:05.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 -- 172.21.15.52:0/3988866907 shutdown_connections 2024-09-19T09:39:05.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 -- 172.21.15.52:0/3988866907 wait complete. 2024-09-19T09:39:05.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.937+0000 7f968d1f2640 1 Processor -- start 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 -- start start 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688101420 0x7f9688198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 0x7f968819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9688110ea0 con 0x7f9688100a80 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9688110d20 con 0x7f9688101420 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968d1f2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9688111020 con 0x7f9688106a80 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59888/0 (socket says 172.21.15.52:59888) 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 -- 172.21.15.52:0/3080392110 learned_addr learned my addr 172.21.15.52:0/3080392110 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968659c640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688101420 0x7f9688198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968759e640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 0x7f968819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 -- 172.21.15.52:0/3080392110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 msgr2=0x7f968819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 0x7f968819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 -- 172.21.15.52:0/3080392110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688101420 msgr2=0x7f9688198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688101420 0x7f9688198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f9686d9d640 1 -- 172.21.15.52:0/3080392110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968819d4e0 con 0x7f9688100a80 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.938+0000 7f968759e640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 0x7f968819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f9686d9d640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f9678009230 tx=0x7f9678004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967803f030 con 0x7f9688100a80 2024-09-19T09:39:05.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9678003ad0 con 0x7f9688100a80 2024-09-19T09:39:05.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968819d770 con 0x7f9688100a80 2024-09-19T09:39:05.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678035070 con 0x7f9688100a80 2024-09-19T09:39:05.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.939+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96881a50b0 con 0x7f9688100a80 2024-09-19T09:39:05.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.940+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96881021c0 con 0x7f9688100a80 2024-09-19T09:39:05.944 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:05 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:05.945 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:05 smithi169 ceph-mon[35454]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:39:05.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.942+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9678042030 con 0x7f9688100a80 2024-09-19T09:39:05.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.943+0000 7f966ffff640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 0x7f96700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:05.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.943+0000 7f968659c640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 0x7f96700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:05.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.943+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8068+0+0 (secure 0 0 0) 0x7f96780f01f0 con 0x7f9688100a80 2024-09-19T09:39:05.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.943+0000 7f968659c640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 0x7f96700a5700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96880fec70 tx=0x7f967c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:05.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:05.946+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96780bcf60 con 0x7f9688100a80 2024-09-19T09:39:06.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:05 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/631881473' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:06.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:05 smithi086 ceph-mon[34813]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:39:06.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.122+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f96881a5280 con 0x7f9688100a80 2024-09-19T09:39:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.551+0000 7f966ffff640 1 -- 172.21.15.52:0/3080392110 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f96780bc860 con 0x7f9688100a80 2024-09-19T09:39:06.553 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-09-19T09:39:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 msgr2=0x7f96700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 0x7f96700a5700 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96880fec70 tx=0x7f967c00b410 comp rx=0 tx=0).stop 2024-09-19T09:39:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 msgr2=0x7f9688198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:06.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f9678009230 tx=0x7f9678004270 comp rx=0 tx=0).stop 2024-09-19T09:39:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 shutdown_connections 2024-09-19T09:39:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:6800/2340346787,v1:172.21.15.52:6801/2340346787] conn(0x7f96700a3240 0x7f96700a5700 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9688106a80 0x7f968819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:06.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9688101420 0x7f9688198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:06.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 --2- 172.21.15.52:0/3080392110 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9688100a80 0x7f9688198530 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:06.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.555+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 >> 172.21.15.52:0/3080392110 conn(0x7f96880fc7a0 msgr2=0x7f96880fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:06.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.556+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 shutdown_connections 2024-09-19T09:39:06.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-19T09:39:06.556+0000 7f968d1f2640 1 -- 172.21.15.52:0/3080392110 wait complete. 2024-09-19T09:39:06.892 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:06 smithi052 ceph-mon[30947]: pgmap v870: 65 pgs: 65 active+clean; 577 KiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:39:06.892 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:06 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:06.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:06 smithi169 ceph-mon[35454]: pgmap v870: 65 pgs: 65 active+clean; 577 KiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:39:06.943 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:06 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:06 smithi086 ceph-mon[34813]: pgmap v870: 65 pgs: 65 active+clean; 577 KiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:39:07.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:06 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:39:07.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:07.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:07.362 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:39:07.395 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:39:07.395 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:39:07.411 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:39:07.430 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:39:07.453 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:39:07.454 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:39:07.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:39:07.555 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 systemd[1]: Stopping Ceph mon.a for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:07.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:07 smithi169 ceph-mon[35454]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:07.693 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:07 smithi169 ceph-mon[35454]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:39:07.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:07 smithi086 ceph-mon[34813]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:07.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:07 smithi086 ceph-mon[34813]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:39:07.821 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 ceph-mon[30947]: from='client.? 172.21.15.52:0/3080392110' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:39:07.822 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 ceph-mon[30947]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:39:07.822 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a[30943]: 2024-09-19T09:39:07.758+0000 7f888a12e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:07.822 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a[30943]: 2024-09-19T09:39:07.758+0000 7f888a12e640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:39:08.112 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:07 smithi052 podman[132570]: 2024-09-19 09:39:07.82018888 +0000 UTC m=+0.180751205 container died 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:39:08.430 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:08 smithi052 podman[132570]: 2024-09-19 09:39:08.300868336 +0000 UTC m=+0.661430649 container cleanup 3b3079e1ad5def6903e3ceedc96a9771aa8a53fa65c183ef93acb4ca35287042 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:39:08.431 INFO:journalctl@ceph.mon.a.smithi052.stdout:Sep 19 09:39:08 smithi052 bash[132570]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:39:08.667 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:39:08.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:08.716 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:39:08.716 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:39:08.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:39:09.008 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:08 smithi086 systemd[1]: Stopping Ceph mon.b for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:09.425 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-b[34809]: 2024-09-19T09:39:09.032+0000 7fd488a79640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:09.425 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-b[34809]: 2024-09-19T09:39:09.032+0000 7fd488a79640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:39:09.426 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:09 smithi086 podman[71051]: 2024-09-19 09:39:09.166005228 +0000 UTC m=+0.247993854 container died 48be049d55c65f5e2f697d288a9a8bdde36d54f2f1e6020d235c765348394655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:39:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:09 smithi086 podman[71051]: 2024-09-19 09:39:09.523673114 +0000 UTC m=+0.605661724 container cleanup 48be049d55c65f5e2f697d288a9a8bdde36d54f2f1e6020d235c765348394655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:39:09.758 INFO:journalctl@ceph.mon.b.smithi086.stdout:Sep 19 09:39:09 smithi086 bash[71051]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:39:09.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:39:09.999 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:09.999 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:39:09.999 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:39:09.999 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:39:10.295 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 systemd[1]: Stopping Ceph mon.c for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:10.595 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c[35439]: 2024-09-19T09:39:10.292+0000 7fd3abac1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:10.595 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c[35439]: 2024-09-19T09:39:10.292+0000 7fd3abac1640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:39:10.595 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 podman[70808]: 2024-09-19 09:39:10.354862998 +0000 UTC m=+0.154880226 container died 0d7f735401b6fa572d4e06f2a1a78f2280416a29f537ed1fe4014678d7575676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:39:10.863 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 podman[70808]: 2024-09-19 09:39:10.693875561 +0000 UTC m=+0.493892798 container cleanup 0d7f735401b6fa572d4e06f2a1a78f2280416a29f537ed1fe4014678d7575676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:39:10.863 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 bash[70808]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:39:11.125 INFO:journalctl@ceph.mon.c.smithi169.stdout:Sep 19 09:39:10 smithi169 podman[70820]: 2024-09-19 09:39:10.862095378 +0000 UTC m=+0.501831830 container remove 0d7f735401b6fa572d4e06f2a1a78f2280416a29f537ed1fe4014678d7575676 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:39:11.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:39:11.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:11.179 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:39:11.180 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:39:11.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:39:11.507 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 systemd[1]: Stopping Ceph mgr.x for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:11.783 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:39:11.505+0000 7facc8920640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:11.783 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x[31174]: 2024-09-19T09:39:11.505+0000 7facc8920640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T09:39:11.783 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 podman[132692]: 2024-09-19 09:39:11.536979536 +0000 UTC m=+0.147444455 container died 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:39:12.134 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 podman[132692]: 2024-09-19 09:39:11.96449079 +0000 UTC m=+0.574955700 container cleanup 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-19T09:39:12.134 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:11 smithi052 bash[132692]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:39:12.360 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:39:12.384 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:12 smithi052 podman[132703]: 2024-09-19 09:39:12.13292604 +0000 UTC m=+0.590303972 container remove 7dc7192617613a1d1a841a7756af109fbfa67c3f873f42c436431e6ec1cb3415 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:39:12.384 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:12 smithi052 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-19T09:39:12.384 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:12 smithi052 systemd[1]: Stopped Ceph mgr.x for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:39:12.385 INFO:journalctl@ceph.mgr.x.smithi052.stdout:Sep 19 09:39:12 smithi052 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.x.service: Consumed 52.019s CPU time. 2024-09-19T09:39:12.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:12.397 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:39:12.397 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:39:12.398 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:39:12.758 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:12 smithi086 systemd[1]: Stopping Ceph mgr.y for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:13.120 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:12 smithi086 podman[71172]: 2024-09-19 09:39:12.815406081 +0000 UTC m=+0.224930067 container died 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:39:13.454 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:13 smithi086 podman[71172]: 2024-09-19 09:39:13.119616372 +0000 UTC m=+0.529140355 container cleanup 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:39:13.455 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:13 smithi086 bash[71172]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:39:13.455 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:13 smithi086 podman[71185]: 2024-09-19 09:39:13.329088784 +0000 UTC m=+0.507311135 container remove 21312ba7e98ff1b33c59dcf88a61028f087cbf152bb2224d7b412f971ff0a916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T09:39:13.455 INFO:journalctl@ceph.mgr.y.smithi086.stdout:Sep 19 09:39:13 smithi086 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:39:13.475 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:39:13.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:13.509 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:39:13.509 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:39:13.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:39:13.845 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:13 smithi169 systemd[1]: Stopping Ceph mgr.z for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:14.149 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:13 smithi169 podman[70936]: 2024-09-19 09:39:13.844272595 +0000 UTC m=+0.144703574 container died a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:39:14.443 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:14 smithi169 podman[70936]: 2024-09-19 09:39:14.148590501 +0000 UTC m=+0.449021480 container cleanup a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T09:39:14.443 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:14 smithi169 bash[70936]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:39:14.443 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:14 smithi169 podman[70951]: 2024-09-19 09:39:14.37504914 +0000 UTC m=+0.521008806 container remove a9a97a0802892c63342aa837ed831e271ee190d0404d8220882cd3ad6ff4e91c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:39:14.443 INFO:journalctl@ceph.mgr.z.smithi169.stdout:Sep 19 09:39:14 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:39:14.497 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:39:14.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:14.531 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:39:14.531 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:39:14.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:39:14.829 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:14 smithi052 systemd[1]: Stopping Ceph osd.0 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:15.180 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:39:14.827+0000 7f0cb2e61640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:15.181 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:39:14.827+0000 7f0cb2e61640 -1 osd.0 84 *** Got signal Terminated *** 2024-09-19T09:39:15.181 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0[42209]: 2024-09-19T09:39:14.827+0000 7f0cb2e61640 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:20.565 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:20 smithi052 podman[132811]: 2024-09-19 09:39:20.241911402 +0000 UTC m=+5.513228119 container died 5b7d30b8cb9b1545c4470e79714b1962bb66d210a862c8bb054d9e70f5a0b8c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:39:20.930 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:20 smithi052 podman[132811]: 2024-09-19 09:39:20.728376506 +0000 UTC m=+5.999693225 container cleanup 5b7d30b8cb9b1545c4470e79714b1962bb66d210a862c8bb054d9e70f5a0b8c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:39:20.930 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:20 smithi052 bash[132811]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:39:21.313 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:20 smithi052 podman[132839]: 2024-09-19 09:39:20.979841567 +0000 UTC m=+0.735651955 container remove 5b7d30b8cb9b1545c4470e79714b1962bb66d210a862c8bb054d9e70f5a0b8c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:39:21.617 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.215002909 +0000 UTC m=+0.016741474 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:21.618 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.313993151 +0000 UTC m=+0.115731752 container create 46f0df4b18e1f2395f1997dfdfc4b68b5408fce1f3cce7de6296db44fbdc5b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:39:21.618 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.541527619 +0000 UTC m=+0.343266184 container init 46f0df4b18e1f2395f1997dfdfc4b68b5408fce1f3cce7de6296db44fbdc5b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:39:21.618 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.545063437 +0000 UTC m=+0.346801993 container start 46f0df4b18e1f2395f1997dfdfc4b68b5408fce1f3cce7de6296db44fbdc5b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:39:21.618 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.616281799 +0000 UTC m=+0.418020355 container attach 46f0df4b18e1f2395f1997dfdfc4b68b5408fce1f3cce7de6296db44fbdc5b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:39:21.931 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 19 09:39:21 smithi052 podman[132926]: 2024-09-19 09:39:21.754254251 +0000 UTC m=+0.555992807 container died 46f0df4b18e1f2395f1997dfdfc4b68b5408fce1f3cce7de6296db44fbdc5b63 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:39:22.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:39:22.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:22.617 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:39:22.617 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:39:22.618 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:39:22.917 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:22 smithi086 systemd[1]: Stopping Ceph osd.1 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:23.258 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:39:22.914+0000 7fa88accf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:23.258 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:39:22.914+0000 7fa88accf640 -1 osd.1 84 *** Got signal Terminated *** 2024-09-19T09:39:23.258 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1[39290]: 2024-09-19T09:39:22.914+0000 7fa88accf640 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:28.709 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:28 smithi086 podman[71306]: 2024-09-19 09:39:28.403012807 +0000 UTC m=+5.586188716 container died 4d5b807670f6bbc3663402b37631d4435cab44d53280e347cd234a9f1f0c72cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:39:29.008 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:28 smithi086 podman[71306]: 2024-09-19 09:39:28.798429368 +0000 UTC m=+5.981605276 container cleanup 4d5b807670f6bbc3663402b37631d4435cab44d53280e347cd234a9f1f0c72cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:39:29.008 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:28 smithi086 bash[71306]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:39:29.335 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71321]: 2024-09-19 09:39:29.024699698 +0000 UTC m=+0.621425507 container remove 4d5b807670f6bbc3663402b37631d4435cab44d53280e347cd234a9f1f0c72cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:39:29.645 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.334028344 +0000 UTC m=+0.107895229 container create 7383af97b6966d8d17281e0746c14405d401a38431782f7177fe8ec7c3d84f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:39:29.645 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.241461212 +0000 UTC m=+0.015328056 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:29.645 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.569746067 +0000 UTC m=+0.343612916 container init 7383af97b6966d8d17281e0746c14405d401a38431782f7177fe8ec7c3d84f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:39:29.645 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.573284239 +0000 UTC m=+0.347151079 container start 7383af97b6966d8d17281e0746c14405d401a38431782f7177fe8ec7c3d84f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:39:29.646 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.644415224 +0000 UTC m=+0.418282079 container attach 7383af97b6966d8d17281e0746c14405d401a38431782f7177fe8ec7c3d84f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:39:30.008 INFO:journalctl@ceph.osd.1.smithi086.stdout:Sep 19 09:39:29 smithi086 podman[71409]: 2024-09-19 09:39:29.763287148 +0000 UTC m=+0.537153988 container died 7383af97b6966d8d17281e0746c14405d401a38431782f7177fe8ec7c3d84f5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:39:30.373 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:39:30.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:30.412 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:39:30.412 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:39:30.413 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:39:30.693 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:30 smithi169 systemd[1]: Stopping Ceph osd.2 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:31.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:39:30.743+0000 7f0974966640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:31.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:39:30.743+0000 7f0974966640 -1 osd.2 84 *** Got signal Terminated *** 2024-09-19T09:39:31.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2[40439]: 2024-09-19T09:39:30.743+0000 7f0974966640 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:36.606 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:36 smithi169 podman[71075]: 2024-09-19 09:39:36.286608894 +0000 UTC m=+5.677614859 container died 11b5d4434f7e01a2dd0ed1baa7848d3ef140e02f236eea7f23581411352302df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:39:36.930 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:36 smithi169 podman[71075]: 2024-09-19 09:39:36.68590953 +0000 UTC m=+6.076915483 container cleanup 11b5d4434f7e01a2dd0ed1baa7848d3ef140e02f236eea7f23581411352302df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:39:36.930 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:36 smithi169 bash[71075]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:39:37.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:36 smithi169 podman[71090]: 2024-09-19 09:39:36.929041695 +0000 UTC m=+0.637910012 container remove 11b5d4434f7e01a2dd0ed1baa7848d3ef140e02f236eea7f23581411352302df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:39:37.500 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.230086676 +0000 UTC m=+0.103041710 container create c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:39:37.501 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.143213008 +0000 UTC m=+0.016168008 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:37.501 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.42461232 +0000 UTC m=+0.297567318 container init c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:39:37.501 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.428059332 +0000 UTC m=+0.301014318 container start c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:39:37.501 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.499262985 +0000 UTC m=+0.372217983 container attach c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:39:37.938 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:37 smithi169 podman[71179]: 2024-09-19 09:39:37.615471539 +0000 UTC m=+0.488426535 container died c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:39:38.187 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:39:38.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:38 smithi169 podman[71202]: 2024-09-19 09:39:38.169412367 +0000 UTC m=+0.548454011 container remove c4cf66ca068e7f2010f1915a70050a06529d352f3f212654a0faea786bc8f282 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:39:38.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:38 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-19T09:39:38.193 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:38 smithi169 systemd[1]: Stopped Ceph osd.2 for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:39:38.194 INFO:journalctl@ceph.osd.2.smithi169.stdout:Sep 19 09:39:38 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.2.service: Consumed 16.646s CPU time. 2024-09-19T09:39:38.228 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:38.229 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:39:38.229 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:39:38.229 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:39:38.541 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:38 smithi052 systemd[1]: Stopping Ceph osd.3 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:38.931 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:38 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:39:38.538+0000 7fb8bfb3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:38.931 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:38 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:39:38.538+0000 7fb8bfb3f640 -1 osd.3 84 *** Got signal Terminated *** 2024-09-19T09:39:38.931 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:38 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:39:38.538+0000 7fb8bfb3f640 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:41.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:40 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:40.718+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:41.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:41 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:41.670+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:41.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:41 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:41.760+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:42.639 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:42 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:39:42.185+0000 7fb8b813c640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.577622+0000 front 2024-09-19T09:39:19.577712+0000 (oldest deadline 2024-09-19T09:39:41.877812+0000) 2024-09-19T09:39:42.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:42 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:42.746+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:42.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:42 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:42.637+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:42.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:42.559+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:43.430 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:43 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3[48880]: 2024-09-19T09:39:43.156+0000 7fb8b813c640 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.577622+0000 front 2024-09-19T09:39:19.577712+0000 (oldest deadline 2024-09-19T09:39:41.877812+0000) 2024-09-19T09:39:43.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:43 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:43.307+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:43.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:43 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:43.773+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:43.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:43 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:43.605+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:43.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:43.514+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:44.241 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:43 smithi052 podman[133030]: 2024-09-19 09:39:43.980999333 +0000 UTC m=+5.550482678 container died 4ba25d54c961d678be8ba3f6410e427f9b62a0fc0466eb01d1ca58698e621794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:39:44.656 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:44 smithi052 podman[133030]: 2024-09-19 09:39:44.422996829 +0000 UTC m=+5.992480177 container cleanup 4ba25d54c961d678be8ba3f6410e427f9b62a0fc0466eb01d1ca58698e621794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:39:44.657 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:44 smithi052 bash[133030]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:39:44.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:44 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:44.307+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:44.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:44 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:44.745+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:44.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:44 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:44.655+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:44.931 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:44 smithi052 podman[133046]: 2024-09-19 09:39:44.68077711 +0000 UTC m=+0.699855245 container remove 4ba25d54c961d678be8ba3f6410e427f9b62a0fc0466eb01d1ca58698e621794 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:39:44.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:44.504+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:45.412 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.125791818 +0000 UTC m=+0.107604443 container create 89c503ccf17a6adb698bf6a61f2712d657791c3c60c173ac165eefd0e0703a5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:39:45.413 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.034600704 +0000 UTC m=+0.016413349 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:45.413 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.344445058 +0000 UTC m=+0.326257702 container init 89c503ccf17a6adb698bf6a61f2712d657791c3c60c173ac165eefd0e0703a5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:39:45.413 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.347975372 +0000 UTC m=+0.329787993 container start 89c503ccf17a6adb698bf6a61f2712d657791c3c60c173ac165eefd0e0703a5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:39:45.413 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.411226788 +0000 UTC m=+0.393039420 container attach 89c503ccf17a6adb698bf6a61f2712d657791c3c60c173ac165eefd0e0703a5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T09:39:45.680 INFO:journalctl@ceph.osd.3.smithi052.stdout:Sep 19 09:39:45 smithi052 podman[133139]: 2024-09-19 09:39:45.545710443 +0000 UTC m=+0.527523069 container died 89c503ccf17a6adb698bf6a61f2712d657791c3c60c173ac165eefd0e0703a5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T09:39:45.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:45.541+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:45.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:45.350+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:45.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:45 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:45.350+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:46.133 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:45 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:45.746+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:46.133 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:45 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:45.693+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:46.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:39:46.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:46.201 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:39:46.201 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:39:46.201 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:39:46.493 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:46 smithi086 systemd[1]: Stopping Ceph osd.4 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:46.493 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:46 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:46.343+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:46.581 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:46 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:46.309+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:46.758 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:46 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:46.491+0000 7f15ed474640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:46.758 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:46 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:46.491+0000 7f15ed474640 -1 osd.4 84 *** Got signal Terminated *** 2024-09-19T09:39:46.758 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:46 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:46.491+0000 7f15ed474640 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:46.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:46 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:46.580+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:47.180 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:46 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:46.702+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:47.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:46 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:46.728+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:47.612 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:47 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:47.351+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:47.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:47 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:47.380+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:47.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:47 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:47.611+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:48.180 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:47 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:47.735+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:48.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:47 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:47.772+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:48.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:48 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:48.582+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:48.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:48 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:48.361+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:48.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:48 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:48.395+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:49.181 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:48 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:48.694+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:49.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:48 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:48.820+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:49.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:48 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:48.987+0000 7f15e5a71640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.696559+0000 front 2024-09-19T09:39:24.696806+0000 (oldest deadline 2024-09-19T09:39:48.697171+0000) 2024-09-19T09:39:49.619 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:49 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:49.363+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:49.619 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:49 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:49.363+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:49.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:49 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:49.422+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:49.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:49 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:49.422+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:49.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:49 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:49.655+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:49.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:49 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:49.655+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:49.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:49 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:49.866+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:49.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:49 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:49.866+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:49.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:49 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:49.618+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:50.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:49 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:49.990+0000 7f15e5a71640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.696559+0000 front 2024-09-19T09:39:24.696806+0000 (oldest deadline 2024-09-19T09:39:48.697171+0000) 2024-09-19T09:39:50.630 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:50 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:50.367+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:50.630 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:50 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:50.367+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:50.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:50 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:50.628+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:50.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:50 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:50.452+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:50.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:50 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:50.452+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:50.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:50.622+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:50.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:50.622+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:50.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:50.871+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:50.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:50 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:50.871+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:50.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:50 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:50.629+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:50.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:50 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:50.715+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:51.468 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:51 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4[45929]: 2024-09-19T09:39:51.014+0000 7f15e5a71640 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.696559+0000 front 2024-09-19T09:39:24.696806+0000 (oldest deadline 2024-09-19T09:39:48.697171+0000) 2024-09-19T09:39:51.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:51 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:51.635+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:51.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:51 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:51.415+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:51.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:51 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:51.415+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:51.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:51 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:51.643+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:51.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:51 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:51.467+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:51.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:51 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:51.467+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:51.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:51.844+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:51.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:51.844+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:51.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:51.614+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:51.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:51.614+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:52.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:51 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:51.742+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:52.235 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:51 smithi086 podman[71511]: 2024-09-19 09:39:51.963727395 +0000 UTC m=+5.575144243 container died 3b96b5058fe59a26d47910402ef377d044dccfbc72ce621c46101b6b5a3177b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:39:52.505 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:52 smithi086 podman[71511]: 2024-09-19 09:39:52.32471257 +0000 UTC m=+5.936129409 container cleanup 3b96b5058fe59a26d47910402ef377d044dccfbc72ce621c46101b6b5a3177b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:39:52.505 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:52 smithi086 bash[71511]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:39:52.613 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:52.407+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:52.613 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:52.407+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:52.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:52 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:52.620+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:52.759 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:52 smithi086 podman[71528]: 2024-09-19 09:39:52.625926872 +0000 UTC m=+0.663349984 container remove 3b96b5058fe59a26d47910402ef377d044dccfbc72ce621c46101b6b5a3177b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:39:52.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:52 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:52.503+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:52.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:52 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:52.503+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:52.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:52.575+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:52.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:52.575+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:52.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:52.811+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:52.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:52 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:52.811+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:52.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:52.718+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:52.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:52.611+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:52.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:52 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:52.611+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:53.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:52 smithi086 podman[71628]: 2024-09-19 09:39:52.968371764 +0000 UTC m=+0.093926986 container create 825c725c611f94203e6b6ff48b2ae8ae102dd678429b02b53f85a13ec8a57088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:39:53.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:52 smithi086 podman[71628]: 2024-09-19 09:39:52.891619011 +0000 UTC m=+0.017174250 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:39:53.258 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:53 smithi086 podman[71628]: 2024-09-19 09:39:53.195782181 +0000 UTC m=+0.321337403 container init 825c725c611f94203e6b6ff48b2ae8ae102dd678429b02b53f85a13ec8a57088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:39:53.259 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:53 smithi086 podman[71628]: 2024-09-19 09:39:53.199117549 +0000 UTC m=+0.324672779 container start 825c725c611f94203e6b6ff48b2ae8ae102dd678429b02b53f85a13ec8a57088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:39:53.670 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:53 smithi086 podman[71628]: 2024-09-19 09:39:53.28733428 +0000 UTC m=+0.412889503 container attach 825c725c611f94203e6b6ff48b2ae8ae102dd678429b02b53f85a13ec8a57088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:39:53.670 INFO:journalctl@ceph.osd.4.smithi086.stdout:Sep 19 09:39:53 smithi086 podman[71628]: 2024-09-19 09:39:53.389778737 +0000 UTC m=+0.515333974 container died 825c725c611f94203e6b6ff48b2ae8ae102dd678429b02b53f85a13ec8a57088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:39:53.670 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:53 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:53.501+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:53.671 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:53 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:53.501+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:53.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:53 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:53.637+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:53.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:53 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:53.637+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:53.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:53 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:53.418+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:53.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:53 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:53.418+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:53.823 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:53.544+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:53.823 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:53.544+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:53.983 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:53 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:53.668+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:54.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:39:54.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:39:54.050 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:39:54.050 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:39:54.050 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:39:54.078 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:53 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:53.767+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:54.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:53.821+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:54.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:53 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:53.821+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:54.349 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 systemd[1]: Stopping Ceph osd.5 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:54.413+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:54.413+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:54.347+0000 7f9389c7f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:54.347+0000 7f9389c7f640 -1 osd.5 84 *** Got signal Terminated *** 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:54.347+0000 7f9389c7f640 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:54.628+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:54.631 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:54.628+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:54.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:54 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:54.453+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:54.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:54 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:54.453+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:54.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:54 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:54.628+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:54.844 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:54.568+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:54.844 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:54.568+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:54.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:54 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:54.793+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:55.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:54.842+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:55.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:54 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:54.842+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:55.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:55 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:55.580+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:55.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:55 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:55.580+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:55.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:55 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:55.434+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:55.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:55 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:55.434+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:55.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:55 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:55.622+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:55.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:55 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:55.436+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:55.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:55 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:55.436+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:55.862 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:55.551+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:55.862 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:55.551+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:56.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:55.861+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:56.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:55 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:55.861+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:56.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:55 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:55.812+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:56.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:56 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:56.561+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:56.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:56 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:56.561+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:56.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:56 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:56.388+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:56.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:56 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:56.388+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:56.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:56 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:56.616+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:56.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:56 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:56.451+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:56.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:56 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:56.451+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:56.837 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:56.521+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:56.837 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:56.521+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:57.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:56.836+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:57.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:56.836+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:57.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:56 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:56.769+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:57.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:57.377+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:57.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:57.377+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:57.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:57.596+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:57.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:57.596+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:57.694 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:57.596+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.532055+0000 front 2024-09-19T09:39:34.532010+0000 (oldest deadline 2024-09-19T09:39:56.832181+0000) 2024-09-19T09:39:57.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:57 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:57.587+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:57.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:57 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:57.442+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:57.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:57 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:57.442+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:57.818 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:57 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:57.531+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:57.818 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:57 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:57.531+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:58.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:57 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:57.816+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:58.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:57 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:57.816+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:58.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:57 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:57.737+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:58.626 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:58.369+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:58.626 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:58.369+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:58.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:58 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:58.610+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:58.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:58 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:58.610+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:39:58.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:58 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:58.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:58.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:58 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:58.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:58.769 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:58 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:58.486+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:58.769 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:58 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:58.486+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:58.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:58.724+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:39:58.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:58.624+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:18.829468+0000 front 2024-09-19T09:39:18.829372+0000 (oldest deadline 2024-09-19T09:39:42.329441+0000) 2024-09-19T09:39:58.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:58.624+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.329842+0000 front 2024-09-19T09:39:22.329942+0000 (oldest deadline 2024-09-19T09:39:51.730479+0000) 2024-09-19T09:39:58.943 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:58 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5[46925]: 2024-09-19T09:39:58.624+0000 7f9386284640 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.532055+0000 front 2024-09-19T09:39:34.532010+0000 (oldest deadline 2024-09-19T09:39:56.832181+0000) 2024-09-19T09:39:59.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:58 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:58.768+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:59.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:58 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:58.768+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:59.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:59.403+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:39:59.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:39:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:39:59.403+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:39:59.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:59 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:59.621+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:39:59.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:39:59 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:39:59.621+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:39:59.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:59 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:59.411+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:39:59.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:39:59 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:39:59.411+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:39:59.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:59.498+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:39:59.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:39:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:39:59.498+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:39:59.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:59.722+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:39:59.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:59.722+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:39:59.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:39:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:39:59.722+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:00.057 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:39:59 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:39:59.697+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:00.058 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:39:59 smithi169 podman[71294]: 2024-09-19 09:39:59.775648533 +0000 UTC m=+5.524182404 container died c7656603d5efdc78287ea4062da7d5c839994818e92848ef3f14a092bea8b8dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:40:00.425 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71294]: 2024-09-19 09:40:00.163988926 +0000 UTC m=+5.912522799 container cleanup c7656603d5efdc78287ea4062da7d5c839994818e92848ef3f14a092bea8b8dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:40:00.425 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 bash[71294]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:40:00.693 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71310]: 2024-09-19 09:40:00.423597509 +0000 UTC m=+0.640961088 container remove c7656603d5efdc78287ea4062da7d5c839994818e92848ef3f14a092bea8b8dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:40:00.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:00.440+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:00.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:00.440+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:00.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:00.574+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:00.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:00.574+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:00.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:00.368+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:00.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:00.368+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:00.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:00 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:00.368+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:00.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:00.515+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:00.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:00.515+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:00.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:00.515+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:00.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:00.676+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:00.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:00.676+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:00.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:00 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:00.676+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:01.028 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:00 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:00.746+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:01.028 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71406]: 2024-09-19 09:40:00.639455159 +0000 UTC m=+0.015875376 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:01.028 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71406]: 2024-09-19 09:40:00.741424103 +0000 UTC m=+0.117844302 container create 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:40:01.028 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71406]: 2024-09-19 09:40:00.952055068 +0000 UTC m=+0.328475264 container init 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:01.028 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:00 smithi169 podman[71406]: 2024-09-19 09:40:00.955292959 +0000 UTC m=+0.331713162 container start 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:01.029 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 podman[71406]: 2024-09-19 09:40:01.02708642 +0000 UTC m=+0.403506626 container attach 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:40:01.408 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 podman[71406]: 2024-09-19 09:40:01.15428916 +0000 UTC m=+0.530709364 container died 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:40:01.623 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:01.341+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:01.623 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:01.341+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:01.623 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:01.341+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:01.650 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:40:01.694 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 podman[71429]: 2024-09-19 09:40:01.630517368 +0000 UTC m=+0.467348424 container remove 35d415755349c98921456fd0e95ff45451af0972636b9e935ef725f2bb59ad62 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 systemd[1]: Stopped Ceph osd.5 for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.5.smithi169.stdout:Sep 19 09:40:01 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.5.service: Consumed 14.451s CPU time. 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:01 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:01.405+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:01 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:01.405+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:01.695 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:01 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:01.405+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:01.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:01.731 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:40:01.731 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:40:01.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:01.474+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:01.474+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:01.474+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:01.643+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:01.643+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:01.761 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:01 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:01.643+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:02.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:01.621+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:02.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:01 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:01.621+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:02.045 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:01 smithi052 systemd[1]: Stopping Ceph osd.6 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:02.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:01 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:01.725+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:02.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:01 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:01.725+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:02.430 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.043+0000 7f0ac289d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:02.431 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.043+0000 7f0ac289d640 -1 osd.6 84 *** Got signal Terminated *** 2024-09-19T09:40:02.431 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.043+0000 7f0ac289d640 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:02.657 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:02 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:02.382+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:02.657 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:02 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:02.382+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:02.657 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:02 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:02.382+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:02.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:02 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:02.373+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:02.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:02 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:02.373+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:02.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:02 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:02.373+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:02.923 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:02 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:02.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:02.923 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:02 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:02.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:02.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.505+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:02.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.505+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:02.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:02.505+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:02.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:02.664+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:02.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:02.664+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:02.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:02 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:02.665+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:03.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:02 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:02.740+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:03.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:02 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:02.740+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:03.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:03 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:03.388+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:03.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:03 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:03.388+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:03.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:03 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:03.388+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:03.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:03 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:03.644+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:03.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:03 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:03.644+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:03.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:03 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:03.400+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:03.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:03 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:03.400+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:03.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:03 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:03.400+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:03.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:03.554+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:03.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:03.554+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:03.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:03.554+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:03.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:03.707+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:03.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:03.707+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:03.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:03 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:03.707+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:04.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:03 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:03.777+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:04.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:03 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:03.777+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:04.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:04 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:04.406+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:04.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:04 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:04.406+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:04.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:04 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:04.406+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:04.695 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:04 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:04.418+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:04.695 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:04 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:04.418+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:04.695 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:04 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:04.418+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:04.579+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:04.579+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:04.579+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:04.704+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:04.704+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:04.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:04 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:04.704+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:05.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:04 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:04.693+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:05.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:04 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:04.693+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:05.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:04 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:04.761+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:05.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:04 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:04.761+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:05.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:05 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:05.404+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:05.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:05 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:05.404+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:05.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:05 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:05.404+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:05.722 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:05.456+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:05.722 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:05.456+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:05.723 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:05.456+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:05.723 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:05.456+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:05.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:05.621+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:05.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:05.621+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:05.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:05.621+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:05.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:05.728+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:05.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:05.728+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:05.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:05.728+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:05.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:05 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:05.728+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:06.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:05.720+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:06.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:05.720+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:06.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:05.720+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:06.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:05 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:05.802+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:06.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:05 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:05.802+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:06.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:06.357+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:06.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:06.357+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:06.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:06.357+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:06.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:06.357+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:06.745 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:06.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:06.746 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:06.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:06.746 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:06.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:06.746 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:06.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:06.930 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:06.611+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:15.234200+0000 front 2024-09-19T09:39:15.234117+0000 (oldest deadline 2024-09-19T09:39:41.134170+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:06.611+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:24.035349+0000 front 2024-09-19T09:39:24.035334+0000 (oldest deadline 2024-09-19T09:39:49.335149+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6[55807]: 2024-09-19T09:40:06.611+0000 7f0abae9a640 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.536804+0000 front 2024-09-19T09:39:34.536848+0000 (oldest deadline 2024-09-19T09:39:59.836967+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:06.724+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:06.724+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:06.724+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:06.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:06 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:06.724+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:07.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:06.744+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:07.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:06.744+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:07.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:06 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:06.744+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:07.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:06.779+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:07.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:06 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:06.779+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:07.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:07.326+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:07.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:07.326+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:07.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:07.326+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:07.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:07.326+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:07.695 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:07 smithi052 podman[133254]: 2024-09-19 09:40:07.442377068 +0000 UTC m=+5.501836362 container died a8348ea1ba48a28a8a3a76a53509d52e0449bd2e099952b57ae88a69ecf8efcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:40:07.699 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:07.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:07.699 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:07.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:07.699 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:07.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:07.699 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:07.430+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:08.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:07.697+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:08.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:07.697+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:08.008 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:07 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:07.697+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:08.079 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:07 smithi052 podman[133254]: 2024-09-19 09:40:07.859611324 +0000 UTC m=+5.919070650 container cleanup a8348ea1ba48a28a8a3a76a53509d52e0449bd2e099952b57ae88a69ecf8efcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:40:08.079 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:07 smithi052 bash[133254]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:40:08.079 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:07.730+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:08.079 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:07.730+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:08.079 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:07.730+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:08.080 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:07 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:07.730+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:08.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:07.816+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:08.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:07.816+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:08.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:07 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:07.816+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:08.430 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133269]: 2024-09-19 09:40:08.077715161 +0000 UTC m=+0.632022726 container remove a8348ea1ba48a28a8a3a76a53509d52e0449bd2e099952b57ae88a69ecf8efcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T09:40:08.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:08.287+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:08.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:08.287+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:08.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:08.287+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:08.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:08.287+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:08.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:08.649+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:08.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:08.649+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:08.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:08.649+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:08.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:08.476+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:08.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:08.476+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:08.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:08.476+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:08.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:08 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:08.476+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:08.823 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:08 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:08.735+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:08 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:08.735+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:08 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:08.735+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:08 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:08.735+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.495252364 +0000 UTC m=+0.105818891 container create 615acd9a4304e97b44b4522437586b3a9dcfe037fd9f58281f2fde98bdf9414d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.405508026 +0000 UTC m=+0.016074523 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.739519272 +0000 UTC m=+0.350085762 container init 615acd9a4304e97b44b4522437586b3a9dcfe037fd9f58281f2fde98bdf9414d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.742966402 +0000 UTC m=+0.353532885 container start 615acd9a4304e97b44b4522437586b3a9dcfe037fd9f58281f2fde98bdf9414d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:08.824 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.822721745 +0000 UTC m=+0.433288228 container attach 615acd9a4304e97b44b4522437586b3a9dcfe037fd9f58281f2fde98bdf9414d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:40:09.181 INFO:journalctl@ceph.osd.6.smithi052.stdout:Sep 19 09:40:08 smithi052 podman[133355]: 2024-09-19 09:40:08.941074781 +0000 UTC m=+0.551641281 container died 615acd9a4304e97b44b4522437586b3a9dcfe037fd9f58281f2fde98bdf9414d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:40:09.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:08.831+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:09.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:08.831+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:09.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:08 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:08.831+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:09.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:40:09.668 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:09.669 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:40:09.669 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:40:09.669 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:40:09.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:09.334+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:09.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:09.334+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:09.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:09.334+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:09.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:09.334+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:09.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:09 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:09.715+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:09.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:09 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:09.715+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:09.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:09 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:09.715+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:09.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:09 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:09.715+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:09.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:09.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:09.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:09.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:09.970 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:09.971 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:09.971 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 systemd[1]: Stopping Ceph osd.7 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:09.971 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.968+0000 7f7b6974b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:09.971 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.968+0000 7f7b6974b640 -1 osd.7 84 *** Got signal Terminated *** 2024-09-19T09:40:09.971 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:09.968+0000 7f7b6974b640 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:10.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:09.813+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:10.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:09.813+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:10.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:09 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:09.813+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:10.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:10.291+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:10.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:10.291+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:10.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:10.291+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:10.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:10.291+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:10.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:10.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:10.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:10.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:10.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:10.657+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:10.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:10.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:10.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:10.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:10.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:10.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:10.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:10 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:10.465+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:11.180 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:10.727+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:11.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:10.727+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:11.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:10.727+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:11.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:10 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:10.727+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:11.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:10.766+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:11.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:10.766+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:11.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:10 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:10.766+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:11.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:11.286+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:11.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:11.286+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:11.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:11.286+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:11.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:11.286+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:11.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:11.617+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:11.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:11.617+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:11.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:11.617+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:11.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:11.420+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:11.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:11.420+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:11.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:11.420+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:11.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:11 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:11.420+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:12.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:11.733+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:12.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:11.733+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:12.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:11.733+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:12.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:11 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:11.733+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:12.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:11.756+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:12.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:11.756+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:12.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:11 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:11.756+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:12.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:12.288+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:12.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:12.288+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:12.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:12.288+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:12.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:12.288+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:12.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:12.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:12.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:12.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:12.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:12.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:12.655+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.119534+0000 front 2024-09-19T09:39:51.119516+0000 (oldest deadline 2024-09-19T09:40:12.219621+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:12.448+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:12.448+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:12.448+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:12.448+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:12.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:12 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:12.448+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:13.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:12.693+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:13.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:12.693+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:13.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:12.693+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:13.181 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:12 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:12.693+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:13.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:12.805+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:13.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:12.805+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:13.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:12.805+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:13.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:12 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:12.805+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:13.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:13.268+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:13.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:13.268+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:13.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:13.268+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:13.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:13.268+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:13.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:13.268+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:13.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:13.475+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:13.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:13.475+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:13.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:13.475+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:13.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:13.475+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:13.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:13.475+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:13.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:13.660+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:13.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:13.660+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:13.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:13.660+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:13.759 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:13.660+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.119534+0000 front 2024-09-19T09:39:51.119516+0000 (oldest deadline 2024-09-19T09:40:12.219621+0000) 2024-09-19T09:40:13.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:13 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:13.658+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:13.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:13 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:13.658+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:13.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:13 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:13.658+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:13.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:13 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:13.658+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:13.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:13 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:13.658+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:14.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:13.759+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:14.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:13.759+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:14.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:13.759+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:14.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:13 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:13.759+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:14.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:14.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:14.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:14.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:14.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:14.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:14.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:14.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:14.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:14.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:14.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:14.645+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.915591+0000 front 2024-09-19T09:39:27.915613+0000 (oldest deadline 2024-09-19T09:39:49.615698+0000) 2024-09-19T09:40:14.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:14.645+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.417188+0000 front 2024-09-19T09:39:35.417301+0000 (oldest deadline 2024-09-19T09:39:57.717118+0000) 2024-09-19T09:40:14.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:14.645+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:37.717669+0000 front 2024-09-19T09:39:37.717718+0000 (oldest deadline 2024-09-19T09:40:04.718129+0000) 2024-09-19T09:40:14.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7[52914]: 2024-09-19T09:40:14.645+0000 7f7b65d50640 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.119534+0000 front 2024-09-19T09:39:51.119516+0000 (oldest deadline 2024-09-19T09:40:12.219621+0000) 2024-09-19T09:40:14.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:14.459+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:14.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:14.459+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:14.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:14.459+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:14.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:14.459+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:14.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:14 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:14.459+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:14.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:14.661+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:14.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:14.661+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:14.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:14.661+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:14.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:14.661+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:14.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:14 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:14.661+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:15.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:14.722+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:15.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:14.722+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:15.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:14.722+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:15.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:14 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:14.722+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:15.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:15.273+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:15.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:15.273+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:15.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:15.273+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:15.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:15.273+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:15.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:15.273+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:15.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:15 smithi086 podman[71732]: 2024-09-19 09:40:15.503734105 +0000 UTC m=+5.633515404 container died 90be88f526ef9129f50e296ff5db7a1c2956ec6feb40e2248747914c9c29d498 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:40:15.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:15 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:15.471+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:15.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:15 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:15.472+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:15.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:15 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:15.472+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:15.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:15 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:15.472+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:15.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:15 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:15.472+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:15.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:15 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:15.623+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:15.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:15 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:15.623+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:15.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:15 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:15.623+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:15.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:15 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:15.623+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:15.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:15 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:15.623+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:16.045 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:15 smithi086 podman[71732]: 2024-09-19 09:40:15.850930825 +0000 UTC m=+5.980712130 container cleanup 90be88f526ef9129f50e296ff5db7a1c2956ec6feb40e2248747914c9c29d498 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:40:16.045 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:15 smithi086 bash[71732]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:40:16.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:15.755+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:16.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:15.755+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:16.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:15.755+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:16.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:15 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:15.755+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:16.462 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71748]: 2024-09-19 09:40:16.044048417 +0000 UTC m=+0.533714285 container remove 90be88f526ef9129f50e296ff5db7a1c2956ec6feb40e2248747914c9c29d498 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:40:16.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:16.252+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:16.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:16.252+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:16.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:16.252+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:16.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:16.252+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:16.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:16.252+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:16.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.461268023 +0000 UTC m=+0.112093025 container create 4dc7ca0f50123092565f6f8ae9827001e263a6997f08814430960337d9d4dee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:40:16.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.364908901 +0000 UTC m=+0.015733908 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:16.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.68859214 +0000 UTC m=+0.339417151 container init 4dc7ca0f50123092565f6f8ae9827001e263a6997f08814430960337d9d4dee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:40:16.758 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.691855593 +0000 UTC m=+0.342680608 container start 4dc7ca0f50123092565f6f8ae9827001e263a6997f08814430960337d9d4dee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:16.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:16 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:16.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:16.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:16 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:16.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:16.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:16 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:16.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:16.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:16 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:16.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:16.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:16 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:16.508+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:16.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:16 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:16.621+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:16.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:16 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:16.621+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:16.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:16 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:16.621+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:16.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:16 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:16.621+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:16.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:16 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:16.621+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:17.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:16.706+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:17.193 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:16.706+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:17.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:16.706+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:17.194 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:16 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:16.706+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:17.198 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.763299902 +0000 UTC m=+0.414124908 container attach 4dc7ca0f50123092565f6f8ae9827001e263a6997f08814430960337d9d4dee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:40:17.198 INFO:journalctl@ceph.osd.7.smithi086.stdout:Sep 19 09:40:16 smithi086 podman[71838]: 2024-09-19 09:40:16.885787135 +0000 UTC m=+0.536612139 container died 4dc7ca0f50123092565f6f8ae9827001e263a6997f08814430960337d9d4dee8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-19T09:40:17.483 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:40:17.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:17.523 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:40:17.523 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:40:17.523 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:40:17.551 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:17.238+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:17.551 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:17.238+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:17.551 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:17.238+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:17.551 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:17.238+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:17.552 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:17.238+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:17.732 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:17.554+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:17.732 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:17.554+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:17.732 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:17.554+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:17.732 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:17.554+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:17.732 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:17.554+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 systemd[1]: Stopping Ceph osd.8 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.681+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.681+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.681+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.681+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.840+0000 7f702e2e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.840+0000 7f702e2e4640 -1 osd.8 84 *** Got signal Terminated *** 2024-09-19T09:40:17.843 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:17 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:17.840+0000 7f702e2e4640 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:17.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:17 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:17.619+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:17.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:17 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:17.619+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:17.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:17 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:17.619+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:17.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:17 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:17.619+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:17.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:17 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:17.619+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:18.678 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:18.192+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:18.678 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:18.192+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:18.678 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:18.192+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:18.678 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:18.192+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:18.678 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:18.192+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:18.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:18 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:18.601+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:18.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:18 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:18.601+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:18.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:18 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:18.601+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:18.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:18 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:18.601+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:18.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:18 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:18.601+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:18.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:18.676+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:18.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:18.676+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:18.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:18.676+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:18.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:18 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:18.676+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:19.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:18.594+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:19.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:18.594+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:19.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:18.594+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:19.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:18.594+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:19.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:18 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:18.594+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:19.673 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:19.215+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:19.673 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:19.215+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:19.673 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:19.215+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:19.674 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:19.215+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:19.674 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:19.215+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:19.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:19 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:19.552+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:19.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:19 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:19.552+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:19.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:19 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:19.552+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:19.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:19 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:19.552+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:19.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:19 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:19.552+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:19.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:19.671+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:19.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:19.671+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:19.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:19.671+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:19.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:19 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:19.671+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:20.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:19 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:19.562+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:20.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:19 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:19.562+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:20.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:19 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:19.562+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:20.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:19 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:19.562+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:20.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:19 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:19.562+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:20.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:20.173+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:20.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:20.173+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:20.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:20.173+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:20.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:20.173+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:20.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:20.173+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:20.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:20.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:20.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:20.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:20.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:20.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:20 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:20.574+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:20.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:20.624+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:20.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:20.624+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:20.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:20.624+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:20.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:20 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:20.624+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:21.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:20.576+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:21.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:20.576+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:21.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:20.576+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:21.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:20.576+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:21.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:20 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:20.576+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:21.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:21.163+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:21.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:21.163+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:21.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:21.163+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:21.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:21.163+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:21.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:21.163+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:21.909 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:21 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:21.624+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:21.910 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:21 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:21.624+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:21.910 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:21 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:21.624+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:21.910 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:21 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:21.624+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:21.910 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:21 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:21.624+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:21.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:21.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:21.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:21.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:21.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:21.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:21 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:21.540+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:21.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:21.665+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:21.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:21.665+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:21.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:21.665+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:21.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:21 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:21.665+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:22.680 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:22.206+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:22.680 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:22.206+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:22.681 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:22.206+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:22.681 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:22.206+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:22.681 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:22.206+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:22.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:22.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:22.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:22.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:22.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:22.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:22 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:22.501+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:22.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:22.678+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.717661+0000 front 2024-09-19T09:39:27.717742+0000 (oldest deadline 2024-09-19T09:39:49.918261+0000) 2024-09-19T09:40:22.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:22.678+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:35.719496+0000 front 2024-09-19T09:39:35.719474+0000 (oldest deadline 2024-09-19T09:40:01.019632+0000) 2024-09-19T09:40:22.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:22.678+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:43.221033+0000 front 2024-09-19T09:39:43.221124+0000 (oldest deadline 2024-09-19T09:40:07.321118+0000) 2024-09-19T09:40:22.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:22.678+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:47.321797+0000 front 2024-09-19T09:39:47.321784+0000 (oldest deadline 2024-09-19T09:40:12.621670+0000) 2024-09-19T09:40:22.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8[53436]: 2024-09-19T09:40:22.678+0000 7f70268e1640 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.522613+0000 front 2024-09-19T09:39:58.522591+0000 (oldest deadline 2024-09-19T09:40:22.022886+0000) 2024-09-19T09:40:23.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:23.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:23.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:23.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:23.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:23.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:22 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:22.608+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:23.352 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:23 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:23.187+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:23.352 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:23 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:23.187+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:23.352 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:23 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:23.187+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:23.353 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:23 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:23.187+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:23.353 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:23 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:23.187+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:23.684 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:23 smithi169 podman[71509]: 2024-09-19 09:40:23.35107155 +0000 UTC m=+5.636594021 container died 27bf1e69899748ae652bdb4aa66b79a5b96085dbeb1a132c5b4f70f58d3c443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:40:23.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:23.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:23.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:23.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:23.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:23.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:23 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:23.525+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:23.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:23 smithi169 podman[71509]: 2024-09-19 09:40:23.682897158 +0000 UTC m=+5.968419639 container cleanup 27bf1e69899748ae652bdb4aa66b79a5b96085dbeb1a132c5b4f70f58d3c443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:40:23.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:23 smithi169 bash[71509]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:40:23.944 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:23 smithi169 podman[71534]: 2024-09-19 09:40:23.892576758 +0000 UTC m=+0.540214782 container remove 27bf1e69899748ae652bdb4aa66b79a5b96085dbeb1a132c5b4f70f58d3c443c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:40:24.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:24.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:24.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:24.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:24.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:24.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:23 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:23.603+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:24.303 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:24.174+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:24.303 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:24.174+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:24.303 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:24.174+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:24.303 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:24.174+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:24.303 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:24 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:24.174+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:24.613 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.301888516 +0000 UTC m=+0.108939678 container create 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:40:24.614 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.209051467 +0000 UTC m=+0.016102641 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:24.614 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.529368027 +0000 UTC m=+0.336419190 container init 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:40:24.614 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.532875838 +0000 UTC m=+0.339927004 container start 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:40:24.614 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.612574784 +0000 UTC m=+0.419625964 container attach 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:24.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:24 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:24.490+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:24.943 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:24 smithi169 podman[71623]: 2024-09-19 09:40:24.724982975 +0000 UTC m=+0.532034146 container died 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:40:25.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:25.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:25.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:25.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:25.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:25.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:24 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:24.573+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:25.248 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:25 smithi169 podman[71646]: 2024-09-19 09:40:25.224641904 +0000 UTC m=+0.493375054 container remove 37e0ac71b330e2ca8aa3a8a0066214a4c60fee95d717659aba3870e1d5abab27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:25 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.8.service: Deactivated successfully. 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:25 smithi169 systemd[1]: Stopped Ceph osd.8 for 044f38fa-7667-11ef-bceb-c7b262605968. 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.8.smithi169.stdout:Sep 19 09:40:25 smithi169 systemd[1]: ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.8.service: Consumed 11.511s CPU time. 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:25.313 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:25.314 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:25.314 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:25.314 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:25.314 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:25.213+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:25.329 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:25.329 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:40:25.329 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:40:25.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 systemd[1]: Stopping Ceph osd.9 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:25.639 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:25.640 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.520+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:25.640 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.637+0000 7f5fa8822640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:25.640 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.637+0000 7f5fa8822640 -1 osd.9 84 *** Got signal Terminated *** 2024-09-19T09:40:25.640 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:25 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:25.637+0000 7f5fa8822640 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:26.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:26.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:26.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:26.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:26.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:26.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:25 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:25.605+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:26.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:26.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:26.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:26.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:26.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:26.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:26 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:26.229+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:26.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:26 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:26.530+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:27.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:27.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:27.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:27.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:27.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:27.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:26 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:26.588+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:27.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:27.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:27.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:27.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:27.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:27.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:27 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:27.262+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:27.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:27 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:27.535+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:28.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:28.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:28.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:28.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:28.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:28.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:27 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:27.633+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:28.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:28.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:28.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:28.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:28.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:28.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:28 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:28.244+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:28.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:28.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:28.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:28.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:28.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:28.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:28 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:28.531+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:29.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:29.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:29.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:29.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:29.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:29.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:28 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:28.677+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:29.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:29.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:29.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:29.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:29.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:29.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:29.250+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:29.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:29.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:29.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:29.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:29.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:29.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:29 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:29.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:30.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.705+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.705+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.705+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.705+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.706+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.706+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:30.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:29 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:29.706+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:30.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:30.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:30.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:30.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:30.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:30.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:30 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:30.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:30.930 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:16.994564+0000 front 2024-09-19T09:39:16.994552+0000 (oldest deadline 2024-09-19T09:39:40.494761+0000) 2024-09-19T09:40:30.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:26.796640+0000 front 2024-09-19T09:39:26.796667+0000 (oldest deadline 2024-09-19T09:39:49.696745+0000) 2024-09-19T09:40:30.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.397793+0000 front 2024-09-19T09:39:34.397774+0000 (oldest deadline 2024-09-19T09:39:59.697986+0000) 2024-09-19T09:40:30.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:39.698356+0000 front 2024-09-19T09:39:39.698392+0000 (oldest deadline 2024-09-19T09:40:05.598576+0000) 2024-09-19T09:40:30.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:51.300918+0000 front 2024-09-19T09:39:51.300959+0000 (oldest deadline 2024-09-19T09:40:13.000668+0000) 2024-09-19T09:40:30.931 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:30 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9[62374]: 2024-09-19T09:40:30.581+0000 7f5fa0e1f640 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.102316+0000 front 2024-09-19T09:39:58.102423+0000 (oldest deadline 2024-09-19T09:40:19.802215+0000) 2024-09-19T09:40:31.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:31.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:30 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:30.710+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:31.348 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:31 smithi052 podman[133470]: 2024-09-19 09:40:31.070715247 +0000 UTC m=+5.536360899 container died 8fc7a8335c1b450a39239b8909a35cd8fc1b91edb30602d3036119d637a922ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:31.681 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:31 smithi052 podman[133470]: 2024-09-19 09:40:31.520979617 +0000 UTC m=+5.986625255 container cleanup 8fc7a8335c1b450a39239b8909a35cd8fc1b91edb30602d3036119d637a922ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:40:31.681 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:31 smithi052 bash[133470]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:31.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:31 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:31.216+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:31.995 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:31 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:31.732+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:32.099 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:31 smithi052 podman[133485]: 2024-09-19 09:40:31.688990754 +0000 UTC m=+0.611047623 container remove 8fc7a8335c1b450a39239b8909a35cd8fc1b91edb30602d3036119d637a922ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:40:32.385 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.098044861 +0000 UTC m=+0.111808201 container create a6082e1dad6b9bfa2a18edd0f9f8639e92694162b52881f6558569f3ad74a44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:40:32.385 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.002437706 +0000 UTC m=+0.016201052 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:32.385 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.300284467 +0000 UTC m=+0.314047820 container init a6082e1dad6b9bfa2a18edd0f9f8639e92694162b52881f6558569f3ad74a44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:40:32.385 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.303930051 +0000 UTC m=+0.317693385 container start a6082e1dad6b9bfa2a18edd0f9f8639e92694162b52881f6558569f3ad74a44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:40:32.385 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.383614701 +0000 UTC m=+0.397378048 container attach a6082e1dad6b9bfa2a18edd0f9f8639e92694162b52881f6558569f3ad74a44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:32.680 INFO:journalctl@ceph.osd.9.smithi052.stdout:Sep 19 09:40:32 smithi052 podman[133572]: 2024-09-19 09:40:32.494260034 +0000 UTC m=+0.508023392 container died a6082e1dad6b9bfa2a18edd0f9f8639e92694162b52881f6558569f3ad74a44b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:40:32.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:32.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:32.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:32.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:32.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:32.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:32 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:32.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:33.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:40:33.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:33.213 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:40:33.214 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:40:33.214 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:33.242 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:32 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:32.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:33.508 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 systemd[1]: Stopping Ceph osd.10 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:33.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:33.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:33.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:33.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:33.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:33.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:33.195+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:33.810 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.509+0000 7f5e586d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:33.811 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.509+0000 7f5e586d3640 -1 osd.10 84 *** Got signal Terminated *** 2024-09-19T09:40:33.811 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.509+0000 7f5e586d3640 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:34.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:34.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:34.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:34.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:34.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:34.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:34.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:33 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:33.809+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:34.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:34.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:34.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:34.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:34.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:34.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:34 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:34.160+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:35.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:35.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:35.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:35.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:35.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:35.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:35.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:34 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:34.769+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:35.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:35.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:35.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:35.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:35.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:35.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:35 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:35.140+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:36.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:36.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:36.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:36.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:36.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:36.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:36.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:35 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:35.760+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:36.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:36.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:36.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:36.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:36.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:36.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:36 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:36.182+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:37.008 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:37.009 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:36 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:36.745+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:37.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:37.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:37.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:37.443 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:37.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:37.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:37.444 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:37 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:37.180+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:38.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.033882+0000 front 2024-09-19T09:39:19.033932+0000 (oldest deadline 2024-09-19T09:39:42.533828+0000) 2024-09-19T09:40:38.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:22.534237+0000 front 2024-09-19T09:39:22.534269+0000 (oldest deadline 2024-09-19T09:39:48.434393+0000) 2024-09-19T09:40:38.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.235951+0000 front 2024-09-19T09:39:34.236030+0000 (oldest deadline 2024-09-19T09:39:59.535914+0000) 2024-09-19T09:40:38.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:41.837017+0000 front 2024-09-19T09:39:41.837034+0000 (oldest deadline 2024-09-19T09:40:05.336812+0000) 2024-09-19T09:40:38.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.637808+0000 front 2024-09-19T09:39:50.637824+0000 (oldest deadline 2024-09-19T09:40:12.337796+0000) 2024-09-19T09:40:38.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:59.339423+0000 front 2024-09-19T09:39:59.339218+0000 (oldest deadline 2024-09-19T09:40:21.639029+0000) 2024-09-19T09:40:38.259 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:37 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10[59676]: 2024-09-19T09:40:37.777+0000 7f5e50cd0640 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.52:6822 osd.6 since back 2024-09-19T09:40:06.939917+0000 front 2024-09-19T09:40:06.939878+0000 (oldest deadline 2024-09-19T09:40:29.239922+0000) 2024-09-19T09:40:38.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:38.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:38.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:38.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:38.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:38.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:38.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:38 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:38.214+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:39.258 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:38 smithi086 podman[71951]: 2024-09-19 09:40:38.965212693 +0000 UTC m=+5.559537955 container died 105dc685a83d0b4a84cb9b97e8f5b2e6b394cad7c85bd699029d6816de1d6354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:40:39.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:39.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:39.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:39.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:39.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:39.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:39.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:39 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:39.246+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:39.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:39 smithi086 podman[71951]: 2024-09-19 09:40:39.259665495 +0000 UTC m=+5.853990758 container cleanup 105dc685a83d0b4a84cb9b97e8f5b2e6b394cad7c85bd699029d6816de1d6354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:40:39.758 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:39 smithi086 bash[71951]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:40:39.759 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:39 smithi086 podman[71966]: 2024-09-19 09:40:39.435772648 +0000 UTC m=+0.468998151 container remove 105dc685a83d0b4a84cb9b97e8f5b2e6b394cad7c85bd699029d6816de1d6354 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:40.165 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:39 smithi086 podman[72058]: 2024-09-19 09:40:39.765625888 +0000 UTC m=+0.015566718 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:40.165 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:39 smithi086 podman[72058]: 2024-09-19 09:40:39.869663576 +0000 UTC m=+0.119604398 container create f398a99e2a46b2e147377f1794353e063cb77a00395ef1bfe77d22da06227576 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:40:40.165 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:40 smithi086 podman[72058]: 2024-09-19 09:40:40.080148041 +0000 UTC m=+0.330088859 container init f398a99e2a46b2e147377f1794353e063cb77a00395ef1bfe77d22da06227576 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:40:40.165 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:40 smithi086 podman[72058]: 2024-09-19 09:40:40.083250538 +0000 UTC m=+0.333191358 container start f398a99e2a46b2e147377f1794353e063cb77a00395ef1bfe77d22da06227576 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:40:40.165 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:40 smithi086 podman[72058]: 2024-09-19 09:40:40.163354214 +0000 UTC m=+0.413295056 container attach f398a99e2a46b2e147377f1794353e063cb77a00395ef1bfe77d22da06227576 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:40.508 INFO:journalctl@ceph.osd.10.smithi086.stdout:Sep 19 09:40:40 smithi086 podman[72058]: 2024-09-19 09:40:40.271454031 +0000 UTC m=+0.521394851 container died f398a99e2a46b2e147377f1794353e063cb77a00395ef1bfe77d22da06227576 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:40:40.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:40.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:40.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:40.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:40.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:40.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:40.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:40.199+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:40.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:40:40.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:40.922 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:40:40.922 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:40:40.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:40:41.232 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:40 smithi169 systemd[1]: Stopping Ceph osd.11 for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:41.232 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.193+0000 7f68ec06e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:41.232 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.193+0000 7f68ec06e640 -1 osd.11 84 *** Got signal Terminated *** 2024-09-19T09:40:41.232 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.193+0000 7f68ec06e640 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:41.233 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:41 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:41.231+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:42.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:42.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:42.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:42.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:42.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:42.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:42.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:42 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:42.197+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:43.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:43.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:43.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:43.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:43.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:43.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:43.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:43 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:43.226+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:44.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:44.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:44.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:44.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:44.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:44.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:44.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:44.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:44 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:44.204+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6820 osd.8 since back 2024-09-19T09:40:22.426881+0000 front 2024-09-19T09:40:22.426917+0000 (oldest deadline 2024-09-19T09:40:44.027284+0000) 2024-09-19T09:40:45.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-19T09:39:19.117660+0000 front 2024-09-19T09:39:19.117646+0000 (oldest deadline 2024-09-19T09:39:44.417477+0000) 2024-09-19T09:40:45.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6804 osd.1 since back 2024-09-19T09:39:27.318644+0000 front 2024-09-19T09:39:27.318453+0000 (oldest deadline 2024-09-19T09:39:48.418650+0000) 2024-09-19T09:40:45.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6804 osd.2 since back 2024-09-19T09:39:34.820186+0000 front 2024-09-19T09:39:34.820330+0000 (oldest deadline 2024-09-19T09:40:00.720377+0000) 2024-09-19T09:40:45.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.52:6814 osd.3 since back 2024-09-19T09:39:40.720849+0000 front 2024-09-19T09:39:40.720887+0000 (oldest deadline 2024-09-19T09:40:05.921474+0000) 2024-09-19T09:40:45.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6812 osd.4 since back 2024-09-19T09:39:50.423412+0000 front 2024-09-19T09:39:50.423439+0000 (oldest deadline 2024-09-19T09:40:12.723374+0000) 2024-09-19T09:40:45.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6812 osd.5 since back 2024-09-19T09:39:58.524664+0000 front 2024-09-19T09:39:58.524583+0000 (oldest deadline 2024-09-19T09:40:24.324985+0000) 2024-09-19T09:40:45.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.86:6820 osd.7 since back 2024-09-19T09:40:13.026431+0000 front 2024-09-19T09:40:13.026489+0000 (oldest deadline 2024-09-19T09:40:37.126287+0000) 2024-09-19T09:40:45.694 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:45 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11[60490]: 2024-09-19T09:40:45.196+0000 7f68e466b640 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.169:6820 osd.8 since back 2024-09-19T09:40:22.426881+0000 front 2024-09-19T09:40:22.426917+0000 (oldest deadline 2024-09-19T09:40:44.027284+0000) 2024-09-19T09:40:46.828 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:46 smithi169 podman[71725]: 2024-09-19 09:40:46.55449662 +0000 UTC m=+5.439794213 container died 6d0b738b98f9aa35b1987a7d0da713983783757ed34dde5b72e0eaee2ec99a03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:47.145 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:46 smithi169 podman[71725]: 2024-09-19 09:40:46.900828148 +0000 UTC m=+5.786125741 container cleanup 6d0b738b98f9aa35b1987a7d0da713983783757ed34dde5b72e0eaee2ec99a03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:40:47.145 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:46 smithi169 bash[71725]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:40:47.437 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71741]: 2024-09-19 09:40:47.143701099 +0000 UTC m=+0.590438840 container remove 6d0b738b98f9aa35b1987a7d0da713983783757ed34dde5b72e0eaee2ec99a03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:40:47.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.43605439 +0000 UTC m=+0.095004880 container create 6947ee9f37042c9f124b0243f465925ea564e586b300e458e4b99621de91a02f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:40:47.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.357040964 +0000 UTC m=+0.015991461 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:40:47.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.622136256 +0000 UTC m=+0.281086744 container init 6947ee9f37042c9f124b0243f465925ea564e586b300e458e4b99621de91a02f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:47.693 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.625616551 +0000 UTC m=+0.284567055 container start 6947ee9f37042c9f124b0243f465925ea564e586b300e458e4b99621de91a02f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:40:48.075 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.696882225 +0000 UTC m=+0.355832732 container attach 6947ee9f37042c9f124b0243f465925ea564e586b300e458e4b99621de91a02f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:40:48.076 INFO:journalctl@ceph.osd.11.smithi169.stdout:Sep 19 09:40:47 smithi169 podman[71829]: 2024-09-19 09:40:47.812323692 +0000 UTC m=+0.471274189 container died 6947ee9f37042c9f124b0243f465925ea564e586b300e458e4b99621de91a02f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:40:48.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:40:48.394 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:48.395 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:40:48.395 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:40:48.395 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:40:48.680 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:48 smithi052 systemd[1]: Stopping Ceph mds.a for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:49.040 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:48 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a[69236]: 2024-09-19T09:40:48.738+0000 7f378fbcb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:49.040 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:48 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a[69236]: 2024-09-19T09:40:48.738+0000 7f378fbcb640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:40:50.149 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:49 smithi052 podman[133687]: 2024-09-19 09:40:49.898001657 +0000 UTC m=+1.292339383 container died 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:40:50.750 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:50 smithi052 podman[133687]: 2024-09-19 09:40:50.464276177 +0000 UTC m=+1.858613902 container cleanup 8827f81daa3aa33b5628be0acf8689a3e68671c6d1f4485fea491d9d3c9e2b04 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:40:50.750 INFO:journalctl@ceph.mds.a.smithi052.stdout:Sep 19 09:40:50 smithi052 bash[133687]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:40:50.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:40:50.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:50.956 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:40:50.956 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:40:50.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:40:51.286 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:51 smithi052 systemd[1]: Stopping Ceph mds.d for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:51.681 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d[68051]: 2024-09-19T09:40:51.284+0000 7f1b4cea5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:51.681 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:51 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d[68051]: 2024-09-19T09:40:51.284+0000 7f1b4cea5640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:40:55.681 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:55 smithi052 podman[133819]: 2024-09-19 09:40:55.298073689 +0000 UTC m=+4.120552901 container died f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:40:56.120 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:55 smithi052 podman[133819]: 2024-09-19 09:40:55.851809485 +0000 UTC m=+4.674288739 container cleanup f959c16a4fc49fe54cb397e36f82e95e72c30ed894ab49f504179d9e7a300b81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:40:56.121 INFO:journalctl@ceph.mds.d.smithi052.stdout:Sep 19 09:40:55 smithi052 bash[133819]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:40:56.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:40:56.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:56.328 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:40:56.328 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:40:56.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:40:56.649 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:56 smithi052 systemd[1]: Stopping Ceph mds.g for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:40:56.930 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g[68840]: 2024-09-19T09:40:56.646+0000 7fe414b35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:40:56.931 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:56 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g[68840]: 2024-09-19T09:40:56.646+0000 7fe414b35640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:40:58.857 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:58 smithi052 podman[133941]: 2024-09-19 09:40:58.567156096 +0000 UTC m=+2.020551047 container died 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:40:59.181 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:59 smithi052 podman[133941]: 2024-09-19 09:40:59.022491213 +0000 UTC m=+2.475886164 container cleanup 05d6e8eed157cdf789d4aaca1e242f3439deb205e1269cbac8248f16b67c80e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:40:59.181 INFO:journalctl@ceph.mds.g.smithi052.stdout:Sep 19 09:40:59 smithi052 bash[133941]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:40:59.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:40:59.547 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:40:59.547 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:40:59.547 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:40:59.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:40:59.878 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:40:59 smithi052 systemd[1]: Stopping Ceph mds.j for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:00.180 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:40:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j[67655]: 2024-09-19T09:40:59.876+0000 7f7a909ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:00.181 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:40:59 smithi052 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j[67655]: 2024-09-19T09:40:59.876+0000 7f7a909ec640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:41:04.176 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:41:03 smithi052 podman[134059]: 2024-09-19 09:41:03.891164788 +0000 UTC m=+4.126423030 container died f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:41:04.430 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:41:04 smithi052 podman[134059]: 2024-09-19 09:41:04.343602809 +0000 UTC m=+4.578861038 container cleanup f7feed5b29bdd6092004acdc252cff2ec23586c64815801c170bd817f2f5d13b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:41:04.431 INFO:journalctl@ceph.mds.j.smithi052.stdout:Sep 19 09:41:04 smithi052 bash[134059]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:41:04.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:41:04.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:04.775 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:41:04.775 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:41:04.776 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:41:05.136 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:04 smithi086 systemd[1]: Stopping Ceph mds.b for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:05.509 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: 2024-09-19T09:41:05.134+0000 7f0b4f067640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:05.509 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:05 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b[65321]: 2024-09-19T09:41:05.134+0000 7f0b4f067640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:41:08.952 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:08 smithi086 podman[72162]: 2024-09-19 09:41:08.605932532 +0000 UTC m=+3.642858276 container died 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:09.258 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:09 smithi086 podman[72162]: 2024-09-19 09:41:09.050043434 +0000 UTC m=+4.086969166 container cleanup 858b18a023426374b672e098711db12cbadfe2d6c415da085fe9cfc1f9e6d259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:41:09.258 INFO:journalctl@ceph.mds.b.smithi086.stdout:Sep 19 09:41:09 smithi086 bash[72162]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:41:09.526 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:41:09.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:09.561 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:41:09.561 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:41:09.561 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:41:09.879 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:09 smithi086 systemd[1]: Stopping Ceph mds.e for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:10.258 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: 2024-09-19T09:41:09.878+0000 7f992e510640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:10.258 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:09 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e[64722]: 2024-09-19T09:41:09.878+0000 7f992e510640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:41:13.008 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:12 smithi086 podman[72281]: 2024-09-19 09:41:12.608206267 +0000 UTC m=+2.828604671 container died a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:41:13.322 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:13 smithi086 podman[72281]: 2024-09-19 09:41:13.128566448 +0000 UTC m=+3.348964893 container cleanup a8f5187a287ad2ce078132abe7dfbda1228e0e2b8e37bb888c0db1c170f72588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:41:13.322 INFO:journalctl@ceph.mds.e.smithi086.stdout:Sep 19 09:41:13 smithi086 bash[72281]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:41:13.549 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:41:13.582 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:13.582 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:41:13.582 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:41:13.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:41:13.874 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:13 smithi086 systemd[1]: Stopping Ceph mds.h for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:14.258 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: 2024-09-19T09:41:13.873+0000 7f4af4f65640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:14.258 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:13 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h[65024]: 2024-09-19T09:41:13.873+0000 7f4af4f65640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:41:16.875 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:16 smithi086 podman[72402]: 2024-09-19 09:41:16.603788346 +0000 UTC m=+2.810131019 container died f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:41:17.258 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:16 smithi086 podman[72402]: 2024-09-19 09:41:16.973271584 +0000 UTC m=+3.179614240 container cleanup f219ed2b0b822cbf87a09cd447b825c91932d8e857a611565ca877018ec65b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:17.258 INFO:journalctl@ceph.mds.h.smithi086.stdout:Sep 19 09:41:16 smithi086 bash[72402]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:41:17.394 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:41:17.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:17.427 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:41:17.427 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:41:17.427 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:41:18.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:17 smithi086 systemd[1]: Stopping Ceph mds.k for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:18.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k[64407]: 2024-09-19T09:41:17.743+0000 7f32cfd14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:18.008 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:17 smithi086 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k[64407]: 2024-09-19T09:41:17.743+0000 7f32cfd14640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:41:21.228 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:20 smithi086 podman[72521]: 2024-09-19 09:41:20.869724882 +0000 UTC m=+3.220776897 container died dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:41:21.508 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:21 smithi086 podman[72521]: 2024-09-19 09:41:21.309935528 +0000 UTC m=+3.660987544 container cleanup dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T09:41:21.508 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:21 smithi086 bash[72521]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:41:21.508 INFO:journalctl@ceph.mds.k.smithi086.stdout:Sep 19 09:41:21 smithi086 podman[72533]: 2024-09-19 09:41:21.469077299 +0000 UTC m=+0.601890291 container remove dd9da82d6b205db8f08606144bdb6afe1ed276332857ebb9cdd895709dd86b44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:41:21.681 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:41:21.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:21.713 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:41:21.713 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:41:21.713 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:41:22.001 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:21 smithi169 systemd[1]: Stopping Ceph mds.c for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:22.266 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: 2024-09-19T09:41:21.999+0000 7f77a0e27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:22.266 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:22 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c[65351]: 2024-09-19T09:41:21.999+0000 7f77a0e27640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:41:24.869 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:24 smithi169 podman[71930]: 2024-09-19 09:41:24.599876772 +0000 UTC m=+2.693351402 container died cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:41:25.176 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:24 smithi169 podman[71930]: 2024-09-19 09:41:24.957917575 +0000 UTC m=+3.051392244 container cleanup cb88f9f5171cba9cf47e720db4c16958e9251caff494682b121ee00857541e75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:25.177 INFO:journalctl@ceph.mds.c.smithi169.stdout:Sep 19 09:41:24 smithi169 bash[71930]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:41:25.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:41:25.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:25.358 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:41:25.358 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:41:25.358 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:41:25.693 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:25 smithi169 systemd[1]: Stopping Ceph mds.f for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:25.693 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: 2024-09-19T09:41:25.670+0000 7f9b3c996640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:25.694 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:25 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f[65046]: 2024-09-19T09:41:25.670+0000 7f9b3c996640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:41:28.863 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:28 smithi169 podman[72062]: 2024-09-19 09:41:28.599807427 +0000 UTC m=+3.023870243 container died 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:29.193 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:28 smithi169 podman[72062]: 2024-09-19 09:41:28.953199845 +0000 UTC m=+3.377262658 container cleanup 104c4616ec50b3ea0cc08ab2cf4bd4a37999a580b2127602bd50348def32bb59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T09:41:29.193 INFO:journalctl@ceph.mds.f.smithi169.stdout:Sep 19 09:41:28 smithi169 bash[72062]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:41:29.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:41:29.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:29.370 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:41:29.370 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:41:29.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:41:29.692 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:29 smithi169 systemd[1]: Stopping Ceph mds.i for 044f38fa-7667-11ef-bceb-c7b262605968... 2024-09-19T09:41:29.943 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: 2024-09-19T09:41:29.690+0000 7f786f2a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:41:29.943 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:29 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i[65654]: 2024-09-19T09:41:29.690+0000 7f786f2a1640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:41:32.867 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:32 smithi169 podman[72183]: 2024-09-19 09:41:32.598386369 +0000 UTC m=+3.005899429 container died 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:41:33.192 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:32 smithi169 podman[72183]: 2024-09-19 09:41:32.973856817 +0000 UTC m=+3.381369868 container cleanup 7b958e05ae1cc64ee94e4617c38027b0cbf78a350e8cb65337a7ec59409addd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:41:33.193 INFO:journalctl@ceph.mds.i.smithi169.stdout:Sep 19 09:41:32 smithi169 bash[72183]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:41:33.330 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:41:33.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:33.363 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:41:33.363 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:41:33.364 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:41:33.943 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 19 09:41:33 smithi169 ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-l[64747]: 2024-09-19T09:41:33.684+0000 7f1c0317c640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:41:37.971 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 19 09:41:37 smithi169 podman[72304]: 2024-09-19 09:41:37.700894974 +0000 UTC m=+4.120660564 container died e596c6ed90ee1f9d159e296186d58ab3753b0e966890f2c5d33a20e702b48032 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:41:38.321 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 19 09:41:38 smithi169 podman[72304]: 2024-09-19 09:41:38.068965779 +0000 UTC m=+4.488731369 container cleanup e596c6ed90ee1f9d159e296186d58ab3753b0e966890f2c5d33a20e702b48032 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:41:38.321 INFO:journalctl@ceph.mds.l.smithi169.stdout:Sep 19 09:41:38 smithi169 bash[72304]: ceph-044f38fa-7667-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:41:38.457 DEBUG:teuthology.orchestra.run.smithi169:> sudo pkill -f 'journalctl -f -n 0 -u ceph-044f38fa-7667-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:41:38.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:41:38.489 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:41:38.489 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:41:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:41.281 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:41:41.480 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:43.984 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:41:44.187 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:46.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:41:46.602 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:41:46.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:41:46.662 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:41:46.665 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi052/crash 2024-09-19T09:41:46.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:41:46.707 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:41:46.707 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:41:46.709 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi086/crash 2024-09-19T09:41:46.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:41:46.811 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:41:46.811 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:41:46.814 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi169/crash 2024-09-19T09:41:46.815 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:41:46.859 INFO:teuthology.orchestra.run.smithi169.stderr:tar: /var/lib/ceph/044f38fa-7667-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:41:46.859 INFO:teuthology.orchestra.run.smithi169.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:41:46.860 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:41:46.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:41:46.909 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:41:46.909 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:41:46.912 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:41:46.915 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:41:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-09-19T09:41:46.937 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:41:46.937 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:41:46.938 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:41:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:41:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:41:46.939 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:41:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:41:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.9% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:41:46.941 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:: No such file or directory 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr: 83.3% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:41:46.944 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:41:46.945 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:41:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:41:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.g.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:41:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:41:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:41:46.946 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:41:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:41:46.951 INFO:teuthology.orchestra.run.smithi052.stderr: 94.6% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:41:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:41:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.8% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:41:46.951 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:41:46.953 INFO:teuthology.orchestra.run.smithi086.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:41:46.953 INFO:teuthology.orchestra.run.smithi086.stderr:: No such file or directory 2024-09-19T09:41:46.953 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:41:46.953 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:41:46.953 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log: 83.4% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr: 94.5% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:41:46.954 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:41:46.955 INFO:teuthology.orchestra.run.smithi169.stderr: 87.9% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:41:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:41:46.955 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:41:46.957 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log: /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.y.log: 87.9% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.j.log: 90.9% 94.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi052.stderr: 94.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:41:46.958 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:41:46.959 INFO:teuthology.orchestra.run.smithi086.stderr: 91.0% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:41:46.959 INFO:teuthology.orchestra.run.smithi086.stderr: 93.1% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:41:46.961 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:41:46.961 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:41:46.961 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:41:46.962 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.c.log: 93.3% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:41:46.962 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:41:46.970 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:41:46.976 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:41:46.984 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:41:47.041 INFO:teuthology.orchestra.run.smithi169.stderr: 94.8% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:41:47.049 INFO:teuthology.orchestra.run.smithi086.stderr: 92.6% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:41:47.051 INFO:teuthology.orchestra.run.smithi169.stderr: 94.6% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:41:47.066 INFO:teuthology.orchestra.run.smithi169.stderr: 92.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:41:47.278 INFO:teuthology.orchestra.run.smithi086.stderr: 94.1% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:41:47.302 INFO:teuthology.orchestra.run.smithi052.stderr: 90.2% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:41:47.374 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:41:47.503 INFO:teuthology.orchestra.run.smithi052.stderr: 92.6% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:41:47.573 INFO:teuthology.orchestra.run.smithi086.stderr: 91.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:41:47.586 INFO:teuthology.orchestra.run.smithi169.stderr: 92.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:41:47.748 INFO:teuthology.orchestra.run.smithi169.stderr: 92.5% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:41:47.769 INFO:teuthology.orchestra.run.smithi169.stderr: 92.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:41:47.793 INFO:teuthology.orchestra.run.smithi052.stderr: 92.2% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:41:47.830 INFO:teuthology.orchestra.run.smithi086.stderr: 92.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:41:47.843 INFO:teuthology.orchestra.run.smithi052.stderr: 92.0% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:41:47.852 INFO:teuthology.orchestra.run.smithi052.stderr: 92.3% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:41:47.929 INFO:teuthology.orchestra.run.smithi086.stderr: 92.7% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:41:47.936 INFO:teuthology.orchestra.run.smithi086.stderr: 92.0% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:41:48.040 INFO:teuthology.orchestra.run.smithi169.stderr: 93.1% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:41:48.042 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-09-19T09:41:48.042 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m1.113s 2024-09-19T09:41:48.043 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m4.011s 2024-09-19T09:41:48.043 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.155s 2024-09-19T09:41:48.089 INFO:teuthology.orchestra.run.smithi052.stderr: 90.3% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:41:48.091 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-19T09:41:48.091 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m1.165s 2024-09-19T09:41:48.091 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m4.642s 2024-09-19T09:41:48.091 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.166s 2024-09-19T09:41:48.226 INFO:teuthology.orchestra.run.smithi086.stderr: 93.2% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:41:48.777 INFO:teuthology.orchestra.run.smithi086.stderr: 92.9% -- replaced with /var/log/ceph/044f38fa-7667-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:41:48.779 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-19T09:41:48.779 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m1.849s 2024-09-19T09:41:48.779 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m6.815s 2024-09-19T09:41:48.779 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m0.241s 2024-09-19T09:41:48.780 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:41:48.780 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi052/log 2024-09-19T09:41:48.781 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:41:49.540 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi086/log 2024-09-19T09:41:49.541 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:41:50.474 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi169/log 2024-09-19T09:41:50.475 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:41:51.071 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:41:51.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force 2024-09-19T09:41:51.284 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:51.635 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force 2024-09-19T09:41:51.837 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:52.099 DEBUG:teuthology.orchestra.run.smithi169:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 044f38fa-7667-11ef-bceb-c7b262605968 --force 2024-09-19T09:41:52.301 INFO:teuthology.orchestra.run.smithi169.stdout:Deleting cluster with fsid: 044f38fa-7667-11ef-bceb-c7b262605968 2024-09-19T09:41:52.581 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:41:52.582 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:52.602 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:52.618 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:41:52.634 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:41:52.634 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:41:52.646 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:41:52.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:41:52.649 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:41:52.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:41:52.775 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:41:52.786 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:41:52.786 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:41:52.789 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:41:52.792 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:41:52.804 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:41:52.805 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:41:52.807 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:41:52.809 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:41:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-19T09:41:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +752us[ +734us] +/- 46ms 2024-09-19T09:41:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -1933us[-1933us] +/- 64ms 2024-09-19T09:41:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +1085us[+1085us] +/- 69ms 2024-09-19T09:41:52.810 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:41:52.811 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:41:52.811 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-19T09:41:52.811 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +749us[ +736us] +/- 46ms 2024-09-19T09:41:52.811 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1946us[-1958us] +/- 64ms 2024-09-19T09:41:52.811 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +1072us[+1059us] +/- 69ms 2024-09-19T09:41:52.812 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +694us[ +705us] +/- 46ms 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1982us[-1970us] +/- 64ms 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +1034us[+1045us] +/- 69ms 2024-09-19T09:41:52.813 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:41:52.813 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:41:52.843 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:41:52.844 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:41:52.895 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:41:52.992 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:41:53.060 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:41:53.128 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:41:53.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:53.161 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:41:53.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:53.189 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:41:53.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:53.216 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:41:53.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:41:53.266 INFO:teuthology.task.internal:Duration was 2230.208858 seconds 2024-09-19T09:41:53.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:41:53.327 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:41:53.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:41:53.329 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:41:53.332 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:41:53.368 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:41:53.370 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:41:53.370 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:41:53.799 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:41:53.799 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-19T09:41:53.799 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:41:53.822 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-19T09:41:53.822 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:41:53.864 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-09-19T09:41:53.864 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:41:53.890 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:41:53.890 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:41:53.893 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:41:53.907 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:41:53.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:41:53.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:41:53.961 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:41:53.973 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:41:55.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:41:55.926 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:41:55.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:41:55.952 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:41:55.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:41:56.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:41:56.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.028 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.030 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.050 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-19T09:41:56.055 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-19T09:41:56.081 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-09-19T09:41:56.290 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:56.306 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:56.348 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:41:56.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:41:56.365 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:41:56.377 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:41:56.378 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi052 2024-09-19T09:41:56.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:41:56.463 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi086 2024-09-19T09:41:56.464 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:41:56.506 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911895/remote/smithi169 2024-09-19T09:41:56.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:41:56.547 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:41:56.547 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:41:56.549 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:41:56.552 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:41:56.599 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:41:56.614 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:41:56.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:41:56.624 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:41:56.625 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:41:56.628 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:41:56.631 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:41:56.641 INFO:teuthology.orchestra.run.smithi052.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:41 /home/ubuntu/cephtest 2024-09-19T09:41:56.646 INFO:teuthology.orchestra.run.smithi086.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:41 /home/ubuntu/cephtest 2024-09-19T09:41:56.657 INFO:teuthology.orchestra.run.smithi169.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:41 /home/ubuntu/cephtest 2024-09-19T09:41:56.658 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:41:56.669 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:41:56.713 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/test_o_trunc}} duration: 2230.208858013153 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:41:56.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:41:56.800 INFO:teuthology.run:pass